vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #309
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13worker1: QEMU running (pid 51)14worker1 # Formatting '/build/vm-state-worker1/tmp.PdmInIcUEZ', fmt=raw size=107374182415lb: QEMU running (pid 50)16worker1 # mke2fs 1.47.4 (6-Mar-2025)17lb # Disk image does not exist, creating the virtualisation disk image...18worker1 # Discarding device blocks: 0/262144 done19worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes20worker1 # Filesystem UUID: b7e6f070-525c-4cc8-bf72-d4152b9db0a421lb # Formatting '/build/vm-state-lb/tmp.Hi6Q5eoN4E', fmt=raw size=107374182422worker1 # Superblock backups stored on blocks:23worker1 # 32768, 98304, 163840, 22937624lb # mke2fs 1.47.4 (6-Mar-2025)25worker1 # 26lb # Discarding device blocks: 0/262144 done27lb # Creating filesystem with 262144 4k blocks and 65536 inodes28worker1 # Allocating group tables: 0/8 done29worker1 # Writing inode tables: 0/8 done30worker1 # Creating journal (8192 blocks): done31worker2 # Disk image does not exist, creating the virtualisation disk image...32worker2 # Formatting '/build/vm-state-worker2/tmp.z2TbGT1b2k', fmt=raw size=107374182433worker2 # mke2fs 1.47.4 (6-Mar-2025)34worker2 # Discarding device blocks: 0/262144 done35worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes36worker2 # Filesystem UUID: df3c2ef2-03fe-410f-b293-5211d898b33937worker2 # Superblock backups stored on blocks:38worker2 # 32768, 98304, 163840, 22937639worker2 # 40worker2 # Allocating group tables: 0/8 done41worker2 # Writing inode tables: 0/8 done42worker2 # Creating journal (8192 blocks): done43worker2 # Writing superblocks and filesystem accounting information: 0/8 done44worker2 # 45worker2 # Virtualisation disk image created.46worker2: QEMU running (pid 52)47lb # Filesystem UUID: 726ef101-fbce-4685-8eaa-7a481dbde06248worker1 # Writing superblocks and filesystem accounting information: 0/8 done49lb # Superblock backups stored on blocks:50worker1 # 51lb # 32768, 98304, 163840, 22937652worker1 # Virtualisation disk image created.53lb # 54lb # Allocating group tables: 0/8 done55lb # Writing inode tables: 0/8 done56lb # Creating journal (8192 blocks): done57lb # Writing superblocks and filesystem accounting information: 0/8 done58lb # 59lb # Virtualisation disk image created.60client: QEMU running (pid 49)61client # Disk image does not exist, creating the virtualisation disk image...62client # Formatting '/build/vm-state-client/tmp.NCDDOOxY1F', fmt=raw size=107374182463client # mke2fs 1.47.4 (6-Mar-2025)64client # Discarding device blocks: 0/262144 done65(finished: start all VMs, in 0.58 seconds)66client # Creating filesystem with 262144 4k blocks and 65536 inodes67client: waiting for unit network-addresses-eth1.service68client # Filesystem UUID: e9d46106-4183-48af-bee6-ef81301ba8f269client: waiting for the VM to finish booting70client # Superblock backups stored on blocks:71client # 32768, 98304, 163840, 22937672client # 73client # Allocating group tables: 0/8 done74client # Writing inode tables: 0/8 done75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681lb # [ 0.000000] KASLR enabled82lb # [ 0.000000] random: crng init done83lb # [ 0.000000] Machine model: linux,dummy-virt84lb # [ 0.000000] efi: UEFI not found.85lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88lb # [ 0.000000] Zone ranges:89lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90lb # [ 0.000000] DMA32 empty91lb # [ 0.000000] Normal empty92lb # [ 0.000000] Device empty93lb # [ 0.000000] Movable zone start for each node94lb # [ 0.000000] Early memory node ranges95lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098lb # [ 0.000000] psci: probing for conduit method from DT.99lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.100lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101lb # [ 0.000000] psci: Trusted OS migration not required102lb # [ 0.000000] psci: SMC Calling Convention v1.1103lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105lb # [ 0.000000] Detected PIPT I-cache on CPU0106lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107lb # [ 0.000000] CPU features: detected: GICv3 CPU interface108lb # [ 0.000000] CPU features: detected: Spectre-v4109lb # [ 0.000000] CPU features: detected: Spectre-BHB110lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112lb # [ 0.000000] alternatives: applying boot alternatives113lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty0114lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space.115lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119lb # [ 0.000000] software IO TLB: area num 1.120lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122lb # [ 0.000000] Fallback order for Node 0: 0123lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124lb # [ 0.000000] Policy zone: DMA125lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127lb # [ 0.000000] allocated 3145728 bytes of page_ext128lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups130lb # [ 0.000000] rcu: Hierarchical RCU implementation.131lb # [ 0.000000] rcu: RCU event tracing is enabled.132lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.134lb # [ 0.000000] Rude variant of Tasks RCU enabled.135lb # [ 0.000000] Tracing variant of Tasks RCU enabled.136lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.139lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0142lb # [ 0.000000] GICv3: 256 SPIs implemented143lb # [ 0.000000] GICv3: 0 Extended SPIs implemented144lb # [ 0.000000] Root IRQ handler: gic_handle_irq145lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI146lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0147lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000148lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]149lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)150lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)151lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000152lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000153lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.154lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns155lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).156lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns157lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns158lb # [ 0.000044] arm-pv: using stolen time PV159lb # [ 0.000957] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)160lb # [ 0.001163] Console: colour dummy device 80x25161lb # [ 0.001172] printk: legacy console [tty0] enabled162lb # [ 0.001372] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)163worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]164lb # [ 0.001379] pid_max: default: 32768 minimum: 301165lb # [ 0.001455] LSM: initializing lsm=capability,landlock,yama,bpf,ima166lb # [ 0.001702] landlock: Up and running.167worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026168lb # [ 0.001706] Yama: becoming mindful.169worker1 # [ 0.000000] KASLR enabled170lb # [ 0.002602] LSM support for eBPF active171worker1 # [ 0.000000] random: crng init done172worker1 # [ 0.000000] Machine model: linux,dummy-virt173lb # [ 0.002795] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)174worker1 # [ 0.000000] efi: UEFI not found.175worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT176lb # [ 0.002865] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)177worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]178worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]179lb # [ 0.004230] cacheinfo: Unable to detect cache hierarchy for CPU 0180worker1 # [ 0.000000] Zone ranges:181lb # [ 0.005066] rcu: Hierarchical SRCU implementation.182worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]183lb # [ 0.005071] rcu: Max phase no-delay instances is 1000.184worker1 # [ 0.000000] DMA32 empty185worker1 # [ 0.000000] Normal empty186lb # [ 0.006317] fsl-mc MSI: its@8080000 domain created187worker1 # [ 0.000000] Device empty188lb # [ 0.006421] EFI services will not be available.189worker1 # [ 0.000000] Movable zone start for each node190lb # [ 0.006522] smp: Bringing up secondary CPUs ...191worker1 # [ 0.000000] Early memory node ranges192lb # [ 0.006532] smp: Brought up 1 node, 1 CPU193worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]194lb # [ 0.006535] SMP: Total of 1 processors activated.195lb # [ 0.006541] CPU: All CPU(s) started at EL1196worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]197lb # [ 0.006554] CPU features: detected: Branch Target Identification198worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000199lb # [ 0.006559] CPU features: detected: ARMv8.4 Translation Table Level200worker1 # [ 0.000000] psci: probing for conduit method from DT.201worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.202lb # [ 0.006562] CPU features: detected: Instruction cache invalidation not required for I/D coherence203worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs204worker1 # [ 0.000000] psci: Trusted OS migration not required205lb # [ 0.006566] CPU features: detected: Data cache clean to the PoU not required for I/D coherence206worker1 # [ 0.000000] psci: SMC Calling Convention v1.1207lb # [ 0.006569] CPU features: detected: Common not Private translations208worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)209lb # [ 0.006572] CPU features: detected: CRC32 instructions210worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296211lb # [ 0.006576] CPU features: detected: Data cache clean to Point of Deep Persistence212worker1 # [ 0.000000] Detected PIPT I-cache on CPU0213lb # [ 0.006579] CPU features: detected: Data cache clean to Point of Persistence214worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)215lb # [ 0.006583] CPU features: detected: Data independent timing control (DIT)216worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface217lb # [ 0.006586] CPU features: detected: E0PD218worker1 # [ 0.000000] CPU features: detected: Spectre-v4219lb # [ 0.006589] CPU features: detected: Enhanced Counter Virtualization220worker1 # [ 0.000000] CPU features: detected: Spectre-BHB221lb # [ 0.006592] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)222worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38223lb # [ 0.006595] CPU features: detected: Enhanced Virtualization Traps224worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23225lb # [ 0.006598] CPU features: detected: Fine Grained Traps226worker1 # [ 0.000000] alternatives: applying boot alternatives227lb # [ 0.006602] CPU features: detected: Generic authentication (architected QARMA5 algorithm)228lb # [ 0.006608] CPU features: detected: RCpc load-acquire (LDAPR)229lb # [ 0.006611] CPU features: detected: LSE atomic instructions230lb # [ 0.006614] CPU features: detected: Privileged Access Never231lb # [ 0.006617] CPU features: detected: PMUv3232worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j2qxr8a7hldbnz3bjlwmjzfspljjn6ns-nixos-system-worker1-test/init regInfo=/nix/store/nc11w7iwxydiadrk3dadfy3f4symzsjq-closure-info/registration console=ttyAMA0,115200n8 console=tty0233lb # [ 0.006619] CPU features: detected: RAS Extension Support234lb # [ 0.006622] CPU features: detected: RASv1p1 Extension Support235worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/nc11w7iwxydiadrk3dadfy3f4symzsjq-closure-info/registration", will be passed to user space.236lb # [ 0.006625] CPU features: detected: Random Number Generator237lb # [ 0.006628] CPU features: detected: Speculation barrier (SB)238worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes239lb # [ 0.006631] CPU features: detected: Stage-2 Force Write-Back240worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)241lb # [ 0.006634] CPU features: detected: TLB range maintenance instructions242worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)243lb # [ 0.006639] CPU features: detected: Speculative Store Bypassing Safe (SSBS)244worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB245lb # [ 0.006691] alternatives: applying system-wide alternatives246worker1 # [ 0.000000] software IO TLB: area num 1.247lb # [ 0.009987] CPU features: detected: BBM Level 2 without TLB conflict abort248worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB249worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)250lb # [ 0.010232] Memory: 1406532K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)251worker1 # [ 0.000000] Fallback order for Node 0: 0252lb # [ 0.010714] devtmpfs: initialized253worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216254worker1 # [ 0.000000] Policy zone: DMA255lb # [ 0.012736] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)256worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off257lb # [ 0.012761] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).258worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1259lb # [ 0.012985] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL260worker1 # [ 0.000000] allocated 3145728 bytes of page_ext261lb # [ 0.012989] 0 pages in range for non-PLT usage262worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages263lb # [ 0.012990] 508288 pages in range for PLT usage264worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups265lb # [ 0.013127] pinctrl core: initialized pinctrl subsystem266lb # [ 0.014072] DMI not present or invalid.267worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.268worker1 # [ 0.000000] rcu: RCU event tracing is enabled.269lb # [ 0.018374] NET: Registered PF_NETLINK/PF_ROUTE protocol family270worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.271lb # [ 0.020860] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations272worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.273lb # [ 0.021064] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations274worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.275worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.276lb # [ 0.021296] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations277lb # [ 0.021327] audit: initializing netlink subsys (disabled)278worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.279lb # [ 0.022036] thermal_sys: Registered thermal governor 'fair_share'280worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1281lb # [ 0.022039] thermal_sys: Registered thermal governor 'bang_bang'282worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.283lb # [ 0.022043] thermal_sys: Registered thermal governor 'step_wise'284lb # [ 0.022069] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1285worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.286lb # [ 0.022081] thermal_sys: Registered thermal governor 'user_space'287worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.288lb # [ 0.022082] thermal_sys: Registered thermal governor 'power_allocator'289worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0290lb # [ 0.022109] cpuidle: using governor ladder291worker1 # [ 0.000000] GICv3: 256 SPIs implemented292lb # [ 0.022117] cpuidle: using governor menu293worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented294lb # [ 0.022330] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.295worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq296worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI297lb # [ 0.022349] ASID allocator initialised with 65536 entries298lb # [ 0.023740] Serial: AMBA PL011 UART driver299worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0300worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000301lb # [ 0.029456] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1302worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]303lb # [ 0.029617] printk: console [ttyAMA0] enabled304worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)305worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)306worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000307worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000308worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.309worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns310worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).311worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns312worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns313lb # [ 0.157321] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages314worker1 # [ 0.000043] arm-pv: using stolen time PV315lb # [ 0.157346] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page316worker1 # [ 0.000623] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)317lb # [ 0.157352] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages318worker1 # [ 0.000836] Console: colour dummy device 80x25319lb # [ 0.157356] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page320worker1 # [ 0.000845] printk: legacy console [tty0] enabled321lb # [ 0.157360] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages322worker1 # [ 0.001076] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)323lb # [ 0.157365] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page324worker1 # [ 0.001083] pid_max: default: 32768 minimum: 301325lb # [ 0.157369] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages326worker1 # [ 0.001185] LSM: initializing lsm=capability,landlock,yama,bpf,ima327lb # [ 0.157373] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page328worker1 # [ 0.001417] landlock: Up and running.329worker1 # [ 0.001420] Yama: becoming mindful.330worker1 # [ 0.002227] LSM support for eBPF active331worker1 # [ 0.002404] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)332lb # [ 0.165516] fbcon: Taking over console333lb # [ 0.165542] ACPI: Interpreter disabled.334worker1 # [ 0.002440] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)335worker1 # [ 0.003671] cacheinfo: Unable to detect cache hierarchy for CPU 0336client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]337worker1 # [ 0.004516] rcu: Hierarchical SRCU implementation.338worker1 # [ 0.004521] rcu: Max phase no-delay instances is 1000.339worker1 # [ 0.005806] fsl-mc MSI: its@8080000 domain created340client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026341worker1 # [ 0.005905] EFI services will not be available.342client # [ 0.000000] KASLR enabled343client # [ 0.000000] random: crng init done344worker1 # [ 0.005978] smp: Bringing up secondary CPUs ...345client # [ 0.000000] Machine model: linux,dummy-virt346worker1 # [ 0.005988] smp: Brought up 1 node, 1 CPU347client # [ 0.000000] efi: UEFI not found.348worker1 # [ 0.005991] SMP: Total of 1 processors activated.349worker1 # [ 0.005997] CPU: All CPU(s) started at EL1350client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT351worker1 # [ 0.006010] CPU features: detected: Branch Target Identification352client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]353worker1 # [ 0.006015] CPU features: detected: ARMv8.4 Translation Table Level354client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]355client # [ 0.000000] Zone ranges:356lb # [ 0.173810] iommu: Default domain type: Translated357worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]358worker1 # [ 0.006019] CPU features: detected: Instruction cache invalidation not required for I/D coherence359client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]360lb # [ 0.173827] iommu: DMA domain TLB invalidation policy: strict mode361client # [ 0.000000] DMA32 empty362client # [ 0.000000] Normal empty363worker1 # [ 0.006022] CPU features: detected: Data cache clean to the PoU not required for I/D coherence364client # [ 0.000000] Device empty365lb # [ 0.175531] SCSI subsystem initialized366worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026367client # [ 0.000000] Movable zone start for each node368worker1 # [ 0.006026] CPU features: detected: Common not Private translations369worker2 # [ 0.000000] KASLR enabled370client # [ 0.000000] Early memory node ranges371worker1 # [ 0.006029] CPU features: detected: CRC32 instructions372worker2 # [ 0.000000] random: crng init done373lb # [ 0.176252] usbcore: registered new interface driver usbfs374worker2 # [ 0.000000] Machine model: linux,dummy-virt375client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]376worker2 # [ 0.000000] efi: UEFI not found.377lb # [ 0.176290] usbcore: registered new interface driver hub378worker1 # [ 0.006032] CPU features: detected: Data cache clean to Point of Deep Persistence379client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]380lb # [ 0.176310] usbcore: registered new device driver usb381worker1 # [ 0.006036] CPU features: detected: Data cache clean to Point of Persistence382worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT383client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000384lb # [ 0.176641] pps_core: LinuxPPS API ver. 1 registered385worker1 # [ 0.006039] CPU features: detected: Data independent timing control (DIT)386worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]387client # [ 0.000000] psci: probing for conduit method from DT.388worker1 # [ 0.006042] CPU features: detected: E0PD389client # [ 0.000000] psci: PSCIv1.3 detected in firmware.390lb # [ 0.176647] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>391worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]392worker2 # [ 0.000000] Zone ranges:393lb # [ 0.176659] PTP clock support registered394client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs395worker1 # [ 0.006045] CPU features: detected: Enhanced Counter Virtualization396lb # [ 0.176715] EDAC MC: Ver: 3.0.0397client # [ 0.000000] psci: Trusted OS migration not required398worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]399worker1 # [ 0.006048] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)400worker2 # [ 0.000000] DMA32 empty401client # [ 0.000000] psci: SMC Calling Convention v1.1402lb # [ 0.181269] scmi_core: SCMI protocol bus registered403worker2 # [ 0.000000] Normal empty404worker1 # [ 0.006051] CPU features: detected: Enhanced Virtualization Traps405worker2 # [ 0.000000] Device empty406worker2 # [ 0.000000] Movable zone start for each node407client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)408worker1 # [ 0.006054] CPU features: detected: Fine Grained Traps409worker2 # [ 0.000000] Early memory node ranges410lb # [ 0.182291] FPGA manager framework411lb # [ 0.183349] vgaarb: loaded412client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296413worker1 # [ 0.006058] CPU features: detected: Generic authentication (architected QARMA5 algorithm)414worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]415client # [ 0.000000] Detected PIPT I-cache on CPU0416worker1 # [ 0.006064] CPU features: detected: RCpc load-acquire (LDAPR)417lb # [ 0.184008] clocksource: Switched to clocksource arch_sys_counter418worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]419client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)420worker1 # [ 0.006067] CPU features: detected: LSE atomic instructions421worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000422client # [ 0.000000] CPU features: detected: GICv3 CPU interface423worker1 # [ 0.006070] CPU features: detected: Privileged Access Never424worker2 # [ 0.000000] psci: probing for conduit method from DT.425client # [ 0.000000] CPU features: detected: Spectre-v4426worker1 # [ 0.006073] CPU features: detected: PMUv3427worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.428client # [ 0.000000] CPU features: detected: Spectre-BHB429worker1 # [ 0.006076] CPU features: detected: RAS Extension Support430worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs431client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38432worker1 # [ 0.006078] CPU features: detected: RASv1p1 Extension Support433worker2 # [ 0.000000] psci: Trusted OS migration not required434lb # [ 0.187412] VFS: Disk quotas dquot_6.6.0435client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23436worker1 # [ 0.006081] CPU features: detected: Random Number Generator437worker2 # [ 0.000000] psci: SMC Calling Convention v1.1438lb # [ 0.187453] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)439client # [ 0.000000] alternatives: applying boot alternatives440worker1 # [ 0.006084] CPU features: detected: Speculation barrier (SB)441worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)442worker1 # [ 0.006087] CPU features: detected: Stage-2 Force Write-Back443worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296444worker1 # [ 0.006091] CPU features: detected: TLB range maintenance instructions445worker2 # [ 0.000000] Detected PIPT I-cache on CPU0446worker1 # [ 0.006096] CPU features: detected: Speculative Store Bypassing Safe (SSBS)447worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)448lb # [ 0.191342] netfs: FS-Cache loaded449worker1 # [ 0.006140] alternatives: applying system-wide alternatives450worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface451lb # [ 0.191495] pnp: PnP ACPI: disabled452client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qbvmimlqs6jxl6sssayj2w8bdy8wgcr3-nixos-system-client-test/init regInfo=/nix/store/88pg9amnaasba3553f3hivpphviqafkd-closure-info/registration console=ttyAMA0,115200n8 console=tty0453worker1 # [ 0.009512] CPU features: detected: BBM Level 2 without TLB conflict abort454worker2 # [ 0.000000] CPU features: detected: Spectre-v4455worker2 # [ 0.000000] CPU features: detected: Spectre-BHB456worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38457client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/88pg9amnaasba3553f3hivpphviqafkd-closure-info/registration", will be passed to user space.458worker1 # [ 0.009772] Memory: 1406548K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)459worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23460client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes461worker2 # [ 0.000000] alternatives: applying boot alternatives462worker1 # [ 0.010210] devtmpfs: initialized463client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)464lb # [ 0.195582] NET: Registered PF_INET protocol family465worker1 # [ 0.012254] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)466client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)467lb # [ 0.195895] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)468client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB469worker1 # [ 0.012280] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).470client # [ 0.000000] software IO TLB: area num 1.471worker1 # [ 0.012503] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL472client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB473worker1 # [ 0.012508] 0 pages in range for non-PLT usage474worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/7digbfsc20vzcirhn315hf59vz6m69an-nixos-system-worker2-test/init regInfo=/nix/store/ci22qypsjfi6jx2zysskbscsmljc0ir5-closure-info/registration console=ttyAMA0,115200n8 console=tty0475worker1 # [ 0.012509] 508288 pages in range for PLT usage476client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)477worker1 # [ 0.012646] pinctrl core: initialized pinctrl subsystem478client # [ 0.000000] Fallback order for Node 0: 0479worker1 # [ 0.013481] DMI not present or invalid.480worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ci22qypsjfi6jx2zysskbscsmljc0ir5-closure-info/registration", will be passed to user space.481client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216482client # [ 0.000000] Policy zone: DMA483worker1 # [ 0.017330] NET: Registered PF_NETLINK/PF_ROUTE protocol family484worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes485client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off486worker1 # [ 0.020118] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations487worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)488client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1489worker1 # [ 0.020386] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations490client # [ 0.000000] allocated 3145728 bytes of page_ext491worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)492worker1 # [ 0.020611] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations493client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages494worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB495client # [ 0.000000] ftrace: allocated 294 pages with 4 groups496worker1 # [ 0.020651] audit: initializing netlink subsys (disabled)497worker2 # [ 0.000000] software IO TLB: area num 1.498client # [ 0.000000] rcu: Hierarchical RCU implementation.499worker1 # [ 0.021275] thermal_sys: Registered thermal governor 'fair_share'500worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB501client # [ 0.000000] rcu: RCU event tracing is enabled.502worker1 # [ 0.021278] thermal_sys: Registered thermal governor 'bang_bang'503client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.504worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)505worker1 # [ 0.021282] thermal_sys: Registered thermal governor 'step_wise'506worker2 # [ 0.000000] Fallback order for Node 0: 0507client # [ 0.000000] Trampoline variant of Tasks RCU enabled.508worker1 # [ 0.021287] thermal_sys: Registered thermal governor 'user_space'509client # [ 0.000000] Rude variant of Tasks RCU enabled.510worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216511worker2 # [ 0.000000] Policy zone: DMA512client # [ 0.000000] Tracing variant of Tasks RCU enabled.513worker1 # [ 0.021290] thermal_sys: Registered thermal governor 'power_allocator'514worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off515client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.516worker1 # [ 0.021326] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1517worker1 # [ 0.021337] cpuidle: using governor ladder518worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1519client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1520worker1 # [ 0.021342] cpuidle: using governor menu521worker2 # [ 0.000000] allocated 3145728 bytes of page_ext522worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages523worker1 # [ 0.021564] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.524client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.525worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups526worker1 # [ 0.021604] ASID allocator initialised with 65536 entries527client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.528worker1 # [ 0.022919] Serial: AMBA PL011 UART driver529worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.530worker2 # [ 0.000000] rcu: RCU event tracing is enabled.531client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.532worker1 # [ 0.028473] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1533worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.534worker1 # [ 0.028658] printk: console [ttyAMA0] enabled535client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0536worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.537client # [ 0.000000] GICv3: 256 SPIs implemented538worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.539client # [ 0.000000] GICv3: 0 Extended SPIs implemented540worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.541client # [ 0.000000] Root IRQ handler: gic_handle_irq542client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI543worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.544client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0545worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1546client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000547client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]548worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.549client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)550worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.551client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)552worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.553client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000554worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0555worker2 # [ 0.000000] GICv3: 256 SPIs implemented556client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000557worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented558worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq559client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.560worker1 # [ 0.154748] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages561worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI562worker1 # [ 0.154772] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page563worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0564client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns565worker1 # [ 0.154778] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages566worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000567client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).568worker1 # [ 0.154782] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page569worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]570worker1 # [ 0.154787] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages571client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns572worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)573worker1 # [ 0.154791] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page574client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns575client # [ 0.000032] arm-pv: using stolen time PV576worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)577worker1 # [ 0.154796] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages578worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000579worker1 # [ 0.154800] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page580client # [ 0.000418] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)581worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000582lb # [ 0.227521] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)583client # [ 0.000572] Console: colour dummy device 80x25584client # [ 0.000581] printk: legacy console [tty0] enabled585worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.586lb # [ 0.227586] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)587worker1 # [ 0.162382] fbcon: Taking over console588client # [ 0.000785] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)589lb # [ 0.227623] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)590worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns591worker1 # [ 0.162402] ACPI: Interpreter disabled.592client # [ 0.000792] pid_max: default: 32768 minimum: 301593worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).594lb # [ 0.227713] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)595client # [ 0.000867] LSM: initializing lsm=capability,landlock,yama,bpf,ima596client # [ 0.001010] landlock: Up and running.597lb # [ 0.227857] TCP: Hash tables configured (established 16384 bind 16384)598worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns599client # [ 0.001012] Yama: becoming mindful.600lb # [ 0.227955] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)601client # [ 0.001484] LSM support for eBPF active602worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns603lb # [ 0.227995] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)604client # [ 0.001630] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)605worker2 # [ 0.000033] arm-pv: using stolen time PV606client # [ 0.001671] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)607worker2 # [ 0.000451] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)608client # [ 0.002952] cacheinfo: Unable to detect cache hierarchy for CPU 0609worker2 # [ 0.000654] Console: colour dummy device 80x25610client # [ 0.003749] rcu: Hierarchical SRCU implementation.611worker2 # [ 0.000663] printk: legacy console [tty0] enabled612client # [ 0.003754] rcu: Max phase no-delay instances is 1000.613client # [ 0.005014] fsl-mc MSI: its@8080000 domain created614worker2 # [ 0.000891] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)615client # [ 0.005111] EFI services will not be available.616worker2 # [ 0.000898] pid_max: default: 32768 minimum: 301617client # [ 0.005193] smp: Bringing up secondary CPUs ...618worker1 # [ 0.170991] iommu: Default domain type: Translated619client # [ 0.005202] smp: Brought up 1 node, 1 CPU620worker2 # [ 0.000973] LSM: initializing lsm=capability,landlock,yama,bpf,ima621worker1 # [ 0.171005] iommu: DMA domain TLB invalidation policy: strict mode622client # [ 0.005206] SMP: Total of 1 processors activated.623worker2 # [ 0.001110] landlock: Up and running.624worker1 # [ 0.171429] SCSI subsystem initialized625worker2 # [ 0.001113] Yama: becoming mindful.626client # [ 0.005211] CPU: All CPU(s) started at EL1627worker2 # [ 0.001593] LSM support for eBPF active628lb # [ 0.234418] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)629client # [ 0.005224] CPU features: detected: Branch Target Identification630lb # [ 0.234528] NET: Registered PF_UNIX/PF_LOCAL protocol family631worker2 # [ 0.001753] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)632worker1 # [ 0.173513] usbcore: registered new interface driver usbfs633client # [ 0.005229] CPU features: detected: ARMv8.4 Translation Table Level634lb # [ 0.234555] NET: Registered PF_XDP protocol family635worker1 # [ 0.173548] usbcore: registered new interface driver hub636lb # [ 0.234576] PCI: CLS 0 bytes, default 64637worker2 # [ 0.001797] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)638client # [ 0.005232] CPU features: detected: Instruction cache invalidation not required for I/D coherence639worker1 # [ 0.173566] usbcore: registered new device driver usb640lb # [ 0.234878] Trying to unpack rootfs image as initramfs...641worker2 # [ 0.003039] cacheinfo: Unable to detect cache hierarchy for CPU 0642worker1 # [ 0.173876] pps_core: LinuxPPS API ver. 1 registered643client # [ 0.005236] CPU features: detected: Data cache clean to the PoU not required for I/D coherence644worker2 # [ 0.003876] rcu: Hierarchical SRCU implementation.645worker2 # [ 0.003882] rcu: Max phase no-delay instances is 1000.646lb # [ 0.243299] kvm [1]: HYP mode not available647client # [ 0.005240] CPU features: detected: Common not Private translations648worker1 # [ 0.173883] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>649worker2 # [ 0.005226] fsl-mc MSI: its@8080000 domain created650client # [ 0.005243] CPU features: detected: CRC32 instructions651worker1 # [ 0.173893] PTP clock support registered652worker2 # [ 0.005322] EFI services will not be available.653worker1 # [ 0.173956] EDAC MC: Ver: 3.0.0654client # [ 0.005246] CPU features: detected: Data cache clean to Point of Deep Persistence655worker2 # [ 0.005405] smp: Bringing up secondary CPUs ...656worker1 # [ 0.178548] scmi_core: SCMI protocol bus registered657worker2 # [ 0.005416] smp: Brought up 1 node, 1 CPU658client # [ 0.005250] CPU features: detected: Data cache clean to Point of Persistence659worker2 # [ 0.005419] SMP: Total of 1 processors activated.660worker1 # [ 0.179549] FPGA manager framework661client # [ 0.005253] CPU features: detected: Data independent timing control (DIT)662worker2 # [ 0.005426] CPU: All CPU(s) started at EL1663worker1 # [ 0.180579] vgaarb: loaded664client # [ 0.005256] CPU features: detected: E0PD665worker2 # [ 0.005438] CPU features: detected: Branch Target Identification666client # [ 0.005259] CPU features: detected: Enhanced Counter Virtualization667worker1 # [ 0.181301] clocksource: Switched to clocksource arch_sys_counter668worker2 # [ 0.005444] CPU features: detected: ARMv8.4 Translation Table Level669client # [ 0.005262] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)670worker2 # [ 0.005447] CPU features: detected: Instruction cache invalidation not required for I/D coherence671client # [ 0.005265] CPU features: detected: Enhanced Virtualization Traps672client # [ 0.005268] CPU features: detected: Fine Grained Traps673worker2 # [ 0.005451] CPU features: detected: Data cache clean to the PoU not required for I/D coherence674client # [ 0.005272] CPU features: detected: Generic authentication (architected QARMA5 algorithm)675worker2 # [ 0.005454] CPU features: detected: Common not Private translations676client # [ 0.005278] CPU features: detected: RCpc load-acquire (LDAPR)677worker2 # [ 0.005457] CPU features: detected: CRC32 instructions678client # [ 0.005281] CPU features: detected: LSE atomic instructions679worker2 # [ 0.005460] CPU features: detected: Data cache clean to Point of Deep Persistence680client # [ 0.005284] CPU features: detected: Privileged Access Never681worker1 # [ 0.186484] VFS: Disk quotas dquot_6.6.0682worker2 # [ 0.005464] CPU features: detected: Data cache clean to Point of Persistence683client # [ 0.005286] CPU features: detected: PMUv3684worker1 # [ 0.186534] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)685client # [ 0.005289] CPU features: detected: RAS Extension Support686worker2 # [ 0.005467] CPU features: detected: Data independent timing control (DIT)687worker2 # [ 0.005470] CPU features: detected: E0PD688client # [ 0.005292] CPU features: detected: RASv1p1 Extension Support689worker1 # [ 0.188274] netfs: FS-Cache loaded690worker1 # [ 0.188423] pnp: PnP ACPI: disabled691client # [ 0.005294] CPU features: detected: Random Number Generator692worker2 # [ 0.005473] CPU features: detected: Enhanced Counter Virtualization693client # [ 0.005297] CPU features: detected: Speculation barrier (SB)694worker2 # [ 0.005476] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)695client # [ 0.005300] CPU features: detected: Stage-2 Force Write-Back696worker2 # [ 0.005479] CPU features: detected: Enhanced Virtualization Traps697client # [ 0.005303] CPU features: detected: TLB range maintenance instructions698worker2 # [ 0.005482] CPU features: detected: Fine Grained Traps699client # [ 0.005307] CPU features: detected: Speculative Store Bypassing Safe (SSBS)700worker2 # [ 0.005485] CPU features: detected: Generic authentication (architected QARMA5 algorithm)701client # [ 0.005346] alternatives: applying system-wide alternatives702worker2 # [ 0.005490] CPU features: detected: RCpc load-acquire (LDAPR)703worker1 # [ 0.192580] NET: Registered PF_INET protocol family704client # [ 0.008679] CPU features: detected: BBM Level 2 without TLB conflict abort705worker1 # [ 0.192877] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)706worker2 # [ 0.005494] CPU features: detected: LSE atomic instructions707client # [ 0.008917] Memory: 1406564K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)708worker2 # [ 0.005497] CPU features: detected: Privileged Access Never709client # [ 0.009387] devtmpfs: initialized710worker2 # [ 0.005499] CPU features: detected: PMUv3711client # [ 0.011379] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)712worker2 # [ 0.005502] CPU features: detected: RAS Extension Support713worker2 # [ 0.005505] CPU features: detected: RASv1p1 Extension Support714client # [ 0.011406] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).715worker2 # [ 0.005508] CPU features: detected: Random Number Generator716client # [ 0.011600] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL717client # [ 0.011605] 0 pages in range for non-PLT usage718client # [ 0.011606] 508288 pages in range for PLT usage719worker2 # [ 0.005510] CPU features: detected: Speculation barrier (SB)720worker2 # [ 0.005514] CPU features: detected: Stage-2 Force Write-Back721worker2 # [ 0.005516] CPU features: detected: TLB range maintenance instructions722client # [ 0.011716] pinctrl core: initialized pinctrl subsystem723client # [ 0.012571] DMI not present or invalid.724worker2 # [ 0.005521] CPU features: detected: Speculative Store Bypassing Safe (SSBS)725client # [ 0.016077] NET: Registered PF_NETLINK/PF_ROUTE protocol family726worker2 # [ 0.005565] alternatives: applying system-wide alternatives727client # [ 0.018638] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations728worker2 # [ 0.008834] CPU features: detected: BBM Level 2 without TLB conflict abort729client # [ 0.018834] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations730client # [ 0.019051] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations731worker2 # [ 0.009042] Memory: 1406536K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)732worker2 # [ 0.009503] devtmpfs: initialized733worker2 # [ 0.011621] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)734client # [ 0.019083] audit: initializing netlink subsys (disabled)735client # [ 0.019756] thermal_sys: Registered thermal governor 'fair_share'736worker2 # [ 0.011649] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).737client # [ 0.019759] thermal_sys: Registered thermal governor 'bang_bang'738worker2 # [ 0.011864] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL739worker2 # [ 0.011869] 0 pages in range for non-PLT usage740client # [ 0.019763] thermal_sys: Registered thermal governor 'step_wise'741worker2 # [ 0.011870] 508288 pages in range for PLT usage742client # [ 0.019768] thermal_sys: Registered thermal governor 'user_space'743worker2 # [ 0.012011] pinctrl core: initialized pinctrl subsystem744worker2 # [ 0.012912] DMI not present or invalid.745worker2 # [ 0.016202] NET: Registered PF_NETLINK/PF_ROUTE protocol family746client # [ 0.019771] thermal_sys: Registered thermal governor 'power_allocator'747client # [ 0.019817] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1748client # [ 0.019825] cpuidle: using governor ladder749worker2 # [ 0.019535] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations750client # [ 0.019831] cpuidle: using governor menu751worker2 # [ 0.019762] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations752client # [ 0.020042] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.753client # [ 0.020060] ASID allocator initialised with 65536 entries754worker2 # [ 0.019990] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations755client # [ 0.021364] Serial: AMBA PL011 UART driver756worker2 # [ 0.020021] audit: initializing netlink subsys (disabled)757client # [ 0.026702] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1758worker2 # [ 0.020751] thermal_sys: Registered thermal governor 'fair_share'759client # [ 0.026866] printk: console [ttyAMA0] enabled760worker2 # [ 0.020754] thermal_sys: Registered thermal governor 'bang_bang'761worker2 # [ 0.020757] thermal_sys: Registered thermal governor 'step_wise'762worker2 # [ 0.020762] thermal_sys: Registered thermal governor 'user_space'763worker2 # [ 0.020765] thermal_sys: Registered thermal governor 'power_allocator'764worker2 # [ 0.020795] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1765worker2 # [ 0.020805] cpuidle: using governor ladder766worker2 # [ 0.020811] cpuidle: using governor menu767worker2 # [ 0.021060] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.768worker2 # [ 0.021081] ASID allocator initialised with 65536 entries769worker2 # [ 0.022340] Serial: AMBA PL011 UART driver770worker2 # [ 0.027670] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1771worker2 # [ 0.027857] printk: console [ttyAMA0] enabled772client # [ 0.149039] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages773client # [ 0.149062] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page774client # [ 0.149068] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages775client # [ 0.149072] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page776client # [ 0.149077] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages777client # [ 0.149081] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page778client # [ 0.149085] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages779client # [ 0.149089] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page780client # [ 0.156683] fbcon: Taking over console781client # [ 0.156703] ACPI: Interpreter disabled.782worker2 # [ 0.153358] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages783worker2 # [ 0.153382] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page784worker1 # [ 0.226078] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)785worker2 # [ 0.153387] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages786worker1 # [ 0.226141] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)787worker2 # [ 0.153391] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page788worker1 # [ 0.226178] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)789worker2 # [ 0.153396] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages790worker1 # [ 0.226276] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)791worker2 # [ 0.153400] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page792worker1 # [ 0.226422] TCP: Hash tables configured (established 16384 bind 16384)793worker2 # [ 0.153405] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages794worker1 # [ 0.226532] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)795client # [ 0.164527] iommu: Default domain type: Translated796worker2 # [ 0.153409] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page797client # [ 0.164541] iommu: DMA domain TLB invalidation policy: strict mode798worker1 # [ 0.226573] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)799client # [ 0.164953] SCSI subsystem initialized800worker1 # [ 0.226612] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)801worker2 # [ 0.161373] fbcon: Taking over console802worker1 # [ 0.226711] NET: Registered PF_UNIX/PF_LOCAL protocol family803client # [ 0.167046] usbcore: registered new interface driver usbfs804worker2 # [ 0.161397] ACPI: Interpreter disabled.805worker1 # [ 0.226743] NET: Registered PF_XDP protocol family806client # [ 0.167080] usbcore: registered new interface driver hub807worker1 # [ 0.226763] PCI: CLS 0 bytes, default 64808client # [ 0.167113] usbcore: registered new device driver usb809worker1 # [ 0.227030] Trying to unpack rootfs image as initramfs...810client # [ 0.167425] pps_core: LinuxPPS API ver. 1 registered811client # [ 0.167431] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>812client # [ 0.167452] PTP clock support registered813client # [ 0.167509] EDAC MC: Ver: 3.0.0814worker1 # [ 0.243286] kvm [1]: HYP mode not available815client # [ 0.172292] scmi_core: SCMI protocol bus registered816client # [ 0.173317] FPGA manager framework817client # [ 0.174470] vgaarb: loaded818client # [ 0.175157] clocksource: Switched to clocksource arch_sys_counter819worker2 # [ 0.169874] iommu: Default domain type: Translated820worker2 # [ 0.169888] iommu: DMA domain TLB invalidation policy: strict mode821worker2 # [ 0.171710] SCSI subsystem initialized822worker2 # [ 0.172432] usbcore: registered new interface driver usbfs823worker2 # [ 0.172468] usbcore: registered new interface driver hub824worker2 # [ 0.172487] usbcore: registered new device driver usb825worker2 # [ 0.172777] pps_core: LinuxPPS API ver. 1 registered826worker2 # [ 0.172783] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>827worker2 # [ 0.172794] PTP clock support registered828client # [ 0.182047] VFS: Disk quotas dquot_6.6.0829worker2 # [ 0.172879] EDAC MC: Ver: 3.0.0830client # [ 0.182100] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)831worker2 # [ 0.177629] scmi_core: SCMI protocol bus registered832client # [ 0.183901] netfs: FS-Cache loaded833client # [ 0.184046] pnp: PnP ACPI: disabled834worker2 # [ 0.178669] FPGA manager framework835worker2 # [ 0.179677] vgaarb: loaded836worker2 # [ 0.180353] clocksource: Switched to clocksource arch_sys_counter837worker2 # [ 0.182346] VFS: Disk quotas dquot_6.6.0838worker2 # [ 0.182388] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)839client # [ 0.188066] NET: Registered PF_INET protocol family840worker2 # [ 0.186405] netfs: FS-Cache loaded841client # [ 0.188379] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)842worker2 # [ 0.186556] pnp: PnP ACPI: disabled843worker2 # [ 0.190783] NET: Registered PF_INET protocol family844worker2 # [ 0.191094] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)845client # [ 0.221733] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846client # [ 0.221801] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847client # [ 0.221838] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)848client # [ 0.221933] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849client # [ 0.222079] TCP: Hash tables configured (established 16384 bind 16384)850client # [ 0.222190] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)851client # [ 0.222234] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)852client # [ 0.222273] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)853client # [ 0.222374] NET: Registered PF_UNIX/PF_LOCAL protocol family854worker2 # [ 0.224742] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)855client # [ 0.222433] NET: Registered PF_XDP protocol family856worker2 # [ 0.224809] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)857client # [ 0.222454] PCI: CLS 0 bytes, default 64858client # [ 0.222735] Trying to unpack rootfs image as initramfs...859worker2 # [ 0.224886] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)860worker2 # [ 0.224982] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)861worker2 # [ 0.225126] TCP: Hash tables configured (established 16384 bind 16384)862worker2 # [ 0.225230] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)863worker2 # [ 0.225271] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)864worker2 # [ 0.225311] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)865worker2 # [ 0.225412] NET: Registered PF_UNIX/PF_LOCAL protocol family866worker2 # [ 0.225458] NET: Registered PF_XDP protocol family867worker2 # [ 0.225479] PCI: CLS 0 bytes, default 64868client # [ 0.240965] kvm [1]: HYP mode not available869worker2 # [ 0.225767] Trying to unpack rootfs image as initramfs...870worker2 # [ 0.242477] kvm [1]: HYP mode not available871lb # [ 0.432591] Initialise system trusted keyrings872lb # [ 0.433385] workingset: timestamp_bits=42 max_order=19 bucket_order=0873lb # [ 0.434712] squashfs: version 4.0 (2009/01/31) Phillip Lougher874lb # [ 0.435536] 9p: Installing v9fs 9p2000 file system support875lb # [ 0.459659] Key type asymmetric registered876lb # [ 0.459692] Asymmetric key parser 'x509' registered877lb # [ 0.459774] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878lb # [ 0.468334] io scheduler mq-deadline registered879lb # [ 0.468363] io scheduler kyber registered880lb # [ 0.473996] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881lb # [ 0.475415] ledtrig-cpu: registered to indicate activity on CPUs882lb # [ 0.475875] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:883lb # [ 0.475894] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000884lb # [ 0.475906] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000885lb # [ 0.475915] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000886lb # [ 0.475943] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits887lb # [ 0.475969] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]888lb # [ 0.483194] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00889lb # [ 0.483212] pci_bus 0000:00: root bus resource [bus 00-ff]890lb # [ 0.483219] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]891lb # [ 0.483225] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]892lb # [ 0.483230] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]893lb # [ 0.483333] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint894lb # [ 0.483773] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint895lb # [ 0.483958] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]896lb # [ 0.483974] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]897lb # [ 0.484004] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]898lb # [ 0.496087] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]899worker1 # [ 0.434020] Initialise system trusted keyrings900lb # [ 0.496633] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint901lb # [ 0.496826] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]902lb # [ 0.496842] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]903worker1 # [ 0.434822] workingset: timestamp_bits=42 max_order=19 bucket_order=0904worker1 # [ 0.436317] squashfs: version 4.0 (2009/01/31) Phillip Lougher905lb # [ 0.496871] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]906lb # [ 0.497337] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint907worker1 # [ 0.437090] 9p: Installing v9fs 9p2000 file system support908lb # [ 0.497521] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]909lb # [ 0.497537] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]910lb # [ 0.497565] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]911lb # [ 0.498016] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint912lb # [ 0.498198] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]913lb # [ 0.498214] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]914lb # [ 0.498247] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915lb # [ 0.498716] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint916lb # [ 0.498930] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]917lb # [ 0.498946] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]918lb # [ 0.498975] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]919lb # [ 0.499424] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint920lb # [ 0.499606] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]921lb # [ 0.499622] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]922lb # [ 0.499651] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]923lb # [ 0.520183] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint924lb # [ 0.520392] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]925lb # [ 0.520409] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]926lb # [ 0.520439] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]927lb # [ 0.520456] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]928lb # [ 0.521044] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint929lb # [ 0.521240] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]930lb # [ 0.521271] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]931lb # [ 0.521732] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint932lb # [ 0.521923] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]933lb # [ 0.521953] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]934worker1 # [ 0.465984] Key type asymmetric registered935lb # [ 0.522346] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint936worker1 # [ 0.466018] Asymmetric key parser 'x509' registered937lb # [ 0.522525] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]938worker1 # [ 0.466104] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)939lb # [ 0.522780] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint940worker1 # [ 0.468346] io scheduler mq-deadline registered941worker1 # [ 0.468360] io scheduler kyber registered942lb # [ 0.523123] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]943lb # [ 0.523141] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]944lb # [ 0.523170] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]945lb # [ 0.523662] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint946lb # [ 0.523846] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]947lb # [ 0.523862] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]948lb # [ 0.523891] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]949lb # [ 0.544628] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned950lb # [ 0.544658] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned951lb # [ 0.544665] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned952lb # [ 0.544716] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned953lb # [ 0.544765] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned954lb # [ 0.544814] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned955lb # [ 0.544862] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned956lb # [ 0.544910] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned957lb # [ 0.544959] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned958worker1 # [ 0.481973] pl061_gpio 9030000.pl061: PL061 GPIO chip registered959lb # [ 0.545008] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned960worker1 # [ 0.482683] ledtrig-cpu: registered to indicate activity on CPUs961worker1 # [ 0.483064] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:962lb # [ 0.545057] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned963worker1 # [ 0.483083] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000964lb # [ 0.545105] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned965lb # [ 0.545223] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned966worker1 # [ 0.483097] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000967lb # [ 0.545272] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned968worker1 # [ 0.483104] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000969lb # [ 0.545294] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned970client # [ 0.421770] Initialise system trusted keyrings971worker1 # [ 0.483129] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits972lb # [ 0.545315] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned973lb # [ 0.545337] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned974worker1 # [ 0.483152] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]975lb # [ 0.545362] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned976worker1 # [ 0.483228] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00977worker1 # [ 0.483238] pci_bus 0000:00: root bus resource [bus 00-ff]978lb # [ 0.545384] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned979worker1 # [ 0.483245] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]980lb # [ 0.545406] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned981worker1 # [ 0.483250] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]982lb # [ 0.545428] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned983worker1 # [ 0.483255] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]984lb # [ 0.545450] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned985client # [ 0.427278] workingset: timestamp_bits=42 max_order=19 bucket_order=0986lb # [ 0.545472] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned987worker1 # [ 0.483327] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint988client # [ 0.428617] squashfs: version 4.0 (2009/01/31) Phillip Lougher989lb # [ 0.545496] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned990worker1 # [ 0.483842] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint991worker2 # [ 0.423533] Initialise system trusted keyrings992lb # [ 0.545518] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned993worker1 # [ 0.484042] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]994lb # [ 0.545539] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned995worker1 # [ 0.484060] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]996lb # [ 0.545561] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned997client # [ 0.429392] 9p: Installing v9fs 9p2000 file system support998worker1 # [ 0.484091] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]999lb # [ 0.545583] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1000worker1 # [ 0.484108] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1001lb # [ 0.545604] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1002worker1 # [ 0.484610] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1003lb # [ 0.545625] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1004worker1 # [ 0.484805] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1005lb # [ 0.545646] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1006worker2 # [ 0.428406] workingset: timestamp_bits=42 max_order=19 bucket_order=01007worker1 # [ 0.484821] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1008lb # [ 0.545668] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1009worker1 # [ 0.484853] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1010lb # [ 0.545689] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1011worker2 # [ 0.429798] squashfs: version 4.0 (2009/01/31) Phillip Lougher1012lb # [ 0.545716] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1013worker1 # [ 0.485371] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1014lb # [ 0.545743] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1015worker1 # [ 0.485567] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1016lb # [ 0.545753] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1017worker1 # [ 0.485584] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1018worker2 # [ 0.430591] 9p: Installing v9fs 9p2000 file system support1019lb # [ 0.545758] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1020worker1 # [ 0.485616] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1021lb # [ 0.546977] pci 0000:00:0a.0: enabling device (0000 -> 0002)1022worker1 # [ 0.486128] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1023worker1 # [ 0.486325] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1024worker1 # [ 0.486341] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1025worker1 # [ 0.486384] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1026worker1 # [ 0.486865] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1027worker1 # [ 0.487056] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1028worker1 # [ 0.487073] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1029worker1 # [ 0.487104] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1030worker1 # [ 0.487576] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1031worker1 # [ 0.487766] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1032worker1 # [ 0.487782] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1033worker1 # [ 0.487829] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1034worker1 # [ 0.488354] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1035worker1 # [ 0.488550] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1036client # [ 0.450192] Key type asymmetric registered1037worker1 # [ 0.488567] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1038client # [ 0.450226] Asymmetric key parser 'x509' registered1039worker1 # [ 0.488597] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1040client # [ 0.450336] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1041worker1 # [ 0.488614] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1042worker1 # [ 0.489106] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1043worker2 # [ 0.451360] Key type asymmetric registered1044worker2 # [ 0.451397] Asymmetric key parser 'x509' registered1045worker2 # [ 0.451485] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1046client # [ 0.459246] io scheduler mq-deadline registered1047client # [ 0.459275] io scheduler kyber registered1048client # [ 0.464714] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1049worker2 # [ 0.460436] io scheduler mq-deadline registered1050worker2 # [ 0.460468] io scheduler kyber registered1051worker1 # [ 0.533353] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1052worker1 # [ 0.533444] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1053worker1 # [ 0.534025] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1054worker1 # [ 0.534232] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1055worker1 # [ 0.534263] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1056worker2 # [ 0.466019] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1057lb # [ 0.611563] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1058worker1 # [ 0.534686] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1059worker1 # [ 0.534894] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1060worker1 # [ 0.535164] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1061worker1 # [ 0.535478] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1062worker1 # [ 0.535497] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1063lb # [ 0.614817] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1064worker1 # [ 0.535528] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1065worker1 # [ 0.536066] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1066worker1 # [ 0.536261] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1067worker1 # [ 0.536278] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1068client # [ 0.471212] ledtrig-cpu: registered to indicate activity on CPUs1069worker1 # [ 0.536310] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1070client # [ 0.471789] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1071worker1 # [ 0.536949] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1072client # [ 0.471813] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001073worker1 # [ 0.536961] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1074worker2 # [ 0.472402] ledtrig-cpu: registered to indicate activity on CPUs1075client # [ 0.471825] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001076worker1 # [ 0.536966] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1077worker2 # [ 0.473028] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1078client # [ 0.471834] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001079worker1 # [ 0.537015] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1080worker2 # [ 0.473053] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001081client # [ 0.471863] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1082worker1 # [ 0.537065] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1083worker2 # [ 0.473066] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001084worker1 # [ 0.537114] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1085client # [ 0.471908] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1086lb # [ 0.621562] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1087worker2 # [ 0.473075] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001088client # [ 0.472009] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001089worker1 # [ 0.537164] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1090client # [ 0.472019] pci_bus 0000:00: root bus resource [bus 00-ff]1091worker2 # [ 0.473102] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1092worker1 # [ 0.537214] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1093client # [ 0.472025] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1094worker1 # [ 0.537268] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1095worker2 # [ 0.473131] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1096client # [ 0.472031] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1097worker2 # [ 0.473223] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001098worker1 # [ 0.537357] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1099client # [ 0.472036] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1100worker2 # [ 0.473233] pci_bus 0000:00: root bus resource [bus 00-ff]1101worker1 # [ 0.537406] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1102client # [ 0.472127] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1103worker2 # [ 0.473239] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1104worker1 # [ 0.537455] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1105client # [ 0.472580] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1106worker2 # [ 0.473245] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1107client # [ 0.472769] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1108worker1 # [ 0.537534] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1109worker2 # [ 0.473250] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1110client # [ 0.472785] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1111worker1 # [ 0.537583] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1112worker2 # [ 0.473341] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1113client # [ 0.472816] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1114worker1 # [ 0.537606] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1115client # [ 0.472837] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1116worker2 # [ 0.473799] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1117worker1 # [ 0.537657] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1118worker2 # [ 0.473993] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1119client # [ 0.473304] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1120worker1 # [ 0.537683] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1121worker2 # [ 0.474010] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1122client # [ 0.473492] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1123worker1 # [ 0.537709] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1124worker2 # [ 0.474041] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1125client # [ 0.473508] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1126worker1 # [ 0.537733] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1127worker2 # [ 0.474057] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1128client # [ 0.473537] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1129lb # [ 0.632821] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1130worker1 # [ 0.537756] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1131lb # [ 0.635235] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1132worker2 # [ 0.474523] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1133client # [ 0.473988] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1134worker1 # [ 0.537779] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1135worker2 # [ 0.474710] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1136client # [ 0.474171] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1137worker1 # [ 0.537803] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1138worker2 # [ 0.474726] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1139client # [ 0.474187] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1140worker1 # [ 0.537826] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1141worker2 # [ 0.474757] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1142client # [ 0.474216] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1143worker1 # [ 0.537851] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1144worker2 # [ 0.475218] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1145client # [ 0.474748] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1146worker1 # [ 0.537874] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1147client # [ 0.474931] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1148worker2 # [ 0.475405] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1149worker1 # [ 0.537898] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1150client # [ 0.474946] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1151worker2 # [ 0.475422] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1152worker1 # [ 0.537920] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1153client # [ 0.474980] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1154worker2 # [ 0.475452] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1155worker1 # [ 0.537943] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1156client # [ 0.475483] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1157worker2 # [ 0.475918] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1158worker1 # [ 0.537966] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1159client # [ 0.475668] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1160worker2 # [ 0.476103] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1161worker1 # [ 0.537989] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1162client # [ 0.475686] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1163worker2 # [ 0.476120] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1164worker1 # [ 0.538011] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1165client # [ 0.475717] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1166worker2 # [ 0.476153] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1167worker1 # [ 0.538034] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1168worker1 # [ 0.538057] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1169client # [ 0.476196] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1170lb # [ 0.645720] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1171client # [ 0.476401] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1172worker1 # [ 0.538080] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1173client # [ 0.476416] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1174worker1 # [ 0.538109] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1175worker1 # [ 0.538120] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1176client # [ 0.476447] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1177worker2 # [ 0.502075] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1178worker1 # [ 0.538124] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1179client # [ 0.476903] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1180worker2 # [ 0.502269] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1181worker1 # [ 0.539382] pci 0000:00:0a.0: enabling device (0000 -> 0002)1182client # [ 0.477087] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1183worker2 # [ 0.502285] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1184client # [ 0.477103] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1185worker2 # [ 0.502315] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1186client # [ 0.477133] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1187worker2 # [ 0.502778] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1188client # [ 0.477149] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1189worker2 # [ 0.502965] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1190client # [ 0.477614] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1191worker2 # [ 0.502982] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1192client # [ 0.477800] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1193worker2 # [ 0.503011] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1194client # [ 0.477830] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1195worker2 # [ 0.503506] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1196client # [ 0.478282] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1197worker2 # [ 0.503691] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1198client # [ 0.478495] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1199worker2 # [ 0.503707] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1200client # [ 0.478524] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1201worker2 # [ 0.503737] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1202client # [ 0.478915] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1203worker2 # [ 0.503754] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1204client # [ 0.479099] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1205lb # [ 0.656705] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1206worker2 # [ 0.504216] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1207lb # [ 0.659904] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1208lb # [ 0.663805] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1209client # [ 0.527561] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1210client # [ 0.527895] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1211client # [ 0.527915] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1212client # [ 0.527944] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1213client # [ 0.528474] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1214client # [ 0.528661] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1215worker1 # [ 0.608247] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1216client # [ 0.528676] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1217lb # [ 0.672528] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1218client # [ 0.528705] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1219lb # [ 0.675602] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1220worker2 # [ 0.524524] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1221client # [ 0.529297] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1222worker2 # [ 0.524580] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1223client # [ 0.529309] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1224worker2 # [ 0.525168] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1225client # [ 0.529315] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1226worker2 # [ 0.525377] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1227client # [ 0.529360] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1228worker2 # [ 0.525409] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1229client # [ 0.529406] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1230worker2 # [ 0.525807] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1231client # [ 0.529453] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1232worker2 # [ 0.525988] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1233client # [ 0.529499] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1234worker2 # [ 0.526243] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1235client # [ 0.529545] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1236worker2 # [ 0.526559] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1237worker2 # [ 0.526581] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1238client # [ 0.529596] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1239worker2 # [ 0.526611] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1240client # [ 0.529644] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1241worker2 # [ 0.527083] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1242client # [ 0.529691] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1243worker2 # [ 0.527269] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1244client # [ 0.529738] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1245worker2 # [ 0.527285] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1246worker2 # [ 0.527315] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1247client # [ 0.529813] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1248worker2 # [ 0.527910] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1249client # [ 0.529858] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1250worker2 # [ 0.527923] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1251client # [ 0.529880] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1252client # [ 0.529900] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1253worker1 # [ 0.623106] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1254worker2 # [ 0.527929] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1255client # [ 0.529921] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1256worker2 # [ 0.527976] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1257client # [ 0.529946] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1258worker2 # [ 0.528024] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1259client # [ 0.529967] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1260worker2 # [ 0.528073] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1261client # [ 0.529989] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1262client # [ 0.530010] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1263worker2 # [ 0.528120] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1264client # [ 0.530031] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1265worker2 # [ 0.528169] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1266lb # [ 0.696838] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1267worker1 # [ 0.626302] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1268client # [ 0.530053] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1269worker1 # [ 0.628820] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1270worker2 # [ 0.528218] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1271client # [ 0.530076] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1272worker2 # [ 0.528268] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1273client # [ 0.530097] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1274lb # [ 0.699626] msm_serial: driver initialized1275lb # [ 0.699776] SuperH (H)SCI(F) driver initialized1276worker2 # [ 0.528316] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1277client # [ 0.530118] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1278lb # [ 0.699831] STM32 USART driver initialized1279client # [ 0.530139] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1280worker2 # [ 0.528388] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1281client # [ 0.530160] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1282worker2 # [ 0.528469] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1283client # [ 0.530180] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1284worker2 # [ 0.528516] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1285client # [ 0.530201] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1286client # [ 0.530222] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1287worker2 # [ 0.528538] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1288worker2 # [ 0.528560] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1289client # [ 0.530243] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1290client # [ 0.530265] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1291worker2 # [ 0.528582] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1292client # [ 0.530286] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1293worker2 # [ 0.528607] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1294client # [ 0.530313] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1295worker2 # [ 0.528629] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1296client # [ 0.530322] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1297worker2 # [ 0.528652] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1298client # [ 0.530327] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1299worker2 # [ 0.528673] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1300worker1 # [ 0.638916] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1301worker2 # [ 0.528696] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1302worker1 # [ 0.641143] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1303worker2 # [ 0.528718] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1304worker2 # [ 0.528741] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1305worker2 # [ 0.528764] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1306worker2 # [ 0.528786] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1307worker2 # [ 0.528808] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1308worker2 # [ 0.528830] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1309worker2 # [ 0.528860] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1310worker2 # [ 0.528883] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1311worker2 # [ 0.528905] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1312worker2 # [ 0.528928] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1313client # [ 0.575656] pci 0000:00:0a.0: enabling device (0000 -> 0002)1314worker2 # [ 0.528950] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1315worker2 # [ 0.528972] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1316worker2 # [ 0.529001] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1317worker2 # [ 0.529011] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1318worker1 # [ 0.652467] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1319worker2 # [ 0.529016] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1320worker2 # [ 0.530189] pci 0000:00:0a.0: enabling device (0000 -> 0002)1321worker1 # [ 0.656576] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1322worker1 # [ 0.664617] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1323client # [ 0.597139] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1324lb # [ 0.738544] loop: module loaded1325lb # [ 0.738787] virtio_blk virtio5: 1/0/0 default/read/poll queues1326lb # [ 0.739717] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1327worker1 # [ 0.674930] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1328worker2 # [ 0.603593] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1329client # [ 0.608338] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1330worker1 # [ 0.682769] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1331worker2 # [ 0.606973] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1332lb # [ 0.752925] megasas: 07.734.00.00-rc11333lb # [ 0.753746] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1334lb # [ 0.756195] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001335client # [ 0.615310] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1336client # [ 0.617776] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1337lb # [ 0.756282] Intel/Sharp Extended Query Table at 0x00311338lb # [ 0.758276] Using buffer write method1339worker2 # [ 0.613599] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1340worker1 # [ 0.696600] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1341lb # [ 0.758377] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1342worker1 # [ 0.699348] msm_serial: driver initialized1343worker1 # [ 0.699529] SuperH (H)SCI(F) driver initialized1344worker1 # [ 0.699583] STM32 USART driver initialized1345client # [ 0.628368] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1346client # [ 0.631119] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1347worker2 # [ 0.625232] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1348worker2 # [ 0.627523] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1349lb # [ 0.772807] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001350lb # [ 0.772869] Intel/Sharp Extended Query Table at 0x00311351lb # [ 0.774405] Using buffer write method1352lb # [ 0.774450] Concatenating MTD devices:1353lb # [ 0.774455] (0): "0.flash"1354lb # [ 0.774459] (1): "0.flash"1355lb # [ 0.774462] into device "0.flash"1356client # [ 0.641746] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1357worker2 # [ 0.639087] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1358client # [ 0.645280] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1359worker2 # [ 0.645704] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1360worker2 # [ 0.648117] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1361client # [ 0.655526] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1362client # [ 0.657996] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1363client # [ 0.662597] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1364worker2 # [ 0.658394] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1365worker1 # [ 0.745644] loop: module loaded1366worker1 # [ 0.745896] virtio_blk virtio5: 1/0/0 default/read/poll queues1367worker1 # [ 0.746748] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1368client # [ 0.680682] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1369worker2 # [ 0.668676] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1370worker2 # [ 0.674225] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1371client # [ 0.688757] msm_serial: driver initialized1372client # [ 0.688977] SuperH (H)SCI(F) driver initialized1373worker1 # [ 0.758179] megasas: 07.734.00.00-rc11374client # [ 0.689033] STM32 USART driver initialized1375worker1 # [ 0.759045] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1376worker2 # [ 0.687753] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1377worker1 # [ 0.761362] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001378worker1 # [ 0.761433] Intel/Sharp Extended Query Table at 0x00311379worker1 # [ 0.763302] Using buffer write method1380worker1 # [ 0.763400] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1381worker2 # [ 0.697732] msm_serial: driver initialized1382worker2 # [ 0.697938] SuperH (H)SCI(F) driver initialized1383worker2 # [ 0.697996] STM32 USART driver initialized1384worker1 # [ 0.777340] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001385worker1 # [ 0.777385] Intel/Sharp Extended Query Table at 0x00311386worker1 # [ 0.779223] Using buffer write method1387worker1 # [ 0.779275] Concatenating MTD devices:1388worker1 # [ 0.779279] (0): "0.flash"1389worker1 # [ 0.779284] (1): "0.flash"1390worker1 # [ 0.779287] into device "0.flash"1391client # [ 0.724314] loop: module loaded1392client # [ 0.724563] virtio_blk virtio5: 1/0/0 default/read/poll queues1393client # [ 0.725467] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1394client # [ 0.732074] megasas: 07.734.00.00-rc11395client # [ 0.732912] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1396worker2 # [ 0.731814] loop: module loaded1397worker2 # [ 0.732065] virtio_blk virtio5: 1/0/0 default/read/poll queues1398worker2 # [ 0.732960] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1399worker2 # [ 0.741364] megasas: 07.734.00.00-rc11400client # [ 0.743294] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001401worker2 # [ 0.742214] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1402client # [ 0.743343] Intel/Sharp Extended Query Table at 0x00311403client # [ 0.746381] Using buffer write method1404client # [ 0.746538] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1405client # [ 0.748206] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001406worker2 # [ 0.746429] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001407client # [ 0.748272] Intel/Sharp Extended Query Table at 0x00311408worker2 # [ 0.746463] Intel/Sharp Extended Query Table at 0x00311409client # [ 0.749997] Using buffer write method1410worker2 # [ 0.748231] Using buffer write method1411client # [ 0.750046] Concatenating MTD devices:1412worker2 # [ 0.748349] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1413client # [ 0.750051] (0): "0.flash"1414client # [ 0.750055] (1): "0.flash"1415client # [ 0.750058] into device "0.flash"1416worker2 # [ 0.759475] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001417worker2 # [ 0.759531] Intel/Sharp Extended Query Table at 0x00311418worker2 # [ 0.771106] Using buffer write method1419worker2 # [ 0.771176] Concatenating MTD devices:1420worker2 # [ 0.771194] (0): "0.flash"1421worker2 # [ 0.771199] (1): "0.flash"1422worker2 # [ 0.771202] into device "0.flash"1423lb # [ 1.070623] Freeing initrd memory: 26140K1424lb # [ 1.077313] tun: Universal TUN/TAP device driver, 1.61425lb # [ 1.081642] thunder_xcv, ver 1.01426lb # [ 1.081703] thunder_bgx, ver 1.01427lb # [ 1.081728] nicpf, ver 1.01428lb # [ 1.082314] e1000: Intel(R) PRO/1000 Network Driver1429lb # [ 1.082322] e1000: Copyright (c) 1999-2006 Intel Corporation.1430lb # [ 1.082352] e1000e: Intel(R) PRO/1000 Network Driver1431lb # [ 1.082364] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432lb # [ 1.082394] igb: Intel(R) Gigabit Ethernet Network Driver1433lb # [ 1.082400] igb: Copyright (c) 2007-2014 Intel Corporation.1434lb # [ 1.082423] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435lb # [ 1.082429] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436lb # [ 1.082571] sky2: driver version 1.301437lb # [ 1.084841] ehci-pci 0000:00:0a.0: EHCI Host Controller1438lb # [ 1.084912] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11439lb # [ 1.085132] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001440lb # [ 1.094934] usbcore: registered new interface driver usb-storage1441lb # [ 1.095055] usbcore: registered new interface driver usbserial_generic1442lb # [ 1.095070] usbserial: USB Serial support registered for generic1443lb # [ 1.095713] hv_vmbus: registering driver hyperv_keyboard1444lb # [ 1.096092] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001445lb # [ 1.096537] hub 1-0:1.0: USB hub found1446lb # [ 1.096562] hub 1-0:1.0: 6 ports detected1447lb # [ 1.102377] rtc-pl031 9010000.pl031: registered as rtc01448lb # [ 1.102417] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:21:39 UTC (1789906899)1449lb # [ 1.102757] i2c_dev: i2c /dev entries driver1450lb # [ 1.107937] sdhci: Secure Digital Host Controller Interface driver1451lb # [ 1.107952] sdhci: Copyright(c) Pierre Ossman1452lb # [ 1.109553] Synopsys Designware Multimedia Card Interface Driver1453lb # [ 1.109944] sdhci-pltfm: SDHCI platform and OF driver helper1454lb # [ 1.111734] hid: raw HID events driver (C) Jiri Kosina1455lb # [ 1.111999] usbcore: registered new interface driver usbhid1456lb # [ 1.112006] usbhid: USB HID core driver1457lb # [ 1.116410] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1458lb # [ 1.118016] drop_monitor: Initializing network drop monitor service1459lb # [ 1.118210] NET: Registered PF_INET6 protocol family1460lb # [ 1.121520] Segment Routing with IPv61461lb # [ 1.121543] In-situ OAM (IOAM) with IPv61462lb # [ 1.121578] NET: Registered PF_PACKET protocol family1463lb # [ 1.123281] 9pnet: Installing 9P2000 support1464lb # [ 1.126152] Key type dns_resolver registered1465worker1 # [ 1.061637] Freeing initrd memory: 26148K1466worker1 # [ 1.068123] tun: Universal TUN/TAP device driver, 1.61467lb # [ 1.133273] registered taskstats version 11468lb # [ 1.133449] Loading compiled-in X.509 certificates1469worker1 # [ 1.072297] thunder_xcv, ver 1.01470worker1 # [ 1.072349] thunder_bgx, ver 1.01471worker1 # [ 1.072373] nicpf, ver 1.01472worker1 # [ 1.072940] e1000: Intel(R) PRO/1000 Network Driver1473worker1 # [ 1.072948] e1000: Copyright (c) 1999-2006 Intel Corporation.1474worker1 # [ 1.072973] e1000e: Intel(R) PRO/1000 Network Driver1475lb # [ 1.142641] Demotion targets for Node 0: null1476worker1 # [ 1.072982] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1477lb # [ 1.142786] Key type .fscrypt registered1478worker1 # [ 1.073011] igb: Intel(R) Gigabit Ethernet Network Driver1479lb # [ 1.142792] Key type fscrypt-provisioning registered1480worker1 # [ 1.073017] igb: Copyright (c) 2007-2014 Intel Corporation.1481lb # [ 1.143000] ima: No TPM chip found, activating TPM-bypass!1482lb # [ 1.143026] ima: Allocated hash algorithm: sha11483worker1 # [ 1.073041] igbvf: Intel(R) Gigabit Virtual Function Network Driver1484lb # [ 1.143051] ima: No architecture policies found1485worker1 # [ 1.073047] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1486worker1 # [ 1.073185] sky2: driver version 1.301487lb # [ 1.147374] input: gpio-keys as /devices/platform/gpio-keys/input/input01488worker1 # [ 1.082080] usbcore: registered new interface driver usb-storage1489worker1 # [ 1.082222] usbcore: registered new interface driver usbserial_generic1490worker1 # [ 1.082238] usbserial: USB Serial support registered for generic1491worker1 # [ 1.082843] hv_vmbus: registering driver hyperv_keyboard1492worker1 # [ 1.084415] ehci-pci 0000:00:0a.0: EHCI Host Controller1493worker1 # [ 1.084450] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11494worker1 # [ 1.084675] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001495worker1 # [ 1.090239] rtc-pl031 9010000.pl031: registered as rtc01496worker1 # [ 1.090270] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:21:39 UTC (1789906899)1497worker1 # [ 1.090699] i2c_dev: i2c /dev entries driver1498worker1 # [ 1.093861] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001499worker1 # [ 1.094210] hub 1-0:1.0: USB hub found1500worker1 # [ 1.094239] hub 1-0:1.0: 6 ports detected1501worker1 # [ 1.098507] sdhci: Secure Digital Host Controller Interface driver1502worker1 # [ 1.098521] sdhci: Copyright(c) Pierre Ossman1503worker1 # [ 1.098786] Synopsys Designware Multimedia Card Interface Driver1504worker1 # [ 1.099156] sdhci-pltfm: SDHCI platform and OF driver helper1505worker1 # [ 1.100974] hid: raw HID events driver (C) Jiri Kosina1506worker1 # [ 1.101225] usbcore: registered new interface driver usbhid1507lb # [ 1.169504] clk: Disabling unused clocks1508worker1 # [ 1.101233] usbhid: USB HID core driver1509lb # [ 1.169552] PM: genpd: Disabling unused power domains1510lb # [ 1.174084] Freeing unused kernel memory: 4736K1511lb # [ 1.174299] Run /init as init process1512worker1 # [ 1.106780] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1513worker1 # [ 1.108366] drop_monitor: Initializing network drop monitor service1514worker1 # [ 1.108573] NET: Registered PF_INET6 protocol family1515worker1 # [ 1.111784] Segment Routing with IPv61516worker1 # [ 1.111830] In-situ OAM (IOAM) with IPv61517worker1 # [ 1.111864] NET: Registered PF_PACKET protocol family1518worker1 # [ 1.113599] 9pnet: Installing 9P2000 support1519worker1 # [ 1.115997] Key type dns_resolver registered1520lb # [ 1.190923] systemd[1]: Successfully made /usr/ read-only.1521worker1 # [ 1.123214] registered taskstats version 11522worker1 # [ 1.123388] Loading compiled-in X.509 certificates1523client # [ 1.057985] Freeing initrd memory: 26160K1524worker1 # [ 1.132330] Demotion targets for Node 0: null1525worker1 # [ 1.132480] Key type .fscrypt registered1526worker1 # [ 1.132488] Key type fscrypt-provisioning registered1527worker1 # [ 1.132599] ima: No TPM chip found, activating TPM-bypass!1528worker1 # [ 1.132620] ima: Allocated hash algorithm: sha11529worker1 # [ 1.132646] ima: No architecture policies found1530worker1 # [ 1.136938] input: gpio-keys as /devices/platform/gpio-keys/input/input01531client # [ 1.064529] tun: Universal TUN/TAP device driver, 1.61532worker2 # [ 1.066574] Freeing initrd memory: 26148K1533client # [ 1.068975] thunder_xcv, ver 1.01534client # [ 1.069039] thunder_bgx, ver 1.01535client # [ 1.069064] nicpf, ver 1.01536client # [ 1.069644] e1000: Intel(R) PRO/1000 Network Driver1537client # [ 1.069652] e1000: Copyright (c) 1999-2006 Intel Corporation.1538client # [ 1.069677] e1000e: Intel(R) PRO/1000 Network Driver1539client # [ 1.069687] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1540client # [ 1.069717] igb: Intel(R) Gigabit Ethernet Network Driver1541client # [ 1.069724] igb: Copyright (c) 2007-2014 Intel Corporation.1542client # [ 1.069747] igbvf: Intel(R) Gigabit Virtual Function Network Driver1543client # [ 1.069753] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1544worker2 # [ 1.073131] tun: Universal TUN/TAP device driver, 1.61545client # [ 1.069886] sky2: driver version 1.301546client # [ 1.072051] ehci-pci 0000:00:0a.0: EHCI Host Controller1547client # [ 1.072090] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11548client # [ 1.072391] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001549client # [ 1.082596] usbcore: registered new interface driver usb-storage1550client # [ 1.082727] usbcore: registered new interface driver usbserial_generic1551client # [ 1.082745] usbserial: USB Serial support registered for generic1552client # [ 1.083228] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001553client # [ 1.083609] hub 1-0:1.0: USB hub found1554worker2 # [ 1.077498] thunder_xcv, ver 1.01555worker2 # [ 1.077560] thunder_bgx, ver 1.01556client # [ 1.083644] hub 1-0:1.0: 6 ports detected1557worker2 # [ 1.077584] nicpf, ver 1.01558worker1 # [ 1.159181] clk: Disabling unused clocks1559worker2 # [ 1.078165] e1000: Intel(R) PRO/1000 Network Driver1560worker1 # [ 1.159226] PM: genpd: Disabling unused power domains1561worker2 # [ 1.078173] e1000: Copyright (c) 1999-2006 Intel Corporation.1562client # [ 1.088213] hv_vmbus: registering driver hyperv_keyboard1563worker2 # [ 1.078199] e1000e: Intel(R) PRO/1000 Network Driver1564worker2 # [ 1.078208] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1565worker1 # [ 1.163729] Freeing unused kernel memory: 4736K1566worker2 # [ 1.078239] igb: Intel(R) Gigabit Ethernet Network Driver1567client # [ 1.089893] rtc-pl031 9010000.pl031: registered as rtc01568worker1 # [ 1.163968] Run /init as init process1569worker2 # [ 1.078245] igb: Copyright (c) 2007-2014 Intel Corporation.1570client # [ 1.089927] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:21:39 UTC (1789906899)1571worker2 # [ 1.078270] igbvf: Intel(R) Gigabit Virtual Function Network Driver1572client # [ 1.090258] i2c_dev: i2c /dev entries driver1573worker2 # [ 1.078277] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1574worker2 # [ 1.078415] sky2: driver version 1.301575worker2 # [ 1.080066] usbcore: registered new interface driver usb-storage1576worker2 # [ 1.080231] usbcore: registered new interface driver usbserial_generic1577worker2 # [ 1.080248] usbserial: USB Serial support registered for generic1578worker2 # [ 1.081201] ehci-pci 0000:00:0a.0: EHCI Host Controller1579worker2 # [ 1.081237] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11580worker2 # [ 1.081414] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001581client # [ 1.095444] sdhci: Secure Digital Host Controller Interface driver1582client # [ 1.095456] sdhci: Copyright(c) Pierre Ossman1583worker2 # [ 1.093545] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001584worker2 # [ 1.094000] hub 1-0:1.0: USB hub found1585client # [ 1.095724] Synopsys Designware Multimedia Card Interface Driver1586worker2 # [ 1.094022] hub 1-0:1.0: 6 ports detected1587client # [ 1.096104] sdhci-pltfm: SDHCI platform and OF driver helper1588client # [ 1.097879] hid: raw HID events driver (C) Jiri Kosina1589client # [ 1.098175] usbcore: registered new interface driver usbhid1590client # [ 1.098182] usbhid: USB HID core driver1591worker2 # [ 1.096793] hv_vmbus: registering driver hyperv_keyboard1592worker2 # [ 1.098568] rtc-pl031 9010000.pl031: registered as rtc01593worker2 # [ 1.098601] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:21:39 UTC (1789906899)1594client # [ 1.103975] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1595worker1 # [ 1.179912] systemd[1]: Successfully made /usr/ read-only.1596worker2 # [ 1.098947] i2c_dev: i2c /dev entries driver1597client # [ 1.105577] drop_monitor: Initializing network drop monitor service1598client # [ 1.105758] NET: Registered PF_INET6 protocol family1599client # [ 1.109229] Segment Routing with IPv61600client # [ 1.109254] In-situ OAM (IOAM) with IPv61601worker2 # [ 1.104159] sdhci: Secure Digital Host Controller Interface driver1602client # [ 1.109286] NET: Registered PF_PACKET protocol family1603worker2 # [ 1.104176] sdhci: Copyright(c) Pierre Ossman1604client # [ 1.110976] 9pnet: Installing 9P2000 support1605worker2 # [ 1.105844] Synopsys Designware Multimedia Card Interface Driver1606worker2 # [ 1.106227] sdhci-pltfm: SDHCI platform and OF driver helper1607client # [ 1.113884] Key type dns_resolver registered1608worker2 # [ 1.108014] hid: raw HID events driver (C) Jiri Kosina1609worker2 # [ 1.108287] usbcore: registered new interface driver usbhid1610worker2 # [ 1.108294] usbhid: USB HID core driver1611worker2 # [ 1.112796] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1612worker2 # [ 1.114379] drop_monitor: Initializing network drop monitor service1613worker2 # [ 1.114542] NET: Registered PF_INET6 protocol family1614client # [ 1.120599] registered taskstats version 11615worker2 # [ 1.117945] Segment Routing with IPv61616client # [ 1.120761] Loading compiled-in X.509 certificates1617worker2 # [ 1.117969] In-situ OAM (IOAM) with IPv61618worker2 # [ 1.118002] NET: Registered PF_PACKET protocol family1619worker2 # [ 1.119685] 9pnet: Installing 9P2000 support1620worker2 # [ 1.122799] Key type dns_resolver registered1621client # [ 1.129773] Demotion targets for Node 0: null1622client # [ 1.129916] Key type .fscrypt registered1623client # [ 1.129923] Key type fscrypt-provisioning registered1624client # [ 1.130033] ima: No TPM chip found, activating TPM-bypass!1625client # [ 1.130055] ima: Allocated hash algorithm: sha11626client # [ 1.130082] ima: No architecture policies found1627client # [ 1.134266] input: gpio-keys as /devices/platform/gpio-keys/input/input01628worker2 # [ 1.129507] registered taskstats version 11629worker2 # [ 1.129706] Loading compiled-in X.509 certificates1630worker2 # [ 1.138889] Demotion targets for Node 0: null1631worker2 # [ 1.139039] Key type .fscrypt registered1632worker2 # [ 1.139046] Key type fscrypt-provisioning registered1633worker2 # [ 1.139155] ima: No TPM chip found, activating TPM-bypass!1634worker2 # [ 1.139178] ima: Allocated hash algorithm: sha11635worker2 # [ 1.139205] ima: No architecture policies found1636worker2 # [ 1.143644] input: gpio-keys as /devices/platform/gpio-keys/input/input01637client # [ 1.156295] clk: Disabling unused clocks1638client # [ 1.156341] PM: genpd: Disabling unused power domains1639client # [ 1.160834] Freeing unused kernel memory: 4736K1640client # [ 1.161034] Run /init as init process1641worker2 # [ 1.166180] clk: Disabling unused clocks1642worker2 # [ 1.166226] PM: genpd: Disabling unused power domains1643worker2 # [ 1.170698] Freeing unused kernel memory: 4736K1644worker2 # [ 1.170931] Run /init as init process1645client # [ 1.177735] systemd[1]: Successfully made /usr/ read-only.1646worker2 # [ 1.187005] systemd[1]: Successfully made /usr/ read-only.1647lb # [ 1.344121] usb 1-1: new high-speed USB device number 2 using ehci-pci1648worker1 # [ 1.341442] usb 1-1: new high-speed USB device number 2 using ehci-pci1649client # [ 1.331229] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker2 # [ 1.340418] usb 1-1: new high-speed USB device number 2 using ehci-pci1651lb # [ 1.500512] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652lb # [ 1.526036] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653lb # [ 1.533639] systemd[1]: Detected virtualization qemu.1654lb # [ 1.535023] systemd[1]: Detected architecture arm64.1655lb # [ 1.536249] systemd[1]: Running in initrd.1656lb # [ 1.537885] systemd[1]: Initializing machine ID from random generator.1657lb # [ 1.539928] systemd[1]: Hostname set to <lb>.1658worker1 # [ 1.494004] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659worker1 # [ 1.514682] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1660worker1 # [ 1.519515] systemd[1]: Detected virtualization qemu.1661worker1 # [ 1.520384] systemd[1]: Detected architecture arm64.1662worker1 # [ 1.521095] systemd[1]: Running in initrd.1663lb # [ 1.591203] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01664worker1 # [ 1.523656] systemd[1]: Initializing machine ID from random generator.1665worker1 # [ 1.526878] systemd[1]: Hostname set to <worker1>.1666client # [ 1.485637] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11667worker2 # [ 1.490102] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11668worker1 # [ 1.585610] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01669client # [ 1.512941] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1670client # [ 1.525525] systemd[1]: Detected virtualization qemu.1671client # [ 1.527797] systemd[1]: Detected architecture arm64.1672client # [ 1.529728] systemd[1]: Running in initrd.1673client # [ 1.532415] systemd[1]: Initializing machine ID from random generator.1674worker2 # [ 1.521990] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1675worker2 # [ 1.530310] systemd[1]: Detected virtualization qemu.1676client # [ 1.535393] systemd[1]: Hostname set to <client>.1677worker2 # [ 1.531624] systemd[1]: Detected architecture arm64.1678worker2 # [ 1.532960] systemd[1]: Running in initrd.1679worker2 # [ 1.534672] systemd[1]: Initializing machine ID from random generator.1680worker2 # [ 1.536544] systemd[1]: Hostname set to <worker2>.1681lb # [ 1.708268] usb 1-2: new high-speed USB device number 3 using ehci-pci1682client # [ 1.579593] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker2 # [ 1.582227] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01684worker1 # [ 1.705397] usb 1-2: new high-speed USB device number 3 using ehci-pci1685lb # [ 1.791986] systemd[1]: bpf-restrict-fs: LSM BPF program attached1686client # [ 1.703219] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker2 # [ 1.700440] usb 1-2: new high-speed USB device number 3 using ehci-pci1688lb # [ 1.858566] systemd[1]: Queued start job for default target Initrd Default Target.1689lb # [ 1.861906] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690lb # [ 1.863880] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691lb # [ 1.867939] systemd[1]: Created slice Slice /system/modprobe.1692lb # [ 1.869093] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1693lb # [ 1.869137] systemd[1]: Expecting device /dev/disk/by-label/nixos...1694lb # [ 1.869166] systemd[1]: Reached target Path Units.1695lb # [ 1.869183] systemd[1]: Reached target Slice Units.1696lb # [ 1.869200] systemd[1]: Reached target Swaps.1697lb # [ 1.869218] systemd[1]: Reached target Timer Units.1698lb # [ 1.869422] systemd[1]: Listening on D-Bus System Message Bus Socket.1699lb # [ 1.869570] systemd[1]: Listening on Journal Socket (/dev/log).1700lb # [ 1.869694] systemd[1]: Listening on Journal Sockets.1701lb # [ 1.869805] systemd[1]: Listening on udev Control Socket.1702lb # [ 1.869901] systemd[1]: Listening on udev Kernel Socket.1703lb # [ 1.869921] systemd[1]: Reached target Socket Units.1704lb # [ 1.880389] systemd[1]: Starting Create List of Static Device Nodes...1705lb # [ 1.888264] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1706lb # [ 1.889248] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1707lb # [ 1.896344] systemd[1]: Mounting Kernel Configuration File System...1708worker1 # [ 1.850802] systemd[1]: bpf-restrict-fs: LSM BPF program attached1709lb # [ 1.929043] systemd[1]: Starting Journal Service...1710lb # [ 1.936389] systemd[1]: Starting Load Kernel Modules...1711worker1 # [ 1.864883] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21712worker2 # [ 1.790881] systemd[1]: bpf-restrict-fs: LSM BPF program attached1713lb # [ 1.937335] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1714worker1 # [ 1.870640] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01715lb # [ 1.952346] systemd[1]: Starting Coldplug All udev Devices...1716lb # [ 1.962090] systemd[1]: Finished Create List of Static Device Nodes.1717lb # [ 1.963311] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1718lb # [ 1.963674] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1719lb # [ 1.963971] systemd[1]: Mounted Kernel Configuration File System.1720lb # [ 1.991396] systemd-journald[73]: Collecting audit messages is disabled.1721lb # [ 1.992208] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1722client # [ 1.858512] systemd[1]: bpf-restrict-fs: LSM BPF program attached1723worker2 # [ 1.861821] systemd[1]: Queued start job for default target Initrd Default Target.1724client # [ 1.866740] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21725worker2 # [ 1.865730] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21726client # [ 1.870974] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01727worker2 # [ 1.867608] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01728worker2 # [ 1.871688] systemd[1]: Created slice Slice /system/modprobe.1729worker2 # [ 1.872771] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1730worker2 # [ 1.872818] systemd[1]: Expecting device /dev/disk/by-label/nixos...1731worker2 # [ 1.872897] systemd[1]: Reached target Path Units.1732worker2 # [ 1.872916] systemd[1]: Reached target Slice Units.1733worker2 # [ 1.872938] systemd[1]: Reached target Swaps.1734worker2 # [ 1.872955] systemd[1]: Reached target Timer Units.1735worker2 # [ 1.873161] systemd[1]: Listening on D-Bus System Message Bus Socket.1736worker2 # [ 1.873295] systemd[1]: Listening on Journal Socket (/dev/log).1737worker2 # [ 1.873429] systemd[1]: Listening on Journal Sockets.1738worker2 # [ 1.873544] systemd[1]: Listening on udev Control Socket.1739worker2 # [ 1.873645] systemd[1]: Listening on udev Kernel Socket.1740worker2 # [ 1.873664] systemd[1]: Reached target Socket Units.1741worker2 # [ 1.884075] systemd[1]: Starting Create List of Static Device Nodes...1742lb # [ 2.030373] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1743worker1 # [ 1.964943] systemd[1]: Queued start job for default target Initrd Default Target.1744worker2 # [ 1.892612] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1745worker2 # [ 1.892736] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1746worker1 # [ 1.975914] systemd[1]: Created slice Slice /system/modprobe.1747worker1 # [ 1.977131] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1748worker1 # [ 1.978500] systemd[1]: Expecting device /dev/disk/by-label/nixos...1749worker1 # [ 1.979512] systemd[1]: Reached target Path Units.1750worker2 # [ 1.900779] systemd[1]: Mounting Kernel Configuration File System...1751worker1 # [ 1.980333] systemd[1]: Reached target Slice Units.1752worker1 # [ 1.981123] systemd[1]: Reached target Swaps.1753worker1 # [ 1.981903] systemd[1]: Reached target Timer Units.1754worker1 # [ 1.982907] systemd[1]: Listening on D-Bus System Message Bus Socket.1755worker1 # [ 1.984182] systemd[1]: Listening on Journal Socket (/dev/log).1756worker1 # [ 1.985284] systemd[1]: Listening on Journal Sockets.1757worker1 # [ 1.986277] systemd[1]: Listening on udev Control Socket.1758worker1 # [ 1.987287] systemd[1]: Listening on udev Kernel Socket.1759worker1 # [ 1.988339] systemd[1]: Reached target Socket Units.1760worker1 # [ 1.990976] systemd[1]: Starting Create List of Static Device Nodes...1761lb # [ 2.052153] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1762lb # [ 2.057209] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01763lb # [ 2.057474] [drm] features: -virgl +edid -resource_blob -host_visible1764lb # [ 2.057484] [drm] features: -context_init1765lb # [ 2.058236] [drm] number of scanouts: 11766lb # [ 2.058392] [drm] number of cap sets: 01767worker2 # [ 1.916954] systemd[1]: Starting Journal Service...1768worker1 # [ 2.001609] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1769worker1 # [ 2.002855] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1770lb # [ 2.072798] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1771lb # [ 2.075738] systemd[1]: Starting Create Static Device Nodes in /dev...1772worker1 # [ 2.010676] systemd[1]: Mounting Kernel Configuration File System...1773worker2 # [ 1.936759] systemd[1]: Starting Load Kernel Modules...1774worker2 # [ 1.937757] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1775lb # [ 2.080749] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1776lb # [ 2.080780] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01777worker1 # [ 2.029616] systemd[1]: Starting Journal Service...1778client # [ 1.959764] systemd[1]: Queued start job for default target Initrd Default Target.1779worker2 # [ 1.956722] systemd[1]: Starting Coldplug All udev Devices...1780client # [ 1.965482] systemd[1]: Created slice Slice /system/modprobe.1781client # [ 1.966648] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1782client # [ 1.967976] systemd[1]: Expecting device /dev/disk/by-label/nixos...1783client # [ 1.968984] systemd[1]: Reached target Path Units.1784client # [ 1.969747] systemd[1]: Reached target Slice Units.1785client # [ 1.970574] systemd[1]: Reached target Swaps.1786client # [ 1.971320] systemd[1]: Reached target Timer Units.1787worker2 # [ 1.965364] systemd[1]: Finished Create List of Static Device Nodes.1788client # [ 1.972393] systemd[1]: Listening on D-Bus System Message Bus Socket.1789worker1 # [ 2.046344] systemd[1]: Starting Load Kernel Modules...1790worker2 # [ 1.966477] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1791client # [ 1.973562] systemd[1]: Listening on Journal Socket (/dev/log).1792worker1 # [ 2.047330] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1793client # [ 1.974676] systemd[1]: Listening on Journal Sockets.1794worker2 # [ 1.969661] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1795worker2 # [ 1.970084] systemd[1]: Mounted Kernel Configuration File System.1796client # [ 1.975694] systemd[1]: Listening on udev Control Socket.1797client # [ 1.975820] systemd[1]: Listening on udev Kernel Socket.1798client # [ 1.975846] systemd[1]: Reached target Socket Units.1799client # [ 1.980053] systemd[1]: Starting Create List of Static Device Nodes...1800lb # [ 2.112774] Console: switching to colour frame buffer device 160x501801worker1 # [ 2.058514] systemd[1]: Starting Coldplug All udev Devices...1802worker2 # [ 1.985064] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1803client # [ 1.991467] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1804client # [ 1.992605] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1805worker1 # [ 2.074475] systemd[1]: Finished Create List of Static Device Nodes.1806worker2 # [ 1.995265] systemd-journald[73]: Collecting audit messages is disabled.1807worker1 # [ 2.076705] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1808lb # [ 2.144789] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1809lb # [ 2.149148] systemd[1]: Finished Create Static Device Nodes in /dev.1810client # [ 2.007745] systemd[1]: Mounting Kernel Configuration File System...1811lb # [ 2.150592] systemd[1]: Reached target Preparation for Local File Systems.1812lb # [ 2.154708] systemd[1]: Reached target Local File Systems.1813worker1 # [ 2.090075] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1814worker1 # [ 2.090863] systemd[1]: Mounted Kernel Configuration File System.1815lb # [ 2.164513] systemd[1]: Starting Rule-based Manager for Device Events and Files...1816client # [ 2.027590] systemd[1]: Starting Journal Service...1817worker1 # [ 2.099494] systemd-journald[73]: Collecting audit messages is disabled.1818client # [ 2.031440] systemd[1]: Starting Load Kernel Modules...1819client # [ 2.032338] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1820worker1 # [ 2.105681] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1821worker2 # [ 2.033749] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1822lb # [ 2.184618] systemd[1]: Finished Load Kernel Modules.1823lb # [ 2.192269] systemd[1]: Starting Apply Kernel Variables...1824worker2 # [ 2.048502] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1825client # [ 2.066491] systemd-journald[73]: Collecting audit messages is disabled.1826lb # [ 2.188552] systemd-modules-load[74]: Inserted module 'dm_mod'1827client # [ 2.067732] systemd[1]: Starting Coldplug All udev Devices...1828lb # [ 2.189855] systemd-modules-load[74]: Module 'virtio_balloon' is built in1829client # [ 2.070281] systemd[1]: Finished Create List of Static Device Nodes.1830lb # [ 2.191107] systemd-modules-load[74]: Module 'virtio_console' is built in1831worker2 # [ 2.064754] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01832worker2 # [ 2.065070] [drm] features: -virgl +edid -resource_blob -host_visible1833client # [ 2.072316] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1834worker2 # [ 2.065082] [drm] features: -context_init1835worker2 # [ 2.065861] [drm] number of scanouts: 11836worker2 # [ 2.065887] [drm] number of cap sets: 01837worker1 # [ 2.149616] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1838lb # [ 2.216365] systemd[1]: Started Journal Service.1839lb # [ 2.199683] systemd-modules-load[74]: Inserted module 'virtio_gpu'1840lb # [ 2.204624] systemd-modules-load[74]: Module 'virtio_rng' is built in1841worker2 # [ 2.077182] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1842client # [ 2.083622] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1843worker1 # [ 2.158172] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1844client # [ 2.096292] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1845client # [ 2.096704] systemd[1]: Mounted Kernel Configuration File System.1846worker2 # [ 2.084805] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1847worker2 # [ 2.084835] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01848worker1 # [ 2.165441] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1849worker1 # [ 2.170807] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01850worker1 # [ 2.171086] [drm] features: -virgl +edid -resource_blob -host_visible1851worker1 # [ 2.171102] [drm] features: -context_init1852worker1 # [ 2.172014] [drm] number of scanouts: 11853worker2 # [ 2.095019] systemd[1]: Starting Create Static Device Nodes in /dev...1854worker1 # [ 2.172043] [drm] number of cap sets: 01855worker1 # [ 2.177400] systemd[1]: Starting Create Static Device Nodes in /dev...1856lb # [ 2.228897] systemd[1]: Starting Create System Files and Directories...1857worker1 # [ 2.193827] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1858worker1 # [ 2.193863] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01859worker2 # [ 2.112899] Console: switching to colour frame buffer device 160x501860client # [ 2.133034] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1861client # [ 2.148903] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1862lb # [ 2.276548] systemd[1]: Finished Apply Kernel Variables.1863worker2 # [ 2.148749] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1864worker2 # [ 2.153040] systemd[1]: Finished Create Static Device Nodes in /dev.1865worker2 # [ 2.153508] systemd[1]: Reached target Preparation for Local File Systems.1866worker2 # [ 2.153556] systemd[1]: Reached target Local File Systems.1867worker1 # [ 2.233848] Console: switching to colour frame buffer device 160x501868client # [ 2.163450] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01869client # [ 2.163729] [drm] features: -virgl +edid -resource_blob -host_visible1870client # [ 2.163741] [drm] features: -context_init1871client # [ 2.164516] [drm] number of scanouts: 11872client # [ 2.164537] [drm] number of cap sets: 01873worker2 # [ 2.164939] systemd[1]: Starting Rule-based Manager for Device Events and Files...1874worker1 # [ 2.246934] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1875worker1 # [ 2.250189] systemd[1]: Finished Create Static Device Nodes in /dev.1876worker1 # [ 2.250472] systemd[1]: Reached target Preparation for Local File Systems.1877worker1 # [ 2.250513] systemd[1]: Reached target Local File Systems.1878lb # [ 2.301335] systemd[1]: Finished Create System Files and Directories.1879client # [ 2.179633] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1880client # [ 2.179665] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01881worker1 # [ 2.256813] systemd[1]: Starting Rule-based Manager for Device Events and Files...1882client # [ 2.185847] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1883worker2 # [ 2.181202] systemd[1]: Finished Load Kernel Modules.1884lb # [ 2.309482] systemd-udevd[79]: Using default interface naming scheme 'v261'.1885client # [ 2.191937] systemd[1]: Starting Create Static Device Nodes in /dev...1886worker2 # [ 2.188947] systemd[1]: Starting Apply Kernel Variables...1887worker2 # [ 2.184268] systemd-modules-load[74]: Inserted module 'dm_mod'1888worker2 # [ 2.187313] systemd-modules-load[74]: Module 'virtio_balloon' is built in1889worker2 # [ 2.192663] systemd-modules-load[74]: Module 'virtio_console' is built in1890worker2 # [ 2.193860] systemd-modules-load[74]: Inserted module 'virtio_gpu'1891worker2 # [ 2.194895] systemd-modules-load[74]: Module 'virtio_rng' is built in1892lb # [ 2.339932] systemd[1]: Started Rule-based Manager for Device Events and Files.1893worker2 # [ 2.212653] systemd[1]: Started Journal Service.1894worker1 # [ 2.293734] systemd[1]: Finished Load Kernel Modules.1895client # [ 2.215552] Console: switching to colour frame buffer device 160x501896worker1 # [ 2.297959] systemd[1]: Starting Apply Kernel Variables...1897worker1 # [ 2.285209] systemd-modules-load[74]: Inserted module 'dm_mod'1898worker1 # [ 2.286384] systemd-modules-load[74]: Module 'virtio_balloon' is built in1899worker1 # [ 2.313612] systemd[1]: Started Journal Service.1900worker1 # [ 2.296492] systemd-modules-load[74]: Module 'virtio_console' is built in1901worker1 # [ 2.301849] systemd-modules-load[74]: Inserted module 'virtio_gpu'1902client # [ 2.250708] systemd[1]: Started Journal Service.1903client # [ 2.252360] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1904client # [ 2.241100] systemd-modules-load[74]: Inserted module 'dm_mod'1905worker2 # [ 2.237893] systemd[1]: Starting Create System Files and Directories...1906worker1 # [ 2.312441] systemd-modules-load[74]: Module 'virtio_rng' is built in1907client # [ 2.246986] systemd-modules-load[74]: Module 'virtio_balloon' is built in1908worker1 # [ 2.318564] systemd[1]: Starting Create System Files and Directories...1909client # [ 2.254697] systemd-modules-load[74]: Module 'virtio_console' is built in1910client # [ 2.260478] systemd[1]: Finished Create Static Device Nodes in /dev.1911client # [ 2.264380] systemd[1]: Reached target Preparation for Local File Systems.1912client # [ 2.265554] systemd[1]: Reached target Local File Systems.1913client # [ 2.266486] systemd-modules-load[74]: Inserted module 'virtio_gpu'1914client # [ 2.276413] systemd-modules-load[74]: Module 'virtio_rng' is built in1915client # [ 2.277519] systemd[1]: Starting Create System Files and Directories...1916client # [ 2.278675] systemd[1]: Starting Rule-based Manager for Device Events and Files...1917lb # [ 2.414934] systemd[1]: Starting Virtual Console Setup...1918worker2 # [ 2.272968] systemd[1]: Finished Apply Kernel Variables.1919worker1 # [ 2.351041] systemd[1]: Finished Apply Kernel Variables.1920client # [ 2.285255] systemd[1]: Finished Load Kernel Modules.1921worker2 # [ 2.285998] systemd-udevd[80]: Using default interface naming scheme 'v261'.1922worker2 # [ 2.293254] systemd[1]: Finished Create System Files and Directories.1923worker1 # [ 2.369541] systemd-udevd[80]: Using default interface naming scheme 'v261'.1924client # [ 2.313145] systemd[1]: Starting Apply Kernel Variables...1925worker1 # [ 2.388105] systemd[1]: Finished Create System Files and Directories.1926worker2 # [ 2.321231] systemd[1]: Started Rule-based Manager for Device Events and Files.1927lb # [ 2.472643] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1928worker1 # [ 2.409295] systemd[1]: Started Rule-based Manager for Device Events and Files.1929lb # [ 2.480712] systemd[1]: Finished Virtual Console Setup.1930client # [ 2.345585] systemd[1]: Finished Create System Files and Directories.1931client # [ 2.365543] systemd[1]: Finished Apply Kernel Variables.1932client # [ 2.377904] systemd-udevd[81]: Using default interface naming scheme 'v261'.1933worker2 # [ 2.396323] systemd[1]: Starting Virtual Console Setup...1934worker1 # [ 2.472788] systemd[1]: Starting Virtual Console Setup...1935client # [ 2.407060] systemd[1]: Started Rule-based Manager for Device Events and Files.1936worker2 # [ 2.448719] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1937worker2 # [ 2.452740] systemd[1]: Finished Virtual Console Setup.1938worker1 # [ 2.532673] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1939worker1 # [ 2.536724] systemd[1]: Finished Virtual Console Setup.1940client # [ 2.479815] systemd[1]: Starting Virtual Console Setup...1941client # [ 2.524577] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942client # [ 2.530331] systemd[1]: Finished Virtual Console Setup.1943lb # [ 3.085192] systemd[1]: Finished Coldplug All udev Devices.1944lb # [ 3.086226] systemd[1]: Reached target System Initialization.1945lb # [ 3.087132] systemd[1]: Reached target Basic System.1946worker2 # [ 3.050961] systemd[1]: Finished Coldplug All udev Devices.1947worker2 # [ 3.052707] systemd[1]: Reached target System Initialization.1948worker2 # [ 3.056149] systemd[1]: Reached target Basic System.1949worker1 # [ 3.150478] systemd[1]: Finished Coldplug All udev Devices.1950worker1 # [ 3.151507] systemd[1]: Reached target System Initialization.1951worker1 # [ 3.152386] systemd[1]: Reached target Basic System.1952client # [ 3.112494] systemd[1]: Finished Coldplug All udev Devices.1953client # [ 3.114277] systemd[1]: Reached target System Initialization.1954client # [ 3.115203] systemd[1]: Reached target Basic System.1955lb # [ 3.251553] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1956lb # [ 3.285255] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1957lb # [ 3.290604] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1958lb # [ 3.359707] systemd[1]: Found device /dev/disk/by-label/nixos.1959worker2 # [ 3.218065] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1960lb # [ 3.362667] systemd[1]: Reached target Initrd Root Device.1961lb # [ 3.368155] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1962worker2 # [ 3.248714] (udev-worker)[102]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1963worker2 # [ 3.254181] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1964worker1 # [ 3.329676] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1965client # [ 3.268446] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1966worker1 # [ 3.357344] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1967worker1 # [ 3.361685] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1968lb # [ 3.430450] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1969lb # [ 3.438862] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1970client # [ 3.303189] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1971client # [ 3.308529] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1972lb # [ 3.452600] systemd[1]: Mounting /sysroot...1973worker2 # [ 3.319984] systemd[1]: Found device /dev/disk/by-label/nixos.1974worker2 # [ 3.324657] systemd[1]: Reached target Initrd Root Device.1975worker2 # [ 3.329375] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1976lb # [ 3.505177] EXT4-fs (vda): mounted filesystem 726ef101-fbce-4685-8eaa-7a481dbde062 r/w with ordered data mode. Quota mode: none.1977lb # [ 3.493667] systemd[1]: Mounted /sysroot.1978lb # [ 3.496071] systemd[1]: Reached target Initrd Root File System.1979lb # [ 3.498597] systemd[1]: Starting Mountpoints Configured in the Real Root...1980client # [ 3.375737] systemd[1]: Found device /dev/disk/by-label/nixos.1981client # [ 3.377241] systemd[1]: Reached target Initrd Root Device.1982worker1 # [ 3.446566] systemd[1]: Found device /dev/disk/by-label/nixos.1983client # [ 3.380888] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1984worker1 # [ 3.451123] systemd[1]: Reached target Initrd Root Device.1985worker1 # [ 3.456706] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1986lb # [ 3.532170] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1987worker2 # [ 3.391627] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1988lb # [ 3.537259] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1989lb # [ 3.542494] systemd[1]: Reloading...1990worker2 # [ 3.403957] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1991worker2 # [ 3.408338] systemd[1]: Mounting /sysroot...1992client # [ 3.440515] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1993worker1 # [ 3.510925] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1994client # [ 3.448246] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1995worker1 # [ 3.520200] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1996worker1 # [ 3.522893] systemd[1]: Mounting /sysroot...1997worker2 # [ 3.464562] EXT4-fs (vda): mounted filesystem df3c2ef2-03fe-410f-b293-5211d898b339 r/w with ordered data mode. Quota mode: none.1998client # [ 3.459128] systemd[1]: Mounting /sysroot...1999worker2 # [ 3.457415] systemd[1]: Mounted /sysroot.2000worker2 # [ 3.458659] systemd[1]: Reached target Initrd Root File System.
loading 1,483 hidden lines…
3484lb # [ 23.447812] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3485lb # [ 23.450597] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3486lb # [ 23.456596] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3487lb # [ 23.458843] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3488lb # [ 23.461297] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3489lb # [ 23.463631] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3490lb # [ 23.466119] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3491lb # [ 23.470706] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3492lb # [ 23.473353] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3493lb # [ 23.476837] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3494lb # [ 23.478705] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3495lb # [ 23.482006] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3496lb # [ 23.484464] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3497lb # [ 23.487455] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3498lb # [ 23.490603] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3499lb # [ 23.494456] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3500lb # [ 23.504348] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13501lb # [ 23.507280] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3502lb # [ 23.510784] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3503lb # [ 23.514576] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3504lb # [ 23.517998] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3505lb # [ 23.522015] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3506lb # [ 23.532934] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3507lb # [ 23.542552] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3508lb # [ 23.548295] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3509lb # [ 23.556111] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3510lb # [ 23.558760] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3511lb # [ 23.561825] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3512lb # [ 23.563830] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3513lb # [ 23.566453] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3514lb # [ 23.570523] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3515lb # [ 23.574718] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3516lb # [ 23.579099] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3517lb # [ 23.582430] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3518lb # [ 23.586919] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3519lb # [ 23.591081] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3520lb # [ 23.594185] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3521lb # [ 23.602950] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3522lb # [ 23.609981] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3523lb # [ 23.617380] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3524lb # [ 23.622579] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3525lb # [ 23.628846] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3526lb # [ 23.636071] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3527lb # [ 23.668600] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3528lb # [ 23.670902] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23529lb # [ 23.673350] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83530lb # [ 23.678214] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3531lb # [ 23.683159] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3532lb # [ 23.685910] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3533lb # [ 23.694803] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3534worker2 # [ 23.550859] systemd[1]: Reached target Network is Online.3535lb # [ 23.697305] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3536worker1 # [ 23.627121] systemd[1]: Starting Nix worker-protocol over gRPC...3537lb # [ 23.701777] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3538worker2 # [ 23.565897] systemd[1]: Starting scheduler-token.service...3539lb # [ 23.705203] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3540lb # [ 23.714195] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3541lb # [ 23.724363] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3542lb # [ 23.727465] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3543lb # [ 23.732430] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3544lb # [ 23.735067] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3545lb # [ 23.741226] envoy[922]: [2026-09-20 12:22:01.694][922][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3546lb # [ 23.745331] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23547lb # [ 23.752210] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3548lb # [ 23.754164] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3549lb # [ 23.755916] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3550lb # [ 23.759885] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3551lb # [ 23.762202] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3552lb # [ 23.765558] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3553lb # [ 23.771689] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3554lb # [ 23.773996] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3555lb # [ 23.780894] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3556lb # [ 23.782886] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3557lb # [ 23.785473] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3558lb # [ 23.787437] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3559lb # [ 23.790658] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3560lb # [ 23.794354] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3561lb # [ 23.801424] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23562lb # [ 23.803319] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3563lb # [ 23.806462] envoy[922]: [2026-09-20 12:22:01.695][922][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3564lb # [ 23.810149] envoy[922]: [2026-09-20 12:22:01.735][922][info][main] [source/server/server.cc:531] HTTP header map info:3565lb # [ 23.811552] envoy[922]: [2026-09-20 12:22:01.737][922][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3566lb # [ 23.827380] envoy[922]: [2026-09-20 12:22:01.737][922][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3567lb # [ 23.829247] envoy[922]: [2026-09-20 12:22:01.737][922][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3568lb # [ 23.838733] envoy[922]: [2026-09-20 12:22:01.737][922][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3569lb # [ 23.841188] envoy[922]: [2026-09-20 12:22:01.859][922][info][main] [source/server/server.cc:968] runtime: {}3570lb # [ 23.842749] envoy[922]: [2026-09-20 12:22:01.873][922][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3571lb # [ 23.844946] envoy[922]: [2026-09-20 12:22:01.873][922][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013572lb # [ 23.847634] envoy[922]: [2026-09-20 12:22:01.873][922][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013573lb # [ 23.849805] envoy[922]: [2026-09-20 12:22:01.878][922][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3574lb # [ 23.851881] envoy[922]: [2026-09-20 12:22:01.879][922][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3575lb # [ 23.855873] envoy[922]: [2026-09-20 12:22:01.879][922][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3576lb # [ 23.858221] envoy[922]: [2026-09-20 12:22:02.110][922][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3577lb # [ 23.860211] envoy[922]: [2026-09-20 12:22:02.167][922][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3578lb # [ 23.862607] envoy[922]: [2026-09-20 12:22:02.168][922][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3579lb # [ 23.866553] envoy[922]: [2026-09-20 12:22:02.168][922][info][main] [source/server/server.cc:1077] starting main dispatch loop3580worker2 # [ 23.739155] systemd[1]: scheduler-token.service: Deactivated successfully.3581worker2 # [ 23.741849] systemd[1]: Finished scheduler-token.service.3582worker2 # [ 23.746756] systemd[1]: scheduler-token.service: Consumed 66ms CPU time over 176ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3583worker2 # [ 23.751605] systemd[1]: Starting Nix worker-protocol over gRPC...3584worker1 # [ 23.906976] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3585worker1 # [ 23.919773] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3586worker1 # [ 23.922797] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13587worker1 # [ 23.969420] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3588worker1 # [ 23.985482] systemd[1]: Started Nix worker-protocol over gRPC.3589worker1 # [ 24.006764] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3590lb # [ 24.080368] envoy[922]: [2026-09-20 12:22:02.496][922][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3591lb # [ 24.088384] envoy[922]: [2026-09-20 12:22:02.496][922][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3592lb # [ 24.094382] envoy[922]: [2026-09-20 12:22:02.496][922][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3593lb # [ 24.100006] envoy[922]: [2026-09-20 12:22:02.496][922][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3594worker2 # [ 23.988441] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3595worker2 # [ 24.002675] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3596worker2 # [ 24.005485] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13597worker2 # [ 24.063303] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3598worker2 # [ 24.070328] systemd[1]: Started Nix worker-protocol over gRPC.3599worker2 # [ 24.113949] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500513600worker2 # [ 24.120615] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3601worker1 # [ 24.208230] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3602worker2 # [ 24.324951] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500513603worker2 # [ 24.337191] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3604worker2 # [ 24.532485] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500513605worker2 # [ 24.538382] nix-grpc-daemon[776]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3606worker1 # [ 24.608875] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3607worker2 # [ 24.740200] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500513608worker2 # [ 24.746427] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3609worker2 # [ 24.947980] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500513610worker2 # [ 24.953803] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3611worker2 # [ 25.158379] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500513612worker2 # [ 25.162940] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3613worker1 # [ 25.413534] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500513614worker1 # [ 25.414023] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3615worker2 # [ 25.359070] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 25.364906] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3617worker1 # [ 25.614024] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500513618worker1 # [ 25.618272] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3619worker2 # [ 25.567786] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500513620worker2 # [ 25.574912] nix-grpc-daemon[776]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3621worker1 # [ 25.819858] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500513622worker1 # [ 25.826124] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3623worker2 # [ 25.776571] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500513624worker2 # [ 25.782410] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3625worker1 # [ 26.026763] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500513626worker1 # [ 26.032517] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker2 # [ 25.984838] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 25.990481] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3629worker1 # [ 26.233687] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500513630worker1 # [ 26.239495] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3631worker2 # [ 26.194759] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500513632worker2 # [ 26.199229] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3633worker1 # [ 26.443277] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500513634worker1 # [ 26.447678] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker2 # [ 26.395728] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 26.402243] nix-grpc-daemon[776]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3637worker1 # [ 26.644156] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500513638worker1 # [ 26.650013] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker2 # [ 26.603255] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 26.609751] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3641worker1 # [ 26.851182] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500513642worker1 # [ 26.857025] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker2 # [ 26.811014] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 26.817220] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3645worker1 # [ 27.058079] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500513646worker1 # [ 27.063785] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker2 # [ 27.018533] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 27.024376] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3649worker1 # [ 27.264665] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500513650worker1 # [ 27.270620] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker2 # [ 27.228567] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 27.233044] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3653worker1 # [ 27.474458] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500513654worker1 # [ 27.478907] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker2 # [ 27.429483] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 27.435344] nix-grpc-daemon[776]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3657worker1 # [ 27.675798] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500513658worker1 # [ 27.681726] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker2 # [ 27.637760] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500513660worker2 # [ 27.645777] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3661worker1 # [ 27.883529] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500513662worker1 # [ 27.889465] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker2 # [ 27.846775] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500513664worker2 # [ 27.853418] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3665worker1 # [ 28.090305] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500513666worker1 # [ 28.096409] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker2 # [ 28.055484] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500513668worker2 # [ 28.061664] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3669worker1 # [ 28.297495] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500513670worker1 # [ 28.301956] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker2 # [ 28.265679] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500513672worker2 # [ 28.270290] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3673worker1 # [ 28.505256] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500513674worker1 # [ 28.510699] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker2 # [ 28.466888] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500513676worker2 # [ 28.472665] nix-grpc-daemon[776]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3677worker1 # [ 28.711638] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500513678worker1 # [ 28.717250] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker2 # [ 28.674531] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500513680worker2 # [ 28.680705] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3681worker1 # [ 28.918451] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500513682worker1 # [ 28.924405] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3683worker2 # [ 28.882675] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500513684worker2 # [ 28.888951] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3685worker1 # [ 29.125481] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500513686worker1 # [ 29.131603] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3687worker2 # [ 29.090794] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500513688worker2 # [ 29.097105] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3689worker1 # [ 29.332854] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500513690worker1 # [ 29.338922] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3691worker2 # [ 29.301192] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500513692worker2 # [ 29.305888] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3693worker1 # [ 29.540398] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500513694worker1 # [ 29.543175] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3695worker2 # [ 29.502330] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500513696worker2 # [ 29.509340] nix-grpc-daemon[776]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3697worker1 # [ 29.745132] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500513698worker1 # [ 29.752093] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3699worker2 # [ 29.713357] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500513700worker2 # [ 29.718524] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3701worker1 # [ 29.952733] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500513702worker1 # [ 29.955601] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3703worker2 # [ 29.915301] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500513704worker2 # [ 29.921562] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3705worker1 # [ 30.156361] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500513706worker1 # [ 30.159597] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3707worker2 # [ 30.123239] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500513708worker2 # [ 30.131406] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3709worker1 # [ 30.360502] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500513710worker1 # [ 30.364113] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3711worker2 # [ 30.334149] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500513712worker2 # [ 30.339895] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3713worker1 # [ 30.569189] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500513714worker1 # [ 30.573750] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3715worker2 # [ 30.541928] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500513716worker2 # [ 30.548537] nix-grpc-daemon[776]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3717worker1 # [ 30.769247] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_connected addr=lb:500513718worker1 # [ 30.774836] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3719worker2 # [ 30.749933] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_connected addr=lb:500513720worker2 # [ 30.755622] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3721worker1 # [ 30.975628] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_connected addr=lb:500513722worker1 # [ 30.981355] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3723worker2 # [ 30.957416] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_connected addr=lb:500513724worker2 # [ 30.960540] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3725worker1 # [ 31.181655] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_connected addr=lb:500513726worker1 # [ 31.188116] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3727worker2 # [ 31.161724] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_connected addr=lb:500513728worker2 # [ 31.167632] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3729worker1 # [ 31.389131] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_connected addr=lb:500513730worker1 # [ 31.393541] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3731worker2 # [ 31.369226] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_connected addr=lb:500513732worker2 # [ 31.372609] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3733worker1 # [ 31.596247] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_connected addr=lb:500513734worker1 # [ 31.598856] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3735worker2 # [ 31.574664] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_connected addr=lb:500513736worker2 # [ 31.580580] nix-grpc-daemon[776]: ts=2026-09-20T12:22:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3737worker1 # [ 31.797792] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_connected addr=lb:500513738worker1 # [ 31.803715] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3739worker2 # [ 31.782290] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_connected addr=lb:500513740worker2 # [ 31.788454] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3741worker1 # [ 32.005128] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_connected addr=lb:500513742worker1 # [ 32.011209] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3743worker2 # [ 31.990136] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_connected addr=lb:500513744worker2 # [ 31.996105] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3745worker1 # [ 32.212253] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_connected addr=lb:500513746worker1 # [ 32.218107] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3747worker2 # [ 32.197892] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_connected addr=lb:500513748worker2 # [ 32.203814] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3749worker1 # [ 32.419155] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_connected addr=lb:500513750worker1 # [ 32.425647] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3751worker2 # [ 32.408467] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_connected addr=lb:500513752worker2 # [ 32.412864] nix-grpc-daemon[776]: ts=2026-09-20T12:22:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3753worker1 # [ 32.628980] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_connected addr=lb:500513754worker1 # [ 32.635394] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3755worker2 # [ 32.609858] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_connected addr=lb:500513756worker2 # [ 32.616199] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3757worker1 # [ 32.836876] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_connected addr=lb:500513758worker1 # [ 32.843045] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3759worker2 # [ 32.817348] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_connected addr=lb:500513760worker2 # [ 32.821573] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3761worker1 # [ 33.044172] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_connected addr=lb:500513762worker1 # [ 33.049965] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3763worker2 # [ 33.022905] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_connected addr=lb:500513764worker2 # [ 33.027254] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3765worker1 # [ 33.250314] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_connected addr=lb:500513766worker1 # [ 33.253534] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3767worker2 # [ 33.228845] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_connected addr=lb:500513768worker2 # [ 33.235238] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3769worker1 # [ 33.454874] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_connected addr=lb:500513770worker1 # [ 33.458854] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3771worker2 # [ 33.439418] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_connected addr=lb:500513772worker2 # [ 33.444282] nix-grpc-daemon[776]: ts=2026-09-20T12:22:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3773worker1 # [ 33.663700] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_connected addr=lb:500513774worker1 # [ 33.668659] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3775worker2 # [ 33.640498] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_connected addr=lb:500513776worker2 # [ 33.646690] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3777worker1 # [ 33.865103] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_connected addr=lb:500513778worker1 # [ 33.871385] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3779worker2 # [ 33.847546] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_connected addr=lb:500513780worker2 # [ 33.850052] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3781worker1 # [ 34.072927] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_connected addr=lb:500513782worker1 # [ 34.078577] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3783worker2 # [ 34.051953] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_connected addr=lb:500513784worker2 # [ 34.057680] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3785worker1 # [ 34.279780] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_connected addr=lb:500513786worker1 # [ 34.285807] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3787lb # [ 34.355055] rustfs-bucket-start[1023]: mb s3://farm3788lb # [ 34.383185] systemd[1]: Finished rustfs-bucket.service.3789worker2 # [ 34.259470] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_connected addr=lb:500513790worker2 # [ 34.265467] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3791lb # [ 34.414468] systemd[1]: Starting niks3 server...3792worker1 # [ 34.486981] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_connected addr=lb:500513793worker1 # [ 34.493935] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3794worker2 # [ 34.469187] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_connected addr=lb:500513795worker2 # [ 34.473198] nix-grpc-daemon[776]: ts=2026-09-20T12:22:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3796lb # [ 34.688748] postgres[1048]: [1048] ERROR: relation "goose_db_version" does not exist at character 363797lb # [ 34.690138] postgres[1048]: [1048] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3798lb # [ 34.733500] niks3-server[1041]: 2026/09/20 12:22:13 OK 20241026095416_initial_model.sql (27.04ms)3799lb # [ 34.739063] niks3-server[1041]: 2026/09/20 12:22:13 OK 20251210153512_drop_unused_gin_index.sql (5.91ms)3800lb # [ 34.746254] niks3-server[1041]: 2026/09/20 12:22:13 OK 20251218171726_add_pins.sql (7.11ms)3801lb # [ 34.752245] niks3-server[1041]: 2026/09/20 12:22:13 OK 20260628120000_add_object_size_and_stats.sql (5.94ms)3802lb # [ 34.758334] niks3-server[1041]: 2026/09/20 12:22:13 OK 20260905000000_add_claims.sql (6.03ms)3803lb # [ 34.765119] niks3-server[1041]: 2026/09/20 12:22:13 OK 20260920000000_drop_claims.sql (6.58ms)3804lb # [ 34.766561] niks3-server[1041]: 2026/09/20 12:22:13 goose: successfully migrated database to version: 202609200000003805worker1 # [ 34.697481] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_connected addr=lb:500513806lb # [ 34.772898] niks3-server[1041]: 2026/09/20 12:22:13 OK 1_commit_pending_closure.sql (7.75ms)3807worker1 # [ 34.701954] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3808lb # [ 34.776412] niks3-server[1041]: 2026/09/20 12:22:13 OK 2_object_stats_trigger.sql (3.36ms)3809lb # [ 34.777757] niks3-server[1041]: 2026/09/20 12:22:13 goose: up to current file version: 23810lb # [ 34.782561] niks3-server[1041]: 2026/09/20 12:22:13 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3811worker2 # [ 34.669913] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_connected addr=lb:500513812worker2 # [ 34.675805] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3813lb # [ 34.838362] niks3-server[1041]: 2026/09/20 12:22:13 INFO Read proxy enabled — serving cache objects from S33814lb # [ 34.839892] niks3-server[1041]: 2026/09/20 12:22:13 INFO Using socket-activated listener address=0.0.0.0:57513815lb # [ 34.843792] niks3-server[1041]: 2026/09/20 12:22:13 INFO systemd watchdog enabled interval=15s3816lb # [ 34.849371] niks3-server[1041]: 2026/09/20 12:22:13 INFO Starting HTTP server address=0.0.0.0:57513817lb # [ 34.850646] systemd[1]: Started niks3 server.3818lb # [ 34.851317] systemd[1]: Reached target Multi-User System.3819lb # [ 34.857276] systemd[1]: Startup finished in 1.159s (kernel) + 5.367s (initrd) + 28.326s (userspace) = 34.853s.3820lb # [ 34.862567] niks3-server[1041]: 2026/09/20 12:22:13 INFO lead: acquired remote=192.168.1.4:406343821worker2 # [ 34.721260] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_take_over3822worker1 # [ 34.898723] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_connected addr=lb:500513823worker1 # [ 34.905434] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3824worker2 # [ 34.877966] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_connected addr=lb:500513825worker2 # [ 34.885074] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3826lb: (finished: waiting for unit niks3.service, in 17.53 seconds)3827lb: waiting for TCP port 5751 on localhost3828worker1 # [ 35.103231] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_connected addr=lb:500513829worker1 # [ 35.109571] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3830lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3831lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds)3832lb: waiting for unit envoy.service3833worker2 # [ 35.086531] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_connected addr=lb:500513834worker2 # [ 35.092643] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3835lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3836lb: waiting for TCP port 50051 on localhost3837lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3838lb # [ 35.323510] envoy[922]: conn peer=[::1]:55524 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=43839lb: (finished: waiting for TCP port 50051 on localhost, in 0.06 seconds)3840worker1 # [ 35.312157] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_connected addr=lb:500513841worker2 # [ 35.247484] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:565983842worker2 # [ 35.254095] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03843worker2 # [ 35.293743] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=scheduler_connected addr=lb:500513844worker2 # [ 35.312605] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=oidc_jwks provider=mock keys=13845worker2 # [ 35.315334] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:565983846worker2 # [ 35.317882] nix-grpc-daemon[776]: ts=2026-09-20T12:22:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03847worker2 # [ 35.340610] systemd[1]: Starting scheduler-token.service...3848worker2 # [ 35.446246] systemd[1]: scheduler-token.service: Deactivated successfully.3849worker2 # [ 35.448484] systemd[1]: Finished scheduler-token.service.3850worker2 # [ 35.452810] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 109ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3851lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3852lb: must succeed: curl -sf localhost:9901/clusters3853lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3854lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)3855subtest: one node schedules and both builders hold a WorkerSession on it3856lb: must succeed: curl -sf localhost:9901/clusters3857lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3858worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3859worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)3860lb: must succeed: curl -sf localhost:9901/clusters3861lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)3862lb: must succeed: curl -sf localhost:9901/clusters3863lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)3864lb: must succeed: curl -sf localhost:9901/clusters3865lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3866lb: must succeed: curl -sf localhost:9901/clusters3867lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3868worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'3869worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.08 seconds)3870worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3871worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)3872lb: must succeed: curl -sf localhost:9901/clusters3873lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3874lb: must succeed: curl -sf localhost:9901/clusters3875lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3876worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics3877worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.11 seconds)3878worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3879worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)3880worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3881worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)3882worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3883worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)3884(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.98 seconds)3885subtest: balancer auth: client cert, bearer token, nothing, unknown CN3886worker1 # [ 36.965645] nix-grpc-daemon[776]: ts=2026-09-20T12:22:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:499843887worker1 # [ 36.987811] systemd[1]: Started Nix Daemon.3888worker1 # [ 37.309332] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3889worker1 # [ 37.354781] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 1/5)3890worker1 # [ 37.426278] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 183 ms (attempt 2/5)3891worker1 # [ 37.616343] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 295 ms (attempt 3/5)3892worker1 # [ 37.918110] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 4/5)3893worker1 # [ 37.992625] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3894worker2 # [ 37.976443] nix-grpc-daemon[776]: ts=2026-09-20T12:22:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:566063895worker2 # [ 37.994198] systemd[1]: Started Nix Daemon.3896worker2 # [ 38.333770] nix-daemon[858]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3897worker2 # [ 38.366814] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 1/5)3898worker2 # [ 38.410105] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 2/5)3899worker2 # [ 38.448597] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 325 ms (attempt 3/5)3900worker2 # [ 38.782529] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 430 ms (attempt 4/5)3901worker2 # [ 39.227051] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3902worker2 # [ 39.241128] nix-grpc-daemon[776]: ts=2026-09-20T12:22:17Z level=debug event=path_info_miss path=qbvmimlqs6jxl6sssayj2w8bdy8wgcr3-nixos-system-client-test error="error: path '/nix/store/qbvmimlqs6jxl6sssayj2w8bdy8wgcr3-nixos-system-client-test' is required, but there is no substituter that can build it"3903worker1 # [ 39.326975] nix-grpc-daemon[776]: ts=2026-09-20T12:22:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:499843904worker1 # [ 39.346676] nix-grpc-daemon[776]: ts=2026-09-20T12:22:17Z level=debug event=path_info_miss path=qbvmimlqs6jxl6sssayj2w8bdy8wgcr3-nixos-system-client-test error="error: path '/nix/store/qbvmimlqs6jxl6sssayj2w8bdy8wgcr3-nixos-system-client-test' is required, but there is no substituter that can build it"3905client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3906client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds)3907client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3908client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds)3909worker1 # [ 39.859919] nix-grpc-daemon[776]: ts=2026-09-20T12:22:18Z level=info event=oidc_jwks provider=mock keys=13910worker1 # [ 39.866509] nix-grpc-daemon[776]: ts=2026-09-20T12:22:18Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:499843911worker2 # [ 39.810379] nix-grpc-daemon[776]: ts=2026-09-20T12:22:18Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:566063912worker2 # [ 39.827740] nix-grpc-daemon[776]: ts=2026-09-20T12:22:18Z level=debug event=path_info_miss path=qbvmimlqs6jxl6sssayj2w8bdy8wgcr3-nixos-system-client-test error="error: path '/nix/store/qbvmimlqs6jxl6sssayj2w8bdy8wgcr3-nixos-system-client-test' is required, but there is no substituter that can build it"3913worker1 # [ 39.909164] nix-grpc-daemon[776]: ts=2026-09-20T12:22:18Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:499843914worker1 # [ 39.923663] nix-grpc-daemon[776]: ts=2026-09-20T12:22:18Z level=debug event=path_info_miss path=qbvmimlqs6jxl6sssayj2w8bdy8wgcr3-nixos-system-client-test error="error: path '/nix/store/qbvmimlqs6jxl6sssayj2w8bdy8wgcr3-nixos-system-client-test' is required, but there is no substituter that can build it"3915client: must succeed: rm -r /var/lib/nix-grpc-store3916client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3917worker1 # [ 40.276116] nix-grpc-daemon[776]: ts=2026-09-20T12:22:18Z level=info event=denied method=QueryMissing cn=- role=none3918worker2 # [ 40.478335] nix-grpc-daemon[776]: ts=2026-09-20T12:22:18Z level=info event=denied method=QueryMissing cn=stranger role=none3919(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.99 seconds)3920subtest: DAG build is scheduled across workers and lands in the cache3921client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23922worker2 # [ 40.767094] nix-grpc-daemon[776]: ts=2026-09-20T12:22:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:566063923client # don't know how to build these paths:3924client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3925worker2 # [ 40.790027] nix-grpc-daemon[776]: ts=2026-09-20T12:22:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566063926worker2 # [ 40.841596] nix-grpc-daemon[776]: ts=2026-09-20T12:22:19Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03927worker2 # [ 40.844922] nix-grpc-daemon[776]: ts=2026-09-20T12:22:19Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13928worker1 # [ 40.974355] nix-grpc-daemon[776]: ts=2026-09-20T12:22:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499843929worker1 # [ 41.002092] nix-grpc-daemon[776]: ts=2026-09-20T12:22:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499843930client # copying 1 paths to 'lb:50051'...3931worker1 # [ 41.022835] nix-grpc-daemon[776]: ts=2026-09-20T12:22:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499843932client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3933worker1 # [ 41.073461] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3934worker1 # [ 41.115787] nix-grpc-daemon[776]: ts=2026-09-20T12:22:19Z level=info event=niks3_push_started pid=8473935worker1 # [ 41.438139] nix-grpc-daemon[847]: time=2026-09-20T12:22:19.866Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""3936worker1 # [ 41.700684] nix-daemon[837]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3937worker1 # [ 41.726751] nix-daemon[837]: reaped child process 864, status = succeeded3938worker1 # [ 41.941856] nix-daemon[837]: accepted connection from pid 866, user nix-grpc-daemon (trusted)3939worker1 # [ 41.966530] nix-daemon[837]: reaped child process 869, status = succeeded3940lb # [ 42.051018] niks3-server[1041]: 2026/09/20 12:22:20 INFO Received uploads request method=POST path=/api/pending_closures3941worker1 # [ 42.024207] nix-grpc-daemon[847]: time=2026-09-20T12:22:20.455Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3942worker1 # [ 42.026965] nix-grpc-daemon[847]: time=2026-09-20T12:22:20.457Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3943lb # [ 42.160835] niks3-server[1041]: 2026/09/20 12:22:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3944lb # [ 42.177462] niks3-server[1041]: 2026/09/20 12:22:20 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3945lb # [ 42.207308] niks3-server[1041]: 2026/09/20 12:22:20 INFO Signed narinfos id=1 count=13946worker1 # [ 42.144199] nix-grpc-daemon[847]: time=2026-09-20T12:22:20.574Z level=INFO msg="Uploading 1 narinfos"3947lb # [ 42.231625] niks3-server[1041]: 2026/09/20 12:22:20 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3948lb # [ 42.238827] niks3-server[1041]: 2026/09/20 12:22:20 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3949lb # [ 42.245118] niks3-server[1041]: 2026/09/20 12:22:20 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3950lb # [ 42.260392] niks3-server[1041]: 2026/09/20 12:22:20 INFO Completed upload id=13951worker1 # [ 42.192710] nix-grpc-daemon[847]: time=2026-09-20T12:22:20.623Z level=INFO msg="Upload complete. (744ms)"3952worker1 # [ 42.207717] nix-grpc-daemon[776]: ts=2026-09-20T12:22:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=1 paths=1 nar_bytes_in=5043953worker1 # [ 42.225810] nix-grpc-daemon[776]: ts=2026-09-20T12:22:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499843954worker1 # [ 42.242019] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3955worker1 # [ 42.249597] nix-daemon[837]: reaped child process 845, status = succeeded3956client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3957client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3958worker1 # [ 42.269655] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3959lb # [ 43.695316] envoy[922]: conn peer=[2001:db8:1::1]:44400 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=24423960lb # [ 43.700863] envoy[922]: conn peer=[2001:db8:1::1]:44412 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=933961lb # [ 43.705820] envoy[922]: conn peer=[2001:db8:1::1]:44416 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=173962lb # [ 43.710560] envoy[922]: conn peer=[2001:db8:1::1]:44422 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=182 ms=253963client # farm-a> LOG-farm-a-t13964worker1 # [ 43.929207] nix-daemon[837]: reaped child process 873, status = succeeded3965worker1 # [ 44.145608] nix-daemon[837]: accepted connection from pid 888, user nix-grpc-daemon (trusted)3966worker1 # [ 44.170738] nix-daemon[837]: reaped child process 891, status = succeeded3967lb # [ 44.257052] niks3-server[1041]: 2026/09/20 12:22:22 INFO Received uploads request method=POST path=/api/pending_closures3968worker1 # [ 44.210437] nix-grpc-daemon[847]: time=2026-09-20T12:22:22.639Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3969worker1 # [ 44.212796] nix-grpc-daemon[847]: time=2026-09-20T12:22:22.639Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3970lb # [ 44.332440] niks3-server[1041]: 2026/09/20 12:22:22 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3971lb # [ 44.342952] niks3-server[1041]: 2026/09/20 12:22:22 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3972lb # [ 44.354377] niks3-server[1041]: 2026/09/20 12:22:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3973worker1 # [ 44.292170] nix-grpc-daemon[847]: time=2026-09-20T12:22:22.721Z level=INFO msg="Uploading 1 narinfos"3974lb # [ 44.361509] niks3-server[1041]: 2026/09/20 12:22:22 INFO Signed narinfos id=2 count=13975lb # [ 44.365195] niks3-server[1041]: 2026/09/20 12:22:22 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3976lb # [ 44.380428] niks3-server[1041]: 2026/09/20 12:22:22 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3977lb # [ 44.389929] niks3-server[1041]: 2026/09/20 12:22:22 INFO Completed upload id=23978worker1 # [ 44.321367] nix-grpc-daemon[847]: time=2026-09-20T12:22:22.752Z level=INFO msg="Upload complete. (434ms)"3979lb # [ 44.392948] niks3-server[1041]: 2026/09/20 12:22:22 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3980worker1 # [ 44.333585] nix-grpc-daemon[776]: ts=2026-09-20T12:22:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13981worker1 # [ 44.356509] nix-daemon[837]: reaped child process 871, status = succeeded3982worker2 # [ 44.284538] nix-grpc-daemon[776]: ts=2026-09-20T12:22:22Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03983worker1 # [ 44.418614] nix-grpc-daemon[776]: ts=2026-09-20T12:22:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499843984worker1 # [ 44.441836] nix-grpc-daemon[776]: ts=2026-09-20T12:22:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499843985worker1 # [ 44.463532] nix-grpc-daemon[847]: time=2026-09-20T12:22:22.894Z level=INFO msg="All 1 paths already cached"3986client # copying 1 paths to 'lb:50051'...3987client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3988worker1 # [ 44.475446] nix-grpc-daemon[776]: ts=2026-09-20T12:22:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499843989worker1 # [ 44.492761] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3990worker1 # [ 44.754506] nix-daemon[837]: accepted connection from pid 895, user nix-grpc-daemon (trusted)3991worker1 # [ 44.783321] nix-daemon[837]: reaped child process 898, status = succeeded3992worker2 # [ 44.293622] nix-grpc-daemon[776]: ts=2026-09-20T12:22:22Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13993worker1 # [ 45.010210] nix-daemon[837]: accepted connection from pid 900, user nix-grpc-daemon (trusted)3994worker1 # [ 45.032121] nix-daemon[837]: reaped child process 904, status = succeeded3995lb # [ 45.115149] niks3-server[1041]: 2026/09/20 12:22:23 INFO Received uploads request method=POST path=/api/pending_closures3996worker1 # [ 45.063824] nix-grpc-daemon[847]: time=2026-09-20T12:22:23.494Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3997worker1 # [ 45.066493] nix-grpc-daemon[847]: time=2026-09-20T12:22:23.496Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3998lb # [ 45.171352] niks3-server[1041]: 2026/09/20 12:22:23 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3999lb # [ 45.189292] niks3-server[1041]: 2026/09/20 12:22:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4000worker1 # [ 45.130866] nix-grpc-daemon[847]: time=2026-09-20T12:22:23.561Z level=INFO msg="Uploading 1 narinfos"4001lb # [ 45.203994] niks3-server[1041]: 2026/09/20 12:22:23 INFO Signed narinfos id=3 count=14002lb # [ 45.214558] niks3-server[1041]: 2026/09/20 12:22:23 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls4003lb # [ 45.229717] niks3-server[1041]: 2026/09/20 12:22:23 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4004lb # [ 45.239463] niks3-server[1041]: 2026/09/20 12:22:23 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo4005lb # [ 45.245805] niks3-server[1041]: 2026/09/20 12:22:23 INFO Completed upload id=34006worker1 # [ 45.177985] nix-grpc-daemon[847]: time=2026-09-20T12:22:23.608Z level=INFO msg="Upload complete. (662ms)"4007worker1 # [ 45.190425] nix-grpc-daemon[776]: ts=2026-09-20T12:22:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 paths=1 nar_bytes_in=6244008worker1 # [ 45.206852] nix-grpc-daemon[776]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844009worker1 # [ 45.222368] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4010worker1 # [ 45.229708] nix-daemon[837]: reaped child process 893, status = succeeded4011client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...4012client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4013worker1 # [ 45.244396] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4014client # farm-b> LOG-farm-b-t14015worker1 # [ 46.307516] nix-daemon[837]: reaped child process 908, status = succeeded4016worker1 # [ 46.522725] nix-daemon[837]: accepted connection from pid 923, user nix-grpc-daemon (trusted)4017worker1 # [ 46.544394] nix-daemon[837]: reaped child process 926, status = succeeded4018lb # [ 46.630878] niks3-server[1041]: 2026/09/20 12:22:25 INFO Received uploads request method=POST path=/api/pending_closures4019worker1 # [ 46.573723] nix-grpc-daemon[847]: time=2026-09-20T12:22:25.003Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4020worker1 # [ 46.575293] nix-grpc-daemon[847]: time=2026-09-20T12:22:25.003Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"4021lb # [ 46.681347] niks3-server[1041]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst4022lb # [ 46.694262] niks3-server[1041]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4023lb # [ 46.702267] niks3-server[1041]: 2026/09/20 12:22:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4024worker1 # [ 46.638736] nix-grpc-daemon[847]: time=2026-09-20T12:22:25.069Z level=INFO msg="Uploading 1 narinfos"4025lb # [ 46.710659] niks3-server[1041]: 2026/09/20 12:22:25 INFO Signed narinfos id=4 count=14026lb # [ 46.716200] niks3-server[1041]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls4027lb # [ 46.727156] niks3-server[1041]: 2026/09/20 12:22:25 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4028lb # [ 46.734276] niks3-server[1041]: 2026/09/20 12:22:25 INFO Completed upload id=44029worker1 # [ 46.666291] nix-grpc-daemon[847]: time=2026-09-20T12:22:25.097Z level=INFO msg="Upload complete. (407ms)"4030lb # [ 46.737674] niks3-server[1041]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo4031worker1 # [ 46.681721] nix-grpc-daemon[776]: ts=2026-09-20T12:22:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=14032worker2 # [ 46.614664] nix-grpc-daemon[776]: ts=2026-09-20T12:22:25Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=04033worker2 # [ 46.621312] nix-grpc-daemon[776]: ts=2026-09-20T12:22:25Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=14034worker1 # [ 46.704767] nix-daemon[837]: reaped child process 906, status = succeeded4035worker1 # [ 46.735338] nix-grpc-daemon[776]: ts=2026-09-20T12:22:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844036worker1 # [ 46.756950] nix-grpc-daemon[776]: ts=2026-09-20T12:22:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499844037worker1 # [ 46.772326] nix-grpc-daemon[847]: time=2026-09-20T12:22:25.203Z level=INFO msg="All 2 paths already cached"4038client # copying 1 paths to 'lb:50051'...4039client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4040worker1 # [ 46.783549] nix-grpc-daemon[776]: ts=2026-09-20T12:22:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499844041worker1 # [ 46.805639] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4042worker1 # [ 47.053535] nix-daemon[837]: accepted connection from pid 930, user nix-grpc-daemon (trusted)4043worker1 # [ 47.078353] nix-daemon[837]: reaped child process 933, status = succeeded4044worker1 # [ 47.262648] nix-daemon[837]: accepted connection from pid 935, user nix-grpc-daemon (trusted)4045worker1 # [ 47.283439] nix-daemon[837]: reaped child process 938, status = succeeded4046lb # [ 47.365068] niks3-server[1041]: 2026/09/20 12:22:25 INFO Received uploads request method=POST path=/api/pending_closures4047worker1 # [ 47.310736] nix-grpc-daemon[847]: time=2026-09-20T12:22:25.741Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4048worker1 # [ 47.312536] nix-grpc-daemon[847]: time=2026-09-20T12:22:25.741Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4049lb # [ 47.411849] niks3-server[1041]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4050lb # [ 47.432643] niks3-server[1041]: 2026/09/20 12:22:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4051worker1 # [ 47.372112] nix-grpc-daemon[847]: time=2026-09-20T12:22:25.802Z level=INFO msg="Uploading 1 narinfos"4052lb # [ 47.446157] niks3-server[1041]: 2026/09/20 12:22:25 INFO Signed narinfos id=5 count=14053lb # [ 47.451713] niks3-server[1041]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4054lb # [ 47.468098] niks3-server[1041]: 2026/09/20 12:22:25 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4055lb # [ 47.475407] niks3-server[1041]: 2026/09/20 12:22:25 INFO Completed upload id=54056worker1 # [ 47.407658] nix-grpc-daemon[847]: time=2026-09-20T12:22:25.838Z level=INFO msg="Upload complete. (580ms)"4057lb # [ 47.480724] niks3-server[1041]: 2026/09/20 12:22:25 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4058worker1 # [ 47.420515] nix-grpc-daemon[776]: ts=2026-09-20T12:22:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 paths=1 nar_bytes_in=7524059worker1 # [ 47.436946] nix-grpc-daemon[776]: ts=2026-09-20T12:22:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844060worker1 # [ 47.453357] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4061worker1 # [ 47.460181] nix-daemon[837]: reaped child process 928, status = succeeded4062client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4063worker1 # [ 47.477274] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4064client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4065worker1 # [ 48.509105] nix-daemon[837]: reaped child process 942, status = succeeded4066client # farm-top> LOG-farm-top-t14067worker1 # [ 48.687760] nix-daemon[837]: accepted connection from pid 958, user nix-grpc-daemon (trusted)4068worker1 # [ 48.712513] nix-daemon[837]: reaped child process 961, status = succeeded4069lb # [ 48.795137] niks3-server[1041]: 2026/09/20 12:22:27 INFO Received uploads request method=POST path=/api/pending_closures4070worker1 # [ 48.742314] nix-grpc-daemon[847]: time=2026-09-20T12:22:27.170Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4071worker1 # [ 48.743900] nix-grpc-daemon[847]: time=2026-09-20T12:22:27.170Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4072lb # [ 48.839310] niks3-server[1041]: 2026/09/20 12:22:27 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4073lb # [ 48.861478] niks3-server[1041]: 2026/09/20 12:22:27 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4074lb # [ 48.870492] niks3-server[1041]: 2026/09/20 12:22:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4075lb # [ 48.877500] niks3-server[1041]: 2026/09/20 12:22:27 INFO Signed narinfos id=6 count=14076worker1 # [ 48.808098] nix-grpc-daemon[847]: time=2026-09-20T12:22:27.238Z level=INFO msg="Uploading 1 narinfos"4077lb # [ 48.882517] niks3-server[1041]: 2026/09/20 12:22:27 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4078lb # [ 48.892289] niks3-server[1041]: 2026/09/20 12:22:27 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4079lb # [ 48.900663] niks3-server[1041]: 2026/09/20 12:22:27 INFO Completed upload id=64080worker1 # [ 48.831405] nix-grpc-daemon[847]: time=2026-09-20T12:22:27.262Z level=INFO msg="Upload complete. (337ms)"4081lb # [ 48.903491] niks3-server[1041]: 2026/09/20 12:22:27 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4082worker1 # [ 48.845497] nix-grpc-daemon[776]: ts=2026-09-20T12:22:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14083worker1 # [ 48.866135] nix-daemon[837]: reaped child process 940, status = succeeded4084client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 8.32 seconds)4085client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4086client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.27 seconds)4087client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4088client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4089client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4090client # copying 3 paths...4091client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4092client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4093client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4094client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.35 seconds)4095(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 9.12 seconds)4096subtest: repeat is answered Cached by the scheduler without building4097worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4098worker1 # finding garbage collector roots...4099worker1 # deleting specified paths...4100worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4101worker1 # deleting unused links...4102worker1 # note: hard linking is currently saving 0.0 KiB4103worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.35 seconds)4104worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4105worker2 # finding garbage collector roots...4106worker2 # deleting specified paths...4107worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4108worker2 # deleting unused links...4109worker2 # note: hard linking is currently saving 0.0 KiB4110worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.37 seconds)4111client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24112client # don't know how to build these paths:4113client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4114worker2 # [ 50.647427] nix-grpc-daemon[776]: ts=2026-09-20T12:22:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:566064115worker2 # [ 50.656723] nix-grpc-daemon[776]: ts=2026-09-20T12:22:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566064116worker2 # [ 50.700446] nix-grpc-daemon[776]: ts=2026-09-20T12:22:29Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14117client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.40 seconds)4118client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4119client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.25 seconds)4120lb: must succeed: curl -sf localhost:9901/clusters4121lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)4122lb: must succeed: curl -sf localhost:9901/clusters4123lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4124worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4125worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds)4126(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.78 seconds)4127subtest: inputs already in the cache are not sent to the scheduler4128lb: must succeed: curl -sf localhost:9901/clusters4129lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4130lb: must succeed: curl -sf localhost:9901/clusters4131lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4132worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4133worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.08 seconds)4134client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24135worker1 # [ 52.038737] nix-grpc-daemon[776]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:499844136client # don't know how to build these paths:4137client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4138worker2 # [ 51.979319] nix-grpc-daemon[776]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566064139worker2 # [ 52.003012] nix-grpc-daemon[776]: ts=2026-09-20T12:22:30Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04140worker2 # [ 52.010352] nix-grpc-daemon[776]: ts=2026-09-20T12:22:30Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14141worker1 # [ 52.126159] nix-grpc-daemon[776]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844142worker1 # [ 52.148155] nix-grpc-daemon[776]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499844143worker1 # [ 52.170270] nix-grpc-daemon[847]: time=2026-09-20T12:22:30.599Z level=INFO msg="All 2 paths already cached"4144client # copying 1 paths to 'lb:50051'...4145client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4146worker1 # [ 52.184672] nix-grpc-daemon[776]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499844147worker1 # [ 52.201305] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4148worker1 # [ 52.456622] nix-daemon[837]: accepted connection from pid 978, user nix-grpc-daemon (trusted)4149worker1 # [ 52.479771] nix-daemon[837]: reaped child process 981, status = succeeded4150worker1 # [ 52.685140] nix-daemon[837]: accepted connection from pid 983, user nix-grpc-daemon (trusted)4151worker1 # [ 52.706896] nix-daemon[837]: reaped child process 986, status = succeeded4152lb # [ 52.795680] niks3-server[1041]: 2026/09/20 12:22:31 INFO Received uploads request method=POST path=/api/pending_closures4153worker1 # [ 52.742207] nix-grpc-daemon[847]: time=2026-09-20T12:22:31.172Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4154worker1 # [ 52.743882] nix-grpc-daemon[847]: time=2026-09-20T12:22:31.172Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4155lb # [ 52.835452] niks3-server[1041]: 2026/09/20 12:22:31 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4156lb # [ 52.846773] niks3-server[1041]: 2026/09/20 12:22:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4157worker1 # [ 52.782852] nix-grpc-daemon[847]: time=2026-09-20T12:22:31.213Z level=INFO msg="Uploading 1 narinfos"4158lb # [ 52.853882] niks3-server[1041]: 2026/09/20 12:22:31 INFO Signed narinfos id=7 count=14159lb # [ 52.858276] niks3-server[1041]: 2026/09/20 12:22:31 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4160lb # [ 52.867430] niks3-server[1041]: 2026/09/20 12:22:31 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4161lb # [ 52.874107] niks3-server[1041]: 2026/09/20 12:22:31 INFO Completed upload id=74162worker1 # [ 52.806339] nix-grpc-daemon[847]: time=2026-09-20T12:22:31.237Z level=INFO msg="Upload complete. (576ms)"4163lb # [ 52.880914] niks3-server[1041]: 2026/09/20 12:22:31 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4164worker1 # [ 52.816373] nix-grpc-daemon[776]: ts=2026-09-20T12:22:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 paths=1 nar_bytes_in=7524165worker1 # [ 52.825748] nix-grpc-daemon[776]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844166worker1 # [ 52.839987] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4167worker1 # [ 52.846107] nix-daemon[837]: reaped child process 976, status = succeeded4168client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4169worker1 # [ 52.860599] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4170client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4171lb # [ 53.694280] envoy[922]: conn peer=[2001:db8:1::1]:44424 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9540 tx=3858 ms=80414172lb # [ 53.699756] envoy[922]: conn peer=[2001:db8:1::1]:40964 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=844173client # farm-top> LOG-farm-top-t1b4174worker1 # [ 54.122397] nix-daemon[837]: reaped child process 990, status = succeeded4175worker1 # [ 54.337130] nix-daemon[837]: accepted connection from pid 1005, user nix-grpc-daemon (trusted)4176worker1 # [ 54.359951] nix-daemon[837]: reaped child process 1008, status = succeeded4177lb # [ 54.450874] niks3-server[1041]: 2026/09/20 12:22:32 INFO Received uploads request method=POST path=/api/pending_closures4178worker1 # [ 54.396473] nix-grpc-daemon[847]: time=2026-09-20T12:22:32.824Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4179worker1 # [ 54.398082] nix-grpc-daemon[847]: time=2026-09-20T12:22:32.824Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4180lb # [ 54.501151] niks3-server[1041]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4181lb # [ 54.514280] niks3-server[1041]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4182worker1 # [ 54.458952] nix-grpc-daemon[847]: time=2026-09-20T12:22:32.889Z level=INFO msg="Uploading 1 narinfos"4183lb # [ 54.527380] niks3-server[1041]: 2026/09/20 12:22:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4184lb # [ 54.535881] niks3-server[1041]: 2026/09/20 12:22:32 INFO Signed narinfos id=8 count=14185lb # [ 54.541502] niks3-server[1041]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4186lb # [ 54.554391] niks3-server[1041]: 2026/09/20 12:22:32 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4187lb # [ 54.561372] niks3-server[1041]: 2026/09/20 12:22:32 INFO Completed upload id=84188worker1 # [ 54.492795] nix-grpc-daemon[847]: time=2026-09-20T12:22:32.923Z level=INFO msg="Upload complete. (413ms)"4189lb # [ 54.564726] niks3-server[1041]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4190worker1 # [ 54.505362] nix-grpc-daemon[776]: ts=2026-09-20T12:22:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14191worker1 # [ 54.521567] nix-daemon[837]: reaped child process 988, status = succeeded4192client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.83 seconds)4193client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4194client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.28 seconds)4195lb: must succeed: curl -sf localhost:9901/clusters4196lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)4197lb: must succeed: curl -sf localhost:9901/clusters4198lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4199worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4200worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.08 seconds)4201(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.61 seconds)4202subtest: two clients wanting the same drv build it once4203client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4204client # [ 55.127212] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4205client # Running as unit: dedup1.service; invocation ID: 724f914e85974b8ab685bf801048f35b4206client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.12 seconds)4207client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4208client # [ 55.432846] nix[878]: don't know how to build these paths:4209client # [ 55.433943] nix[878]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4210worker1 # [ 55.498013] nix-grpc-daemon[776]: ts=2026-09-20T12:22:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:499844211worker2 # [ 55.447931] nix-grpc-daemon[776]: ts=2026-09-20T12:22:33Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04212worker2 # [ 55.448518] nix-grpc-daemon[776]: ts=2026-09-20T12:22:33Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14213worker2 # [ 55.492879] nix-grpc-daemon[776]: ts=2026-09-20T12:22:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:566064214worker2 # [ 55.522432] nix-grpc-daemon[776]: ts=2026-09-20T12:22:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566064215client # [ 55.548668] nix[878]: copying 1 paths to 'lb:50051'...4216worker2 # [ 55.544220] nix-grpc-daemon[776]: ts=2026-09-20T12:22:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:566064217client # [ 55.552961] nix[878]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4218worker2 # [ 55.567394] nix-daemon[858]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4219worker2 # [ 55.605001] nix-grpc-daemon[776]: ts=2026-09-20T12:22:34Z level=info event=niks3_push_started pid=9084220worker2 # [ 55.911647] nix-grpc-daemon[908]: time=2026-09-20T12:22:34.327Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4221worker2 # [ 56.139829] nix-daemon[858]: accepted connection from pid 921, user nix-grpc-daemon (trusted)4222worker2 # [ 56.166521] nix-daemon[858]: reaped child process 924, status = succeeded4223client # [ 56.274144] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4224client # Running as unit: dedup2.service; invocation ID: ac931ae5ed304cdbad164cd6491495e24225client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.15 seconds)4226worker2 # [ 56.375173] nix-daemon[858]: accepted connection from pid 926, user nix-grpc-daemon (trusted)4227worker2 # [ 56.396630] nix-daemon[858]: reaped child process 929, status = succeeded4228lb # [ 56.553940] niks3-server[1041]: 2026/09/20 12:22:34 INFO Received uploads request method=POST path=/api/pending_closures4229worker2 # [ 56.459686] nix-grpc-daemon[908]: time=2026-09-20T12:22:34.876Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4230worker2 # [ 56.468226] nix-grpc-daemon[908]: time=2026-09-20T12:22:34.876Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4231lb # [ 56.641554] niks3-server[1041]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4232lb # [ 56.658107] niks3-server[1041]: 2026/09/20 12:22:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4233worker2 # [ 56.524902] nix-grpc-daemon[908]: time=2026-09-20T12:22:34.942Z level=INFO msg="Uploading 1 narinfos"4234lb # [ 56.672447] niks3-server[1041]: 2026/09/20 12:22:35 INFO Signed narinfos id=9 count=14235lb # [ 56.683850] niks3-server[1041]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4236lb # [ 56.694492] niks3-server[1041]: 2026/09/20 12:22:35 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4237worker2 # [ 56.558825] nix-grpc-daemon[908]: time=2026-09-20T12:22:34.976Z level=INFO msg="Upload complete. (638ms)"4238lb # [ 56.701611] niks3-server[1041]: 2026/09/20 12:22:35 INFO Completed upload id=94239lb # [ 56.705022] niks3-server[1041]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4240worker2 # [ 56.568469] nix-grpc-daemon[776]: ts=2026-09-20T12:22:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56606 duration_s=1 paths=1 nar_bytes_in=4324241worker2 # [ 56.571386] nix-grpc-daemon[776]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:566064242worker2 # [ 56.582753] nix-daemon[858]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4243worker2 # [ 56.587053] nix-daemon[858]: reaped child process 906, status = succeeded4244client # [ 56.605113] nix[878]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4245worker2 # [ 56.599855] nix-daemon[858]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4246worker1 # [ 56.687612] nix-grpc-daemon[776]: ts=2026-09-20T12:22:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:499844247client # [ 56.629362] nix[894]: don't know how to build these paths:4248client # [ 56.630512] nix[894]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4249worker2 # [ 56.633956] nix-grpc-daemon[776]: ts=2026-09-20T12:22:35Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04250worker2 # [ 56.640349] nix-grpc-daemon[776]: ts=2026-09-20T12:22:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:566064251client # [ 56.650939] nix[894]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4252client: must succeed: sleep 24253client: (finished: must succeed: sleep 2, in 2.07 seconds)4254client: waiting for success: ! systemctl is-active dedup1 dedup24255worker2 # [ 60.044256] nix-daemon[858]: reaped child process 937, status = succeeded4256worker2 # [ 60.239555] nix-daemon[858]: accepted connection from pid 964, user nix-grpc-daemon (trusted)4257worker2 # [ 60.260593] nix-daemon[858]: reaped child process 967, status = succeeded4258lb # [ 60.417445] niks3-server[1041]: 2026/09/20 12:22:38 INFO Received uploads request method=POST path=/api/pending_closures4259worker2 # [ 60.291693] nix-grpc-daemon[908]: time=2026-09-20T12:22:38.707Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4260worker2 # [ 60.294466] nix-grpc-daemon[908]: time=2026-09-20T12:22:38.707Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4261lb # [ 60.497603] niks3-server[1041]: 2026/09/20 12:22:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4262worker2 # [ 60.368413] nix-grpc-daemon[908]: time=2026-09-20T12:22:38.785Z level=INFO msg="Uploading 1 narinfos"4263lb # [ 60.515456] niks3-server[1041]: 2026/09/20 12:22:38 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4264lb # [ 60.530546] niks3-server[1041]: 2026/09/20 12:22:38 INFO Signed narinfos id=10 count=14265lb # [ 60.536451] niks3-server[1041]: 2026/09/20 12:22:38 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4266lb # [ 60.543915] niks3-server[1041]: 2026/09/20 12:22:38 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4267lb # [ 60.556173] niks3-server[1041]: 2026/09/20 12:22:38 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4268lb # [ 60.563872] niks3-server[1041]: 2026/09/20 12:22:38 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4269lb # [ 60.571705] niks3-server[1041]: 2026/09/20 12:22:38 INFO Completed upload id=104270worker2 # [ 60.429917] nix-grpc-daemon[908]: time=2026-09-20T12:22:38.847Z level=INFO msg="Upload complete. (416ms)"4271worker2 # [ 60.445716] nix-grpc-daemon[776]: ts=2026-09-20T12:22:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56606 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14272worker2 # [ 60.472625] nix-grpc-daemon[776]: ts=2026-09-20T12:22:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56606 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14273worker2 # [ 60.481736] nix-daemon[858]: reaped child process 935, status = succeeded4274client # [ 60.526942] systemd[1]: dedup2.service: Deactivated successfully.4275client # [ 60.538792] systemd[1]: dedup2.service: Consumed 204ms CPU time over 4.251s wall clock time, 31M memory peak, 7.5K incoming IP traffic, 6.5K outgoing IP traffic.4276client # [ 60.565875] systemd[1]: dedup1.service: Deactivated successfully.4277client # [ 60.569418] systemd[1]: dedup1.service: Consumed 195ms CPU time over 5.441s wall clock time, 39.2M memory peak, 8.7K incoming IP traffic, 9.1K outgoing IP traffic.4278client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.19 seconds)4279client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4280client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.08 seconds)4281worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4282worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.09 seconds)4283worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4284worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.09 seconds)4285worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4286worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds)4287worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4288worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds)4289(finished: subtest: two clients wanting the same drv build it once, in 6.54 seconds)4290subtest: build hook: nix-daemon with builders = grpc://lb4291client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4292client # [ 61.857649] systemd[1]: Started Nix Daemon.4293client # [ 62.082629] nix-daemon[936]: accepted connection from pid 933, user root (trusted)4294worker2 # [ 62.350776] nix-grpc-daemon[776]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:566064295worker2 # [ 62.358301] nix-grpc-daemon[776]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566064296worker2 # [ 62.387412] nix-grpc-daemon[776]: ts=2026-09-20T12:22:40Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04297worker2 # [ 62.394444] nix-grpc-daemon[776]: ts=2026-09-20T12:22:40Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14298worker1 # [ 62.514567] nix-grpc-daemon[776]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844299worker1 # [ 62.534367] nix-grpc-daemon[776]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499844300worker1 # [ 62.553419] nix-grpc-daemon[776]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499844301worker1 # [ 62.576415] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4302worker1 # [ 62.830297] nix-daemon[837]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)4303worker1 # [ 62.856322] nix-daemon[837]: reaped child process 1036, status = succeeded4304worker1 # [ 63.053511] nix-daemon[837]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)4305worker1 # [ 63.079930] nix-daemon[837]: reaped child process 1041, status = succeeded4306lb # [ 63.161935] niks3-server[1041]: 2026/09/20 12:22:41 INFO Received uploads request method=POST path=/api/pending_closures4307worker1 # [ 63.113233] nix-grpc-daemon[847]: time=2026-09-20T12:22:41.542Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4308worker1 # [ 63.114824] nix-grpc-daemon[847]: time=2026-09-20T12:22:41.542Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4309lb # [ 63.213616] niks3-server[1041]: 2026/09/20 12:22:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4310worker1 # [ 63.154200] nix-grpc-daemon[847]: time=2026-09-20T12:22:41.584Z level=INFO msg="Uploading 1 narinfos"4311lb # [ 63.225943] niks3-server[1041]: 2026/09/20 12:22:41 INFO Signed narinfos id=11 count=14312lb # [ 63.233453] niks3-server[1041]: 2026/09/20 12:22:41 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4313lb # [ 63.243054] niks3-server[1041]: 2026/09/20 12:22:41 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4314lb # [ 63.257413] niks3-server[1041]: 2026/09/20 12:22:41 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4315lb # [ 63.271412] niks3-server[1041]: 2026/09/20 12:22:41 INFO Completed upload id=114316worker1 # [ 63.200837] nix-grpc-daemon[847]: time=2026-09-20T12:22:41.631Z level=INFO msg="Upload complete. (601ms)"4317lb # [ 63.280423] niks3-server[1041]: 2026/09/20 12:22:41 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4318worker1 # [ 63.212625] nix-grpc-daemon[776]: ts=2026-09-20T12:22:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 paths=1 nar_bytes_in=5124319worker1 # [ 63.229418] nix-grpc-daemon[776]: ts=2026-09-20T12:22:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844320worker1 # [ 63.247612] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4321worker1 # [ 63.255885] nix-daemon[837]: reaped child process 1031, status = succeeded4322worker1 # [ 63.271132] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4323lb # [ 63.696413] envoy[922]: conn peer=[2001:db8:1::1]:35244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4215 tx=1746 ms=24884324lb # [ 63.701914] envoy[922]: conn peer=[2001:db8:1::1]:35256 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1109 ms=38764325lb # [ 63.706980] envoy[922]: conn peer=[2001:db8:1::1]:35246 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1374 ms=50964326worker1 # [ 64.327621] nix-daemon[837]: reaped child process 1045, status = succeeded4327worker1 # [ 64.521120] nix-daemon[837]: accepted connection from pid 1060, user nix-grpc-daemon (trusted)4328worker1 # [ 64.541093] nix-daemon[837]: reaped child process 1063, status = succeeded4329lb # [ 64.621264] niks3-server[1041]: 2026/09/20 12:22:43 INFO Received uploads request method=POST path=/api/pending_closures4330worker1 # [ 64.566942] nix-grpc-daemon[847]: time=2026-09-20T12:22:42.995Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4331worker1 # [ 64.568704] nix-grpc-daemon[847]: time=2026-09-20T12:22:42.995Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4332lb # [ 64.665698] niks3-server[1041]: 2026/09/20 12:22:43 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4333lb # [ 64.678659] niks3-server[1041]: 2026/09/20 12:22:43 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4334lb # [ 64.689580] niks3-server[1041]: 2026/09/20 12:22:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4335lb # [ 64.697158] niks3-server[1041]: 2026/09/20 12:22:43 INFO Signed narinfos id=12 count=14336worker1 # [ 64.629266] nix-grpc-daemon[847]: time=2026-09-20T12:22:43.059Z level=INFO msg="Uploading 1 narinfos"4337lb # [ 64.701714] niks3-server[1041]: 2026/09/20 12:22:43 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4338lb # [ 64.712069] niks3-server[1041]: 2026/09/20 12:22:43 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4339lb # [ 64.721240] niks3-server[1041]: 2026/09/20 12:22:43 INFO Completed upload id=124340worker1 # [ 64.653522] nix-grpc-daemon[847]: time=2026-09-20T12:22:43.084Z level=INFO msg="Upload complete. (363ms)"4341lb # [ 64.724154] niks3-server[1041]: 2026/09/20 12:22:43 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4342worker1 # [ 64.670778] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14343worker1 # [ 64.684663] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:499844344worker1 # [ 64.689290] nix-daemon[837]: reaped child process 1043, status = succeeded4345worker2 # [ 64.630745] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:566064346worker2 # [ 64.652146] nix-grpc-daemon[776]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4347worker2 # [ 64.678057] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56606 duration_s=0 paths=1 nar_bytes_out=1284348worker2 # [ 65.009202] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:566064349worker2 # [ 65.014448] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566064350worker2 # [ 65.024882] nix-grpc-daemon[908]: time=2026-09-20T12:22:43.441Z level=INFO msg="All 1 paths already cached"4351worker2 # [ 65.044106] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04352worker2 # [ 65.046837] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14353worker1 # [ 65.128438] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844354worker1 # [ 65.145406] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499844355worker1 # [ 65.161202] nix-grpc-daemon[847]: time=2026-09-20T12:22:43.592Z level=INFO msg="All 1 paths already cached"4356worker1 # [ 65.171018] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499844357worker1 # [ 65.185228] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4358worker1 # [ 65.397822] nix-daemon[837]: accepted connection from pid 1067, user nix-grpc-daemon (trusted)4359worker1 # [ 65.419219] nix-daemon[837]: reaped child process 1070, status = succeeded4360worker1 # [ 65.601797] nix-daemon[837]: accepted connection from pid 1072, user nix-grpc-daemon (trusted)4361worker1 # [ 65.622086] nix-daemon[837]: reaped child process 1075, status = succeeded4362lb # [ 65.702064] niks3-server[1041]: 2026/09/20 12:22:44 INFO Received uploads request method=POST path=/api/pending_closures4363worker1 # [ 65.907806] nix-grpc-daemon[847]: time=2026-09-20T12:22:44.337Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4364worker1 # [ 65.912723] nix-grpc-daemon[847]: time=2026-09-20T12:22:44.337Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4365lb # [ 65.999940] niks3-server[1041]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4366worker1 # [ 65.942888] nix-grpc-daemon[847]: time=2026-09-20T12:22:44.373Z level=INFO msg="Uploading 1 narinfos"4367lb # [ 66.013202] niks3-server[1041]: 2026/09/20 12:22:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4368lb # [ 66.026185] niks3-server[1041]: 2026/09/20 12:22:44 INFO Signed narinfos id=13 count=14369lb # [ 66.034169] niks3-server[1041]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4370lb # [ 66.043928] niks3-server[1041]: 2026/09/20 12:22:44 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4371lb # [ 66.055710] niks3-server[1041]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4372lb # [ 66.063985] niks3-server[1041]: 2026/09/20 12:22:44 INFO Completed upload id=134373worker1 # [ 65.995950] nix-grpc-daemon[847]: time=2026-09-20T12:22:44.426Z level=INFO msg="Upload complete. (792ms)"4374worker1 # [ 66.000474] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 paths=1 nar_bytes_in=6244375worker1 # [ 66.008426] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844376worker1 # [ 66.015503] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4377worker1 # [ 66.018771] nix-daemon[837]: reaped child process 1065, status = succeeded4378worker1 # [ 66.026374] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4379worker1 # [ 67.469481] nix-daemon[837]: reaped child process 1079, status = succeeded4380worker1 # [ 67.676582] nix-daemon[837]: accepted connection from pid 1094, user nix-grpc-daemon (trusted)4381worker1 # [ 67.699038] nix-daemon[837]: reaped child process 1097, status = succeeded4382lb # [ 67.783413] niks3-server[1041]: 2026/09/20 12:22:46 INFO Received uploads request method=POST path=/api/pending_closures4383worker1 # [ 67.725966] nix-grpc-daemon[847]: time=2026-09-20T12:22:46.156Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4384worker1 # [ 67.729147] nix-grpc-daemon[847]: time=2026-09-20T12:22:46.158Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4385lb # [ 67.828173] niks3-server[1041]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4386worker1 # [ 67.774948] nix-grpc-daemon[847]: time=2026-09-20T12:22:46.205Z level=INFO msg="Uploading 1 narinfos"4387lb # [ 67.843056] niks3-server[1041]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4388lb # [ 67.853750] niks3-server[1041]: 2026/09/20 12:22:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4389lb # [ 67.861948] niks3-server[1041]: 2026/09/20 12:22:46 INFO Signed narinfos id=14 count=14390lb # [ 67.870596] niks3-server[1041]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4391worker1 # [ 67.806983] nix-grpc-daemon[847]: time=2026-09-20T12:22:46.237Z level=INFO msg="Upload complete. (371ms)"4392lb # [ 67.875537] niks3-server[1041]: 2026/09/20 12:22:46 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4393lb # [ 67.880412] niks3-server[1041]: 2026/09/20 12:22:46 INFO Completed upload id=144394lb # [ 67.884234] niks3-server[1041]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4395worker1 # [ 67.821295] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14396worker1 # [ 67.839531] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:499844397worker1 # [ 67.844906] nix-daemon[837]: reaped child process 1077, status = succeeded4398worker2 # [ 67.789128] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:566064399worker2 # [ 67.804847] nix-grpc-daemon[776]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4400worker2 # [ 67.824731] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56606 duration_s=0 paths=1 nar_bytes_out=1764401worker1 # [ 68.200506] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:499844402worker2 # [ 68.131299] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566064403worker2 # [ 68.144509] nix-grpc-daemon[908]: time=2026-09-20T12:22:46.561Z level=INFO msg="All 2 paths already cached"4404worker2 # [ 68.166356] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04405worker2 # [ 68.173144] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14406worker1 # [ 68.250859] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844407worker1 # [ 68.269355] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499844408worker1 # [ 68.286725] nix-grpc-daemon[847]: time=2026-09-20T12:22:46.717Z level=INFO msg="All 2 paths already cached"4409worker1 # [ 68.298495] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499844410worker1 # [ 68.313291] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4411worker1 # [ 68.519669] nix-daemon[837]: accepted connection from pid 1101, user nix-grpc-daemon (trusted)4412worker1 # [ 68.540547] nix-daemon[837]: reaped child process 1104, status = succeeded4413worker1 # [ 68.713270] nix-daemon[837]: accepted connection from pid 1106, user nix-grpc-daemon (trusted)4414worker1 # [ 68.732908] nix-daemon[837]: reaped child process 1109, status = succeeded4415lb # [ 68.818165] niks3-server[1041]: 2026/09/20 12:22:47 INFO Received uploads request method=POST path=/api/pending_closures4416worker1 # [ 68.759159] nix-grpc-daemon[847]: time=2026-09-20T12:22:47.189Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4417worker1 # [ 68.760838] nix-grpc-daemon[847]: time=2026-09-20T12:22:47.189Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4418lb # [ 68.840427] niks3-server[1041]: 2026/09/20 12:22:47 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4419lb # [ 68.851599] niks3-server[1041]: 2026/09/20 12:22:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4420worker1 # [ 68.787002] nix-grpc-daemon[847]: time=2026-09-20T12:22:47.217Z level=INFO msg="Uploading 1 narinfos"4421lb # [ 68.858744] niks3-server[1041]: 2026/09/20 12:22:47 INFO Signed narinfos id=15 count=14422lb # [ 68.862084] niks3-server[1041]: 2026/09/20 12:22:47 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4423lb # [ 68.871437] niks3-server[1041]: 2026/09/20 12:22:47 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4424lb # [ 68.877920] niks3-server[1041]: 2026/09/20 12:22:47 INFO Completed upload id=154425worker1 # [ 68.809975] nix-grpc-daemon[847]: time=2026-09-20T12:22:47.240Z level=INFO msg="Upload complete. (479ms)"4426lb # [ 68.880424] niks3-server[1041]: 2026/09/20 12:22:47 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4427worker1 # [ 68.816329] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 paths=1 nar_bytes_in=7524428worker1 # [ 68.825284] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844429worker1 # [ 68.835900] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4430worker1 # [ 68.841028] nix-daemon[837]: reaped child process 1099, status = succeeded4431worker1 # [ 68.854797] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4432worker1 # [ 69.476859] nix-daemon[837]: reaped child process 1113, status = succeeded4433worker1 # [ 69.649106] nix-daemon[837]: accepted connection from pid 1128, user nix-grpc-daemon (trusted)4434worker1 # [ 69.669469] nix-daemon[837]: reaped child process 1131, status = succeeded4435lb # [ 69.749563] niks3-server[1041]: 2026/09/20 12:22:48 INFO Received uploads request method=POST path=/api/pending_closures4436worker1 # [ 69.692397] nix-grpc-daemon[847]: time=2026-09-20T12:22:48.123Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4437worker1 # [ 69.697686] nix-grpc-daemon[847]: time=2026-09-20T12:22:48.125Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4438lb # [ 69.796330] niks3-server[1041]: 2026/09/20 12:22:48 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4439lb # [ 69.810611] niks3-server[1041]: 2026/09/20 12:22:48 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4440lb # [ 69.821435] niks3-server[1041]: 2026/09/20 12:22:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4441worker1 # [ 69.758606] nix-grpc-daemon[847]: time=2026-09-20T12:22:48.189Z level=INFO msg="Uploading 1 narinfos"4442lb # [ 69.831100] niks3-server[1041]: 2026/09/20 12:22:48 INFO Signed narinfos id=16 count=14443lb # [ 69.837169] niks3-server[1041]: 2026/09/20 12:22:48 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4444lb # [ 69.846532] niks3-server[1041]: 2026/09/20 12:22:48 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4445lb # [ 69.857283] niks3-server[1041]: 2026/09/20 12:22:48 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4446lb # [ 69.861836] niks3-server[1041]: 2026/09/20 12:22:48 INFO Completed upload id=164447worker1 # [ 69.794682] nix-grpc-daemon[847]: time=2026-09-20T12:22:48.224Z level=INFO msg="Upload complete. (330ms)"4448worker1 # [ 69.809997] nix-grpc-daemon[776]: ts=2026-09-20T12:22:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14449worker1 # [ 69.828251] nix-grpc-daemon[776]: ts=2026-09-20T12:22:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:499844450worker1 # [ 69.836491] nix-grpc-daemon[776]: ts=2026-09-20T12:22:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:499844451worker1 # [ 69.842787] nix-daemon[837]: reaped child process 1111, status = succeeded4452worker1 # [ 69.846168] nix-grpc-daemon[776]: ts=2026-09-20T12:22:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 paths=1 nar_bytes_out=2324453client # [ 69.912363] nix-daemon[936]: reaped child process 938, status = succeeded4454client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.36 seconds)4455client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4456client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4457client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4458client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds)4459client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4460client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4461(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.50 seconds)4462subtest: an input only one worker has still reaches the builder4463client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4464client # this derivation will be built:4465client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4466client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4467client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.47 seconds)4468client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4469client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds)4470worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4471worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds)4472worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4473worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4474client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24475client # [ 71.313821] nix-daemon[936]: accepted connection from pid 1019, user root (trusted)4476client # this derivation will be built:4477client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4478worker1 # [ 71.603937] nix-grpc-daemon[776]: ts=2026-09-20T12:22:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:499844479client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4480worker2 # [ 71.539076] nix-grpc-daemon[776]: ts=2026-09-20T12:22:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566064481client # copying 1 paths...4482client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4483worker2 # [ 71.554688] nix-grpc-daemon[776]: ts=2026-09-20T12:22:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:566064484worker2 # [ 71.575111] nix-daemon[858]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4485worker2 # [ 71.809761] nix-daemon[858]: accepted connection from pid 991, user nix-grpc-daemon (trusted)4486worker2 # [ 71.833494] nix-daemon[858]: reaped child process 994, status = succeeded4487lb # [ 71.994348] niks3-server[1041]: 2026/09/20 12:22:50 INFO Received uploads request method=POST path=/api/pending_closures4488worker2 # [ 71.861299] nix-grpc-daemon[908]: time=2026-09-20T12:22:50.278Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4489worker2 # [ 71.862883] nix-grpc-daemon[908]: time=2026-09-20T12:22:50.278Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4490lb # [ 72.029127] niks3-server[1041]: 2026/09/20 12:22:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4491worker2 # [ 71.894549] nix-grpc-daemon[908]: time=2026-09-20T12:22:50.311Z level=INFO msg="Uploading 1 narinfos"4492lb # [ 72.039612] niks3-server[1041]: 2026/09/20 12:22:50 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4493lb # [ 72.053691] niks3-server[1041]: 2026/09/20 12:22:50 INFO Signed narinfos id=17 count=14494lb # [ 72.058430] niks3-server[1041]: 2026/09/20 12:22:50 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4495worker2 # [ 71.926899] nix-grpc-daemon[908]: time=2026-09-20T12:22:50.344Z level=INFO msg="Upload complete. (329ms)"4496lb # [ 72.068898] niks3-server[1041]: 2026/09/20 12:22:50 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4497lb # [ 72.076174] niks3-server[1041]: 2026/09/20 12:22:50 INFO Completed upload id=174498lb # [ 72.080003] niks3-server[1041]: 2026/09/20 12:22:50 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4499worker2 # [ 71.936692] nix-grpc-daemon[776]: ts=2026-09-20T12:22:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56606 duration_s=0 paths=1 nar_bytes_in=1204500worker2 # [ 71.956986] nix-grpc-daemon[776]: ts=2026-09-20T12:22:50Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04501worker2 # [ 71.967229] nix-grpc-daemon[776]: ts=2026-09-20T12:22:50Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14502worker2 # [ 71.972623] nix-daemon[858]: reaped child process 989, status = succeeded4503worker2 # [ 72.003828] nix-grpc-daemon[776]: ts=2026-09-20T12:22:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:566064504worker2 # [ 72.020971] nix-grpc-daemon[776]: ts=2026-09-20T12:22:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566064505client # copying 2 paths to 'lb:50051'...4506worker2 # [ 72.043746] nix-grpc-daemon[776]: ts=2026-09-20T12:22:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:566064507client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4508client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4509worker2 # [ 72.056152] nix-daemon[858]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4510worker2 # [ 72.287423] nix-daemon[858]: accepted connection from pid 1000, user nix-grpc-daemon (trusted)4511worker2 # [ 72.310730] nix-daemon[858]: reaped child process 1003, status = succeeded4512worker2 # [ 72.498791] nix-daemon[858]: accepted connection from pid 1005, user nix-grpc-daemon (trusted)4513worker2 # [ 72.519035] nix-daemon[858]: reaped child process 1008, status = succeeded4514lb # [ 72.676137] niks3-server[1041]: 2026/09/20 12:22:51 INFO Received uploads request method=POST path=/api/pending_closures4515lb # [ 72.693134] niks3-server[1041]: 2026/09/20 12:22:51 INFO Received uploads request method=POST path=/api/pending_closures4516worker2 # [ 72.561240] nix-grpc-daemon[908]: time=2026-09-20T12:22:50.978Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4517worker2 # [ 72.563033] nix-grpc-daemon[908]: time=2026-09-20T12:22:50.978Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4518worker2 # [ 72.565240] nix-grpc-daemon[908]: time=2026-09-20T12:22:50.978Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4519lb # [ 72.730693] niks3-server[1041]: 2026/09/20 12:22:51 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4520lb # [ 72.744742] niks3-server[1041]: 2026/09/20 12:22:51 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4521lb # [ 72.762792] niks3-server[1041]: 2026/09/20 12:22:51 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4522worker2 # [ 72.632139] nix-grpc-daemon[908]: time=2026-09-20T12:22:51.048Z level=INFO msg="Uploading 3 narinfos"4523lb # [ 72.773909] niks3-server[1041]: 2026/09/20 12:22:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4524lb # [ 72.781926] niks3-server[1041]: 2026/09/20 12:22:51 INFO Signed narinfos id=18 count=14525lb # [ 72.788330] niks3-server[1041]: 2026/09/20 12:22:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4526lb # [ 72.791942] niks3-server[1041]: 2026/09/20 12:22:51 INFO Signed narinfos id=19 count=24527lb # [ 72.800931] niks3-server[1041]: 2026/09/20 12:22:51 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4528lb # [ 72.816367] niks3-server[1041]: 2026/09/20 12:22:51 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4529lb # [ 72.828117] niks3-server[1041]: 2026/09/20 12:22:51 INFO Completed upload id=194530lb # [ 72.829962] niks3-server[1041]: 2026/09/20 12:22:51 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4531lb # [ 72.836321] niks3-server[1041]: 2026/09/20 12:22:51 INFO Completed upload id=184532worker2 # [ 72.693572] nix-grpc-daemon[908]: time=2026-09-20T12:22:51.111Z level=INFO msg="Upload complete. (613ms)"4533lb # [ 72.838965] niks3-server[1041]: 2026/09/20 12:22:51 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4534lb # [ 72.843275] niks3-server[1041]: 2026/09/20 12:22:51 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4535lb # [ 72.846957] niks3-server[1041]: 2026/09/20 12:22:51 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4536worker2 # [ 72.709212] nix-grpc-daemon[776]: ts=2026-09-20T12:22:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56606 duration_s=0 paths=2 nar_bytes_in=9844537worker2 # [ 72.728496] nix-grpc-daemon[776]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:566064538worker2 # [ 72.742511] nix-daemon[858]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4539worker2 # [ 72.752128] nix-daemon[858]: reaped child process 998, status = succeeded4540client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4541client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4542worker2 # [ 72.764702] nix-daemon[858]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4543lb # [ 73.695732] envoy[922]: conn peer=[2001:db8:1::1]:56340 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3459 tx=1679 ms=24024544lb # [ 73.701235] envoy[922]: conn peer=[2001:db8:1::1]:56350 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=1234545lb # [ 73.706701] envoy[922]: conn peer=[2001:db8:1::1]:56354 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3901 tx=1876 ms=28744546lb # [ 73.713707] envoy[922]: conn peer=[2001:db8:1::1]:56360 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=1024547lb # [ 73.718819] envoy[922]: conn peer=[2001:db8:1::1]:56372 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4296 tx=2090 ms=17054548lb # [ 73.725588] envoy[922]: conn peer=[2001:db8:1::1]:56386 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=724549worker2 # [ 73.599584] nix-daemon[858]: reaped child process 1012, status = succeeded4550worker2 # [ 73.793549] nix-daemon[858]: accepted connection from pid 1027, user nix-grpc-daemon (trusted)4551worker2 # [ 73.815033] nix-daemon[858]: reaped child process 1030, status = succeeded4552lb # [ 73.974226] niks3-server[1041]: 2026/09/20 12:22:52 INFO Received uploads request method=POST path=/api/pending_closures4553worker2 # [ 73.842458] nix-grpc-daemon[908]: time=2026-09-20T12:22:52.259Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4554lb # [ 74.011088] niks3-server[1041]: 2026/09/20 12:22:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4555worker2 # [ 73.875966] nix-grpc-daemon[908]: time=2026-09-20T12:22:52.293Z level=INFO msg="Uploading 1 narinfos"4556lb # [ 74.022405] niks3-server[1041]: 2026/09/20 12:22:52 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4557lb # [ 74.033968] niks3-server[1041]: 2026/09/20 12:22:52 INFO Signed narinfos id=20 count=14558worker2 # [ 73.896503] nix-grpc-daemon[908]: time=2026-09-20T12:22:52.314Z level=INFO msg="Upload complete. (318ms)"4559lb # [ 74.040846] niks3-server[1041]: 2026/09/20 12:22:52 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4560lb # [ 74.045184] niks3-server[1041]: 2026/09/20 12:22:52 INFO Completed upload id=204561lb # [ 74.047936] niks3-server[1041]: 2026/09/20 12:22:52 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4562worker2 # [ 73.905008] nix-grpc-daemon[776]: ts=2026-09-20T12:22:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56606 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14563lb # [ 74.051656] niks3-server[1041]: 2026/09/20 12:22:52 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4564worker2 # [ 73.920635] nix-daemon[858]: reaped child process 1010, status = succeeded4565client # copying 1 paths...4566worker2 # [ 73.953172] nix-grpc-daemon[776]: ts=2026-09-20T12:22:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:566064567client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4568worker1 # [ 74.061961] nix-grpc-daemon[776]: ts=2026-09-20T12:22:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:499844569worker1 # [ 74.080329] nix-grpc-daemon[776]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4570worker1 # [ 74.103547] nix-grpc-daemon[776]: ts=2026-09-20T12:22:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 paths=1 nar_bytes_out=1204571client # [ 74.168918] nix-daemon[936]: reaped child process 1022, status = succeeded4572client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.12 seconds)4573client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24574client # [ 74.406119] nix-daemon[936]: accepted connection from pid 1041, user root (trusted)4575client # this derivation will be built:4576client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4577worker1 # [ 74.686568] nix-grpc-daemon[776]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:499844578worker2 # [ 74.619220] nix-grpc-daemon[776]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566064579client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4580worker2 # [ 74.627920] nix-grpc-daemon[908]: time=2026-09-20T12:22:53.045Z level=INFO msg="All 1 paths already cached"4581worker2 # [ 74.645506] nix-grpc-daemon[776]: ts=2026-09-20T12:22:53Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04582worker2 # [ 74.652429] nix-grpc-daemon[776]: ts=2026-09-20T12:22:53Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14583worker1 # [ 74.764722] nix-grpc-daemon[776]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844584worker1 # [ 74.782038] nix-grpc-daemon[776]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499844585client # copying 1 paths to 'lb:50051'...4586client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4587worker1 # [ 74.807970] nix-grpc-daemon[776]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499844588worker1 # [ 74.823775] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4589worker1 # [ 74.847879] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 1/5)4590worker1 # [ 74.864243] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 163 ms (attempt 2/5)4591worker1 # [ 75.034880] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 3/5)4592worker1 # [ 75.066210] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 4/5)4593worker1 # [ 75.133097] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4594worker1 # [ 75.145368] nix-grpc-daemon[776]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4595worker1 # [ 75.388336] nix-daemon[837]: accepted connection from pid 1145, user nix-grpc-daemon (trusted)4596worker1 # [ 75.407787] nix-daemon[837]: reaped child process 1148, status = succeeded4597worker1 # [ 75.600398] nix-daemon[837]: accepted connection from pid 1150, user nix-grpc-daemon (trusted)4598worker1 # [ 75.620173] nix-daemon[837]: reaped child process 1153, status = succeeded4599lb # [ 75.705479] niks3-server[1041]: 2026/09/20 12:22:54 INFO Received uploads request method=POST path=/api/pending_closures4600worker1 # [ 75.649549] nix-grpc-daemon[847]: time=2026-09-20T12:22:54.079Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4601worker1 # [ 75.651156] nix-grpc-daemon[847]: time=2026-09-20T12:22:54.079Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4602lb # [ 75.742610] niks3-server[1041]: 2026/09/20 12:22:54 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4603lb # [ 75.754652] niks3-server[1041]: 2026/09/20 12:22:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4604worker1 # [ 75.694113] nix-grpc-daemon[847]: time=2026-09-20T12:22:54.124Z level=INFO msg="Uploading 1 narinfos"4605lb # [ 75.766964] niks3-server[1041]: 2026/09/20 12:22:54 INFO Signed narinfos id=21 count=14606lb # [ 75.775085] niks3-server[1041]: 2026/09/20 12:22:54 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4607lb # [ 75.787461] niks3-server[1041]: 2026/09/20 12:22:54 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4608worker1 # [ 75.724419] nix-grpc-daemon[847]: time=2026-09-20T12:22:54.155Z level=INFO msg="Upload complete. (546ms)"4609lb # [ 75.792510] niks3-server[1041]: 2026/09/20 12:22:54 INFO Completed upload id=214610lb # [ 75.795262] niks3-server[1041]: 2026/09/20 12:22:54 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4611worker1 # [ 75.732161] nix-grpc-daemon[776]: ts=2026-09-20T12:22:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 paths=1 nar_bytes_in=5684612worker1 # [ 75.736410] nix-grpc-daemon[776]: ts=2026-09-20T12:22:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499844613worker1 # [ 75.748521] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4614worker1 # [ 75.750698] nix-daemon[837]: reaped child process 1139, status = succeeded4615client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4616worker1 # [ 75.762375] nix-daemon[837]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4617client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4618worker1 # [ 76.786719] nix-daemon[837]: reaped child process 1157, status = succeeded4619worker1 # [ 76.951617] nix-daemon[837]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)4620worker1 # [ 76.973477] nix-daemon[837]: reaped child process 1175, status = succeeded4621lb # [ 77.052552] niks3-server[1041]: 2026/09/20 12:22:55 INFO Received uploads request method=POST path=/api/pending_closures4622worker1 # [ 77.022947] nix-grpc-daemon[847]: time=2026-09-20T12:22:55.452Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4623lb # [ 77.117440] niks3-server[1041]: 2026/09/20 12:22:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4624worker1 # [ 77.057253] nix-grpc-daemon[847]: time=2026-09-20T12:22:55.487Z level=INFO msg="Uploading 1 narinfos"4625lb # [ 77.129452] niks3-server[1041]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4626lb # [ 77.138689] niks3-server[1041]: 2026/09/20 12:22:55 INFO Signed narinfos id=22 count=14627lb # [ 77.142494] niks3-server[1041]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4628worker1 # [ 77.085544] nix-grpc-daemon[847]: time=2026-09-20T12:22:55.516Z level=INFO msg="Upload complete. (314ms)"4629lb # [ 77.153331] niks3-server[1041]: 2026/09/20 12:22:55 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4630lb # [ 77.158437] niks3-server[1041]: 2026/09/20 12:22:55 INFO Completed upload id=224631lb # [ 77.161886] niks3-server[1041]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4632worker1 # [ 77.097383] nix-grpc-daemon[776]: ts=2026-09-20T12:22:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14633worker1 # [ 77.115067] nix-daemon[837]: reaped child process 1155, status = succeeded4634client # copying 1 paths...4635worker1 # [ 77.146346] nix-grpc-daemon[776]: ts=2026-09-20T12:22:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:499844636client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4637worker1 # [ 77.183802] nix-grpc-daemon[776]: ts=2026-09-20T12:22:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:499844638worker1 # [ 77.189280] nix-grpc-daemon[776]: ts=2026-09-20T12:22:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 paths=1 nar_bytes_out=1204639client # [ 77.240774] nix-daemon[936]: reaped child process 1044, status = succeeded4640client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.07 seconds)4641client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24642client # [ 77.461140] nix-daemon[936]: accepted connection from pid 1063, user root (trusted)4643client # this derivation will be built:4644client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4645worker1 # [ 77.733810] nix-grpc-daemon[776]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:499844646client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4647worker1 # [ 77.742174] nix-grpc-daemon[776]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499844648worker1 # [ 77.750263] nix-grpc-daemon[847]: time=2026-09-20T12:22:56.181Z level=INFO msg="All 1 paths already cached"4649worker2 # [ 77.695923] nix-grpc-daemon[776]: ts=2026-09-20T12:22:56Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04650worker2 # [ 77.701380] nix-grpc-daemon[776]: ts=2026-09-20T12:22:56Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14651worker2 # [ 77.738343] nix-grpc-daemon[776]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:566064652worker2 # [ 77.751687] nix-grpc-daemon[776]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566064653worker2 # [ 77.774617] nix-grpc-daemon[908]: time=2026-09-20T12:22:56.191Z level=INFO msg="All 1 paths already cached"4654client # copying 1 paths to 'lb:50051'...4655client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4656worker2 # [ 77.783171] nix-grpc-daemon[776]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:566064657worker2 # [ 77.795047] nix-daemon[858]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4658worker2 # [ 77.979968] nix-daemon[858]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)4659worker2 # [ 78.001559] nix-daemon[858]: reaped child process 1041, status = succeeded4660worker2 # [ 78.184442] nix-daemon[858]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)4661worker2 # [ 78.206323] nix-daemon[858]: reaped child process 1046, status = succeeded4662lb # [ 78.362929] niks3-server[1041]: 2026/09/20 12:22:56 INFO Received uploads request method=POST path=/api/pending_closures4663worker2 # [ 78.229084] nix-grpc-daemon[908]: time=2026-09-20T12:22:56.646Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4664worker2 # [ 78.231311] nix-grpc-daemon[908]: time=2026-09-20T12:22:56.648Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4665lb # [ 78.394399] niks3-server[1041]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4666lb # [ 78.412790] niks3-server[1041]: 2026/09/20 12:22:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4667worker2 # [ 78.276971] nix-grpc-daemon[908]: time=2026-09-20T12:22:56.694Z level=INFO msg="Uploading 1 narinfos"4668lb # [ 78.427252] niks3-server[1041]: 2026/09/20 12:22:56 INFO Signed narinfos id=23 count=14669lb # [ 78.433840] niks3-server[1041]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4670lb # [ 78.444528] niks3-server[1041]: 2026/09/20 12:22:56 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4671lb # [ 78.449747] niks3-server[1041]: 2026/09/20 12:22:56 INFO Completed upload id=234672worker2 # [ 78.307994] nix-grpc-daemon[908]: time=2026-09-20T12:22:56.725Z level=INFO msg="Upload complete. (500ms)"4673lb # [ 78.452832] niks3-server[1041]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4674worker2 # [ 78.316394] nix-grpc-daemon[776]: ts=2026-09-20T12:22:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56606 duration_s=0 paths=1 nar_bytes_in=5684675worker2 # [ 78.328918] nix-grpc-daemon[776]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:566064676worker2 # [ 78.340936] nix-daemon[858]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4677worker2 # [ 78.348277] nix-daemon[858]: reaped child process 1036, status = succeeded4678client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4679worker2 # [ 78.361727] nix-daemon[858]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4680client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4681worker2 # [ 79.588222] nix-daemon[858]: reaped child process 1050, status = succeeded4682worker2 # [ 79.757851] nix-daemon[858]: accepted connection from pid 1065, user nix-grpc-daemon (trusted)4683worker2 # [ 79.777672] nix-daemon[858]: reaped child process 1068, status = succeeded4684lb # [ 79.933259] niks3-server[1041]: 2026/09/20 12:22:58 INFO Received uploads request method=POST path=/api/pending_closures4685worker2 # [ 79.812408] nix-grpc-daemon[908]: time=2026-09-20T12:22:58.228Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4686lb # [ 79.974209] niks3-server[1041]: 2026/09/20 12:22:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4687worker2 # [ 79.841259] nix-grpc-daemon[908]: time=2026-09-20T12:22:58.258Z level=INFO msg="Uploading 1 narinfos"4688lb # [ 79.988868] niks3-server[1041]: 2026/09/20 12:22:58 INFO Signed narinfos id=24 count=14689lb # [ 79.997136] niks3-server[1041]: 2026/09/20 12:22:58 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4690lb # [ 80.010433] niks3-server[1041]: 2026/09/20 12:22:58 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4691worker2 # [ 79.872312] nix-grpc-daemon[908]: time=2026-09-20T12:22:58.289Z level=INFO msg="Upload complete. (300ms)"4692lb # [ 80.014978] niks3-server[1041]: 2026/09/20 12:22:58 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4693lb # [ 80.017916] niks3-server[1041]: 2026/09/20 12:22:58 INFO Completed upload id=244694lb # [ 80.021122] niks3-server[1041]: 2026/09/20 12:22:58 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4695worker2 # [ 79.884883] nix-grpc-daemon[776]: ts=2026-09-20T12:22:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56606 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14696worker2 # [ 79.897853] nix-daemon[858]: reaped child process 1048, status = succeeded4697client # copying 1 paths...4698worker2 # [ 79.928744] nix-grpc-daemon[776]: ts=2026-09-20T12:22:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:566064699client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4700worker1 # [ 80.032736] nix-grpc-daemon[776]: ts=2026-09-20T12:22:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:499844701worker1 # [ 80.042244] nix-grpc-daemon[776]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4702worker1 # [ 80.054257] nix-grpc-daemon[776]: ts=2026-09-20T12:22:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49984 duration_s=0 paths=1 nar_bytes_out=1204703client # [ 80.118618] nix-daemon[936]: reaped child process 1066, status = succeeded4704client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.87 seconds)4705(finished: subtest: an input only one worker has still reaches the builder, in 10.06 seconds)4706subtest: upload whose reference the worker lacks is completed from the cache4707client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4708client # this derivation will be built:4709client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4710client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4711client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.48 seconds)4712client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4713client # this derivation will be built:4714client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4715client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4716client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.54 seconds)4717client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4718client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds)4719worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4720worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4721worker2 # [ 81.678550] systemd[1]: Stopping Nix worker-protocol over gRPC...4722worker2 # [ 82.103541] nix-grpc-daemon[776]: ts=2026-09-20T12:23:00Z level=info event=signal_exit4723worker2 # [ 82.358587] nix-grpc-daemon[776]: ts=2026-09-20T12:23:00Z level=info event=scheduler_yield4724worker1 # [ 82.445392] nix-grpc-daemon[776]: ts=2026-09-20T12:23:00Z level=info event=scheduler_restarting addr=lb:500514725worker2 # [ 82.367873] nix-grpc-daemon[776]: ts=2026-09-20T12:23:00Z level=info event=scheduler_restarting addr=lb:500514726lb # [ 82.513210] niks3-server[1041]: 2026/09/20 12:23:00 INFO lead: released remote=192.168.1.4:406344727worker2 # [ 82.375577] nix-grpc-daemon[776]: ts=2026-09-20T12:23:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:565984728worker2 # [ 82.380705] nix-grpc-daemon[776]: ts=2026-09-20T12:23:00Z level=info event=worker_gone addr=192.168.1.4:500514729worker2 # [ 82.384753] nix-grpc-daemon[776]: ts=2026-09-20T12:23:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:565984730worker2 # [ 82.389178] nix-grpc-daemon[776]: ts=2026-09-20T12:23:00Z level=info event=worker_gone addr=192.168.1.3:500514731worker2 # [ 82.569788] nix-grpc-daemon[776]: ts=2026-09-20T12:23:00Z level=info event=scheduler_connected addr=lb:500514732worker1 # [ 82.646138] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500514733worker2 # [ 82.575325] nix-grpc-daemon[776]: ts=2026-09-20T12:23:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4734worker1 # [ 82.651567] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4735worker1 # [ 82.852231] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500514736worker2 # [ 82.776660] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500514737worker1 # [ 82.855189] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4738worker2 # [ 82.782432] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4739worker1 # [ 83.056221] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500514740worker2 # [ 82.983705] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500514741worker1 # [ 83.061851] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4742worker2 # [ 82.989295] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4743worker1 # [ 83.262483] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500514744worker1 # [ 83.265980] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4745worker2 # [ 83.192418] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500514746worker2 # [ 83.196607] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4747worker2 # [ 83.364248] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_restarting4748worker1 # [ 83.469071] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500514749worker1 # [ 83.473583] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4750worker2 # [ 83.413780] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4751worker2 # [ 83.428006] nix-daemon[858]: reaped child process 860, status = succeeded4752lb # [ 83.694758] envoy[922]: conn peer=[2001:db8:1::1]:39242 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4222 tx=1796 ms=25624753lb # [ 83.700074] envoy[922]: conn peer=[2001:db8:1::1]:39246 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1034754lb # [ 83.705406] envoy[922]: conn peer=[2001:db8:1::1]:39254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3728 tx=1843 ms=25554755lb # [ 83.711642] envoy[922]: conn peer=[2001:db8:1::1]:39262 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=634756lb # [ 83.718452] envoy[922]: conn peer=[2001:db8:1::1]:39268 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3729 tx=1819 ms=23794757lb # [ 83.723619] envoy[922]: conn peer=[2001:db8:1::1]:39276 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=854758lb # [ 83.728669] envoy[922]: conn peer=[2001:db8:1::4]:43132 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=45923 tx=2451 ms=593014759worker1 # [ 83.670214] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=info event=scheduler_connected addr=lb:500514760worker1 # [ 83.675846] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4761worker2 # [ 83.628635] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4762worker2 # [ 83.636769] systemd[1]: Stopped Nix worker-protocol over gRPC.4763worker2 # [ 83.639490] systemd[1]: nix-grpc-daemon.service: Consumed 2.272s CPU time over 59.875s wall clock time, 51.6M memory peak, 59.6K incoming IP traffic, 164.5K outgoing IP traffic.4764worker2 # [ 83.656626] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4765worker2 # [ 83.658625] systemd[1]: Closed Nix worker-protocol over gRPC.4766worker2 # [ 83.662941] systemd[1]: nix-grpc-daemon.socket: Consumed 746us CPU time over 1min 10.493s wall clock time, 256K memory peak, 74.5K incoming IP traffic, 64K outgoing IP traffic.4767lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4768lb: must succeed: curl -sf localhost:9901/clusters4769lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4770lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4771client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24772worker1 # [ 83.876685] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=info event=scheduler_connected addr=lb:500514773worker1 # [ 83.882157] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4774worker1 # [ 84.079936] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:499844775worker1 # [ 84.087886] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=info event=scheduler_connected addr=lb:500514776client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4777worker1 # [ 84.094038] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4778worker1 # [ 84.099405] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:499844779client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.30 seconds)4780worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4781worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4782worker2 # [ 84.166379] systemd[1]: Listening on Nix worker-protocol over gRPC.4783worker1 # [ 84.289326] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=info event=scheduler_connected addr=lb:500514784worker1 # [ 84.297678] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4785worker2 # [ 84.255613] systemd[1]: Starting scheduler-token.service...4786worker1 # [ 84.337882] systemd[1]: Stopping Nix worker-protocol over gRPC...4787worker2 # [ 84.354782] systemd[1]: scheduler-token.service: Deactivated successfully.4788worker2 # [ 84.360469] systemd[1]: Finished scheduler-token.service.4789worker2 # [ 84.361769] systemd[1]: scheduler-token.service: Consumed 49ms CPU time over 102ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4790worker2 # [ 84.369293] systemd[1]: Starting Nix worker-protocol over gRPC...4791worker1 # [ 84.497109] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=info event=scheduler_connected addr=lb:500514792worker1 # [ 84.502407] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4793worker2 # [ 84.556814] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:02Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4794worker2 # [ 84.558811] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4795worker2 # [ 84.563289] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14796worker2 # [ 84.572103] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4797worker2 # [ 84.573904] systemd[1]: Started Nix worker-protocol over gRPC.4798worker2 # [ 84.589403] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:03Z level=info event=scheduler_take_over4799lb # [ 84.734680] niks3-server[1041]: 2026/09/20 12:23:03 INFO lead: acquired remote=192.168.1.4:512484800worker2 # [ 84.611699] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:03Z level=info event=scheduler_connected addr=lb:500514801worker2 # [ 84.621525] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:03Z level=info event=oidc_jwks provider=mock keys=14802worker2 # [ 84.622999] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:03Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:462004803worker2 # [ 84.625045] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04804worker2 # [ 84.630922] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:03Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:462004805worker1 # [ 84.703684] nix-grpc-daemon[776]: ts=2026-09-20T12:23:03Z level=info event=scheduler_connected addr=lb:500514806worker2 # [ 84.632819] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04807worker1 # [ 85.016122] nix-grpc-daemon[776]: ts=2026-09-20T12:23:03Z level=info event=signal_exit4808worker1 # [ 86.287595] nix-grpc-daemon[776]: ts=2026-09-20T12:23:04Z level=info event=scheduler_restarting4809worker2 # [ 86.223998] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:462004810worker2 # [ 86.224451] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:04Z level=info event=worker_gone addr=192.168.1.3:500514811worker1 # [ 86.321058] nix-grpc-daemon[776]: ts=2026-09-20T12:23:04Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4812worker1 # [ 86.342422] nix-daemon[837]: reaped child process 839, status = succeeded4813worker1 # [ 87.143898] nix-grpc-daemon[776]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4814worker1 # [ 87.144322] nix-grpc-daemon[776]: E0000 00:00:1789906985.574495 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4815worker1 # [ 87.160755] nix-grpc-daemon[776]: E0000 00:00:1789906985.591588 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4816worker1 # [ 87.601543] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4817worker1 # [ 87.609936] systemd[1]: Stopped Nix worker-protocol over gRPC.4818worker1 # [ 87.611918] systemd[1]: nix-grpc-daemon.service: Consumed 4.108s CPU time over 1min 3.974s wall clock time, 56.2M memory peak, 82.9K incoming IP traffic, 152.7K outgoing IP traffic.4819worker1 # [ 87.627870] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4820worker1 # [ 87.631924] systemd[1]: Closed Nix worker-protocol over gRPC.4821worker1 # [ 87.633865] systemd[1]: nix-grpc-daemon.socket: Consumed 825us CPU time over 1min 14.037s wall clock time, 256K memory peak, 79.9K incoming IP traffic, 65.1K outgoing IP traffic.4822lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4823lb: must succeed: curl -sf localhost:9901/clusters4824lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4825lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.07 seconds)4826client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24827worker2 # [ 87.865845] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462064828worker2 # [ 87.879156] nix-daemon[858]: accepted connection from pid 1092, user nix-grpc-daemon (trusted)4829worker2 # [ 87.900783] nix-grpc-daemon[1092]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5)4830worker2 # [ 87.975190] nix-grpc-daemon[1092]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 2/5)4831worker2 # [ 88.118597] nix-grpc-daemon[1092]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 162 ms (attempt 3/5)4832worker2 # [ 88.288480] nix-grpc-daemon[1092]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 700 ms (attempt 4/5)4833worker2 # [ 88.997856] nix-grpc-daemon[1092]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4834client # copying 2 paths...4835client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4836worker2 # [ 89.025968] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462064837client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4838worker2 # [ 89.046879] nix-daemon[858]: accepted connection from pid 1092, user nix-grpc-daemon (trusted)4839worker2 # [ 89.078110] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:07Z level=info event=niks3_push_started pid=11484840worker2 # [ 89.293249] nix-grpc-daemon[1148]: time=2026-09-20T12:23:07.710Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4841worker2 # [ 89.474088] nix-daemon[858]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)4842worker2 # [ 89.493706] nix-daemon[858]: reaped child process 1164, status = succeeded4843lb # [ 89.649172] niks3-server[1041]: 2026/09/20 12:23:08 INFO Received uploads request method=POST path=/api/pending_closures4844lb # [ 89.656725] niks3-server[1041]: 2026/09/20 12:23:08 INFO Received uploads request method=POST path=/api/pending_closures4845worker2 # [ 89.522739] nix-grpc-daemon[1148]: time=2026-09-20T12:23:07.938Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4846worker2 # [ 89.525862] nix-grpc-daemon[1148]: time=2026-09-20T12:23:07.938Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4847worker2 # [ 89.527701] nix-grpc-daemon[1148]: time=2026-09-20T12:23:07.938Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4848lb # [ 89.704699] niks3-server[1041]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4849lb # [ 89.720254] niks3-server[1041]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4850lb # [ 89.726666] niks3-server[1041]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4851worker2 # [ 89.591785] nix-grpc-daemon[1148]: time=2026-09-20T12:23:08.007Z level=INFO msg="Uploading 3 narinfos"4852lb # [ 89.735137] niks3-server[1041]: 2026/09/20 12:23:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4853lb # [ 89.741808] niks3-server[1041]: 2026/09/20 12:23:08 INFO Signed narinfos id=25 count=14854lb # [ 89.743604] niks3-server[1041]: 2026/09/20 12:23:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4855lb # [ 89.750957] niks3-server[1041]: 2026/09/20 12:23:08 INFO Signed narinfos id=26 count=24856lb # [ 89.754881] niks3-server[1041]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4857lb # [ 89.768362] niks3-server[1041]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4858lb # [ 89.771888] niks3-server[1041]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4859lb # [ 89.779245] niks3-server[1041]: 2026/09/20 12:23:08 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4860lb # [ 89.781935] niks3-server[1041]: 2026/09/20 12:23:08 INFO Completed upload id=254861lb # [ 89.783678] niks3-server[1041]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4862worker2 # [ 89.641913] nix-grpc-daemon[1148]: time=2026-09-20T12:23:08.059Z level=INFO msg="Upload complete. (344ms)"4863lb # [ 89.786478] niks3-server[1041]: 2026/09/20 12:23:08 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4864lb # [ 89.789059] niks3-server[1041]: 2026/09/20 12:23:08 INFO Completed upload id=264865worker2 # [ 89.652361] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46206 duration_s=0 paths=2 nar_bytes_in=3124866worker2 # [ 89.669588] nix-daemon[858]: reaped child process 1146, status = succeeded4867client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 2.07 seconds)4868worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4869worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4870worker1 # [ 89.890927] systemd[1]: Listening on Nix worker-protocol over gRPC.4871worker1 # [ 89.901179] systemd[1]: Starting Nix worker-protocol over gRPC...4872worker1 # [ 90.105747] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:08Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4873worker1 # [ 90.108480] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4874worker1 # [ 90.112696] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14875worker1 # [ 90.121357] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:08Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4876worker1 # [ 90.123164] systemd[1]: Started Nix worker-protocol over gRPC.4877lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4878lb: must succeed: curl -sf localhost:9901/clusters4879worker1 # [ 90.146279] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:08Z level=info event=scheduler_connected addr=lb:500514880worker2 # [ 90.076569] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:08Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:462004881worker2 # [ 90.081611] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04882lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4883lb: must succeed: curl -sf localhost:9901/clusters4884lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4885lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)4886(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.11 seconds)4887subtest: scheduler down: the other node takes the lock and keeps it4888lb: must succeed: curl -sf localhost:9901/clusters4889lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4890lb: must succeed: curl -sf localhost:9901/clusters4891lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4892lb: must succeed: curl -sf localhost:9901/clusters4893lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4894lb: must succeed: curl -sf localhost:9901/clusters4895lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4896worker2 # [ 91.519364] systemd[1]: Stopping Nix worker-protocol over gRPC...4897worker2 # [ 91.578136] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:09Z level=info event=signal_exit4898worker2 # [ 91.790627] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=scheduler_yield4899lb # [ 91.939048] niks3-server[1041]: 2026/09/20 12:23:10 INFO lead: released remote=192.168.1.4:512484900worker1 # [ 91.871774] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:10Z level=info event=scheduler_restarting addr=lb:500514901worker2 # [ 91.797900] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:462004902worker2 # [ 91.804269] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=worker_gone addr=192.168.1.3:500514903worker2 # [ 91.810475] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=scheduler_restarting addr=lb:500514904worker2 # [ 91.814669] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:462004905worker2 # [ 91.819213] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=worker_gone addr=192.168.1.4:500514906worker1 # [ 92.071825] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:10Z level=info event=scheduler_connected addr=lb:500514907worker1 # [ 92.077278] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4908worker2 # [ 92.005731] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=scheduler_connected addr=lb:500514909worker2 # [ 92.011200] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4910worker1 # [ 92.277985] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:10Z level=info event=scheduler_connected addr=lb:500514911worker1 # [ 92.283350] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4912worker2 # [ 92.212512] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=scheduler_connected addr=lb:500514913worker2 # [ 92.217862] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4914worker1 # [ 92.484333] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:10Z level=info event=scheduler_connected addr=lb:500514915worker1 # [ 92.489598] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4916worker2 # [ 92.419167] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=scheduler_connected addr=lb:500514917worker2 # [ 92.424699] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4918worker1 # [ 92.690472] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:500514919worker1 # [ 92.696067] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4920worker2 # [ 92.630261] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4921worker2 # [ 92.796897] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:11Z level=info event=scheduler_restarting4922worker1 # [ 92.898703] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:500514923worker2 # [ 92.827522] nix-daemon[858]: reaped child process 1141, status = succeeded4924worker1 # [ 92.903070] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4925worker1 # [ 93.099387] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:500514926worker1 # [ 93.104856] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4927worker2 # [ 93.045824] nix-grpc-daemon[1092]: ts=2026-09-20T12:23:11Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4928worker1 # [ 93.305745] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:500514929worker1 # [ 93.311075] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4930worker1 # [ 93.511902] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:11Z level=info event=scheduler_connected addr=lb:500514931worker1 # [ 93.517213] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4932lb # [ 93.694891] envoy[922]: conn peer=[2001:db8:1::1]:44894 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=294933lb # [ 93.700438] envoy[922]: conn peer=192.168.1.3:37756 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10030 tx=2834 ms=613574934lb # [ 93.706364] envoy[922]: conn peer=[2001:db8:1::1]:44898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=282 ms=18044935lb # [ 93.712855] envoy[922]: conn peer=[2001:db8:1::4]:57274 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4045 tx=326 ms=84394936worker2 # [ 93.630846] nix-grpc-daemon[1092]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4937worker2 # [ 93.635437] nix-grpc-daemon[1092]: E0000 00:00:1789906992.046971 1135 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4938worker1 # [ 93.718056] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:12Z level=info event=scheduler_connected addr=lb:500514939worker2 # [ 93.642031] nix-grpc-daemon[1092]: E0000 00:00:1789906992.047329 1135 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4940worker1 # [ 93.723384] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4941worker1 # [ 93.926519] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:12Z level=info event=scheduler_connected addr=lb:500514942worker1 # [ 93.930762] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4943worker1 # [ 94.126980] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:12Z level=info event=scheduler_connected addr=lb:500514944worker1 # [ 94.132365] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4945worker1 # [ 94.333205] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:12Z level=info event=scheduler_connected addr=lb:500514946worker1 # [ 94.338618] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4947worker1 # [ 94.539270] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:12Z level=info event=scheduler_connected addr=lb:500514948worker1 # [ 94.544600] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4949worker2 # [ 94.610736] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4950worker2 # [ 94.617112] systemd[1]: Stopped Nix worker-protocol over gRPC.4951worker2 # [ 94.619581] systemd[1]: nix-grpc-daemon.service: Consumed 456ms CPU time over 10.240s wall clock time, 31.2M memory peak, 18.8K incoming IP traffic, 25.2K outgoing IP traffic.4952worker2 # [ 94.638982] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4953worker2 # [ 94.641443] systemd[1]: Closed Nix worker-protocol over gRPC.4954worker2 # [ 94.644613] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 10.478s wall clock time, 256K memory peak, 20.8K incoming IP traffic, 15.6K outgoing IP traffic.4955worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4956worker1 # [ 94.745879] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:500514957worker1 # [ 94.753063] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4958worker1 # [ 94.954688] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:500514959worker1 # [ 94.958968] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4960worker1 # [ 95.133316] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:13Z level=info event=scheduler_take_over4961lb # [ 95.202208] niks3-server[1041]: 2026/09/20 12:23:13 INFO lead: acquired remote=192.168.1.3:441164962worker1 # [ 95.155715] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:500514963worker1 # [ 95.161026] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4964worker1 # [ 95.361877] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:500514965worker1 # [ 95.367150] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4966worker1 # [ 95.567994] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:500514967worker1 # [ 95.573245] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4968worker1 # [ 95.774160] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:14Z level=info event=scheduler_connected addr=lb:500514969worker1 # [ 95.783798] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:14Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:365384970worker1 # [ 95.790464] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04971worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.17 seconds)4972worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4973worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4974client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24975worker1 # [ 96.206309] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:365404976worker1 # [ 96.223597] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)4977client # don't know how to build these paths:4978client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4979worker1 # [ 96.244102] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365404980worker1 # [ 96.261689] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5)4981worker1 # [ 96.324436] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 2/5)4982worker1 # [ 96.336049] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 3/5)4983worker1 # [ 96.351519] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 218 ms (attempt 4/5)4984worker1 # [ 96.577902] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4985worker1 # [ 96.614759] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:15Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04986worker1 # [ 96.622620] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:15Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14987worker1 # [ 96.661984] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365404988worker1 # [ 96.681147] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365404989client # copying 1 paths to 'lb:50051'...4990client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4991worker1 # [ 96.700126] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365404992worker1 # [ 96.716226] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)4993worker1 # [ 96.747790] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:15Z level=info event=niks3_push_started pid=12724994worker1 # [ 96.974071] nix-grpc-daemon[1272]: time=2026-09-20T12:23:15.404Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""4995worker1 # [ 97.157866] nix-daemon[837]: accepted connection from pid 1285, user nix-grpc-daemon (trusted)4996worker1 # [ 97.178168] nix-daemon[837]: reaped child process 1288, status = succeeded4997worker1 # [ 97.364893] nix-daemon[837]: accepted connection from pid 1290, user nix-grpc-daemon (trusted)4998worker1 # [ 97.384653] nix-daemon[837]: reaped child process 1293, status = succeeded4999lb # [ 97.465183] niks3-server[1041]: 2026/09/20 12:23:15 INFO Received uploads request method=POST path=/api/pending_closures5000worker1 # [ 97.409815] nix-grpc-daemon[1272]: time=2026-09-20T12:23:15.839Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5001worker1 # [ 97.411422] nix-grpc-daemon[1272]: time=2026-09-20T12:23:15.839Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5002lb # [ 97.512390] niks3-server[1041]: 2026/09/20 12:23:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5003lb # [ 97.534691] niks3-server[1041]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5004lb # [ 97.557652] niks3-server[1041]: 2026/09/20 12:23:15 INFO Signed narinfos id=27 count=15005worker1 # [ 97.490614] nix-grpc-daemon[1272]: time=2026-09-20T12:23:15.920Z level=INFO msg="Uploading 1 narinfos"5006lb # [ 97.575649] niks3-server[1041]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5007lb # [ 97.580976] niks3-server[1041]: 2026/09/20 12:23:15 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5008lb # [ 97.595748] niks3-server[1041]: 2026/09/20 12:23:16 INFO Completed upload id=275009worker1 # [ 97.528175] nix-grpc-daemon[1272]: time=2026-09-20T12:23:15.958Z level=INFO msg="Upload complete. (550ms)"5010lb # [ 97.604258] niks3-server[1041]: 2026/09/20 12:23:16 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5011worker1 # [ 97.542877] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36540 duration_s=0 paths=1 nar_bytes_in=5205012worker1 # [ 97.560486] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365405013worker1 # [ 97.570444] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5014worker1 # [ 97.576300] nix-daemon[837]: reaped child process 1270, status = succeeded5015client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5016client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5017worker1 # [ 97.593799] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5018client # farm-a> LOG-farm-a-on-standby5019worker1 # [ 99.044979] nix-daemon[837]: reaped child process 1297, status = succeeded5020worker1 # [ 99.240165] nix-daemon[837]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5021worker1 # [ 99.261220] nix-daemon[837]: reaped child process 1315, status = succeeded5022lb # [ 99.342321] niks3-server[1041]: 2026/09/20 12:23:17 INFO Received uploads request method=POST path=/api/pending_closures5023worker1 # [ 99.292665] nix-grpc-daemon[1272]: time=2026-09-20T12:23:17.722Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5024worker1 # [ 99.294914] nix-grpc-daemon[1272]: time=2026-09-20T12:23:17.722Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5025lb # [ 99.405648] niks3-server[1041]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5026lb # [ 99.416732] niks3-server[1041]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5027lb # [ 99.428770] niks3-server[1041]: 2026/09/20 12:23:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5028lb # [ 99.435771] niks3-server[1041]: 2026/09/20 12:23:17 INFO Signed narinfos id=28 count=15029worker1 # [ 99.368141] nix-grpc-daemon[1272]: time=2026-09-20T12:23:17.797Z level=INFO msg="Uploading 1 narinfos"5030lb # [ 99.439459] niks3-server[1041]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5031lb # [ 99.456225] niks3-server[1041]: 2026/09/20 12:23:17 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5032lb # [ 99.465844] niks3-server[1041]: 2026/09/20 12:23:17 INFO Completed upload id=285033worker1 # [ 99.398053] nix-grpc-daemon[1272]: time=2026-09-20T12:23:17.828Z level=INFO msg="Upload complete. (390ms)"5034lb # [ 99.469725] niks3-server[1041]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5035worker1 # [ 99.428884] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36540 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15036worker1 # [ 99.444408] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:17Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05037worker1 # [ 99.450011] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:17Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15038worker1 # [ 99.455312] nix-daemon[837]: reaped child process 1295, status = succeeded5039worker1 # [ 99.469428] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365405040worker1 # [ 99.486247] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365405041worker1 # [ 99.503184] nix-grpc-daemon[1272]: time=2026-09-20T12:23:17.934Z level=INFO msg="All 1 paths already cached"5042client # copying 1 paths to 'lb:50051'...5043client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5044worker1 # [ 99.513518] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365405045worker1 # [ 99.528469] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5046worker1 # [ 99.737799] nix-daemon[837]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5047worker1 # [ 99.759890] nix-daemon[837]: reaped child process 1324, status = succeeded5048worker1 # [ 99.942901] nix-daemon[837]: accepted connection from pid 1326, user nix-grpc-daemon (trusted)5049worker1 # [ 99.964857] nix-daemon[837]: reaped child process 1329, status = succeeded5050lb # [ 100.044413] niks3-server[1041]: 2026/09/20 12:23:18 INFO Received uploads request method=POST path=/api/pending_closures5051worker1 # [ 100.051714] nix-grpc-daemon[1272]: time=2026-09-20T12:23:18.482Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5052worker1 # [ 100.057179] nix-grpc-daemon[1272]: time=2026-09-20T12:23:18.486Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5053lb # [ 100.149075] niks3-server[1041]: 2026/09/20 12:23:18 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5054lb # [ 100.166767] niks3-server[1041]: 2026/09/20 12:23:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5055worker1 # [ 100.106235] nix-grpc-daemon[1272]: time=2026-09-20T12:23:18.536Z level=INFO msg="Uploading 1 narinfos"5056lb # [ 100.178521] niks3-server[1041]: 2026/09/20 12:23:18 INFO Signed narinfos id=29 count=15057lb # [ 100.186080] niks3-server[1041]: 2026/09/20 12:23:18 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5058lb # [ 100.197599] niks3-server[1041]: 2026/09/20 12:23:18 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5059lb # [ 100.206882] niks3-server[1041]: 2026/09/20 12:23:18 INFO Completed upload id=295060worker1 # [ 100.138834] nix-grpc-daemon[1272]: time=2026-09-20T12:23:18.569Z level=INFO msg="Upload complete. (592ms)"5061lb # [ 100.209499] niks3-server[1041]: 2026/09/20 12:23:18 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5062worker1 # [ 100.149889] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36540 duration_s=0 paths=1 nar_bytes_in=6405063worker1 # [ 100.165267] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365405064worker1 # [ 100.183637] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5065worker1 # [ 100.196386] nix-daemon[837]: reaped child process 1319, status = succeeded5066client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5067client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5068worker1 # [ 100.208250] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5069client # farm-b> LOG-farm-b-on-standby5070worker1 # [ 101.264279] nix-daemon[837]: reaped child process 1333, status = succeeded5071worker1 # [ 101.458230] nix-daemon[837]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5072worker1 # [ 101.477569] nix-daemon[837]: reaped child process 1351, status = succeeded5073lb # [ 101.561841] niks3-server[1041]: 2026/09/20 12:23:19 INFO Received uploads request method=POST path=/api/pending_closures5074worker1 # [ 101.518952] nix-grpc-daemon[1272]: time=2026-09-20T12:23:19.948Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5075worker1 # [ 101.520938] nix-grpc-daemon[1272]: time=2026-09-20T12:23:19.948Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5076lb # [ 101.612115] niks3-server[1041]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5077lb # [ 101.629684] niks3-server[1041]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5078lb # [ 101.644338] niks3-server[1041]: 2026/09/20 12:23:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5079worker1 # [ 101.584619] nix-grpc-daemon[1272]: time=2026-09-20T12:23:20.014Z level=INFO msg="Uploading 1 narinfos"5080lb # [ 101.659167] niks3-server[1041]: 2026/09/20 12:23:20 INFO Signed narinfos id=30 count=15081lb # [ 101.666107] niks3-server[1041]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5082lb # [ 101.675734] niks3-server[1041]: 2026/09/20 12:23:20 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5083lb # [ 101.683112] niks3-server[1041]: 2026/09/20 12:23:20 INFO Completed upload id=305084worker1 # [ 101.614623] nix-grpc-daemon[1272]: time=2026-09-20T12:23:20.045Z level=INFO msg="Upload complete. (392ms)"5085lb # [ 101.685672] niks3-server[1041]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5086worker1 # [ 101.637609] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36540 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15087worker1 # [ 101.658877] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:20Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05088worker1 # [ 101.664296] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:20Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15089worker1 # [ 101.669993] nix-daemon[837]: reaped child process 1331, status = succeeded5090worker1 # [ 101.677107] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365405091worker1 # [ 101.693694] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365405092worker1 # [ 101.809283] nix-grpc-daemon[1272]: time=2026-09-20T12:23:20.239Z level=INFO msg="All 2 paths already cached"5093client # copying 1 paths to 'lb:50051'...5094client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5095worker1 # [ 101.822116] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365405096worker1 # [ 101.837457] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5097worker1 # [ 102.057243] nix-daemon[837]: accepted connection from pid 1357, user nix-grpc-daemon (trusted)5098worker1 # [ 102.078626] nix-daemon[837]: reaped child process 1360, status = succeeded5099worker1 # [ 102.263550] nix-daemon[837]: accepted connection from pid 1362, user nix-grpc-daemon (trusted)5100worker1 # [ 102.282473] nix-daemon[837]: reaped child process 1365, status = succeeded5101lb # [ 102.362170] niks3-server[1041]: 2026/09/20 12:23:20 INFO Received uploads request method=POST path=/api/pending_closures5102worker1 # [ 102.306549] nix-grpc-daemon[1272]: time=2026-09-20T12:23:20.737Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5103worker1 # [ 102.308161] nix-grpc-daemon[1272]: time=2026-09-20T12:23:20.737Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5104lb # [ 102.394696] niks3-server[1041]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5105lb # [ 102.411784] niks3-server[1041]: 2026/09/20 12:23:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5106worker1 # [ 102.350189] nix-grpc-daemon[1272]: time=2026-09-20T12:23:20.780Z level=INFO msg="Uploading 1 narinfos"5107lb # [ 102.421899] niks3-server[1041]: 2026/09/20 12:23:20 INFO Signed narinfos id=31 count=15108lb # [ 102.431621] niks3-server[1041]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5109lb # [ 102.443164] niks3-server[1041]: 2026/09/20 12:23:20 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5110lb # [ 102.452864] niks3-server[1041]: 2026/09/20 12:23:20 INFO Completed upload id=315111lb # [ 102.455734] niks3-server[1041]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5112worker1 # [ 102.384973] nix-grpc-daemon[1272]: time=2026-09-20T12:23:20.815Z level=INFO msg="Upload complete. (528ms)"5113worker1 # [ 102.396263] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36540 duration_s=0 paths=1 nar_bytes_in=7685114worker1 # [ 102.412645] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365405115worker1 # [ 102.419613] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5116worker1 # [ 102.425012] nix-daemon[837]: reaped child process 1355, status = succeeded5117client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5118worker1 # [ 102.438359] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5119client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5120client # farm-top> LOG-farm-top-on-standby5121worker1 # [ 103.062497] nix-daemon[837]: reaped child process 1369, status = succeeded5122worker1 # [ 103.223085] nix-daemon[837]: accepted connection from pid 1384, user nix-grpc-daemon (trusted)5123worker1 # [ 103.244728] nix-daemon[837]: reaped child process 1387, status = succeeded5124lb # [ 103.325159] niks3-server[1041]: 2026/09/20 12:23:21 INFO Received uploads request method=POST path=/api/pending_closures5125worker1 # [ 103.269713] nix-grpc-daemon[1272]: time=2026-09-20T12:23:21.700Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5126worker1 # [ 103.272891] nix-grpc-daemon[1272]: time=2026-09-20T12:23:21.702Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5127lb # [ 103.361861] niks3-server[1041]: 2026/09/20 12:23:21 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5128lb # [ 103.377005] niks3-server[1041]: 2026/09/20 12:23:21 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5129lb # [ 103.386899] niks3-server[1041]: 2026/09/20 12:23:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5130worker1 # [ 103.324415] nix-grpc-daemon[1272]: time=2026-09-20T12:23:21.754Z level=INFO msg="Uploading 1 narinfos"5131lb # [ 103.397363] niks3-server[1041]: 2026/09/20 12:23:21 INFO Signed narinfos id=32 count=15132lb # [ 103.403032] niks3-server[1041]: 2026/09/20 12:23:21 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5133lb # [ 103.410682] niks3-server[1041]: 2026/09/20 12:23:21 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5134lb # [ 103.418044] niks3-server[1041]: 2026/09/20 12:23:21 INFO Completed upload id=325135worker1 # [ 103.349037] nix-grpc-daemon[1272]: time=2026-09-20T12:23:21.779Z level=INFO msg="Upload complete. (301ms)"5136lb # [ 103.420331] niks3-server[1041]: 2026/09/20 12:23:21 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5137worker1 # [ 103.361075] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36540 duration_s=0 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15138worker1 # [ 103.376850] nix-daemon[837]: reaped child process 1367, status = succeeded5139client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.50 seconds)5140client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5141lb # [ 103.694075] envoy[922]: conn peer=[2001:db8:1::1]:33632 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9567 tx=3866 ms=72175142client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5143worker2 # [ 103.707107] systemd[1]: Listening on Nix worker-protocol over gRPC.5144worker2 # [ 103.716561] systemd[1]: Starting scheduler-token.service...5145worker2 # [ 103.817768] systemd[1]: scheduler-token.service: Deactivated successfully.5146worker2 # [ 103.823930] systemd[1]: Finished scheduler-token.service.5147worker2 # [ 103.827047] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 101ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5148worker2 # [ 103.830977] systemd[1]: Starting Nix worker-protocol over gRPC...5149worker2 # [ 104.011855] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:22Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5150worker2 # [ 104.014540] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:22Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5151worker2 # [ 104.018735] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:22Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15152worker2 # [ 104.026828] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:22Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5153worker2 # [ 104.035263] systemd[1]: Started Nix worker-protocol over gRPC.5154lb: must succeed: curl -sf localhost:9901/clusters5155worker2 # [ 104.050168] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:22Z level=info event=scheduler_connected addr=lb:500515156worker1 # [ 104.136300] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:22Z level=info event=oidc_jwks provider=mock keys=15157lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5158worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5159worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5160lb: must succeed: curl -sf localhost:9901/clusters5161lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5162lb: must succeed: curl -sf localhost:9901/clusters5163lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5164worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5165worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5166(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.19 seconds)5167subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5168client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5169client # [ 104.504736] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5170client # Running as unit: rs.service; invocation ID: 1ff3ea90ea454e628a466ceb9f4f7b665171client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5172worker1 # [ 104.142610] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:22Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:365385173worker1 # [ 104.142905] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:22Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05174worker2 # [ 104.749076] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:446805175worker2 # [ 104.764492] nix-daemon[858]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5176client # [ 104.789490] nix[1167]: don't know how to build these paths:5177client # [ 104.791294] nix[1167]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5178worker1 # [ 104.874916] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:23Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05179worker1 # [ 104.880814] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:23Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15180worker1 # [ 104.921485] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365405181worker1 # [ 104.937505] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365405182client # [ 104.885338] nix[1167]: copying 1 paths to 'lb:50051'...5183worker1 # [ 104.953195] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365405184client # [ 104.888753] nix[1167]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5185worker1 # [ 104.971721] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5186worker1 # [ 105.179287] nix-daemon[837]: accepted connection from pid 1400, user nix-grpc-daemon (trusted)5187worker1 # [ 105.200799] nix-daemon[837]: reaped child process 1403, status = succeeded5188worker1 # [ 105.376670] nix-daemon[837]: accepted connection from pid 1405, user nix-grpc-daemon (trusted)5189worker1 # [ 105.397686] nix-daemon[837]: reaped child process 1408, status = succeeded5190lb # [ 105.479150] niks3-server[1041]: 2026/09/20 12:23:23 INFO Received uploads request method=POST path=/api/pending_closures5191worker1 # [ 105.423652] nix-grpc-daemon[1272]: time=2026-09-20T12:23:23.853Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5192worker1 # [ 105.425369] nix-grpc-daemon[1272]: time=2026-09-20T12:23:23.853Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5193lb # [ 105.513062] niks3-server[1041]: 2026/09/20 12:23:23 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5194lb # [ 105.532096] niks3-server[1041]: 2026/09/20 12:23:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5195worker1 # [ 105.469918] nix-grpc-daemon[1272]: time=2026-09-20T12:23:23.900Z level=INFO msg="Uploading 1 narinfos"5196lb # [ 105.545882] niks3-server[1041]: 2026/09/20 12:23:23 INFO Signed narinfos id=33 count=15197lb # [ 105.552910] niks3-server[1041]: 2026/09/20 12:23:23 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5198lb # [ 105.560915] niks3-server[1041]: 2026/09/20 12:23:23 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5199lb # [ 105.571143] niks3-server[1041]: 2026/09/20 12:23:23 INFO Completed upload id=335200worker1 # [ 105.503379] nix-grpc-daemon[1272]: time=2026-09-20T12:23:23.934Z level=INFO msg="Upload complete. (513ms)"5201lb # [ 105.578945] niks3-server[1041]: 2026/09/20 12:23:23 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5202worker1 # [ 105.512350] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36540 duration_s=0 paths=1 nar_bytes_in=4165203worker1 # [ 105.524463] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365405204worker1 # [ 105.539575] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5205worker1 # [ 105.545948] nix-daemon[837]: reaped child process 1398, status = succeeded5206client # [ 105.490744] nix[1167]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5207worker1 # [ 105.562531] nix-daemon[837]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5208lb: must succeed: curl -sf localhost:9901/clusters5209lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5210lb: must succeed: curl -sf localhost:9901/clusters5211lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5212lb: must succeed: curl -sf localhost:9901/clusters5213lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5214lb: must succeed: curl -sf localhost:9901/clusters5215lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5216worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5217worker2 # [ 107.507808] systemd-journald[273]: Received client request to rotate journal, rotating.5218worker2 # [ 107.548429] systemd-journald[273]: Vacuuming done, freed 0B of archived journals from /var/log/journal/4e56f9ac515a4557834f02bdfa234572.5219worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.11 seconds)5220worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5221worker1 # [ 107.675560] systemd[1]: Stopping Nix worker-protocol over gRPC...5222worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5223client: must succeed: sleep 5.05224worker1 # [ 108.131988] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:26Z level=info event=draining5225client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5226worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5227worker1 # [ 113.213144] nix-daemon[837]: reaped child process 1412, status = succeeded5228worker1 # [ 113.409181] nix-daemon[837]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)5229worker1 # [ 113.428601] nix-daemon[837]: reaped child process 1455, status = succeeded5230lb # [ 113.511133] niks3-server[1041]: 2026/09/20 12:23:31 INFO Received uploads request method=POST path=/api/pending_closures5231worker1 # [ 113.459133] nix-grpc-daemon[1272]: time=2026-09-20T12:23:31.887Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5232worker1 # [ 113.460843] nix-grpc-daemon[1272]: time=2026-09-20T12:23:31.887Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5233lb # [ 113.557862] niks3-server[1041]: 2026/09/20 12:23:31 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5234lb # [ 113.570506] niks3-server[1041]: 2026/09/20 12:23:31 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5235worker1 # [ 113.508801] nix-grpc-daemon[1272]: time=2026-09-20T12:23:31.939Z level=INFO msg="Uploading 1 narinfos"5236lb # [ 113.578511] niks3-server[1041]: 2026/09/20 12:23:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5237lb # [ 113.583516] niks3-server[1041]: 2026/09/20 12:23:31 INFO Signed narinfos id=34 count=15238lb # [ 113.588853] niks3-server[1041]: 2026/09/20 12:23:32 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5239lb # [ 113.594491] niks3-server[1041]: 2026/09/20 12:23:32 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5240worker1 # [ 113.526541] nix-grpc-daemon[1272]: time=2026-09-20T12:23:31.957Z level=INFO msg="Upload complete. (344ms)"5241lb # [ 113.599327] niks3-server[1041]: 2026/09/20 12:23:32 INFO Completed upload id=345242lb # [ 113.605283] niks3-server[1041]: 2026/09/20 12:23:32 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5243worker1 # [ 113.541066] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36540 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15244worker1 # [ 113.556291] nix-daemon[837]: reaped child process 1410, status = succeeded5245client # [ 113.514391] systemd[1]: rs.service: Deactivated successfully.5246client # [ 113.518738] systemd[1]: rs.service: Consumed 166ms CPU time over 9.013s wall clock time, 39.2M memory peak, 8.7K incoming IP traffic, 9.1K outgoing IP traffic.5247lb # [ 113.695029] envoy[922]: conn peer=[2001:db8:1::1]:34614 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2940 tx=1326 ms=87345248worker1 # [ 114.135318] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:32Z level=info event=signal_exit5249worker1 # [ 114.369295] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:32Z level=info event=scheduler_yield5250lb # [ 114.438772] niks3-server[1041]: 2026/09/20 12:23:32 INFO lead: released remote=192.168.1.3:441165251worker2 # [ 114.300674] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:32Z level=info event=scheduler_restarting addr=lb:500515252worker1 # [ 114.374978] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:32Z level=info event=scheduler_restarting addr=lb:500515253worker1 # [ 114.384356] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:365385254worker1 # [ 114.388950] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:32Z level=info event=worker_gone addr=192.168.1.3:500515255worker1 # [ 114.392922] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:365385256worker1 # [ 114.397302] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:32Z level=info event=worker_gone addr=192.168.1.4:500515257worker2 # [ 114.501235] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:32Z level=info event=scheduler_connected addr=lb:500515258worker1 # [ 114.578465] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:33Z level=info event=scheduler_connected addr=lb:500515259worker2 # [ 114.507022] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5260worker1 # [ 114.583778] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5261worker2 # [ 114.708103] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:33Z level=info event=scheduler_connected addr=lb:500515262worker1 # [ 114.784528] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:33Z level=info event=scheduler_connected addr=lb:500515263worker2 # [ 114.713469] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5264worker1 # [ 114.789764] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5265worker2 # [ 114.914898] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:33Z level=info event=scheduler_connected addr=lb:500515266worker1 # [ 114.990691] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:33Z level=info event=scheduler_connected addr=lb:500515267worker2 # [ 114.920555] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5268worker1 # [ 114.996241] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5269worker1 # [ 115.197061] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:33Z level=info event=scheduler_connected addr=lb:500515270worker2 # [ 115.122437] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:33Z level=info event=scheduler_connected addr=lb:500515271worker1 # [ 115.202496] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5272worker2 # [ 115.129414] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5273worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.22 seconds)5274client: waiting for success: ! systemctl is-active rs5275client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5276client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5277worker1 # [ 115.370832] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:33Z level=info event=scheduler_restarting5278client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5279client: must fail: journalctl -u rs | grep -q 'reconnecting'5280worker2 # [ 115.331381] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:33Z level=info event=scheduler_connected addr=lb:500515281worker2 # [ 115.335794] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5282worker1 # [ 115.423930] nix-grpc-daemon[1199]: ts=2026-09-20T12:23:33Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5283worker1 # [ 115.429981] nix-daemon[837]: reaped child process 1263, status = succeeded5284client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5285lb: must succeed: curl -sf localhost:9901/clusters5286lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5287worker2 # [ 115.532782] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:33Z level=info event=scheduler_connected addr=lb:500515288worker2 # [ 115.538028] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5289worker1 # [ 115.663770] nix-grpc-daemon[1199]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5290worker1 # [ 115.668512] nix-grpc-daemon[1199]: E0000 00:00:1789907014.093244 1242 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5291worker1 # [ 115.687802] nix-grpc-daemon[1199]: E0000 00:00:1789907014.118579 1242 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5292worker2 # [ 115.739146] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500515293worker2 # [ 115.744554] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5294worker2 # [ 115.945718] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500515295worker2 # [ 115.950930] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5296worker2 # [ 116.152263] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500515297worker2 # [ 116.157543] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5298worker1 # [ 116.340548] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5299worker1 # [ 116.345170] systemd[1]: Stopped Nix worker-protocol over gRPC.5300worker1 # [ 116.347759] systemd[1]: nix-grpc-daemon.service: Consumed 1.954s CPU time over 26.438s wall clock time, 34.4M memory peak, 49.2K incoming IP traffic, 90.6K outgoing IP traffic.5301worker1 # [ 116.371076] systemd[1]: Starting Nix worker-protocol over gRPC...5302worker2 # [ 116.360980] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500515303worker2 # [ 116.365133] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5304lb: must succeed: curl -sf localhost:9901/clusters5305worker1 # [ 116.569879] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5306worker1 # [ 116.572484] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5307worker1 # [ 116.576539] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15308worker1 # [ 116.584453] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5309worker1 # [ 116.586246] systemd[1]: Started Nix worker-protocol over gRPC.5310worker1 # [ 116.593195] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=scheduler_take_over5311lb # [ 116.662384] niks3-server[1041]: 2026/09/20 12:23:35 INFO lead: acquired remote=192.168.1.3:329565312worker1 # [ 116.607176] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500515313worker1 # [ 116.609140] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5314lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5315worker2 # [ 116.562071] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500515316worker2 # [ 116.567466] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5317worker1 # [ 116.810269] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500515318worker1 # [ 116.815564] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5319worker2 # [ 116.768760] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500515320worker2 # [ 116.774106] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5321worker1 # [ 117.016596] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500515322worker1 # [ 117.021958] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5323worker2 # [ 116.975230] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500515324worker2 # [ 116.980596] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5325worker1 # [ 117.222997] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500515326worker1 # [ 117.228586] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5327worker2 # [ 117.181805] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500515328worker2 # [ 117.187165] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5329worker1 # [ 117.429561] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500515330worker1 # [ 117.438749] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:372005331worker1 # [ 117.444232] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05332worker2 # [ 117.389846] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500515333worker1 # [ 117.472158] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=oidc_jwks provider=mock keys=15334worker1 # [ 117.477435] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:372005335worker1 # [ 117.482953] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05336lb: must succeed: curl -sf localhost:9901/clusters5337lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5338worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5339worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5340(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.28 seconds)5341subtest: scheduler restart mid-build: build finishes, no double build5342client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5343client # [ 117.783795] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5344client # Running as unit: mid.service; invocation ID: 6ccd52ff838e4d7b9c84b6847cc65fc25345client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5346worker1 # [ 118.090619] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:372125347worker1 # [ 118.104413] nix-daemon[837]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5348client # [ 118.055559] nix[1203]: don't know how to build these paths:5349client # [ 118.057022] nix[1203]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5350worker1 # [ 118.137566] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:36Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05351worker1 # [ 118.145165] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:36Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15352worker1 # [ 118.184752] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372125353worker1 # [ 118.201902] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5)5354worker1 # [ 118.233314] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 176 ms (attempt 2/5)5355worker1 # [ 118.417246] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 142 ms (attempt 3/5)5356worker1 # [ 118.566924] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 4/5)5357worker1 # [ 118.644127] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5358worker1 # [ 118.665966] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:372125359client # [ 118.615247] nix[1203]: copying 1 paths to 'lb:50051'...5360worker1 # [ 118.682445] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:372125361client # [ 118.618011] nix[1203]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5362worker1 # [ 118.697615] nix-daemon[837]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5363worker1 # [ 118.726466] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:37Z level=info event=niks3_push_started pid=15275364worker1 # [ 118.941818] nix-grpc-daemon[1527]: time=2026-09-20T12:23:37.372Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5365worker1 # [ 119.130754] nix-daemon[837]: accepted connection from pid 1540, user nix-grpc-daemon (trusted)5366worker1 # [ 119.157151] nix-daemon[837]: reaped child process 1547, status = succeeded5367worker1 # [ 119.330887] nix-daemon[837]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5368worker1 # [ 119.351204] nix-daemon[837]: reaped child process 1552, status = succeeded5369lb # [ 119.434460] niks3-server[1041]: 2026/09/20 12:23:37 INFO Received uploads request method=POST path=/api/pending_closures5370worker1 # [ 119.376513] nix-grpc-daemon[1527]: time=2026-09-20T12:23:37.807Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5371worker1 # [ 119.379791] nix-grpc-daemon[1527]: time=2026-09-20T12:23:37.809Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5372lb # [ 119.470582] niks3-server[1041]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5373lb # [ 119.483344] niks3-server[1041]: 2026/09/20 12:23:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5374worker1 # [ 119.422092] nix-grpc-daemon[1527]: time=2026-09-20T12:23:37.852Z level=INFO msg="Uploading 1 narinfos"5375lb # [ 119.496629] niks3-server[1041]: 2026/09/20 12:23:37 INFO Signed narinfos id=35 count=15376lb # [ 119.503935] niks3-server[1041]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5377lb # [ 119.513503] niks3-server[1041]: 2026/09/20 12:23:37 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5378lb # [ 119.521074] niks3-server[1041]: 2026/09/20 12:23:37 INFO Completed upload id=355379worker1 # [ 119.453093] nix-grpc-daemon[1527]: time=2026-09-20T12:23:37.883Z level=INFO msg="Upload complete. (506ms)"5380lb # [ 119.524534] niks3-server[1041]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5381worker1 # [ 119.460772] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37212 duration_s=0 paths=1 nar_bytes_in=4245382worker1 # [ 119.475744] nix-grpc-daemon[1462]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:372125383worker1 # [ 119.482654] nix-daemon[837]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5384worker1 # [ 119.487564] nix-daemon[837]: reaped child process 1525, status = succeeded5385worker1 # [ 119.498380] nix-daemon[837]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5386client # [ 119.431132] nix[1203]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5387lb: must succeed: curl -sf localhost:9901/clusters5388lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5389lb: must succeed: curl -sf localhost:9901/clusters5390lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5391worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5392worker1 # [ 121.923768] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1462 (nix-grpc-daemon) on client request.5393worker1 # [ 121.927099] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5394lb # [ 122.002289] niks3-server[1041]: 2026/09/20 12:23:40 INFO lead: released remote=192.168.1.3:329565395client # [ 121.876515] nix[1203]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5396worker2 # [ 121.869281] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:40Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5397worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5398client: must succeed: sleep 5.05399client # [ 121.876907] nix[1203]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5400worker1 # [ 121.972575] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5401worker1 # [ 121.974227] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5402worker1 # [ 121.975538] systemd[1]: nix-grpc-daemon.service: Consumed 520ms CPU time over 5.593s wall clock time, 31.5M memory peak, 14.4K incoming IP traffic, 18.8K outgoing IP traffic.5403worker1 # [ 121.984739] nix-daemon[837]: reaped child process 1518, status = succeeded5404worker1 # [ 121.986552] nix-daemon[837]: reaped child process 1554, status = succeeded5405worker1 # [ 121.996645] nix-daemon[1556]: unexpected Nix daemon error: error: interrupted by the user5406worker1 # [ 122.003054] nix-daemon[837]: reaped child process 1556, status = failed with exit code 15407worker2 # [ 122.069557] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:40Z level=info event=scheduler_connected addr=lb:500515408worker1 # [ 122.147363] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5409worker1 # [ 122.157172] systemd[1]: Starting Nix worker-protocol over gRPC...5410worker1 # [ 122.362456] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5411worker1 # [ 122.364961] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5412worker1 # [ 122.369067] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15413worker1 # [ 122.377119] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5414worker1 # [ 122.378923] systemd[1]: Started Nix worker-protocol over gRPC.5415worker1 # [ 122.393676] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=info event=scheduler_take_over5416lb # [ 122.462033] niks3-server[1041]: 2026/09/20 12:23:40 INFO lead: acquired remote=192.168.1.3:424145417worker1 # [ 122.408808] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=info event=oidc_jwks provider=mock keys=15418worker1 # [ 122.410362] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:429965419worker1 # [ 122.417239] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05420worker1 # [ 122.420288] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=info event=scheduler_connected addr=lb:500515421worker1 # [ 122.422250] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:429965422worker1 # [ 122.423895] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05423worker1 # [ 122.451583] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05424worker1 # [ 122.454275] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:40Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15425worker2 # [ 122.422941] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446805426worker2 # [ 122.440598] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5)5427worker2 # [ 122.453198] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 158 ms (attempt 2/5)5428worker2 # [ 122.618911] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 291 ms (attempt 3/5)5429worker2 # [ 122.918923] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 415 ms (attempt 4/5)5430worker2 # [ 123.342344] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5431worker2 # [ 123.362546] nix-grpc-daemon[1188]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5432worker2 # [ 123.392951] nix-daemon[858]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5433client # [ 123.418117] nix[1203]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5434worker2 # [ 123.415505] nix-daemon[858]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5435lb # [ 123.696636] envoy[922]: conn peer=[2001:db8:1::3]:53376 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4430 tx=1377 ms=252705436lb # [ 123.702772] envoy[922]: conn peer=[2001:db8:1::3]:34516 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1015 tx=434 ms=53405437client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5438client: waiting for success: ! systemctl is-active mid5439worker2 # [ 127.440798] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:45Z level=info event=niks3_push_started pid=13395440worker2 # [ 127.488724] nix-daemon[858]: reaped child process 1315, status = succeeded5441worker2 # [ 127.703807] nix-grpc-daemon[1339]: time=2026-09-20T12:23:46.120Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""5442worker2 # [ 127.878316] nix-daemon[858]: accepted connection from pid 1352, user nix-grpc-daemon (trusted)5443worker2 # [ 127.897971] nix-daemon[858]: reaped child process 1355, status = succeeded5444lb # [ 128.055866] niks3-server[1041]: 2026/09/20 12:23:46 INFO Received uploads request method=POST path=/api/pending_closures5445worker2 # [ 127.927597] nix-grpc-daemon[1339]: time=2026-09-20T12:23:46.343Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5446worker2 # [ 127.930532] nix-grpc-daemon[1339]: time=2026-09-20T12:23:46.343Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5447lb # [ 128.108585] niks3-server[1041]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5448lb # [ 128.126085] niks3-server[1041]: 2026/09/20 12:23:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5449worker2 # [ 127.985743] nix-grpc-daemon[1339]: time=2026-09-20T12:23:46.401Z level=INFO msg="Uploading 1 narinfos"5450lb # [ 128.140356] niks3-server[1041]: 2026/09/20 12:23:46 INFO Signed narinfos id=36 count=15451lb # [ 128.142632] niks3-server[1041]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5452worker2 # [ 128.014596] nix-grpc-daemon[1339]: time=2026-09-20T12:23:46.432Z level=INFO msg="Upload complete. (307ms)"5453lb # [ 128.160379] niks3-server[1041]: 2026/09/20 12:23:46 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5454lb # [ 128.166306] niks3-server[1041]: 2026/09/20 12:23:46 INFO Completed upload id=365455worker2 # [ 128.024242] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44680 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15456lb # [ 128.171575] niks3-server[1041]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5457lb # [ 128.176602] niks3-server[1041]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5458worker2 # [ 128.041654] nix-daemon[858]: reaped child process 1313, status = succeeded5459client # [ 128.080485] systemd[1]: mid.service: Deactivated successfully.5460client # [ 128.084709] systemd[1]: mid.service: Consumed 167ms CPU time over 10.300s wall clock time, 37.2M memory peak, 9.7K incoming IP traffic, 10.7K outgoing IP traffic.5461client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5462client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5463client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5464(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.74 seconds)5465subtest: interrupting the client stops the build on the worker5466client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5467client # [ 128.492793] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5468client # Running as unit: intr.service; invocation ID: da1dd95eac714125b275c8055a355f325469client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5470worker2 # [ 128.716973] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:446805471client # [ 128.731590] nix[1239]: don't know how to build these paths:5472client # [ 128.733277] nix[1239]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5473worker1 # [ 128.815653] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:47Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05474worker1 # [ 128.815995] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:47Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15475worker1 # [ 128.866025] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245476worker1 # [ 128.881196] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5477worker1 # [ 128.905110] nix-grpc-daemon[1592]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 1/5)5478worker1 # [ 128.974211] nix-grpc-daemon[1592]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 128 ms (attempt 2/5)5479worker1 # [ 129.110029] nix-grpc-daemon[1592]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 251 ms (attempt 3/5)5480worker1 # [ 129.369013] nix-grpc-daemon[1592]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 173 ms (attempt 4/5)5481worker1 # [ 129.542799] nix-grpc-daemon[1592]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5482worker1 # [ 129.565966] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430245483client # [ 129.513052] nix[1239]: copying 1 paths to 'lb:50051'...5484worker1 # [ 129.583857] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430245485client # [ 129.516453] nix[1239]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5486worker1 # [ 129.600322] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5487worker1 # [ 129.808887] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:48Z level=info event=niks3_push_started pid=16685488worker1 # [ 130.032522] nix-grpc-daemon[1668]: time=2026-09-20T12:23:48.462Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5489worker1 # [ 130.212387] nix-daemon[837]: accepted connection from pid 1681, user nix-grpc-daemon (trusted)5490worker1 # [ 130.230312] nix-daemon[837]: reaped child process 1684, status = succeeded5491worker1 # [ 130.410442] nix-daemon[837]: accepted connection from pid 1686, user nix-grpc-daemon (trusted)5492worker1 # [ 130.429917] nix-daemon[837]: reaped child process 1689, status = succeeded5493lb # [ 130.510232] niks3-server[1041]: 2026/09/20 12:23:48 INFO Received uploads request method=POST path=/api/pending_closures5494worker1 # [ 130.458721] nix-grpc-daemon[1668]: time=2026-09-20T12:23:48.888Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5495worker1 # [ 130.460636] nix-grpc-daemon[1668]: time=2026-09-20T12:23:48.888Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5496lb # [ 130.555711] niks3-server[1041]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5497worker1 # [ 130.499633] nix-grpc-daemon[1668]: time=2026-09-20T12:23:48.929Z level=INFO msg="Uploading 1 narinfos"5498lb # [ 130.567427] niks3-server[1041]: 2026/09/20 12:23:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5499lb # [ 130.578067] niks3-server[1041]: 2026/09/20 12:23:48 INFO Signed narinfos id=37 count=15500lb # [ 130.588420] niks3-server[1041]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5501lb # [ 130.596187] niks3-server[1041]: 2026/09/20 12:23:49 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5502lb # [ 130.608769] niks3-server[1041]: 2026/09/20 12:23:49 INFO Completed upload id=375503worker1 # [ 130.540796] nix-grpc-daemon[1668]: time=2026-09-20T12:23:48.971Z level=INFO msg="Upload complete. (504ms)"5504lb # [ 130.611350] niks3-server[1041]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5505worker1 # [ 130.552126] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=4245506worker1 # [ 130.566260] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245507worker1 # [ 130.573924] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5508worker1 # [ 130.578856] nix-daemon[837]: reaped child process 1662, status = succeeded5509client # [ 130.523335] nix[1239]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5510worker1 # [ 130.592989] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5511client: must succeed: systemctl kill -s INT intr5512client # [ 132.268758] systemd[1]: intr.service: Sent signal SIGINT to main process 1239 (nix) on client request.5513worker1 # [ 132.345891] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:50Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5514client # [ 132.277667] nix[1239]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5515client # [ 132.287402] nix[1239]: error: interrupted by the user5516client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5517client # [ 132.320693] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5518client # [ 132.325724] systemd[1]: intr.service: Failed with result 'exit-code'.5519client # [ 132.328153] systemd[1]: intr.service: Consumed 149ms CPU time over 3.831s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.5520worker1 # [ 132.439271] nix-daemon[1693]: unexpected Nix daemon error: error: interrupted by the user5521worker1 # [ 132.444837] nix-daemon[837]: reaped child process 1691, status = succeeded5522worker1 # [ 132.449445] nix-daemon[837]: reaped child process 1693, status = failed with exit code 15523(finished: subtest: interrupting the client stops the build on the worker, in 4.00 seconds)5524subtest: a deploy mid-build drains: the build finishes, the new generation takes over5525client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5526client # [ 132.521677] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5527client # Running as unit: sw.service; invocation ID: 05734ef998d84312acf051742f6235d55528client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds)5529client # [ 132.762557] nix[1260]: don't know how to build these paths:5530client # [ 132.763505] nix[1260]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5531worker1 # [ 132.827553] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:430245532worker1 # [ 132.842765] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:51Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05533worker1 # [ 132.848646] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:51Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15534worker2 # [ 132.815939] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446805535worker2 # [ 132.829949] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446805536client # [ 132.852249] nix[1260]: copying 1 paths to 'lb:50051'...5537worker2 # [ 132.846046] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446805538client # [ 132.854588] nix[1260]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5539worker2 # [ 132.863161] nix-daemon[858]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5540worker2 # [ 133.070966] nix-daemon[858]: accepted connection from pid 1383, user nix-grpc-daemon (trusted)5541worker2 # [ 133.092480] nix-daemon[858]: reaped child process 1386, status = succeeded5542worker2 # [ 133.269205] nix-daemon[858]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5543worker2 # [ 133.287692] nix-daemon[858]: reaped child process 1391, status = succeeded5544lb # [ 133.441532] niks3-server[1041]: 2026/09/20 12:23:51 INFO Received uploads request method=POST path=/api/pending_closures5545worker2 # [ 133.310400] nix-grpc-daemon[1339]: time=2026-09-20T12:23:51.727Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5546worker2 # [ 133.311945] nix-grpc-daemon[1339]: time=2026-09-20T12:23:51.727Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5547lb # [ 133.474624] niks3-server[1041]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5548lb # [ 133.494142] niks3-server[1041]: 2026/09/20 12:23:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5549worker2 # [ 133.361183] nix-grpc-daemon[1339]: time=2026-09-20T12:23:51.778Z level=INFO msg="Uploading 1 narinfos"5550lb # [ 133.509634] niks3-server[1041]: 2026/09/20 12:23:51 INFO Signed narinfos id=38 count=15551lb # [ 133.516924] niks3-server[1041]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5552lb # [ 133.527879] niks3-server[1041]: 2026/09/20 12:23:51 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5553lb # [ 133.536675] niks3-server[1041]: 2026/09/20 12:23:51 INFO Completed upload id=385554worker2 # [ 133.394121] nix-grpc-daemon[1339]: time=2026-09-20T12:23:51.811Z level=INFO msg="Upload complete. (513ms)"5555lb # [ 133.539528] niks3-server[1041]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5556worker2 # [ 133.405074] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44680 duration_s=0 paths=1 nar_bytes_in=4165557worker2 # [ 133.418255] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446805558worker2 # [ 133.425860] nix-daemon[858]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5559worker2 # [ 133.430919] nix-daemon[858]: reaped child process 1381, status = succeeded5560client # [ 133.448772] nix[1260]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5561worker2 # [ 133.446181] nix-daemon[858]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5562lb # [ 133.696684] envoy[922]: conn peer=[2001:db8:1::1]:52428 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3845 tx=1677 ms=100365563lb # [ 133.703148] envoy[922]: conn peer=[2001:db8:1::1]:56616 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=753 ms=35765564worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25565worker2 # Checking switch inhibitors... done5566worker2 # [ 135.999845] nixos[1426]: switching to system configuration /nix/store/k3qfx92gg82rmprinrr30akpyaivv2m4-nixos-system-worker2-test5567worker2 # activating the configuration...5568worker2 # [ 136.004544] systemd[1]: Stopped target Local File Systems.5569worker2 # [ 136.005357] systemd[1]: Stopped target Remote File Systems.5570worker2 # setting up /etc...5571worker2 # [ 136.825227] systemd[1]: Reload requested from client PID 1426 ('.switch-to-conf') (unit backdoor.service)...5572worker2 # [ 136.827022] systemd[1]: Reloading...5573worker2 # [ 137.735469] systemd[1]: Reloading finished in 902 ms.5574worker2 # restarting sysinit-reactivation.target5575worker2 # [ 137.826517] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5576worker2 # [ 137.976142] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5577worker2 # [ 137.977349] systemd[1]: Reached target Reactivate sysinit units.5578worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5579worker2 # [ 137.984747] systemd[1]: Reloading D-Bus System Message Bus...5580worker2 # [ 137.997246] dbus-broker-launch[499]: Caught SIGHUP, trigger reload.5581worker2 # [ 137.999363] systemd[1]: Reloading Nix worker-protocol over gRPC...5582worker2 # [ 138.015113] dbus-broker-launch[499]: Looking up NSS user entry for 'systemd-timesync'...5583worker2 # [ 138.026389] dbus-broker-launch[499]: NSS returned no entry for 'systemd-timesync'5584worker2 # [ 138.027446] dbus-broker-launch[499]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5585worker2 # [ 138.043944] systemd[1]: Reloaded Nix worker-protocol over gRPC.5586worker2 # [ 138.048839] nix-grpc-daemon[1188]: ts=2026-09-20T12:23:56Z level=info event=draining5587worker2 # [ 138.067908] systemd[1]: Reloaded D-Bus System Message Bus.5588worker2 # [ 138.075359] systemd[1]: Reached target Local File Systems.5589worker2 # [ 138.078947] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5590worker2 # [ 138.086651] systemd[1]: Starting Create SUID/SGID Wrappers...5591worker2 # [ 138.087524] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5592worker2 # [ 138.090808] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675593worker2 # [ 138.102919] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5594worker2 # [ 138.110642] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5595worker2 # [ 138.111925] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5596worker2 # [ 138.116381] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5597worker2 # [ 138.117699] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5598worker2 # [ 138.121745] systemd[1]: Reached target Remote File Systems.5599worker2 # [ 138.620726] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5600worker2 # [ 138.621842] systemd[1]: Finished Create SUID/SGID Wrappers.5601worker2 # [ 138.626535] systemd[1]: Starting linger-users.service...5602worker2 # [ 138.688664] systemd[1]: linger-users.service: Deactivated successfully.5603worker2 # [ 138.696133] systemd[1]: Finished linger-users.service.5604worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5605worker2 # [ 138.947463] nixos[1426]: finished switching to system configuration /nix/store/k3qfx92gg82rmprinrr30akpyaivv2m4-nixos-system-worker2-test5606worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.79 seconds)5607worker2: must succeed: pgrep -f 'read -t [9]0 x'5608worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5609client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25610worker1 # [ 139.359344] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:430245611client # don't know how to build these paths:5612client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5613worker1 # [ 139.369949] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430245614worker1 # [ 139.399205] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:57Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05615worker1 # [ 139.406076] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:57Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15616worker1 # [ 139.449978] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245617worker1 # [ 139.466733] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430245618client # copying 1 paths to 'lb:50051'...5619worker1 # [ 139.484391] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430245620client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5621worker1 # [ 139.508478] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5622worker1 # [ 139.723393] nix-daemon[837]: accepted connection from pid 1743, user nix-grpc-daemon (trusted)5623worker1 # [ 139.745686] nix-daemon[837]: reaped child process 1746, status = succeeded5624worker1 # [ 139.922786] nix-daemon[837]: accepted connection from pid 1748, user nix-grpc-daemon (trusted)5625worker1 # [ 139.941959] nix-daemon[837]: reaped child process 1751, status = succeeded5626lb # [ 140.023336] niks3-server[1041]: 2026/09/20 12:23:58 INFO Received uploads request method=POST path=/api/pending_closures5627worker1 # [ 139.964426] nix-grpc-daemon[1668]: time=2026-09-20T12:23:58.394Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5628worker1 # [ 139.965908] nix-grpc-daemon[1668]: time=2026-09-20T12:23:58.394Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5629lb # [ 140.054803] niks3-server[1041]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5630lb # [ 140.069703] niks3-server[1041]: 2026/09/20 12:23:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5631worker1 # [ 140.007288] nix-grpc-daemon[1668]: time=2026-09-20T12:23:58.437Z level=INFO msg="Uploading 1 narinfos"5632lb # [ 140.082234] niks3-server[1041]: 2026/09/20 12:23:58 INFO Signed narinfos id=39 count=15633lb # [ 140.088314] niks3-server[1041]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5634lb # [ 140.097628] niks3-server[1041]: 2026/09/20 12:23:58 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5635lb # [ 140.104784] niks3-server[1041]: 2026/09/20 12:23:58 INFO Completed upload id=395636worker1 # [ 140.035532] nix-grpc-daemon[1668]: time=2026-09-20T12:23:58.466Z level=INFO msg="Upload complete. (509ms)"5637lb # [ 140.108858] niks3-server[1041]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5638worker1 # [ 140.044497] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=5285639worker1 # [ 140.056643] nix-grpc-daemon[1592]: ts=2026-09-20T12:23:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245640worker1 # [ 140.066585] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5641worker1 # [ 140.073570] nix-daemon[837]: reaped child process 1741, status = succeeded5642client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5643client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5644worker1 # [ 140.087036] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5645client # farm-a> LOG-farm-a-during-drain5646worker1 # [ 141.334337] nix-daemon[837]: reaped child process 1755, status = succeeded5647worker1 # [ 141.522731] nix-daemon[837]: accepted connection from pid 1770, user nix-grpc-daemon (trusted)5648worker1 # [ 141.542190] nix-daemon[837]: reaped child process 1773, status = succeeded5649lb # [ 141.623172] niks3-server[1041]: 2026/09/20 12:24:00 INFO Received uploads request method=POST path=/api/pending_closures5650worker1 # [ 141.568576] nix-grpc-daemon[1668]: time=2026-09-20T12:23:59.997Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5651worker1 # [ 141.572845] nix-grpc-daemon[1668]: time=2026-09-20T12:23:59.997Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5652lb # [ 141.676854] niks3-server[1041]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5653lb # [ 141.687416] niks3-server[1041]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5654lb # [ 141.698602] niks3-server[1041]: 2026/09/20 12:24:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5655lb # [ 141.704587] niks3-server[1041]: 2026/09/20 12:24:00 INFO Signed narinfos id=40 count=15656worker1 # [ 141.638038] nix-grpc-daemon[1668]: time=2026-09-20T12:24:00.067Z level=INFO msg="Uploading 1 narinfos"5657lb # [ 141.707824] niks3-server[1041]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5658lb # [ 141.716973] niks3-server[1041]: 2026/09/20 12:24:00 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5659lb # [ 141.724491] niks3-server[1041]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5660lb # [ 141.728541] niks3-server[1041]: 2026/09/20 12:24:00 INFO Completed upload id=405661worker1 # [ 141.660635] nix-grpc-daemon[1668]: time=2026-09-20T12:24:00.091Z level=INFO msg="Upload complete. (362ms)"5662worker1 # [ 141.678147] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15663worker1 # [ 141.696286] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:00Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05664worker1 # [ 141.699632] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:00Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15665worker1 # [ 141.703675] nix-daemon[837]: reaped child process 1753, status = succeeded5666worker1 # [ 141.726207] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245667worker1 # [ 141.743072] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430245668worker1 # [ 141.760866] nix-grpc-daemon[1668]: time=2026-09-20T12:24:00.191Z level=INFO msg="All 1 paths already cached"5669client # copying 1 paths to 'lb:50051'...5670worker1 # [ 141.771983] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430245671client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5672worker1 # [ 141.796594] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5673worker1 # [ 142.014284] nix-daemon[837]: accepted connection from pid 1779, user nix-grpc-daemon (trusted)5674worker1 # [ 142.033578] nix-daemon[837]: reaped child process 1782, status = succeeded5675worker1 # [ 142.210551] nix-daemon[837]: accepted connection from pid 1784, user nix-grpc-daemon (trusted)5676worker1 # [ 142.228798] nix-daemon[837]: reaped child process 1787, status = succeeded5677lb # [ 142.310393] niks3-server[1041]: 2026/09/20 12:24:00 INFO Received uploads request method=POST path=/api/pending_closures5678worker1 # [ 142.252098] nix-grpc-daemon[1668]: time=2026-09-20T12:24:00.682Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5679worker1 # [ 142.253604] nix-grpc-daemon[1668]: time=2026-09-20T12:24:00.682Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5680lb # [ 142.341610] niks3-server[1041]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5681worker1 # [ 142.287411] nix-grpc-daemon[1668]: time=2026-09-20T12:24:00.718Z level=INFO msg="Uploading 1 narinfos"5682lb # [ 142.359863] niks3-server[1041]: 2026/09/20 12:24:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5683lb # [ 142.370702] niks3-server[1041]: 2026/09/20 12:24:00 INFO Signed narinfos id=41 count=15684lb # [ 142.380600] niks3-server[1041]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5685lb # [ 142.383991] niks3-server[1041]: 2026/09/20 12:24:00 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5686lb # [ 142.602964] niks3-server[1041]: 2026/09/20 12:24:01 INFO Completed upload id=415687worker1 # [ 142.535152] nix-grpc-daemon[1668]: time=2026-09-20T12:24:00.965Z level=INFO msg="Upload complete. (720ms)"5688lb # [ 142.613797] niks3-server[1041]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5689worker1 # [ 142.545398] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=6405690worker1 # [ 142.563019] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245691worker1 # [ 142.579194] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5692worker1 # [ 142.590645] nix-daemon[837]: reaped child process 1777, status = succeeded5693client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5694client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5695worker1 # [ 142.600815] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5696client # farm-b> LOG-farm-b-during-drain5697worker1 # [ 143.851849] nix-daemon[837]: reaped child process 1791, status = succeeded5698worker1 # [ 144.036128] nix-daemon[837]: accepted connection from pid 1806, user nix-grpc-daemon (trusted)5699worker1 # [ 144.054030] nix-daemon[837]: reaped child process 1809, status = succeeded5700lb # [ 144.138473] niks3-server[1041]: 2026/09/20 12:24:02 INFO Received uploads request method=POST path=/api/pending_closures5701worker1 # [ 144.080952] nix-grpc-daemon[1668]: time=2026-09-20T12:24:02.510Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5702worker1 # [ 144.082544] nix-grpc-daemon[1668]: time=2026-09-20T12:24:02.510Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5703lb # [ 144.175074] niks3-server[1041]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5704lb # [ 144.187380] niks3-server[1041]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5705lb # [ 144.200193] niks3-server[1041]: 2026/09/20 12:24:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5706worker1 # [ 144.138519] nix-grpc-daemon[1668]: time=2026-09-20T12:24:02.569Z level=INFO msg="Uploading 1 narinfos"5707lb # [ 144.207800] niks3-server[1041]: 2026/09/20 12:24:02 INFO Signed narinfos id=42 count=15708lb # [ 144.216186] niks3-server[1041]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5709lb # [ 144.230665] niks3-server[1041]: 2026/09/20 12:24:02 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5710lb # [ 144.236657] niks3-server[1041]: 2026/09/20 12:24:02 INFO Completed upload id=425711worker1 # [ 144.168700] nix-grpc-daemon[1668]: time=2026-09-20T12:24:02.599Z level=INFO msg="Upload complete. (354ms)"5712lb # [ 144.239300] niks3-server[1041]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5713worker1 # [ 144.189237] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15714worker1 # [ 144.204808] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:02Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05715worker1 # [ 144.208868] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:02Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15716worker1 # [ 144.213111] nix-daemon[837]: reaped child process 1789, status = succeeded5717worker1 # [ 144.228730] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245718worker1 # [ 144.245387] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430245719worker1 # [ 144.259950] nix-grpc-daemon[1668]: time=2026-09-20T12:24:02.690Z level=INFO msg="All 2 paths already cached"5720client # copying 1 paths to 'lb:50051'...5721client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5722worker1 # [ 144.271277] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430245723worker1 # [ 144.290010] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5724worker1 # [ 144.504461] nix-daemon[837]: accepted connection from pid 1815, user nix-grpc-daemon (trusted)5725worker1 # [ 144.525612] nix-daemon[837]: reaped child process 1818, status = succeeded5726worker1 # [ 144.700908] nix-daemon[837]: accepted connection from pid 1820, user nix-grpc-daemon (trusted)5727worker1 # [ 144.722333] nix-daemon[837]: reaped child process 1823, status = succeeded5728lb # [ 144.803048] niks3-server[1041]: 2026/09/20 12:24:03 INFO Received uploads request method=POST path=/api/pending_closures5729worker1 # [ 144.744638] nix-grpc-daemon[1668]: time=2026-09-20T12:24:03.175Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5730worker1 # [ 144.746181] nix-grpc-daemon[1668]: time=2026-09-20T12:24:03.175Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5731lb # [ 144.829806] niks3-server[1041]: 2026/09/20 12:24:03 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5732worker1 # [ 144.777030] nix-grpc-daemon[1668]: time=2026-09-20T12:24:03.207Z level=INFO msg="Uploading 1 narinfos"5733lb # [ 144.846081] niks3-server[1041]: 2026/09/20 12:24:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5734lb # [ 144.857225] niks3-server[1041]: 2026/09/20 12:24:03 INFO Signed narinfos id=43 count=15735lb # [ 144.864816] niks3-server[1041]: 2026/09/20 12:24:03 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5736lb # [ 144.870975] niks3-server[1041]: 2026/09/20 12:24:03 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5737worker1 # [ 144.808481] nix-grpc-daemon[1668]: time=2026-09-20T12:24:03.239Z level=INFO msg="Upload complete. (500ms)"5738lb # [ 144.878144] niks3-server[1041]: 2026/09/20 12:24:03 INFO Completed upload id=435739lb # [ 144.882082] niks3-server[1041]: 2026/09/20 12:24:03 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5740worker1 # [ 144.816127] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=7685741worker1 # [ 144.824418] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245742worker1 # [ 144.836197] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5743worker1 # [ 144.841095] nix-daemon[837]: reaped child process 1813, status = succeeded5744client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5745worker1 # [ 144.854368] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5746client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5747client # farm-top> LOG-farm-top-during-drain5748worker1 # [ 145.897878] nix-daemon[837]: reaped child process 1827, status = succeeded5749worker1 # [ 146.072372] nix-daemon[837]: accepted connection from pid 1842, user nix-grpc-daemon (trusted)5750worker1 # [ 146.092889] nix-daemon[837]: reaped child process 1845, status = succeeded5751lb # [ 146.170172] niks3-server[1041]: 2026/09/20 12:24:04 INFO Received uploads request method=POST path=/api/pending_closures5752worker1 # [ 146.114640] nix-grpc-daemon[1668]: time=2026-09-20T12:24:04.543Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5753worker1 # [ 146.116259] nix-grpc-daemon[1668]: time=2026-09-20T12:24:04.543Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5754lb # [ 146.202971] niks3-server[1041]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5755lb # [ 146.219191] niks3-server[1041]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5756lb # [ 146.232101] niks3-server[1041]: 2026/09/20 12:24:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5757worker1 # [ 146.168805] nix-grpc-daemon[1668]: time=2026-09-20T12:24:04.599Z level=INFO msg="Uploading 1 narinfos"5758lb # [ 146.241687] niks3-server[1041]: 2026/09/20 12:24:04 INFO Signed narinfos id=44 count=15759lb # [ 146.247115] niks3-server[1041]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5760lb # [ 146.253449] niks3-server[1041]: 2026/09/20 12:24:04 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5761lb # [ 146.258950] niks3-server[1041]: 2026/09/20 12:24:04 INFO Completed upload id=445762worker1 # [ 146.190320] nix-grpc-daemon[1668]: time=2026-09-20T12:24:04.621Z level=INFO msg="Upload complete. (326ms)"5763worker1 # [ 146.201482] nix-grpc-daemon[1668]: time=2026-09-20T12:24:04.621Z level=WARN msg="Failed to register uploaded object" key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo error="server returned 404: object is not pending upload\n"5764worker1 # [ 146.219700] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15765worker1 # [ 146.225958] nix-daemon[837]: reaped child process 1825, status = succeeded5766client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 7.16 seconds)5767client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5768client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5769worker2: must succeed: pkill -f 'read -t [9]0 x'5770worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5771client: waiting for success: ! systemctl is-active sw5772worker2 # [ 146.717687] nix-daemon[858]: reaped child process 1395, status = succeeded5773worker2 # [ 146.904264] nix-daemon[858]: accepted connection from pid 1566, user nix-grpc-daemon (trusted)5774worker2 # [ 146.923070] nix-daemon[858]: reaped child process 1569, status = succeeded5775lb # [ 147.077890] niks3-server[1041]: 2026/09/20 12:24:05 INFO Received uploads request method=POST path=/api/pending_closures5776worker2 # [ 146.946542] nix-grpc-daemon[1339]: time=2026-09-20T12:24:05.363Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5777worker2 # [ 146.948369] nix-grpc-daemon[1339]: time=2026-09-20T12:24:05.363Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5778lb # [ 147.112663] niks3-server[1041]: 2026/09/20 12:24:05 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5779lb # [ 147.125218] niks3-server[1041]: 2026/09/20 12:24:05 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5780lb # [ 147.135411] niks3-server[1041]: 2026/09/20 12:24:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5781worker2 # [ 147.000181] nix-grpc-daemon[1339]: time=2026-09-20T12:24:05.416Z level=INFO msg="Uploading 1 narinfos"5782lb # [ 147.142095] niks3-server[1041]: 2026/09/20 12:24:05 INFO Signed narinfos id=45 count=15783lb # [ 147.147594] niks3-server[1041]: 2026/09/20 12:24:05 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5784lb # [ 147.160406] niks3-server[1041]: 2026/09/20 12:24:05 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5785lb # [ 147.168785] niks3-server[1041]: 2026/09/20 12:24:05 INFO Completed upload id=455786worker2 # [ 147.026119] nix-grpc-daemon[1339]: time=2026-09-20T12:24:05.443Z level=INFO msg="Upload complete. (344ms)"5787lb # [ 147.173234] niks3-server[1041]: 2026/09/20 12:24:05 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5788worker2 # [ 147.041147] nix-grpc-daemon[1188]: ts=2026-09-20T12:24:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44680 duration_s=13 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15789worker2 # [ 147.057792] nix-grpc-daemon[1188]: ts=2026-09-20T12:24:05Z level=info event=signal_exit5790worker2 # [ 147.063179] nix-daemon[858]: reaped child process 1393, status = succeeded5791client # [ 147.093585] systemd[1]: sw.service: Deactivated successfully.5792client # [ 147.098313] systemd[1]: sw.service: Consumed 165ms CPU time over 14.575s wall clock time, 38.9M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5793client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5794client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5795client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5796worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5797worker2 # [ 147.748990] systemd[1]: Starting scheduler-token.service...5798worker2 # [ 147.836756] systemd[1]: scheduler-token.service: Deactivated successfully.5799worker2 # [ 147.839996] systemd[1]: Finished scheduler-token.service.5800worker2 # [ 147.842148] systemd[1]: scheduler-token.service: Consumed 34ms CPU time over 90ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5801worker1 # [ 148.363710] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:429965802worker1 # [ 148.368756] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:06Z level=info event=worker_gone addr=192.168.1.4:500515803worker2 # [ 148.295650] nix-grpc-daemon[1188]: ts=2026-09-20T12:24:06Z level=info event=scheduler_restarting5804worker2 # [ 148.309367] nix-grpc-daemon[1188]: ts=2026-09-20T12:24:06Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5805worker2 # [ 148.334788] nix-daemon[858]: reaped child process 1244, status = succeeded5806worker2 # [ 148.508988] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5807worker2 # [ 148.517148] systemd[1]: nix-grpc-daemon.service: Consumed 999ms CPU time over 44.681s wall clock time, 30.8M memory peak, 24.3K incoming IP traffic, 45.5K outgoing IP traffic.5808worker2 # [ 148.536685] systemd[1]: Starting Nix worker-protocol over gRPC...5809worker2 # [ 148.735101] nix-grpc-daemon[1586]: ts=2026-09-20T12:24:07Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5810worker2 # [ 148.737809] nix-grpc-daemon[1586]: ts=2026-09-20T12:24:07Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5811worker2 # [ 148.742036] nix-grpc-daemon[1586]: ts=2026-09-20T12:24:07Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15812worker2 # [ 148.750151] nix-grpc-daemon[1586]: ts=2026-09-20T12:24:07Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5813worker2 # [ 148.765332] systemd[1]: Started Nix worker-protocol over gRPC.5814worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.12 seconds)5815lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5816lb: must succeed: curl -sf localhost:9901/clusters5817worker2 # [ 148.779447] nix-grpc-daemon[1586]: ts=2026-09-20T12:24:07Z level=info event=scheduler_connected addr=lb:500515818worker1 # [ 148.857572] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:07Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:429965819worker1 # [ 148.863594] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:07Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05820lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5821lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.08 seconds)5822lb: must succeed: curl -sf localhost:9901/clusters5823lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5824worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5825worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5826(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.54 seconds)5827subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5828client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15829worker1 # [ 149.319748] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:430245830worker2 # [ 149.260159] nix-grpc-daemon[1586]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446205831worker2 # [ 149.274131] nix-daemon[858]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)5832worker2 # [ 149.298050] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 1/5)5833worker2 # [ 149.376730] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 112 ms (attempt 2/5)5834worker2 # [ 149.496405] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 179 ms (attempt 3/5)5835worker2 # [ 149.682956] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 670 ms (attempt 4/5)5836worker2 # [ 150.362373] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5837worker1 # [ 150.491825] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:08Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05838worker1 # [ 150.497231] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:08Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15839worker1 # [ 150.503706] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:08Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05840worker1 # [ 150.509565] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:08Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05841worker1 # [ 150.538864] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245842worker1 # [ 150.554525] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430245843worker1 # [ 150.569803] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430245844worker1 # [ 150.584815] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5845worker1 # [ 150.791133] nix-daemon[837]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)5846worker1 # [ 150.810743] nix-daemon[837]: reaped child process 1857, status = succeeded5847worker1 # [ 150.983356] nix-daemon[837]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)5848worker1 # [ 151.002369] nix-daemon[837]: reaped child process 1862, status = succeeded5849lb # [ 151.083596] niks3-server[1041]: 2026/09/20 12:24:09 INFO Received uploads request method=POST path=/api/pending_closures5850worker1 # [ 151.026687] nix-grpc-daemon[1668]: time=2026-09-20T12:24:09.457Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5851worker1 # [ 151.028361] nix-grpc-daemon[1668]: time=2026-09-20T12:24:09.457Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5852lb # [ 151.115340] niks3-server[1041]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5853worker1 # [ 151.058662] nix-grpc-daemon[1668]: time=2026-09-20T12:24:09.489Z level=INFO msg="Uploading 1 narinfos"5854lb # [ 151.129886] niks3-server[1041]: 2026/09/20 12:24:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5855lb # [ 151.139963] niks3-server[1041]: 2026/09/20 12:24:09 INFO Signed narinfos id=46 count=15856lb # [ 151.150345] niks3-server[1041]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5857worker1 # [ 151.087520] nix-grpc-daemon[1668]: time=2026-09-20T12:24:09.518Z level=INFO msg="Upload complete. (486ms)"5858lb # [ 151.156100] niks3-server[1041]: 2026/09/20 12:24:09 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5859lb # [ 151.161625] niks3-server[1041]: 2026/09/20 12:24:09 INFO Completed upload id=465860worker1 # [ 151.096224] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=5125861lb # [ 151.165259] niks3-server[1041]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5862worker1 # [ 151.106546] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245863worker1 # [ 151.113437] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5864worker1 # [ 151.118031] nix-daemon[837]: reaped child process 1852, status = succeeded5865worker1 # [ 151.131024] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5866worker1 # [ 152.574784] nix-daemon[837]: reaped child process 1866, status = succeeded5867worker1 # [ 152.766646] nix-daemon[837]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)5868worker1 # [ 152.787130] nix-daemon[837]: reaped child process 1884, status = succeeded5869lb # [ 152.871136] niks3-server[1041]: 2026/09/20 12:24:11 INFO Received uploads request method=POST path=/api/pending_closures5870worker1 # [ 152.812675] nix-grpc-daemon[1668]: time=2026-09-20T12:24:11.243Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5871worker1 # [ 152.818689] nix-grpc-daemon[1668]: time=2026-09-20T12:24:11.245Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5872lb # [ 152.913523] niks3-server[1041]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5873lb # [ 152.928456] niks3-server[1041]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5874lb # [ 152.937162] niks3-server[1041]: 2026/09/20 12:24:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5875lb # [ 152.943568] niks3-server[1041]: 2026/09/20 12:24:11 INFO Signed narinfos id=47 count=15876worker1 # [ 152.876056] nix-grpc-daemon[1668]: time=2026-09-20T12:24:11.306Z level=INFO msg="Uploading 1 narinfos"5877lb # [ 152.949654] niks3-server[1041]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5878lb # [ 152.959544] niks3-server[1041]: 2026/09/20 12:24:11 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5879worker1 # [ 152.897655] nix-grpc-daemon[1668]: time=2026-09-20T12:24:11.328Z level=INFO msg="Upload complete. (356ms)"5880lb # [ 152.968376] niks3-server[1041]: 2026/09/20 12:24:11 INFO Completed upload id=475881lb # [ 152.972596] niks3-server[1041]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5882worker1 # [ 152.917229] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15883worker1 # [ 152.934251] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:11Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15884worker1 # [ 152.943311] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245885worker1 # [ 152.948371] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:11Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05886worker1 # [ 152.952688] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430245887worker1 # [ 152.957417] nix-daemon[837]: reaped child process 1864, status = succeeded5888worker1 # [ 152.965071] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430245889worker1 # [ 152.974675] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5890worker1 # [ 153.160961] nix-daemon[837]: accepted connection from pid 1890, user nix-grpc-daemon (trusted)5891worker1 # [ 153.179204] nix-daemon[837]: reaped child process 1893, status = succeeded5892worker1 # [ 153.358262] nix-daemon[837]: accepted connection from pid 1895, user nix-grpc-daemon (trusted)5893worker1 # [ 153.375492] nix-daemon[837]: reaped child process 1898, status = succeeded5894lb # [ 153.455547] niks3-server[1041]: 2026/09/20 12:24:11 INFO Received uploads request method=POST path=/api/pending_closures5895worker1 # [ 153.396941] nix-grpc-daemon[1668]: time=2026-09-20T12:24:11.827Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5896worker1 # [ 153.398909] nix-grpc-daemon[1668]: time=2026-09-20T12:24:11.827Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5897lb # [ 153.487740] niks3-server[1041]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5898worker1 # [ 153.433212] nix-grpc-daemon[1668]: time=2026-09-20T12:24:11.863Z level=INFO msg="Uploading 1 narinfos"5899lb # [ 153.506522] niks3-server[1041]: 2026/09/20 12:24:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5900lb # [ 153.516681] niks3-server[1041]: 2026/09/20 12:24:11 INFO Signed narinfos id=48 count=15901lb # [ 153.519253] niks3-server[1041]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5902lb # [ 153.527987] niks3-server[1041]: 2026/09/20 12:24:11 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5903lb # [ 153.533457] niks3-server[1041]: 2026/09/20 12:24:11 INFO Completed upload id=485904worker1 # [ 153.464801] nix-grpc-daemon[1668]: time=2026-09-20T12:24:11.895Z level=INFO msg="Upload complete. (486ms)"5905lb # [ 153.536172] niks3-server[1041]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5906worker1 # [ 153.472138] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=5125907worker1 # [ 153.487036] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245908worker1 # [ 153.494262] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5909worker1 # [ 153.499029] nix-daemon[837]: reaped child process 1888, status = succeeded5910worker1 # [ 153.513752] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5911lb # [ 153.693887] envoy[922]: conn peer=[2001:db8:1::1]:32860 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9655 tx=3882 ms=68645912lb # [ 153.699025] envoy[922]: conn peer=[2001:db8:1::1]:32854 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1349 ms=143035913lb # [ 153.704076] envoy[922]: conn peer=[2001:db8:1::4]:54802 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=13709 tx=1002 ms=442505914worker1 # [ 154.534717] nix-daemon[837]: reaped child process 1902, status = succeeded5915worker1 # [ 154.700974] nix-daemon[837]: accepted connection from pid 1917, user nix-grpc-daemon (trusted)5916worker1 # [ 154.720283] nix-daemon[837]: reaped child process 1920, status = succeeded5917lb # [ 154.801246] niks3-server[1041]: 2026/09/20 12:24:13 INFO Received uploads request method=POST path=/api/pending_closures5918worker1 # [ 154.744419] nix-grpc-daemon[1668]: time=2026-09-20T12:24:13.173Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5919worker1 # [ 154.745895] nix-grpc-daemon[1668]: time=2026-09-20T12:24:13.173Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5920lb # [ 154.852125] niks3-server[1041]: 2026/09/20 12:24:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5921worker1 # [ 154.796351] nix-grpc-daemon[1668]: time=2026-09-20T12:24:13.226Z level=INFO msg="Uploading 1 narinfos"5922lb # [ 154.869224] niks3-server[1041]: 2026/09/20 12:24:13 INFO Signed narinfos id=49 count=15923lb # [ 154.884388] niks3-server[1041]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5924lb # [ 154.895834] niks3-server[1041]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5925worker1 # [ 154.834636] nix-grpc-daemon[1668]: time=2026-09-20T12:24:13.265Z level=INFO msg="Upload complete. (311ms)"5926lb # [ 154.907104] niks3-server[1041]: 2026/09/20 12:24:13 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5927lb # [ 154.914673] niks3-server[1041]: 2026/09/20 12:24:13 INFO Completed upload id=495928lb # [ 154.918119] niks3-server[1041]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5929worker1 # [ 154.850604] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15930lb # [ 154.923702] niks3-server[1041]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5931worker1 # [ 154.866449] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:13Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15932worker1 # [ 154.870560] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:13Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05933worker1 # [ 154.873766] nix-daemon[837]: reaped child process 1900, status = succeeded5934worker1 # [ 154.896182] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245935worker1 # [ 154.910884] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430245936worker1 # [ 154.925732] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430245937worker1 # [ 154.939166] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5938worker1 # [ 155.142239] nix-daemon[837]: accepted connection from pid 1926, user nix-grpc-daemon (trusted)5939worker1 # [ 155.162169] nix-daemon[837]: reaped child process 1929, status = succeeded5940worker1 # [ 155.343903] nix-daemon[837]: accepted connection from pid 1931, user nix-grpc-daemon (trusted)5941worker1 # [ 155.361848] nix-daemon[837]: reaped child process 1934, status = succeeded5942lb # [ 155.442867] niks3-server[1041]: 2026/09/20 12:24:13 INFO Received uploads request method=POST path=/api/pending_closures5943worker1 # [ 155.388202] nix-grpc-daemon[1668]: time=2026-09-20T12:24:13.818Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5944worker1 # [ 155.389715] nix-grpc-daemon[1668]: time=2026-09-20T12:24:13.818Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5945worker1 # [ 155.416846] nix-grpc-daemon[1668]: time=2026-09-20T12:24:13.847Z level=INFO msg="Uploading 1 narinfos"5946lb # [ 155.485289] niks3-server[1041]: 2026/09/20 12:24:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5947lb # [ 155.499185] niks3-server[1041]: 2026/09/20 12:24:13 INFO Signed narinfos id=50 count=15948lb # [ 155.506551] niks3-server[1041]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5949lb # [ 155.512493] niks3-server[1041]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5950lb # [ 155.521037] niks3-server[1041]: 2026/09/20 12:24:13 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5951lb # [ 155.525787] niks3-server[1041]: 2026/09/20 12:24:13 INFO Completed upload id=505952worker1 # [ 155.457903] nix-grpc-daemon[1668]: time=2026-09-20T12:24:13.888Z level=INFO msg="Upload complete. (504ms)"5953lb # [ 155.529410] niks3-server[1041]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5954worker1 # [ 155.468868] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=5125955worker1 # [ 155.481728] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245956worker1 # [ 155.488780] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5957worker1 # [ 155.494867] nix-daemon[837]: reaped child process 1924, status = succeeded5958worker1 # [ 155.509312] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5959worker1 # [ 156.950535] nix-daemon[837]: reaped child process 1938, status = succeeded5960worker1 # [ 157.140960] nix-daemon[837]: accepted connection from pid 1953, user nix-grpc-daemon (trusted)5961worker1 # [ 157.159093] nix-daemon[837]: reaped child process 1956, status = succeeded5962lb # [ 157.241878] niks3-server[1041]: 2026/09/20 12:24:15 INFO Received uploads request method=POST path=/api/pending_closures5963worker1 # [ 157.182904] nix-grpc-daemon[1668]: time=2026-09-20T12:24:15.612Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5964worker1 # [ 157.184500] nix-grpc-daemon[1668]: time=2026-09-20T12:24:15.612Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5965lb # [ 157.277512] niks3-server[1041]: 2026/09/20 12:24:15 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5966lb # [ 157.292333] niks3-server[1041]: 2026/09/20 12:24:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5967worker1 # [ 157.230768] nix-grpc-daemon[1668]: time=2026-09-20T12:24:15.661Z level=INFO msg="Uploading 1 narinfos"5968lb # [ 157.305397] niks3-server[1041]: 2026/09/20 12:24:15 INFO Signed narinfos id=51 count=15969lb # [ 157.307608] niks3-server[1041]: 2026/09/20 12:24:15 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5970lb # [ 157.313887] niks3-server[1041]: 2026/09/20 12:24:15 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5971lb # [ 157.323487] niks3-server[1041]: 2026/09/20 12:24:15 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5972lb # [ 157.327796] niks3-server[1041]: 2026/09/20 12:24:15 INFO Completed upload id=515973worker1 # [ 157.259873] nix-grpc-daemon[1668]: time=2026-09-20T12:24:15.690Z level=INFO msg="Upload complete. (339ms)"5974lb # [ 157.330270] niks3-server[1041]: 2026/09/20 12:24:15 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5975worker1 # [ 157.278118] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15976worker1 # [ 157.293154] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:15Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15977worker1 # [ 157.302439] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430245978worker1 # [ 157.307682] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:15Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05979worker1 # [ 157.312401] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430245980worker1 # [ 157.316626] nix-daemon[837]: reaped child process 1936, status = succeeded5981worker1 # [ 157.319891] nix-grpc-daemon[1668]: time=2026-09-20T12:24:15.742Z level=INFO msg="All 1 paths already cached"5982worker1 # [ 157.329642] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430245983worker1 # [ 157.335816] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5984worker1 # [ 157.516187] nix-daemon[837]: accepted connection from pid 1962, user nix-grpc-daemon (trusted)5985worker1 # [ 157.533991] nix-daemon[837]: reaped child process 1965, status = succeeded5986worker1 # [ 157.709267] nix-daemon[837]: accepted connection from pid 1967, user nix-grpc-daemon (trusted)5987worker1 # [ 157.726603] nix-daemon[837]: reaped child process 1970, status = succeeded5988lb # [ 157.806773] niks3-server[1041]: 2026/09/20 12:24:16 INFO Received uploads request method=POST path=/api/pending_closures5989worker1 # [ 157.748062] nix-grpc-daemon[1668]: time=2026-09-20T12:24:16.178Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5990worker1 # [ 157.749607] nix-grpc-daemon[1668]: time=2026-09-20T12:24:16.178Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5991lb # [ 157.840412] niks3-server[1041]: 2026/09/20 12:24:16 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5992worker1 # [ 157.783445] nix-grpc-daemon[1668]: time=2026-09-20T12:24:16.214Z level=INFO msg="Uploading 1 narinfos"5993lb # [ 157.855926] niks3-server[1041]: 2026/09/20 12:24:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5994lb # [ 157.867268] niks3-server[1041]: 2026/09/20 12:24:16 INFO Signed narinfos id=52 count=15995lb # [ 157.872279] niks3-server[1041]: 2026/09/20 12:24:16 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5996lb # [ 157.882533] niks3-server[1041]: 2026/09/20 12:24:16 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5997lb # [ 157.888180] niks3-server[1041]: 2026/09/20 12:24:16 INFO Completed upload id=525998worker1 # [ 157.819719] nix-grpc-daemon[1668]: time=2026-09-20T12:24:16.250Z level=INFO msg="Upload complete. (478ms)"5999lb # [ 157.891203] niks3-server[1041]: 2026/09/20 12:24:16 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6000worker1 # [ 157.828305] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=6246001worker1 # [ 157.842278] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430246002worker1 # [ 157.849121] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6003worker1 # [ 157.854430] nix-daemon[837]: reaped child process 1960, status = succeeded6004worker1 # [ 157.866397] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6005worker1 # [ 158.691274] nix-daemon[837]: reaped child process 1974, status = succeeded6006worker1 # [ 158.856147] nix-daemon[837]: accepted connection from pid 1989, user nix-grpc-daemon (trusted)6007worker1 # [ 158.874836] nix-daemon[837]: reaped child process 1992, status = succeeded6008lb # [ 158.954872] niks3-server[1041]: 2026/09/20 12:24:17 INFO Received uploads request method=POST path=/api/pending_closures6009worker1 # [ 158.899624] nix-grpc-daemon[1668]: time=2026-09-20T12:24:17.326Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6010worker1 # [ 158.901336] nix-grpc-daemon[1668]: time=2026-09-20T12:24:17.327Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6011lb # [ 159.000795] niks3-server[1041]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6012worker1 # [ 158.944107] nix-grpc-daemon[1668]: time=2026-09-20T12:24:17.374Z level=INFO msg="Uploading 1 narinfos"6013lb # [ 159.015168] niks3-server[1041]: 2026/09/20 12:24:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6014lb # [ 159.022951] niks3-server[1041]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6015lb # [ 159.031250] niks3-server[1041]: 2026/09/20 12:24:17 INFO Signed narinfos id=53 count=16016worker1 # [ 158.966138] nix-grpc-daemon[1668]: time=2026-09-20T12:24:17.397Z level=INFO msg="Upload complete. (287ms)"6017lb # [ 159.034787] niks3-server[1041]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6018lb # [ 159.038708] niks3-server[1041]: 2026/09/20 12:24:17 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6019lb # [ 159.042876] niks3-server[1041]: 2026/09/20 12:24:17 INFO Completed upload id=536020lb # [ 159.045533] niks3-server[1041]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo6021worker1 # [ 158.978179] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=16022worker1 # [ 158.991731] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:17Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=16023worker1 # [ 158.995974] nix-daemon[837]: reaped child process 1972, status = succeeded6024worker1 # [ 159.023231] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430246025worker1 # [ 159.030616] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:17Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=06026worker1 # [ 159.041808] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430246027worker1 # [ 159.055527] nix-grpc-daemon[1668]: time=2026-09-20T12:24:17.486Z level=INFO msg="All 1 paths already cached"6028worker1 # [ 159.064116] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430246029worker1 # [ 159.076082] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6030worker1 # [ 159.274888] nix-daemon[837]: accepted connection from pid 1998, user nix-grpc-daemon (trusted)6031worker1 # [ 159.292196] nix-daemon[837]: reaped child process 2001, status = succeeded6032worker1 # [ 159.467332] nix-daemon[837]: accepted connection from pid 2003, user nix-grpc-daemon (trusted)6033worker1 # [ 159.482952] nix-daemon[837]: reaped child process 2006, status = succeeded6034lb # [ 159.566933] niks3-server[1041]: 2026/09/20 12:24:17 INFO Received uploads request method=POST path=/api/pending_closures6035worker1 # [ 159.508949] nix-grpc-daemon[1668]: time=2026-09-20T12:24:17.939Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6036worker1 # [ 159.510602] nix-grpc-daemon[1668]: time=2026-09-20T12:24:17.939Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6037lb # [ 159.593843] niks3-server[1041]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6038lb # [ 159.608497] niks3-server[1041]: 2026/09/20 12:24:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6039worker1 # [ 159.546544] nix-grpc-daemon[1668]: time=2026-09-20T12:24:17.977Z level=INFO msg="Uploading 1 narinfos"6040lb # [ 159.621177] niks3-server[1041]: 2026/09/20 12:24:18 INFO Signed narinfos id=54 count=16041lb # [ 159.632423] niks3-server[1041]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6042worker1 # [ 159.569815] nix-grpc-daemon[1668]: time=2026-09-20T12:24:18.000Z level=INFO msg="Upload complete. (480ms)"6043lb # [ 159.638823] niks3-server[1041]: 2026/09/20 12:24:18 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6044lb # [ 159.645269] niks3-server[1041]: 2026/09/20 12:24:18 INFO Completed upload id=546045worker1 # [ 159.576540] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=6246046lb # [ 159.648218] niks3-server[1041]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6047worker1 # [ 159.584973] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430246048worker1 # [ 159.595308] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6049worker1 # [ 159.599707] nix-daemon[837]: reaped child process 1996, status = succeeded6050worker1 # [ 159.612605] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6051worker1 # [ 161.056375] nix-daemon[837]: reaped child process 2010, status = succeeded6052worker1 # [ 161.241917] nix-daemon[837]: accepted connection from pid 2025, user nix-grpc-daemon (trusted)6053worker1 # [ 161.259588] nix-daemon[837]: reaped child process 2028, status = succeeded6054lb # [ 161.345968] niks3-server[1041]: 2026/09/20 12:24:19 INFO Received uploads request method=POST path=/api/pending_closures6055worker1 # [ 161.292094] nix-grpc-daemon[1668]: time=2026-09-20T12:24:19.722Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6056worker1 # [ 161.295164] nix-grpc-daemon[1668]: time=2026-09-20T12:24:19.724Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6057lb # [ 161.391385] niks3-server[1041]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6058lb # [ 161.404443] niks3-server[1041]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6059lb # [ 161.418281] niks3-server[1041]: 2026/09/20 12:24:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6060worker1 # [ 161.356108] nix-grpc-daemon[1668]: time=2026-09-20T12:24:19.786Z level=INFO msg="Uploading 1 narinfos"6061lb # [ 161.430059] niks3-server[1041]: 2026/09/20 12:24:19 INFO Signed narinfos id=55 count=16062lb # [ 161.435554] niks3-server[1041]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6063lb # [ 161.443529] niks3-server[1041]: 2026/09/20 12:24:19 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6064lb # [ 161.452993] niks3-server[1041]: 2026/09/20 12:24:19 INFO Completed upload id=556065worker1 # [ 161.385083] nix-grpc-daemon[1668]: time=2026-09-20T12:24:19.815Z level=INFO msg="Upload complete. (362ms)"6066lb # [ 161.455523] niks3-server[1041]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6067worker1 # [ 161.405240] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=16068worker1 # [ 161.421645] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:19Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16069worker1 # [ 161.432235] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430246070worker1 # [ 161.435537] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:19Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06071worker1 # [ 161.440600] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430246072worker1 # [ 161.443643] nix-daemon[837]: reaped child process 2008, status = succeeded6073worker1 # [ 161.446438] nix-grpc-daemon[1668]: time=2026-09-20T12:24:19.876Z level=INFO msg="All 1 paths already cached"6074worker1 # [ 161.450496] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430246075worker1 # [ 161.461637] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6076worker1 # [ 161.654406] nix-daemon[837]: accepted connection from pid 2034, user nix-grpc-daemon (trusted)6077worker1 # [ 161.671245] nix-daemon[837]: reaped child process 2037, status = succeeded6078worker1 # [ 161.847751] nix-daemon[837]: accepted connection from pid 2039, user nix-grpc-daemon (trusted)6079worker1 # [ 161.863391] nix-daemon[837]: reaped child process 2042, status = succeeded6080lb # [ 161.946855] niks3-server[1041]: 2026/09/20 12:24:20 INFO Received uploads request method=POST path=/api/pending_closures6081worker1 # [ 161.888057] nix-grpc-daemon[1668]: time=2026-09-20T12:24:20.318Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6082worker1 # [ 161.889539] nix-grpc-daemon[1668]: time=2026-09-20T12:24:20.318Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6083worker1 # [ 161.922318] nix-grpc-daemon[1668]: time=2026-09-20T12:24:20.353Z level=INFO msg="Uploading 1 narinfos"6084lb # [ 161.976458] niks3-server[1041]: 2026/09/20 12:24:20 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6085lb # [ 161.994453] niks3-server[1041]: 2026/09/20 12:24:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6086lb # [ 162.006547] niks3-server[1041]: 2026/09/20 12:24:20 INFO Signed narinfos id=56 count=16087lb # [ 162.013736] niks3-server[1041]: 2026/09/20 12:24:20 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6088worker1 # [ 161.949458] nix-grpc-daemon[1668]: time=2026-09-20T12:24:20.380Z level=INFO msg="Upload complete. (475ms)"6089lb # [ 162.018336] niks3-server[1041]: 2026/09/20 12:24:20 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6090lb # [ 162.022543] niks3-server[1041]: 2026/09/20 12:24:20 INFO Completed upload id=566091lb # [ 162.025162] niks3-server[1041]: 2026/09/20 12:24:20 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6092worker1 # [ 161.957929] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=6246093worker1 # [ 161.970079] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430246094worker1 # [ 161.975595] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6095worker1 # [ 161.979702] nix-daemon[837]: reaped child process 2032, status = succeeded6096worker1 # [ 161.993574] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6097worker1 # [ 162.825526] nix-daemon[837]: reaped child process 2046, status = succeeded6098worker1 # [ 162.996977] nix-daemon[837]: accepted connection from pid 2061, user nix-grpc-daemon (trusted)6099worker1 # [ 163.015818] nix-daemon[837]: reaped child process 2064, status = succeeded6100lb # [ 163.098187] niks3-server[1041]: 2026/09/20 12:24:21 INFO Received uploads request method=POST path=/api/pending_closures6101worker1 # [ 163.042839] nix-grpc-daemon[1668]: time=2026-09-20T12:24:21.471Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6102worker1 # [ 163.044483] nix-grpc-daemon[1668]: time=2026-09-20T12:24:21.471Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6103lb # [ 163.132172] niks3-server[1041]: 2026/09/20 12:24:21 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6104lb # [ 163.147804] niks3-server[1041]: 2026/09/20 12:24:21 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6105lb # [ 163.156650] niks3-server[1041]: 2026/09/20 12:24:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6106worker1 # [ 163.093921] nix-grpc-daemon[1668]: time=2026-09-20T12:24:21.524Z level=INFO msg="Uploading 1 narinfos"6107lb # [ 163.165952] niks3-server[1041]: 2026/09/20 12:24:21 INFO Signed narinfos id=57 count=16108lb # [ 163.171700] niks3-server[1041]: 2026/09/20 12:24:21 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6109lb # [ 163.178640] niks3-server[1041]: 2026/09/20 12:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6110worker1 # [ 163.117269] nix-grpc-daemon[1668]: time=2026-09-20T12:24:21.548Z level=INFO msg="Upload complete. (314ms)"6111lb # [ 163.186669] niks3-server[1041]: 2026/09/20 12:24:21 INFO Completed upload id=576112lb # [ 163.189157] niks3-server[1041]: 2026/09/20 12:24:21 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6113worker1 # [ 163.132469] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16114worker1 # [ 163.148862] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:21Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16115worker1 # [ 163.161244] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430246116worker1 # [ 163.169806] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:21Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06117worker1 # [ 163.178182] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430246118worker1 # [ 163.186326] nix-grpc-daemon[1668]: time=2026-09-20T12:24:21.591Z level=INFO msg="All 2 paths already cached"6119worker1 # [ 163.190120] nix-daemon[837]: reaped child process 2044, status = succeeded6120worker1 # [ 163.193779] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6121worker1 # [ 163.196413] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430246122worker1 # [ 163.372782] nix-daemon[837]: accepted connection from pid 2070, user nix-grpc-daemon (trusted)6123worker1 # [ 163.390104] nix-daemon[837]: reaped child process 2073, status = succeeded6124worker1 # [ 163.569456] nix-daemon[837]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)6125worker1 # [ 163.587279] nix-daemon[837]: reaped child process 2078, status = succeeded6126lb # [ 163.667124] niks3-server[1041]: 2026/09/20 12:24:22 INFO Received uploads request method=POST path=/api/pending_closures6127worker1 # [ 163.608279] nix-grpc-daemon[1668]: time=2026-09-20T12:24:22.039Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6128worker1 # [ 163.610191] nix-grpc-daemon[1668]: time=2026-09-20T12:24:22.039Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6129lb # [ 163.696731] niks3-server[1041]: 2026/09/20 12:24:22 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6130lb # [ 163.709895] niks3-server[1041]: 2026/09/20 12:24:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6131worker1 # [ 163.647690] nix-grpc-daemon[1668]: time=2026-09-20T12:24:22.078Z level=INFO msg="Uploading 1 narinfos"6132lb # [ 163.719141] niks3-server[1041]: 2026/09/20 12:24:22 INFO Signed narinfos id=58 count=16133lb # [ 163.729578] niks3-server[1041]: 2026/09/20 12:24:22 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6134lb # [ 163.741957] niks3-server[1041]: 2026/09/20 12:24:22 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6135worker1 # [ 163.679963] nix-grpc-daemon[1668]: time=2026-09-20T12:24:22.110Z level=INFO msg="Upload complete. (486ms)"6136lb # [ 163.748616] niks3-server[1041]: 2026/09/20 12:24:22 INFO Completed upload id=586137lb # [ 163.752091] niks3-server[1041]: 2026/09/20 12:24:22 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6138worker1 # [ 163.688182] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=7526139worker1 # [ 163.703983] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430246140worker1 # [ 163.710870] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6141worker1 # [ 163.716171] nix-daemon[837]: reaped child process 2068, status = succeeded6142worker1 # [ 163.732108] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6143worker1 # [ 164.572207] nix-daemon[837]: reaped child process 2082, status = succeeded6144worker1 # [ 164.751822] nix-daemon[837]: accepted connection from pid 2097, user nix-grpc-daemon (trusted)6145worker1 # [ 164.768707] nix-daemon[837]: reaped child process 2100, status = succeeded6146lb # [ 164.853973] niks3-server[1041]: 2026/09/20 12:24:23 INFO Received uploads request method=POST path=/api/pending_closures6147worker1 # [ 164.794931] nix-grpc-daemon[1668]: time=2026-09-20T12:24:23.224Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6148worker1 # [ 164.796660] nix-grpc-daemon[1668]: time=2026-09-20T12:24:23.224Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6149lb # [ 164.882356] niks3-server[1041]: 2026/09/20 12:24:23 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6150lb # [ 164.898324] niks3-server[1041]: 2026/09/20 12:24:23 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6151lb # [ 164.910113] niks3-server[1041]: 2026/09/20 12:24:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6152worker1 # [ 164.847591] nix-grpc-daemon[1668]: time=2026-09-20T12:24:23.278Z level=INFO msg="Uploading 1 narinfos"6153lb # [ 164.920473] niks3-server[1041]: 2026/09/20 12:24:23 INFO Signed narinfos id=59 count=16154lb # [ 164.923143] niks3-server[1041]: 2026/09/20 12:24:23 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6155lb # [ 164.933530] niks3-server[1041]: 2026/09/20 12:24:23 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6156lb # [ 164.940619] niks3-server[1041]: 2026/09/20 12:24:23 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6157lb # [ 164.946838] niks3-server[1041]: 2026/09/20 12:24:23 INFO Completed upload id=596158worker1 # [ 164.878913] nix-grpc-daemon[1668]: time=2026-09-20T12:24:23.309Z level=INFO msg="Upload complete. (336ms)"6159worker1 # [ 164.893361] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16160worker1 # [ 164.908904] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:23Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16161worker1 # [ 164.913278] nix-daemon[837]: reaped child process 2080, status = succeeded6162worker1 # [ 164.932792] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430246163worker1 # [ 164.947542] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430246164worker1 # [ 164.961881] nix-grpc-daemon[1668]: time=2026-09-20T12:24:23.392Z level=INFO msg="All 2 paths already cached"6165worker1 # [ 164.971112] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430246166worker1 # [ 164.985355] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6167worker1 # [ 165.189838] nix-daemon[837]: accepted connection from pid 2104, user nix-grpc-daemon (trusted)6168worker1 # [ 165.208822] nix-daemon[837]: reaped child process 2107, status = succeeded6169worker1 # [ 165.387520] nix-daemon[837]: accepted connection from pid 2109, user nix-grpc-daemon (trusted)6170worker1 # [ 165.406956] nix-daemon[837]: reaped child process 2112, status = succeeded6171lb # [ 165.486768] niks3-server[1041]: 2026/09/20 12:24:23 INFO Received uploads request method=POST path=/api/pending_closures6172worker1 # [ 165.427606] nix-grpc-daemon[1668]: time=2026-09-20T12:24:23.858Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6173worker1 # [ 165.429258] nix-grpc-daemon[1668]: time=2026-09-20T12:24:23.858Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6174lb # [ 165.516819] niks3-server[1041]: 2026/09/20 12:24:23 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6175lb # [ 165.527855] niks3-server[1041]: 2026/09/20 12:24:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6176worker1 # [ 165.467285] nix-grpc-daemon[1668]: time=2026-09-20T12:24:23.898Z level=INFO msg="Uploading 1 narinfos"6177lb # [ 165.535437] niks3-server[1041]: 2026/09/20 12:24:23 INFO Signed narinfos id=60 count=16178lb # [ 165.541825] niks3-server[1041]: 2026/09/20 12:24:23 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6179lb # [ 165.553672] niks3-server[1041]: 2026/09/20 12:24:23 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6180worker1 # [ 165.495247] nix-grpc-daemon[1668]: time=2026-09-20T12:24:23.926Z level=INFO msg="Upload complete. (493ms)"6181lb # [ 165.563339] niks3-server[1041]: 2026/09/20 12:24:23 INFO Completed upload id=606182lb # [ 165.568163] niks3-server[1041]: 2026/09/20 12:24:23 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6183worker1 # [ 165.504275] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=7526184worker1 # [ 165.516272] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430246185worker1 # [ 165.522005] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6186worker1 # [ 165.526706] nix-daemon[837]: reaped child process 2102, status = succeeded6187worker1 # [ 165.540728] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6188worker1 # [ 166.387979] nix-daemon[837]: reaped child process 2116, status = succeeded6189worker1 # [ 166.574468] nix-daemon[837]: accepted connection from pid 2131, user nix-grpc-daemon (trusted)6190worker1 # [ 166.592203] nix-daemon[837]: reaped child process 2134, status = succeeded6191lb # [ 166.673185] niks3-server[1041]: 2026/09/20 12:24:25 INFO Received uploads request method=POST path=/api/pending_closures6192worker1 # [ 166.616491] nix-grpc-daemon[1668]: time=2026-09-20T12:24:25.046Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6193worker1 # [ 166.618242] nix-grpc-daemon[1668]: time=2026-09-20T12:24:25.046Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6194lb # [ 166.706142] niks3-server[1041]: 2026/09/20 12:24:25 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6195lb # [ 166.722005] niks3-server[1041]: 2026/09/20 12:24:25 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6196lb # [ 166.736096] niks3-server[1041]: 2026/09/20 12:24:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6197worker1 # [ 166.673378] nix-grpc-daemon[1668]: time=2026-09-20T12:24:25.103Z level=INFO msg="Uploading 1 narinfos"6198lb # [ 166.746358] niks3-server[1041]: 2026/09/20 12:24:25 INFO Signed narinfos id=61 count=16199lb # [ 166.752304] niks3-server[1041]: 2026/09/20 12:24:25 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6200lb # [ 166.760548] niks3-server[1041]: 2026/09/20 12:24:25 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6201lb # [ 166.767933] niks3-server[1041]: 2026/09/20 12:24:25 INFO Completed upload id=616202worker1 # [ 166.699418] nix-grpc-daemon[1668]: time=2026-09-20T12:24:25.130Z level=INFO msg="Upload complete. (347ms)"6203lb # [ 166.771471] niks3-server[1041]: 2026/09/20 12:24:25 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6204worker1 # [ 166.716317] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16205worker1 # [ 166.732343] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:25Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16206worker1 # [ 166.738285] nix-daemon[837]: reaped child process 2114, status = succeeded6207worker1 # [ 166.756509] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430246208worker1 # [ 166.771971] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430246209worker1 # [ 166.787129] nix-grpc-daemon[1668]: time=2026-09-20T12:24:25.217Z level=INFO msg="All 2 paths already cached"6210worker1 # [ 166.796056] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430246211worker1 # [ 166.810204] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6212worker1 # [ 167.021171] nix-daemon[837]: accepted connection from pid 2138, user nix-grpc-daemon (trusted)6213worker1 # [ 167.039208] nix-daemon[837]: reaped child process 2141, status = succeeded6214worker1 # [ 167.216236] nix-daemon[837]: accepted connection from pid 2143, user nix-grpc-daemon (trusted)6215worker1 # [ 167.233229] nix-daemon[837]: reaped child process 2146, status = succeeded6216lb # [ 167.315508] niks3-server[1041]: 2026/09/20 12:24:25 INFO Received uploads request method=POST path=/api/pending_closures6217worker1 # [ 167.257133] nix-grpc-daemon[1668]: time=2026-09-20T12:24:25.687Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6218worker1 # [ 167.258707] nix-grpc-daemon[1668]: time=2026-09-20T12:24:25.687Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6219lb # [ 167.347331] niks3-server[1041]: 2026/09/20 12:24:25 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6220lb # [ 167.360083] niks3-server[1041]: 2026/09/20 12:24:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6221worker1 # [ 167.297819] nix-grpc-daemon[1668]: time=2026-09-20T12:24:25.728Z level=INFO msg="Uploading 1 narinfos"6222lb # [ 167.372575] niks3-server[1041]: 2026/09/20 12:24:25 INFO Signed narinfos id=62 count=16223lb # [ 167.375950] niks3-server[1041]: 2026/09/20 12:24:25 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6224worker1 # [ 167.321916] nix-grpc-daemon[1668]: time=2026-09-20T12:24:25.752Z level=INFO msg="Upload complete. (494ms)"6225lb # [ 167.390883] niks3-server[1041]: 2026/09/20 12:24:25 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6226lb # [ 167.397537] niks3-server[1041]: 2026/09/20 12:24:25 INFO Completed upload id=626227lb # [ 167.401628] niks3-server[1041]: 2026/09/20 12:24:25 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6228worker1 # [ 167.332279] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=0 paths=1 nar_bytes_in=7526229worker1 # [ 167.340653] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430246230worker1 # [ 167.352264] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6231worker1 # [ 167.354925] nix-daemon[837]: reaped child process 2136, status = succeeded6232worker1 # [ 167.366454] nix-daemon[837]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)6233worker1 # [ 168.797073] nix-daemon[837]: reaped child process 2150, status = succeeded6234worker1 # [ 168.960393] nix-daemon[837]: accepted connection from pid 2165, user nix-grpc-daemon (trusted)6235worker1 # [ 168.979646] nix-daemon[837]: reaped child process 2168, status = succeeded6236lb # [ 169.060818] niks3-server[1041]: 2026/09/20 12:24:27 INFO Received uploads request method=POST path=/api/pending_closures6237worker1 # [ 169.003421] nix-grpc-daemon[1668]: time=2026-09-20T12:24:27.432Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6238worker1 # [ 169.005416] nix-grpc-daemon[1668]: time=2026-09-20T12:24:27.433Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6239lb # [ 169.094307] niks3-server[1041]: 2026/09/20 12:24:27 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6240lb # [ 169.109888] niks3-server[1041]: 2026/09/20 12:24:27 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6241lb # [ 169.117881] niks3-server[1041]: 2026/09/20 12:24:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6242worker1 # [ 169.055479] nix-grpc-daemon[1668]: time=2026-09-20T12:24:27.486Z level=INFO msg="Uploading 1 narinfos"6243lb # [ 169.127972] niks3-server[1041]: 2026/09/20 12:24:27 INFO Signed narinfos id=63 count=16244lb # [ 169.130810] niks3-server[1041]: 2026/09/20 12:24:27 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6245lb # [ 169.141599] niks3-server[1041]: 2026/09/20 12:24:27 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6246lb # [ 169.149005] niks3-server[1041]: 2026/09/20 12:24:27 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6247lb # [ 169.153727] niks3-server[1041]: 2026/09/20 12:24:27 INFO Completed upload id=636248worker1 # [ 169.085819] nix-grpc-daemon[1668]: time=2026-09-20T12:24:27.516Z level=INFO msg="Upload complete. (306ms)"6249worker1 # [ 169.101195] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43024 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16250worker1 # [ 169.116449] nix-daemon[837]: reaped child process 2148, status = succeeded6251client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.11 seconds)6252worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6253worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6254client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]'6255client # [ 169.249833] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6256client # Running as unit: gpu.service; invocation ID: b47b2396471f42ab80b74af50edcd4286257client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds)6258lb: must succeed: curl -sf localhost:9901/clusters6259lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6260lb: must succeed: curl -sf localhost:9901/clusters6261lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6262worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6263worker2 # [ 169.476813] nix-grpc-daemon[1586]: ts=2026-09-20T12:24:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:446206264worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6265client # [ 169.491481] nix[1339]: don't know how to build these paths:6266client # [ 169.492587] nix[1339]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv6267worker2 # [ 169.489588] nix-grpc-daemon[1586]: ts=2026-09-20T12:24:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446206268worker1 # [ 169.588164] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:28Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06269client # [ 169.527468] nix[1339]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker6270lb: must succeed: curl -sf localhost:9901/clusters6271lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6272lb: must succeed: curl -sf localhost:9901/clusters6273lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6274worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6275worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6276client: waiting for success: systemctl show -p Result gpu | grep -q exit-code6277lb # [ 173.697487] envoy[922]: conn peer=[2001:db8:1::1]:44120 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27092 tx=10672 ms=197956278client # [ 199.532866] nix[1339]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}6279client # [ 199.543794] nix[1339]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed6280client # [ 199.590273] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE6281client # [ 199.598278] systemd[1]: gpu.service: Failed with result 'exit-code'.6282client # [ 199.602051] systemd[1]: gpu.service: Consumed 161ms CPU time over 30.345s wall clock time, 33.2M memory peak, 6.5K incoming IP traffic, 5.8K outgoing IP traffic.6283client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.32 seconds)6284client: must succeed: journalctl -u gpu -o cat6285client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds)6286lb: must succeed: curl -sf localhost:9901/clusters6287lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6288lb: must succeed: curl -sf localhost:9901/clusters6289lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6290worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6291worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6292(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.30 seconds)6293subtest: low disk drains a worker and builds go to the other6294worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6295worker1 # [ 201.441831] nix-grpc-daemon[1592]: ts=2026-09-20T12:24:59Z level=info event=unhealthy reason=min_free6296worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds)6297worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6298worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.05 seconds)6299client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26300client # don't know how to build these paths:6301client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6302worker1 # [ 201.780803] nix-grpc-daemon[1592]: ts=2026-09-20T12:25:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:430246303worker2 # [ 201.714735] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446206304worker1 # [ 201.816110] nix-grpc-daemon[1592]: ts=2026-09-20T12:25:00Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06305worker1 # [ 201.821737] nix-grpc-daemon[1592]: ts=2026-09-20T12:25:00Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16306worker2 # [ 201.790078] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446206307worker2 # [ 201.806955] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446206308client # copying 1 paths to 'lb:50051'...6309client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6310worker2 # [ 201.823622] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446206311worker2 # [ 201.840483] nix-daemon[858]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6312worker2 # [ 201.871408] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:00Z level=info event=niks3_push_started pid=16426313worker2 # [ 202.088757] nix-grpc-daemon[1642]: time=2026-09-20T12:25:00.505Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""6314worker2 # [ 202.267244] nix-daemon[858]: accepted connection from pid 1655, user nix-grpc-daemon (trusted)6315worker2 # [ 202.285863] nix-daemon[858]: reaped child process 1658, status = succeeded6316worker2 # [ 202.462973] nix-daemon[858]: accepted connection from pid 1660, user nix-grpc-daemon (trusted)6317worker2 # [ 202.481444] nix-daemon[858]: reaped child process 1663, status = succeeded6318lb # [ 202.637644] niks3-server[1041]: 2026/09/20 12:25:01 INFO Received uploads request method=POST path=/api/pending_closures6319worker2 # [ 202.508104] nix-grpc-daemon[1642]: time=2026-09-20T12:25:00.924Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6320worker2 # [ 202.509640] nix-grpc-daemon[1642]: time=2026-09-20T12:25:00.924Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6321lb # [ 202.680649] niks3-server[1041]: 2026/09/20 12:25:01 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6322worker2 # [ 202.552153] nix-grpc-daemon[1642]: time=2026-09-20T12:25:00.968Z level=INFO msg="Uploading 1 narinfos"6323lb # [ 202.693017] niks3-server[1041]: 2026/09/20 12:25:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6324lb # [ 202.699976] niks3-server[1041]: 2026/09/20 12:25:01 INFO Signed narinfos id=64 count=16325lb # [ 202.708356] niks3-server[1041]: 2026/09/20 12:25:01 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6326lb # [ 202.721606] niks3-server[1041]: 2026/09/20 12:25:01 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6327worker2 # [ 202.587101] nix-grpc-daemon[1642]: time=2026-09-20T12:25:01.004Z level=INFO msg="Upload complete. (494ms)"6328lb # [ 202.730394] niks3-server[1041]: 2026/09/20 12:25:01 INFO Completed upload id=646329lb # [ 202.735117] niks3-server[1041]: 2026/09/20 12:25:01 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6330worker2 # [ 202.596434] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44620 duration_s=0 paths=1 nar_bytes_in=5126331worker2 # [ 202.611183] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446206332worker2 # [ 202.618552] nix-daemon[858]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6333worker2 # [ 202.624263] nix-daemon[858]: reaped child process 1640, status = succeeded6334client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6335client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6336worker2 # [ 202.639816] nix-daemon[858]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6337lb # [ 203.703124] envoy[922]: conn peer=[2001:db8:1::1]:59938 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=300786338client # farm-a> LOG-farm-a-drain6339worker2 # [ 203.662383] nix-daemon[858]: reaped child process 1667, status = succeeded6340worker2 # [ 203.825385] nix-daemon[858]: accepted connection from pid 1682, user nix-grpc-daemon (trusted)6341worker2 # [ 203.843673] nix-daemon[858]: reaped child process 1685, status = succeeded6342lb # [ 203.997771] niks3-server[1041]: 2026/09/20 12:25:02 INFO Received uploads request method=POST path=/api/pending_closures6343worker2 # [ 203.868010] nix-grpc-daemon[1642]: time=2026-09-20T12:25:02.284Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6344worker2 # [ 203.873324] nix-grpc-daemon[1642]: time=2026-09-20T12:25:02.284Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6345worker2 # [ 203.916162] nix-grpc-daemon[1642]: time=2026-09-20T12:25:02.333Z level=INFO msg="Uploading 1 narinfos"6346lb # [ 204.048398] niks3-server[1041]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6347lb # [ 204.060944] niks3-server[1041]: 2026/09/20 12:25:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6348lb # [ 204.069585] niks3-server[1041]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6349lb # [ 204.075741] niks3-server[1041]: 2026/09/20 12:25:02 INFO Signed narinfos id=65 count=16350lb # [ 204.082840] niks3-server[1041]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6351worker2 # [ 203.944712] nix-grpc-daemon[1642]: time=2026-09-20T12:25:02.362Z level=INFO msg="Upload complete. (294ms)"6352lb # [ 204.087241] niks3-server[1041]: 2026/09/20 12:25:02 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6353lb # [ 204.092900] niks3-server[1041]: 2026/09/20 12:25:02 INFO Completed upload id=656354lb # [ 204.095952] niks3-server[1041]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6355worker2 # [ 203.952790] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44620 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16356worker1 # [ 204.036900] nix-grpc-daemon[1592]: ts=2026-09-20T12:25:02Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06357worker2 # [ 203.968661] nix-daemon[858]: reaped child process 1665, status = succeeded6358worker1 # [ 204.037300] nix-grpc-daemon[1592]: ts=2026-09-20T12:25:02Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16359worker2 # [ 204.006102] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446206360worker2 # [ 204.023284] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446206361worker2 # [ 204.036653] nix-grpc-daemon[1642]: time=2026-09-20T12:25:02.454Z level=INFO msg="All 1 paths already cached"6362client # copying 1 paths to 'lb:50051'...6363client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6364worker2 # [ 204.046228] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446206365worker2 # [ 204.060298] nix-daemon[858]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6366worker2 # [ 204.264096] nix-daemon[858]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6367worker2 # [ 204.281396] nix-daemon[858]: reaped child process 1692, status = succeeded6368worker2 # [ 204.457817] nix-daemon[858]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6369worker2 # [ 204.476313] nix-daemon[858]: reaped child process 1697, status = succeeded6370lb # [ 204.629005] niks3-server[1041]: 2026/09/20 12:25:03 INFO Received uploads request method=POST path=/api/pending_closures6371worker2 # [ 204.496150] nix-grpc-daemon[1642]: time=2026-09-20T12:25:02.913Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6372worker2 # [ 204.498168] nix-grpc-daemon[1642]: time=2026-09-20T12:25:02.913Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6373lb # [ 204.660774] niks3-server[1041]: 2026/09/20 12:25:03 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6374lb # [ 204.674456] niks3-server[1041]: 2026/09/20 12:25:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6375worker2 # [ 204.539019] nix-grpc-daemon[1642]: time=2026-09-20T12:25:02.956Z level=INFO msg="Uploading 1 narinfos"6376lb # [ 204.685221] niks3-server[1041]: 2026/09/20 12:25:03 INFO Signed narinfos id=66 count=16377lb # [ 204.687948] niks3-server[1041]: 2026/09/20 12:25:03 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6378lb # [ 204.701345] niks3-server[1041]: 2026/09/20 12:25:03 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6379worker2 # [ 204.563706] nix-grpc-daemon[1642]: time=2026-09-20T12:25:02.981Z level=INFO msg="Upload complete. (487ms)"6380lb # [ 204.706557] niks3-server[1041]: 2026/09/20 12:25:03 INFO Completed upload id=666381lb # [ 204.710286] niks3-server[1041]: 2026/09/20 12:25:03 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6382worker2 # [ 204.572297] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44620 duration_s=0 paths=1 nar_bytes_in=6326383worker2 # [ 204.580622] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446206384worker2 # [ 204.593549] nix-daemon[858]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6385worker2 # [ 204.596431] nix-daemon[858]: reaped child process 1687, status = succeeded6386client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6387client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6388worker2 # [ 204.609707] nix-daemon[858]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6389client # farm-b> LOG-farm-b-drain6390worker2 # [ 205.639154] nix-daemon[858]: reaped child process 1701, status = succeeded6391worker2 # [ 205.802204] nix-daemon[858]: accepted connection from pid 1716, user nix-grpc-daemon (trusted)6392worker2 # [ 205.820092] nix-daemon[858]: reaped child process 1719, status = succeeded6393lb # [ 205.974173] niks3-server[1041]: 2026/09/20 12:25:04 INFO Received uploads request method=POST path=/api/pending_closures6394worker2 # [ 205.841980] nix-grpc-daemon[1642]: time=2026-09-20T12:25:04.258Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6395worker2 # [ 205.843440] nix-grpc-daemon[1642]: time=2026-09-20T12:25:04.258Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6396lb # [ 206.008834] niks3-server[1041]: 2026/09/20 12:25:04 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6397worker2 # [ 205.880277] nix-grpc-daemon[1642]: time=2026-09-20T12:25:04.297Z level=INFO msg="Uploading 1 narinfos"6398lb # [ 206.022597] niks3-server[1041]: 2026/09/20 12:25:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6399lb # [ 206.034795] niks3-server[1041]: 2026/09/20 12:25:04 INFO Signed narinfos id=67 count=16400lb # [ 206.040788] niks3-server[1041]: 2026/09/20 12:25:04 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6401lb # [ 206.045151] niks3-server[1041]: 2026/09/20 12:25:04 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6402lb # [ 206.050353] niks3-server[1041]: 2026/09/20 12:25:04 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6403lb # [ 206.056303] niks3-server[1041]: 2026/09/20 12:25:04 INFO Completed upload id=676404lb # [ 206.058834] niks3-server[1041]: 2026/09/20 12:25:04 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6405worker2 # [ 205.914307] nix-grpc-daemon[1642]: time=2026-09-20T12:25:04.331Z level=INFO msg="Upload complete. (294ms)"6406worker2 # [ 205.925140] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44620 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16407worker1 # [ 206.004866] nix-grpc-daemon[1592]: ts=2026-09-20T12:25:04Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06408worker1 # [ 206.005240] nix-grpc-daemon[1592]: ts=2026-09-20T12:25:04Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16409worker2 # [ 205.940596] nix-daemon[858]: reaped child process 1699, status = succeeded6410worker2 # [ 205.973858] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446206411worker2 # [ 205.989901] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:446206412worker2 # [ 206.004313] nix-grpc-daemon[1642]: time=2026-09-20T12:25:04.421Z level=INFO msg="All 2 paths already cached"6413client # copying 1 paths to 'lb:50051'...6414client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6415worker2 # [ 206.014465] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:446206416worker2 # [ 206.028363] nix-daemon[858]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6417worker2 # [ 206.231732] nix-daemon[858]: accepted connection from pid 1723, user nix-grpc-daemon (trusted)6418worker2 # [ 206.251442] nix-daemon[858]: reaped child process 1726, status = succeeded6419worker2 # [ 206.427657] nix-daemon[858]: accepted connection from pid 1728, user nix-grpc-daemon (trusted)6420worker2 # [ 206.444850] nix-daemon[858]: reaped child process 1731, status = succeeded6421lb # [ 206.600416] niks3-server[1041]: 2026/09/20 12:25:05 INFO Received uploads request method=POST path=/api/pending_closures6422worker2 # [ 206.467034] nix-grpc-daemon[1642]: time=2026-09-20T12:25:04.884Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6423worker2 # [ 206.468700] nix-grpc-daemon[1642]: time=2026-09-20T12:25:04.884Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6424lb # [ 206.626534] niks3-server[1041]: 2026/09/20 12:25:05 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6425worker2 # [ 206.497227] nix-grpc-daemon[1642]: time=2026-09-20T12:25:04.914Z level=INFO msg="Uploading 1 narinfos"6426lb # [ 206.642672] niks3-server[1041]: 2026/09/20 12:25:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6427lb # [ 206.654865] niks3-server[1041]: 2026/09/20 12:25:05 INFO Signed narinfos id=68 count=16428lb # [ 206.664156] niks3-server[1041]: 2026/09/20 12:25:05 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6429lb # [ 206.667933] niks3-server[1041]: 2026/09/20 12:25:05 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6430lb # [ 206.672648] niks3-server[1041]: 2026/09/20 12:25:05 INFO Completed upload id=686431worker2 # [ 206.529992] nix-grpc-daemon[1642]: time=2026-09-20T12:25:04.947Z level=INFO msg="Upload complete. (484ms)"6432lb # [ 206.676164] niks3-server[1041]: 2026/09/20 12:25:05 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6433worker2 # [ 206.536447] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44620 duration_s=0 paths=1 nar_bytes_in=7606434worker2 # [ 206.549770] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:446206435worker2 # [ 206.557415] nix-daemon[858]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6436worker2 # [ 206.563021] nix-daemon[858]: reaped child process 1721, status = succeeded6437client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6438worker2 # [ 206.575862] nix-daemon[858]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6439client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6440client # farm-top> LOG-farm-top-drain6441worker2 # [ 207.420970] nix-daemon[858]: reaped child process 1735, status = succeeded6442worker2 # [ 207.595021] nix-daemon[858]: accepted connection from pid 1750, user nix-grpc-daemon (trusted)6443worker2 # [ 207.613749] nix-daemon[858]: reaped child process 1753, status = succeeded6444lb # [ 207.769612] niks3-server[1041]: 2026/09/20 12:25:06 INFO Received uploads request method=POST path=/api/pending_closures6445worker2 # [ 207.638558] nix-grpc-daemon[1642]: time=2026-09-20T12:25:06.054Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6446worker2 # [ 207.640119] nix-grpc-daemon[1642]: time=2026-09-20T12:25:06.054Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6447lb # [ 207.805139] niks3-server[1041]: 2026/09/20 12:25:06 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6448lb # [ 207.816387] niks3-server[1041]: 2026/09/20 12:25:06 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6449worker2 # [ 207.686182] nix-grpc-daemon[1642]: time=2026-09-20T12:25:06.103Z level=INFO msg="Uploading 1 narinfos"6450lb # [ 207.830926] niks3-server[1041]: 2026/09/20 12:25:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6451lb # [ 207.838913] niks3-server[1041]: 2026/09/20 12:25:06 INFO Signed narinfos id=69 count=16452lb # [ 207.843342] niks3-server[1041]: 2026/09/20 12:25:06 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6453worker2 # [ 207.705328] nix-grpc-daemon[1642]: time=2026-09-20T12:25:06.122Z level=INFO msg="Upload complete. (319ms)"6454lb # [ 207.847887] niks3-server[1041]: 2026/09/20 12:25:06 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6455lb # [ 207.851421] niks3-server[1041]: 2026/09/20 12:25:06 INFO Completed upload id=696456lb # [ 207.854104] niks3-server[1041]: 2026/09/20 12:25:06 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6457worker2 # [ 207.716928] nix-grpc-daemon[1586]: ts=2026-09-20T12:25:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44620 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16458worker2 # [ 207.729477] nix-daemon[858]: reaped child process 1733, status = succeeded6459client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.31 seconds)6460client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6461client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds)6462worker1: must succeed: rm /nix/.rw-store/fill6463worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6464worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6465worker1 # [ 208.446211] nix-grpc-daemon[1592]: ts=2026-09-20T12:25:06Z level=info event=healthy reason=min_free6466worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.13 seconds)6467(finished: subtest: low disk drains a worker and builds go to the other, in 9.11 seconds)6468(finished: run the VM test script, in 210.42 seconds)6469test script finished in 210.71s6470cleanup6471kill QemuMachine (pid 49)6472client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6473kill QemuMachine (pid 50)6474lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6475kill QemuMachine (pid 51)6476worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6477kill QemuMachine (pid 52)6478worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6479(finished: cleanup, in 1.29 seconds)6480additionally exposed symbols:6481 client, lb, worker1, worker2,6482 vlan1,6483 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh