vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #421
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13worker1 # Formatting '/build/vm-state-worker1/tmp.BJrpoksowh', fmt=raw size=107374182414worker1 # mke2fs 1.47.4 (6-Mar-2025)15worker1 # Discarding device blocks: 0/262144 done16lb # Disk image does not exist, creating the virtualisation disk image...17lb: QEMU running (pid 50)18worker2 # Disk image does not exist, creating the virtualisation disk image...19worker2: QEMU running (pid 52)20worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes21worker2 # Formatting '/build/vm-state-worker2/tmp.YG697k6ZWJ', fmt=raw size=107374182422client # Disk image does not exist, creating the virtualisation disk image...23worker1: QEMU running (pid 51)24lb # Formatting '/build/vm-state-lb/tmp.3eRrWdxJVC', fmt=raw size=107374182425worker2 # mke2fs 1.47.4 (6-Mar-2025)26client # Formatting '/build/vm-state-client/tmp.Jx4SLNp2AR', fmt=raw size=107374182427client: QEMU running (pid 49)28worker1 # Filesystem UUID: c984beb8-4ed6-43a2-b125-8614558ba7c029lb # mke2fs 1.47.4 (6-Mar-2025)30client # mke2fs 1.47.4 (6-Mar-2025)31worker2 # Discarding device blocks: 0/262144 done32worker1 # Superblock backups stored on blocks:33client # Discarding device blocks: 0/262144 done34worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes35worker1 # 32768, 98304, 163840, 22937636lb # Discarding device blocks: 0/262144 done37(finished: start all VMs, in 0.62 seconds)38client # Creating filesystem with 262144 4k blocks and 65536 inodes39worker2 # Filesystem UUID: 31ffeedd-562d-4cb7-9ccc-3cfbd032960e40worker1 # 41client # Filesystem UUID: cb0671fc-4834-41bd-a14f-9d5961c9917842client: waiting for unit network-addresses-eth1.service43lb # Creating filesystem with 262144 4k blocks and 65536 inodes44worker2 # Superblock backups stored on blocks:45worker1 # Allocating group tables: 0/8 done46lb # Filesystem UUID: 484e8737-2bf0-4fca-aa9f-27b5d66e82a947worker2 # 32768, 98304, 163840, 22937648worker1 # Writing inode tables: 0/8 done49lb # Superblock backups stored on blocks:50worker2 # 51worker1 # Creating journal (8192 blocks): done52lb # 32768, 98304, 163840, 22937653worker2 # Allocating group tables: 0/8 done54worker1 # Writing superblocks and filesystem accounting information: 0/8 done55lb # 56worker2 # Writing inode tables: 0/8 done57worker1 # 58lb # Allocating group tables: 0/8 done59worker2 # Creating journal (8192 blocks): done60worker1 # Virtualisation disk image created.61lb # Writing inode tables: 0/8 done62worker2 # Writing superblocks and filesystem accounting information: 0/8 done63client # Superblock backups stored on blocks:64client: waiting for the VM to finish booting65lb # Creating journal (8192 blocks): done66lb # Writing superblocks and filesystem accounting information: 0/8 done67client # 32768, 98304, 163840, 22937668lb # 69client # 70lb # Virtualisation disk image created.71client # Allocating group tables: 0/8 done72worker2 # 73client # Writing inode tables: 0/8 done74client # Creating journal (8192 blocks): done75worker2 # Virtualisation disk image created.76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681lb # [ 0.000000] KASLR enabled82lb # [ 0.000000] random: crng init done83lb # [ 0.000000] Machine model: linux,dummy-virt84lb # [ 0.000000] efi: UEFI not found.85lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88lb # [ 0.000000] Zone ranges:89lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90lb # [ 0.000000] DMA32 empty91lb # [ 0.000000] Normal empty92lb # [ 0.000000] Device empty93lb # [ 0.000000] Movable zone start for each node94lb # [ 0.000000] Early memory node ranges95lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098lb # [ 0.000000] psci: probing for conduit method from DT.99lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.100lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101lb # [ 0.000000] psci: Trusted OS migration not required102lb # [ 0.000000] psci: SMC Calling Convention v1.1103lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105lb # [ 0.000000] Detected PIPT I-cache on CPU0106lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107lb # [ 0.000000] CPU features: detected: GICv3 CPU interface108lb # [ 0.000000] CPU features: detected: Spectre-v4109lb # [ 0.000000] CPU features: detected: Spectre-BHB110lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112lb # [ 0.000000] alternatives: applying boot alternatives113lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty0114lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space.115lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119lb # [ 0.000000] software IO TLB: area num 1.120lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122lb # [ 0.000000] Fallback order for Node 0: 0123lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124lb # [ 0.000000] Policy zone: DMA125lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127lb # [ 0.000000] allocated 3145728 bytes of page_ext128lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups130lb # [ 0.000000] rcu: Hierarchical RCU implementation.131lb # [ 0.000000] rcu: RCU event tracing is enabled.132lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.134lb # [ 0.000000] Rude variant of Tasks RCU enabled.135lb # [ 0.000000] Tracing variant of Tasks RCU enabled.136lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.139lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0142lb # [ 0.000000] GICv3: 256 SPIs implemented143lb # [ 0.000000] GICv3: 0 Extended SPIs implemented144lb # [ 0.000000] Root IRQ handler: gic_handle_irq145lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI146lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0147lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000148lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]149lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)150lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)151lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000152lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000153lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.154lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns155lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).156lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns157lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns158lb # [ 0.000036] arm-pv: using stolen time PV159lb # [ 0.000759] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)160lb # [ 0.000888] Console: colour dummy device 80x25161lb # [ 0.000917] printk: legacy console [tty0] enabled162lb # [ 0.001128] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)163lb # [ 0.001137] pid_max: default: 32768 minimum: 301164lb # [ 0.001220] LSM: initializing lsm=capability,landlock,yama,bpf,ima165lb # [ 0.001449] landlock: Up and running.166lb # [ 0.001452] Yama: becoming mindful.167lb # [ 0.002143] LSM support for eBPF active168lb # [ 0.002328] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)169lb # [ 0.002363] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)170lb # [ 0.003608] cacheinfo: Unable to detect cache hierarchy for CPU 0171lb # [ 0.004398] rcu: Hierarchical SRCU implementation.172lb # [ 0.004403] rcu: Max phase no-delay instances is 1000.173lb # [ 0.005644] fsl-mc MSI: its@8080000 domain created174lb # [ 0.005744] EFI services will not be available.175lb # [ 0.005840] smp: Bringing up secondary CPUs ...176lb # [ 0.005850] smp: Brought up 1 node, 1 CPU177lb # [ 0.005853] SMP: Total of 1 processors activated.178lb # [ 0.005859] CPU: All CPU(s) started at EL1179lb # [ 0.005870] CPU features: detected: Branch Target Identification180lb # [ 0.005875] CPU features: detected: ARMv8.4 Translation Table Level181lb # [ 0.005878] CPU features: detected: Instruction cache invalidation not required for I/D coherence182lb # [ 0.005882] CPU features: detected: Data cache clean to the PoU not required for I/D coherence183lb # [ 0.005885] CPU features: detected: Common not Private translations184lb # [ 0.005888] CPU features: detected: CRC32 instructions185lb # [ 0.005891] CPU features: detected: Data cache clean to Point of Deep Persistence186lb # [ 0.005895] CPU features: detected: Data cache clean to Point of Persistence187lb # [ 0.005898] CPU features: detected: Data independent timing control (DIT)188lb # [ 0.005901] CPU features: detected: E0PD189lb # [ 0.005903] CPU features: detected: Enhanced Counter Virtualization190lb # [ 0.005906] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)191lb # [ 0.005910] CPU features: detected: Enhanced Virtualization Traps192lb # [ 0.005913] CPU features: detected: Fine Grained Traps193lb # [ 0.005916] CPU features: detected: Generic authentication (architected QARMA5 algorithm)194worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]195lb # [ 0.005921] CPU features: detected: RCpc load-acquire (LDAPR)196lb # [ 0.005924] CPU features: detected: LSE atomic instructions197worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026198lb # [ 0.005927] CPU features: detected: Privileged Access Never199worker1 # [ 0.000000] KASLR enabled200lb # [ 0.005929] CPU features: detected: PMUv3201worker1 # [ 0.000000] random: crng init done202worker1 # [ 0.000000] Machine model: linux,dummy-virt203lb # [ 0.005932] CPU features: detected: RAS Extension Support204worker1 # [ 0.000000] efi: UEFI not found.205lb # [ 0.005935] CPU features: detected: RASv1p1 Extension Support206worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT207lb # [ 0.005938] CPU features: detected: Random Number Generator208worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]209lb # [ 0.005940] CPU features: detected: Speculation barrier (SB)210worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]211lb # [ 0.005943] CPU features: detected: Stage-2 Force Write-Back212worker1 # [ 0.000000] Zone ranges:213lb # [ 0.005946] CPU features: detected: TLB range maintenance instructions214worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]215worker1 # [ 0.000000] DMA32 empty216lb # [ 0.005951] CPU features: detected: Speculative Store Bypassing Safe (SSBS)217worker1 # [ 0.000000] Normal empty218worker1 # [ 0.000000] Device empty219lb # [ 0.005995] alternatives: applying system-wide alternatives220worker1 # [ 0.000000] Movable zone start for each node221lb # [ 0.009087] CPU features: detected: BBM Level 2 without TLB conflict abort222worker1 # [ 0.000000] Early memory node ranges223worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]224worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]225lb # [ 0.009265] Memory: 1406568K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)226worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000227lb # [ 0.009743] devtmpfs: initialized228worker1 # [ 0.000000] psci: probing for conduit method from DT.229lb # [ 0.011759] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)230worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.231worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs232lb # [ 0.011786] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).233worker1 # [ 0.000000] psci: Trusted OS migration not required234lb # [ 0.012009] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL235worker1 # [ 0.000000] psci: SMC Calling Convention v1.1236lb # [ 0.012013] 0 pages in range for non-PLT usage237lb # [ 0.012014] 508288 pages in range for PLT usage238worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)239lb # [ 0.012141] pinctrl core: initialized pinctrl subsystem240worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296241lb # [ 0.012986] DMI not present or invalid.242worker1 # [ 0.000000] Detected PIPT I-cache on CPU0243lb # [ 0.017420] NET: Registered PF_NETLINK/PF_ROUTE protocol family244worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)245lb # [ 0.019696] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations246worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface247worker1 # [ 0.000000] CPU features: detected: Spectre-v4248lb # [ 0.019879] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations249worker1 # [ 0.000000] CPU features: detected: Spectre-BHB250lb # [ 0.020082] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations251worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38252worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23253worker1 # [ 0.000000] alternatives: applying boot alternatives254worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]255worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026256worker2 # [ 0.000000] KASLR enabled257worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/wvalz6r5skvxvlhrfirgwz4wl61fm4va-nixos-system-worker1-test/init regInfo=/nix/store/gm51mxchc9khs4nzqasjsrv6m71341j2-closure-info/registration console=ttyAMA0,115200n8 console=tty0258worker2 # [ 0.000000] random: crng init done259worker2 # [ 0.000000] Machine model: linux,dummy-virt260worker2 # [ 0.000000] efi: UEFI not found.261worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/gm51mxchc9khs4nzqasjsrv6m71341j2-closure-info/registration", will be passed to user space.262worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT263worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes264worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]265lb # [ 0.020104] audit: initializing netlink subsys (disabled)266worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)267worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]268worker2 # [ 0.000000] Zone ranges:269lb # [ 0.020749] thermal_sys: Registered thermal governor 'fair_share'270worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)271worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]272lb # [ 0.020752] thermal_sys: Registered thermal governor 'bang_bang'273worker2 # [ 0.000000] DMA32 empty274worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB275worker2 # [ 0.000000] Normal empty276lb # [ 0.020757] thermal_sys: Registered thermal governor 'step_wise'277worker1 # [ 0.000000] software IO TLB: area num 1.278worker2 # [ 0.000000] Device empty279lb # [ 0.020762] thermal_sys: Registered thermal governor 'user_space'280worker2 # [ 0.000000] Movable zone start for each node281worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB282worker2 # [ 0.000000] Early memory node ranges283lb # [ 0.020764] thermal_sys: Registered thermal governor 'power_allocator'284worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)285worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]286worker1 # [ 0.000000] Fallback order for Node 0: 0287lb # [ 0.020794] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1288worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]289lb # [ 0.020804] cpuidle: using governor ladder290worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216291lb # [ 0.020810] cpuidle: using governor menu292worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000293worker1 # [ 0.000000] Policy zone: DMA294worker2 # [ 0.000000] psci: probing for conduit method from DT.295worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off296lb # [ 0.021038] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.297worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.298lb # [ 0.021061] ASID allocator initialised with 65536 entries299worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1300worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs301lb # [ 0.022396] Serial: AMBA PL011 UART driver302worker1 # [ 0.000000] allocated 3145728 bytes of page_ext303worker2 # [ 0.000000] psci: Trusted OS migration not required304worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages305worker2 # [ 0.000000] psci: SMC Calling Convention v1.1306lb # [ 0.028074] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1307worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups308lb # [ 0.028210] printk: console [ttyAMA0] enabled309worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.310worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)311worker1 # [ 0.000000] rcu: RCU event tracing is enabled.312worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296313lb # [ 0.155094] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages314worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.315worker2 # [ 0.000000] Detected PIPT I-cache on CPU0316lb # [ 0.155117] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page317worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.318worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)319worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.320lb # [ 0.155122] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages321worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface322worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.323lb # [ 0.155127] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page324worker2 # [ 0.000000] CPU features: detected: Spectre-v4325worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.326worker2 # [ 0.000000] CPU features: detected: Spectre-BHB327lb # [ 0.155131] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages328worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1329worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38330lb # [ 0.155136] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page331worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23332worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.333lb # [ 0.155140] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages334worker2 # [ 0.000000] alternatives: applying boot alternatives335lb # [ 0.155144] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page336worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.337client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]338worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.339worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0340worker1 # [ 0.000000] GICv3: 256 SPIs implemented341client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026342lb # [ 0.162618] fbcon: Taking over console343client # [ 0.000000] KASLR enabled344lb # [ 0.162634] ACPI: Interpreter disabled.345worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented346worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/80z4xyfc602fv7k5faxlrpwh7krnsxf5-nixos-system-worker2-test/init regInfo=/nix/store/ghmnx54p4a7nm7im2fdspja68nj61lqr-closure-info/registration console=ttyAMA0,115200n8 console=tty0347client # [ 0.000000] random: crng init done348worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq349lb # [ 0.164573] iommu: Default domain type: Translated350client # [ 0.000000] Machine model: linux,dummy-virt351worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI352client # [ 0.000000] efi: UEFI not found.353lb # [ 0.164583] iommu: DMA domain TLB invalidation policy: strict mode354worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0355worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ghmnx54p4a7nm7im2fdspja68nj61lqr-closure-info/registration", will be passed to user space.356client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT357lb # [ 0.166332] SCSI subsystem initialized358worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000359worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes360client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]361worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]362client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]363worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)364client # [ 0.000000] Zone ranges:365worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)366worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)367client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]368client # [ 0.000000] DMA32 empty369worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)370client # [ 0.000000] Normal empty371worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB372client # [ 0.000000] Device empty373worker2 # [ 0.000000] software IO TLB: area num 1.374worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000375client # [ 0.000000] Movable zone start for each node376worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB377client # [ 0.000000] Early memory node ranges378worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000379client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]380worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)381worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.382worker2 # [ 0.000000] Fallback order for Node 0: 0383client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]384worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns385worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216386client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000387worker2 # [ 0.000000] Policy zone: DMA388worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).389client # [ 0.000000] psci: probing for conduit method from DT.390worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off391client # [ 0.000000] psci: PSCIv1.3 detected in firmware.392client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs393worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1394worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns395lb # [ 0.174233] usbcore: registered new interface driver usbfs396client # [ 0.000000] psci: Trusted OS migration not required397worker2 # [ 0.000000] allocated 3145728 bytes of page_ext398lb # [ 0.174269] usbcore: registered new interface driver hub399worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns400client # [ 0.000000] psci: SMC Calling Convention v1.1401worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages402worker1 # [ 0.000037] arm-pv: using stolen time PV403lb # [ 0.174295] usbcore: registered new device driver usb404worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups405lb # [ 0.174616] pps_core: LinuxPPS API ver. 1 registered406client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)407worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.408worker1 # [ 0.000636] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)409client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296410worker2 # [ 0.000000] rcu: RCU event tracing is enabled.411lb # [ 0.174624] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>412worker1 # [ 0.000829] Console: colour dummy device 80x25413client # [ 0.000000] Detected PIPT I-cache on CPU0414lb # [ 0.174635] PTP clock support registered415worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.416worker1 # [ 0.000838] printk: legacy console [tty0] enabled417lb # [ 0.174693] EDAC MC: Ver: 3.0.0418worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.419client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)420worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.421client # [ 0.000000] CPU features: detected: GICv3 CPU interface422lb # [ 0.179364] scmi_core: SCMI protocol bus registered423worker1 # [ 0.001041] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)424worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.425client # [ 0.000000] CPU features: detected: Spectre-v4426worker1 # [ 0.001048] pid_max: default: 32768 minimum: 301427lb # [ 0.180362] FPGA manager framework428client # [ 0.000000] CPU features: detected: Spectre-BHB429worker1 # [ 0.001130] LSM: initializing lsm=capability,landlock,yama,bpf,ima430worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.431lb # [ 0.181343] vgaarb: loaded432worker1 # [ 0.001284] landlock: Up and running.433client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38434worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1435worker1 # [ 0.001287] Yama: becoming mindful.436client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23437worker1 # [ 0.001904] LSM support for eBPF active438client # [ 0.000000] alternatives: applying boot alternatives439worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.440lb # [ 0.182010] clocksource: Switched to clocksource arch_sys_counter441worker1 # [ 0.002070] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)442lb # [ 0.182632] VFS: Disk quotas dquot_6.6.0443worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.444worker1 # [ 0.002114] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)445lb # [ 0.182665] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)446worker1 # [ 0.003297] cacheinfo: Unable to detect cache hierarchy for CPU 0447worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.448lb # [ 0.185031] netfs: FS-Cache loaded449worker1 # [ 0.004123] rcu: Hierarchical SRCU implementation.450lb # [ 0.185151] pnp: PnP ACPI: disabled451worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0452worker1 # [ 0.004128] rcu: Max phase no-delay instances is 1000.453worker2 # [ 0.000000] GICv3: 256 SPIs implemented454client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test/init regInfo=/nix/store/rzniyzvnz3lr579n2zcxgfngii3jfr3p-closure-info/registration console=ttyAMA0,115200n8 console=tty0455worker1 # [ 0.005395] fsl-mc MSI: its@8080000 domain created456worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented457worker1 # [ 0.005489] EFI services will not be available.458worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq459worker1 # [ 0.005587] smp: Bringing up secondary CPUs ...460worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI461worker1 # [ 0.005598] smp: Brought up 1 node, 1 CPU462client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/rzniyzvnz3lr579n2zcxgfngii3jfr3p-closure-info/registration", will be passed to user space.463worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0464worker1 # [ 0.005601] SMP: Total of 1 processors activated.465worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000466client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes467worker1 # [ 0.005607] CPU: All CPU(s) started at EL1468worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]469worker1 # [ 0.005619] CPU features: detected: Branch Target Identification470client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)471worker1 # [ 0.005624] CPU features: detected: ARMv8.4 Translation Table Level472worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)473client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)474worker1 # [ 0.005627] CPU features: detected: Instruction cache invalidation not required for I/D coherence475client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB476worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)477client # [ 0.000000] software IO TLB: area num 1.478worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000479worker1 # [ 0.005631] CPU features: detected: Data cache clean to the PoU not required for I/D coherence480client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB481worker1 # [ 0.005635] CPU features: detected: Common not Private translations482worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000483client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)484worker1 # [ 0.005638] CPU features: detected: CRC32 instructions485lb # [ 0.191333] NET: Registered PF_INET protocol family486worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.487client # [ 0.000000] Fallback order for Node 0: 0488worker1 # [ 0.005641] CPU features: detected: Data cache clean to Point of Deep Persistence489lb # [ 0.191627] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)490client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216491worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns492client # [ 0.000000] Policy zone: DMA493worker1 # [ 0.005644] CPU features: detected: Data cache clean to Point of Persistence494worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).495client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off496worker1 # [ 0.005647] CPU features: detected: Data independent timing control (DIT)497worker1 # [ 0.005650] CPU features: detected: E0PD498client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1499worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns500client # [ 0.000000] allocated 3145728 bytes of page_ext501worker1 # [ 0.005653] CPU features: detected: Enhanced Counter Virtualization502client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages503worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns504worker1 # [ 0.005656] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)505client # [ 0.000000] ftrace: allocated 294 pages with 4 groups506worker2 # [ 0.000033] arm-pv: using stolen time PV507worker1 # [ 0.005659] CPU features: detected: Enhanced Virtualization Traps508client # [ 0.000000] rcu: Hierarchical RCU implementation.509worker1 # [ 0.005662] CPU features: detected: Fine Grained Traps510client # [ 0.000000] rcu: RCU event tracing is enabled.511worker2 # [ 0.000509] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)512worker2 # [ 0.000716] Console: colour dummy device 80x25513client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.514worker1 # [ 0.005666] CPU features: detected: Generic authentication (architected QARMA5 algorithm)515worker2 # [ 0.000725] printk: legacy console [tty0] enabled516client # [ 0.000000] Trampoline variant of Tasks RCU enabled.517worker1 # [ 0.005671] CPU features: detected: RCpc load-acquire (LDAPR)518client # [ 0.000000] Rude variant of Tasks RCU enabled.519worker1 # [ 0.005674] CPU features: detected: LSE atomic instructions520worker2 # [ 0.000955] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)521client # [ 0.000000] Tracing variant of Tasks RCU enabled.522worker1 # [ 0.005677] CPU features: detected: Privileged Access Never523worker2 # [ 0.000962] pid_max: default: 32768 minimum: 301524worker1 # [ 0.005680] CPU features: detected: PMUv3525client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.526worker2 # [ 0.001036] LSM: initializing lsm=capability,landlock,yama,bpf,ima527worker1 # [ 0.005683] CPU features: detected: RAS Extension Support528worker2 # [ 0.001230] landlock: Up and running.529client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1530worker2 # [ 0.001232] Yama: becoming mindful.531worker1 # [ 0.005685] CPU features: detected: RASv1p1 Extension Support532worker2 # [ 0.001753] LSM support for eBPF active533client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.534worker1 # [ 0.005688] CPU features: detected: Random Number Generator535worker2 # [ 0.001911] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)536worker1 # [ 0.005691] CPU features: detected: Speculation barrier (SB)537client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.538worker1 # [ 0.005694] CPU features: detected: Stage-2 Force Write-Back539worker2 # [ 0.001957] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)540worker1 # [ 0.005697] CPU features: detected: TLB range maintenance instructions541client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.542worker2 # [ 0.003207] cacheinfo: Unable to detect cache hierarchy for CPU 0543client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0544worker2 # [ 0.003966] rcu: Hierarchical SRCU implementation.545worker1 # [ 0.005701] CPU features: detected: Speculative Store Bypassing Safe (SSBS)546client # [ 0.000000] GICv3: 256 SPIs implemented547worker2 # [ 0.003971] rcu: Max phase no-delay instances is 1000.548worker1 # [ 0.005741] alternatives: applying system-wide alternatives549client # [ 0.000000] GICv3: 0 Extended SPIs implemented550worker2 # [ 0.005304] fsl-mc MSI: its@8080000 domain created551worker1 # [ 0.009235] CPU features: detected: BBM Level 2 without TLB conflict abort552client # [ 0.000000] Root IRQ handler: gic_handle_irq553worker2 # [ 0.005400] EFI services will not be available.554client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI555worker2 # [ 0.005491] smp: Bringing up secondary CPUs ...556client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0557worker2 # [ 0.005501] smp: Brought up 1 node, 1 CPU558worker1 # [ 0.009457] Memory: 1406512K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)559worker2 # [ 0.005504] SMP: Total of 1 processors activated.560client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000561worker1 # [ 0.009907] devtmpfs: initialized562worker2 # [ 0.005511] CPU: All CPU(s) started at EL1563client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]564worker1 # [ 0.011883] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)565worker2 # [ 0.005521] CPU features: detected: Branch Target Identification566client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)567worker2 # [ 0.005526] CPU features: detected: ARMv8.4 Translation Table Level568worker1 # [ 0.011908] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).569worker1 # [ 0.012112] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL570client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)571worker2 # [ 0.005529] CPU features: detected: Instruction cache invalidation not required for I/D coherence572worker1 # [ 0.012117] 0 pages in range for non-PLT usage573client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000574worker1 # [ 0.012118] 508288 pages in range for PLT usage575worker2 # [ 0.005533] CPU features: detected: Data cache clean to the PoU not required for I/D coherence576worker1 # [ 0.012252] pinctrl core: initialized pinctrl subsystem577client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000578worker1 # [ 0.013119] DMI not present or invalid.579worker2 # [ 0.005536] CPU features: detected: Common not Private translations580client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.581worker2 # [ 0.005540] CPU features: detected: CRC32 instructions582worker1 # [ 0.016665] NET: Registered PF_NETLINK/PF_ROUTE protocol family583worker1 # [ 0.019215] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations584worker2 # [ 0.005542] CPU features: detected: Data cache clean to Point of Deep Persistence585client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns586worker1 # [ 0.019405] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations587worker2 # [ 0.005546] CPU features: detected: Data cache clean to Point of Persistence588client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).589worker2 # [ 0.005549] CPU features: detected: Data independent timing control (DIT)590worker1 # [ 0.019614] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations591worker2 # [ 0.005552] CPU features: detected: E0PD592client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns593worker1 # [ 0.019637] audit: initializing netlink subsys (disabled)594worker2 # [ 0.005555] CPU features: detected: Enhanced Counter Virtualization595client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns596worker2 # [ 0.005558] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)597client # [ 0.000033] arm-pv: using stolen time PV598worker1 # [ 0.020258] thermal_sys: Registered thermal governor 'fair_share'599worker2 # [ 0.005561] CPU features: detected: Enhanced Virtualization Traps600worker1 # [ 0.020260] thermal_sys: Registered thermal governor 'bang_bang'601client # [ 0.000454] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)602worker2 # [ 0.005564] CPU features: detected: Fine Grained Traps603worker1 # [ 0.020264] thermal_sys: Registered thermal governor 'step_wise'604client # [ 0.000642] Console: colour dummy device 80x25605client # [ 0.000650] printk: legacy console [tty0] enabled606worker1 # [ 0.020269] thermal_sys: Registered thermal governor 'user_space'607worker2 # [ 0.005568] CPU features: detected: Generic authentication (architected QARMA5 algorithm)608worker2 # [ 0.005573] CPU features: detected: RCpc load-acquire (LDAPR)609worker1 # [ 0.020272] thermal_sys: Registered thermal governor 'power_allocator'610client # [ 0.000854] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)611worker2 # [ 0.005576] CPU features: detected: LSE atomic instructions612worker1 # [ 0.020311] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1613client # [ 0.000862] pid_max: default: 32768 minimum: 301614worker2 # [ 0.005579] CPU features: detected: Privileged Access Never615worker1 # [ 0.020320] cpuidle: using governor ladder616client # [ 0.000933] LSM: initializing lsm=capability,landlock,yama,bpf,ima617worker2 # [ 0.005581] CPU features: detected: PMUv3618worker1 # [ 0.020326] cpuidle: using governor menu619client # [ 0.001089] landlock: Up and running.620worker2 # [ 0.005584] CPU features: detected: RAS Extension Support621client # [ 0.001091] Yama: becoming mindful.622worker1 # [ 0.020530] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.623client # [ 0.001574] LSM support for eBPF active624worker2 # [ 0.005587] CPU features: detected: RASv1p1 Extension Support625worker1 # [ 0.020548] ASID allocator initialised with 65536 entries626worker2 # [ 0.005589] CPU features: detected: Random Number Generator627worker1 # [ 0.021864] Serial: AMBA PL011 UART driver628client # [ 0.001711] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)629worker2 # [ 0.005592] CPU features: detected: Speculation barrier (SB)630worker1 # [ 0.027304] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1631client # [ 0.001752] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)632worker2 # [ 0.005595] CPU features: detected: Stage-2 Force Write-Back633worker1 # [ 0.027489] printk: console [ttyAMA0] enabled634client # [ 0.002962] cacheinfo: Unable to detect cache hierarchy for CPU 0635lb # [ 0.221249] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)636worker2 # [ 0.005598] CPU features: detected: TLB range maintenance instructions637client # [ 0.003751] rcu: Hierarchical SRCU implementation.638lb # [ 0.221306] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)639client # [ 0.003757] rcu: Max phase no-delay instances is 1000.640worker2 # [ 0.005603] CPU features: detected: Speculative Store Bypassing Safe (SSBS)641client # [ 0.005012] fsl-mc MSI: its@8080000 domain created642worker2 # [ 0.005641] alternatives: applying system-wide alternatives643lb # [ 0.221341] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)644client # [ 0.005104] EFI services will not be available.645worker2 # [ 0.008797] CPU features: detected: BBM Level 2 without TLB conflict abort646client # [ 0.005189] smp: Bringing up secondary CPUs ...647lb # [ 0.221423] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)648client # [ 0.005197] smp: Brought up 1 node, 1 CPU649lb # [ 0.221571] TCP: Hash tables configured (established 16384 bind 16384)650client # [ 0.005200] SMP: Total of 1 processors activated.651worker2 # [ 0.009026] Memory: 1406532K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)652client # [ 0.005206] CPU: All CPU(s) started at EL1653worker2 # [ 0.009503] devtmpfs: initialized654lb # [ 0.221673] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)655client # [ 0.005217] CPU features: detected: Branch Target Identification656lb # [ 0.221713] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)657client # [ 0.005221] CPU features: detected: ARMv8.4 Translation Table Level658worker2 # [ 0.011463] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)659lb # [ 0.221749] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)660client # [ 0.005224] CPU features: detected: Instruction cache invalidation not required for I/D coherence661lb # [ 0.221843] NET: Registered PF_UNIX/PF_LOCAL protocol family662worker2 # [ 0.011496] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).663lb # [ 0.221895] NET: Registered PF_XDP protocol family664client # [ 0.005228] CPU features: detected: Data cache clean to the PoU not required for I/D coherence665worker2 # [ 0.011687] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL666lb # [ 0.221915] PCI: CLS 0 bytes, default 64667client # [ 0.005232] CPU features: detected: Common not Private translations668worker2 # [ 0.011692] 0 pages in range for non-PLT usage669worker1 # [ 0.150261] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages670lb # [ 0.222126] Trying to unpack rootfs image as initramfs...671worker2 # [ 0.011693] 508288 pages in range for PLT usage672client # [ 0.005235] CPU features: detected: CRC32 instructions673worker1 # [ 0.150283] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page674worker2 # [ 0.011813] pinctrl core: initialized pinctrl subsystem675client # [ 0.005238] CPU features: detected: Data cache clean to Point of Deep Persistence676worker2 # [ 0.012681] DMI not present or invalid.677worker1 # [ 0.150289] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages678client # [ 0.005241] CPU features: detected: Data cache clean to Point of Persistence679worker2 # [ 0.016149] NET: Registered PF_NETLINK/PF_ROUTE protocol family680worker1 # [ 0.150294] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page681client # [ 0.005245] CPU features: detected: Data independent timing control (DIT)682worker2 # [ 0.018604] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations683worker1 # [ 0.150298] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages684client # [ 0.005248] CPU features: detected: E0PD685worker1 # [ 0.150303] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page686worker2 # [ 0.018809] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations687client # [ 0.005250] CPU features: detected: Enhanced Counter Virtualization688worker1 # [ 0.150307] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages689worker2 # [ 0.019011] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations690client # [ 0.005253] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)691worker1 # [ 0.150311] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page692worker2 # [ 0.019036] audit: initializing netlink subsys (disabled)693client # [ 0.005257] CPU features: detected: Enhanced Virtualization Traps694worker2 # [ 0.019595] thermal_sys: Registered thermal governor 'fair_share'695client # [ 0.005260] CPU features: detected: Fine Grained Traps696lb # [ 0.240096] kvm [1]: HYP mode not available697worker2 # [ 0.019596] thermal_sys: Registered thermal governor 'bang_bang'698client # [ 0.005264] CPU features: detected: Generic authentication (architected QARMA5 algorithm)699worker1 # [ 0.157745] fbcon: Taking over console700worker2 # [ 0.019600] thermal_sys: Registered thermal governor 'step_wise'701worker1 # [ 0.157763] ACPI: Interpreter disabled.702client # [ 0.005268] CPU features: detected: RCpc load-acquire (LDAPR)703worker2 # [ 0.019605] thermal_sys: Registered thermal governor 'user_space'704client # [ 0.005271] CPU features: detected: LSE atomic instructions705worker2 # [ 0.019607] thermal_sys: Registered thermal governor 'power_allocator'706client # [ 0.005275] CPU features: detected: Privileged Access Never707client # [ 0.005277] CPU features: detected: PMUv3708worker2 # [ 0.019645] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1709client # [ 0.005280] CPU features: detected: RAS Extension Support710worker2 # [ 0.019654] cpuidle: using governor ladder711worker2 # [ 0.019659] cpuidle: using governor menu712client # [ 0.005283] CPU features: detected: RASv1p1 Extension Support713client # [ 0.005285] CPU features: detected: Random Number Generator714worker2 # [ 0.019852] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.715client # [ 0.005288] CPU features: detected: Speculation barrier (SB)716worker2 # [ 0.019867] ASID allocator initialised with 65536 entries717worker2 # [ 0.021146] Serial: AMBA PL011 UART driver718client # [ 0.005291] CPU features: detected: Stage-2 Force Write-Back719client # [ 0.005294] CPU features: detected: TLB range maintenance instructions720worker2 # [ 0.026427] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1721worker2 # [ 0.026589] printk: console [ttyAMA0] enabled722client # [ 0.005298] CPU features: detected: Speculative Store Bypassing Safe (SSBS)723client # [ 0.005336] alternatives: applying system-wide alternatives724worker1 # [ 0.166469] iommu: Default domain type: Translated725client # [ 0.008574] CPU features: detected: BBM Level 2 without TLB conflict abort726worker1 # [ 0.166481] iommu: DMA domain TLB invalidation policy: strict mode727worker1 # [ 0.166894] SCSI subsystem initialized728client # [ 0.008834] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)729worker1 # [ 0.168969] usbcore: registered new interface driver usbfs730client # [ 0.009505] devtmpfs: initialized731worker1 # [ 0.169004] usbcore: registered new interface driver hub732worker1 # [ 0.169022] usbcore: registered new device driver usb733client # [ 0.011383] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)734worker1 # [ 0.169309] pps_core: LinuxPPS API ver. 1 registered735client # [ 0.011407] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).736worker1 # [ 0.169318] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>737client # [ 0.011607] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL738worker1 # [ 0.169328] PTP clock support registered739worker1 # [ 0.169384] EDAC MC: Ver: 3.0.0740client # [ 0.011612] 0 pages in range for non-PLT usage741client # [ 0.011613] 508288 pages in range for PLT usage742worker1 # [ 0.174110] scmi_core: SCMI protocol bus registered743worker2 # [ 0.149838] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages744client # [ 0.011728] pinctrl core: initialized pinctrl subsystem745client # [ 0.012491] DMI not present or invalid.746worker2 # [ 0.149861] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page747worker1 # [ 0.175101] FPGA manager framework748worker1 # [ 0.176077] vgaarb: loaded749client # [ 0.015792] NET: Registered PF_NETLINK/PF_ROUTE protocol family750worker2 # [ 0.149867] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages751client # [ 0.018134] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations752worker2 # [ 0.149871] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page753worker1 # [ 0.176761] clocksource: Switched to clocksource arch_sys_counter754client # [ 0.018318] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations755worker2 # [ 0.149880] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages756worker2 # [ 0.149888] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page757client # [ 0.018525] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations758worker2 # [ 0.149892] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages759client # [ 0.018551] audit: initializing netlink subsys (disabled)760worker2 # [ 0.149896] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page761client # [ 0.019181] thermal_sys: Registered thermal governor 'fair_share'762client # [ 0.019184] thermal_sys: Registered thermal governor 'bang_bang'763worker1 # [ 0.181347] VFS: Disk quotas dquot_6.6.0764client # [ 0.019188] thermal_sys: Registered thermal governor 'step_wise'765worker1 # [ 0.181400] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)766worker2 # [ 0.157521] fbcon: Taking over console767client # [ 0.019193] thermal_sys: Registered thermal governor 'user_space'768worker2 # [ 0.157541] ACPI: Interpreter disabled.769worker1 # [ 0.183097] netfs: FS-Cache loaded770client # [ 0.019196] thermal_sys: Registered thermal governor 'power_allocator'771worker1 # [ 0.183229] pnp: PnP ACPI: disabled772client # [ 0.019227] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1773client # [ 0.019236] cpuidle: using governor ladder774client # [ 0.019242] cpuidle: using governor menu775client # [ 0.019430] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.776client # [ 0.019447] ASID allocator initialised with 65536 entries777client # [ 0.020714] Serial: AMBA PL011 UART driver778client # [ 0.026088] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1779worker1 # [ 0.187226] NET: Registered PF_INET protocol family780client # [ 0.026258] printk: console [ttyAMA0] enabled781worker1 # [ 0.187518] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)782worker2 # [ 0.166184] iommu: Default domain type: Translated783worker2 # [ 0.166196] iommu: DMA domain TLB invalidation policy: strict mode784worker2 # [ 0.166587] SCSI subsystem initialized785worker2 # [ 0.168635] usbcore: registered new interface driver usbfs786worker2 # [ 0.168668] usbcore: registered new interface driver hub787worker2 # [ 0.168688] usbcore: registered new device driver usb788worker2 # [ 0.168996] pps_core: LinuxPPS API ver. 1 registered789client # [ 0.148639] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages790worker2 # [ 0.169005] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>791client # [ 0.148659] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page792worker2 # [ 0.169015] PTP clock support registered793worker2 # [ 0.169077] EDAC MC: Ver: 3.0.0794client # [ 0.148665] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages795worker2 # [ 0.173851] scmi_core: SCMI protocol bus registered796client # [ 0.148669] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page797worker2 # [ 0.174873] FPGA manager framework798client # [ 0.148673] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages799worker2 # [ 0.175888] vgaarb: loaded800client # [ 0.148677] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page801worker2 # [ 0.176587] clocksource: Switched to clocksource arch_sys_counter802client # [ 0.148682] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages803client # [ 0.148686] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page804client # [ 0.156658] fbcon: Taking over console805client # [ 0.156675] ACPI: Interpreter disabled.806worker2 # [ 0.181299] VFS: Disk quotas dquot_6.6.0807worker2 # [ 0.181351] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)808worker2 # [ 0.183057] netfs: FS-Cache loaded809worker2 # [ 0.183195] pnp: PnP ACPI: disabled810client # [ 0.164328] iommu: Default domain type: Translated811client # [ 0.164341] iommu: DMA domain TLB invalidation policy: strict mode812worker2 # [ 0.187378] NET: Registered PF_INET protocol family813client # [ 0.164736] SCSI subsystem initialized814worker2 # [ 0.187681] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)815client # [ 0.166861] usbcore: registered new interface driver usbfs816client # [ 0.166893] usbcore: registered new interface driver hub817client # [ 0.166912] usbcore: registered new device driver usb818client # [ 0.167206] pps_core: LinuxPPS API ver. 1 registered819client # [ 0.167211] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>820client # [ 0.167222] PTP clock support registered821client # [ 0.167280] EDAC MC: Ver: 3.0.0822client # [ 0.172130] scmi_core: SCMI protocol bus registered823client # [ 0.173203] FPGA manager framework824client # [ 0.174280] vgaarb: loaded825client # [ 0.174979] clocksource: Switched to clocksource arch_sys_counter826worker1 # [ 0.218412] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)827worker1 # [ 0.218473] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)828worker1 # [ 0.218509] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)829client # [ 0.180228] VFS: Disk quotas dquot_6.6.0830worker1 # [ 0.218599] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)831client # [ 0.180269] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)832worker1 # [ 0.218745] TCP: Hash tables configured (established 16384 bind 16384)833worker1 # [ 0.218851] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)834worker1 # [ 0.218890] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)835client # [ 0.184102] netfs: FS-Cache loaded836worker1 # [ 0.218927] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)837client # [ 0.184237] pnp: PnP ACPI: disabled838worker1 # [ 0.219019] NET: Registered PF_UNIX/PF_LOCAL protocol family839worker1 # [ 0.219042] NET: Registered PF_XDP protocol family840worker1 # [ 0.219064] PCI: CLS 0 bytes, default 64841worker1 # [ 0.219334] Trying to unpack rootfs image as initramfs...842client # [ 0.188451] NET: Registered PF_INET protocol family843client # [ 0.188931] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)844worker1 # [ 0.234737] kvm [1]: HYP mode not available845lb # [ 0.341131] Initialise system trusted keyrings846worker2 # [ 0.219075] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)847worker2 # [ 0.219135] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)848worker2 # [ 0.219170] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)849worker2 # [ 0.219257] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)850worker2 # [ 0.219400] TCP: Hash tables configured (established 16384 bind 16384)851worker2 # [ 0.219494] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)852worker2 # [ 0.219535] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)853worker2 # [ 0.219572] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)854worker2 # [ 0.219682] NET: Registered PF_UNIX/PF_LOCAL protocol family855worker2 # [ 0.219724] NET: Registered PF_XDP protocol family856worker2 # [ 0.219745] PCI: CLS 0 bytes, default 64857lb # [ 0.350128] workingset: timestamp_bits=42 max_order=19 bucket_order=0858worker2 # [ 0.219993] Trying to unpack rootfs image as initramfs...859lb # [ 0.351677] squashfs: version 4.0 (2009/01/31) Phillip Lougher860client # [ 0.218930] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)861worker2 # [ 0.238738] kvm [1]: HYP mode not available862lb # [ 0.352469] 9p: Installing v9fs 9p2000 file system support863client # [ 0.220229] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)864client # [ 0.220270] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)865client # [ 0.220359] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)866lb # [ 0.365188] Key type asymmetric registered867client # [ 0.220508] TCP: Hash tables configured (established 16384 bind 16384)868lb # [ 0.365204] Asymmetric key parser 'x509' registered869client # [ 0.220605] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)870lb # [ 0.365259] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)871client # [ 0.220645] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)872client # [ 0.220682] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)873client # [ 0.220780] NET: Registered PF_UNIX/PF_LOCAL protocol family874client # [ 0.220806] NET: Registered PF_XDP protocol family875client # [ 0.220826] PCI: CLS 0 bytes, default 64876client # [ 0.221092] Trying to unpack rootfs image as initramfs...877lb # [ 0.374118] io scheduler mq-deadline registered878lb # [ 0.374144] io scheduler kyber registered879client # [ 0.243043] kvm [1]: HYP mode not available880lb # [ 0.386208] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881lb # [ 0.387771] ledtrig-cpu: registered to indicate activity on CPUs882lb # [ 0.388199] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:883lb # [ 0.388220] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000884lb # [ 0.388232] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000885lb # [ 0.388240] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000886lb # [ 0.388276] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits887lb # [ 0.388305] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]888lb # [ 0.388399] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00889lb # [ 0.388411] pci_bus 0000:00: root bus resource [bus 00-ff]890lb # [ 0.388418] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]891lb # [ 0.388423] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]892lb # [ 0.388429] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]893lb # [ 0.388488] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint894lb # [ 0.388961] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint895lb # [ 0.389151] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]896lb # [ 0.389168] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]897lb # [ 0.389197] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]898lb # [ 0.389213] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]899lb # [ 0.389693] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint900lb # [ 0.389879] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]901lb # [ 0.389895] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]902lb # [ 0.389924] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]903lb # [ 0.414537] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint904lb # [ 0.414753] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]905lb # [ 0.414772] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]906lb # [ 0.414802] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]907lb # [ 0.415272] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint908lb # [ 0.415456] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]909lb # [ 0.415472] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]910lb # [ 0.415505] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]911lb # [ 0.415969] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint912lb # [ 0.416156] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]913lb # [ 0.416172] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]914lb # [ 0.416204] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915lb # [ 0.416705] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint916lb # [ 0.416917] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]917lb # [ 0.416934] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]918lb # [ 0.416964] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]919lb # [ 0.417425] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint920lb # [ 0.417613] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]921lb # [ 0.417630] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]922lb # [ 0.417661] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]923lb # [ 0.417678] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]924worker1 # [ 0.347690] Initialise system trusted keyrings925lb # [ 0.435061] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint926lb # [ 0.435270] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]927lb # [ 0.435300] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]928lb # [ 0.435772] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint929worker1 # [ 0.352850] workingset: timestamp_bits=42 max_order=19 bucket_order=0930lb # [ 0.435955] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]931lb # [ 0.435984] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]932worker1 # [ 0.354328] squashfs: version 4.0 (2009/01/31) Phillip Lougher933lb # [ 0.436378] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint934lb # [ 0.436563] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]935worker1 # [ 0.355138] 9p: Installing v9fs 9p2000 file system support936lb # [ 0.436817] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint937lb # [ 0.437237] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]938lb # [ 0.437272] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]939lb # [ 0.437303] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]940lb # [ 0.437844] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint941lb # [ 0.454177] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]942lb # [ 0.454222] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]943lb # [ 0.454264] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]944lb # [ 0.455036] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned945lb # [ 0.455052] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned946worker2 # [ 0.349182] Initialise system trusted keyrings947lb # [ 0.455059] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned948worker2 # [ 0.349962] workingset: timestamp_bits=42 max_order=19 bucket_order=0949lb # [ 0.455114] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned950worker2 # [ 0.351342] squashfs: version 4.0 (2009/01/31) Phillip Lougher951worker1 # [ 0.375902] Key type asymmetric registered952lb # [ 0.455171] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned953worker1 # [ 0.375931] Asymmetric key parser 'x509' registered954worker2 # [ 0.352141] 9p: Installing v9fs 9p2000 file system support955lb # [ 0.455224] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned956worker1 # [ 0.376010] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)957lb # [ 0.455279] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned958lb # [ 0.455332] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned959lb # [ 0.455387] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned960lb # [ 0.455441] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned961lb # [ 0.455501] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned962lb # [ 0.455557] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned963lb # [ 0.455707] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned964worker1 # [ 0.384841] io scheduler mq-deadline registered965lb # [ 0.455765] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned966worker1 # [ 0.384871] io scheduler kyber registered967lb # [ 0.455793] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned968lb # [ 0.455819] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned969lb # [ 0.455844] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned970lb # [ 0.455873] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned971lb # [ 0.455898] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned972lb # [ 0.455921] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned973worker1 # [ 0.390090] pl061_gpio 9030000.pl061: PL061 GPIO chip registered974lb # [ 0.455945] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned975lb # [ 0.455971] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned976lb # [ 0.455996] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned977worker1 # [ 0.391429] ledtrig-cpu: registered to indicate activity on CPUs978lb # [ 0.456023] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned979worker1 # [ 0.391831] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:980lb # [ 0.456049] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned981worker1 # [ 0.391851] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000982lb # [ 0.456071] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned983lb # [ 0.456095] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned984worker1 # [ 0.391864] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000985lb # [ 0.456118] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned986worker1 # [ 0.391872] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000987lb # [ 0.456145] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned988worker1 # [ 0.391893] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits989lb # [ 0.456170] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned990lb # [ 0.456195] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned991worker1 # [ 0.391914] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]992lb # [ 0.456219] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned993worker1 # [ 0.391999] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00994lb # [ 0.456243] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned995worker1 # [ 0.392009] pci_bus 0000:00: root bus resource [bus 00-ff]996lb # [ 0.456267] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned997worker1 # [ 0.392015] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]998lb # [ 0.456297] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]999worker1 # [ 0.392021] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1000lb # [ 0.456307] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1001worker1 # [ 0.392026] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1002lb # [ 0.456312] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1003client # [ 0.356745] Initialise system trusted keyrings1004worker1 # [ 0.392129] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1005lb # [ 0.457570] pci 0000:00:0a.0: enabling device (0000 -> 0002)1006client # [ 0.357554] workingset: timestamp_bits=42 max_order=19 bucket_order=01007worker2 # [ 0.380893] Key type asymmetric registered1008worker1 # [ 0.392609] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1009worker2 # [ 0.380922] Asymmetric key parser 'x509' registered1010client # [ 0.358882] squashfs: version 4.0 (2009/01/31) Phillip Lougher1011worker2 # [ 0.381006] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1012worker2 # [ 0.383175] io scheduler mq-deadline registered1013worker2 # [ 0.383187] io scheduler kyber registered1014lb # [ 0.498177] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 39660 usecs1015client # [ 0.359791] 9p: Installing v9fs 9p2000 file system support1016worker2 # [ 0.392741] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1017worker1 # [ 0.412886] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1018worker2 # [ 0.394233] ledtrig-cpu: registered to indicate activity on CPUs1019worker1 # [ 0.412919] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1020worker2 # [ 0.394641] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1021worker1 # [ 0.412952] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1022worker2 # [ 0.394660] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001023worker1 # [ 0.412968] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1024worker1 # [ 0.413497] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1025worker2 # [ 0.394673] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001026worker1 # [ 0.413690] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1027worker2 # [ 0.394681] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001028worker1 # [ 0.413706] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1029worker2 # [ 0.394705] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1030worker1 # [ 0.413735] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1031client # [ 0.379736] Key type asymmetric registered1032worker1 # [ 0.414200] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1033worker2 # [ 0.394745] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1034client # [ 0.379766] Asymmetric key parser 'x509' registered1035worker1 # [ 0.414386] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1036worker2 # [ 0.394826] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001037client # [ 0.379843] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1038worker1 # [ 0.414402] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1039worker2 # [ 0.394836] pci_bus 0000:00: root bus resource [bus 00-ff]1040worker1 # [ 0.414431] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1041worker2 # [ 0.394843] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1042worker2 # [ 0.394848] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1043worker1 # [ 0.414887] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1044worker1 # [ 0.415068] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1045worker2 # [ 0.394854] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1046worker1 # [ 0.415083] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1047worker2 # [ 0.394953] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1048worker1 # [ 0.415116] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1049worker2 # [ 0.395416] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1050worker1 # [ 0.415582] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1051lb # [ 0.520349] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1052worker2 # [ 0.395606] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1053client # [ 0.387048] io scheduler mq-deadline registered1054worker1 # [ 0.415767] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1055worker2 # [ 0.395622] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1056client # [ 0.387072] io scheduler kyber registered1057worker1 # [ 0.415783] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1058worker2 # [ 0.395652] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1059worker1 # [ 0.415812] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1060worker2 # [ 0.395668] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1061worker1 # [ 0.416277] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1062worker2 # [ 0.396142] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1063worker1 # [ 0.416460] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1064worker2 # [ 0.396354] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1065worker1 # [ 0.416476] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1066worker2 # [ 0.396371] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1067worker1 # [ 0.416505] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1068worker2 # [ 0.396401] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1069worker1 # [ 0.416995] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1070worker1 # [ 0.417182] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1071worker2 # [ 0.416307] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1072worker1 # [ 0.417198] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1073worker2 # [ 0.416507] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1074worker1 # [ 0.417230] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1075worker2 # [ 0.416523] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1076worker1 # [ 0.417247] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1077worker2 # [ 0.416553] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1078worker1 # [ 0.417745] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1079worker1 # [ 0.417942] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1080worker1 # [ 0.417972] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1081lb # [ 0.531211] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1082worker1 # [ 0.418430] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1083client # [ 0.399157] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1084worker1 # [ 0.418617] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1085lb # [ 0.533531] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1086worker1 # [ 0.418646] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1087worker1 # [ 0.419037] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1088worker1 # [ 0.419222] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1089client # [ 0.400635] ledtrig-cpu: registered to indicate activity on CPUs1090worker1 # [ 0.419477] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1091client # [ 0.401054] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1092worker1 # [ 0.419770] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1093worker1 # [ 0.419787] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1094client # [ 0.401077] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001095worker1 # [ 0.419817] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1096worker2 # [ 0.425094] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1097client # [ 0.401090] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001098worker2 # [ 0.425302] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1099worker1 # [ 0.420286] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1100worker2 # [ 0.425320] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1101client # [ 0.401098] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001102worker1 # [ 0.420477] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1103worker2 # [ 0.425353] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1104worker1 # [ 0.420492] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1105client # [ 0.401123] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1106worker1 # [ 0.420523] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1107worker2 # [ 0.425828] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1108client # [ 0.401148] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1109worker2 # [ 0.426017] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1110client # [ 0.401273] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001111worker2 # [ 0.426034] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1112lb # [ 0.544876] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1113client # [ 0.401283] pci_bus 0000:00: root bus resource [bus 00-ff]1114worker2 # [ 0.426065] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1115client # [ 0.401289] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1116worker2 # [ 0.426525] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1117client # [ 0.401295] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1118worker2 # [ 0.426715] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1119client # [ 0.401300] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1120worker2 # [ 0.426731] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1121client # [ 0.401363] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1122worker2 # [ 0.426761] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1123client # [ 0.401841] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1124worker2 # [ 0.427232] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1125client # [ 0.402040] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1126worker2 # [ 0.427425] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1127client # [ 0.402058] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1128worker2 # [ 0.427441] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1129worker1 # [ 0.461203] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1130client # [ 0.402088] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131worker2 # [ 0.427474] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1132client # [ 0.402105] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1133worker2 # [ 0.427490] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1134worker1 # [ 0.461223] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1135client # [ 0.402584] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1136worker1 # [ 0.461229] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1137worker2 # [ 0.427997] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1138lb # [ 0.551223] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1139client # [ 0.402774] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1140worker2 # [ 0.428194] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1141worker1 # [ 0.461282] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1142lb # [ 0.553639] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1143client # [ 0.402791] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1144worker2 # [ 0.428226] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1145worker1 # [ 0.461329] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1146client # [ 0.402822] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1147worker1 # [ 0.461378] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1148client # [ 0.422764] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1149worker1 # [ 0.461424] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1150client # [ 0.422964] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1151worker1 # [ 0.461472] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1152worker1 # [ 0.461521] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1153worker2 # [ 0.444855] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1154worker1 # [ 0.461569] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1155worker2 # [ 0.445047] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1156client # [ 0.424659] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1157worker2 # [ 0.445077] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1158worker1 # [ 0.461618] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1159client # [ 0.424692] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1160worker2 # [ 0.445481] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1161worker1 # [ 0.461666] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1162client # [ 0.425168] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1163worker2 # [ 0.445666] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1164client # [ 0.425357] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1165worker1 # [ 0.461797] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1166client # [ 0.425373] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1167worker2 # [ 0.445926] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1168worker1 # [ 0.461845] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1169lb # [ 0.563706] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1170worker2 # [ 0.446230] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1171client # [ 0.425414] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1172worker1 # [ 0.461867] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1173worker2 # [ 0.446246] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1174client # [ 0.425894] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1175worker1 # [ 0.461892] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1176worker2 # [ 0.446276] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1177client # [ 0.426087] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1178worker1 # [ 0.461914] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1179worker2 # [ 0.446757] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1180client # [ 0.426104] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1181worker1 # [ 0.461938] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1182worker2 # [ 0.446946] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1183client # [ 0.426135] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1184worker1 # [ 0.461960] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1185worker2 # [ 0.446962] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1186client # [ 0.426597] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1187worker1 # [ 0.461982] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1188worker2 # [ 0.446993] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1189client # [ 0.426786] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1190worker1 # [ 0.462003] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1191worker2 # [ 0.447608] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1192client # [ 0.426802] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1193worker1 # [ 0.462025] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1194worker2 # [ 0.447620] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1195client # [ 0.426832] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1196worker1 # [ 0.462047] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1197worker2 # [ 0.447625] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1198worker1 # [ 0.462070] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1199worker2 # [ 0.447671] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1200worker1 # [ 0.462092] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1201lb # [ 0.570304] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1202worker2 # [ 0.447724] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1203worker1 # [ 0.462114] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1204lb # [ 0.572756] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1205worker1 # [ 0.462136] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1206worker2 # [ 0.447773] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1207worker1 # [ 0.462158] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1208worker2 # [ 0.447822] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1209worker1 # [ 0.462179] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1210worker2 # [ 0.447870] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1211worker1 # [ 0.462201] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1212worker1 # [ 0.462222] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1213worker2 # [ 0.447918] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1214worker1 # [ 0.462244] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1215worker2 # [ 0.447966] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1216worker1 # [ 0.462266] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1217worker2 # [ 0.448015] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1218worker1 # [ 0.462288] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1219worker1 # [ 0.462316] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1220worker2 # [ 0.448065] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1221client # [ 0.443365] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1222worker1 # [ 0.462325] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1223client # [ 0.443571] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1224worker2 # [ 0.448138] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1225worker1 # [ 0.462330] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1226client # [ 0.443589] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1227worker2 # [ 0.448184] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1228worker1 # [ 0.463527] pci 0000:00:0a.0: enabling device (0000 -> 0002)1229client # [ 0.443621] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1230worker2 # [ 0.448206] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1231client # [ 0.443638] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1232worker2 # [ 0.448230] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1233lb # [ 0.583320] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1234worker2 # [ 0.448255] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1235client # [ 0.444161] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1236client # [ 0.444363] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1237worker2 # [ 0.448280] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1238client # [ 0.444394] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1239worker2 # [ 0.448302] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1240worker2 # [ 0.448345] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1241client # [ 0.444863] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1242worker2 # [ 0.448367] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1243client # [ 0.445054] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1244worker2 # [ 0.448390] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1245client # [ 0.445085] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1246worker2 # [ 0.448412] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1247client # [ 0.445503] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1248worker2 # [ 0.448435] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1249client # [ 0.445694] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1250worker2 # [ 0.448459] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1251client # [ 0.445969] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1252worker2 # [ 0.448481] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1253client # [ 0.446293] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1254worker2 # [ 0.448503] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1255lb # [ 0.590225] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1256client # [ 0.446312] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1257worker2 # [ 0.448525] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1258client # [ 0.446343] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1259worker2 # [ 0.448546] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1260client # [ 0.446845] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1261worker2 # [ 0.448568] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1262lb # [ 0.603954] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1263client # [ 0.467070] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1264client # [ 0.467097] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1265client # [ 0.467127] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1266worker1 # [ 0.520086] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1267client # [ 0.467767] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1268lb # [ 0.606879] msm_serial: driver initialized1269lb # [ 0.607055] SuperH (H)SCI(F) driver initialized1270client # [ 0.467780] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1271lb # [ 0.607129] STM32 USART driver initialized1272client # [ 0.467786] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1273worker2 # [ 0.496649] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1274client # [ 0.467834] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1275worker2 # [ 0.496732] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1276client # [ 0.467883] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1277worker2 # [ 0.496757] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1278client # [ 0.467931] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1279worker2 # [ 0.496785] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1280worker2 # [ 0.496825] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1281client # [ 0.467982] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1282worker2 # [ 0.496835] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1283client # [ 0.468030] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1284worker2 # [ 0.496841] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1285client # [ 0.468081] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1286worker2 # [ 0.498085] pci 0000:00:0a.0: enabling device (0000 -> 0002)1287client # [ 0.468131] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1288client # [ 0.468179] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1289client # [ 0.468226] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1290worker1 # [ 0.530236] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1291client # [ 0.468356] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1292client # [ 0.468403] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1293client # [ 0.468429] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1294client # [ 0.468451] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1295client # [ 0.468474] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1296client # [ 0.468501] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1297client # [ 0.468525] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1298client # [ 0.468549] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1299client # [ 0.468572] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1300client # [ 0.468595] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1301client # [ 0.468618] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1302client # [ 0.468642] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1303client # [ 0.468666] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1304client # [ 0.468688] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1305client # [ 0.468711] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1306client # [ 0.468732] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1307client # [ 0.468755] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1308client # [ 0.468777] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1309client # [ 0.468800] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1310client # [ 0.468822] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1311worker1 # [ 0.541062] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1312worker1 # [ 0.543262] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1313client # [ 0.468847] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1314worker1 # [ 0.545422] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1315client # [ 0.468869] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1316client # [ 0.468897] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1317client # [ 0.468907] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1318worker1 # [ 0.547682] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1319client # [ 0.468912] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1320worker2 # [ 0.525084] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1321client # [ 0.470129] pci 0000:00:0a.0: enabling device (0000 -> 0002)1322worker2 # [ 0.527446] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1323lb # [ 0.643433] loop: module loaded1324lb # [ 0.643665] virtio_blk virtio5: 1/0/0 default/read/poll queues1325lb # [ 0.644608] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1326worker1 # [ 0.558315] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1327worker1 # [ 0.560632] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1328worker2 # [ 0.539110] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1329worker1 # [ 0.572279] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1330worker2 # [ 0.545350] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1331lb # [ 0.654848] megasas: 07.734.00.00-rc11332worker2 # [ 0.547605] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1333lb # [ 0.655689] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1334lb # [ 0.657987] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001335lb # [ 0.658096] Intel/Sharp Extended Query Table at 0x00311336lb # [ 0.659878] Using buffer write method1337client # [ 0.529876] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1338lb # [ 0.659969] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1339lb # [ 0.661830] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001340lb # [ 0.661871] Intel/Sharp Extended Query Table at 0x00311341worker1 # [ 0.578105] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1342worker1 # [ 0.580608] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1343worker2 # [ 0.558240] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1344client # [ 0.536464] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1345client # [ 0.538680] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1346lb # [ 0.679729] Using buffer write method1347lb # [ 0.679790] Concatenating MTD devices:1348lb # [ 0.679794] (0): "0.flash"1349lb # [ 0.679798] (1): "0.flash"1350lb # [ 0.679802] into device "0.flash"1351worker2 # [ 0.564853] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1352worker2 # [ 0.567342] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1353worker1 # [ 0.598058] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1354client # [ 0.548605] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1355client # [ 0.550773] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1356worker1 # [ 0.600995] msm_serial: driver initialized1357worker1 # [ 0.601145] SuperH (H)SCI(F) driver initialized1358worker2 # [ 0.577666] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1359worker1 # [ 0.601198] STM32 USART driver initialized1360worker2 # [ 0.579867] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1361client # [ 0.562149] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1362worker2 # [ 0.592172] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1363client # [ 0.568443] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1364client # [ 0.570762] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1365worker2 # [ 0.605290] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1366client # [ 0.580839] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1367client # [ 0.582885] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1368worker2 # [ 0.608052] msm_serial: driver initialized1369worker2 # [ 0.608227] SuperH (H)SCI(F) driver initialized1370worker2 # [ 0.608283] STM32 USART driver initialized1371worker1 # [ 0.635675] loop: module loaded1372worker1 # [ 0.635890] virtio_blk virtio5: 1/0/0 default/read/poll queues1373worker1 # [ 0.638138] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1374client # [ 0.594549] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1375worker1 # [ 0.644911] megasas: 07.734.00.00-rc11376worker1 # [ 0.645775] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1377client # [ 0.611273] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1378worker1 # [ 0.658461] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001379client # [ 0.614240] msm_serial: driver initialized1380worker1 # [ 0.658499] Intel/Sharp Extended Query Table at 0x00311381client # [ 0.614405] SuperH (H)SCI(F) driver initialized1382worker1 # [ 0.660375] Using buffer write method1383client # [ 0.614458] STM32 USART driver initialized1384worker1 # [ 0.660460] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1385worker1 # [ 0.665798] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001386worker1 # [ 0.665834] Intel/Sharp Extended Query Table at 0x00311387worker1 # [ 0.667801] Using buffer write method1388worker1 # [ 0.667828] Concatenating MTD devices:1389worker1 # [ 0.667832] (0): "0.flash"1390worker1 # [ 0.667836] (1): "0.flash"1391worker1 # [ 0.667840] into device "0.flash"1392worker2 # [ 0.646489] loop: module loaded1393worker2 # [ 0.646743] virtio_blk virtio5: 1/0/0 default/read/poll queues1394worker2 # [ 0.647646] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1395worker2 # [ 0.661506] megasas: 07.734.00.00-rc11396worker2 # [ 0.662320] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1397worker2 # [ 0.664450] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001398worker2 # [ 0.664497] Intel/Sharp Extended Query Table at 0x00311399worker2 # [ 0.666354] Using buffer write method1400client # [ 0.649705] loop: module loaded1401worker2 # [ 0.666473] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1402client # [ 0.649947] virtio_blk virtio5: 1/0/0 default/read/poll queues1403worker2 # [ 0.668378] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001404client # [ 0.650828] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1405worker2 # [ 0.668429] Intel/Sharp Extended Query Table at 0x00311406worker2 # [ 0.689007] Using buffer write method1407worker2 # [ 0.689084] Concatenating MTD devices:1408worker2 # [ 0.689088] (0): "0.flash"1409worker2 # [ 0.689105] (1): "0.flash"1410client # [ 0.663169] megasas: 07.734.00.00-rc11411worker2 # [ 0.689109] into device "0.flash"1412client # [ 0.664140] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1413client # [ 0.666709] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001414client # [ 0.666744] Intel/Sharp Extended Query Table at 0x00311415client # [ 0.672186] Using buffer write method1416client # [ 0.672291] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1417client # [ 0.674374] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001418client # [ 0.674411] Intel/Sharp Extended Query Table at 0x00311419client # [ 0.688930] Using buffer write method1420client # [ 0.688980] Concatenating MTD devices:1421client # [ 0.688985] (0): "0.flash"1422client # [ 0.688989] (1): "0.flash"1423client # [ 0.688993] into device "0.flash"1424lb # [ 0.985486] Freeing initrd memory: 26140K1425lb # [ 0.991854] tun: Universal TUN/TAP device driver, 1.61426lb # [ 0.995909] thunder_xcv, ver 1.01427lb # [ 0.995963] thunder_bgx, ver 1.01428lb # [ 0.995987] nicpf, ver 1.01429lb # [ 0.996590] e1000: Intel(R) PRO/1000 Network Driver1430lb # [ 0.996600] e1000: Copyright (c) 1999-2006 Intel Corporation.1431lb # [ 0.996625] e1000e: Intel(R) PRO/1000 Network Driver1432lb # [ 0.996633] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1433lb # [ 0.996663] igb: Intel(R) Gigabit Ethernet Network Driver1434lb # [ 0.996669] igb: Copyright (c) 2007-2014 Intel Corporation.1435lb # [ 0.996696] igbvf: Intel(R) Gigabit Virtual Function Network Driver1436lb # [ 0.996703] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1437lb # [ 0.996842] sky2: driver version 1.301438lb # [ 1.005763] usbcore: registered new interface driver usb-storage1439lb # [ 1.005872] usbcore: registered new interface driver usbserial_generic1440lb # [ 1.005888] usbserial: USB Serial support registered for generic1441lb # [ 1.009114] ehci-pci 0000:00:0a.0: EHCI Host Controller1442lb # [ 1.009149] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11443lb # [ 1.009350] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001444lb # [ 1.012216] hv_vmbus: registering driver hyperv_keyboard1445lb # [ 1.013876] rtc-pl031 9010000.pl031: registered as rtc01446lb # [ 1.013911] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:31 UTC (1789911211)1447lb # [ 1.016023] i2c_dev: i2c /dev entries driver1448lb # [ 1.019524] sdhci: Secure Digital Host Controller Interface driver1449lb # [ 1.019539] sdhci: Copyright(c) Pierre Ossman1450lb # [ 1.019845] Synopsys Designware Multimedia Card Interface Driver1451lb # [ 1.020256] sdhci-pltfm: SDHCI platform and OF driver helper1452lb # [ 1.024824] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001453lb # [ 1.026307] hub 1-0:1.0: USB hub found1454lb # [ 1.026791] hub 1-0:1.0: 6 ports detected1455lb # [ 1.027674] hid: raw HID events driver (C) Jiri Kosina1456lb # [ 1.027964] usbcore: registered new interface driver usbhid1457lb # [ 1.027975] usbhid: USB HID core driver1458lb # [ 1.031045] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1459lb # [ 1.032724] drop_monitor: Initializing network drop monitor service1460lb # [ 1.032952] NET: Registered PF_INET6 protocol family1461lb # [ 1.036202] Segment Routing with IPv61462lb # [ 1.036226] In-situ OAM (IOAM) with IPv61463lb # [ 1.036266] NET: Registered PF_PACKET protocol family1464lb # [ 1.038072] 9pnet: Installing 9P2000 support1465lb # [ 1.040447] Key type dns_resolver registered1466lb # [ 1.047965] registered taskstats version 11467lb # [ 1.048132] Loading compiled-in X.509 certificates1468lb # [ 1.057308] Demotion targets for Node 0: null1469lb # [ 1.057435] Key type .fscrypt registered1470worker1 # [ 0.968718] Freeing initrd memory: 26148K1471lb # [ 1.057441] Key type fscrypt-provisioning registered1472lb # [ 1.057545] ima: No TPM chip found, activating TPM-bypass!1473lb # [ 1.057570] ima: Allocated hash algorithm: sha11474lb # [ 1.057592] ima: No architecture policies found1475lb # [ 1.061993] input: gpio-keys as /devices/platform/gpio-keys/input/input01476worker1 # [ 0.975001] tun: Universal TUN/TAP device driver, 1.61477worker1 # [ 0.978868] thunder_xcv, ver 1.01478worker1 # [ 0.978909] thunder_bgx, ver 1.01479worker1 # [ 0.978931] nicpf, ver 1.01480worker1 # [ 0.979488] e1000: Intel(R) PRO/1000 Network Driver1481worker1 # [ 0.979498] e1000: Copyright (c) 1999-2006 Intel Corporation.1482worker1 # [ 0.979523] e1000e: Intel(R) PRO/1000 Network Driver1483worker1 # [ 0.979531] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1484worker1 # [ 0.979560] igb: Intel(R) Gigabit Ethernet Network Driver1485worker1 # [ 0.979567] igb: Copyright (c) 2007-2014 Intel Corporation.1486worker1 # [ 0.979596] igbvf: Intel(R) Gigabit Virtual Function Network Driver1487worker1 # [ 0.979602] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1488worker1 # [ 0.979733] sky2: driver version 1.301489worker1 # [ 0.988441] usbcore: registered new interface driver usb-storage1490worker1 # [ 0.988559] usbcore: registered new interface driver usbserial_generic1491worker1 # [ 0.988576] usbserial: USB Serial support registered for generic1492worker1 # [ 0.991786] ehci-pci 0000:00:0a.0: EHCI Host Controller1493worker1 # [ 0.991818] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11494worker1 # [ 0.992064] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001495worker1 # [ 0.994961] hv_vmbus: registering driver hyperv_keyboard1496worker1 # [ 0.996506] rtc-pl031 9010000.pl031: registered as rtc01497worker1 # [ 0.996535] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:31 UTC (1789911211)1498worker1 # [ 0.998583] i2c_dev: i2c /dev entries driver1499lb # [ 1.088000] clk: Disabling unused clocks1500lb # [ 1.088043] PM: genpd: Disabling unused power domains1501lb # [ 1.092425] Freeing unused kernel memory: 4736K1502worker1 # [ 1.001875] sdhci: Secure Digital Host Controller Interface driver1503lb # [ 1.092643] Run /init as init process1504worker1 # [ 1.001886] sdhci: Copyright(c) Pierre Ossman1505worker1 # [ 1.002146] Synopsys Designware Multimedia Card Interface Driver1506worker1 # [ 1.002521] sdhci-pltfm: SDHCI platform and OF driver helper1507worker1 # [ 1.004311] hid: raw HID events driver (C) Jiri Kosina1508worker1 # [ 1.004599] usbcore: registered new interface driver usbhid1509worker1 # [ 1.004605] usbhid: USB HID core driver1510worker1 # [ 1.009380] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001511worker1 # [ 1.010433] hub 1-0:1.0: USB hub found1512worker1 # [ 1.010919] hub 1-0:1.0: 6 ports detected1513worker2 # [ 0.990378] Freeing initrd memory: 26148K1514worker1 # [ 1.012857] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1515worker1 # [ 1.014438] drop_monitor: Initializing network drop monitor service1516worker1 # [ 1.014631] NET: Registered PF_INET6 protocol family1517worker1 # [ 1.017871] Segment Routing with IPv61518worker1 # [ 1.017893] In-situ OAM (IOAM) with IPv61519worker1 # [ 1.017924] NET: Registered PF_PACKET protocol family1520lb # [ 1.108574] systemd[1]: Successfully made /usr/ read-only.1521worker1 # [ 1.019563] 9pnet: Installing 9P2000 support1522worker2 # [ 0.996781] tun: Universal TUN/TAP device driver, 1.61523worker1 # [ 1.022296] Key type dns_resolver registered1524worker2 # [ 1.000845] thunder_xcv, ver 1.01525worker2 # [ 1.000892] thunder_bgx, ver 1.01526worker2 # [ 1.000923] nicpf, ver 1.01527worker2 # [ 1.001519] e1000: Intel(R) PRO/1000 Network Driver1528worker2 # [ 1.001528] e1000: Copyright (c) 1999-2006 Intel Corporation.1529worker2 # [ 1.001558] e1000e: Intel(R) PRO/1000 Network Driver1530worker2 # [ 1.001566] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1531client # [ 0.985422] Freeing initrd memory: 26160K1532worker2 # [ 1.001597] igb: Intel(R) Gigabit Ethernet Network Driver1533worker1 # [ 1.028907] registered taskstats version 11534worker2 # [ 1.001602] igb: Copyright (c) 2007-2014 Intel Corporation.1535worker1 # [ 1.029105] Loading compiled-in X.509 certificates1536worker2 # [ 1.001629] igbvf: Intel(R) Gigabit Virtual Function Network Driver1537worker2 # [ 1.001635] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1538worker2 # [ 1.001774] sky2: driver version 1.301539worker2 # [ 1.003463] usbcore: registered new interface driver usb-storage1540worker2 # [ 1.003560] usbcore: registered new interface driver usbserial_generic1541worker2 # [ 1.003575] usbserial: USB Serial support registered for generic1542worker2 # [ 1.004175] hv_vmbus: registering driver hyperv_keyboard1543worker1 # [ 1.038096] Demotion targets for Node 0: null1544client # [ 0.991739] tun: Universal TUN/TAP device driver, 1.61545worker1 # [ 1.038218] Key type .fscrypt registered1546worker1 # [ 1.038227] Key type fscrypt-provisioning registered1547worker1 # [ 1.038325] ima: No TPM chip found, activating TPM-bypass!1548worker2 # [ 1.015970] ehci-pci 0000:00:0a.0: EHCI Host Controller1549worker1 # [ 1.038343] ima: Allocated hash algorithm: sha11550worker1 # [ 1.038369] ima: No architecture policies found1551worker2 # [ 1.016011] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11552worker2 # [ 1.016197] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001553worker1 # [ 1.042646] input: gpio-keys as /devices/platform/gpio-keys/input/input01554worker2 # [ 1.018856] rtc-pl031 9010000.pl031: registered as rtc01555worker2 # [ 1.018886] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:31 UTC (1789911211)1556worker2 # [ 1.019257] i2c_dev: i2c /dev entries driver1557client # [ 0.995681] thunder_xcv, ver 1.01558client # [ 0.995729] thunder_bgx, ver 1.01559client # [ 0.995751] nicpf, ver 1.01560client # [ 0.996304] e1000: Intel(R) PRO/1000 Network Driver1561client # [ 0.996311] e1000: Copyright (c) 1999-2006 Intel Corporation.1562worker2 # [ 1.024389] sdhci: Secure Digital Host Controller Interface driver1563client # [ 0.996338] e1000e: Intel(R) PRO/1000 Network Driver1564worker2 # [ 1.024405] sdhci: Copyright(c) Pierre Ossman1565client # [ 0.996346] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1566worker2 # [ 1.024662] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001567client # [ 0.996374] igb: Intel(R) Gigabit Ethernet Network Driver1568worker2 # [ 1.025056] hub 1-0:1.0: USB hub found1569worker2 # [ 1.025117] hub 1-0:1.0: 6 ports detected1570client # [ 0.996380] igb: Copyright (c) 2007-2014 Intel Corporation.1571client # [ 0.996402] igbvf: Intel(R) Gigabit Virtual Function Network Driver1572client # [ 0.996408] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1573client # [ 0.996558] sky2: driver version 1.301574client # [ 0.998207] usbcore: registered new interface driver usb-storage1575client # [ 0.998372] usbcore: registered new interface driver usbserial_generic1576client # [ 0.998386] usbserial: USB Serial support registered for generic1577worker2 # [ 1.028773] Synopsys Designware Multimedia Card Interface Driver1578client # [ 0.999794] ehci-pci 0000:00:0a.0: EHCI Host Controller1579worker2 # [ 1.029162] sdhci-pltfm: SDHCI platform and OF driver helper1580client # [ 0.999836] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11581worker2 # [ 1.031012] hid: raw HID events driver (C) Jiri Kosina1582client # [ 1.000086] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001583worker2 # [ 1.031282] usbcore: registered new interface driver usbhid1584worker2 # [ 1.031293] usbhid: USB HID core driver1585client # [ 1.012136] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001586client # [ 1.012516] hub 1-0:1.0: USB hub found1587client # [ 1.012539] hub 1-0:1.0: 6 ports detected1588client # [ 1.014690] hv_vmbus: registering driver hyperv_keyboard1589worker2 # [ 1.035903] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1590worker1 # [ 1.060838] clk: Disabling unused clocks1591worker2 # [ 1.037542] drop_monitor: Initializing network drop monitor service1592worker1 # [ 1.060870] PM: genpd: Disabling unused power domains1593worker2 # [ 1.037699] NET: Registered PF_INET6 protocol family1594client # [ 1.016375] rtc-pl031 9010000.pl031: registered as rtc01595worker2 # [ 1.040859] Segment Routing with IPv61596worker2 # [ 1.040901] In-situ OAM (IOAM) with IPv61597worker1 # [ 1.065266] Freeing unused kernel memory: 4736K1598client # [ 1.016411] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:31 UTC (1789911211)1599worker1 # [ 1.065454] Run /init as init process1600worker2 # [ 1.040956] NET: Registered PF_PACKET protocol family1601client # [ 1.016721] i2c_dev: i2c /dev entries driver1602worker2 # [ 1.042598] 9pnet: Installing 9P2000 support1603client # [ 1.021923] sdhci: Secure Digital Host Controller Interface driver1604client # [ 1.021940] sdhci: Copyright(c) Pierre Ossman1605client # [ 1.022205] Synopsys Designware Multimedia Card Interface Driver1606client # [ 1.022575] sdhci-pltfm: SDHCI platform and OF driver helper1607worker2 # [ 1.045354] Key type dns_resolver registered1608client # [ 1.027092] hid: raw HID events driver (C) Jiri Kosina1609client # [ 1.027373] usbcore: registered new interface driver usbhid1610worker2 # [ 1.052146] registered taskstats version 11611client # [ 1.027383] usbhid: USB HID core driver1612worker2 # [ 1.052303] Loading compiled-in X.509 certificates1613client # [ 1.030354] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1614client # [ 1.033098] drop_monitor: Initializing network drop monitor service1615client # [ 1.033295] NET: Registered PF_INET6 protocol family1616client # [ 1.035528] Segment Routing with IPv61617client # [ 1.035560] In-situ OAM (IOAM) with IPv61618worker1 # [ 1.083249] systemd[1]: Successfully made /usr/ read-only.1619client # [ 1.035601] NET: Registered PF_PACKET protocol family1620worker2 # [ 1.061239] Demotion targets for Node 0: null1621client # [ 1.037302] 9pnet: Installing 9P2000 support1622worker2 # [ 1.061372] Key type .fscrypt registered1623worker2 # [ 1.061379] Key type fscrypt-provisioning registered1624worker2 # [ 1.061486] ima: No TPM chip found, activating TPM-bypass!1625worker2 # [ 1.061509] ima: Allocated hash algorithm: sha11626worker2 # [ 1.061533] ima: No architecture policies found1627client # [ 1.040239] Key type dns_resolver registered1628worker2 # [ 1.066001] input: gpio-keys as /devices/platform/gpio-keys/input/input01629client # [ 1.046826] registered taskstats version 11630client # [ 1.047562] Loading compiled-in X.509 certificates1631client # [ 1.056069] Demotion targets for Node 0: null1632client # [ 1.056197] Key type .fscrypt registered1633client # [ 1.056204] Key type fscrypt-provisioning registered1634client # [ 1.056305] ima: No TPM chip found, activating TPM-bypass!1635client # [ 1.056324] ima: Allocated hash algorithm: sha11636client # [ 1.056348] ima: No architecture policies found1637client # [ 1.060565] input: gpio-keys as /devices/platform/gpio-keys/input/input01638worker2 # [ 1.084805] clk: Disabling unused clocks1639worker2 # [ 1.084837] PM: genpd: Disabling unused power domains1640worker2 # [ 1.089203] Freeing unused kernel memory: 4736K1641worker2 # [ 1.089403] Run /init as init process1642client # [ 1.080113] clk: Disabling unused clocks1643client # [ 1.080150] PM: genpd: Disabling unused power domains1644worker2 # [ 1.107520] systemd[1]: Successfully made /usr/ read-only.1645client # [ 1.084692] Freeing unused kernel memory: 4736K1646client # [ 1.084905] Run /init as init process1647client # [ 1.101948] systemd[1]: Successfully made /usr/ read-only.1648lb # [ 1.274122] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.256870] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker2 # [ 1.272695] usb 1-1: new high-speed USB device number 2 using ehci-pci1651client # [ 1.259044] usb 1-1: new high-speed USB device number 2 using ehci-pci1652lb # [ 1.428676] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653lb # [ 1.443708] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1654lb # [ 1.456251] systemd[1]: Detected virtualization qemu.1655lb # [ 1.458461] systemd[1]: Detected architecture arm64.1656lb # [ 1.460610] systemd[1]: Running in initrd.1657lb # [ 1.463385] systemd[1]: Initializing machine ID from random generator.1658lb # [ 1.466430] systemd[1]: Hostname set to <lb>.1659worker1 # [ 1.409575] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660worker1 # [ 1.418181] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1661worker1 # [ 1.430926] systemd[1]: Detected virtualization qemu.1662lb # [ 1.518393] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01663worker1 # [ 1.433241] systemd[1]: Detected architecture arm64.1664worker1 # [ 1.435183] systemd[1]: Running in initrd.1665worker1 # [ 1.437980] systemd[1]: Initializing machine ID from random generator.1666worker1 # [ 1.441069] systemd[1]: Hostname set to <worker1>.1667worker2 # [ 1.427148] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11668client # [ 1.415940] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11669worker2 # [ 1.442738] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1670worker2 # [ 1.455658] systemd[1]: Detected virtualization qemu.1671worker2 # [ 1.457906] systemd[1]: Detected architecture arm64.1672worker2 # [ 1.459888] systemd[1]: Running in initrd.1673client # [ 1.436845] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1674client # [ 1.441033] systemd[1]: Detected virtualization qemu.1675client # [ 1.441762] systemd[1]: Detected architecture arm64.1676client # [ 1.442465] systemd[1]: Running in initrd.1677worker2 # [ 1.463105] systemd[1]: Initializing machine ID from random generator.1678client # [ 1.443500] systemd[1]: Initializing machine ID from random generator.1679client # [ 1.444569] systemd[1]: Hostname set to <client>.1680worker2 # [ 1.466729] systemd[1]: Hostname set to <worker2>.1681worker1 # [ 1.501103] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682worker2 # [ 1.517159] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683lb # [ 1.642145] usb 1-2: new high-speed USB device number 3 using ehci-pci1684client # [ 1.507275] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01685worker1 # [ 1.624849] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker2 # [ 1.640759] usb 1-2: new high-speed USB device number 3 using ehci-pci1687client # [ 1.627116] usb 1-2: new high-speed USB device number 3 using ehci-pci1688lb # [ 1.788116] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689lb # [ 1.805425] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690lb # [ 1.805896] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691client # [ 1.706267] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692worker1 # [ 1.789674] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21693worker1 # [ 1.795019] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01694worker1 # [ 1.800304] systemd[1]: bpf-restrict-fs: LSM BPF program attached1695lb # [ 1.902357] systemd[1]: Queued start job for default target Initrd Default Target.1696lb # [ 1.912299] systemd[1]: Created slice Slice /system/modprobe.1697lb # [ 1.913351] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1698lb # [ 1.914448] systemd[1]: Expecting device /dev/disk/by-label/nixos...1699lb # [ 1.915283] systemd[1]: Reached target Path Units.1700lb # [ 1.915917] systemd[1]: Reached target Slice Units.1701lb # [ 1.916555] systemd[1]: Reached target Swaps.1702lb # [ 1.917165] systemd[1]: Reached target Timer Units.1703lb # [ 1.918000] systemd[1]: Listening on D-Bus System Message Bus Socket.1704lb # [ 1.919005] systemd[1]: Listening on Journal Socket (/dev/log).1705lb # [ 1.919907] systemd[1]: Listening on Journal Sockets.1706lb # [ 1.920718] systemd[1]: Listening on udev Control Socket.1707lb # [ 1.921587] systemd[1]: Listening on udev Kernel Socket.1708worker2 # [ 1.804663] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21709lb # [ 1.922481] systemd[1]: Reached target Socket Units.1710client # [ 1.785890] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21711lb # [ 1.924617] systemd[1]: Starting Create List of Static Device Nodes...1712client # [ 1.788965] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01713worker2 # [ 1.812779] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01714lb # [ 1.931202] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1715lb # [ 1.932227] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1716worker2 # [ 1.822067] systemd[1]: bpf-restrict-fs: LSM BPF program attached1717lb # [ 1.941972] systemd[1]: Mounting Kernel Configuration File System...1718client # [ 1.818154] systemd[1]: Queued start job for default target Initrd Default Target.1719lb # [ 1.954542] systemd[1]: Starting Journal Service...1720client # [ 1.830271] systemd[1]: Created slice Slice /system/modprobe.1721client # [ 1.831572] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1722client # [ 1.832896] systemd[1]: Expecting device /dev/disk/by-label/nixos...1723client # [ 1.833972] systemd[1]: Reached target Path Units.1724client # [ 1.834795] systemd[1]: Reached target Slice Units.1725client # [ 1.835704] systemd[1]: Reached target Swaps.1726client # [ 1.836453] systemd[1]: Reached target Timer Units.1727client # [ 1.837572] systemd[1]: Listening on D-Bus System Message Bus Socket.1728client # [ 1.838908] systemd[1]: Listening on Journal Socket (/dev/log).1729client # [ 1.840183] systemd[1]: Listening on Journal Sockets.1730lb # [ 1.978245] systemd[1]: Starting Load Kernel Modules...1731client # [ 1.840352] systemd[1]: Listening on udev Control Socket.1732client # [ 1.840488] systemd[1]: Listening on udev Kernel Socket.1733lb # [ 1.979159] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1734client # [ 1.840513] systemd[1]: Reached target Socket Units.1735client # [ 1.846051] systemd[1]: Starting Create List of Static Device Nodes...1736lb # [ 1.986360] systemd[1]: Starting Coldplug All udev Devices...1737client # [ 1.855230] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1738worker1 # [ 1.903757] systemd[1]: Queued start job for default target Initrd Default Target.1739client # [ 1.856493] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1740client # [ 1.863618] systemd[1]: Mounting Kernel Configuration File System...1741lb # [ 2.002166] systemd[1]: Finished Create List of Static Device Nodes.1742lb # [ 2.004183] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1743worker1 # [ 1.916252] systemd[1]: Created slice Slice /system/modprobe.1744worker1 # [ 1.917687] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1745worker1 # [ 1.918999] systemd[1]: Expecting device /dev/disk/by-label/nixos...1746worker1 # [ 1.920070] systemd[1]: Reached target Path Units.1747worker1 # [ 1.921071] systemd[1]: Reached target Slice Units.1748worker1 # [ 1.921890] systemd[1]: Reached target Swaps.1749worker1 # [ 1.922624] systemd[1]: Reached target Timer Units.1750lb # [ 2.010928] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1751lb # [ 2.012186] systemd[1]: Mounted Kernel Configuration File System.1752worker1 # [ 1.923658] systemd[1]: Listening on D-Bus System Message Bus Socket.1753worker1 # [ 1.924940] systemd[1]: Listening on Journal Socket (/dev/log).1754worker1 # [ 1.926057] systemd[1]: Listening on Journal Sockets.1755worker1 # [ 1.927030] systemd[1]: Listening on udev Control Socket.1756worker1 # [ 1.928035] systemd[1]: Listening on udev Kernel Socket.1757worker1 # [ 1.928970] systemd[1]: Reached target Socket Units.1758worker1 # [ 1.931550] systemd[1]: Starting Create List of Static Device Nodes...1759lb # [ 2.022609] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1760worker1 # [ 1.941031] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1761client # [ 1.895394] systemd[1]: Starting Journal Service...1762worker1 # [ 1.942213] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1763worker1 # [ 1.948373] systemd[1]: Mounting Kernel Configuration File System...1764client # [ 1.901682] systemd[1]: Starting Load Kernel Modules...1765client # [ 1.901821] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1766worker2 # [ 1.927062] systemd[1]: Queued start job for default target Initrd Default Target.1767client # [ 1.913583] systemd[1]: Starting Coldplug All udev Devices...1768lb # [ 2.049076] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1769worker2 # [ 1.940388] systemd[1]: Created slice Slice /system/modprobe.1770worker2 # [ 1.942087] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1771worker2 # [ 1.943801] systemd[1]: Expecting device /dev/disk/by-label/nixos...1772worker2 # [ 1.945047] systemd[1]: Reached target Path Units.1773worker2 # [ 1.945939] systemd[1]: Reached target Slice Units.1774worker2 # [ 1.946850] systemd[1]: Reached target Swaps.1775worker2 # [ 1.947669] systemd[1]: Reached target Timer Units.1776worker2 # [ 1.948872] systemd[1]: Listening on D-Bus System Message Bus Socket.1777client # [ 1.925908] systemd[1]: Finished Create List of Static Device Nodes.1778worker1 # [ 1.974389] systemd[1]: Starting Journal Service...1779worker2 # [ 1.950240] systemd[1]: Listening on Journal Socket (/dev/log).1780client # [ 1.926966] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1781lb # [ 2.063338] systemd-journald[73]: Collecting audit messages is disabled.1782worker2 # [ 1.951474] systemd[1]: Listening on Journal Sockets.1783worker2 # [ 1.952576] systemd[1]: Listening on udev Control Socket.1784worker2 # [ 1.953786] systemd[1]: Listening on udev Kernel Socket.1785worker2 # [ 1.954865] systemd[1]: Reached target Socket Units.1786worker2 # [ 1.957785] systemd[1]: Starting Create List of Static Device Nodes...1787worker1 # [ 1.984984] systemd[1]: Starting Load Kernel Modules...1788client # [ 1.935884] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1789client # [ 1.936526] systemd[1]: Mounted Kernel Configuration File System.1790worker1 # [ 1.985883] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1791worker2 # [ 1.968912] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1792worker2 # [ 1.970220] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1793client # [ 1.947837] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1794lb # [ 2.078165] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1795lb # [ 2.083233] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01796lb # [ 2.083485] [drm] features: -virgl +edid -resource_blob -host_visible1797lb # [ 2.083495] [drm] features: -context_init1798lb # [ 2.084277] [drm] number of scanouts: 11799lb # [ 2.084297] [drm] number of cap sets: 01800worker2 # [ 1.978075] systemd[1]: Mounting Kernel Configuration File System...1801worker1 # [ 2.001236] systemd[1]: Starting Coldplug All udev Devices...1802lb # [ 2.098742] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1803lb # [ 2.102448] systemd[1]: Starting Create Static Device Nodes in /dev...1804worker1 # [ 2.016995] systemd[1]: Finished Create List of Static Device Nodes.1805worker1 # [ 2.018881] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1806lb # [ 2.106509] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1807lb # [ 2.106537] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01808worker1 # [ 2.025818] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1809worker1 # [ 2.026233] systemd[1]: Mounted Kernel Configuration File System.1810worker2 # [ 2.008899] systemd[1]: Starting Journal Service...1811client # [ 1.984951] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1812client # [ 1.995872] systemd-journald[73]: Collecting audit messages is disabled.1813worker2 # [ 2.019673] systemd[1]: Starting Load Kernel Modules...1814worker1 # [ 2.040050] systemd-journald[73]: Collecting audit messages is disabled.1815worker2 # [ 2.020676] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1816worker1 # [ 2.044439] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1817client # [ 2.003075] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1818worker1 # [ 2.049071] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1819worker2 # [ 2.030299] systemd[1]: Starting Coldplug All udev Devices...1820worker1 # [ 2.057429] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1821lb # [ 2.138805] Console: switching to colour frame buffer device 160x501822client # [ 2.019217] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01823client # [ 2.019509] [drm] features: -virgl +edid -resource_blob -host_visible1824worker1 # [ 2.065229] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01825client # [ 2.019526] [drm] features: -context_init1826worker1 # [ 2.065487] [drm] features: -virgl +edid -resource_blob -host_visible1827client # [ 2.020405] [drm] number of scanouts: 11828worker1 # [ 2.065498] [drm] features: -context_init1829client # [ 2.020430] [drm] number of cap sets: 01830worker1 # [ 2.066253] [drm] number of scanouts: 11831worker1 # [ 2.066270] [drm] number of cap sets: 01832worker2 # [ 2.048884] systemd[1]: Finished Create List of Static Device Nodes.1833client # [ 2.027952] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1834worker2 # [ 2.049952] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1835worker2 # [ 2.050287] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1836worker2 # [ 2.050593] systemd[1]: Mounted Kernel Configuration File System.1837lb # [ 2.170745] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1838worker2 # [ 2.065211] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1839lb # [ 2.175187] systemd[1]: Finished Create Static Device Nodes in /dev.1840client # [ 2.039637] systemd[1]: Starting Create Static Device Nodes in /dev...1841lb # [ 2.175618] systemd[1]: Reached target Preparation for Local File Systems.1842lb # [ 2.175657] systemd[1]: Reached target Local File Systems.1843lb # [ 2.182238] systemd[1]: Starting Rule-based Manager for Device Events and Files...1844client # [ 2.044612] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1845client # [ 2.044644] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01846worker1 # [ 2.093226] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1847worker1 # [ 2.093257] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01848worker1 # [ 2.105585] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1849lb # [ 2.198195] systemd[1]: Finished Load Kernel Modules.1850worker2 # [ 2.095405] systemd-journald[73]: Collecting audit messages is disabled.1851worker1 # [ 2.117272] systemd[1]: Starting Create Static Device Nodes in /dev...1852client # [ 2.068796] Console: switching to colour frame buffer device 160x501853lb # [ 2.210516] systemd[1]: Starting Apply Kernel Variables...1854worker1 # [ 2.129338] Console: switching to colour frame buffer device 160x501855worker1 # [ 2.129987] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1856worker2 # [ 2.112080] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1857client # [ 2.103730] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1858worker1 # [ 2.153838] systemd[1]: Finished Load Kernel Modules.1859client # [ 2.107881] systemd[1]: Finished Create Static Device Nodes in /dev.1860worker2 # [ 2.124710] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1861client # [ 2.108174] systemd[1]: Reached target Preparation for Local File Systems.1862worker2 # [ 2.129880] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01863worker1 # [ 2.157327] systemd[1]: Starting Apply Kernel Variables...1864client # [ 2.108216] systemd[1]: Reached target Local File Systems.1865worker2 # [ 2.130142] [drm] features: -virgl +edid -resource_blob -host_visible1866worker2 # [ 2.130154] [drm] features: -context_init1867worker2 # [ 2.130926] [drm] number of scanouts: 11868worker2 # [ 2.130947] [drm] number of cap sets: 01869client # [ 2.115599] systemd[1]: Starting Rule-based Manager for Device Events and Files...1870lb # [ 2.249957] systemd[1]: Started Journal Service.1871worker2 # [ 2.149511] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1872worker2 # [ 2.152536] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1873worker2 # [ 2.152570] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01874lb # [ 2.248446] systemd-modules-load[74]: Inserted module 'dm_mod'1875worker2 # [ 2.161243] systemd[1]: Starting Create Static Device Nodes in /dev...1876lb # [ 2.252424] systemd-modules-load[74]: Module 'virtio_balloon' is built in1877lb # [ 2.253569] systemd-modules-load[74]: Module 'virtio_console' is built in1878lb # [ 2.254689] systemd-modules-load[74]: Inserted module 'virtio_gpu'1879worker1 # [ 2.185563] systemd[1]: Finished Create Static Device Nodes in /dev.1880lb # [ 2.255725] systemd-modules-load[74]: Module 'virtio_rng' is built in1881worker1 # [ 2.186039] systemd[1]: Reached target Preparation for Local File Systems.1882worker1 # [ 2.186082] systemd[1]: Reached target Local File Systems.1883worker1 # [ 2.191835] systemd[1]: Starting Rule-based Manager for Device Events and Files...1884client # [ 2.147183] systemd[1]: Finished Load Kernel Modules.1885lb # [ 2.267453] systemd[1]: Starting Create System Files and Directories...1886client # [ 2.156797] systemd[1]: Starting Apply Kernel Variables...1887lb # [ 2.278290] systemd[1]: Finished Apply Kernel Variables.1888worker2 # [ 2.189065] Console: switching to colour frame buffer device 160x501889worker2 # [ 2.195983] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1890worker1 # [ 2.233155] systemd[1]: Finished Apply Kernel Variables.1891lb # [ 2.305405] systemd[1]: Finished Create System Files and Directories.1892lb # [ 2.308771] systemd-udevd[79]: Using default interface naming scheme 'v261'.1893worker2 # [ 2.222403] systemd[1]: Finished Create Static Device Nodes in /dev.1894worker2 # [ 2.222889] systemd[1]: Reached target Preparation for Local File Systems.1895worker2 # [ 2.222970] systemd[1]: Reached target Local File Systems.1896worker1 # [ 2.252972] systemd[1]: Started Journal Service.1897client # [ 2.194353] systemd-modules-load[74]: Inserted module 'dm_mod'1898worker1 # [ 2.240806] systemd-modules-load[74]: Inserted module 'dm_mod'1899worker2 # [ 2.233233] systemd[1]: Starting Rule-based Manager for Device Events and Files...1900client # [ 2.210648] systemd[1]: Started Journal Service.1901client # [ 2.200365] systemd-modules-load[74]: Module 'virtio_balloon' is built in1902worker1 # [ 2.252147] systemd-modules-load[74]: Module 'virtio_balloon' is built in1903worker1 # [ 2.253372] systemd-modules-load[74]: Module 'virtio_console' is built in1904client # [ 2.208399] systemd-modules-load[74]: Module 'virtio_console' is built in1905worker1 # [ 2.256345] systemd-modules-load[74]: Inserted module 'virtio_gpu'1906lb # [ 2.341679] systemd[1]: Started Rule-based Manager for Device Events and Files.1907client # [ 2.216599] systemd-modules-load[74]: Inserted module 'virtio_gpu'1908worker2 # [ 2.252790] systemd[1]: Finished Load Kernel Modules.1909client # [ 2.217784] systemd-modules-load[74]: Module 'virtio_rng' is built in1910client # [ 2.218865] systemd[1]: Starting Create System Files and Directories...1911worker1 # [ 2.264350] systemd-modules-load[74]: Module 'virtio_rng' is built in1912worker2 # [ 2.256721] systemd[1]: Starting Apply Kernel Variables...1913worker1 # [ 2.267284] systemd[1]: Starting Create System Files and Directories...1914client # [ 2.232397] systemd-udevd[79]: Using default interface naming scheme 'v261'.1915client # [ 2.237473] systemd[1]: Finished Apply Kernel Variables.1916worker1 # [ 2.288917] systemd-udevd[81]: Using default interface naming scheme 'v261'.1917worker2 # [ 2.295442] systemd[1]: Started Journal Service.1918worker1 # [ 2.306689] systemd[1]: Finished Create System Files and Directories.1919client # [ 2.269735] systemd[1]: Finished Create System Files and Directories.1920worker2 # [ 2.292459] systemd-modules-load[74]: Inserted module 'dm_mod'1921worker2 # [ 2.296490] systemd-modules-load[74]: Module 'virtio_balloon' is built in1922worker2 # [ 2.297640] systemd-modules-load[74]: Module 'virtio_console' is built in1923worker2 # [ 2.298782] systemd-modules-load[74]: Inserted module 'virtio_gpu'1924worker2 # [ 2.299812] systemd-modules-load[74]: Module 'virtio_rng' is built in1925lb # [ 2.412149] systemd[1]: Starting Virtual Console Setup...1926client # [ 2.286699] systemd[1]: Started Rule-based Manager for Device Events and Files.1927worker1 # [ 2.333392] systemd[1]: Started Rule-based Manager for Device Events and Files.1928worker2 # [ 2.315156] systemd[1]: Starting Create System Files and Directories...1929worker2 # [ 2.330274] systemd[1]: Finished Apply Kernel Variables.1930worker2 # [ 2.357620] systemd[1]: Finished Create System Files and Directories.1931lb # [ 2.464573] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1932lb # [ 2.468497] systemd[1]: Finished Virtual Console Setup.1933worker2 # [ 2.364538] systemd-udevd[79]: Using default interface naming scheme 'v261'.1934worker1 # [ 2.394383] systemd[1]: Starting Virtual Console Setup...1935client # [ 2.360165] systemd[1]: Starting Virtual Console Setup...1936worker2 # [ 2.393511] systemd[1]: Started Rule-based Manager for Device Events and Files.1937worker1 # [ 2.452622] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1938worker1 # [ 2.456349] systemd[1]: Finished Virtual Console Setup.1939client # [ 2.420690] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940client # [ 2.423867] systemd[1]: Finished Virtual Console Setup.1941worker2 # [ 2.464146] systemd[1]: Starting Virtual Console Setup...1942worker2 # [ 2.520598] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1943worker2 # [ 2.524141] systemd[1]: Finished Virtual Console Setup.1944lb # [ 3.097834] systemd[1]: Finished Coldplug All udev Devices.1945lb # [ 3.098780] systemd[1]: Reached target System Initialization.1946lb # [ 3.099614] systemd[1]: Reached target Basic System.1947worker1 # [ 3.089061] systemd[1]: Finished Coldplug All udev Devices.1948client # [ 3.044502] systemd[1]: Finished Coldplug All udev Devices.1949worker1 # [ 3.090679] systemd[1]: Reached target System Initialization.1950worker1 # [ 3.091491] systemd[1]: Reached target Basic System.1951client # [ 3.048805] systemd[1]: Reached target System Initialization.1952client # [ 3.049711] systemd[1]: Reached target Basic System.1953worker2 # [ 3.129925] systemd[1]: Finished Coldplug All udev Devices.1954worker2 # [ 3.132820] systemd[1]: Reached target System Initialization.1955lb # [ 3.240691] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1956worker2 # [ 3.136135] systemd[1]: Reached target Basic System.1957lb # [ 3.278544] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958lb # [ 3.284303] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1959client # [ 3.200340] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1960worker1 # [ 3.254348] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1961worker1 # [ 3.259213] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1962worker1 # [ 3.277531] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1963client # [ 3.236376] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1964worker2 # [ 3.260168] (udev-worker)[107]: Network interface NamePolicy= disabled on kernel command line.1965lb # [ 3.372135] systemd[1]: Found device /dev/disk/by-label/nixos.1966client # [ 3.245229] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1967lb # [ 3.377868] systemd[1]: Reached target Initrd Root Device.1968lb # [ 3.383408] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1969worker1 # [ 3.338196] systemd[1]: Found device /dev/disk/by-label/nixos.1970worker1 # [ 3.344623] systemd[1]: Reached target Initrd Root Device.1971worker2 # [ 3.322712] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1972worker1 # [ 3.350427] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1973client # [ 3.305957] systemd[1]: Found device /dev/disk/by-label/nixos.1974worker2 # [ 3.327671] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1975lb # [ 3.438566] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1976client # [ 3.311527] systemd[1]: Reached target Initrd Root Device.1977client # [ 3.316112] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1978lb # [ 3.447862] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1979lb # [ 3.452147] systemd[1]: Mounting /sysroot...1980worker1 # [ 3.405783] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1981worker2 # [ 3.383577] systemd[1]: Found device /dev/disk/by-label/nixos.1982worker2 # [ 3.387218] systemd[1]: Reached target Initrd Root Device.1983worker1 # [ 3.411740] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1984lb # [ 3.514847] EXT4-fs (vda): mounted filesystem 484e8737-2bf0-4fca-aa9f-27b5d66e82a9 r/w with ordered data mode. Quota mode: none.1985worker1 # [ 3.416202] systemd[1]: Mounting /sysroot...1986worker2 # [ 3.393243] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1987lb # [ 3.501094] systemd[1]: Mounted /sysroot.1988lb # [ 3.502645] systemd[1]: Reached target Initrd Root File System.1989client # [ 3.376857] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1990lb # [ 3.508444] systemd[1]: Starting Mountpoints Configured in the Real Root...1991client # [ 3.382644] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1992client # [ 3.387066] systemd[1]: Mounting /sysroot...1993worker1 # [ 3.472139] EXT4-fs (vda): mounted filesystem c984beb8-4ed6-43a2-b125-8614558ba7c0 r/w with ordered data mode. Quota mode: none.1994lb # [ 3.540456] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1995worker1 # [ 3.461844] systemd[1]: Mounted /sysroot.1996worker1 # [ 3.464827] systemd[1]: Reached target Initrd Root File System.1997lb # [ 3.547916] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1998lb # [ 3.552303] systemd[1]: Reloading...1999worker1 # [ 3.469210] systemd[1]: Starting Mountpoints Configured in the Real Root...2000worker2 # [ 3.447082] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks
loading 1,387 hidden lines…
3388lb # [ 15.769216] dhcpcd[670]: eth0: adding route to fec0::/643389lb # [ 15.770024] dhcpcd[670]: eth0: adding default route via fe80::23390lb # [ 15.775689] systemd[1]: Starting Virtual Console Setup...3391lb # [ 15.801331] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3392lb # [ 15.804873] systemd[1]: Stopped Virtual Console Setup.3393lb # [ 15.831185] systemd[1]: Starting Virtual Console Setup...3394client # [ 15.734915] dhcpcd[546]: eth0: soliciting an IPv6 router3395client # [ 15.738508] dhcpcd[546]: eth0: Router Advertisement from fe80::23396client # [ 15.741320] dhcpcd[546]: eth0: adding address fec0::5054:ff:fe12:3456/643397client # [ 15.744189] dhcpcd[546]: eth0: adding route to fec0::/643398client # [ 15.746417] dhcpcd[546]: eth0: adding default route via fe80::23399client # [ 15.793240] dhcpcd[546]: eth0: soliciting a DHCP lease3400client # [ 15.797047] dhcpcd[546]: eth0: offered 10.0.2.15 from 10.0.2.23401client # [ 15.800474] dhcpcd[546]: eth0: probing address 10.0.2.15/243402lb # [ 15.996778] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3403lb # [ 16.083579] systemd-logind[530]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3404lb # [ 16.353206] systemd-vconsole-setup[777]: Configuration of first virtual console was skipped, ignoring remaining ones.3405lb # [ 16.361713] systemd[1]: Finished Virtual Console Setup.3406lb # [ 16.570055] postgresql-pre-start[705]: selecting default time zone ... UTC3407lb # [ 16.574555] postgresql-pre-start[705]: creating configuration files ... ok3408lb # [ 16.858791] postgresql-pre-start[705]: running bootstrap script ... ok3409lb # [ 17.544224] postgresql-pre-start[705]: performing post-bootstrap initialization ... ok3410lb # [ 17.710687] postgresql-pre-start[705]: syncing data to disk ... ok3411lb # [ 17.712845] postgresql-pre-start[705]: initdb: warning: enabling "trust" authentication for local connections3412lb # [ 17.714274] postgresql-pre-start[705]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3413lb # [ 17.716561] postgresql-pre-start[705]: Success. You can now start the database server using:3414lb # [ 17.717731] postgresql-pre-start[705]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3415lb # [ 17.846632] postgres[821]: [821] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3416lb # [ 17.851156] postgres[821]: [821] LOG: listening on IPv6 address "::1", port 54323417lb # [ 17.852498] postgres[821]: [821] LOG: listening on IPv4 address "127.0.0.1", port 54323418lb # [ 17.854215] postgres[821]: [821] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3419lb # [ 17.868509] postgres[830]: [830] LOG: database system was shut down at 2026-09-20 13:33:48 GMT3420lb # [ 17.875869] postgres[821]: [821] LOG: database system is ready to accept connections3421lb # [ 17.881564] systemd[1]: Started PostgreSQL Server.3422lb # [ 17.890980] systemd[1]: Starting PostgreSQL Setup Scripts...3423lb # [ 18.146496] postgresql-setup-start[841]: CREATE DATABASE3424lb # [ 18.203805] postgresql-setup-start[846]: CREATE ROLE3425lb # [ 18.231234] postgresql-setup-start[848]: ALTER DATABASE3426lb # [ 18.239179] systemd[1]: Finished PostgreSQL Setup Scripts.3427lb # [ 18.241174] systemd[1]: Reached target PostgreSQL.3428worker1 # [ 18.210326] dhcpcd[632]: eth0: leased 10.0.2.15 for 86400 seconds3429worker1 # [ 18.213955] dhcpcd[632]: eth0: adding route to 10.0.2.0/243430worker1 # [ 18.217294] dhcpcd[632]: eth0: adding default route via 10.0.2.23431worker1 # [ 18.374476] systemd[1]: Started DHCP Client.3432worker1 # [ 18.376724] systemd[1]: Reached target Multi-User System.3433worker1 # [ 18.377535] systemd[1]: Startup finished in 1.053s (kernel) + 4.695s (initrd) + 12.627s (userspace) = 18.376s.3434lb # [ 18.644618] dhcpcd[670]: eth0: leased 10.0.2.15 for 86400 seconds3435lb # [ 18.647364] dhcpcd[670]: eth0: adding route to 10.0.2.0/243436lb # [ 18.650544] dhcpcd[670]: eth0: adding default route via 10.0.2.23437lb # [ 18.813326] systemd[1]: Started DHCP Client.3438lb # [ 18.815320] systemd[1]: Reached target Network is Online.3439lb # [ 18.820568] systemd[1]: Started Envoy reverse proxy.3440lb # [ 18.829067] systemd[1]: Started mock-oidc.service.3441lb # [ 18.928605] mock-oidc-server[916]: Mock OIDC Server running3442lb # [ 18.930927] mock-oidc-server[916]: OIDC Address: 192.168.1.2:80803443lb # [ 18.932628] mock-oidc-server[916]: Issue Address: 0.0.0.0:80813444lb # [ 18.933658] mock-oidc-server[916]: Issuer: http://192.168.1.2:8080/oidc3445lb # [ 18.934925] mock-oidc-server[916]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3446lb # [ 18.936509] mock-oidc-server[916]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3447lb # [ 18.938120] mock-oidc-server[916]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3448lb # [ 19.636232] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3449lb # [ 19.636411] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:469] statically linked extensions:3450lb # [ 19.636450] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3451lb # [ 19.636483] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3452lb # [ 19.636529] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3453lb # [ 19.636563] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3454lb # [ 19.636596] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3455lb # [ 19.636628] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3456lb # [ 19.636660] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3457lb # [ 19.636741] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3458lb # [ 19.702019] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3459lb # [ 19.715980] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3460lb # [ 19.718727] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3461lb # [ 19.723578] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3462lb # [ 19.729596] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3463lb # [ 19.737483] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3464lb # [ 19.741606] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3465lb # [ 19.743870] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3466lb # [ 19.748526] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3467lb # [ 19.751957] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3468lb # [ 19.753946] envoy[915]: [2026-09-20 13:33:50.142][915][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3469lb # [ 19.760889] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3470lb # [ 19.764556] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3471lb # [ 19.771966] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23472lb # [ 19.779182] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3473lb # [ 19.791117] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3474lb # [ 19.795500] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3475lb # [ 19.805297] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3476lb # [ 19.807616] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3477lb # [ 19.810654] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3478lb # [ 19.813387] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3479lb # [ 19.815460] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3480lb # [ 19.820347] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3481lb # [ 19.823816] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3482lb # [ 19.829680] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3483lb # [ 19.832812] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23484lb # [ 19.834619] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3485lb # [ 19.836659] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13486lb # [ 19.839042] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3487lb # [ 19.842600] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3488lb # [ 19.846384] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3489lb # [ 19.848796] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3490lb # [ 19.850931] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3491lb # [ 19.853518] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3492lb # [ 19.856100] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3493lb # [ 19.858004] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3494lb # [ 19.861270] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3495lb # [ 19.863586] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3496lb # [ 19.868789] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3497lb # [ 19.873008] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3498lb # [ 19.876511] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3499lb # [ 19.878451] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3500lb # [ 19.880990] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3501lb # [ 19.896412] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3502lb # [ 19.905179] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3503lb # [ 19.908487] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3504lb # [ 19.910364] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3505lb # [ 19.913523] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3506lb # [ 19.915655] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3507lb # [ 19.918187] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3508lb # [ 19.925421] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3509lb # [ 19.927284] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3510lb # [ 19.935432] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3511lb # [ 19.940803] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3512lb # [ 19.943582] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3513lb # [ 19.946257] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3514lb # [ 19.949630] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3515lb # [ 19.957463] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3516lb # [ 19.960077] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3517lb # [ 19.966250] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3518lb # [ 19.969008] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3519lb # [ 19.974233] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3520lb # [ 19.977442] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3521lb # [ 19.979291] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3522lb # [ 19.991302] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3523lb # [ 19.993495] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3524lb # [ 19.995520] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3525lb # [ 19.997836] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3526lb # [ 20.001265] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3527lb # [ 20.003120] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3528lb # [ 20.005753] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3529lb # [ 20.008679] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3530lb # [ 20.011285] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3531lb # [ 20.013601] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3532lb # [ 20.016085] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23533lb # [ 20.018558] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3534lb # [ 20.020794] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3535lb # [ 20.023278] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3536lb # [ 20.026036] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3537lb # [ 20.029836] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3538lb # [ 20.031863] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3539lb # [ 20.034189] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3540lb # [ 20.037308] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3541lb # [ 20.040547] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3542lb # [ 20.043207] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3543lb # [ 20.045722] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3544lb # [ 20.048860] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3545lb # [ 20.051706] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83546lb # [ 20.054200] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3547lb # [ 20.057090] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3548lb # [ 20.062544] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3549lb # [ 20.065550] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3550lb # [ 20.067905] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3551lb # [ 20.069795] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3552lb # [ 20.081697] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3553lb # [ 20.092140] envoy[915]: [2026-09-20 13:33:50.143][915][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3554lb # [ 20.094123] envoy[915]: [2026-09-20 13:33:50.207][915][info][main] [source/server/server.cc:531] HTTP header map info:3555lb # [ 20.095843] envoy[915]: [2026-09-20 13:33:50.223][915][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3556lb # [ 20.113033] envoy[915]: [2026-09-20 13:33:50.223][915][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3557lb # [ 20.114649] envoy[915]: [2026-09-20 13:33:50.223][915][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3558lb # [ 20.124091] envoy[915]: [2026-09-20 13:33:50.223][915][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3559lb # [ 20.125965] envoy[915]: [2026-09-20 13:33:50.361][915][info][main] [source/server/server.cc:968] runtime: {}3560lb # [ 20.127405] envoy[915]: [2026-09-20 13:33:50.384][915][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3561lb # [ 20.129309] envoy[915]: [2026-09-20 13:33:50.384][915][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013562lb # [ 20.131027] envoy[915]: [2026-09-20 13:33:50.384][915][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013563lb # [ 20.132821] envoy[915]: [2026-09-20 13:33:50.403][915][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3564lb # [ 20.134524] envoy[915]: [2026-09-20 13:33:50.403][915][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3565lb # [ 20.136295] envoy[915]: [2026-09-20 13:33:50.403][915][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3566lb # [ 20.142375] envoy[915]: [2026-09-20 13:33:50.650][915][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3567lb # [ 20.153812] envoy[915]: [2026-09-20 13:33:50.661][915][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3568worker1 # [ 20.072404] systemd[1]: Starting Nix worker-protocol over gRPC...3569lb # [ 20.156625] envoy[915]: [2026-09-20 13:33:50.664][915][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3570lb # [ 20.160187] envoy[915]: [2026-09-20 13:33:50.664][915][info][main] [source/server/server.cc:1077] starting main dispatch loop3571worker1 # [ 20.317359] nix-grpc-daemon[777]: ts=2026-09-20T13:33:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3572worker1 # [ 20.330110] nix-grpc-daemon[777]: ts=2026-09-20T13:33:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3573worker1 # [ 20.332542] nix-grpc-daemon[777]: ts=2026-09-20T13:33:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13574worker1 # [ 20.377865] nix-grpc-daemon[777]: ts=2026-09-20T13:33:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3575worker1 # [ 20.379728] systemd[1]: Started Nix worker-protocol over gRPC.3576worker1 # [ 20.410182] nix-grpc-daemon[777]: ts=2026-09-20T13:33:50Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3577lb # [ 20.497681] envoy[915]: [2026-09-20 13:33:51.005][915][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3578lb # [ 20.504675] envoy[915]: [2026-09-20 13:33:51.005][915][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3579lb # [ 20.511892] envoy[915]: [2026-09-20 13:33:51.005][915][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3580lb # [ 20.519477] envoy[915]: [2026-09-20 13:33:51.005][915][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3581client # [ 20.486407] dhcpcd[546]: eth0: leased 10.0.2.15 for 86400 seconds3582worker1 # [ 20.610837] nix-grpc-daemon[777]: ts=2026-09-20T13:33:51Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3583client # [ 20.489938] dhcpcd[546]: eth0: adding route to 10.0.2.0/243584client # [ 20.490107] dhcpcd[546]: eth0: adding default route via 10.0.2.23585client # [ 20.650887] systemd[1]: Started DHCP Client.3586client # [ 20.654577] systemd[1]: Reached target Multi-User System.3587client # [ 20.655423] systemd[1]: Startup finished in 1.074s (kernel) + 5.497s (initrd) + 14.081s (userspace) = 20.654s.3588worker2 # [ 20.753205] dhcpcd[646]: eth0: leased 10.0.2.15 for 86400 seconds3589worker2 # [ 20.756885] dhcpcd[646]: eth0: adding route to 10.0.2.0/243590worker2 # [ 20.759800] dhcpcd[646]: eth0: adding default route via 10.0.2.23591worker2 # [ 20.925091] systemd[1]: Started DHCP Client.3592worker2 # [ 20.928536] systemd[1]: Reached target Multi-User System.3593worker2 # [ 20.929441] systemd[1]: Reached target Network is Online.3594worker2 # [ 20.933145] systemd[1]: Starting scheduler-token.service...3595worker1 # [ 21.011728] nix-grpc-daemon[777]: ts=2026-09-20T13:33:51Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3596worker2 # [ 21.036087] systemd[1]: scheduler-token.service: Deactivated successfully.3597worker2 # [ 21.038523] systemd[1]: Finished scheduler-token.service.3598worker2 # [ 21.039344] systemd[1]: scheduler-token.service: Consumed 29ms CPU time over 104ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3599worker2 # [ 21.045612] systemd[1]: Starting Nix worker-protocol over gRPC...3600worker2 # [ 21.257306] nix-grpc-daemon[778]: ts=2026-09-20T13:33:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3601worker2 # [ 21.269663] nix-grpc-daemon[778]: ts=2026-09-20T13:33:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3602worker2 # [ 21.272128] nix-grpc-daemon[778]: ts=2026-09-20T13:33:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13603worker2 # [ 21.320133] nix-grpc-daemon[778]: ts=2026-09-20T13:33:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3604worker2 # [ 21.326585] systemd[1]: Started Nix worker-protocol over gRPC.3605worker2 # [ 21.327914] systemd[1]: Startup finished in 1.077s (kernel) + 5.615s (initrd) + 14.629s (userspace) = 21.322s.3606worker2 # [ 21.362984] nix-grpc-daemon[778]: ts=2026-09-20T13:33:51Z level=info event=scheduler_connected addr=lb:500513607worker2 # [ 21.366520] nix-grpc-daemon[778]: ts=2026-09-20T13:33:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3608worker2 # [ 21.567525] nix-grpc-daemon[778]: ts=2026-09-20T13:33:52Z level=info event=scheduler_connected addr=lb:500513609worker2 # [ 21.569632] nix-grpc-daemon[778]: ts=2026-09-20T13:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3610worker2 # [ 21.771351] nix-grpc-daemon[778]: ts=2026-09-20T13:33:52Z level=info event=scheduler_connected addr=lb:500513611worker2 # [ 21.777150] nix-grpc-daemon[778]: ts=2026-09-20T13:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3612worker1 # [ 21.815168] nix-grpc-daemon[777]: ts=2026-09-20T13:33:52Z level=info event=scheduler_connected addr=lb:500513613worker1 # [ 21.815544] nix-grpc-daemon[777]: ts=2026-09-20T13:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3614worker2 # [ 21.978466] nix-grpc-daemon[778]: ts=2026-09-20T13:33:52Z level=info event=scheduler_connected addr=lb:500513615worker2 # [ 21.984229] nix-grpc-daemon[778]: ts=2026-09-20T13:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3616worker1 # [ 22.015944] nix-grpc-daemon[777]: ts=2026-09-20T13:33:52Z level=info event=scheduler_connected addr=lb:500513617worker1 # [ 22.021733] nix-grpc-daemon[777]: ts=2026-09-20T13:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3618worker2 # [ 22.185657] nix-grpc-daemon[778]: ts=2026-09-20T13:33:52Z level=info event=scheduler_connected addr=lb:500513619worker2 # [ 22.191182] nix-grpc-daemon[778]: ts=2026-09-20T13:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3620worker1 # [ 22.222744] nix-grpc-daemon[777]: ts=2026-09-20T13:33:52Z level=info event=scheduler_connected addr=lb:500513621worker1 # [ 22.227462] nix-grpc-daemon[777]: ts=2026-09-20T13:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3622worker2 # [ 22.394334] nix-grpc-daemon[778]: ts=2026-09-20T13:33:52Z level=info event=scheduler_connected addr=lb:500513623worker2 # [ 22.398609] nix-grpc-daemon[778]: ts=2026-09-20T13:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3624worker1 # [ 22.428342] nix-grpc-daemon[777]: ts=2026-09-20T13:33:52Z level=info event=scheduler_connected addr=lb:500513625worker1 # [ 22.433642] nix-grpc-daemon[777]: ts=2026-09-20T13:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3626worker2 # [ 22.595512] nix-grpc-daemon[778]: ts=2026-09-20T13:33:53Z level=info event=scheduler_connected addr=lb:500513627worker2 # [ 22.601193] nix-grpc-daemon[778]: ts=2026-09-20T13:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3628worker1 # [ 22.634700] nix-grpc-daemon[777]: ts=2026-09-20T13:33:53Z level=info event=scheduler_connected addr=lb:500513629worker1 # [ 22.641305] nix-grpc-daemon[777]: ts=2026-09-20T13:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3630worker2 # [ 22.802443] nix-grpc-daemon[778]: ts=2026-09-20T13:33:53Z level=info event=scheduler_connected addr=lb:500513631worker2 # [ 22.808095] nix-grpc-daemon[778]: ts=2026-09-20T13:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3632worker1 # [ 22.843710] nix-grpc-daemon[777]: ts=2026-09-20T13:33:53Z level=info event=scheduler_connected addr=lb:500513633worker1 # [ 22.847321] nix-grpc-daemon[777]: ts=2026-09-20T13:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3634worker2 # [ 23.010997] nix-grpc-daemon[778]: ts=2026-09-20T13:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker1 # [ 23.044470] nix-grpc-daemon[777]: ts=2026-09-20T13:33:53Z level=info event=scheduler_connected addr=lb:500513636worker1 # [ 23.047769] nix-grpc-daemon[777]: ts=2026-09-20T13:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3637worker1 # [ 23.248596] nix-grpc-daemon[777]: ts=2026-09-20T13:33:53Z level=info event=scheduler_connected addr=lb:500513638worker1 # [ 23.252287] nix-grpc-daemon[777]: ts=2026-09-20T13:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker2 # [ 23.415113] nix-grpc-daemon[778]: ts=2026-09-20T13:33:53Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 23.419921] nix-grpc-daemon[778]: ts=2026-09-20T13:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3641worker1 # [ 23.453320] nix-grpc-daemon[777]: ts=2026-09-20T13:33:53Z level=info event=scheduler_connected addr=lb:500513642worker1 # [ 23.458874] nix-grpc-daemon[777]: ts=2026-09-20T13:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker2 # [ 23.616146] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 23.621758] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3645worker1 # [ 23.659997] nix-grpc-daemon[777]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513646worker1 # [ 23.665587] nix-grpc-daemon[777]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker2 # [ 23.823634] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 23.829360] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3649worker1 # [ 23.869006] nix-grpc-daemon[777]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513650worker1 # [ 23.873287] nix-grpc-daemon[777]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker2 # [ 24.030759] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 24.036740] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3653worker1 # [ 24.069545] nix-grpc-daemon[777]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513654worker1 # [ 24.074921] nix-grpc-daemon[777]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker2 # [ 24.238035] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 24.243778] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3657worker1 # [ 24.275727] nix-grpc-daemon[777]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513658worker1 # [ 24.279477] nix-grpc-daemon[777]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker2 # [ 24.447269] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513660worker2 # [ 24.451667] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3661worker1 # [ 24.480937] nix-grpc-daemon[777]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513662worker1 # [ 24.485926] nix-grpc-daemon[777]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker2 # [ 24.648624] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513664worker2 # [ 24.654283] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3665worker1 # [ 24.683293] nix-grpc-daemon[777]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513666worker1 # [ 24.689116] nix-grpc-daemon[777]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker2 # [ 24.855688] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513668worker2 # [ 24.861375] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3669worker1 # [ 24.892292] nix-grpc-daemon[777]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513670worker1 # [ 24.896491] nix-grpc-daemon[777]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker2 # [ 25.062966] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513672worker1 # [ 25.093231] nix-grpc-daemon[777]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513673worker2 # [ 25.068671] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3674worker1 # [ 25.098962] nix-grpc-daemon[777]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker2 # [ 25.270168] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513676worker1 # [ 25.299902] nix-grpc-daemon[777]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 25.275772] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3678worker1 # [ 25.305497] nix-grpc-daemon[777]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker2 # [ 25.479263] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 25.506489] nix-grpc-daemon[777]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 25.483826] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3682worker1 # [ 25.511949] nix-grpc-daemon[777]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3683worker2 # [ 25.680150] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513684worker2 # [ 25.683159] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3685worker1 # [ 25.712968] nix-grpc-daemon[777]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513686worker1 # [ 25.718402] nix-grpc-daemon[777]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3687worker2 # [ 25.884726] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513688worker2 # [ 25.890170] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3689worker1 # [ 25.921777] nix-grpc-daemon[777]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513690worker1 # [ 25.926214] nix-grpc-daemon[777]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3691worker2 # [ 26.091768] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513692worker1 # [ 26.122011] nix-grpc-daemon[777]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513693worker2 # [ 26.097538] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3694worker1 # [ 26.132358] nix-grpc-daemon[777]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3695worker2 # [ 26.298945] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513696worker1 # [ 26.328814] nix-grpc-daemon[777]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513697worker2 # [ 26.304879] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3698worker1 # [ 26.334420] nix-grpc-daemon[777]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3699worker2 # [ 26.508512] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513700worker1 # [ 26.535441] nix-grpc-daemon[777]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513701worker2 # [ 26.513224] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3702worker1 # [ 26.541528] nix-grpc-daemon[777]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3703worker2 # [ 26.709750] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513704worker2 # [ 26.715489] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3705worker1 # [ 26.743141] nix-grpc-daemon[777]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513706worker1 # [ 26.749248] nix-grpc-daemon[777]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3707worker2 # [ 26.917006] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513708worker2 # [ 26.922646] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3709worker1 # [ 26.952464] nix-grpc-daemon[777]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513710worker1 # [ 26.956997] nix-grpc-daemon[777]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3711worker2 # [ 27.124378] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513712worker1 # [ 27.153135] nix-grpc-daemon[777]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513713worker2 # [ 27.130297] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3714worker1 # [ 27.158943] nix-grpc-daemon[777]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3715worker2 # [ 27.331642] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513716worker1 # [ 27.359988] nix-grpc-daemon[777]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513717worker2 # [ 27.337926] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3718worker1 # [ 27.366241] nix-grpc-daemon[777]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3719worker2 # [ 27.539841] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513720worker2 # [ 27.543119] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3721worker1 # [ 27.567484] nix-grpc-daemon[777]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513722worker1 # [ 27.573371] nix-grpc-daemon[777]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3723worker2 # [ 27.745056] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513724worker1 # [ 27.774206] nix-grpc-daemon[777]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513725worker2 # [ 27.751016] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3726worker1 # [ 27.780128] nix-grpc-daemon[777]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3727worker2 # [ 27.952773] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513728worker1 # [ 27.982452] nix-grpc-daemon[777]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513729worker2 # [ 27.958157] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3730worker1 # [ 27.988252] nix-grpc-daemon[777]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3731worker2 # [ 28.159869] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513732worker1 # [ 28.189162] nix-grpc-daemon[777]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513733worker2 # [ 28.165361] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3734worker1 # [ 28.194645] nix-grpc-daemon[777]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3735lb # [ 28.343675] rustfs-bucket-start[1006]: mb s3://farm3736lb # [ 28.353459] systemd[1]: Finished rustfs-bucket.service.3737lb # [ 28.363908] systemd[1]: Starting niks3 server...3738worker2 # [ 28.366417] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513739worker1 # [ 28.395884] nix-grpc-daemon[777]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513740worker2 # [ 28.374525] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3741worker1 # [ 28.401540] nix-grpc-daemon[777]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3742lb # [ 28.614055] postgres[1025]: [1025] ERROR: relation "goose_db_version" does not exist at character 363743lb # [ 28.615409] postgres[1025]: [1025] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3744lb # [ 28.650922] niks3-server[1016]: 2026/09/20 13:33:59 OK 20241026095416_initial_model.sql (22.34ms)3745lb # [ 28.654398] niks3-server[1016]: 2026/09/20 13:33:59 OK 20251210153512_drop_unused_gin_index.sql (3.88ms)3746lb # [ 28.660093] niks3-server[1016]: 2026/09/20 13:33:59 OK 20251218171726_add_pins.sql (5.6ms)3747lb # [ 28.664943] niks3-server[1016]: 2026/09/20 13:33:59 OK 20260628120000_add_object_size_and_stats.sql (4.84ms)3748lb # [ 28.670695] niks3-server[1016]: 2026/09/20 13:33:59 OK 20260905000000_add_claims.sql (5.69ms)3749lb # [ 28.676420] niks3-server[1016]: 2026/09/20 13:33:59 OK 20260920000000_drop_claims.sql (4.94ms)3750lb # [ 28.679429] niks3-server[1016]: 2026/09/20 13:33:59 goose: successfully migrated database to version: 202609200000003751lb # [ 28.684961] niks3-server[1016]: 2026/09/20 13:33:59 OK 1_commit_pending_closure.sql (8.64ms)3752worker2 # [ 28.577226] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513753lb # [ 28.688630] niks3-server[1016]: 2026/09/20 13:33:59 OK 2_object_stats_trigger.sql (3.52ms)3754worker1 # [ 28.602517] nix-grpc-daemon[777]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513755lb # [ 28.690049] niks3-server[1016]: 2026/09/20 13:33:59 goose: up to current file version: 23756worker2 # [ 28.582268] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3757lb # [ 28.694352] niks3-server[1016]: 2026/09/20 13:33:59 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3758worker1 # [ 28.608505] nix-grpc-daemon[777]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3759lb # [ 28.742144] niks3-server[1016]: 2026/09/20 13:33:59 INFO Read proxy enabled — serving cache objects from S33760lb # [ 28.745074] niks3-server[1016]: 2026/09/20 13:33:59 INFO Using socket-activated listener address=0.0.0.0:57513761lb # [ 28.748105] niks3-server[1016]: 2026/09/20 13:33:59 INFO systemd watchdog enabled interval=15s3762lb # [ 28.754795] systemd[1]: Started niks3 server.3763lb # [ 28.755519] niks3-server[1016]: 2026/09/20 13:33:59 INFO Starting HTTP server address=0.0.0.0:57513764lb # [ 28.757073] systemd[1]: Reached target Multi-User System.3765lb # [ 28.759811] systemd[1]: Startup finished in 1.075s (kernel) + 5.456s (initrd) + 22.220s (userspace) = 28.752s.3766lb # [ 28.764779] niks3-server[1016]: 2026/09/20 13:33:59 INFO lead: acquired remote=192.168.1.4:404043767worker2 # [ 28.662836] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_take_over3768worker2 # [ 28.783753] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513769worker1 # [ 28.809392] nix-grpc-daemon[777]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513770worker2 # [ 28.789178] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3771worker1 # [ 28.814478] nix-grpc-daemon[777]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3772worker1 # [ 29.013347] nix-grpc-daemon[777]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513773worker2 # [ 28.990784] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513774worker1 # [ 29.017857] nix-grpc-daemon[777]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3775worker2 # [ 28.996309] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3776worker1 # [ 29.214149] nix-grpc-daemon[777]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513777worker2 # [ 29.193202] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513778worker1 # [ 29.219750] nix-grpc-daemon[777]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3779worker2 # [ 29.198747] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3780worker1 # [ 29.424243] nix-grpc-daemon[777]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513781worker2 # [ 29.402305] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513782worker2 # [ 29.411706] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:485603783worker2 # [ 29.416927] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03784worker2 # [ 29.432184] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=oidc_jwks provider=mock keys=13785worker2 # [ 29.438427] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:485603786worker2 # [ 29.443998] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03787lb: (finished: waiting for unit niks3.service, in 14.70 seconds)3788lb: waiting for TCP port 5751 on localhost3789lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3790lb: (finished: waiting for TCP port 5751 on localhost, in 0.13 seconds)3791lb: waiting for unit envoy.service3792lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3793lb: waiting for TCP port 50051 on localhost3794lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3795lb # [ 29.853995] envoy[915]: conn peer=[::1]:33668 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33796lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3797worker2 # [ 29.925452] systemd[1]: Starting scheduler-token.service...3798worker2 # [ 30.016783] systemd[1]: scheduler-token.service: Deactivated successfully.3799worker2 # [ 30.019818] systemd[1]: Finished scheduler-token.service.3800worker2 # [ 30.023251] systemd[1]: scheduler-token.service: Consumed 37ms CPU time over 95ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3801lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3802lb: must succeed: curl -sf localhost:9901/clusters3803lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)3804lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)3805subtest: one node schedules and both builders hold a WorkerSession on it3806lb: must succeed: curl -sf localhost:9901/clusters3807lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)3808worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3809worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)3810lb: must succeed: curl -sf localhost:9901/clusters3811lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3812lb: must succeed: curl -sf localhost:9901/clusters3813lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)3814worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'3815worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.07 seconds)3816(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.36 seconds)3817subtest: balancer auth: client cert, bearer token, nothing, unknown CN3818worker2 # [ 30.844862] nix-grpc-daemon[778]: ts=2026-09-20T13:34:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536403819worker2 # [ 30.860665] systemd[1]: Started Nix Daemon.3820worker2 # [ 31.156847] nix-daemon[846]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3821worker2 # [ 31.195233] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 1/5)3822worker2 # [ 31.236479] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 106 ms (attempt 2/5)3823worker2 # [ 31.348525] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 323 ms (attempt 3/5)3824worker2 # [ 31.679761] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 152 ms (attempt 4/5)3825worker2 # [ 31.842247] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3826worker2 # [ 31.867216] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:536403827worker2 # [ 31.877695] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=debug event=path_info_miss path=b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test error="error: path '/nix/store/b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test' is required, but there is no substituter that can build it"3828worker1 # [ 31.921302] nix-grpc-daemon[777]: ts=2026-09-20T13:34:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:474943829worker1 # [ 31.928893] systemd[1]: Started Nix Daemon.3830worker1 # [ 32.181832] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3831worker1 # [ 32.208238] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5)3832worker1 # [ 32.293339] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 131 ms (attempt 2/5)3833worker1 # [ 32.432037] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 158 ms (attempt 3/5)3834worker1 # [ 32.596053] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 383 ms (attempt 4/5)3835worker1 # [ 32.990208] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3836worker1 # [ 33.007714] nix-grpc-daemon[777]: ts=2026-09-20T13:34:03Z level=debug event=path_info_miss path=b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test error="error: path '/nix/store/b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test' is required, but there is no substituter that can build it"3837client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3838client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)3839client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3840client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3841worker1 # [ 33.464162] nix-grpc-daemon[777]: ts=2026-09-20T13:34:03Z level=info event=oidc_jwks provider=mock keys=13842worker1 # [ 33.469488] nix-grpc-daemon[777]: ts=2026-09-20T13:34:03Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:474943843worker2 # [ 33.465833] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:536403844worker2 # [ 33.478674] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=debug event=path_info_miss path=b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test error="error: path '/nix/store/b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test' is required, but there is no substituter that can build it"3845worker2 # [ 33.493896] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:536403846worker2 # [ 33.501944] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=debug event=path_info_miss path=b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test error="error: path '/nix/store/b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test' is required, but there is no substituter that can build it"3847client: must succeed: rm -r /var/lib/nix-grpc-store3848client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds)3849worker2 # [ 33.808647] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=denied method=QueryMissing cn=- role=none3850worker2 # [ 34.063919] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=denied method=QueryMissing cn=stranger role=none3851(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.59 seconds)3852subtest: DAG build is scheduled across workers and lands in the cache3853client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23854worker2 # [ 34.321778] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536403855client # don't know how to build these paths:3856client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3857worker1 # [ 34.363740] nix-grpc-daemon[777]: ts=2026-09-20T13:34:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474943858worker2 # [ 34.383157] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03859worker2 # [ 34.391164] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13860worker1 # [ 34.459960] nix-grpc-daemon[777]: ts=2026-09-20T13:34:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474943861worker1 # [ 34.481945] nix-grpc-daemon[777]: ts=2026-09-20T13:34:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474943862client # copying 1 paths to 'lb:50051'...3863worker1 # [ 34.499697] nix-grpc-daemon[777]: ts=2026-09-20T13:34:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474943864client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3865worker1 # [ 34.533166] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3866worker1 # [ 34.568294] nix-grpc-daemon[777]: ts=2026-09-20T13:34:05Z level=info event=niks3_push_started pid=8443867worker1 # [ 34.861969] nix-grpc-daemon[844]: time=2026-09-20T13:34:05.380Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""3868worker1 # [ 35.058749] nix-daemon[834]: accepted connection from pid 857, user nix-grpc-daemon (trusted)3869worker1 # [ 35.080750] nix-daemon[834]: reaped child process 860, status = succeeded3870worker1 # [ 35.255178] nix-daemon[834]: accepted connection from pid 862, user nix-grpc-daemon (trusted)3871worker1 # [ 35.272882] nix-daemon[834]: reaped child process 865, status = succeeded3872lb # [ 35.370125] niks3-server[1016]: 2026/09/20 13:34:05 INFO Received uploads request method=POST path=/api/pending_closures3873worker1 # [ 35.312025] nix-grpc-daemon[844]: time=2026-09-20T13:34:05.832Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3874worker1 # [ 35.314795] nix-grpc-daemon[844]: time=2026-09-20T13:34:05.832Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3875lb # [ 35.440946] niks3-server[1016]: 2026/09/20 13:34:05 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3876lb # [ 35.452178] niks3-server[1016]: 2026/09/20 13:34:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3877lb # [ 35.462016] niks3-server[1016]: 2026/09/20 13:34:05 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3878lb # [ 35.492067] niks3-server[1016]: 2026/09/20 13:34:05 INFO Signed narinfos id=1 count=13879worker1 # [ 35.410504] nix-grpc-daemon[844]: time=2026-09-20T13:34:05.929Z level=INFO msg="Uploading 1 narinfos"3880lb # [ 35.509271] niks3-server[1016]: 2026/09/20 13:34:06 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3881lb # [ 35.520540] niks3-server[1016]: 2026/09/20 13:34:06 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3882lb # [ 35.540355] niks3-server[1016]: 2026/09/20 13:34:06 INFO Completed upload id=13883worker1 # [ 35.457987] nix-grpc-daemon[844]: time=2026-09-20T13:34:05.977Z level=INFO msg="Upload complete. (588ms)"3884worker1 # [ 35.470956] nix-grpc-daemon[777]: ts=2026-09-20T13:34:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=0 paths=1 nar_bytes_in=5043885worker1 # [ 35.492447] nix-grpc-daemon[777]: ts=2026-09-20T13:34:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474943886worker1 # [ 35.503246] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3887worker1 # [ 35.515862] nix-daemon[834]: reaped child process 842, status = succeeded3888client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3889client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3890worker1 # [ 35.527169] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3891client # farm-a> LOG-farm-a-t13892worker1 # [ 36.557804] nix-daemon[834]: reaped child process 869, status = succeeded3893worker1 # [ 36.743692] nix-daemon[834]: accepted connection from pid 885, user nix-grpc-daemon (trusted)3894worker1 # [ 36.764869] nix-daemon[834]: reaped child process 888, status = succeeded3895lb # [ 36.862160] niks3-server[1016]: 2026/09/20 13:34:07 INFO Received uploads request method=POST path=/api/pending_closures3896worker1 # [ 36.799342] nix-grpc-daemon[844]: time=2026-09-20T13:34:07.317Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3897worker1 # [ 36.801915] nix-grpc-daemon[844]: time=2026-09-20T13:34:07.317Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3898lb # [ 36.925078] niks3-server[1016]: 2026/09/20 13:34:07 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3899lb # [ 36.941437] niks3-server[1016]: 2026/09/20 13:34:07 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3900lb # [ 36.956927] niks3-server[1016]: 2026/09/20 13:34:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3901lb # [ 36.965259] niks3-server[1016]: 2026/09/20 13:34:07 INFO Signed narinfos id=2 count=13902worker1 # [ 36.881599] nix-grpc-daemon[844]: time=2026-09-20T13:34:07.399Z level=INFO msg="Uploading 1 narinfos"3903lb # [ 36.969419] niks3-server[1016]: 2026/09/20 13:34:07 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3904lb # [ 36.985811] niks3-server[1016]: 2026/09/20 13:34:07 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3905lb # [ 36.996320] niks3-server[1016]: 2026/09/20 13:34:07 INFO Completed upload id=23906worker1 # [ 36.911521] nix-grpc-daemon[844]: time=2026-09-20T13:34:07.431Z level=INFO msg="Upload complete. (369ms)"3907lb # [ 36.999465] niks3-server[1016]: 2026/09/20 13:34:07 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3908worker1 # [ 36.925475] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13909worker2 # [ 36.918562] nix-grpc-daemon[778]: ts=2026-09-20T13:34:07Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03910worker1 # [ 36.947724] nix-daemon[834]: reaped child process 867, status = succeeded3911worker2 # [ 36.925109] nix-grpc-daemon[778]: ts=2026-09-20T13:34:07Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13912worker1 # [ 36.991651] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474943913worker1 # [ 37.011814] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474943914worker1 # [ 37.030346] nix-grpc-daemon[844]: time=2026-09-20T13:34:07.550Z level=INFO msg="All 1 paths already cached"3915client # copying 1 paths to 'lb:50051'...3916worker1 # [ 37.041696] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474943917client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3918worker1 # [ 37.067043] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3919worker1 # [ 37.302272] nix-daemon[834]: accepted connection from pid 892, user nix-grpc-daemon (trusted)3920worker1 # [ 37.325473] nix-daemon[834]: reaped child process 895, status = succeeded3921worker1 # [ 37.515428] nix-daemon[834]: accepted connection from pid 897, user nix-grpc-daemon (trusted)3922worker1 # [ 37.536840] nix-daemon[834]: reaped child process 900, status = succeeded3923lb # [ 37.631623] niks3-server[1016]: 2026/09/20 13:34:08 INFO Received uploads request method=POST path=/api/pending_closures3924worker1 # [ 37.561086] nix-grpc-daemon[844]: time=2026-09-20T13:34:08.080Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3925worker1 # [ 37.562595] nix-grpc-daemon[844]: time=2026-09-20T13:34:08.080Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3926lb # [ 37.677660] niks3-server[1016]: 2026/09/20 13:34:08 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3927worker1 # [ 37.610377] nix-grpc-daemon[844]: time=2026-09-20T13:34:08.130Z level=INFO msg="Uploading 1 narinfos"3928lb # [ 37.696598] niks3-server[1016]: 2026/09/20 13:34:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3929lb # [ 37.706347] niks3-server[1016]: 2026/09/20 13:34:08 INFO Signed narinfos id=3 count=13930lb # [ 37.711348] niks3-server[1016]: 2026/09/20 13:34:08 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3931lb # [ 37.720721] niks3-server[1016]: 2026/09/20 13:34:08 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3932worker1 # [ 37.641503] nix-grpc-daemon[844]: time=2026-09-20T13:34:08.161Z level=INFO msg="Upload complete. (553ms)"3933lb # [ 37.725350] niks3-server[1016]: 2026/09/20 13:34:08 INFO Completed upload id=33934worker1 # [ 37.646276] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=0 paths=1 nar_bytes_in=6243935lb # [ 37.729056] niks3-server[1016]: 2026/09/20 13:34:08 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3936worker1 # [ 37.652201] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474943937worker1 # [ 37.663415] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3938worker1 # [ 37.664937] nix-daemon[834]: reaped child process 890, status = succeeded3939worker1 # [ 37.673293] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3940client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3941client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3942client # farm-b> LOG-farm-b-t13943worker1 # [ 39.103212] nix-daemon[834]: reaped child process 904, status = succeeded3944worker1 # [ 39.287955] nix-daemon[834]: accepted connection from pid 919, user nix-grpc-daemon (trusted)3945worker1 # [ 39.308839] nix-daemon[834]: reaped child process 922, status = succeeded3946lb # [ 39.406979] niks3-server[1016]: 2026/09/20 13:34:09 INFO Received uploads request method=POST path=/api/pending_closures3947worker1 # [ 39.339418] nix-grpc-daemon[844]: time=2026-09-20T13:34:09.858Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3948worker1 # [ 39.341209] nix-grpc-daemon[844]: time=2026-09-20T13:34:09.858Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3949lb # [ 39.468707] niks3-server[1016]: 2026/09/20 13:34:09 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3950lb # [ 39.479825] niks3-server[1016]: 2026/09/20 13:34:09 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3951lb # [ 39.494396] niks3-server[1016]: 2026/09/20 13:34:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3952worker1 # [ 39.419170] nix-grpc-daemon[844]: time=2026-09-20T13:34:09.938Z level=INFO msg="Uploading 1 narinfos"3953lb # [ 39.505058] niks3-server[1016]: 2026/09/20 13:34:10 INFO Signed narinfos id=4 count=13954lb # [ 39.507278] niks3-server[1016]: 2026/09/20 13:34:10 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3955lb # [ 39.524725] niks3-server[1016]: 2026/09/20 13:34:10 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3956lb # [ 39.531699] niks3-server[1016]: 2026/09/20 13:34:10 INFO Completed upload id=43957worker1 # [ 39.449880] nix-grpc-daemon[844]: time=2026-09-20T13:34:09.969Z level=INFO msg="Upload complete. (365ms)"3958lb # [ 39.537786] niks3-server[1016]: 2026/09/20 13:34:10 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3959worker1 # [ 39.458196] nix-grpc-daemon[777]: ts=2026-09-20T13:34:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13960worker2 # [ 39.447235] nix-grpc-daemon[778]: ts=2026-09-20T13:34:09Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03961worker2 # [ 39.454292] nix-grpc-daemon[778]: ts=2026-09-20T13:34:09Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13962worker1 # [ 39.483106] nix-daemon[834]: reaped child process 902, status = succeeded3963worker1 # [ 39.518705] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474943964worker1 # [ 39.534829] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474943965worker1 # [ 39.550022] nix-grpc-daemon[844]: time=2026-09-20T13:34:10.070Z level=INFO msg="All 2 paths already cached"3966client # copying 1 paths to 'lb:50051'...3967worker1 # [ 39.561345] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474943968client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3969worker1 # [ 39.584459] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3970worker1 # [ 39.806419] nix-daemon[834]: accepted connection from pid 927, user nix-grpc-daemon (trusted)3971worker1 # [ 39.827066] nix-daemon[834]: reaped child process 930, status = succeeded3972worker1 # [ 40.048209] nix-daemon[834]: accepted connection from pid 932, user nix-grpc-daemon (trusted)3973worker1 # [ 40.068001] nix-daemon[834]: reaped child process 935, status = succeeded3974lb # [ 40.150212] envoy[915]: conn peer=[2001:db8:1::1]:33370 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=21803975lb # [ 40.155533] envoy[915]: conn peer=[2001:db8:1::1]:41632 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=863976lb # [ 40.161599] envoy[915]: conn peer=[2001:db8:1::1]:41640 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=123977lb # [ 40.166424] envoy[915]: conn peer=[2001:db8:1::1]:41642 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=143978lb # [ 40.173678] niks3-server[1016]: 2026/09/20 13:34:10 INFO Received uploads request method=POST path=/api/pending_closures3979worker1 # [ 40.102784] nix-grpc-daemon[844]: time=2026-09-20T13:34:10.622Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3980worker1 # [ 40.104540] nix-grpc-daemon[844]: time=2026-09-20T13:34:10.622Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3981lb # [ 40.225147] niks3-server[1016]: 2026/09/20 13:34:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3982worker1 # [ 40.150885] nix-grpc-daemon[844]: time=2026-09-20T13:34:10.670Z level=INFO msg="Uploading 1 narinfos"3983lb # [ 40.240083] niks3-server[1016]: 2026/09/20 13:34:10 INFO Signed narinfos id=5 count=13984lb # [ 40.245876] niks3-server[1016]: 2026/09/20 13:34:10 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3985lb # [ 40.255669] niks3-server[1016]: 2026/09/20 13:34:10 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3986lb # [ 40.263022] niks3-server[1016]: 2026/09/20 13:34:10 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3987lb # [ 40.275853] niks3-server[1016]: 2026/09/20 13:34:10 INFO Completed upload id=53988worker1 # [ 40.193293] nix-grpc-daemon[844]: time=2026-09-20T13:34:10.713Z level=INFO msg="Upload complete. (594ms)"3989lb # [ 40.279312] niks3-server[1016]: 2026/09/20 13:34:10 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3990worker1 # [ 40.206130] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=0 paths=1 nar_bytes_in=7523991worker1 # [ 40.224845] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474943992worker1 # [ 40.239743] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3993worker1 # [ 40.242990] nix-daemon[834]: reaped child process 925, status = succeeded3994client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3995client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3996worker1 # [ 40.260627] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3997worker1 # [ 41.691565] nix-daemon[834]: reaped child process 939, status = succeeded3998client # farm-top> LOG-farm-top-t13999worker1 # [ 41.881877] nix-daemon[834]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4000worker1 # [ 41.903010] nix-daemon[834]: reaped child process 957, status = succeeded4001lb # [ 42.001853] niks3-server[1016]: 2026/09/20 13:34:12 INFO Received uploads request method=POST path=/api/pending_closures4002worker1 # [ 41.936573] nix-grpc-daemon[844]: time=2026-09-20T13:34:12.455Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4003worker1 # [ 41.938189] nix-grpc-daemon[844]: time=2026-09-20T13:34:12.455Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4004lb # [ 42.071139] niks3-server[1016]: 2026/09/20 13:34:12 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4005lb # [ 42.081072] niks3-server[1016]: 2026/09/20 13:34:12 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4006lb # [ 42.090475] niks3-server[1016]: 2026/09/20 13:34:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4007lb # [ 42.096166] niks3-server[1016]: 2026/09/20 13:34:12 INFO Signed narinfos id=6 count=14008worker1 # [ 42.013616] nix-grpc-daemon[844]: time=2026-09-20T13:34:12.532Z level=INFO msg="Uploading 1 narinfos"4009lb # [ 42.100425] niks3-server[1016]: 2026/09/20 13:34:12 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4010lb # [ 42.112720] niks3-server[1016]: 2026/09/20 13:34:12 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4011lb # [ 42.120343] niks3-server[1016]: 2026/09/20 13:34:12 INFO Completed upload id=64012worker1 # [ 42.037823] nix-grpc-daemon[844]: time=2026-09-20T13:34:12.557Z level=INFO msg="Upload complete. (360ms)"4013lb # [ 42.123907] niks3-server[1016]: 2026/09/20 13:34:12 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4014worker1 # [ 42.053894] nix-grpc-daemon[777]: ts=2026-09-20T13:34:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14015worker1 # [ 42.076853] nix-daemon[834]: reaped child process 937, status = succeeded4016client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 8.01 seconds)4017client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4018client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.28 seconds)4019client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4020client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds)4021client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4022client # copying 3 paths...4023client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4024client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4025client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4026client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.41 seconds)4027(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.87 seconds)4028subtest: repeat is answered Cached by the scheduler without building4029worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4030worker1 # finding garbage collector roots...4031worker1 # deleting specified paths...4032worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4033worker1 # deleting unused links...4034worker1 # note: hard linking is currently saving 0.0 KiB4035worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)4036worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4037worker2 # finding garbage collector roots...4038worker2 # deleting specified paths...4039worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4040worker2 # deleting unused links...4041worker2 # note: hard linking is currently saving 0.0 KiB4042worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.35 seconds)4043client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24044worker2 # [ 43.887736] nix-grpc-daemon[778]: ts=2026-09-20T13:34:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536404045client # don't know how to build these paths:4046client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4047worker2 # [ 43.902984] nix-grpc-daemon[778]: ts=2026-09-20T13:34:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536404048worker2 # [ 43.954252] nix-grpc-daemon[778]: ts=2026-09-20T13:34:14Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14049client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.42 seconds)4050client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4051client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.25 seconds)4052lb: must succeed: curl -sf localhost:9901/clusters4053lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4054lb: must succeed: curl -sf localhost:9901/clusters4055lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4056worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4057worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds)4058(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.68 seconds)4059subtest: inputs already in the cache are not sent to the scheduler4060lb: must succeed: curl -sf localhost:9901/clusters4061lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4062lb: must succeed: curl -sf localhost:9901/clusters4063lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4064worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4065worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4066client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24067worker2 # [ 45.167556] nix-grpc-daemon[778]: ts=2026-09-20T13:34:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536404068client # don't know how to build these paths:4069client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4070worker2 # [ 45.180269] nix-grpc-daemon[778]: ts=2026-09-20T13:34:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536404071worker2 # [ 45.201330] nix-grpc-daemon[778]: ts=2026-09-20T13:34:15Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04072worker2 # [ 45.207920] nix-grpc-daemon[778]: ts=2026-09-20T13:34:15Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14073worker1 # [ 45.279751] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474944074worker1 # [ 45.300508] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474944075client # copying 1 paths to 'lb:50051'...4076worker1 # [ 45.322088] nix-grpc-daemon[844]: time=2026-09-20T13:34:15.839Z level=INFO msg="All 2 paths already cached"4077client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4078worker1 # [ 45.328286] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474944079worker1 # [ 45.346367] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4080worker1 # [ 45.589838] nix-daemon[834]: accepted connection from pid 975, user nix-grpc-daemon (trusted)4081worker1 # [ 45.611262] nix-daemon[834]: reaped child process 978, status = succeeded4082worker1 # [ 45.808978] nix-daemon[834]: accepted connection from pid 980, user nix-grpc-daemon (trusted)4083worker1 # [ 45.829383] nix-daemon[834]: reaped child process 983, status = succeeded4084lb # [ 45.926032] niks3-server[1016]: 2026/09/20 13:34:16 INFO Received uploads request method=POST path=/api/pending_closures4085worker1 # [ 45.859611] nix-grpc-daemon[844]: time=2026-09-20T13:34:16.379Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4086worker1 # [ 45.861344] nix-grpc-daemon[844]: time=2026-09-20T13:34:16.379Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4087lb # [ 45.968307] niks3-server[1016]: 2026/09/20 13:34:16 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4088lb # [ 45.986750] niks3-server[1016]: 2026/09/20 13:34:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4089worker1 # [ 45.910151] nix-grpc-daemon[844]: time=2026-09-20T13:34:16.429Z level=INFO msg="Uploading 1 narinfos"4090lb # [ 45.997614] niks3-server[1016]: 2026/09/20 13:34:16 INFO Signed narinfos id=7 count=14091lb # [ 46.005679] niks3-server[1016]: 2026/09/20 13:34:16 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4092lb # [ 46.021086] niks3-server[1016]: 2026/09/20 13:34:16 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4093lb # [ 46.030560] niks3-server[1016]: 2026/09/20 13:34:16 INFO Completed upload id=74094worker1 # [ 45.948087] nix-grpc-daemon[844]: time=2026-09-20T13:34:16.468Z level=INFO msg="Upload complete. (579ms)"4095lb # [ 46.034663] niks3-server[1016]: 2026/09/20 13:34:16 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4096worker1 # [ 45.960212] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=0 paths=1 nar_bytes_in=7524097worker1 # [ 45.969228] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474944098worker1 # [ 45.984528] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4099worker1 # [ 45.992487] nix-daemon[834]: reaped child process 973, status = succeeded4100client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4101client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4102worker1 # [ 46.009325] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4103client # farm-top> LOG-farm-top-t1b4104worker1 # [ 47.053543] nix-daemon[834]: reaped child process 987, status = succeeded4105worker1 # [ 47.259179] nix-daemon[834]: accepted connection from pid 1003, user nix-grpc-daemon (trusted)4106worker1 # [ 47.282423] nix-daemon[834]: reaped child process 1006, status = succeeded4107lb # [ 47.379138] niks3-server[1016]: 2026/09/20 13:34:17 INFO Received uploads request method=POST path=/api/pending_closures4108worker1 # [ 47.309615] nix-grpc-daemon[844]: time=2026-09-20T13:34:17.829Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4109worker1 # [ 47.315118] nix-grpc-daemon[844]: time=2026-09-20T13:34:17.831Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4110lb # [ 47.415852] niks3-server[1016]: 2026/09/20 13:34:17 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4111lb # [ 47.422107] niks3-server[1016]: 2026/09/20 13:34:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4112lb # [ 47.423735] niks3-server[1016]: 2026/09/20 13:34:17 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4113worker1 # [ 47.343599] nix-grpc-daemon[844]: time=2026-09-20T13:34:17.863Z level=INFO msg="Uploading 1 narinfos"4114lb # [ 47.433109] niks3-server[1016]: 2026/09/20 13:34:17 INFO Signed narinfos id=8 count=14115lb # [ 47.442573] niks3-server[1016]: 2026/09/20 13:34:17 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4116lb # [ 47.448808] niks3-server[1016]: 2026/09/20 13:34:17 INFO Completed upload id=84117worker1 # [ 47.366124] nix-grpc-daemon[844]: time=2026-09-20T13:34:17.886Z level=INFO msg="Upload complete. (343ms)"4118lb # [ 47.451319] niks3-server[1016]: 2026/09/20 13:34:17 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4119lb # [ 47.459687] niks3-server[1016]: 2026/09/20 13:34:17 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4120worker1 # [ 47.376077] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14121worker1 # [ 47.388158] nix-daemon[834]: reaped child process 985, status = succeeded4122client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.52 seconds)4123client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4124client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.28 seconds)4125lb: must succeed: curl -sf localhost:9901/clusters4126lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4127lb: must succeed: curl -sf localhost:9901/clusters4128lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4129worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4130worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4131(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.28 seconds)4132subtest: two clients wanting the same drv build it once4133client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4134client # [ 47.993228] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4135client # Running as unit: dedup1.service; invocation ID: c662a99429a2451aa7c7dceb5460bceb4136client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.11 seconds)4137client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4138worker2 # [ 48.299447] nix-grpc-daemon[778]: ts=2026-09-20T13:34:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536404139client # [ 48.287645] nix[887]: don't know how to build these paths:4140client # [ 48.290070] nix[887]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4141worker2 # [ 48.329172] nix-grpc-daemon[778]: ts=2026-09-20T13:34:18Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04142worker2 # [ 48.337734] nix-grpc-daemon[778]: ts=2026-09-20T13:34:18Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14143worker2 # [ 48.379992] nix-grpc-daemon[778]: ts=2026-09-20T13:34:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536404144worker2 # [ 48.406047] nix-grpc-daemon[778]: ts=2026-09-20T13:34:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536404145client # [ 48.404633] nix[887]: copying 1 paths to 'lb:50051'...4146client # [ 48.405966] nix[887]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4147worker2 # [ 48.426576] nix-grpc-daemon[778]: ts=2026-09-20T13:34:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:536404148worker2 # [ 48.449377] nix-daemon[846]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4149worker2 # [ 48.483754] nix-grpc-daemon[778]: ts=2026-09-20T13:34:18Z level=info event=niks3_push_started pid=8984150worker2 # [ 48.795455] nix-grpc-daemon[898]: time=2026-09-20T13:34:19.291Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4151worker2 # [ 49.017318] nix-daemon[846]: accepted connection from pid 911, user nix-grpc-daemon (trusted)4152worker2 # [ 49.039402] nix-daemon[846]: reaped child process 914, status = succeeded4153client # [ 49.129831] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4154client # Running as unit: dedup2.service; invocation ID: 66ff8864f3ec4c85a73070da86e486474155client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.16 seconds)4156worker2 # [ 49.238999] nix-daemon[846]: accepted connection from pid 916, user nix-grpc-daemon (trusted)4157worker2 # [ 49.258837] nix-daemon[846]: reaped child process 919, status = succeeded4158lb # [ 49.381629] niks3-server[1016]: 2026/09/20 13:34:19 INFO Received uploads request method=POST path=/api/pending_closures4159worker2 # [ 49.296568] nix-grpc-daemon[898]: time=2026-09-20T13:34:19.794Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4160worker2 # [ 49.302248] nix-grpc-daemon[898]: time=2026-09-20T13:34:19.794Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4161lb # [ 49.451138] niks3-server[1016]: 2026/09/20 13:34:19 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4162lb # [ 49.458727] niks3-server[1016]: 2026/09/20 13:34:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4163worker2 # [ 49.359375] nix-grpc-daemon[898]: time=2026-09-20T13:34:19.856Z level=INFO msg="Uploading 1 narinfos"4164lb # [ 49.470503] niks3-server[1016]: 2026/09/20 13:34:19 INFO Signed narinfos id=9 count=14165lb # [ 49.487108] niks3-server[1016]: 2026/09/20 13:34:19 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4166lb # [ 49.501493] niks3-server[1016]: 2026/09/20 13:34:20 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4167lb # [ 49.509843] niks3-server[1016]: 2026/09/20 13:34:20 INFO Completed upload id=94168worker2 # [ 49.402948] nix-grpc-daemon[898]: time=2026-09-20T13:34:19.900Z level=INFO msg="Upload complete. (598ms)"4169lb # [ 49.512471] niks3-server[1016]: 2026/09/20 13:34:20 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4170worker2 # [ 49.408749] nix-grpc-daemon[778]: ts=2026-09-20T13:34:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53640 duration_s=0 paths=1 nar_bytes_in=4324171worker2 # [ 49.416121] nix-grpc-daemon[778]: ts=2026-09-20T13:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536404172worker2 # [ 49.427647] nix-daemon[846]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4173worker2 # [ 49.431926] nix-daemon[846]: reaped child process 896, status = succeeded4174client # [ 49.421475] nix[887]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4175worker2 # [ 49.445355] nix-daemon[846]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4176worker1 # [ 49.522915] nix-grpc-daemon[777]: ts=2026-09-20T13:34:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:474944177client # [ 49.486271] nix[903]: don't know how to build these paths:4178client # [ 49.487358] nix[903]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4179worker2 # [ 49.522425] nix-grpc-daemon[778]: ts=2026-09-20T13:34:20Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04180worker2 # [ 49.533896] nix-grpc-daemon[778]: ts=2026-09-20T13:34:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536404181client # [ 49.519917] nix[903]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4182lb # [ 50.150379] envoy[915]: conn peer=[2001:db8:1::1]:41656 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9566 tx=3877 ms=77384183lb # [ 50.156295] envoy[915]: conn peer=[2001:db8:1::1]:57230 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=481 ms=974184lb # [ 50.164950] envoy[915]: conn peer=[2001:db8:1::1]:57246 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4215 tx=1741 ms=22034185client: must succeed: sleep 24186client: (finished: must succeed: sleep 2, in 2.07 seconds)4187client: waiting for success: ! systemctl is-active dedup1 dedup24188worker2 # [ 52.873125] nix-daemon[846]: reaped child process 927, status = succeeded4189worker2 # [ 53.070469] nix-daemon[846]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4190worker2 # [ 53.091710] nix-daemon[846]: reaped child process 957, status = succeeded4191lb # [ 53.215443] niks3-server[1016]: 2026/09/20 13:34:23 INFO Received uploads request method=POST path=/api/pending_closures4192worker2 # [ 53.119894] nix-grpc-daemon[898]: time=2026-09-20T13:34:23.615Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4193worker2 # [ 53.122040] nix-grpc-daemon[898]: time=2026-09-20T13:34:23.615Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4194lb # [ 53.279210] niks3-server[1016]: 2026/09/20 13:34:23 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4195lb # [ 53.291952] niks3-server[1016]: 2026/09/20 13:34:23 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4196lb # [ 53.305820] niks3-server[1016]: 2026/09/20 13:34:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4197lb # [ 53.315204] niks3-server[1016]: 2026/09/20 13:34:23 INFO Signed narinfos id=10 count=14198worker2 # [ 53.207714] nix-grpc-daemon[898]: time=2026-09-20T13:34:23.702Z level=INFO msg="Uploading 1 narinfos"4199lb # [ 53.318498] niks3-server[1016]: 2026/09/20 13:34:23 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4200lb # [ 53.335567] niks3-server[1016]: 2026/09/20 13:34:23 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4201worker2 # [ 53.235288] nix-grpc-daemon[898]: time=2026-09-20T13:34:23.732Z level=INFO msg="Upload complete. (378ms)"4202lb # [ 53.345535] niks3-server[1016]: 2026/09/20 13:34:23 INFO Completed upload id=104203lb # [ 53.347985] niks3-server[1016]: 2026/09/20 13:34:23 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4204worker2 # [ 53.256794] nix-grpc-daemon[778]: ts=2026-09-20T13:34:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53640 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14205worker2 # [ 53.272481] nix-grpc-daemon[778]: ts=2026-09-20T13:34:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53640 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14206worker2 # [ 53.279306] nix-daemon[846]: reaped child process 925, status = succeeded4207client # [ 53.290209] systemd[1]: dedup1.service: Deactivated successfully.4208client # [ 53.299145] systemd[1]: dedup1.service: Consumed 194ms CPU time over 5.305s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.4209client # [ 53.341770] systemd[1]: dedup2.service: Deactivated successfully.4210client # [ 53.344767] systemd[1]: dedup2.service: Consumed 199ms CPU time over 4.216s wall clock time, 31M memory peak, 7.4K incoming IP traffic, 6.4K outgoing IP traffic.4211client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.17 seconds)4212client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4213client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.08 seconds)4214worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4215worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.09 seconds)4216worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4217worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.10 seconds)4218worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4219worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.11 seconds)4220worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4221worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds)4222(finished: subtest: two clients wanting the same drv build it once, in 6.54 seconds)4223subtest: build hook: nix-daemon with builders = grpc://lb4224client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4225client # [ 54.716851] systemd[1]: Started Nix Daemon.4226client # [ 54.933877] nix-daemon[945]: accepted connection from pid 942, user root (trusted)4227worker2 # [ 55.194189] nix-grpc-daemon[778]: ts=2026-09-20T13:34:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:536404228worker2 # [ 55.208999] nix-grpc-daemon[778]: ts=2026-09-20T13:34:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536404229worker2 # [ 55.235509] nix-grpc-daemon[778]: ts=2026-09-20T13:34:25Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04230worker2 # [ 55.242074] nix-grpc-daemon[778]: ts=2026-09-20T13:34:25Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14231worker1 # [ 55.309766] nix-grpc-daemon[777]: ts=2026-09-20T13:34:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474944232worker1 # [ 55.335065] nix-grpc-daemon[777]: ts=2026-09-20T13:34:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474944233worker1 # [ 55.356267] nix-grpc-daemon[777]: ts=2026-09-20T13:34:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474944234worker1 # [ 55.379503] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4235worker1 # [ 55.644812] nix-daemon[834]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)4236worker1 # [ 55.666961] nix-daemon[834]: reaped child process 1034, status = succeeded4237worker1 # [ 55.859605] nix-daemon[834]: accepted connection from pid 1036, user nix-grpc-daemon (trusted)4238worker1 # [ 55.880657] nix-daemon[834]: reaped child process 1039, status = succeeded4239lb # [ 55.977170] niks3-server[1016]: 2026/09/20 13:34:26 INFO Received uploads request method=POST path=/api/pending_closures4240worker1 # [ 55.907927] nix-grpc-daemon[844]: time=2026-09-20T13:34:26.427Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4241worker1 # [ 55.909691] nix-grpc-daemon[844]: time=2026-09-20T13:34:26.427Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4242lb # [ 56.018543] niks3-server[1016]: 2026/09/20 13:34:26 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4243lb # [ 56.037490] niks3-server[1016]: 2026/09/20 13:34:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4244worker1 # [ 55.961107] nix-grpc-daemon[844]: time=2026-09-20T13:34:26.480Z level=INFO msg="Uploading 1 narinfos"4245lb # [ 56.050860] niks3-server[1016]: 2026/09/20 13:34:26 INFO Signed narinfos id=11 count=14246lb # [ 56.056649] niks3-server[1016]: 2026/09/20 13:34:26 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4247lb # [ 56.067963] niks3-server[1016]: 2026/09/20 13:34:26 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4248lb # [ 56.075386] niks3-server[1016]: 2026/09/20 13:34:26 INFO Completed upload id=114249worker1 # [ 55.991875] nix-grpc-daemon[844]: time=2026-09-20T13:34:26.511Z level=INFO msg="Upload complete. (587ms)"4250lb # [ 56.079020] niks3-server[1016]: 2026/09/20 13:34:26 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4251worker1 # [ 56.005008] nix-grpc-daemon[777]: ts=2026-09-20T13:34:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=0 paths=1 nar_bytes_in=5124252worker1 # [ 56.023889] nix-grpc-daemon[777]: ts=2026-09-20T13:34:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474944253worker1 # [ 56.032660] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4254worker1 # [ 56.039591] nix-daemon[834]: reaped child process 1029, status = succeeded4255worker1 # [ 56.058987] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4256worker1 # [ 57.689142] nix-daemon[834]: reaped child process 1043, status = succeeded4257worker1 # [ 57.865818] nix-daemon[834]: accepted connection from pid 1058, user nix-grpc-daemon (trusted)4258worker1 # [ 57.887442] nix-daemon[834]: reaped child process 1061, status = succeeded4259lb # [ 57.990358] niks3-server[1016]: 2026/09/20 13:34:28 INFO Received uploads request method=POST path=/api/pending_closures4260worker1 # [ 57.920513] nix-grpc-daemon[844]: time=2026-09-20T13:34:28.438Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4261worker1 # [ 57.922071] nix-grpc-daemon[844]: time=2026-09-20T13:34:28.438Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4262lb # [ 58.047958] niks3-server[1016]: 2026/09/20 13:34:28 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4263lb # [ 58.058007] niks3-server[1016]: 2026/09/20 13:34:28 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4264lb # [ 58.071211] niks3-server[1016]: 2026/09/20 13:34:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4265worker1 # [ 57.993954] nix-grpc-daemon[844]: time=2026-09-20T13:34:28.513Z level=INFO msg="Uploading 1 narinfos"4266lb # [ 58.081182] niks3-server[1016]: 2026/09/20 13:34:28 INFO Signed narinfos id=12 count=14267lb # [ 58.087228] niks3-server[1016]: 2026/09/20 13:34:28 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4268lb # [ 58.096771] niks3-server[1016]: 2026/09/20 13:34:28 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4269lb # [ 58.103770] niks3-server[1016]: 2026/09/20 13:34:28 INFO Completed upload id=124270worker1 # [ 58.019480] nix-grpc-daemon[844]: time=2026-09-20T13:34:28.539Z level=INFO msg="Upload complete. (345ms)"4271lb # [ 58.106710] niks3-server[1016]: 2026/09/20 13:34:28 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4272worker1 # [ 58.033525] nix-grpc-daemon[777]: ts=2026-09-20T13:34:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=2 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14273worker1 # [ 58.056556] nix-grpc-daemon[777]: ts=2026-09-20T13:34:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:474944274worker1 # [ 58.063236] nix-daemon[834]: reaped child process 1041, status = succeeded4275worker1 # [ 58.082504] nix-grpc-daemon[777]: ts=2026-09-20T13:34:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:474944276worker1 # [ 58.090211] nix-grpc-daemon[777]: ts=2026-09-20T13:34:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=0 paths=1 nar_bytes_out=1284277worker2 # [ 58.405862] nix-grpc-daemon[778]: ts=2026-09-20T13:34:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:536404278worker2 # [ 58.417517] nix-grpc-daemon[778]: ts=2026-09-20T13:34:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536404279worker2 # [ 58.456208] nix-grpc-daemon[778]: ts=2026-09-20T13:34:28Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04280worker2 # [ 58.464270] nix-grpc-daemon[778]: ts=2026-09-20T13:34:28Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14281worker1 # [ 58.493047] nix-grpc-daemon[777]: ts=2026-09-20T13:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474944282worker1 # [ 58.512630] nix-grpc-daemon[777]: ts=2026-09-20T13:34:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474944283worker1 # [ 58.532396] nix-grpc-daemon[844]: time=2026-09-20T13:34:29.052Z level=INFO msg="All 1 paths already cached"4284worker1 # [ 58.545425] nix-grpc-daemon[777]: ts=2026-09-20T13:34:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474944285worker1 # [ 58.562132] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4286worker1 # [ 58.810805] nix-daemon[834]: accepted connection from pid 1065, user nix-grpc-daemon (trusted)4287worker1 # [ 58.834260] nix-daemon[834]: reaped child process 1068, status = succeeded4288worker1 # [ 59.032132] nix-daemon[834]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4289worker1 # [ 59.052160] nix-daemon[834]: reaped child process 1073, status = succeeded4290lb # [ 59.150184] niks3-server[1016]: 2026/09/20 13:34:29 INFO Received uploads request method=POST path=/api/pending_closures4291worker1 # [ 59.078067] nix-grpc-daemon[844]: time=2026-09-20T13:34:29.597Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4292worker1 # [ 59.079612] nix-grpc-daemon[844]: time=2026-09-20T13:34:29.597Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4293lb # [ 59.189440] niks3-server[1016]: 2026/09/20 13:34:29 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4294lb # [ 59.204130] niks3-server[1016]: 2026/09/20 13:34:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4295worker1 # [ 59.127673] nix-grpc-daemon[844]: time=2026-09-20T13:34:29.647Z level=INFO msg="Uploading 1 narinfos"4296lb # [ 59.215240] niks3-server[1016]: 2026/09/20 13:34:29 INFO Signed narinfos id=13 count=14297lb # [ 59.219957] niks3-server[1016]: 2026/09/20 13:34:29 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4298lb # [ 59.231295] niks3-server[1016]: 2026/09/20 13:34:29 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4299worker1 # [ 59.155633] nix-grpc-daemon[844]: time=2026-09-20T13:34:29.675Z level=INFO msg="Upload complete. (571ms)"4300lb # [ 59.240716] niks3-server[1016]: 2026/09/20 13:34:29 INFO Completed upload id=134301lb # [ 59.243509] niks3-server[1016]: 2026/09/20 13:34:29 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4302worker1 # [ 59.172454] nix-grpc-daemon[777]: ts=2026-09-20T13:34:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=0 paths=1 nar_bytes_in=6244303worker1 # [ 59.181049] nix-grpc-daemon[777]: ts=2026-09-20T13:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474944304worker1 # [ 59.195399] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4305worker1 # [ 59.203458] nix-daemon[834]: reaped child process 1063, status = succeeded4306worker1 # [ 59.218155] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4307worker1 # [ 60.053952] nix-daemon[834]: reaped child process 1077, status = succeeded4308lb # [ 60.151698] envoy[915]: conn peer=[2001:db8:1::1]:57258 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1375 ms=49724309lb # [ 60.156933] envoy[915]: conn peer=[2001:db8:1::1]:57266 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1086 ms=38234310lb # [ 60.164329] envoy[915]: conn peer=[2001:db8:1::1]:37398 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3404 tx=1661 ms=29394311lb # [ 60.169249] envoy[915]: conn peer=[2001:db8:1::1]:37406 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=834312worker1 # [ 60.216406] nix-daemon[834]: accepted connection from pid 1092, user nix-grpc-daemon (trusted)4313worker1 # [ 60.236421] nix-daemon[834]: reaped child process 1095, status = succeeded4314lb # [ 60.331735] niks3-server[1016]: 2026/09/20 13:34:30 INFO Received uploads request method=POST path=/api/pending_closures4315worker1 # [ 60.259722] nix-grpc-daemon[844]: time=2026-09-20T13:34:30.778Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4316worker1 # [ 60.261392] nix-grpc-daemon[844]: time=2026-09-20T13:34:30.778Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4317worker1 # [ 60.299537] nix-grpc-daemon[844]: time=2026-09-20T13:34:30.819Z level=INFO msg="Uploading 1 narinfos"4318lb # [ 60.374147] niks3-server[1016]: 2026/09/20 13:34:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4319lb # [ 60.392177] niks3-server[1016]: 2026/09/20 13:34:30 INFO Signed narinfos id=14 count=14320lb # [ 60.395330] niks3-server[1016]: 2026/09/20 13:34:30 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4321lb # [ 60.414051] niks3-server[1016]: 2026/09/20 13:34:30 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4322lb # [ 60.418013] niks3-server[1016]: 2026/09/20 13:34:30 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4323worker1 # [ 60.339153] nix-grpc-daemon[844]: time=2026-09-20T13:34:30.859Z level=INFO msg="Upload complete. (304ms)"4324lb # [ 60.422625] niks3-server[1016]: 2026/09/20 13:34:30 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4325lb # [ 60.425872] niks3-server[1016]: 2026/09/20 13:34:30 INFO Completed upload id=144326lb # [ 60.430228] niks3-server[1016]: 2026/09/20 13:34:30 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4327worker1 # [ 60.348928] nix-grpc-daemon[777]: ts=2026-09-20T13:34:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14328worker2 # [ 60.333841] nix-grpc-daemon[778]: ts=2026-09-20T13:34:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:536404329worker1 # [ 60.362730] nix-daemon[834]: reaped child process 1075, status = succeeded4330worker2 # [ 60.352339] nix-grpc-daemon[778]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4331worker2 # [ 60.376489] nix-grpc-daemon[778]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4332worker2 # [ 60.418144] nix-grpc-daemon[778]: ts=2026-09-20T13:34:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:536404333worker2 # [ 60.425359] nix-grpc-daemon[778]: ts=2026-09-20T13:34:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53640 duration_s=0 paths=1 nar_bytes_out=1764334worker1 # [ 60.761577] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:474944335worker2 # [ 60.747052] nix-grpc-daemon[778]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536404336worker2 # [ 60.754183] nix-grpc-daemon[898]: time=2026-09-20T13:34:31.251Z level=INFO msg="All 2 paths already cached"4337worker2 # [ 60.769003] nix-grpc-daemon[778]: ts=2026-09-20T13:34:31Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04338worker2 # [ 60.775133] nix-grpc-daemon[778]: ts=2026-09-20T13:34:31Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14339worker1 # [ 60.841746] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474944340worker1 # [ 60.858865] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474944341worker1 # [ 60.875116] nix-grpc-daemon[844]: time=2026-09-20T13:34:31.395Z level=INFO msg="All 2 paths already cached"4342worker1 # [ 60.885057] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474944343worker1 # [ 60.899197] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4344worker1 # [ 61.105848] nix-daemon[834]: accepted connection from pid 1099, user nix-grpc-daemon (trusted)4345worker1 # [ 61.125080] nix-daemon[834]: reaped child process 1102, status = succeeded4346worker1 # [ 61.307871] nix-daemon[834]: accepted connection from pid 1104, user nix-grpc-daemon (trusted)4347worker1 # [ 61.326858] nix-daemon[834]: reaped child process 1107, status = succeeded4348lb # [ 61.421888] niks3-server[1016]: 2026/09/20 13:34:31 INFO Received uploads request method=POST path=/api/pending_closures4349worker1 # [ 61.349551] nix-grpc-daemon[844]: time=2026-09-20T13:34:31.869Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4350worker1 # [ 61.351072] nix-grpc-daemon[844]: time=2026-09-20T13:34:31.869Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4351lb # [ 61.454428] niks3-server[1016]: 2026/09/20 13:34:31 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4352worker1 # [ 61.385930] nix-grpc-daemon[844]: time=2026-09-20T13:34:31.905Z level=INFO msg="Uploading 1 narinfos"4353lb # [ 61.470474] niks3-server[1016]: 2026/09/20 13:34:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4354lb # [ 61.480577] niks3-server[1016]: 2026/09/20 13:34:31 INFO Signed narinfos id=15 count=14355lb # [ 61.484864] niks3-server[1016]: 2026/09/20 13:34:31 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4356worker1 # [ 61.412149] nix-grpc-daemon[844]: time=2026-09-20T13:34:31.932Z level=INFO msg="Upload complete. (495ms)"4357lb # [ 61.495334] niks3-server[1016]: 2026/09/20 13:34:31 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4358lb # [ 61.501327] niks3-server[1016]: 2026/09/20 13:34:32 INFO Completed upload id=154359worker1 # [ 61.420802] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=0 paths=1 nar_bytes_in=7524360lb # [ 61.505980] niks3-server[1016]: 2026/09/20 13:34:32 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4361worker1 # [ 61.435578] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474944362worker1 # [ 61.441988] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4363worker1 # [ 61.446511] nix-daemon[834]: reaped child process 1097, status = succeeded4364worker1 # [ 61.460169] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4365worker1 # [ 62.683352] nix-daemon[834]: reaped child process 1111, status = succeeded4366worker1 # [ 62.851245] nix-daemon[834]: accepted connection from pid 1126, user nix-grpc-daemon (trusted)4367worker1 # [ 62.874696] nix-daemon[834]: reaped child process 1129, status = succeeded4368lb # [ 62.970296] niks3-server[1016]: 2026/09/20 13:34:33 INFO Received uploads request method=POST path=/api/pending_closures4369worker1 # [ 62.900529] nix-grpc-daemon[844]: time=2026-09-20T13:34:33.417Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4370worker1 # [ 62.902056] nix-grpc-daemon[844]: time=2026-09-20T13:34:33.417Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4371lb # [ 63.007859] niks3-server[1016]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4372lb # [ 63.021393] niks3-server[1016]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4373lb # [ 63.037077] niks3-server[1016]: 2026/09/20 13:34:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4374worker1 # [ 62.958871] nix-grpc-daemon[844]: time=2026-09-20T13:34:33.478Z level=INFO msg="Uploading 1 narinfos"4375lb # [ 63.048244] niks3-server[1016]: 2026/09/20 13:34:33 INFO Signed narinfos id=16 count=14376lb # [ 63.054548] niks3-server[1016]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4377lb # [ 63.062950] niks3-server[1016]: 2026/09/20 13:34:33 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4378lb # [ 63.071983] niks3-server[1016]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4379worker1 # [ 62.993629] nix-grpc-daemon[844]: time=2026-09-20T13:34:33.513Z level=INFO msg="Upload complete. (323ms)"4380lb # [ 63.076608] niks3-server[1016]: 2026/09/20 13:34:33 INFO Completed upload id=164381worker1 # [ 63.000578] nix-grpc-daemon[777]: ts=2026-09-20T13:34:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14382worker1 # [ 63.008326] nix-daemon[834]: reaped child process 1109, status = succeeded4383worker2 # [ 62.981221] nix-grpc-daemon[778]: ts=2026-09-20T13:34:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:536404384worker2 # [ 62.995339] nix-grpc-daemon[778]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4385worker2 # [ 63.040159] nix-grpc-daemon[778]: ts=2026-09-20T13:34:33Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:536404386worker2 # [ 63.047083] nix-grpc-daemon[778]: ts=2026-09-20T13:34:33Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53640 duration_s=0 paths=1 nar_bytes_out=2324387client # [ 63.158859] nix-daemon[945]: reaped child process 947, status = succeeded4388client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.74 seconds)4389client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4390client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4391client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4392client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4393client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4394client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4395(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.86 seconds)4396subtest: an input only one worker has still reaches the builder4397client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4398client # this derivation will be built:4399client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4400client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4401client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.45 seconds)4402client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4403client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds)4404worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4405worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds)4406worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4407worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4408client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24409client # [ 64.473255] nix-daemon[945]: accepted connection from pid 1028, user root (trusted)4410client # this derivation will be built:4411client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4412worker1 # [ 64.732207] nix-grpc-daemon[777]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:474944413client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4414worker1 # [ 64.740115] nix-grpc-daemon[777]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474944415worker1 # [ 64.941042] nix-daemon[834]: accepted connection from pid 1136, user nix-grpc-daemon (trusted)4416worker1 # [ 64.959661] nix-daemon[834]: reaped child process 1139, status = succeeded4417lb # [ 65.058971] niks3-server[1016]: 2026/09/20 13:34:35 INFO Received uploads request method=POST path=/api/pending_closures4418worker1 # [ 64.987293] nix-grpc-daemon[844]: time=2026-09-20T13:34:35.507Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4419worker1 # [ 64.989335] nix-grpc-daemon[844]: time=2026-09-20T13:34:35.509Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4420lb # [ 65.091750] niks3-server[1016]: 2026/09/20 13:34:35 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4421worker1 # [ 65.021938] nix-grpc-daemon[844]: time=2026-09-20T13:34:35.541Z level=INFO msg="Uploading 1 narinfos"4422lb # [ 65.105173] niks3-server[1016]: 2026/09/20 13:34:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4423lb # [ 65.108000] niks3-server[1016]: 2026/09/20 13:34:35 INFO Signed narinfos id=17 count=14424lb # [ 65.115955] niks3-server[1016]: 2026/09/20 13:34:35 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4425lb # [ 65.124719] niks3-server[1016]: 2026/09/20 13:34:35 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4426lb # [ 65.131376] niks3-server[1016]: 2026/09/20 13:34:35 INFO Completed upload id=174427worker1 # [ 65.047971] nix-grpc-daemon[844]: time=2026-09-20T13:34:35.568Z level=INFO msg="Upload complete. (309ms)"4428lb # [ 65.133894] niks3-server[1016]: 2026/09/20 13:34:35 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4429worker2 # [ 65.053936] nix-grpc-daemon[778]: ts=2026-09-20T13:34:35Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04430worker2 # [ 65.054318] nix-grpc-daemon[778]: ts=2026-09-20T13:34:35Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14431worker2 # [ 65.098874] nix-grpc-daemon[778]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536404432worker2 # [ 65.117137] nix-grpc-daemon[778]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536404433client # copying 2 paths to 'lb:50051'...4434client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4435worker2 # [ 65.139585] nix-grpc-daemon[778]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:536404436client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4437worker2 # [ 65.156162] nix-daemon[846]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4438worker2 # [ 65.381449] nix-daemon[846]: accepted connection from pid 984, user nix-grpc-daemon (trusted)4439worker2 # [ 65.401105] nix-daemon[846]: reaped child process 987, status = succeeded4440worker2 # [ 65.577381] nix-daemon[846]: accepted connection from pid 989, user nix-grpc-daemon (trusted)4441worker2 # [ 65.595330] nix-daemon[846]: reaped child process 992, status = succeeded4442lb # [ 65.713447] niks3-server[1016]: 2026/09/20 13:34:36 INFO Received uploads request method=POST path=/api/pending_closures4443lb # [ 65.723949] niks3-server[1016]: 2026/09/20 13:34:36 INFO Received uploads request method=POST path=/api/pending_closures4444worker2 # [ 65.627502] nix-grpc-daemon[898]: time=2026-09-20T13:34:36.123Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4445worker2 # [ 65.629150] nix-grpc-daemon[898]: time=2026-09-20T13:34:36.123Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4446worker2 # [ 65.630888] nix-grpc-daemon[898]: time=2026-09-20T13:34:36.123Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4447lb # [ 65.767489] niks3-server[1016]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4448lb # [ 65.780865] niks3-server[1016]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4449lb # [ 65.788895] niks3-server[1016]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4450lb # [ 65.798159] niks3-server[1016]: 2026/09/20 13:34:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4451worker2 # [ 65.692485] nix-grpc-daemon[898]: time=2026-09-20T13:34:36.188Z level=INFO msg="Uploading 3 narinfos"4452lb # [ 65.807944] niks3-server[1016]: 2026/09/20 13:34:36 INFO Signed narinfos id=18 count=14453lb # [ 65.813199] niks3-server[1016]: 2026/09/20 13:34:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4454lb # [ 65.821756] niks3-server[1016]: 2026/09/20 13:34:36 INFO Signed narinfos id=19 count=24455lb # [ 65.823964] niks3-server[1016]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4456lb # [ 65.833404] niks3-server[1016]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4457lb # [ 65.843217] niks3-server[1016]: 2026/09/20 13:34:36 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4458lb # [ 65.848613] niks3-server[1016]: 2026/09/20 13:34:36 INFO Completed upload id=184459lb # [ 65.850214] niks3-server[1016]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4460lb # [ 65.855257] niks3-server[1016]: 2026/09/20 13:34:36 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4461lb # [ 65.858879] niks3-server[1016]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4462lb # [ 65.861825] niks3-server[1016]: 2026/09/20 13:34:36 INFO Completed upload id=194463worker2 # [ 65.754885] nix-grpc-daemon[898]: time=2026-09-20T13:34:36.252Z level=INFO msg="Upload complete. (576ms)"4464worker2 # [ 65.765174] nix-grpc-daemon[778]: ts=2026-09-20T13:34:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53640 duration_s=0 paths=2 nar_bytes_in=9844465worker2 # [ 65.780633] nix-grpc-daemon[778]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536404466worker2 # [ 65.791848] nix-daemon[846]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4467worker2 # [ 65.799722] nix-daemon[846]: reaped child process 982, status = succeeded4468worker2 # [ 65.817123] nix-grpc-daemon[778]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4469client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4470worker2 # [ 65.836073] nix-daemon[846]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4471client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4472worker2 # [ 67.264308] nix-daemon[846]: reaped child process 997, status = succeeded4473worker2 # [ 67.421010] nix-daemon[846]: accepted connection from pid 1012, user nix-grpc-daemon (trusted)4474worker2 # [ 67.440869] nix-daemon[846]: reaped child process 1015, status = succeeded4475lb # [ 67.559707] niks3-server[1016]: 2026/09/20 13:34:38 INFO Received uploads request method=POST path=/api/pending_closures4476worker2 # [ 67.463265] nix-grpc-daemon[898]: time=2026-09-20T13:34:37.960Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4477lb # [ 67.589412] niks3-server[1016]: 2026/09/20 13:34:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4478worker2 # [ 67.490981] nix-grpc-daemon[898]: time=2026-09-20T13:34:37.988Z level=INFO msg="Uploading 1 narinfos"4479lb # [ 67.600526] niks3-server[1016]: 2026/09/20 13:34:38 INFO Signed narinfos id=20 count=14480lb # [ 67.612670] niks3-server[1016]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4481lb # [ 67.624332] niks3-server[1016]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4482lb # [ 67.633387] niks3-server[1016]: 2026/09/20 13:34:38 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4483lb # [ 67.644232] niks3-server[1016]: 2026/09/20 13:34:38 INFO Completed upload id=204484worker2 # [ 67.537383] nix-grpc-daemon[898]: time=2026-09-20T13:34:38.034Z level=INFO msg="Upload complete. (284ms)"4485lb # [ 67.647911] niks3-server[1016]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4486worker2 # [ 67.548297] nix-grpc-daemon[778]: ts=2026-09-20T13:34:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53640 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14487worker2 # [ 67.563928] nix-daemon[846]: reaped child process 994, status = succeeded4488client # copying 1 paths...4489worker1 # [ 67.623635] nix-grpc-daemon[777]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:474944490worker1 # [ 67.641819] nix-grpc-daemon[777]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4491client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4492worker1 # [ 67.694344] nix-grpc-daemon[777]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:474944493worker1 # [ 67.699774] nix-grpc-daemon[777]: ts=2026-09-20T13:34:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=0 paths=1 nar_bytes_out=1204494client # [ 67.779414] nix-daemon[945]: reaped child process 1031, status = succeeded4495client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.55 seconds)4496client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24497client # [ 68.014080] nix-daemon[945]: accepted connection from pid 1050, user root (trusted)4498client # this derivation will be built:4499client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4500worker1 # [ 68.264060] nix-grpc-daemon[777]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:474944501client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4502worker2 # [ 68.245119] nix-grpc-daemon[778]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536404503worker2 # [ 68.258385] nix-grpc-daemon[898]: time=2026-09-20T13:34:38.755Z level=INFO msg="All 1 paths already cached"4504worker2 # [ 68.277780] nix-grpc-daemon[778]: ts=2026-09-20T13:34:38Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04505worker2 # [ 68.285171] nix-grpc-daemon[778]: ts=2026-09-20T13:34:38Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14506worker1 # [ 68.312457] nix-grpc-daemon[777]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474944507worker1 # [ 68.328799] nix-grpc-daemon[777]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474944508client # copying 1 paths to 'lb:50051'...4509client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4510worker1 # [ 68.351366] nix-grpc-daemon[777]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474944511worker1 # [ 68.366689] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4512worker1 # [ 68.389892] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 1/5)4513worker1 # [ 68.461360] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 183 ms (attempt 2/5)4514worker1 # [ 68.653103] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 299 ms (attempt 3/5)4515worker1 # [ 68.960208] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 4/5)4516worker1 # [ 68.997039] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4517worker1 # [ 69.006618] nix-grpc-daemon[777]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4518worker1 # [ 69.241482] nix-daemon[834]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4519worker1 # [ 69.261487] nix-daemon[834]: reaped child process 1151, status = succeeded4520worker1 # [ 69.434773] nix-daemon[834]: accepted connection from pid 1153, user nix-grpc-daemon (trusted)4521worker1 # [ 69.453325] nix-daemon[834]: reaped child process 1156, status = succeeded4522lb # [ 69.551307] niks3-server[1016]: 2026/09/20 13:34:40 INFO Received uploads request method=POST path=/api/pending_closures4523worker1 # [ 69.479765] nix-grpc-daemon[844]: time=2026-09-20T13:34:39.999Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4524worker1 # [ 69.481593] nix-grpc-daemon[844]: time=2026-09-20T13:34:39.999Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4525lb # [ 69.581079] niks3-server[1016]: 2026/09/20 13:34:40 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4526lb # [ 69.597198] niks3-server[1016]: 2026/09/20 13:34:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4527worker1 # [ 69.520552] nix-grpc-daemon[844]: time=2026-09-20T13:34:40.040Z level=INFO msg="Uploading 1 narinfos"4528lb # [ 69.611270] niks3-server[1016]: 2026/09/20 13:34:40 INFO Signed narinfos id=21 count=14529lb # [ 69.618388] niks3-server[1016]: 2026/09/20 13:34:40 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4530lb # [ 69.630383] niks3-server[1016]: 2026/09/20 13:34:40 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4531lb # [ 69.636959] niks3-server[1016]: 2026/09/20 13:34:40 INFO Completed upload id=214532worker1 # [ 69.553961] nix-grpc-daemon[844]: time=2026-09-20T13:34:40.074Z level=INFO msg="Upload complete. (514ms)"4533lb # [ 69.640101] niks3-server[1016]: 2026/09/20 13:34:40 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4534worker1 # [ 69.564400] nix-grpc-daemon[777]: ts=2026-09-20T13:34:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=1 paths=1 nar_bytes_in=5684535worker1 # [ 69.572474] nix-grpc-daemon[777]: ts=2026-09-20T13:34:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474944536worker1 # [ 69.586593] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4537worker1 # [ 69.592437] nix-daemon[834]: reaped child process 1142, status = succeeded4538client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4539client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4540worker1 # [ 69.609028] nix-daemon[834]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4541lb # [ 70.152346] envoy[915]: conn peer=[2001:db8:1::1]:37418 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3849 tx=1989 ms=20854542lb # [ 70.157245] envoy[915]: conn peer=[2001:db8:1::1]:37420 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=744543lb # [ 70.161948] envoy[915]: conn peer=[2001:db8:1::1]:37422 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4313 tx=2199 ms=23694544lb # [ 70.167571] envoy[915]: conn peer=[2001:db8:1::1]:42752 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=734545lb # [ 70.172404] envoy[915]: conn peer=[2001:db8:1::1]:42754 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3851 tx=1879 ms=30264546lb # [ 70.177067] envoy[915]: conn peer=[2001:db8:1::1]:42760 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=654547worker1 # [ 70.659599] nix-daemon[834]: reaped child process 1160, status = succeeded4548worker1 # [ 70.841847] nix-daemon[834]: accepted connection from pid 1175, user nix-grpc-daemon (trusted)4549worker1 # [ 70.861542] nix-daemon[834]: reaped child process 1178, status = succeeded4550lb # [ 70.963649] niks3-server[1016]: 2026/09/20 13:34:41 INFO Received uploads request method=POST path=/api/pending_closures4551worker1 # [ 70.892435] nix-grpc-daemon[844]: time=2026-09-20T13:34:41.411Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4552lb # [ 71.001564] niks3-server[1016]: 2026/09/20 13:34:41 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4553lb # [ 71.013389] niks3-server[1016]: 2026/09/20 13:34:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4554worker1 # [ 70.936307] nix-grpc-daemon[844]: time=2026-09-20T13:34:41.456Z level=INFO msg="Uploading 1 narinfos"4555lb # [ 71.021566] niks3-server[1016]: 2026/09/20 13:34:41 INFO Signed narinfos id=22 count=14556lb # [ 71.029304] niks3-server[1016]: 2026/09/20 13:34:41 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4557lb # [ 71.040882] niks3-server[1016]: 2026/09/20 13:34:41 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4558lb # [ 71.048327] niks3-server[1016]: 2026/09/20 13:34:41 INFO Completed upload id=224559worker1 # [ 70.965256] nix-grpc-daemon[844]: time=2026-09-20T13:34:41.485Z level=INFO msg="Upload complete. (344ms)"4560lb # [ 71.051153] niks3-server[1016]: 2026/09/20 13:34:41 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4561worker1 # [ 70.975457] nix-grpc-daemon[777]: ts=2026-09-20T13:34:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14562worker1 # [ 70.993378] nix-daemon[834]: reaped child process 1158, status = succeeded4563client # copying 1 paths...4564worker1 # [ 71.020695] nix-grpc-daemon[777]: ts=2026-09-20T13:34:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:474944565client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4566worker1 # [ 71.046073] nix-grpc-daemon[777]: ts=2026-09-20T13:34:41Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:474944567worker1 # [ 71.052125] nix-grpc-daemon[777]: ts=2026-09-20T13:34:41Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47494 duration_s=0 paths=1 nar_bytes_out=1204568client # [ 71.133763] nix-daemon[945]: reaped child process 1053, status = succeeded4569client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.35 seconds)4570client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24571client # [ 71.356318] nix-daemon[945]: accepted connection from pid 1071, user root (trusted)4572client # this derivation will be built:4573client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4574worker2 # [ 71.581152] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:536404575client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4576worker2 # [ 71.589355] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536404577worker2 # [ 71.765517] nix-grpc-daemon[898]: time=2026-09-20T13:34:42.262Z level=INFO msg="All 1 paths already cached"4578worker2 # [ 71.789456] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04579worker2 # [ 71.797409] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14580worker2 # [ 71.807325] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536404581worker2 # [ 71.820844] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536404582worker2 # [ 71.835778] nix-grpc-daemon[898]: time=2026-09-20T13:34:42.333Z level=INFO msg="All 1 paths already cached"4583client # copying 1 paths to 'lb:50051'...4584client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4585worker2 # [ 71.847161] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:536404586worker2 # [ 71.862465] nix-daemon[846]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4587worker2 # [ 72.062507] nix-daemon[846]: accepted connection from pid 1023, user nix-grpc-daemon (trusted)4588worker2 # [ 72.083780] nix-daemon[846]: reaped child process 1026, status = succeeded4589worker2 # [ 72.255409] nix-daemon[846]: accepted connection from pid 1028, user nix-grpc-daemon (trusted)4590worker2 # [ 72.275251] nix-daemon[846]: reaped child process 1031, status = succeeded4591lb # [ 72.394099] niks3-server[1016]: 2026/09/20 13:34:42 INFO Received uploads request method=POST path=/api/pending_closures4592worker2 # [ 72.296960] nix-grpc-daemon[898]: time=2026-09-20T13:34:42.794Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4593worker2 # [ 72.298501] nix-grpc-daemon[898]: time=2026-09-20T13:34:42.794Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4594lb # [ 72.421403] niks3-server[1016]: 2026/09/20 13:34:42 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4595lb # [ 72.439965] niks3-server[1016]: 2026/09/20 13:34:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4596worker2 # [ 72.338616] nix-grpc-daemon[898]: time=2026-09-20T13:34:42.835Z level=INFO msg="Uploading 1 narinfos"4597lb # [ 72.452410] niks3-server[1016]: 2026/09/20 13:34:42 INFO Signed narinfos id=23 count=14598lb # [ 72.455668] niks3-server[1016]: 2026/09/20 13:34:42 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4599lb # [ 72.467276] niks3-server[1016]: 2026/09/20 13:34:42 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4600worker2 # [ 72.365979] nix-grpc-daemon[898]: time=2026-09-20T13:34:42.863Z level=INFO msg="Upload complete. (486ms)"4601lb # [ 72.475783] niks3-server[1016]: 2026/09/20 13:34:42 INFO Completed upload id=234602lb # [ 72.480064] niks3-server[1016]: 2026/09/20 13:34:42 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4603worker2 # [ 72.376448] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53640 duration_s=0 paths=1 nar_bytes_in=5684604worker2 # [ 72.391183] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536404605worker2 # [ 72.397899] nix-daemon[846]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4606worker2 # [ 72.403193] nix-daemon[846]: reaped child process 1021, status = succeeded4607client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4608client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4609worker2 # [ 72.419464] nix-daemon[846]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4610worker2 # [ 73.857265] nix-daemon[846]: reaped child process 1035, status = succeeded4611worker2 # [ 74.025351] nix-daemon[846]: accepted connection from pid 1050, user nix-grpc-daemon (trusted)4612worker2 # [ 74.047275] nix-daemon[846]: reaped child process 1053, status = succeeded4613lb # [ 74.170408] niks3-server[1016]: 2026/09/20 13:34:44 INFO Received uploads request method=POST path=/api/pending_closures4614worker2 # [ 74.209186] nix-grpc-daemon[898]: time=2026-09-20T13:34:44.703Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4615lb # [ 74.336559] niks3-server[1016]: 2026/09/20 13:34:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4616worker2 # [ 74.236826] nix-grpc-daemon[898]: time=2026-09-20T13:34:44.733Z level=INFO msg="Uploading 1 narinfos"4617lb # [ 74.351840] niks3-server[1016]: 2026/09/20 13:34:44 INFO Signed narinfos id=24 count=14618lb # [ 74.360421] niks3-server[1016]: 2026/09/20 13:34:44 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4619lb # [ 74.369968] niks3-server[1016]: 2026/09/20 13:34:44 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4620lb # [ 74.633075] niks3-server[1016]: 2026/09/20 13:34:45 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4621lb # [ 74.648315] niks3-server[1016]: 2026/09/20 13:34:45 INFO Completed upload id=244622worker2 # [ 74.541702] nix-grpc-daemon[898]: time=2026-09-20T13:34:45.039Z level=INFO msg="Upload complete. (709ms)"4623worker2 # [ 74.553536] nix-grpc-daemon[778]: ts=2026-09-20T13:34:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53640 duration_s=2 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14624lb # [ 74.664343] niks3-server[1016]: 2026/09/20 13:34:45 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4625worker2 # [ 74.575589] nix-daemon[846]: reaped child process 1033, status = succeeded4626client # copying 1 paths...4627worker1 # [ 74.625791] nix-grpc-daemon[777]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:474944628worker1 # [ 74.639736] nix-grpc-daemon[777]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4629client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4630worker2 # [ 74.664257] nix-grpc-daemon[778]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:536404631worker2 # [ 74.670397] nix-grpc-daemon[778]: ts=2026-09-20T13:34:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53640 duration_s=0 paths=1 nar_bytes_out=1204632client # [ 74.738725] nix-daemon[945]: reaped child process 1074, status = succeeded4633client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.61 seconds)4634(finished: subtest: an input only one worker has still reaches the builder, in 11.45 seconds)4635subtest: upload whose reference the worker lacks is completed from the cache4636client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4637client # this derivation will be built:4638client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4639client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4640client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.46 seconds)4641client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4642client # this derivation will be built:4643client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4644client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4645client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.45 seconds)4646client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4647client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4648worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4649worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4650worker2 # [ 76.201259] systemd[1]: Stopping Nix worker-protocol over gRPC...4651worker2 # [ 76.361728] nix-grpc-daemon[778]: ts=2026-09-20T13:34:46Z level=info event=signal_exit4652worker2 # [ 76.611681] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=scheduler_yield4653lb # [ 76.722424] niks3-server[1016]: 2026/09/20 13:34:47 INFO lead: released remote=192.168.1.4:404044654worker2 # [ 76.617608] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=scheduler_restarting addr=lb:500514655worker1 # [ 76.647796] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=info event=scheduler_restarting addr=lb:500514656worker2 # [ 76.623750] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:485604657worker2 # [ 76.630588] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=worker_gone addr=192.168.1.4:500514658worker2 # [ 76.634975] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:485604659worker2 # [ 76.639599] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=worker_gone addr=192.168.1.3:500514660worker2 # [ 76.819174] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=scheduler_connected addr=lb:500514661worker1 # [ 76.847993] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=info event=scheduler_connected addr=lb:500514662worker2 # [ 76.824852] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4663worker1 # [ 76.853447] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4664worker2 # [ 77.026222] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=scheduler_connected addr=lb:500514665worker1 # [ 77.054712] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=info event=scheduler_connected addr=lb:500514666worker2 # [ 77.031718] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4667worker1 # [ 77.060711] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4668worker2 # [ 77.233156] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=scheduler_connected addr=lb:500514669worker1 # [ 77.261666] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=info event=scheduler_connected addr=lb:500514670worker2 # [ 77.238707] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4671worker1 # [ 77.267236] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4672worker2 # [ 77.441936] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=scheduler_connected addr=lb:500514673worker1 # [ 77.468132] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=info event=scheduler_connected addr=lb:500514674worker2 # [ 77.446544] nix-grpc-daemon[778]: ts=2026-09-20T13:34:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4675worker1 # [ 77.473504] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4676worker2 # [ 77.617990] nix-grpc-daemon[778]: ts=2026-09-20T13:34:48Z level=info event=scheduler_restarting4677worker1 # [ 77.676499] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=info event=scheduler_connected addr=lb:500514678worker1 # [ 77.680728] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4679worker2 # [ 77.663619] nix-grpc-daemon[778]: ts=2026-09-20T13:34:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4680worker2 # [ 77.679383] nix-daemon[846]: reaped child process 848, status = succeeded4681worker1 # [ 77.876999] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=info event=scheduler_connected addr=lb:500514682worker1 # [ 77.882294] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4683worker1 # [ 78.083080] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=info event=scheduler_connected addr=lb:500514684worker1 # [ 78.088566] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4685worker1 # [ 78.289771] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=info event=scheduler_connected addr=lb:500514686worker1 # [ 78.295233] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4687worker1 # [ 78.495893] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=scheduler_connected addr=lb:500514688worker1 # [ 78.501290] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4689worker2 # [ 78.529909] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4690worker2 # [ 78.537003] systemd[1]: Stopped Nix worker-protocol over gRPC.4691worker2 # [ 78.539680] systemd[1]: nix-grpc-daemon.service: Consumed 1.976s CPU time over 57.480s wall clock time, 52.1M memory peak, 53.4K incoming IP traffic, 122.7K outgoing IP traffic.4692worker2 # [ 78.555853] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4693worker2 # [ 78.561430] systemd[1]: Closed Nix worker-protocol over gRPC.4694worker2 # [ 78.563692] systemd[1]: nix-grpc-daemon.socket: Consumed 683us CPU time over 1min 6.545s wall clock time, 256K memory peak, 75.9K incoming IP traffic, 62.4K outgoing IP traffic.4695lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4696lb: must succeed: curl -sf localhost:9901/clusters4697lb # [ 78.756786] niks3-server[1016]: 2026/09/20 13:34:49 INFO lead: acquired remote=192.168.1.3:502104698worker1 # [ 78.673147] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=scheduler_take_over4699lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4700lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4701client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24702worker1 # [ 78.703810] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=scheduler_connected addr=lb:500514703worker1 # [ 78.708119] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4704worker1 # [ 78.904483] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=scheduler_connected addr=lb:500514705worker1 # [ 78.909803] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4706worker1 # [ 78.953039] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:474944707client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4708worker1 # [ 78.960430] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:474944709client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds)4710worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4711worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4712worker2 # [ 79.074955] systemd[1]: Listening on Nix worker-protocol over gRPC.4713worker1 # [ 79.110826] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=scheduler_connected addr=lb:500514714worker1 # [ 79.117585] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4715worker1 # [ 79.188763] systemd[1]: Stopping Nix worker-protocol over gRPC...4716worker1 # [ 79.317429] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=scheduler_connected addr=lb:500514717worker1 # [ 79.322838] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4718worker1 # [ 79.416790] nix-grpc-daemon[777]: ts=2026-09-20T13:34:49Z level=info event=signal_exit4719worker1 # [ 79.523645] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=info event=scheduler_connected addr=lb:500514720worker1 # [ 79.529131] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4721worker2 # [ 79.564606] systemd[1]: Starting scheduler-token.service...4722worker1 # [ 79.679079] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=info event=scheduler_yield4723lb # [ 79.763636] niks3-server[1016]: 2026/09/20 13:34:50 INFO lead: released remote=192.168.1.3:502104724worker2 # [ 79.680879] systemd[1]: scheduler-token.service: Deactivated successfully.4725worker2 # [ 79.688805] systemd[1]: Finished scheduler-token.service.4726worker2 # [ 79.690723] systemd[1]: scheduler-token.service: Consumed 52ms CPU time over 121ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4727worker2 # [ 79.700393] systemd[1]: Starting Nix worker-protocol over gRPC...4728worker1 # [ 79.731825] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=info event=scheduler_connected addr=lb:500514729worker1 # [ 79.736145] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4730worker2 # [ 79.895232] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4731worker2 # [ 79.897817] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4732worker2 # [ 79.902145] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14733worker1 # [ 79.932893] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=info event=scheduler_connected addr=lb:500514734worker2 # [ 79.911942] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4735worker1 # [ 79.938180] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4736worker2 # [ 79.924778] systemd[1]: Started Nix worker-protocol over gRPC.4737worker2 # [ 79.926219] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:50Z level=info event=scheduler_take_over4738lb # [ 80.032834] niks3-server[1016]: 2026/09/20 13:34:50 INFO lead: acquired remote=192.168.1.4:385724739worker2 # [ 79.944251] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:50Z level=info event=scheduler_connected addr=lb:500514740worker2 # [ 79.952969] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:50Z level=info event=oidc_jwks provider=mock keys=14741worker2 # [ 79.954487] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:50Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:466544742worker2 # [ 79.956571] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:50Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04743lb # [ 80.150253] envoy[915]: conn peer=[2001:db8:1::1]:42772 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3713 tx=1828 ms=28454744lb # [ 80.155573] envoy[915]: conn peer=[2001:db8:1::1]:33524 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=654745lb # [ 80.160531] envoy[915]: conn peer=[2001:db8:1::1]:33528 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3731 tx=1912 ms=31074746lb # [ 80.166100] envoy[915]: conn peer=[2001:db8:1::1]:33534 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=284747lb # [ 80.170991] envoy[915]: conn peer=[2001:db8:1::4]:51516 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=33565 tx=1894 ms=562954748lb # [ 80.176057] envoy[915]: conn peer=[2001:db8:1::1]:33550 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=224749worker1 # [ 80.139199] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=info event=scheduler_connected addr=lb:500514750worker2 # [ 80.117417] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:50Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:466544751worker2 # [ 80.122885] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:50Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04752worker1 # [ 80.681199] nix-grpc-daemon[777]: ts=2026-09-20T13:34:51Z level=info event=scheduler_restarting4753worker2 # [ 80.667958] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:466544754worker2 # [ 80.672863] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:51Z level=info event=worker_gone addr=192.168.1.3:500514755worker1 # [ 80.717254] nix-grpc-daemon[777]: ts=2026-09-20T13:34:51Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4756worker1 # [ 80.739518] nix-daemon[834]: reaped child process 836, status = succeeded4757worker1 # [ 81.572865] nix-grpc-daemon[777]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4758worker1 # [ 81.577941] nix-grpc-daemon[777]: E0000 00:00:1789911292.091490 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4759worker1 # [ 81.585389] nix-grpc-daemon[777]: E0000 00:00:1789911292.104896 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4760worker1 # [ 82.457087] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4761worker1 # [ 82.463814] systemd[1]: Stopped Nix worker-protocol over gRPC.4762worker1 # [ 82.468472] systemd[1]: nix-grpc-daemon.service: Consumed 3.929s CPU time over 1min 2.383s wall clock time, 59.7M memory peak, 87.6K incoming IP traffic, 158.7K outgoing IP traffic.4763worker1 # [ 82.483362] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4764worker1 # [ 82.486795] systemd[1]: Closed Nix worker-protocol over gRPC.4765worker1 # [ 82.490052] systemd[1]: nix-grpc-daemon.socket: Consumed 596us CPU time over 1min 11.276s wall clock time, 256K memory peak, 77K incoming IP traffic, 63.2K outgoing IP traffic.4766lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4767lb: must succeed: curl -sf localhost:9901/clusters4768lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4769lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4770client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24771worker2 # [ 82.806292] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492204772worker2 # [ 82.822855] nix-daemon[846]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4773worker2 # [ 82.849870] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 1/5)4774worker2 # [ 82.888827] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 2/5)4775worker2 # [ 83.044496] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 159 ms (attempt 3/5)4776worker2 # [ 83.211305] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 14 ms (attempt 4/5)4777worker2 # [ 83.233616] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4778client # copying 2 paths...4779client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4780worker2 # [ 83.260926] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492204781client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4782worker2 # [ 83.278854] nix-daemon[846]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4783worker2 # [ 83.308490] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:53Z level=info event=niks3_push_started pid=11334784worker2 # [ 83.531549] nix-grpc-daemon[1133]: time=2026-09-20T13:34:54.028Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4785worker2 # [ 83.706262] nix-daemon[846]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)4786worker2 # [ 83.724825] nix-daemon[846]: reaped child process 1149, status = succeeded4787lb # [ 83.844911] niks3-server[1016]: 2026/09/20 13:34:54 INFO Received uploads request method=POST path=/api/pending_closures4788lb # [ 83.854945] niks3-server[1016]: 2026/09/20 13:34:54 INFO Received uploads request method=POST path=/api/pending_closures4789worker2 # [ 83.758677] nix-grpc-daemon[1133]: time=2026-09-20T13:34:54.254Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4790worker2 # [ 83.761419] nix-grpc-daemon[1133]: time=2026-09-20T13:34:54.254Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4791worker2 # [ 83.763321] nix-grpc-daemon[1133]: time=2026-09-20T13:34:54.254Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4792lb # [ 83.921998] niks3-server[1016]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4793lb # [ 83.934935] niks3-server[1016]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4794lb # [ 83.950625] niks3-server[1016]: 2026/09/20 13:34:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4795lb # [ 83.958078] niks3-server[1016]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4796lb # [ 83.965517] niks3-server[1016]: 2026/09/20 13:34:54 INFO Signed narinfos id=25 count=14797lb # [ 83.968770] niks3-server[1016]: 2026/09/20 13:34:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4798worker2 # [ 83.860130] nix-grpc-daemon[1133]: time=2026-09-20T13:34:54.355Z level=INFO msg="Uploading 3 narinfos"4799lb # [ 83.970852] niks3-server[1016]: 2026/09/20 13:34:54 INFO Signed narinfos id=26 count=24800lb # [ 83.977710] niks3-server[1016]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4801lb # [ 83.991519] niks3-server[1016]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4802lb # [ 83.997053] niks3-server[1016]: 2026/09/20 13:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4803lb # [ 84.006282] niks3-server[1016]: 2026/09/20 13:34:54 INFO Completed upload id=254804lb # [ 84.009502] niks3-server[1016]: 2026/09/20 13:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4805lb # [ 84.011954] niks3-server[1016]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4806lb # [ 84.017107] niks3-server[1016]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4807lb # [ 84.020561] niks3-server[1016]: 2026/09/20 13:34:54 INFO Completed upload id=264808worker2 # [ 83.914017] nix-grpc-daemon[1133]: time=2026-09-20T13:34:54.411Z level=INFO msg="Upload complete. (378ms)"4809worker2 # [ 83.925437] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49220 duration_s=0 paths=2 nar_bytes_in=3124810worker2 # [ 83.944830] nix-daemon[846]: reaped child process 1131, status = succeeded4811client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.41 seconds)4812worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4813worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4814worker1 # [ 84.111820] systemd[1]: Listening on Nix worker-protocol over gRPC.4815worker1 # [ 84.121660] systemd[1]: Starting Nix worker-protocol over gRPC...4816worker1 # [ 84.319245] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4817worker1 # [ 84.322040] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4818worker1 # [ 84.326542] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14819worker1 # [ 84.335468] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4820worker1 # [ 84.341439] systemd[1]: Started Nix worker-protocol over gRPC.4821lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4822lb: must succeed: curl -sf localhost:9901/clusters4823worker1 # [ 84.365519] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:54Z level=info event=scheduler_connected addr=lb:500514824worker2 # [ 84.344114] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:54Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:466544825worker2 # [ 84.349949] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:54Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04826lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4827lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)4828(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.67 seconds)4829subtest: scheduler down: the other node takes the lock and keeps it4830lb: must succeed: curl -sf localhost:9901/clusters4831lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4832lb: must succeed: curl -sf localhost:9901/clusters4833lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4834lb: must succeed: curl -sf localhost:9901/clusters4835lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4836lb: must succeed: curl -sf localhost:9901/clusters4837lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4838worker2 # [ 84.706137] systemd[1]: Stopping Nix worker-protocol over gRPC...4839worker2 # [ 84.920568] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:55Z level=info event=signal_exit4840worker2 # [ 84.928838] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:55Z level=info event=scheduler_yield4841lb # [ 85.037309] niks3-server[1016]: 2026/09/20 13:34:55 INFO lead: released remote=192.168.1.4:385724842worker1 # [ 84.956471] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:55Z level=info event=scheduler_restarting addr=lb:500514843worker2 # [ 84.944060] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:466544844worker2 # [ 84.949297] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:55Z level=info event=worker_gone addr=192.168.1.3:500514845worker2 # [ 84.955329] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:55Z level=info event=scheduler_restarting addr=lb:500514846worker2 # [ 84.961225] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:466544847worker2 # [ 84.965951] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:55Z level=info event=worker_gone addr=192.168.1.4:500514848worker1 # [ 85.157606] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:55Z level=info event=scheduler_connected addr=lb:500514849worker1 # [ 85.162805] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4850worker2 # [ 85.145575] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:55Z level=info event=scheduler_connected addr=lb:500514851worker2 # [ 85.150916] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4852worker1 # [ 85.365498] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:55Z level=info event=scheduler_connected addr=lb:500514853worker1 # [ 85.369645] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4854worker2 # [ 85.352046] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:55Z level=info event=scheduler_connected addr=lb:500514855worker2 # [ 85.357174] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4856worker1 # [ 85.566085] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:56Z level=info event=scheduler_connected addr=lb:500514857worker1 # [ 85.571338] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4858worker2 # [ 85.558305] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:56Z level=info event=scheduler_connected addr=lb:500514859worker2 # [ 85.563423] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4860worker1 # [ 85.772564] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:56Z level=info event=scheduler_connected addr=lb:500514861worker1 # [ 85.777869] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4862worker2 # [ 85.764556] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:56Z level=info event=scheduler_connected addr=lb:500514863worker2 # [ 85.769601] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4864worker2 # [ 85.938863] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:56Z level=info event=scheduler_restarting4865worker1 # [ 85.978491] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:56Z level=info event=scheduler_connected addr=lb:500514866worker2 # [ 85.956936] nix-grpc-daemon[1077]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4867worker1 # [ 85.983918] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4868worker2 # [ 85.968289] nix-grpc-daemon[1077]: E0000 00:00:1789911296.454111 1120 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4869worker2 # [ 85.991205] nix-grpc-daemon[1077]: E0000 00:00:1789911296.454484 1120 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4870worker2 # [ 85.997793] nix-grpc-daemon[1077]: ts=2026-09-20T13:34:56Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4871worker2 # [ 86.003458] nix-daemon[846]: reaped child process 1126, status = succeeded4872worker1 # [ 86.184773] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:56Z level=info event=scheduler_connected addr=lb:500514873worker1 # [ 86.189868] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4874worker1 # [ 86.392580] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:56Z level=info event=scheduler_connected addr=lb:500514875worker1 # [ 86.396689] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4876worker1 # [ 86.593340] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:57Z level=info event=scheduler_connected addr=lb:500514877worker1 # [ 86.598831] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4878worker1 # [ 86.799653] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:57Z level=info event=scheduler_connected addr=lb:500514879worker1 # [ 86.805143] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4880worker1 # [ 87.005999] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:57Z level=info event=scheduler_connected addr=lb:500514881worker1 # [ 87.011216] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4882worker1 # [ 87.212102] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:57Z level=info event=scheduler_connected addr=lb:500514883worker1 # [ 87.217340] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4884worker1 # [ 87.419988] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:57Z level=info event=scheduler_connected addr=lb:500514885worker1 # [ 87.424123] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4886worker1 # [ 87.620705] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514887worker1 # [ 87.625868] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4888worker1 # [ 87.826739] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514889worker1 # [ 87.831939] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4890worker2 # [ 87.948449] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4891worker2 # [ 87.951425] systemd[1]: Stopped Nix worker-protocol over gRPC.4892worker2 # [ 87.956291] systemd[1]: nix-grpc-daemon.service: Consumed 457ms CPU time over 8.242s wall clock time, 31.1M memory peak, 19.4K incoming IP traffic, 25.6K outgoing IP traffic.4893worker2 # [ 87.971110] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4894worker2 # [ 87.974470] systemd[1]: Closed Nix worker-protocol over gRPC.4895worker2 # [ 87.977804] systemd[1]: nix-grpc-daemon.socket: Consumed 960us CPU time over 8.905s wall clock time, 256K memory peak, 19K incoming IP traffic, 13.8K outgoing IP traffic.4896worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4897worker1 # [ 88.032930] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514898worker1 # [ 88.044431] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4899worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds)4900worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4901worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)4902worker1 # [ 88.241972] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514903worker1 # [ 88.247646] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4904worker1 # [ 88.450371] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514905worker1 # [ 88.456209] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4906worker1 # [ 88.651095] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:59Z level=info event=scheduler_connected addr=lb:500514907worker1 # [ 88.656761] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4908worker1 # [ 88.857578] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:59Z level=info event=scheduler_connected addr=lb:500514909worker1 # [ 88.863001] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4910worker1 # [ 89.064067] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:59Z level=info event=scheduler_connected addr=lb:500514911worker1 # [ 89.069478] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4912worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4913worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4914worker1 # [ 89.270422] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:59Z level=info event=scheduler_connected addr=lb:500514915worker1 # [ 89.275890] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4916lb # [ 89.430307] niks3-server[1016]: 2026/09/20 13:34:59 INFO lead: acquired remote=192.168.1.3:415444917worker1 # [ 89.348311] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:59Z level=info event=scheduler_take_over4918worker1 # [ 89.477975] nix-grpc-daemon[1202]: ts=2026-09-20T13:34:59Z level=info event=scheduler_connected addr=lb:500514919worker1 # [ 89.487414] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:00Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:362104920worker1 # [ 89.492442] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:00Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04921lb # [ 90.151341] envoy[915]: conn peer=[2001:db8:1::3]:60038 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9355 tx=2648 ms=594134922lb # [ 90.151593] envoy[915]: conn peer=[2001:db8:1::1]:43082 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1011 tx=305 ms=11354923lb # [ 90.151778] envoy[915]: conn peer=[2001:db8:1::4]:46488 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4158 tx=349 ms=60434924worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4925worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4926client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24927worker1 # [ 90.561304] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:362264928worker1 # [ 90.577175] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4929client # don't know how to build these paths:4930client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4931worker1 # [ 90.599050] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362264932worker1 # [ 90.616822] nix-grpc-daemon[1202]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5)4933worker1 # [ 90.647614] nix-grpc-daemon[1202]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 2/5)4934worker1 # [ 90.820997] nix-grpc-daemon[1202]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 299 ms (attempt 3/5)4935worker1 # [ 91.120335] nix-grpc-daemon[1202]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 199 ms (attempt 4/5)4936worker1 # [ 91.327561] nix-grpc-daemon[1202]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4937worker1 # [ 91.365413] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:01Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04938worker1 # [ 91.373164] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:01Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14939worker1 # [ 91.414551] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362264940worker1 # [ 91.432452] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362264941client # copying 1 paths to 'lb:50051'...4942client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4943worker1 # [ 91.449015] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362264944worker1 # [ 91.465016] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4945worker1 # [ 91.490735] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=niks3_push_started pid=12754946worker1 # [ 91.700829] nix-grpc-daemon[1275]: time=2026-09-20T13:35:02.220Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""4947worker1 # [ 91.878592] nix-daemon[834]: accepted connection from pid 1288, user nix-grpc-daemon (trusted)4948worker1 # [ 91.899737] nix-daemon[834]: reaped child process 1291, status = succeeded4949worker1 # [ 92.075407] nix-daemon[834]: accepted connection from pid 1293, user nix-grpc-daemon (trusted)4950worker1 # [ 92.097219] nix-daemon[834]: reaped child process 1296, status = succeeded4951lb # [ 92.191714] niks3-server[1016]: 2026/09/20 13:35:02 INFO Received uploads request method=POST path=/api/pending_closures4952worker1 # [ 92.124090] nix-grpc-daemon[1275]: time=2026-09-20T13:35:02.643Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4953worker1 # [ 92.125665] nix-grpc-daemon[1275]: time=2026-09-20T13:35:02.643Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4954lb # [ 92.245772] niks3-server[1016]: 2026/09/20 13:35:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4955lb # [ 92.263571] niks3-server[1016]: 2026/09/20 13:35:02 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4956lb # [ 92.272130] niks3-server[1016]: 2026/09/20 13:35:02 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4957lb # [ 92.280719] niks3-server[1016]: 2026/09/20 13:35:02 INFO Signed narinfos id=27 count=14958worker1 # [ 92.198923] nix-grpc-daemon[1275]: time=2026-09-20T13:35:02.718Z level=INFO msg="Uploading 1 narinfos"4959lb # [ 92.290325] niks3-server[1016]: 2026/09/20 13:35:02 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4960lb # [ 92.304746] niks3-server[1016]: 2026/09/20 13:35:02 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4961lb # [ 92.311975] niks3-server[1016]: 2026/09/20 13:35:02 INFO Completed upload id=274962worker1 # [ 92.229462] nix-grpc-daemon[1275]: time=2026-09-20T13:35:02.749Z level=INFO msg="Upload complete. (523ms)"4963worker1 # [ 92.245428] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36226 duration_s=0 paths=1 nar_bytes_in=5204964worker1 # [ 92.256914] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362264965worker1 # [ 92.270045] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4966worker1 # [ 92.276086] nix-daemon[834]: reaped child process 1273, status = succeeded4967client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4968client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4969worker1 # [ 92.286576] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4970client # farm-a> LOG-farm-a-on-standby4971worker1 # [ 93.331836] nix-daemon[834]: reaped child process 1300, status = succeeded4972worker1 # [ 93.514580] nix-daemon[834]: accepted connection from pid 1315, user nix-grpc-daemon (trusted)4973worker1 # [ 93.534349] nix-daemon[834]: reaped child process 1318, status = succeeded4974lb # [ 93.630898] niks3-server[1016]: 2026/09/20 13:35:04 INFO Received uploads request method=POST path=/api/pending_closures4975worker1 # [ 93.564447] nix-grpc-daemon[1275]: time=2026-09-20T13:35:04.082Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4976worker1 # [ 93.565949] nix-grpc-daemon[1275]: time=2026-09-20T13:35:04.082Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4977lb # [ 93.690204] niks3-server[1016]: 2026/09/20 13:35:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4978worker1 # [ 93.615122] nix-grpc-daemon[1275]: time=2026-09-20T13:35:04.134Z level=INFO msg="Uploading 1 narinfos"4979lb # [ 93.703740] niks3-server[1016]: 2026/09/20 13:35:04 INFO Signed narinfos id=28 count=14980lb # [ 93.711821] niks3-server[1016]: 2026/09/20 13:35:04 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4981lb # [ 93.721615] niks3-server[1016]: 2026/09/20 13:35:04 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4982lb # [ 93.732060] niks3-server[1016]: 2026/09/20 13:35:04 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4983worker1 # [ 93.644648] nix-grpc-daemon[1275]: time=2026-09-20T13:35:04.164Z level=INFO msg="Upload complete. (347ms)"4984lb # [ 93.736329] niks3-server[1016]: 2026/09/20 13:35:04 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4985lb # [ 93.740870] niks3-server[1016]: 2026/09/20 13:35:04 INFO Completed upload id=284986lb # [ 93.744253] niks3-server[1016]: 2026/09/20 13:35:04 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4987worker1 # [ 93.669521] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36226 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14988worker1 # [ 93.684511] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04989worker1 # [ 93.688621] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14990worker1 # [ 93.692851] nix-daemon[834]: reaped child process 1298, status = succeeded4991worker1 # [ 93.714297] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362264992worker1 # [ 93.730429] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362264993worker1 # [ 93.745969] nix-grpc-daemon[1275]: time=2026-09-20T13:35:04.266Z level=INFO msg="All 1 paths already cached"4994client # copying 1 paths to 'lb:50051'...4995client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4996worker1 # [ 93.757570] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362264997worker1 # [ 93.772211] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4998worker1 # [ 93.978589] nix-daemon[834]: accepted connection from pid 1324, user nix-grpc-daemon (trusted)4999worker1 # [ 93.997109] nix-daemon[834]: reaped child process 1327, status = succeeded5000worker1 # [ 94.178225] nix-daemon[834]: accepted connection from pid 1329, user nix-grpc-daemon (trusted)5001worker1 # [ 94.195770] nix-daemon[834]: reaped child process 1332, status = succeeded5002lb # [ 94.290022] niks3-server[1016]: 2026/09/20 13:35:04 INFO Received uploads request method=POST path=/api/pending_closures5003worker1 # [ 94.219904] nix-grpc-daemon[1275]: time=2026-09-20T13:35:04.739Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5004worker1 # [ 94.221650] nix-grpc-daemon[1275]: time=2026-09-20T13:35:04.739Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5005lb # [ 94.324321] niks3-server[1016]: 2026/09/20 13:35:04 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5006lb # [ 94.337025] niks3-server[1016]: 2026/09/20 13:35:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5007worker1 # [ 94.260976] nix-grpc-daemon[1275]: time=2026-09-20T13:35:04.780Z level=INFO msg="Uploading 1 narinfos"5008lb # [ 94.349103] niks3-server[1016]: 2026/09/20 13:35:04 INFO Signed narinfos id=29 count=15009lb # [ 94.357385] niks3-server[1016]: 2026/09/20 13:35:04 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5010lb # [ 94.371077] niks3-server[1016]: 2026/09/20 13:35:04 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5011lb # [ 94.376608] niks3-server[1016]: 2026/09/20 13:35:04 INFO Completed upload id=295012lb # [ 94.380052] niks3-server[1016]: 2026/09/20 13:35:04 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5013worker1 # [ 94.293932] nix-grpc-daemon[1275]: time=2026-09-20T13:35:04.814Z level=INFO msg="Upload complete. (505ms)"5014worker1 # [ 94.304603] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36226 duration_s=0 paths=1 nar_bytes_in=6405015worker1 # [ 94.313018] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362265016worker1 # [ 94.324993] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5017worker1 # [ 94.330871] nix-daemon[834]: reaped child process 1322, status = succeeded5018client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5019worker1 # [ 94.345419] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5020client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5021client # farm-b> LOG-farm-b-on-standby5022worker1 # [ 95.796855] nix-daemon[834]: reaped child process 1336, status = succeeded5023worker1 # [ 95.963847] nix-daemon[834]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5024worker1 # [ 95.983632] nix-daemon[834]: reaped child process 1354, status = succeeded5025lb # [ 96.079522] niks3-server[1016]: 2026/09/20 13:35:06 INFO Received uploads request method=POST path=/api/pending_closures5026worker1 # [ 96.008262] nix-grpc-daemon[1275]: time=2026-09-20T13:35:06.527Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5027worker1 # [ 96.009739] nix-grpc-daemon[1275]: time=2026-09-20T13:35:06.527Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5028lb # [ 96.123271] niks3-server[1016]: 2026/09/20 13:35:06 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5029lb # [ 96.136614] niks3-server[1016]: 2026/09/20 13:35:06 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5030worker1 # [ 96.063663] nix-grpc-daemon[1275]: time=2026-09-20T13:35:06.583Z level=INFO msg="Uploading 1 narinfos"5031lb # [ 96.145757] niks3-server[1016]: 2026/09/20 13:35:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5032lb # [ 96.155220] niks3-server[1016]: 2026/09/20 13:35:06 INFO Signed narinfos id=30 count=15033lb # [ 96.160851] niks3-server[1016]: 2026/09/20 13:35:06 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5034lb # [ 96.169237] niks3-server[1016]: 2026/09/20 13:35:06 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5035lb # [ 96.177857] niks3-server[1016]: 2026/09/20 13:35:06 INFO Completed upload id=305036worker1 # [ 96.095251] nix-grpc-daemon[1275]: time=2026-09-20T13:35:06.615Z level=INFO msg="Upload complete. (334ms)"5037lb # [ 96.181202] niks3-server[1016]: 2026/09/20 13:35:06 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5038worker1 # [ 96.114769] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36226 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15039worker1 # [ 96.132337] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:06Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05040worker1 # [ 96.136456] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:06Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15041worker1 # [ 96.140672] nix-daemon[834]: reaped child process 1334, status = succeeded5042worker1 # [ 96.159303] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362265043worker1 # [ 96.177184] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362265044worker1 # [ 96.193205] nix-grpc-daemon[1275]: time=2026-09-20T13:35:06.713Z level=INFO msg="All 2 paths already cached"5045client # copying 1 paths to 'lb:50051'...5046client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5047worker1 # [ 96.204121] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362265048worker1 # [ 96.219070] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5049worker1 # [ 96.429076] nix-daemon[834]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)5050worker1 # [ 96.450560] nix-daemon[834]: reaped child process 1363, status = succeeded5051worker1 # [ 96.628230] nix-daemon[834]: accepted connection from pid 1365, user nix-grpc-daemon (trusted)5052worker1 # [ 96.647836] nix-daemon[834]: reaped child process 1368, status = succeeded5053lb # [ 96.745320] niks3-server[1016]: 2026/09/20 13:35:07 INFO Received uploads request method=POST path=/api/pending_closures5054worker1 # [ 96.672618] nix-grpc-daemon[1275]: time=2026-09-20T13:35:07.192Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5055worker1 # [ 96.674275] nix-grpc-daemon[1275]: time=2026-09-20T13:35:07.194Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5056lb # [ 96.785350] niks3-server[1016]: 2026/09/20 13:35:07 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5057worker1 # [ 96.712277] nix-grpc-daemon[1275]: time=2026-09-20T13:35:07.232Z level=INFO msg="Uploading 1 narinfos"5058lb # [ 96.801162] niks3-server[1016]: 2026/09/20 13:35:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5059lb # [ 96.811430] niks3-server[1016]: 2026/09/20 13:35:07 INFO Signed narinfos id=31 count=15060lb # [ 96.815779] niks3-server[1016]: 2026/09/20 13:35:07 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5061worker1 # [ 96.743528] nix-grpc-daemon[1275]: time=2026-09-20T13:35:07.263Z level=INFO msg="Upload complete. (507ms)"5062lb # [ 96.826796] niks3-server[1016]: 2026/09/20 13:35:07 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5063lb # [ 96.831174] niks3-server[1016]: 2026/09/20 13:35:07 INFO Completed upload id=315064lb # [ 96.834711] niks3-server[1016]: 2026/09/20 13:35:07 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5065worker1 # [ 96.752299] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36226 duration_s=0 paths=1 nar_bytes_in=7685066worker1 # [ 96.769160] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362265067worker1 # [ 96.777708] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5068worker1 # [ 96.788098] nix-daemon[834]: reaped child process 1358, status = succeeded5069client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5070client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5071worker1 # [ 96.797583] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5072client # farm-top> LOG-farm-top-on-standby5073worker1 # [ 98.220891] nix-daemon[834]: reaped child process 1372, status = succeeded5074worker1 # [ 98.385816] nix-daemon[834]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)5075worker1 # [ 98.405079] nix-daemon[834]: reaped child process 1390, status = succeeded5076lb # [ 98.506219] niks3-server[1016]: 2026/09/20 13:35:09 INFO Received uploads request method=POST path=/api/pending_closures5077worker1 # [ 98.435550] nix-grpc-daemon[1275]: time=2026-09-20T13:35:08.953Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5078worker1 # [ 98.437219] nix-grpc-daemon[1275]: time=2026-09-20T13:35:08.953Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5079lb # [ 98.547676] niks3-server[1016]: 2026/09/20 13:35:09 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5080worker1 # [ 98.479824] nix-grpc-daemon[1275]: time=2026-09-20T13:35:08.999Z level=INFO msg="Uploading 1 narinfos"5081lb # [ 98.565594] niks3-server[1016]: 2026/09/20 13:35:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5082lb # [ 98.573098] niks3-server[1016]: 2026/09/20 13:35:09 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5083lb # [ 98.577345] niks3-server[1016]: 2026/09/20 13:35:09 INFO Signed narinfos id=32 count=15084lb # [ 98.584904] niks3-server[1016]: 2026/09/20 13:35:09 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5085worker1 # [ 98.505408] nix-grpc-daemon[1275]: time=2026-09-20T13:35:09.025Z level=INFO msg="Upload complete. (298ms)"5086lb # [ 98.587624] niks3-server[1016]: 2026/09/20 13:35:09 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5087lb # [ 98.592237] niks3-server[1016]: 2026/09/20 13:35:09 INFO Completed upload id=325088lb # [ 98.596081] niks3-server[1016]: 2026/09/20 13:35:09 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5089worker1 # [ 98.516918] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36226 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15090worker1 # [ 98.532157] nix-daemon[834]: reaped child process 1370, status = succeeded5091client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.26 seconds)5092client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5093client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5094worker2 # [ 98.876882] systemd[1]: Listening on Nix worker-protocol over gRPC.5095worker2 # [ 98.883020] systemd[1]: Starting scheduler-token.service...5096worker2 # [ 98.974720] systemd[1]: scheduler-token.service: Deactivated successfully.5097worker2 # [ 98.978370] systemd[1]: Finished scheduler-token.service.5098worker2 # [ 98.979513] systemd[1]: scheduler-token.service: Consumed 38ms CPU time over 94ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5099worker2 # [ 98.987279] systemd[1]: Starting Nix worker-protocol over gRPC...5100worker2 # [ 99.165964] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:09Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5101worker2 # [ 99.168740] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5102worker2 # [ 99.172949] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15103worker2 # [ 99.180981] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5104worker2 # [ 99.182771] systemd[1]: Started Nix worker-protocol over gRPC.5105lb: must succeed: curl -sf localhost:9901/clusters5106worker2 # [ 99.214282] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:09Z level=info event=scheduler_connected addr=lb:500515107worker1 # [ 99.250712] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:09Z level=info event=oidc_jwks provider=mock keys=15108worker1 # [ 99.251334] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:09Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:362105109worker1 # [ 99.260687] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05110lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5111worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5112worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5113lb: must succeed: curl -sf localhost:9901/clusters5114lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5115lb: must succeed: curl -sf localhost:9901/clusters5116lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5117worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5118worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5119(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 15.14 seconds)5120subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5121client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5122client # [ 99.626944] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5123client # Running as unit: rs.service; invocation ID: 8077e74157094a4b88739f3ab81a5caa5124client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5125worker1 # [ 99.906022] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:362265126client # [ 99.868898] nix[1174]: don't know how to build these paths:5127client # [ 99.870180] nix[1174]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5128worker1 # [ 99.923806] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:10Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05129worker1 # [ 99.930967] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:10Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15130worker1 # [ 99.970871] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362265131worker1 # [ 99.986875] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362265132client # [ 99.956320] nix[1174]: copying 1 paths to 'lb:50051'...5133worker1 # [ 100.002816] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362265134client # [ 99.960169] nix[1174]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5135worker1 # [ 100.018037] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5136lb # [ 100.150833] envoy[915]: conn peer=[2001:db8:1::1]:43096 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9653 tx=3902 ms=79765137worker1 # [ 100.219465] nix-daemon[834]: accepted connection from pid 1403, user nix-grpc-daemon (trusted)5138worker1 # [ 100.239519] nix-daemon[834]: reaped child process 1406, status = succeeded5139worker1 # [ 100.411520] nix-daemon[834]: accepted connection from pid 1408, user nix-grpc-daemon (trusted)5140worker1 # [ 100.430778] nix-daemon[834]: reaped child process 1411, status = succeeded5141lb # [ 100.525562] niks3-server[1016]: 2026/09/20 13:35:11 INFO Received uploads request method=POST path=/api/pending_closures5142worker1 # [ 100.454544] nix-grpc-daemon[1275]: time=2026-09-20T13:35:10.974Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5143worker1 # [ 100.456129] nix-grpc-daemon[1275]: time=2026-09-20T13:35:10.974Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5144lb # [ 100.556371] niks3-server[1016]: 2026/09/20 13:35:11 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5145worker1 # [ 100.485720] nix-grpc-daemon[1275]: time=2026-09-20T13:35:11.005Z level=INFO msg="Uploading 1 narinfos"5146lb # [ 100.572778] niks3-server[1016]: 2026/09/20 13:35:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5147lb # [ 100.583169] niks3-server[1016]: 2026/09/20 13:35:11 INFO Signed narinfos id=33 count=15148lb # [ 100.594301] niks3-server[1016]: 2026/09/20 13:35:11 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5149lb # [ 100.597610] niks3-server[1016]: 2026/09/20 13:35:11 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5150lb # [ 100.601544] niks3-server[1016]: 2026/09/20 13:35:11 INFO Completed upload id=335151worker1 # [ 100.518276] nix-grpc-daemon[1275]: time=2026-09-20T13:35:11.038Z level=INFO msg="Upload complete. (483ms)"5152lb # [ 100.603972] niks3-server[1016]: 2026/09/20 13:35:11 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5153worker1 # [ 100.528432] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36226 duration_s=0 paths=1 nar_bytes_in=4165154worker1 # [ 100.536265] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362265155worker1 # [ 100.548478] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5156worker1 # [ 100.551160] nix-daemon[834]: reaped child process 1401, status = succeeded5157client # [ 100.515152] nix[1174]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5158worker1 # [ 100.564270] nix-daemon[834]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5159lb: must succeed: curl -sf localhost:9901/clusters5160lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5161lb: must succeed: curl -sf localhost:9901/clusters5162lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5163lb: must succeed: curl -sf localhost:9901/clusters5164lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5165lb: must succeed: curl -sf localhost:9901/clusters5166lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5167worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5168worker2 # [ 102.597250] systemd-journald[275]: Received client request to rotate journal, rotating.5169worker2 # [ 102.618663] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/1ac7a3ea67a240c7a1a3c1a4ff47958d.5170worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)5171worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5172worker1 # [ 102.694906] systemd[1]: Stopping Nix worker-protocol over gRPC...5173worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5174client: must succeed: sleep 5.05175worker1 # [ 103.350766] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:13Z level=info event=draining5176client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5177worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5178worker1 # [ 108.217897] nix-daemon[834]: reaped child process 1415, status = succeeded5179worker1 # [ 108.399689] nix-daemon[834]: accepted connection from pid 1455, user nix-grpc-daemon (trusted)5180worker1 # [ 108.417542] nix-daemon[834]: reaped child process 1458, status = succeeded5181lb # [ 108.515244] niks3-server[1016]: 2026/09/20 13:35:19 INFO Received uploads request method=POST path=/api/pending_closures5182worker1 # [ 108.444413] nix-grpc-daemon[1275]: time=2026-09-20T13:35:18.962Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5183worker1 # [ 108.445970] nix-grpc-daemon[1275]: time=2026-09-20T13:35:18.962Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5184lb # [ 108.557566] niks3-server[1016]: 2026/09/20 13:35:19 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5185worker1 # [ 108.491125] nix-grpc-daemon[1275]: time=2026-09-20T13:35:19.010Z level=INFO msg="Uploading 1 narinfos"5186lb # [ 108.574242] niks3-server[1016]: 2026/09/20 13:35:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5187lb # [ 108.584654] niks3-server[1016]: 2026/09/20 13:35:19 INFO Signed narinfos id=34 count=15188lb # [ 108.587024] niks3-server[1016]: 2026/09/20 13:35:19 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5189lb # [ 108.594996] niks3-server[1016]: 2026/09/20 13:35:19 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5190lb # [ 108.602160] niks3-server[1016]: 2026/09/20 13:35:19 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5191lb # [ 108.606514] niks3-server[1016]: 2026/09/20 13:35:19 INFO Completed upload id=345192worker1 # [ 108.523097] nix-grpc-daemon[1275]: time=2026-09-20T13:35:19.043Z level=INFO msg="Upload complete. (342ms)"5193lb # [ 108.608936] niks3-server[1016]: 2026/09/20 13:35:19 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5194worker1 # [ 108.537147] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36226 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15195worker1 # [ 108.553231] nix-daemon[834]: reaped child process 1413, status = succeeded5196client # [ 108.532720] systemd[1]: rs.service: Deactivated successfully.5197client # [ 108.538049] systemd[1]: rs.service: Consumed 155ms CPU time over 8.909s wall clock time, 37.2M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.5198worker1 # [ 109.353583] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:19Z level=info event=signal_exit5199worker1 # [ 109.373946] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:19Z level=info event=scheduler_yield5200lb # [ 109.460784] niks3-server[1016]: 2026/09/20 13:35:19 INFO lead: released remote=192.168.1.3:415445201worker2 # [ 109.354739] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:19Z level=info event=scheduler_restarting addr=lb:500515202worker1 # [ 109.379155] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:362105203worker1 # [ 109.385165] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:19Z level=info event=worker_gone addr=192.168.1.4:500515204worker1 # [ 109.390171] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:19Z level=info event=scheduler_restarting addr=lb:500515205worker1 # [ 109.394368] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:362105206worker1 # [ 109.398876] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:19Z level=info event=worker_gone addr=192.168.1.3:500515207worker2 # [ 109.554714] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:20Z level=info event=scheduler_connected addr=lb:500515208worker2 # [ 109.560235] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5209worker1 # [ 109.587814] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:20Z level=info event=scheduler_connected addr=lb:500515210worker1 # [ 109.592193] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5211worker2 # [ 109.761329] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:20Z level=info event=scheduler_connected addr=lb:500515212worker1 # [ 109.788329] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:20Z level=info event=scheduler_connected addr=lb:500515213worker2 # [ 109.766517] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5214worker1 # [ 109.793583] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5215worker2 # [ 109.967653] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:20Z level=info event=scheduler_connected addr=lb:500515216worker1 # [ 109.994388] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:20Z level=info event=scheduler_connected addr=lb:500515217worker2 # [ 109.972971] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5218worker1 # [ 109.999576] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5219lb # [ 110.150106] envoy[915]: conn peer=[2001:db8:1::1]:54168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1325 ms=86425220worker2 # [ 110.174041] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:20Z level=info event=scheduler_connected addr=lb:500515221worker1 # [ 110.200412] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:20Z level=info event=scheduler_connected addr=lb:500515222worker1 # [ 110.205574] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5223worker2 # [ 110.179293] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5224worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.21 seconds)5225client: waiting for success: ! systemctl is-active rs5226client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5227client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5228worker1 # [ 110.379828] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:20Z level=info event=scheduler_restarting5229worker2 # [ 110.382366] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:20Z level=info event=scheduler_connected addr=lb:500515230client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5231client: must fail: journalctl -u rs | grep -q 'reconnecting'5232worker2 # [ 110.386823] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5233worker1 # [ 110.425746] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5234worker1 # [ 110.439081] nix-daemon[834]: reaped child process 1266, status = succeeded5235client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5236lb: must succeed: curl -sf localhost:9901/clusters5237worker1 # [ 110.475446] nix-grpc-daemon[1202]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5238worker1 # [ 110.480140] nix-grpc-daemon[1202]: E0000 00:00:1789911320.995202 1245 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5239lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5240worker1 # [ 110.527207] nix-grpc-daemon[1202]: E0000 00:00:1789911321.047159 1245 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5241worker2 # [ 110.583608] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:21Z level=info event=scheduler_connected addr=lb:500515242worker2 # [ 110.589027] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5243worker2 # [ 110.790058] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:21Z level=info event=scheduler_connected addr=lb:500515244worker2 # [ 110.795250] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5245worker2 # [ 110.996444] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:21Z level=info event=scheduler_connected addr=lb:500515246worker2 # [ 111.001654] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5247worker2 # [ 111.202712] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:21Z level=info event=scheduler_connected addr=lb:500515248worker2 # [ 111.208045] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5249worker2 # [ 111.410953] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:21Z level=info event=scheduler_connected addr=lb:500515250worker2 # [ 111.415182] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5251worker1 # [ 111.444179] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5252worker1 # [ 111.447252] systemd[1]: Stopped Nix worker-protocol over gRPC.5253worker1 # [ 111.453191] systemd[1]: nix-grpc-daemon.service: Consumed 1.864s CPU time over 27.320s wall clock time, 34.5M memory peak, 50.6K incoming IP traffic, 93.2K outgoing IP traffic.5254worker1 # [ 111.471424] systemd[1]: Starting Nix worker-protocol over gRPC...5255lb: must succeed: curl -sf localhost:9901/clusters5256lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5257worker2 # [ 111.611666] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:22Z level=info event=scheduler_connected addr=lb:500515258worker2 # [ 111.617074] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5259worker1 # [ 111.668654] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5260worker1 # [ 111.672095] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5261worker1 # [ 111.676294] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15262worker1 # [ 111.684067] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5263worker1 # [ 111.685817] systemd[1]: Started Nix worker-protocol over gRPC.5264lb # [ 111.777636] niks3-server[1016]: 2026/09/20 13:35:22 INFO lead: acquired remote=192.168.1.3:560425265worker1 # [ 111.700843] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=scheduler_take_over5266worker1 # [ 111.708203] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=scheduler_connected addr=lb:500515267worker1 # [ 111.710352] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5268worker2 # [ 111.818048] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:22Z level=info event=scheduler_connected addr=lb:500515269worker2 # [ 111.823183] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5270worker1 # [ 111.911550] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=scheduler_connected addr=lb:500515271worker1 # [ 111.916934] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5272worker2 # [ 112.024236] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:22Z level=info event=scheduler_connected addr=lb:500515273worker2 # [ 112.029214] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5274worker1 # [ 112.117620] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=scheduler_connected addr=lb:500515275worker1 # [ 112.122879] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5276worker2 # [ 112.230464] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:22Z level=info event=scheduler_connected addr=lb:500515277worker2 # [ 112.235737] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5278worker1 # [ 112.323876] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=scheduler_connected addr=lb:500515279worker1 # [ 112.329481] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5280worker2 # [ 112.437996] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:22Z level=info event=scheduler_connected addr=lb:500515281worker1 # [ 112.474075] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=oidc_jwks provider=mock keys=15282worker1 # [ 112.478712] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:592045283worker1 # [ 112.484237] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:22Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05284worker1 # [ 112.530224] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:23Z level=info event=scheduler_connected addr=lb:500515285worker1 # [ 112.535862] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:23Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:592045286worker1 # [ 112.540889] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05287lb: must succeed: curl -sf localhost:9901/clusters5288lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5289worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5290worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5291(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.17 seconds)5292subtest: scheduler restart mid-build: build finishes, no double build5293client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5294client # [ 112.797001] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5295client # Running as unit: mid.service; invocation ID: b245e38d106b40c19a8289cf7539c0195296client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5297worker1 # [ 113.079969] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592185298worker1 # [ 113.095200] nix-daemon[834]: accepted connection from pid 1465, user nix-grpc-daemon (trusted)5299client # [ 113.067565] nix[1210]: don't know how to build these paths:5300client # [ 113.068809] nix[1210]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5301worker1 # [ 113.126305] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:23Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05302worker1 # [ 113.132458] nix-grpc-daemon[1465]: ts=2026-09-20T13:35:23Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15303worker2 # [ 113.164678] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484405304worker2 # [ 113.179364] nix-daemon[846]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5305worker2 # [ 113.204367] nix-grpc-daemon[1173]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 1/5)5306worker2 # [ 113.220301] nix-grpc-daemon[1173]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 167 ms (attempt 2/5)5307worker2 # [ 113.394929] nix-grpc-daemon[1173]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 3/5)5308worker2 # [ 113.463443] nix-grpc-daemon[1173]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 388 ms (attempt 4/5)5309worker2 # [ 113.859715] nix-grpc-daemon[1173]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5310worker2 # [ 113.881736] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484405311client # [ 113.873902] nix[1210]: copying 1 paths to 'lb:50051'...5312client # [ 113.878938] nix[1210]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5313worker2 # [ 113.901240] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484405314worker2 # [ 113.915564] nix-daemon[846]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5315worker2 # [ 113.943862] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:24Z level=info event=niks3_push_started pid=12835316worker2 # [ 114.188825] nix-grpc-daemon[1283]: time=2026-09-20T13:35:24.685Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""5317worker2 # [ 114.368467] nix-daemon[846]: accepted connection from pid 1300, user nix-grpc-daemon (trusted)5318worker2 # [ 114.386454] nix-daemon[846]: reaped child process 1303, status = succeeded5319worker2 # [ 114.565068] nix-daemon[846]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5320worker2 # [ 114.583317] nix-daemon[846]: reaped child process 1308, status = succeeded5321lb # [ 114.706223] niks3-server[1016]: 2026/09/20 13:35:25 INFO Received uploads request method=POST path=/api/pending_closures5322worker2 # [ 114.610850] nix-grpc-daemon[1283]: time=2026-09-20T13:35:25.107Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5323worker2 # [ 114.612630] nix-grpc-daemon[1283]: time=2026-09-20T13:35:25.107Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5324worker2 # [ 114.657416] nix-grpc-daemon[1283]: time=2026-09-20T13:35:25.154Z level=INFO msg="Uploading 1 narinfos"5325lb # [ 114.751668] niks3-server[1016]: 2026/09/20 13:35:25 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5326lb # [ 114.770036] niks3-server[1016]: 2026/09/20 13:35:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5327lb # [ 114.780279] niks3-server[1016]: 2026/09/20 13:35:25 INFO Signed narinfos id=35 count=15328lb # [ 114.783398] niks3-server[1016]: 2026/09/20 13:35:25 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5329lb # [ 114.799743] niks3-server[1016]: 2026/09/20 13:35:25 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5330lb # [ 114.804574] niks3-server[1016]: 2026/09/20 13:35:25 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5331worker2 # [ 114.697619] nix-grpc-daemon[1283]: time=2026-09-20T13:35:25.195Z level=INFO msg="Upload complete. (504ms)"5332lb # [ 114.807996] niks3-server[1016]: 2026/09/20 13:35:25 INFO Completed upload id=355333worker2 # [ 114.708458] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48440 duration_s=0 paths=1 nar_bytes_in=4245334worker2 # [ 114.722887] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484405335worker2 # [ 114.729814] nix-daemon[846]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5336worker2 # [ 114.734761] nix-daemon[846]: reaped child process 1281, status = succeeded5337worker2 # [ 114.746974] nix-daemon[846]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5338client # [ 114.725179] nix[1210]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5339lb: must succeed: curl -sf localhost:9901/clusters5340lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5341lb: must succeed: curl -sf localhost:9901/clusters5342lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5343worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5344worker1 # [ 116.893851] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1465 (nix-grpc-daemon) on client request.5345lb # [ 116.985340] niks3-server[1016]: 2026/09/20 13:35:27 INFO lead: released remote=192.168.1.3:560425346worker2 # [ 116.891753] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:27Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5347worker1 # [ 116.905771] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5348client # [ 116.871787] nix[1210]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5349worker1 # [ 116.939278] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5350worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.12 seconds)5351client: must succeed: sleep 5.05352worker1 # [ 116.955379] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5353worker1 # [ 116.960775] systemd[1]: nix-grpc-daemon.service: Consumed 192ms CPU time over 5.472s wall clock time, 11.6M memory peak, 9.9K incoming IP traffic, 10K outgoing IP traffic.5354worker1 # [ 116.964459] nix-daemon[834]: reaped child process 1521, status = succeeded5355worker1 # [ 117.093229] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5356worker1 # [ 117.105490] systemd[1]: Starting Nix worker-protocol over gRPC...5357worker2 # [ 117.092094] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:27Z level=info event=scheduler_connected addr=lb:500515358worker1 # [ 117.324358] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:27Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5359worker1 # [ 117.327005] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5360worker1 # [ 117.331289] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15361worker1 # [ 117.339680] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5362worker1 # [ 117.348664] systemd[1]: Started Nix worker-protocol over gRPC.5363lb # [ 117.433052] niks3-server[1016]: 2026/09/20 13:35:27 INFO lead: acquired remote=192.168.1.3:560605364worker1 # [ 117.357574] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:27Z level=info event=scheduler_take_over5365worker1 # [ 117.369765] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:27Z level=info event=scheduler_connected addr=lb:500515366worker1 # [ 117.371928] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:27Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:592225367worker1 # [ 117.373992] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05368worker1 # [ 117.377726] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:27Z level=info event=oidc_jwks provider=mock keys=15369worker1 # [ 117.379035] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:27Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:592225370worker1 # [ 117.380840] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=15371lb # [ 120.152978] envoy[915]: conn peer=[2001:db8:1::3]:55568 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4835 tx=1455 ms=260575372lb # [ 120.158274] envoy[915]: conn peer=[2001:db8:1::3]:39610 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=972 tx=362 ms=52195373client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5374client: waiting for success: ! systemctl is-active mid5375worker2 # [ 122.385045] nix-daemon[846]: reaped child process 1312, status = succeeded5376worker2 # [ 122.551532] nix-daemon[846]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5377worker2 # [ 122.568321] nix-daemon[846]: reaped child process 1351, status = succeeded5378lb # [ 122.691029] niks3-server[1016]: 2026/09/20 13:35:33 INFO Received uploads request method=POST path=/api/pending_closures5379worker2 # [ 122.598691] nix-grpc-daemon[1283]: time=2026-09-20T13:35:33.093Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5380worker2 # [ 122.601133] nix-grpc-daemon[1283]: time=2026-09-20T13:35:33.093Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5381lb # [ 122.735941] niks3-server[1016]: 2026/09/20 13:35:33 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5382lb # [ 122.750136] niks3-server[1016]: 2026/09/20 13:35:33 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5383lb # [ 122.766401] niks3-server[1016]: 2026/09/20 13:35:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5384worker2 # [ 122.666440] nix-grpc-daemon[1283]: time=2026-09-20T13:35:33.162Z level=INFO msg="Uploading 1 narinfos"5385lb # [ 122.777550] niks3-server[1016]: 2026/09/20 13:35:33 INFO Signed narinfos id=36 count=15386lb # [ 122.783727] niks3-server[1016]: 2026/09/20 13:35:33 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5387lb # [ 122.792652] niks3-server[1016]: 2026/09/20 13:35:33 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5388worker2 # [ 122.693661] nix-grpc-daemon[1283]: time=2026-09-20T13:35:33.191Z level=INFO msg="Upload complete. (328ms)"5389lb # [ 122.803023] niks3-server[1016]: 2026/09/20 13:35:33 INFO Completed upload id=365390worker2 # [ 122.705276] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48440 duration_s=7 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15391worker2 # [ 122.726236] nix-grpc-daemon[1283]: time=2026-09-20T13:35:33.214Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5392worker2 # [ 122.733105] nix-daemon[846]: reaped child process 1310, status = succeeded5393client # [ 122.725288] systemd[1]: mid.service: Deactivated successfully.5394client # [ 122.729701] systemd[1]: mid.service: Consumed 161ms CPU time over 9.931s wall clock time, 37M memory peak, 9K incoming IP traffic, 9.3K outgoing IP traffic.5395client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5396client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5397client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5398(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.74 seconds)5399subtest: interrupting the client stops the build on the worker5400client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5401client # [ 123.512753] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5402client # Running as unit: intr.service; invocation ID: 9411e13ca3df486cb795b05e900e38955403client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5404worker2 # [ 123.762309] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:484405405client # [ 123.748450] nix[1246]: don't know how to build these paths:5406client # [ 123.749474] nix[1246]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5407worker1 # [ 123.812371] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:34Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05408worker1 # [ 123.817781] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:34Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15409worker1 # [ 123.862238] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305410worker1 # [ 123.878600] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5411worker1 # [ 123.900872] nix-grpc-daemon[1549]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 1/5)5412worker1 # [ 123.923342] nix-grpc-daemon[1549]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 182 ms (attempt 2/5)5413worker1 # [ 124.113149] nix-grpc-daemon[1549]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 342 ms (attempt 3/5)5414worker1 # [ 124.463297] nix-grpc-daemon[1549]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 4/5)5415worker1 # [ 124.492422] nix-grpc-daemon[1549]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5416worker1 # [ 124.513358] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484305417client # [ 124.484211] nix[1246]: copying 1 paths to 'lb:50051'...5418client # [ 124.484537] nix[1246]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5419worker1 # [ 124.530809] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484305420worker1 # [ 124.546587] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5421worker1 # [ 124.576875] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:35Z level=info event=niks3_push_started pid=16195422worker1 # [ 124.801816] nix-grpc-daemon[1619]: time=2026-09-20T13:35:35.319Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5423worker1 # [ 124.987357] nix-daemon[834]: accepted connection from pid 1636, user nix-grpc-daemon (trusted)5424worker1 # [ 125.004817] nix-daemon[834]: reaped child process 1639, status = succeeded5425worker1 # [ 125.187188] nix-daemon[834]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)5426worker1 # [ 125.204974] nix-daemon[834]: reaped child process 1644, status = succeeded5427lb # [ 125.305662] niks3-server[1016]: 2026/09/20 13:35:35 INFO Received uploads request method=POST path=/api/pending_closures5428worker1 # [ 125.237729] nix-grpc-daemon[1619]: time=2026-09-20T13:35:35.756Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5429worker1 # [ 125.239319] nix-grpc-daemon[1619]: time=2026-09-20T13:35:35.756Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5430lb # [ 125.366606] niks3-server[1016]: 2026/09/20 13:35:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5431lb # [ 125.391308] niks3-server[1016]: 2026/09/20 13:35:35 INFO Signed narinfos id=37 count=15432worker1 # [ 125.309478] nix-grpc-daemon[1619]: time=2026-09-20T13:35:35.828Z level=INFO msg="Uploading 1 narinfos"5433lb # [ 125.403206] niks3-server[1016]: 2026/09/20 13:35:35 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5434lb # [ 125.433540] niks3-server[1016]: 2026/09/20 13:35:35 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5435lb # [ 125.445945] niks3-server[1016]: 2026/09/20 13:35:35 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5436lb # [ 125.452390] niks3-server[1016]: 2026/09/20 13:35:35 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5437lb # [ 125.460129] niks3-server[1016]: 2026/09/20 13:35:35 INFO Completed upload id=375438worker1 # [ 125.377503] nix-grpc-daemon[1619]: time=2026-09-20T13:35:35.897Z level=INFO msg="Upload complete. (576ms)"5439worker1 # [ 125.389336] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=4245440worker1 # [ 125.404884] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305441worker1 # [ 125.422127] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5442worker1 # [ 125.426478] nix-daemon[834]: reaped child process 1617, status = succeeded5443client # [ 125.394910] nix[1246]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5444worker1 # [ 125.441762] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5445client: must succeed: systemctl kill -s INT intr5446client # [ 127.251698] systemd[1]: intr.service: Sent signal SIGINT to main process 1246 (nix) on client request.5447client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds)5448worker1 # [ 127.312222] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:37Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5449client # [ 127.264824] nix[1246]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5450client # [ 127.271661] nix[1246]: error: interrupted by the user5451client # [ 127.303803] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5452client # [ 127.308891] systemd[1]: intr.service: Failed with result 'exit-code'.5453client # [ 127.311082] systemd[1]: intr.service: Consumed 145ms CPU time over 3.794s wall clock time, 39.2M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5454worker1 # [ 127.474409] nix-daemon[834]: reaped child process 1646, status = succeeded5455worker1 # [ 127.477410] nix-daemon[1648]: unexpected Nix daemon error: error: interrupted by the user5456worker1 # [ 127.483909] nix-daemon[834]: reaped child process 1648, status = failed with exit code 15457(finished: subtest: interrupting the client stops the build on the worker, in 5.11 seconds)5458subtest: a deploy mid-build drains: the build finishes, the new generation takes over5459client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5460client # [ 128.653249] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5461client # Running as unit: sw.service; invocation ID: ba0d711db7f54542814b110992854bb65462client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5463client # [ 128.889855] nix[1266]: don't know how to build these paths:5464client # [ 128.890859] nix[1266]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5465worker2 # [ 128.910470] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:484405466worker1 # [ 128.952755] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:39Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05467worker1 # [ 128.958794] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:39Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15468worker2 # [ 128.973247] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484405469worker2 # [ 128.989559] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484405470client # [ 128.981138] nix[1266]: copying 1 paths to 'lb:50051'...5471client # [ 128.987229] nix[1266]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5472worker2 # [ 129.008061] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484405473worker2 # [ 129.024524] nix-daemon[846]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5474worker2 # [ 129.241127] nix-daemon[846]: accepted connection from pid 1383, user nix-grpc-daemon (trusted)5475worker2 # [ 129.259965] nix-daemon[846]: reaped child process 1386, status = succeeded5476worker2 # [ 129.438706] nix-daemon[846]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5477worker2 # [ 129.457666] nix-daemon[846]: reaped child process 1391, status = succeeded5478lb # [ 129.576676] niks3-server[1016]: 2026/09/20 13:35:40 INFO Received uploads request method=POST path=/api/pending_closures5479worker2 # [ 129.482858] nix-grpc-daemon[1283]: time=2026-09-20T13:35:39.979Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5480worker2 # [ 129.484490] nix-grpc-daemon[1283]: time=2026-09-20T13:35:39.979Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5481lb # [ 129.614622] niks3-server[1016]: 2026/09/20 13:35:40 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5482lb # [ 129.629571] niks3-server[1016]: 2026/09/20 13:35:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5483worker2 # [ 129.530504] nix-grpc-daemon[1283]: time=2026-09-20T13:35:40.027Z level=INFO msg="Uploading 1 narinfos"5484lb # [ 129.643371] niks3-server[1016]: 2026/09/20 13:35:40 INFO Signed narinfos id=38 count=15485lb # [ 129.650712] niks3-server[1016]: 2026/09/20 13:35:40 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5486worker2 # [ 129.560798] nix-grpc-daemon[1283]: time=2026-09-20T13:35:40.058Z level=INFO msg="Upload complete. (518ms)"5487lb # [ 129.668820] niks3-server[1016]: 2026/09/20 13:35:40 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5488lb # [ 129.674220] niks3-server[1016]: 2026/09/20 13:35:40 INFO Completed upload id=385489lb # [ 129.678366] niks3-server[1016]: 2026/09/20 13:35:40 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5490worker2 # [ 129.571902] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48440 duration_s=0 paths=1 nar_bytes_in=4165491worker2 # [ 129.586048] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484405492worker2 # [ 129.593938] nix-daemon[846]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5493worker2 # [ 129.599551] nix-daemon[846]: reaped child process 1381, status = succeeded5494worker2 # [ 129.612771] nix-daemon[846]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5495client # [ 129.590062] nix[1266]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5496lb # [ 130.150261] envoy[915]: conn peer=[2001:db8:1::1]:51566 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3035 tx=1421 ms=96675497lb # [ 130.156378] envoy[915]: conn peer=[2001:db8:1::1]:43546 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=730 ms=35465498worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25499worker2 # Checking switch inhibitors... done5500worker2 # [ 132.139302] nixos[1426]: switching to system configuration /nix/store/jp7aq3prkrgc08jbvkrg9k71d25zrapi-nixos-system-worker2-test5501worker2 # [ 132.142625] systemd[1]: Stopped target Local File Systems.5502worker2 # activating the configuration...5503worker2 # [ 132.148093] systemd[1]: Stopped target Remote File Systems.5504worker2 # setting up /etc...5505worker2 # [ 132.942150] systemd[1]: Reload requested from client PID 1426 ('.switch-to-conf') (unit backdoor.service)...5506worker2 # [ 132.944798] systemd[1]: Reloading...5507worker2 # [ 133.832852] systemd[1]: Reloading finished in 885 ms.5508worker2 # restarting sysinit-reactivation.target5509worker2 # [ 133.918769] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5510worker2 # [ 134.081465] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5511worker2 # [ 134.082705] systemd[1]: Reached target Reactivate sysinit units.5512worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5513worker2 # [ 134.090917] systemd[1]: Reloading D-Bus System Message Bus...5514worker2 # [ 134.094779] dbus-broker-launch[503]: Caught SIGHUP, trigger reload.5515worker2 # [ 134.104901] systemd[1]: Reloading Nix worker-protocol over gRPC...5516worker2 # [ 134.125290] dbus-broker-launch[503]: Looking up NSS user entry for 'systemd-timesync'...5517worker2 # [ 134.127840] dbus-broker-launch[503]: NSS returned no entry for 'systemd-timesync'5518worker2 # [ 134.132271] dbus-broker-launch[503]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5519worker2 # [ 134.156399] systemd[1]: Reloaded Nix worker-protocol over gRPC.5520worker2 # [ 134.178852] systemd[1]: Reloaded D-Bus System Message Bus.5521worker2 # [ 134.185154] systemd[1]: Reached target Remote File Systems.5522worker2 # [ 134.195987] systemd[1]: Starting linger-users.service...5523worker2 # [ 134.198768] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:44Z level=info event=draining5524worker2 # [ 134.204839] systemd[1]: Reached target Local File Systems.5525worker2 # [ 134.212456] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5526worker2 # [ 134.219685] systemd[1]: Starting Create SUID/SGID Wrappers...5527worker2 # [ 134.222790] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5528worker2 # [ 134.223973] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675529worker2 # [ 134.234462] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5530worker2 # [ 134.240816] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5531worker2 # [ 134.242902] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5532worker2 # [ 134.248909] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5533worker2 # [ 134.252175] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5534worker2 # [ 134.287300] systemd[1]: linger-users.service: Deactivated successfully.5535worker2 # [ 134.292248] systemd[1]: Finished linger-users.service.5536worker2 # [ 134.738337] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5537worker2 # [ 134.744158] systemd[1]: Finished Create SUID/SGID Wrappers.5538worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5539worker2 # [ 134.994989] nixos[1426]: finished switching to system configuration /nix/store/jp7aq3prkrgc08jbvkrg9k71d25zrapi-nixos-system-worker2-test5540worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.69 seconds)5541worker2: must succeed: pgrep -f 'read -t [9]0 x'5542worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5543client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25544client # don't know how to build these paths:5545client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5546worker1 # [ 135.345082] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:484305547worker1 # [ 135.354773] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484305548worker1 # [ 135.379564] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:45Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05549worker1 # [ 135.387075] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:45Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15550worker1 # [ 135.430444] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305551worker1 # [ 135.447530] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484305552client # copying 1 paths to 'lb:50051'...5553worker1 # [ 135.465496] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484305554client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5555worker1 # [ 135.496476] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5556worker1 # [ 135.713856] nix-daemon[834]: accepted connection from pid 1702, user nix-grpc-daemon (trusted)5557worker1 # [ 135.733910] nix-daemon[834]: reaped child process 1705, status = succeeded5558worker1 # [ 135.911788] nix-daemon[834]: accepted connection from pid 1707, user nix-grpc-daemon (trusted)5559worker1 # [ 135.931359] nix-daemon[834]: reaped child process 1710, status = succeeded5560lb # [ 136.026789] niks3-server[1016]: 2026/09/20 13:35:46 INFO Received uploads request method=POST path=/api/pending_closures5561worker1 # [ 135.955949] nix-grpc-daemon[1619]: time=2026-09-20T13:35:46.475Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5562worker1 # [ 135.957726] nix-grpc-daemon[1619]: time=2026-09-20T13:35:46.475Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5563lb # [ 136.058963] niks3-server[1016]: 2026/09/20 13:35:46 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5564lb # [ 136.074626] niks3-server[1016]: 2026/09/20 13:35:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5565worker1 # [ 135.997111] nix-grpc-daemon[1619]: time=2026-09-20T13:35:46.516Z level=INFO msg="Uploading 1 narinfos"5566lb # [ 136.085873] niks3-server[1016]: 2026/09/20 13:35:46 INFO Signed narinfos id=39 count=15567lb # [ 136.090728] niks3-server[1016]: 2026/09/20 13:35:46 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5568lb # [ 136.100489] niks3-server[1016]: 2026/09/20 13:35:46 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5569lb # [ 136.104230] niks3-server[1016]: 2026/09/20 13:35:46 INFO Completed upload id=395570worker1 # [ 136.021533] nix-grpc-daemon[1619]: time=2026-09-20T13:35:46.541Z level=INFO msg="Upload complete. (502ms)"5571lb # [ 136.107166] niks3-server[1016]: 2026/09/20 13:35:46 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5572worker1 # [ 136.031812] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=5285573worker1 # [ 136.044279] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305574worker1 # [ 136.051024] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5575worker1 # [ 136.055751] nix-daemon[834]: reaped child process 1700, status = succeeded5576client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5577worker1 # [ 136.067195] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5578client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5579client # farm-a> LOG-farm-a-during-drain5580worker1 # [ 136.911307] nix-daemon[834]: reaped child process 1714, status = succeeded5581worker1 # [ 137.092733] nix-daemon[834]: accepted connection from pid 1729, user nix-grpc-daemon (trusted)5582worker1 # [ 137.109596] nix-daemon[834]: reaped child process 1732, status = succeeded5583lb # [ 137.207351] niks3-server[1016]: 2026/09/20 13:35:47 INFO Received uploads request method=POST path=/api/pending_closures5584worker1 # [ 137.136405] nix-grpc-daemon[1619]: time=2026-09-20T13:35:47.654Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5585worker1 # [ 137.137965] nix-grpc-daemon[1619]: time=2026-09-20T13:35:47.654Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5586lb # [ 137.244916] niks3-server[1016]: 2026/09/20 13:35:47 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5587lb # [ 137.259249] niks3-server[1016]: 2026/09/20 13:35:47 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5588lb # [ 137.279991] niks3-server[1016]: 2026/09/20 13:35:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5589worker1 # [ 137.204211] nix-grpc-daemon[1619]: time=2026-09-20T13:35:47.723Z level=INFO msg="Uploading 1 narinfos"5590lb # [ 137.288168] niks3-server[1016]: 2026/09/20 13:35:47 INFO Signed narinfos id=40 count=15591lb # [ 137.300523] niks3-server[1016]: 2026/09/20 13:35:47 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5592lb # [ 137.311080] niks3-server[1016]: 2026/09/20 13:35:47 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5593lb # [ 137.322951] niks3-server[1016]: 2026/09/20 13:35:47 INFO Completed upload id=405594worker1 # [ 137.240412] nix-grpc-daemon[1619]: time=2026-09-20T13:35:47.760Z level=INFO msg="Upload complete. (360ms)"5595lb # [ 137.325356] niks3-server[1016]: 2026/09/20 13:35:47 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5596worker1 # [ 137.261298] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=15597worker1 # [ 137.277698] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:47Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05598worker1 # [ 137.282823] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:47Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15599worker1 # [ 137.288610] nix-daemon[834]: reaped child process 1712, status = succeeded5600worker1 # [ 137.307102] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305601worker1 # [ 137.322446] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484305602worker1 # [ 137.337640] nix-grpc-daemon[1619]: time=2026-09-20T13:35:47.857Z level=INFO msg="All 1 paths already cached"5603client # copying 1 paths to 'lb:50051'...5604worker1 # [ 137.347809] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484305605client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5606worker1 # [ 137.370718] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5607worker1 # [ 137.575155] nix-daemon[834]: accepted connection from pid 1738, user nix-grpc-daemon (trusted)5608worker1 # [ 137.594824] nix-daemon[834]: reaped child process 1741, status = succeeded5609worker1 # [ 137.766724] nix-daemon[834]: accepted connection from pid 1743, user nix-grpc-daemon (trusted)5610worker1 # [ 137.784261] nix-daemon[834]: reaped child process 1746, status = succeeded5611lb # [ 137.879411] niks3-server[1016]: 2026/09/20 13:35:48 INFO Received uploads request method=POST path=/api/pending_closures5612worker1 # [ 137.806660] nix-grpc-daemon[1619]: time=2026-09-20T13:35:48.326Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5613worker1 # [ 137.808282] nix-grpc-daemon[1619]: time=2026-09-20T13:35:48.326Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5614lb # [ 137.913451] niks3-server[1016]: 2026/09/20 13:35:48 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5615worker1 # [ 137.838254] nix-grpc-daemon[1619]: time=2026-09-20T13:35:48.358Z level=INFO msg="Uploading 1 narinfos"5616lb # [ 137.927192] niks3-server[1016]: 2026/09/20 13:35:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5617lb # [ 137.942380] niks3-server[1016]: 2026/09/20 13:35:48 INFO Signed narinfos id=41 count=15618worker1 # [ 137.864101] nix-grpc-daemon[1619]: time=2026-09-20T13:35:48.384Z level=INFO msg="Upload complete. (475ms)"5619lb # [ 137.947461] niks3-server[1016]: 2026/09/20 13:35:48 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5620lb # [ 137.952904] niks3-server[1016]: 2026/09/20 13:35:48 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5621worker1 # [ 137.872100] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=6405622lb # [ 137.957192] niks3-server[1016]: 2026/09/20 13:35:48 INFO Completed upload id=415623lb # [ 137.959419] niks3-server[1016]: 2026/09/20 13:35:48 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5624worker1 # [ 137.882680] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305625worker1 # [ 137.891512] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5626worker1 # [ 137.894486] nix-daemon[834]: reaped child process 1736, status = succeeded5627client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5628worker1 # [ 137.904621] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5629client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5630client # farm-b> LOG-farm-b-during-drain5631worker1 # [ 139.351345] nix-daemon[834]: reaped child process 1750, status = succeeded5632worker1 # [ 139.538680] nix-daemon[834]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)5633worker1 # [ 139.559285] nix-daemon[834]: reaped child process 1768, status = succeeded5634lb # [ 139.655361] niks3-server[1016]: 2026/09/20 13:35:50 INFO Received uploads request method=POST path=/api/pending_closures5635worker1 # [ 139.585942] nix-grpc-daemon[1619]: time=2026-09-20T13:35:50.104Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5636worker1 # [ 139.587737] nix-grpc-daemon[1619]: time=2026-09-20T13:35:50.105Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5637lb # [ 139.699829] niks3-server[1016]: 2026/09/20 13:35:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5638worker1 # [ 139.626508] nix-grpc-daemon[1619]: time=2026-09-20T13:35:50.146Z level=INFO msg="Uploading 1 narinfos"5639lb # [ 139.716729] niks3-server[1016]: 2026/09/20 13:35:50 INFO Signed narinfos id=42 count=15640lb # [ 139.719258] niks3-server[1016]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5641lb # [ 139.733425] niks3-server[1016]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5642lb # [ 139.738265] niks3-server[1016]: 2026/09/20 13:35:50 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5643lb # [ 139.741594] niks3-server[1016]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5644worker1 # [ 139.658799] nix-grpc-daemon[1619]: time=2026-09-20T13:35:50.178Z level=INFO msg="Upload complete. (342ms)"5645lb # [ 139.744553] niks3-server[1016]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5646lb # [ 139.748427] niks3-server[1016]: 2026/09/20 13:35:50 INFO Completed upload id=425647worker1 # [ 139.673149] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=15648worker1 # [ 139.695026] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:50Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05649worker1 # [ 139.699778] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:50Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15650worker1 # [ 139.704951] nix-daemon[834]: reaped child process 1748, status = succeeded5651worker1 # [ 139.729739] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305652worker1 # [ 139.745761] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484305653worker1 # [ 139.761182] nix-grpc-daemon[1619]: time=2026-09-20T13:35:50.281Z level=INFO msg="All 2 paths already cached"5654client # copying 1 paths to 'lb:50051'...5655client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5656worker1 # [ 139.771771] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484305657worker1 # [ 139.790207] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5658worker1 # [ 139.999908] nix-daemon[834]: accepted connection from pid 1774, user nix-grpc-daemon (trusted)5659worker1 # [ 140.020832] nix-daemon[834]: reaped child process 1777, status = succeeded5660worker1 # [ 140.196836] nix-daemon[834]: accepted connection from pid 1779, user nix-grpc-daemon (trusted)5661worker1 # [ 140.214832] nix-daemon[834]: reaped child process 1782, status = succeeded5662lb # [ 140.309874] niks3-server[1016]: 2026/09/20 13:35:50 INFO Received uploads request method=POST path=/api/pending_closures5663worker1 # [ 140.236817] nix-grpc-daemon[1619]: time=2026-09-20T13:35:50.756Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5664worker1 # [ 140.239161] nix-grpc-daemon[1619]: time=2026-09-20T13:35:50.756Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5665lb # [ 140.339653] niks3-server[1016]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5666worker1 # [ 140.268251] nix-grpc-daemon[1619]: time=2026-09-20T13:35:50.788Z level=INFO msg="Uploading 1 narinfos"5667lb # [ 140.354292] niks3-server[1016]: 2026/09/20 13:35:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5668lb # [ 140.366126] niks3-server[1016]: 2026/09/20 13:35:50 INFO Signed narinfos id=43 count=15669lb # [ 140.370128] niks3-server[1016]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5670lb # [ 140.376724] niks3-server[1016]: 2026/09/20 13:35:50 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5671worker1 # [ 140.298610] nix-grpc-daemon[1619]: time=2026-09-20T13:35:50.818Z level=INFO msg="Upload complete. (489ms)"5672lb # [ 140.383958] niks3-server[1016]: 2026/09/20 13:35:50 INFO Completed upload id=435673lb # [ 140.387785] niks3-server[1016]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5674worker1 # [ 140.304943] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=7685675worker1 # [ 140.318403] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305676worker1 # [ 140.324328] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5677worker1 # [ 140.329618] nix-daemon[834]: reaped child process 1772, status = succeeded5678client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5679client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5680worker1 # [ 140.343003] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5681client # farm-top> LOG-farm-top-during-drain5682worker1 # [ 141.191685] nix-daemon[834]: reaped child process 1786, status = succeeded5683worker1 # [ 141.370235] nix-daemon[834]: accepted connection from pid 1801, user nix-grpc-daemon (trusted)5684worker1 # [ 141.389566] nix-daemon[834]: reaped child process 1804, status = succeeded5685lb # [ 141.487040] niks3-server[1016]: 2026/09/20 13:35:51 INFO Received uploads request method=POST path=/api/pending_closures5686worker1 # [ 141.417309] nix-grpc-daemon[1619]: time=2026-09-20T13:35:51.937Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5687worker1 # [ 141.420759] nix-grpc-daemon[1619]: time=2026-09-20T13:35:51.939Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5688lb # [ 141.525889] niks3-server[1016]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5689lb # [ 141.541051] niks3-server[1016]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5690lb # [ 141.551949] niks3-server[1016]: 2026/09/20 13:35:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5691worker1 # [ 141.474748] nix-grpc-daemon[1619]: time=2026-09-20T13:35:51.994Z level=INFO msg="Uploading 1 narinfos"5692lb # [ 141.557569] niks3-server[1016]: 2026/09/20 13:35:52 INFO Signed narinfos id=44 count=15693lb # [ 141.564428] niks3-server[1016]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5694worker1 # [ 141.492810] nix-grpc-daemon[1619]: time=2026-09-20T13:35:52.012Z level=INFO msg="Upload complete. (337ms)"5695lb # [ 141.577617] niks3-server[1016]: 2026/09/20 13:35:52 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5696lb # [ 141.583292] niks3-server[1016]: 2026/09/20 13:35:52 INFO Completed upload id=445697lb # [ 141.586262] niks3-server[1016]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5698worker1 # [ 141.504698] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=15699worker1 # [ 141.523707] nix-daemon[834]: reaped child process 1784, status = succeeded5700client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.46 seconds)5701client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5702client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5703worker2: must succeed: pkill -f 'read -t [9]0 x'5704worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.07 seconds)5705client: waiting for success: ! systemctl is-active sw5706worker2 # [ 141.852514] nix-daemon[846]: reaped child process 1395, status = succeeded5707worker2 # [ 142.012783] nix-daemon[846]: accepted connection from pid 1566, user nix-grpc-daemon (trusted)5708worker2 # [ 142.032600] nix-daemon[846]: reaped child process 1569, status = succeeded5709lb # [ 142.151142] niks3-server[1016]: 2026/09/20 13:35:52 INFO Received uploads request method=POST path=/api/pending_closures5710worker2 # [ 142.054073] nix-grpc-daemon[1283]: time=2026-09-20T13:35:52.550Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5711worker2 # [ 142.055567] nix-grpc-daemon[1283]: time=2026-09-20T13:35:52.550Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5712lb # [ 142.187128] niks3-server[1016]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5713lb # [ 142.199025] niks3-server[1016]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5714worker2 # [ 142.100171] nix-grpc-daemon[1283]: time=2026-09-20T13:35:52.597Z level=INFO msg="Uploading 1 narinfos"5715lb # [ 142.211097] niks3-server[1016]: 2026/09/20 13:35:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5716lb # [ 142.220789] niks3-server[1016]: 2026/09/20 13:35:52 INFO Signed narinfos id=45 count=15717lb # [ 142.223738] niks3-server[1016]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5718lb # [ 142.231052] niks3-server[1016]: 2026/09/20 13:35:52 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5719lb # [ 142.239563] niks3-server[1016]: 2026/09/20 13:35:52 INFO Completed upload id=455720worker2 # [ 142.132053] nix-grpc-daemon[1283]: time=2026-09-20T13:35:52.629Z level=INFO msg="Upload complete. (290ms)"5721lb # [ 142.242815] niks3-server[1016]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5722worker2 # [ 142.142062] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48440 duration_s=12 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=15723worker2 # [ 142.158305] nix-daemon[846]: reaped child process 1393, status = succeeded5724client # [ 142.167731] systemd[1]: sw.service: Deactivated successfully.5725client # [ 142.173307] systemd[1]: sw.service: Consumed 159ms CPU time over 13.518s wall clock time, 36.9M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.5726worker2 # [ 142.199544] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:52Z level=info event=signal_exit5727client: (finished: waiting for success: ! systemctl is-active sw, in 1.11 seconds)5728client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5729client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)5730worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5731worker2 # [ 143.077844] systemd[1]: Starting scheduler-token.service...5732worker2 # [ 143.169037] systemd[1]: scheduler-token.service: Deactivated successfully.5733worker2 # [ 143.172690] systemd[1]: Finished scheduler-token.service.5734worker2 # [ 143.173977] systemd[1]: scheduler-token.service: Consumed 34ms CPU time over 92ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5735worker1 # [ 143.463816] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:592225736worker2 # [ 143.441259] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:53Z level=info event=scheduler_restarting5737worker1 # [ 143.468563] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:53Z level=info event=worker_gone addr=192.168.1.4:500515738worker2 # [ 143.460660] nix-grpc-daemon[1173]: ts=2026-09-20T13:35:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5739worker2 # [ 143.490438] nix-daemon[846]: reaped child process 1276, status = succeeded5740worker2 # [ 143.660213] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5741worker2 # [ 143.663199] systemd[1]: nix-grpc-daemon.service: Consumed 1.117s CPU time over 44.672s wall clock time, 31.2M memory peak, 27.8K incoming IP traffic, 51K outgoing IP traffic.5742worker2 # [ 143.686767] systemd[1]: Starting Nix worker-protocol over gRPC...5743worker2 # [ 143.889566] nix-grpc-daemon[1586]: ts=2026-09-20T13:35:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5744worker2 # [ 143.893086] nix-grpc-daemon[1586]: ts=2026-09-20T13:35:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5745worker2 # [ 143.895467] nix-grpc-daemon[1586]: ts=2026-09-20T13:35:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15746worker2 # [ 143.903149] nix-grpc-daemon[1586]: ts=2026-09-20T13:35:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5747worker2 # [ 143.911407] systemd[1]: Started Nix worker-protocol over gRPC.5748worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.93 seconds)5749lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5750lb: must succeed: curl -sf localhost:9901/clusters5751worker2 # [ 143.925408] nix-grpc-daemon[1586]: ts=2026-09-20T13:35:54Z level=info event=scheduler_connected addr=lb:500515752worker1 # [ 143.953918] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:54Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:592225753worker1 # [ 143.959782] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:54Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05754lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5755lb: must succeed: curl -sf localhost:9901/clusters5756lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5757lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)5758lb: must succeed: curl -sf localhost:9901/clusters5759lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5760worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5761worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5762(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.62 seconds)5763subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5764client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15765worker1 # [ 145.504860] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:484305766worker1 # [ 145.512442] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484305767worker1 # [ 145.558478] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:56Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05768worker1 # [ 145.565594] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:56Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15769worker1 # [ 145.571648] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:56Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05770worker1 # [ 145.576929] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:56Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05771worker1 # [ 145.605124] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305772worker1 # [ 145.620260] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484305773worker1 # [ 145.634153] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484305774worker1 # [ 145.649204] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5775worker1 # [ 145.858820] nix-daemon[834]: accepted connection from pid 1813, user nix-grpc-daemon (trusted)5776worker1 # [ 145.877555] nix-daemon[834]: reaped child process 1816, status = succeeded5777worker1 # [ 146.051065] nix-daemon[834]: accepted connection from pid 1818, user nix-grpc-daemon (trusted)5778worker1 # [ 146.069567] nix-daemon[834]: reaped child process 1821, status = succeeded5779lb # [ 146.166422] niks3-server[1016]: 2026/09/20 13:35:56 INFO Received uploads request method=POST path=/api/pending_closures5780worker1 # [ 146.093456] nix-grpc-daemon[1619]: time=2026-09-20T13:35:56.613Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5781worker1 # [ 146.094917] nix-grpc-daemon[1619]: time=2026-09-20T13:35:56.613Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5782lb # [ 146.195056] niks3-server[1016]: 2026/09/20 13:35:56 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5783worker1 # [ 146.125953] nix-grpc-daemon[1619]: time=2026-09-20T13:35:56.645Z level=INFO msg="Uploading 1 narinfos"5784lb # [ 146.208830] niks3-server[1016]: 2026/09/20 13:35:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5785lb # [ 146.220354] niks3-server[1016]: 2026/09/20 13:35:56 INFO Signed narinfos id=46 count=15786lb # [ 146.227841] niks3-server[1016]: 2026/09/20 13:35:56 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5787lb # [ 146.238979] niks3-server[1016]: 2026/09/20 13:35:56 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5788lb # [ 146.244400] niks3-server[1016]: 2026/09/20 13:35:56 INFO Completed upload id=465789worker1 # [ 146.161607] nix-grpc-daemon[1619]: time=2026-09-20T13:35:56.681Z level=INFO msg="Upload complete. (496ms)"5790lb # [ 146.247359] niks3-server[1016]: 2026/09/20 13:35:56 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5791worker1 # [ 146.168384] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=5125792worker1 # [ 146.183107] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305793worker1 # [ 146.190890] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5794worker1 # [ 146.195744] nix-daemon[834]: reaped child process 1811, status = succeeded5795worker1 # [ 146.206908] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5796worker1 # [ 147.244616] nix-daemon[834]: reaped child process 1825, status = succeeded5797worker1 # [ 147.413546] nix-daemon[834]: accepted connection from pid 1840, user nix-grpc-daemon (trusted)5798worker1 # [ 147.432233] nix-daemon[834]: reaped child process 1843, status = succeeded5799lb # [ 147.530464] niks3-server[1016]: 2026/09/20 13:35:58 INFO Received uploads request method=POST path=/api/pending_closures5800worker1 # [ 147.456573] nix-grpc-daemon[1619]: time=2026-09-20T13:35:57.976Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5801worker1 # [ 147.460949] nix-grpc-daemon[1619]: time=2026-09-20T13:35:57.978Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5802lb # [ 147.566370] niks3-server[1016]: 2026/09/20 13:35:58 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5803lb # [ 147.579487] niks3-server[1016]: 2026/09/20 13:35:58 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5804lb # [ 147.589456] niks3-server[1016]: 2026/09/20 13:35:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5805worker1 # [ 147.510734] nix-grpc-daemon[1619]: time=2026-09-20T13:35:58.030Z level=INFO msg="Uploading 1 narinfos"5806lb # [ 147.594592] niks3-server[1016]: 2026/09/20 13:35:58 INFO Signed narinfos id=47 count=15807lb # [ 147.599399] niks3-server[1016]: 2026/09/20 13:35:58 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5808lb # [ 147.606070] niks3-server[1016]: 2026/09/20 13:35:58 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5809worker1 # [ 147.527332] nix-grpc-daemon[1619]: time=2026-09-20T13:35:58.047Z level=INFO msg="Upload complete. (308ms)"5810lb # [ 147.612273] niks3-server[1016]: 2026/09/20 13:35:58 INFO Completed upload id=475811lb # [ 147.616731] niks3-server[1016]: 2026/09/20 13:35:58 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5812worker1 # [ 147.541147] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=15813worker1 # [ 147.556307] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:58Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15814worker1 # [ 147.566495] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305815worker1 # [ 147.571435] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:58Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05816worker1 # [ 147.575992] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484305817worker1 # [ 147.580694] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484305818worker1 # [ 147.591032] nix-daemon[834]: reaped child process 1823, status = succeeded5819worker1 # [ 147.596157] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5820worker1 # [ 147.774975] nix-daemon[834]: accepted connection from pid 1849, user nix-grpc-daemon (trusted)5821worker1 # [ 147.791850] nix-daemon[834]: reaped child process 1852, status = succeeded5822worker1 # [ 147.966231] nix-daemon[834]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)5823worker1 # [ 147.983432] nix-daemon[834]: reaped child process 1857, status = succeeded5824lb # [ 148.078877] niks3-server[1016]: 2026/09/20 13:35:58 INFO Received uploads request method=POST path=/api/pending_closures5825worker1 # [ 148.006271] nix-grpc-daemon[1619]: time=2026-09-20T13:35:58.526Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5826worker1 # [ 148.007782] nix-grpc-daemon[1619]: time=2026-09-20T13:35:58.526Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5827lb # [ 148.106383] niks3-server[1016]: 2026/09/20 13:35:58 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5828lb # [ 148.118421] niks3-server[1016]: 2026/09/20 13:35:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5829worker1 # [ 148.041354] nix-grpc-daemon[1619]: time=2026-09-20T13:35:58.561Z level=INFO msg="Uploading 1 narinfos"5830lb # [ 148.129794] niks3-server[1016]: 2026/09/20 13:35:58 INFO Signed narinfos id=48 count=15831lb # [ 148.135240] niks3-server[1016]: 2026/09/20 13:35:58 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5832worker1 # [ 148.060496] nix-grpc-daemon[1619]: time=2026-09-20T13:35:58.580Z level=INFO msg="Upload complete. (458ms)"5833lb # [ 148.144829] niks3-server[1016]: 2026/09/20 13:35:58 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5834lb # [ 148.150001] niks3-server[1016]: 2026/09/20 13:35:58 INFO Completed upload id=485835worker1 # [ 148.066782] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=5125836lb # [ 148.152976] niks3-server[1016]: 2026/09/20 13:35:58 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5837worker1 # [ 148.079535] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305838worker1 # [ 148.085551] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5839worker1 # [ 148.090070] nix-daemon[834]: reaped child process 1847, status = succeeded5840worker1 # [ 148.100152] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5841worker1 # [ 148.720579] nix-daemon[834]: reaped child process 1861, status = succeeded5842worker1 # [ 148.878240] nix-daemon[834]: accepted connection from pid 1876, user nix-grpc-daemon (trusted)5843worker1 # [ 148.895170] nix-daemon[834]: reaped child process 1879, status = succeeded5844lb # [ 148.990459] niks3-server[1016]: 2026/09/20 13:35:59 INFO Received uploads request method=POST path=/api/pending_closures5845worker1 # [ 148.920144] nix-grpc-daemon[1619]: time=2026-09-20T13:35:59.436Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5846worker1 # [ 148.921619] nix-grpc-daemon[1619]: time=2026-09-20T13:35:59.436Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5847lb # [ 149.028199] niks3-server[1016]: 2026/09/20 13:35:59 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5848lb # [ 149.040630] niks3-server[1016]: 2026/09/20 13:35:59 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5849worker1 # [ 148.971624] nix-grpc-daemon[1619]: time=2026-09-20T13:35:59.491Z level=INFO msg="Uploading 1 narinfos"5850lb # [ 149.054427] niks3-server[1016]: 2026/09/20 13:35:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5851lb # [ 149.063531] niks3-server[1016]: 2026/09/20 13:35:59 INFO Signed narinfos id=49 count=15852lb # [ 149.070348] niks3-server[1016]: 2026/09/20 13:35:59 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5853lb # [ 149.079398] niks3-server[1016]: 2026/09/20 13:35:59 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5854lb # [ 149.085713] niks3-server[1016]: 2026/09/20 13:35:59 INFO Completed upload id=495855worker1 # [ 149.001936] nix-grpc-daemon[1619]: time=2026-09-20T13:35:59.522Z level=INFO msg="Upload complete. (292ms)"5856lb # [ 149.088859] niks3-server[1016]: 2026/09/20 13:35:59 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5857worker1 # [ 149.017982] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=15858worker1 # [ 149.034386] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:59Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15859worker1 # [ 149.044280] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305860worker1 # [ 149.049600] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:59Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05861worker1 # [ 149.055875] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484305862worker1 # [ 149.069767] nix-grpc-daemon[1549]: ts=2026-09-20T13:35:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484305863worker1 # [ 149.075590] nix-daemon[834]: reaped child process 1859, status = succeeded5864worker1 # [ 149.078044] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5865worker1 # [ 149.248885] nix-daemon[834]: accepted connection from pid 1885, user nix-grpc-daemon (trusted)5866worker1 # [ 149.265888] nix-daemon[834]: reaped child process 1888, status = succeeded5867worker1 # [ 149.434686] nix-daemon[834]: accepted connection from pid 1890, user nix-grpc-daemon (trusted)5868worker1 # [ 149.451127] nix-daemon[834]: reaped child process 1893, status = succeeded5869lb # [ 149.545208] niks3-server[1016]: 2026/09/20 13:36:00 INFO Received uploads request method=POST path=/api/pending_closures5870worker1 # [ 149.470959] nix-grpc-daemon[1619]: time=2026-09-20T13:35:59.990Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5871worker1 # [ 149.472556] nix-grpc-daemon[1619]: time=2026-09-20T13:35:59.990Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5872lb # [ 149.573352] niks3-server[1016]: 2026/09/20 13:36:00 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5873worker1 # [ 149.502403] nix-grpc-daemon[1619]: time=2026-09-20T13:36:00.022Z level=INFO msg="Uploading 1 narinfos"5874lb # [ 149.589018] niks3-server[1016]: 2026/09/20 13:36:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5875lb # [ 149.599526] niks3-server[1016]: 2026/09/20 13:36:00 INFO Signed narinfos id=50 count=15876worker1 # [ 149.526368] nix-grpc-daemon[1619]: time=2026-09-20T13:36:00.046Z level=INFO msg="Upload complete. (449ms)"5877lb # [ 149.604945] niks3-server[1016]: 2026/09/20 13:36:00 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5878worker1 # [ 149.532382] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=5125879lb # [ 149.616381] niks3-server[1016]: 2026/09/20 13:36:00 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5880lb # [ 149.621209] niks3-server[1016]: 2026/09/20 13:36:00 INFO Completed upload id=505881worker1 # [ 149.540375] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305882lb # [ 149.623474] niks3-server[1016]: 2026/09/20 13:36:00 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5883worker1 # [ 149.549372] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5884worker1 # [ 149.554161] nix-daemon[834]: reaped child process 1883, status = succeeded5885worker1 # [ 149.565638] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5886lb # [ 150.151877] envoy[915]: conn peer=[2001:db8:1::1]:39250 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9569 tx=3840 ms=61845887lb # [ 150.157073] envoy[915]: conn peer=[2001:db8:1::1]:43556 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2935 tx=1334 ms=132505888lb # [ 150.162013] envoy[915]: conn peer=[2001:db8:1::4]:33054 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=13762 tx=929 ms=442495889worker1 # [ 150.409756] nix-daemon[834]: reaped child process 1897, status = succeeded5890worker1 # [ 150.584993] nix-daemon[834]: accepted connection from pid 1912, user nix-grpc-daemon (trusted)5891worker1 # [ 150.603178] nix-daemon[834]: reaped child process 1915, status = succeeded5892lb # [ 150.702601] niks3-server[1016]: 2026/09/20 13:36:01 INFO Received uploads request method=POST path=/api/pending_closures5893worker1 # [ 150.630052] nix-grpc-daemon[1619]: time=2026-09-20T13:36:01.148Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5894worker1 # [ 150.631868] nix-grpc-daemon[1619]: time=2026-09-20T13:36:01.148Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5895lb # [ 150.738350] niks3-server[1016]: 2026/09/20 13:36:01 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5896worker1 # [ 150.670281] nix-grpc-daemon[1619]: time=2026-09-20T13:36:01.190Z level=INFO msg="Uploading 1 narinfos"5897lb # [ 150.753832] niks3-server[1016]: 2026/09/20 13:36:01 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5898lb # [ 150.765925] niks3-server[1016]: 2026/09/20 13:36:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5899lb # [ 150.776255] niks3-server[1016]: 2026/09/20 13:36:01 INFO Signed narinfos id=51 count=15900lb # [ 150.779715] niks3-server[1016]: 2026/09/20 13:36:01 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5901worker1 # [ 150.696425] nix-grpc-daemon[1619]: time=2026-09-20T13:36:01.216Z level=INFO msg="Upload complete. (322ms)"5902lb # [ 150.783308] niks3-server[1016]: 2026/09/20 13:36:01 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5903lb # [ 150.789083] niks3-server[1016]: 2026/09/20 13:36:01 INFO Completed upload id=515904lb # [ 150.791982] niks3-server[1016]: 2026/09/20 13:36:01 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5905worker1 # [ 150.712224] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=15906worker1 # [ 150.728679] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:01Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15907worker1 # [ 150.739835] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305908worker1 # [ 150.746297] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:01Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05909worker1 # [ 150.752454] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484305910worker1 # [ 150.757739] nix-daemon[834]: reaped child process 1895, status = succeeded5911worker1 # [ 150.760157] nix-grpc-daemon[1619]: time=2026-09-20T13:36:01.277Z level=INFO msg="All 1 paths already cached"5912worker1 # [ 150.765089] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484305913worker1 # [ 150.776980] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5914worker1 # [ 150.955355] nix-daemon[834]: accepted connection from pid 1921, user nix-grpc-daemon (trusted)5915worker1 # [ 150.974978] nix-daemon[834]: reaped child process 1924, status = succeeded5916worker1 # [ 151.145620] nix-daemon[834]: accepted connection from pid 1926, user nix-grpc-daemon (trusted)5917worker1 # [ 151.161897] nix-daemon[834]: reaped child process 1929, status = succeeded5918lb # [ 151.260455] niks3-server[1016]: 2026/09/20 13:36:01 INFO Received uploads request method=POST path=/api/pending_closures5919worker1 # [ 151.187433] nix-grpc-daemon[1619]: time=2026-09-20T13:36:01.707Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5920worker1 # [ 151.189063] nix-grpc-daemon[1619]: time=2026-09-20T13:36:01.707Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5921lb # [ 151.288527] niks3-server[1016]: 2026/09/20 13:36:01 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5922lb # [ 151.302646] niks3-server[1016]: 2026/09/20 13:36:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5923worker1 # [ 151.225422] nix-grpc-daemon[1619]: time=2026-09-20T13:36:01.745Z level=INFO msg="Uploading 1 narinfos"5924lb # [ 151.315094] niks3-server[1016]: 2026/09/20 13:36:01 INFO Signed narinfos id=52 count=15925lb # [ 151.320916] niks3-server[1016]: 2026/09/20 13:36:01 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5926worker1 # [ 151.245030] nix-grpc-daemon[1619]: time=2026-09-20T13:36:01.765Z level=INFO msg="Upload complete. (459ms)"5927lb # [ 151.329611] niks3-server[1016]: 2026/09/20 13:36:01 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5928lb # [ 151.335000] niks3-server[1016]: 2026/09/20 13:36:01 INFO Completed upload id=525929worker1 # [ 151.252176] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=6245930lb # [ 151.338389] niks3-server[1016]: 2026/09/20 13:36:01 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5931worker1 # [ 151.266095] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305932worker1 # [ 151.274563] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5933worker1 # [ 151.277516] nix-daemon[834]: reaped child process 1919, status = succeeded5934worker1 # [ 151.288215] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5935worker1 # [ 152.711324] nix-daemon[834]: reaped child process 1933, status = succeeded5936worker1 # [ 152.868733] nix-daemon[834]: accepted connection from pid 1948, user nix-grpc-daemon (trusted)5937worker1 # [ 152.886102] nix-daemon[834]: reaped child process 1951, status = succeeded5938lb # [ 152.983048] niks3-server[1016]: 2026/09/20 13:36:03 INFO Received uploads request method=POST path=/api/pending_closures5939worker1 # [ 152.912407] nix-grpc-daemon[1619]: time=2026-09-20T13:36:03.430Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5940worker1 # [ 152.913884] nix-grpc-daemon[1619]: time=2026-09-20T13:36:03.430Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5941lb # [ 153.027883] niks3-server[1016]: 2026/09/20 13:36:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5942worker1 # [ 152.953038] nix-grpc-daemon[1619]: time=2026-09-20T13:36:03.473Z level=INFO msg="Uploading 1 narinfos"5943lb # [ 153.040046] niks3-server[1016]: 2026/09/20 13:36:03 INFO Signed narinfos id=53 count=15944lb # [ 153.048957] niks3-server[1016]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5945lb # [ 153.061182] niks3-server[1016]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5946worker1 # [ 152.984058] nix-grpc-daemon[1619]: time=2026-09-20T13:36:03.504Z level=INFO msg="Upload complete. (285ms)"5947lb # [ 153.067225] niks3-server[1016]: 2026/09/20 13:36:03 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5948lb # [ 153.071318] niks3-server[1016]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5949lb # [ 153.076451] niks3-server[1016]: 2026/09/20 13:36:03 INFO Completed upload id=535950lb # [ 153.079119] niks3-server[1016]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5951worker1 # [ 152.994944] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=15952worker1 # [ 153.016263] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:03Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15953worker1 # [ 153.021128] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305954worker1 # [ 153.025698] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:03Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05955worker1 # [ 153.030073] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484305956worker1 # [ 153.034451] nix-daemon[834]: reaped child process 1931, status = succeeded5957worker1 # [ 153.037330] nix-grpc-daemon[1619]: time=2026-09-20T13:36:03.557Z level=INFO msg="All 1 paths already cached"5958worker1 # [ 153.043973] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484305959worker1 # [ 153.053226] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5960worker1 # [ 153.235621] nix-daemon[834]: accepted connection from pid 1957, user nix-grpc-daemon (trusted)5961worker1 # [ 153.255058] nix-daemon[834]: reaped child process 1960, status = succeeded5962worker1 # [ 153.423006] nix-daemon[834]: accepted connection from pid 1962, user nix-grpc-daemon (trusted)5963worker1 # [ 153.439133] nix-daemon[834]: reaped child process 1965, status = succeeded5964lb # [ 153.533197] niks3-server[1016]: 2026/09/20 13:36:04 INFO Received uploads request method=POST path=/api/pending_closures5965worker1 # [ 153.459327] nix-grpc-daemon[1619]: time=2026-09-20T13:36:03.979Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5966worker1 # [ 153.460959] nix-grpc-daemon[1619]: time=2026-09-20T13:36:03.979Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5967lb # [ 153.558608] niks3-server[1016]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5968lb # [ 153.570704] niks3-server[1016]: 2026/09/20 13:36:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5969worker1 # [ 153.494386] nix-grpc-daemon[1619]: time=2026-09-20T13:36:04.014Z level=INFO msg="Uploading 1 narinfos"5970lb # [ 153.580782] niks3-server[1016]: 2026/09/20 13:36:04 INFO Signed narinfos id=54 count=15971lb # [ 153.588888] niks3-server[1016]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5972lb # [ 153.596390] niks3-server[1016]: 2026/09/20 13:36:04 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5973worker1 # [ 153.521132] nix-grpc-daemon[1619]: time=2026-09-20T13:36:04.041Z level=INFO msg="Upload complete. (457ms)"5974lb # [ 153.604856] niks3-server[1016]: 2026/09/20 13:36:04 INFO Completed upload id=545975lb # [ 153.608708] niks3-server[1016]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5976worker1 # [ 153.528098] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=6245977worker1 # [ 153.539684] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484305978worker1 # [ 153.550788] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5979worker1 # [ 153.553129] nix-daemon[834]: reaped child process 1955, status = succeeded5980worker1 # [ 153.566987] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5981worker1 # [ 154.786690] nix-daemon[834]: reaped child process 1969, status = succeeded5982worker1 # [ 154.947122] nix-daemon[834]: accepted connection from pid 1984, user nix-grpc-daemon (trusted)5983worker1 # [ 154.963277] nix-daemon[834]: reaped child process 1987, status = succeeded5984lb # [ 155.063209] niks3-server[1016]: 2026/09/20 13:36:05 INFO Received uploads request method=POST path=/api/pending_closures5985worker1 # [ 154.990367] nix-grpc-daemon[1619]: time=2026-09-20T13:36:05.509Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5986worker1 # [ 154.991932] nix-grpc-daemon[1619]: time=2026-09-20T13:36:05.509Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5987lb # [ 155.101788] niks3-server[1016]: 2026/09/20 13:36:05 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5988lb # [ 155.112384] niks3-server[1016]: 2026/09/20 13:36:05 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5989worker1 # [ 155.040120] nix-grpc-daemon[1619]: time=2026-09-20T13:36:05.559Z level=INFO msg="Uploading 1 narinfos"5990lb # [ 155.125830] niks3-server[1016]: 2026/09/20 13:36:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5991lb # [ 155.133152] niks3-server[1016]: 2026/09/20 13:36:05 INFO Signed narinfos id=55 count=15992lb # [ 155.135587] niks3-server[1016]: 2026/09/20 13:36:05 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5993lb # [ 155.143499] niks3-server[1016]: 2026/09/20 13:36:05 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5994lb # [ 155.149953] niks3-server[1016]: 2026/09/20 13:36:05 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5995lb # [ 155.155203] niks3-server[1016]: 2026/09/20 13:36:05 INFO Completed upload id=555996worker1 # [ 155.072552] nix-grpc-daemon[1619]: time=2026-09-20T13:36:05.592Z level=INFO msg="Upload complete. (296ms)"5997worker1 # [ 155.090641] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=15998worker1 # [ 155.103667] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:05Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15999worker1 # [ 155.112185] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484306000worker1 # [ 155.115150] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:05Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06001worker1 # [ 155.120718] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484306002worker1 # [ 155.123620] nix-daemon[834]: reaped child process 1967, status = succeeded6003worker1 # [ 155.126291] nix-grpc-daemon[1619]: time=2026-09-20T13:36:05.645Z level=INFO msg="All 1 paths already cached"6004worker1 # [ 155.130899] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484306005worker1 # [ 155.140244] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6006worker1 # [ 155.321201] nix-daemon[834]: accepted connection from pid 1993, user nix-grpc-daemon (trusted)6007worker1 # [ 155.340462] nix-daemon[834]: reaped child process 1996, status = succeeded6008worker1 # [ 155.511243] nix-daemon[834]: accepted connection from pid 1998, user nix-grpc-daemon (trusted)6009worker1 # [ 155.527110] nix-daemon[834]: reaped child process 2001, status = succeeded6010lb # [ 155.627122] niks3-server[1016]: 2026/09/20 13:36:06 INFO Received uploads request method=POST path=/api/pending_closures6011worker1 # [ 155.554059] nix-grpc-daemon[1619]: time=2026-09-20T13:36:06.073Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6012worker1 # [ 155.555605] nix-grpc-daemon[1619]: time=2026-09-20T13:36:06.073Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6013lb # [ 155.656098] niks3-server[1016]: 2026/09/20 13:36:06 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6014worker1 # [ 155.586493] nix-grpc-daemon[1619]: time=2026-09-20T13:36:06.106Z level=INFO msg="Uploading 1 narinfos"6015lb # [ 155.671973] niks3-server[1016]: 2026/09/20 13:36:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6016lb # [ 155.681373] niks3-server[1016]: 2026/09/20 13:36:06 INFO Signed narinfos id=56 count=16017lb # [ 155.686997] niks3-server[1016]: 2026/09/20 13:36:06 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6018lb # [ 155.694939] niks3-server[1016]: 2026/09/20 13:36:06 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6019lb # [ 155.702343] niks3-server[1016]: 2026/09/20 13:36:06 INFO Completed upload id=566020worker1 # [ 155.618396] nix-grpc-daemon[1619]: time=2026-09-20T13:36:06.138Z level=INFO msg="Upload complete. (469ms)"6021worker1 # [ 155.624544] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=6246022lb # [ 155.707135] niks3-server[1016]: 2026/09/20 13:36:06 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6023worker1 # [ 155.638418] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484306024worker1 # [ 155.644199] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6025worker1 # [ 155.649304] nix-daemon[834]: reaped child process 1991, status = succeeded6026worker1 # [ 155.662360] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6027worker1 # [ 156.683100] nix-daemon[834]: reaped child process 2005, status = succeeded6028worker1 # [ 156.843070] nix-daemon[834]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)6029worker1 # [ 156.863034] nix-daemon[834]: reaped child process 2023, status = succeeded6030lb # [ 156.958569] niks3-server[1016]: 2026/09/20 13:36:07 INFO Received uploads request method=POST path=/api/pending_closures6031worker1 # [ 156.888476] nix-grpc-daemon[1619]: time=2026-09-20T13:36:07.405Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6032worker1 # [ 156.890053] nix-grpc-daemon[1619]: time=2026-09-20T13:36:07.405Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6033lb # [ 157.001317] niks3-server[1016]: 2026/09/20 13:36:07 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6034lb # [ 157.014691] niks3-server[1016]: 2026/09/20 13:36:07 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6035lb # [ 157.023277] niks3-server[1016]: 2026/09/20 13:36:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6036worker1 # [ 156.945685] nix-grpc-daemon[1619]: time=2026-09-20T13:36:07.465Z level=INFO msg="Uploading 1 narinfos"6037lb # [ 157.032435] niks3-server[1016]: 2026/09/20 13:36:07 INFO Signed narinfos id=57 count=16038lb # [ 157.034576] niks3-server[1016]: 2026/09/20 13:36:07 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6039lb # [ 157.041172] niks3-server[1016]: 2026/09/20 13:36:07 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6040lb # [ 157.048536] niks3-server[1016]: 2026/09/20 13:36:07 INFO Completed upload id=576041worker1 # [ 156.965778] nix-grpc-daemon[1619]: time=2026-09-20T13:36:07.485Z level=INFO msg="Upload complete. (294ms)"6042lb # [ 157.050799] niks3-server[1016]: 2026/09/20 13:36:07 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6043worker1 # [ 156.979884] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=16044worker1 # [ 156.996605] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:07Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16045worker1 # [ 157.008806] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484306046worker1 # [ 157.015986] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:07Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06047worker1 # [ 157.024240] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484306048worker1 # [ 157.027453] nix-grpc-daemon[1619]: time=2026-09-20T13:36:07.527Z level=INFO msg="All 2 paths already cached"6049worker1 # [ 157.030481] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6050worker1 # [ 157.039385] nix-daemon[834]: reaped child process 2003, status = succeeded6051worker1 # [ 157.042563] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484306052worker1 # [ 157.216203] nix-daemon[834]: accepted connection from pid 2029, user nix-grpc-daemon (trusted)6053worker1 # [ 157.232490] nix-daemon[834]: reaped child process 2032, status = succeeded6054worker1 # [ 157.409292] nix-daemon[834]: accepted connection from pid 2034, user nix-grpc-daemon (trusted)6055worker1 # [ 157.428155] nix-daemon[834]: reaped child process 2037, status = succeeded6056lb # [ 157.522330] niks3-server[1016]: 2026/09/20 13:36:08 INFO Received uploads request method=POST path=/api/pending_closures6057worker1 # [ 157.448054] nix-grpc-daemon[1619]: time=2026-09-20T13:36:07.968Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6058worker1 # [ 157.449959] nix-grpc-daemon[1619]: time=2026-09-20T13:36:07.969Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6059lb # [ 157.551550] niks3-server[1016]: 2026/09/20 13:36:08 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6060worker1 # [ 157.481440] nix-grpc-daemon[1619]: time=2026-09-20T13:36:08.001Z level=INFO msg="Uploading 1 narinfos"6061lb # [ 157.568244] niks3-server[1016]: 2026/09/20 13:36:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6062lb # [ 157.579007] niks3-server[1016]: 2026/09/20 13:36:08 INFO Signed narinfos id=58 count=16063worker1 # [ 157.506036] nix-grpc-daemon[1619]: time=2026-09-20T13:36:08.026Z level=INFO msg="Upload complete. (466ms)"6064lb # [ 157.588997] niks3-server[1016]: 2026/09/20 13:36:08 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6065lb # [ 157.593760] niks3-server[1016]: 2026/09/20 13:36:08 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6066worker1 # [ 157.512193] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=7526067lb # [ 157.598140] niks3-server[1016]: 2026/09/20 13:36:08 INFO Completed upload id=586068lb # [ 157.600249] niks3-server[1016]: 2026/09/20 13:36:08 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6069worker1 # [ 157.523577] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484306070worker1 # [ 157.529453] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6071worker1 # [ 157.534066] nix-daemon[834]: reaped child process 2027, status = succeeded6072worker1 # [ 157.545977] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6073worker1 # [ 158.585775] nix-daemon[834]: reaped child process 2041, status = succeeded6074worker1 # [ 158.768757] nix-daemon[834]: accepted connection from pid 2056, user nix-grpc-daemon (trusted)6075worker1 # [ 158.786254] nix-daemon[834]: reaped child process 2059, status = succeeded6076lb # [ 158.882827] niks3-server[1016]: 2026/09/20 13:36:09 INFO Received uploads request method=POST path=/api/pending_closures6077worker1 # [ 158.812592] nix-grpc-daemon[1619]: time=2026-09-20T13:36:09.331Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6078worker1 # [ 158.814965] nix-grpc-daemon[1619]: time=2026-09-20T13:36:09.331Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6079lb # [ 158.921177] niks3-server[1016]: 2026/09/20 13:36:09 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6080lb # [ 158.935511] niks3-server[1016]: 2026/09/20 13:36:09 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6081lb # [ 158.947815] niks3-server[1016]: 2026/09/20 13:36:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6082worker1 # [ 158.865473] nix-grpc-daemon[1619]: time=2026-09-20T13:36:09.385Z level=INFO msg="Uploading 1 narinfos"6083lb # [ 158.957169] niks3-server[1016]: 2026/09/20 13:36:09 INFO Signed narinfos id=59 count=16084lb # [ 158.962655] niks3-server[1016]: 2026/09/20 13:36:09 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6085lb # [ 158.972605] niks3-server[1016]: 2026/09/20 13:36:09 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6086lb # [ 158.977671] niks3-server[1016]: 2026/09/20 13:36:09 INFO Completed upload id=596087worker1 # [ 158.894227] nix-grpc-daemon[1619]: time=2026-09-20T13:36:09.414Z level=INFO msg="Upload complete. (333ms)"6088lb # [ 158.980630] niks3-server[1016]: 2026/09/20 13:36:09 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6089worker1 # [ 158.909218] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=16090worker1 # [ 158.925853] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:09Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16091worker1 # [ 158.931232] nix-daemon[834]: reaped child process 2039, status = succeeded6092worker1 # [ 158.949503] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484306093worker1 # [ 158.964523] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484306094worker1 # [ 158.979015] nix-grpc-daemon[1619]: time=2026-09-20T13:36:09.499Z level=INFO msg="All 2 paths already cached"6095worker1 # [ 158.990049] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484306096worker1 # [ 159.004374] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6097worker1 # [ 159.207022] nix-daemon[834]: accepted connection from pid 2063, user nix-grpc-daemon (trusted)6098worker1 # [ 159.226116] nix-daemon[834]: reaped child process 2066, status = succeeded6099worker1 # [ 159.397105] nix-daemon[834]: accepted connection from pid 2068, user nix-grpc-daemon (trusted)6100worker1 # [ 159.415921] nix-daemon[834]: reaped child process 2071, status = succeeded6101lb # [ 159.511425] niks3-server[1016]: 2026/09/20 13:36:10 INFO Received uploads request method=POST path=/api/pending_closures6102worker1 # [ 159.437413] nix-grpc-daemon[1619]: time=2026-09-20T13:36:09.957Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6103worker1 # [ 159.438908] nix-grpc-daemon[1619]: time=2026-09-20T13:36:09.957Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6104lb # [ 159.535841] niks3-server[1016]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6105lb # [ 159.550719] niks3-server[1016]: 2026/09/20 13:36:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6106worker1 # [ 159.473482] nix-grpc-daemon[1619]: time=2026-09-20T13:36:09.993Z level=INFO msg="Uploading 1 narinfos"6107lb # [ 159.563152] niks3-server[1016]: 2026/09/20 13:36:10 INFO Signed narinfos id=60 count=16108lb # [ 159.568514] niks3-server[1016]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6109worker1 # [ 159.493015] nix-grpc-daemon[1619]: time=2026-09-20T13:36:10.013Z level=INFO msg="Upload complete. (469ms)"6110lb # [ 159.577626] niks3-server[1016]: 2026/09/20 13:36:10 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6111lb # [ 159.582447] niks3-server[1016]: 2026/09/20 13:36:10 INFO Completed upload id=606112worker1 # [ 159.499470] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=7526113lb # [ 159.585529] niks3-server[1016]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6114worker1 # [ 159.509020] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484306115worker1 # [ 159.519698] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6116worker1 # [ 159.521789] nix-daemon[834]: reaped child process 2061, status = succeeded6117worker1 # [ 159.535068] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6118worker1 # [ 160.163759] nix-daemon[834]: reaped child process 2075, status = succeeded6119worker1 # [ 160.327461] nix-daemon[834]: accepted connection from pid 2090, user nix-grpc-daemon (trusted)6120worker1 # [ 160.343828] nix-daemon[834]: reaped child process 2093, status = succeeded6121lb # [ 160.442866] niks3-server[1016]: 2026/09/20 13:36:10 INFO Received uploads request method=POST path=/api/pending_closures6122worker1 # [ 160.371510] nix-grpc-daemon[1619]: time=2026-09-20T13:36:10.890Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6123worker1 # [ 160.376275] nix-grpc-daemon[1619]: time=2026-09-20T13:36:10.890Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6124lb # [ 160.487979] niks3-server[1016]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6125worker1 # [ 160.417031] nix-grpc-daemon[1619]: time=2026-09-20T13:36:10.936Z level=INFO msg="Uploading 1 narinfos"6126lb # [ 160.502875] niks3-server[1016]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6127lb # [ 160.514848] niks3-server[1016]: 2026/09/20 13:36:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6128lb # [ 160.519848] niks3-server[1016]: 2026/09/20 13:36:11 INFO Signed narinfos id=61 count=16129lb # [ 160.526259] niks3-server[1016]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6130lb # [ 160.531169] niks3-server[1016]: 2026/09/20 13:36:11 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6131lb # [ 160.534795] niks3-server[1016]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6132lb # [ 160.538864] niks3-server[1016]: 2026/09/20 13:36:11 INFO Completed upload id=616133worker1 # [ 160.455901] nix-grpc-daemon[1619]: time=2026-09-20T13:36:10.976Z level=INFO msg="Upload complete. (312ms)"6134worker1 # [ 160.469069] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=16135worker1 # [ 160.491789] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:10Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16136worker1 # [ 160.496631] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484306137worker1 # [ 160.501090] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484306138worker1 # [ 160.507289] nix-daemon[834]: reaped child process 2073, status = succeeded6139worker1 # [ 160.510012] nix-grpc-daemon[1619]: time=2026-09-20T13:36:11.030Z level=INFO msg="All 2 paths already cached"6140worker1 # [ 160.517672] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484306141worker1 # [ 160.528256] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6142worker1 # [ 160.716535] nix-daemon[834]: accepted connection from pid 2097, user nix-grpc-daemon (trusted)6143worker1 # [ 160.733515] nix-daemon[834]: reaped child process 2100, status = succeeded6144worker1 # [ 160.906294] nix-daemon[834]: accepted connection from pid 2102, user nix-grpc-daemon (trusted)6145worker1 # [ 160.922566] nix-daemon[834]: reaped child process 2105, status = succeeded6146lb # [ 161.016699] niks3-server[1016]: 2026/09/20 13:36:11 INFO Received uploads request method=POST path=/api/pending_closures6147worker1 # [ 160.942913] nix-grpc-daemon[1619]: time=2026-09-20T13:36:11.462Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6148worker1 # [ 160.944471] nix-grpc-daemon[1619]: time=2026-09-20T13:36:11.462Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6149lb # [ 161.043594] niks3-server[1016]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6150worker1 # [ 160.974745] nix-grpc-daemon[1619]: time=2026-09-20T13:36:11.494Z level=INFO msg="Uploading 1 narinfos"6151lb # [ 161.060661] niks3-server[1016]: 2026/09/20 13:36:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6152lb # [ 161.070839] niks3-server[1016]: 2026/09/20 13:36:11 INFO Signed narinfos id=62 count=16153lb # [ 161.074781] niks3-server[1016]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6154lb # [ 161.083817] niks3-server[1016]: 2026/09/20 13:36:11 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6155lb # [ 161.090684] niks3-server[1016]: 2026/09/20 13:36:11 INFO Completed upload id=626156worker1 # [ 161.007118] nix-grpc-daemon[1619]: time=2026-09-20T13:36:11.527Z level=INFO msg="Upload complete. (465ms)"6157lb # [ 161.093292] niks3-server[1016]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6158worker1 # [ 161.016242] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=0 paths=1 nar_bytes_in=7526159worker1 # [ 161.027940] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484306160worker1 # [ 161.036761] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6161worker1 # [ 161.038923] nix-daemon[834]: reaped child process 2095, status = succeeded6162worker1 # [ 161.051430] nix-daemon[834]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6163worker1 # [ 162.690302] nix-daemon[834]: reaped child process 2109, status = succeeded6164worker1 # [ 162.869734] nix-daemon[834]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)6165worker1 # [ 162.888507] nix-daemon[834]: reaped child process 2127, status = succeeded6166lb # [ 162.985706] niks3-server[1016]: 2026/09/20 13:36:13 INFO Received uploads request method=POST path=/api/pending_closures6167worker1 # [ 162.912462] nix-grpc-daemon[1619]: time=2026-09-20T13:36:13.431Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6168worker1 # [ 162.914281] nix-grpc-daemon[1619]: time=2026-09-20T13:36:13.431Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6169lb # [ 163.020484] niks3-server[1016]: 2026/09/20 13:36:13 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6170lb # [ 163.034995] niks3-server[1016]: 2026/09/20 13:36:13 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6171lb # [ 163.049217] niks3-server[1016]: 2026/09/20 13:36:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6172worker1 # [ 162.971198] nix-grpc-daemon[1619]: time=2026-09-20T13:36:13.490Z level=INFO msg="Uploading 1 narinfos"6173lb # [ 163.056924] niks3-server[1016]: 2026/09/20 13:36:13 INFO Signed narinfos id=63 count=16174lb # [ 163.062997] niks3-server[1016]: 2026/09/20 13:36:13 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6175lb # [ 163.072222] niks3-server[1016]: 2026/09/20 13:36:13 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6176lb # [ 163.080235] niks3-server[1016]: 2026/09/20 13:36:13 INFO Completed upload id=636177worker1 # [ 162.998212] nix-grpc-daemon[1619]: time=2026-09-20T13:36:13.516Z level=INFO msg="Upload complete. (335ms)"6178worker1 # [ 163.012302] nix-grpc-daemon[1619]: time=2026-09-20T13:36:13.517Z level=WARN msg="Failed to register uploaded object" key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo error="server returned 404: object is not pending upload\n"6179worker1 # [ 163.028627] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48430 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=16180worker1 # [ 163.035574] nix-daemon[834]: reaped child process 2107, status = succeeded6181client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.83 seconds)6182worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6183worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6184client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16185worker1 # [ 163.400929] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:484306186worker2 # [ 163.393354] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488886187worker2 # [ 163.411468] nix-daemon[846]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6188worker2 # [ 163.436331] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5)6189worker2 # [ 163.462130] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 2/5)6190worker2 # [ 163.536899] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 252 ms (attempt 3/5)6191worker2 # [ 163.789277] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 170 ms (attempt 4/5)6192worker2 # [ 163.967757] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6193worker1 # [ 164.025062] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:14Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06194lb # [ 170.155244] envoy[915]: conn peer=[2001:db8:1::1]:39528 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27204 tx=10705 ms=175236195client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.92 seconds)6196(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 48.83 seconds)6197subtest: low disk drains a worker and builds go to the other6198worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6199worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds)6200worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6201worker1 # [ 195.392197] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:45Z level=info event=unhealthy reason=min_free6202worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6203client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26204worker1 # [ 196.573596] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:484306205client # don't know how to build these paths:6206client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6207worker2 # [ 196.567494] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488886208worker1 # [ 196.622798] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:47Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06209worker1 # [ 196.630347] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:47Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16210worker2 # [ 196.645424] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488886211worker2 # [ 196.662425] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488886212client # copying 1 paths to 'lb:50051'...6213client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6214worker2 # [ 196.679557] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488886215worker2 # [ 196.698370] nix-daemon[846]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6216worker2 # [ 196.731563] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:47Z level=info event=niks3_push_started pid=16426217worker2 # [ 196.951232] nix-grpc-daemon[1642]: time=2026-09-20T13:36:47.448Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""6218worker2 # [ 197.126430] nix-daemon[846]: accepted connection from pid 1655, user nix-grpc-daemon (trusted)6219worker2 # [ 197.145131] nix-daemon[846]: reaped child process 1658, status = succeeded6220worker2 # [ 197.321307] nix-daemon[846]: accepted connection from pid 1660, user nix-grpc-daemon (trusted)6221worker2 # [ 197.339266] nix-daemon[846]: reaped child process 1663, status = succeeded6222lb # [ 197.458290] niks3-server[1016]: 2026/09/20 13:36:47 INFO Received uploads request method=POST path=/api/pending_closures6223worker2 # [ 197.363388] nix-grpc-daemon[1642]: time=2026-09-20T13:36:47.859Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6224worker2 # [ 197.365250] nix-grpc-daemon[1642]: time=2026-09-20T13:36:47.859Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6225lb # [ 197.496447] niks3-server[1016]: 2026/09/20 13:36:48 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6226worker2 # [ 197.403822] nix-grpc-daemon[1642]: time=2026-09-20T13:36:47.901Z level=INFO msg="Uploading 1 narinfos"6227lb # [ 197.510790] niks3-server[1016]: 2026/09/20 13:36:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6228lb # [ 197.522723] niks3-server[1016]: 2026/09/20 13:36:48 INFO Signed narinfos id=64 count=16229lb # [ 197.529735] niks3-server[1016]: 2026/09/20 13:36:48 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6230lb # [ 197.541401] niks3-server[1016]: 2026/09/20 13:36:48 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6231worker2 # [ 197.439574] nix-grpc-daemon[1642]: time=2026-09-20T13:36:47.937Z level=INFO msg="Upload complete. (483ms)"6232lb # [ 197.548405] niks3-server[1016]: 2026/09/20 13:36:48 INFO Completed upload id=646233lb # [ 197.552952] niks3-server[1016]: 2026/09/20 13:36:48 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6234worker2 # [ 197.448267] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=5126235worker2 # [ 197.462777] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488886236worker2 # [ 197.469631] nix-daemon[846]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6237worker2 # [ 197.474731] nix-daemon[846]: reaped child process 1640, status = succeeded6238client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6239worker2 # [ 197.485738] nix-daemon[846]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6240client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6241client # farm-a> LOG-farm-a-drain6242worker2 # [ 198.729821] nix-daemon[846]: reaped child process 1667, status = succeeded6243worker2 # [ 198.920506] nix-daemon[846]: accepted connection from pid 1682, user nix-grpc-daemon (trusted)6244worker2 # [ 198.938427] nix-daemon[846]: reaped child process 1685, status = succeeded6245lb # [ 199.058676] niks3-server[1016]: 2026/09/20 13:36:49 INFO Received uploads request method=POST path=/api/pending_closures6246worker2 # [ 198.963508] nix-grpc-daemon[1642]: time=2026-09-20T13:36:49.457Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6247worker2 # [ 198.965710] nix-grpc-daemon[1642]: time=2026-09-20T13:36:49.458Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6248lb # [ 199.094211] niks3-server[1016]: 2026/09/20 13:36:49 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6249lb # [ 199.105301] niks3-server[1016]: 2026/09/20 13:36:49 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6250lb # [ 199.115981] niks3-server[1016]: 2026/09/20 13:36:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6251lb # [ 199.122008] niks3-server[1016]: 2026/09/20 13:36:49 INFO Signed narinfos id=65 count=16252worker2 # [ 199.015344] nix-grpc-daemon[1642]: time=2026-09-20T13:36:49.511Z level=INFO msg="Uploading 1 narinfos"6253lb # [ 199.126640] niks3-server[1016]: 2026/09/20 13:36:49 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6254lb # [ 199.137440] niks3-server[1016]: 2026/09/20 13:36:49 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6255lb # [ 199.145592] niks3-server[1016]: 2026/09/20 13:36:49 INFO Completed upload id=656256worker2 # [ 199.038692] nix-grpc-daemon[1642]: time=2026-09-20T13:36:49.536Z level=INFO msg="Upload complete. (340ms)"6257lb # [ 199.148617] niks3-server[1016]: 2026/09/20 13:36:49 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6258worker1 # [ 199.081217] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:49Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06259worker2 # [ 199.049196] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=16260worker1 # [ 199.081575] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:49Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16261worker2 # [ 199.066945] nix-daemon[846]: reaped child process 1665, status = succeeded6262worker2 # [ 199.101577] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488886263worker2 # [ 199.116855] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488886264worker2 # [ 199.131176] nix-grpc-daemon[1642]: time=2026-09-20T13:36:49.628Z level=INFO msg="All 1 paths already cached"6265client # copying 1 paths to 'lb:50051'...6266client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6267worker2 # [ 199.144366] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488886268worker2 # [ 199.160606] nix-daemon[846]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6269worker2 # [ 199.362624] nix-daemon[846]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6270worker2 # [ 199.382429] nix-daemon[846]: reaped child process 1692, status = succeeded6271worker2 # [ 199.553269] nix-daemon[846]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6272worker2 # [ 199.573503] nix-daemon[846]: reaped child process 1697, status = succeeded6273lb # [ 199.691213] niks3-server[1016]: 2026/09/20 13:36:50 INFO Received uploads request method=POST path=/api/pending_closures6274worker2 # [ 199.593214] nix-grpc-daemon[1642]: time=2026-09-20T13:36:50.090Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6275worker2 # [ 199.594718] nix-grpc-daemon[1642]: time=2026-09-20T13:36:50.090Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6276lb # [ 199.720368] niks3-server[1016]: 2026/09/20 13:36:50 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6277worker2 # [ 199.624106] nix-grpc-daemon[1642]: time=2026-09-20T13:36:50.121Z level=INFO msg="Uploading 1 narinfos"6278lb # [ 199.734569] niks3-server[1016]: 2026/09/20 13:36:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6279lb # [ 199.745388] niks3-server[1016]: 2026/09/20 13:36:50 INFO Signed narinfos id=66 count=16280lb # [ 199.750540] niks3-server[1016]: 2026/09/20 13:36:50 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6281worker2 # [ 199.651361] nix-grpc-daemon[1642]: time=2026-09-20T13:36:50.148Z level=INFO msg="Upload complete. (473ms)"6282lb # [ 199.760344] niks3-server[1016]: 2026/09/20 13:36:50 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6283lb # [ 199.765270] niks3-server[1016]: 2026/09/20 13:36:50 INFO Completed upload id=666284worker2 # [ 199.658283] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=6326285lb # [ 199.768660] niks3-server[1016]: 2026/09/20 13:36:50 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6286worker2 # [ 199.670076] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488886287worker2 # [ 199.675567] nix-daemon[846]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6288worker2 # [ 199.680251] nix-daemon[846]: reaped child process 1687, status = succeeded6289client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6290worker2 # [ 199.691476] nix-daemon[846]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6291client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6292lb # [ 200.157146] envoy[915]: conn peer=[2001:db8:1::1]:43876 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=914 tx=539 ms=306466293client # farm-b> LOG-farm-b-drain6294worker2 # [ 200.519278] nix-daemon[846]: reaped child process 1701, status = succeeded6295worker2 # [ 200.679619] nix-daemon[846]: accepted connection from pid 1716, user nix-grpc-daemon (trusted)6296worker2 # [ 200.699706] nix-daemon[846]: reaped child process 1719, status = succeeded6297lb # [ 200.818892] niks3-server[1016]: 2026/09/20 13:36:51 INFO Received uploads request method=POST path=/api/pending_closures6298worker2 # [ 200.722079] nix-grpc-daemon[1642]: time=2026-09-20T13:36:51.218Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6299worker2 # [ 200.723631] nix-grpc-daemon[1642]: time=2026-09-20T13:36:51.218Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6300lb # [ 200.852204] niks3-server[1016]: 2026/09/20 13:36:51 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6301lb # [ 200.863172] niks3-server[1016]: 2026/09/20 13:36:51 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6302worker2 # [ 200.769862] nix-grpc-daemon[1642]: time=2026-09-20T13:36:51.267Z level=INFO msg="Uploading 1 narinfos"6303lb # [ 200.880910] niks3-server[1016]: 2026/09/20 13:36:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6304lb # [ 200.891614] niks3-server[1016]: 2026/09/20 13:36:51 INFO Signed narinfos id=67 count=16305lb # [ 200.895602] niks3-server[1016]: 2026/09/20 13:36:51 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6306lb # [ 200.903656] niks3-server[1016]: 2026/09/20 13:36:51 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6307lb # [ 200.908720] niks3-server[1016]: 2026/09/20 13:36:51 INFO Completed upload id=676308worker2 # [ 200.801295] nix-grpc-daemon[1642]: time=2026-09-20T13:36:51.298Z level=INFO msg="Upload complete. (301ms)"6309lb # [ 200.911651] niks3-server[1016]: 2026/09/20 13:36:51 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6310worker2 # [ 200.816516] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=16311worker1 # [ 200.843858] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:51Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06312worker1 # [ 200.849674] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:51Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16313worker2 # [ 200.834484] nix-daemon[846]: reaped child process 1699, status = succeeded6314worker2 # [ 200.865612] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488886315worker2 # [ 200.881303] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488886316worker2 # [ 200.895608] nix-grpc-daemon[1642]: time=2026-09-20T13:36:51.393Z level=INFO msg="All 2 paths already cached"6317client # copying 1 paths to 'lb:50051'...6318client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6319worker2 # [ 200.905997] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488886320worker2 # [ 200.919735] nix-daemon[846]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6321worker2 # [ 201.122277] nix-daemon[846]: accepted connection from pid 1723, user nix-grpc-daemon (trusted)6322worker2 # [ 201.139636] nix-daemon[846]: reaped child process 1726, status = succeeded6323worker2 # [ 201.309065] nix-daemon[846]: accepted connection from pid 1728, user nix-grpc-daemon (trusted)6324worker2 # [ 201.326406] nix-daemon[846]: reaped child process 1731, status = succeeded6325lb # [ 201.444363] niks3-server[1016]: 2026/09/20 13:36:51 INFO Received uploads request method=POST path=/api/pending_closures6326worker2 # [ 201.346825] nix-grpc-daemon[1642]: time=2026-09-20T13:36:51.844Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6327worker2 # [ 201.348376] nix-grpc-daemon[1642]: time=2026-09-20T13:36:51.844Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6328lb # [ 201.474769] niks3-server[1016]: 2026/09/20 13:36:51 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6329lb # [ 201.483241] niks3-server[1016]: 2026/09/20 13:36:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6330worker2 # [ 201.382367] nix-grpc-daemon[1642]: time=2026-09-20T13:36:51.879Z level=INFO msg="Uploading 1 narinfos"6331lb # [ 201.496001] niks3-server[1016]: 2026/09/20 13:36:51 INFO Signed narinfos id=68 count=16332lb # [ 201.498951] niks3-server[1016]: 2026/09/20 13:36:52 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6333lb # [ 201.508577] niks3-server[1016]: 2026/09/20 13:36:52 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6334lb # [ 201.515803] niks3-server[1016]: 2026/09/20 13:36:52 INFO Completed upload id=686335worker2 # [ 201.408852] nix-grpc-daemon[1642]: time=2026-09-20T13:36:51.906Z level=INFO msg="Upload complete. (472ms)"6336lb # [ 201.518508] niks3-server[1016]: 2026/09/20 13:36:52 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6337worker2 # [ 201.416112] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=7606338worker2 # [ 201.425471] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488886339worker2 # [ 201.431373] nix-daemon[846]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6340worker2 # [ 201.435866] nix-daemon[846]: reaped child process 1721, status = succeeded6341client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6342worker2 # [ 201.448196] nix-daemon[846]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6343client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6344client # farm-top> LOG-farm-top-drain6345worker2 # [ 202.874803] nix-daemon[846]: reaped child process 1735, status = succeeded6346worker2 # [ 203.040088] nix-daemon[846]: accepted connection from pid 1750, user nix-grpc-daemon (trusted)6347worker2 # [ 203.057401] nix-daemon[846]: reaped child process 1753, status = succeeded6348lb # [ 203.178789] niks3-server[1016]: 2026/09/20 13:36:53 INFO Received uploads request method=POST path=/api/pending_closures6349worker2 # [ 203.082938] nix-grpc-daemon[1642]: time=2026-09-20T13:36:53.578Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6350worker2 # [ 203.084514] nix-grpc-daemon[1642]: time=2026-09-20T13:36:53.578Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6351lb # [ 203.213308] niks3-server[1016]: 2026/09/20 13:36:53 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6352lb # [ 203.224746] niks3-server[1016]: 2026/09/20 13:36:53 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6353worker2 # [ 203.129745] nix-grpc-daemon[1642]: time=2026-09-20T13:36:53.627Z level=INFO msg="Uploading 1 narinfos"6354lb # [ 203.236319] niks3-server[1016]: 2026/09/20 13:36:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6355lb # [ 203.244053] niks3-server[1016]: 2026/09/20 13:36:53 INFO Signed narinfos id=69 count=16356lb # [ 203.246761] niks3-server[1016]: 2026/09/20 13:36:53 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6357lb # [ 203.257389] niks3-server[1016]: 2026/09/20 13:36:53 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6358lb # [ 203.263108] niks3-server[1016]: 2026/09/20 13:36:53 INFO Completed upload id=696359worker2 # [ 203.155502] nix-grpc-daemon[1642]: time=2026-09-20T13:36:53.653Z level=INFO msg="Upload complete. (297ms)"6360lb # [ 203.266049] niks3-server[1016]: 2026/09/20 13:36:53 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6361worker2 # [ 203.164853] nix-grpc-daemon[1586]: ts=2026-09-20T13:36:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=16362worker2 # [ 203.181022] nix-daemon[846]: reaped child process 1733, status = succeeded6363client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.92 seconds)6364client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6365client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds)6366worker1: must succeed: rm /nix/.rw-store/fill6367worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds)6368worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6369worker1 # [ 204.397266] nix-grpc-daemon[1549]: ts=2026-09-20T13:36:54Z level=info event=healthy reason=min_free6370worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6371(finished: subtest: low disk drains a worker and builds go to the other, in 10.79 seconds)6372(finished: run the VM test script, in 205.89 seconds)6373test script finished in 206.16s6374cleanup6375kill QemuMachine (pid 49)6376client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6377kill QemuMachine (pid 50)6378lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6379kill QemuMachine (pid 51)6380worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6381kill QemuMachine (pid 52)6382worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6383(finished: cleanup, in 1.21 seconds)6384additionally exposed symbols:6385 client, lb, worker1, worker2,6386 vlan1,6387 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh