vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #234
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.01 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2 # Formatting '/build/vm-state-worker2/tmp.OsseMwt39M', fmt=raw size=107374182414worker2 # mke2fs 1.47.4 (6-Mar-2025)15worker2: QEMU running (pid 52)16worker1 # Disk image does not exist, creating the virtualisation disk image...17lb # Disk image does not exist, creating the virtualisation disk image...18worker1: QEMU running (pid 51)19worker2 # Discarding device blocks: 0/262144 done20worker1 # Formatting '/build/vm-state-worker1/tmp.UJVo3XtBA2', fmt=raw size=107374182421client # Disk image does not exist, creating the virtualisation disk image...22client: QEMU running (pid 50)23worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes24worker1 # mke2fs 1.47.4 (6-Mar-2025)25client # Formatting '/build/vm-state-client/tmp.IHcf4oOP3a', fmt=raw size=107374182426lb # Formatting '/build/vm-state-lb/tmp.49PT3n1J3B', fmt=raw size=107374182427lb: QEMU running (pid 49)28client # mke2fs 1.47.4 (6-Mar-2025)29lb # mke2fs 1.47.4 (6-Mar-2025)30worker2 # Filesystem UUID: c5e7dc43-1556-4841-aee5-bb80ca2546dc31worker1 # Discarding device blocks: 0/262144 done32(finished: start all VMs, in 0.59 seconds)33worker2 # Superblock backups stored on blocks:34worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes35client: waiting for unit network-addresses-eth1.service36worker2 # 32768, 98304, 163840, 22937637worker1 # Filesystem UUID: f70f792e-5fe6-4b31-8ae7-383d5363f52a38client: waiting for the VM to finish booting39worker2 # 40worker1 # Superblock backups stored on blocks:41lb # Discarding device blocks: 0/262144 done42client # Discarding device blocks: 0/262144 done43worker2 # Allocating group tables: 0/8 done44worker1 # 32768, 98304, 163840, 22937645lb # Creating filesystem with 262144 4k blocks and 65536 inodes46client # Creating filesystem with 262144 4k blocks and 65536 inodes47worker2 # Writing inode tables: 0/8 done48worker1 # 49lb # Filesystem UUID: 3faef092-bc18-4198-9413-3d057e50018750client # Filesystem UUID: 324c9012-85e1-4c39-b497-46f6f9e41c9651worker2 # Creating journal (8192 blocks): done52worker1 # Allocating group tables: 0/8 done53lb # Superblock backups stored on blocks:54client # Superblock backups stored on blocks:55worker2 # Writing superblocks and filesystem accounting information: 0/8 done56worker1 # Writing inode tables: 0/8 done57lb # 32768, 98304, 163840, 22937658client # 32768, 98304, 163840, 22937659worker2 # 60worker1 # Creating journal (8192 blocks): done61lb # 62client # 63worker2 # Virtualisation disk image created.64worker1 # Writing superblocks and filesystem accounting information: 0/8 done65lb # Allocating group tables: 0/8 done66worker1 # 67lb # Writing inode tables: 0/8 done68worker1 # Virtualisation disk image created.69lb # Creating journal (8192 blocks): done70client # Allocating group tables: 0/8 done71lb # Writing superblocks and filesystem accounting information: 0/8 done72client # Writing inode tables: 0/8 done73lb # 74client # Creating journal (8192 blocks): done75lb # Virtualisation disk image created.76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681lb # [ 0.000000] KASLR enabled82lb # [ 0.000000] random: crng init done83lb # [ 0.000000] Machine model: linux,dummy-virt84lb # [ 0.000000] efi: UEFI not found.85lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88lb # [ 0.000000] Zone ranges:89lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90lb # [ 0.000000] DMA32 empty91lb # [ 0.000000] Normal empty92lb # [ 0.000000] Device empty93lb # [ 0.000000] Movable zone start for each node94lb # [ 0.000000] Early memory node ranges95lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098lb # [ 0.000000] psci: probing for conduit method from DT.99lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.100lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101lb # [ 0.000000] psci: Trusted OS migration not required102lb # [ 0.000000] psci: SMC Calling Convention v1.1103lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105lb # [ 0.000000] Detected PIPT I-cache on CPU0106lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107lb # [ 0.000000] CPU features: detected: GICv3 CPU interface108lb # [ 0.000000] CPU features: detected: Spectre-v4109lb # [ 0.000000] CPU features: detected: Spectre-BHB110lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112lb # [ 0.000000] alternatives: applying boot alternatives113lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0114lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.115lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119lb # [ 0.000000] software IO TLB: area num 1.120lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122lb # [ 0.000000] Fallback order for Node 0: 0123lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124lb # [ 0.000000] Policy zone: DMA125lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127lb # [ 0.000000] allocated 3145728 bytes of page_ext128lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups130lb # [ 0.000000] rcu: Hierarchical RCU implementation.131lb # [ 0.000000] rcu: RCU event tracing is enabled.132lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.134lb # [ 0.000000] Rude variant of Tasks RCU enabled.135lb # [ 0.000000] Tracing variant of Tasks RCU enabled.136lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.139lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0142lb # [ 0.000000] GICv3: 256 SPIs implemented143lb # [ 0.000000] GICv3: 0 Extended SPIs implemented144lb # [ 0.000000] Root IRQ handler: gic_handle_irq145lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI146lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0147lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000148lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]149lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)150lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)151lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000152lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000153lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.154lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns155lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).156lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns157worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]158lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns159lb # [ 0.000040] arm-pv: using stolen time PV160worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026161lb # [ 0.000703] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)162worker1 # [ 0.000000] KASLR enabled163worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]164lb # [ 0.000898] Console: colour dummy device 80x25165worker1 # [ 0.000000] random: crng init done166worker1 # [ 0.000000] Machine model: linux,dummy-virt167lb # [ 0.000907] printk: legacy console [tty0] enabled168worker1 # [ 0.000000] efi: UEFI not found.169worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026170worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT171worker2 # [ 0.000000] KASLR enabled172lb # [ 0.001131] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)173worker2 # [ 0.000000] random: crng init done174lb # [ 0.001138] pid_max: default: 32768 minimum: 301175worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]176worker2 # [ 0.000000] Machine model: linux,dummy-virt177lb # [ 0.001217] LSM: initializing lsm=capability,landlock,yama,bpf,ima178worker2 # [ 0.000000] efi: UEFI not found.179worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]180lb # [ 0.001412] landlock: Up and running.181worker1 # [ 0.000000] Zone ranges:182lb # [ 0.001415] Yama: becoming mindful.183worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT184worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]185lb # [ 0.002151] LSM support for eBPF active186worker1 # [ 0.000000] DMA32 empty187worker1 # [ 0.000000] Normal empty188worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]189lb # [ 0.002330] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)190worker1 # [ 0.000000] Device empty191worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]192worker1 # [ 0.000000] Movable zone start for each node193worker2 # [ 0.000000] Zone ranges:194lb # [ 0.002365] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)195worker1 # [ 0.000000] Early memory node ranges196worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]197worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]198worker2 # [ 0.000000] DMA32 empty199worker2 # [ 0.000000] Normal empty200lb # [ 0.003654] cacheinfo: Unable to detect cache hierarchy for CPU 0201worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]202worker2 # [ 0.000000] Device empty203lb # [ 0.004508] rcu: Hierarchical SRCU implementation.204worker2 # [ 0.000000] Movable zone start for each node205worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000206worker2 # [ 0.000000] Early memory node ranges207lb # [ 0.004513] rcu: Max phase no-delay instances is 1000.208worker1 # [ 0.000000] psci: probing for conduit method from DT.209lb # [ 0.005770] fsl-mc MSI: its@8080000 domain created210worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.211worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]212lb # [ 0.005874] EFI services will not be available.213worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs214worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]215lb # [ 0.005952] smp: Bringing up secondary CPUs ...216worker1 # [ 0.000000] psci: Trusted OS migration not required217lb # [ 0.005963] smp: Brought up 1 node, 1 CPU218worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000219worker1 # [ 0.000000] psci: SMC Calling Convention v1.1220lb # [ 0.005966] SMP: Total of 1 processors activated.221worker2 # [ 0.000000] psci: probing for conduit method from DT.222lb # [ 0.005972] CPU: All CPU(s) started at EL1223worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)224worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.225lb # [ 0.005986] CPU features: detected: Branch Target Identification226worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs227worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296228lb # [ 0.005992] CPU features: detected: ARMv8.4 Translation Table Level229worker2 # [ 0.000000] psci: Trusted OS migration not required230worker1 # [ 0.000000] Detected PIPT I-cache on CPU0231worker2 # [ 0.000000] psci: SMC Calling Convention v1.1232worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)233lb # [ 0.005995] CPU features: detected: Instruction cache invalidation not required for I/D coherence234worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface235worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)236lb # [ 0.005998] CPU features: detected: Data cache clean to the PoU not required for I/D coherence237worker1 # [ 0.000000] CPU features: detected: Spectre-v4238worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296239worker1 # [ 0.000000] CPU features: detected: Spectre-BHB240lb # [ 0.006002] CPU features: detected: Common not Private translations241worker2 # [ 0.000000] Detected PIPT I-cache on CPU0242worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38243lb # [ 0.006005] CPU features: detected: CRC32 instructions244worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)245worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23246lb # [ 0.006008] CPU features: detected: Data cache clean to Point of Deep Persistence247worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface248worker1 # [ 0.000000] alternatives: applying boot alternatives249lb # [ 0.006012] CPU features: detected: Data cache clean to Point of Persistence250worker2 # [ 0.000000] CPU features: detected: Spectre-v4251worker2 # [ 0.000000] CPU features: detected: Spectre-BHB252lb # [ 0.006015] CPU features: detected: Data independent timing control (DIT)253lb # [ 0.006018] CPU features: detected: E0PD254worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38255worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23256client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]257lb # [ 0.006021] CPU features: detected: Enhanced Counter Virtualization258worker2 # [ 0.000000] alternatives: applying boot alternatives259lb # [ 0.006024] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)260worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xkyzp3qp6pddhvd73q6zkbc6j38frf29-nixos-system-worker1-test/init regInfo=/nix/store/5gw6mpva1f7nr3wj3a3mv8hypcarfw9n-closure-info/registration console=ttyAMA0,115200n8 console=tty0261lb # [ 0.006027] CPU features: detected: Enhanced Virtualization Traps262client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026263client # [ 0.000000] KASLR enabled264lb # [ 0.006030] CPU features: detected: Fine Grained Traps265client # [ 0.000000] random: crng init done266client # [ 0.000000] Machine model: linux,dummy-virt267worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/5gw6mpva1f7nr3wj3a3mv8hypcarfw9n-closure-info/registration", will be passed to user space.268lb # [ 0.006034] CPU features: detected: Generic authentication (architected QARMA5 algorithm)269client # [ 0.000000] efi: UEFI not found.270worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes271lb # [ 0.006039] CPU features: detected: RCpc load-acquire (LDAPR)272client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT273worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/yxp2059hn211624f8dhhfjfs5kz281ys-nixos-system-worker2-test/init regInfo=/nix/store/hxm98vqcx7mc1kl18z81zjvfrwyk3rx0-closure-info/registration console=ttyAMA0,115200n8 console=tty0274lb # [ 0.006042] CPU features: detected: LSE atomic instructions275worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)276client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]277lb # [ 0.006045] CPU features: detected: Privileged Access Never278worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)279lb # [ 0.006048] CPU features: detected: PMUv3280client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]281client # [ 0.000000] Zone ranges:282worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/hxm98vqcx7mc1kl18z81zjvfrwyk3rx0-closure-info/registration", will be passed to user space.283lb # [ 0.006051] CPU features: detected: RAS Extension Support284worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB285client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]286worker1 # [ 0.000000] software IO TLB: area num 1.287lb # [ 0.006054] CPU features: detected: RASv1p1 Extension Support288worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes289client # [ 0.000000] DMA32 empty290client # [ 0.000000] Normal empty291lb # [ 0.006056] CPU features: detected: Random Number Generator292worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB293client # [ 0.000000] Device empty294worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)295lb # [ 0.006059] CPU features: detected: Speculation barrier (SB)296client # [ 0.000000] Movable zone start for each node297worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)298client # [ 0.000000] Early memory node ranges299worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)300lb # [ 0.006062] CPU features: detected: Stage-2 Force Write-Back301worker1 # [ 0.000000] Fallback order for Node 0: 0302client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]303worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB304lb # [ 0.006065] CPU features: detected: TLB range maintenance instructions305worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216306worker2 # [ 0.000000] software IO TLB: area num 1.307worker1 # [ 0.000000] Policy zone: DMA308client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]309lb # [ 0.006070] CPU features: detected: Speculative Store Bypassing Safe (SSBS)310client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000311worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB312worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off313lb # [ 0.006114] alternatives: applying system-wide alternatives314client # [ 0.000000] psci: probing for conduit method from DT.315worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1316worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)317lb # [ 0.009433] CPU features: detected: BBM Level 2 without TLB conflict abort318client # [ 0.000000] psci: PSCIv1.3 detected in firmware.319worker1 # [ 0.000000] allocated 3145728 bytes of page_ext320worker2 # [ 0.000000] Fallback order for Node 0: 0321client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs322worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages323worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216324client # [ 0.000000] psci: Trusted OS migration not required325worker2 # [ 0.000000] Policy zone: DMA326worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups327lb # [ 0.009654] Memory: 1406540K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)328client # [ 0.000000] psci: SMC Calling Convention v1.1329worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.330lb # [ 0.010102] devtmpfs: initialized331worker1 # [ 0.000000] rcu: RCU event tracing is enabled.332worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off333client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)334lb # [ 0.012152] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)335worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.336client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296337worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1338client # [ 0.000000] Detected PIPT I-cache on CPU0339worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.340worker2 # [ 0.000000] allocated 3145728 bytes of page_ext341worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.342lb # [ 0.012183] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).343worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages344worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.345lb # [ 0.012429] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL346client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)347lb # [ 0.012435] 0 pages in range for non-PLT usage348worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups349lb # [ 0.012436] 508288 pages in range for PLT usage350client # [ 0.000000] CPU features: detected: GICv3 CPU interface351worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.352client # [ 0.000000] CPU features: detected: Spectre-v4353worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.354lb # [ 0.012582] pinctrl core: initialized pinctrl subsystem355client # [ 0.000000] CPU features: detected: Spectre-BHB356worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1357lb # [ 0.013507] DMI not present or invalid.358worker2 # [ 0.000000] rcu: RCU event tracing is enabled.359lb # [ 0.017501] NET: Registered PF_NETLINK/PF_ROUTE protocol family360worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.361worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.362client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38363client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23364worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.365lb # [ 0.020034] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations366client # [ 0.000000] alternatives: applying boot alternatives367worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.368worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.369lb # [ 0.020231] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations370worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.371worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.372lb # [ 0.020464] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations373worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.374worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0375worker1 # [ 0.000000] GICv3: 256 SPIs implemented376lb # [ 0.020496] audit: initializing netlink subsys (disabled)377worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1378worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented379lb # [ 0.021174] thermal_sys: Registered thermal governor 'fair_share'380worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq381lb # [ 0.021176] thermal_sys: Registered thermal governor 'bang_bang'382client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/08rrs8i91ayi9z7hmrkavgm4mxank57z-nixos-system-client-test/init regInfo=/nix/store/ybgv6yg70j1fvpfsa2gggifl76gh7ngw-closure-info/registration console=ttyAMA0,115200n8 console=tty0383worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.384worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI385lb # [ 0.021181] thermal_sys: Registered thermal governor 'step_wise'386worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0387worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.388lb # [ 0.021189] thermal_sys: Registered thermal governor 'user_space'389worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000390client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ybgv6yg70j1fvpfsa2gggifl76gh7ngw-closure-info/registration", will be passed to user space.391worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]392lb # [ 0.021192] thermal_sys: Registered thermal governor 'power_allocator'393worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.394client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes395lb # [ 0.021219] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1396worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)397worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0398client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)399lb # [ 0.021231] cpuidle: using governor ladder400lb # [ 0.021237] cpuidle: using governor menu401worker2 # [ 0.000000] GICv3: 256 SPIs implemented402client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)403worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)404worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented405lb # [ 0.021490] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.406worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000407worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq408client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB409lb # [ 0.021508] ASID allocator initialised with 65536 entries410worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI411client # [ 0.000000] software IO TLB: area num 1.412lb # [ 0.022832] Serial: AMBA PL011 UART driver413worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000414worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0415client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB416worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.417lb # [ 0.028898] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1418worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000419client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)420lb # [ 0.029087] printk: console [ttyAMA0] enabled421worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]422client # [ 0.000000] Fallback order for Node 0: 0423worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns424client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216425worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)426worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).427client # [ 0.000000] Policy zone: DMA428client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off429worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)430worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns431client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1432worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000433worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns434client # [ 0.000000] allocated 3145728 bytes of page_ext435worker1 # [ 0.000033] arm-pv: using stolen time PV436worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000437client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages438client # [ 0.000000] ftrace: allocated 294 pages with 4 groups439worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.440worker1 # [ 0.000487] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)441client # [ 0.000000] rcu: Hierarchical RCU implementation.442worker1 # [ 0.000687] Console: colour dummy device 80x25443client # [ 0.000000] rcu: RCU event tracing is enabled.444worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns445worker1 # [ 0.000696] printk: legacy console [tty0] enabled446client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.447worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).448client # [ 0.000000] Trampoline variant of Tasks RCU enabled.449worker1 # [ 0.000899] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)450client # [ 0.000000] Rude variant of Tasks RCU enabled.451worker1 # [ 0.000906] pid_max: default: 32768 minimum: 301452worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns453client # [ 0.000000] Tracing variant of Tasks RCU enabled.454worker1 # [ 0.000979] LSM: initializing lsm=capability,landlock,yama,bpf,ima455worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns456worker1 # [ 0.001172] landlock: Up and running.457lb # [ 0.153648] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages458client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.459worker2 # [ 0.000033] arm-pv: using stolen time PV460worker1 # [ 0.001176] Yama: becoming mindful.461lb # [ 0.153672] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page462worker1 # [ 0.001685] LSM support for eBPF active463client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1464worker2 # [ 0.000483] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)465lb # [ 0.153678] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages466worker1 # [ 0.001827] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)467client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.468worker2 # [ 0.000684] Console: colour dummy device 80x25469lb # [ 0.153682] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page470worker1 # [ 0.001863] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)471worker2 # [ 0.000692] printk: legacy console [tty0] enabled472lb # [ 0.153686] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages473client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.474worker1 # [ 0.003079] cacheinfo: Unable to detect cache hierarchy for CPU 0475worker1 # [ 0.003872] rcu: Hierarchical SRCU implementation.476worker2 # [ 0.000894] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)477lb # [ 0.153690] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page478client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.479worker1 # [ 0.003876] rcu: Max phase no-delay instances is 1000.480worker2 # [ 0.000902] pid_max: default: 32768 minimum: 301481lb # [ 0.153695] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages482client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0483worker2 # [ 0.000976] LSM: initializing lsm=capability,landlock,yama,bpf,ima484worker1 # [ 0.005200] fsl-mc MSI: its@8080000 domain created485lb # [ 0.153699] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page486client # [ 0.000000] GICv3: 256 SPIs implemented487worker2 # [ 0.001161] landlock: Up and running.488worker1 # [ 0.005296] EFI services will not be available.489client # [ 0.000000] GICv3: 0 Extended SPIs implemented490worker2 # [ 0.001164] Yama: becoming mindful.491worker1 # [ 0.005381] smp: Bringing up secondary CPUs ...492client # [ 0.000000] Root IRQ handler: gic_handle_irq493worker2 # [ 0.001667] LSM support for eBPF active494worker1 # [ 0.005391] smp: Brought up 1 node, 1 CPU495client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI496worker1 # [ 0.005394] SMP: Total of 1 processors activated.497worker2 # [ 0.001821] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)498client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0499lb # [ 0.161150] fbcon: Taking over console500worker1 # [ 0.005400] CPU: All CPU(s) started at EL1501lb # [ 0.161168] ACPI: Interpreter disabled.502worker2 # [ 0.001856] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)503client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000504worker1 # [ 0.005413] CPU features: detected: Branch Target Identification505client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]506worker2 # [ 0.003108] cacheinfo: Unable to detect cache hierarchy for CPU 0507lb # [ 0.163099] iommu: Default domain type: Translated508worker1 # [ 0.005418] CPU features: detected: ARMv8.4 Translation Table Level509worker2 # [ 0.004125] rcu: Hierarchical SRCU implementation.510lb # [ 0.163110] iommu: DMA domain TLB invalidation policy: strict mode511client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)512worker1 # [ 0.005421] CPU features: detected: Instruction cache invalidation not required for I/D coherence513worker2 # [ 0.004132] rcu: Max phase no-delay instances is 1000.514lb # [ 0.164852] SCSI subsystem initialized515worker2 # [ 0.005502] fsl-mc MSI: its@8080000 domain created516client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)517worker1 # [ 0.005424] CPU features: detected: Data cache clean to the PoU not required for I/D coherence518worker2 # [ 0.005598] EFI services will not be available.519client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000520worker2 # [ 0.005685] smp: Bringing up secondary CPUs ...521worker1 # [ 0.005428] CPU features: detected: Common not Private translations522worker2 # [ 0.005695] smp: Brought up 1 node, 1 CPU523worker1 # [ 0.005435] CPU features: detected: CRC32 instructions524client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000525worker2 # [ 0.005698] SMP: Total of 1 processors activated.526client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.527worker2 # [ 0.005705] CPU: All CPU(s) started at EL1528worker1 # [ 0.005438] CPU features: detected: Data cache clean to Point of Deep Persistence529worker2 # [ 0.005717] CPU features: detected: Branch Target Identification530worker1 # [ 0.005441] CPU features: detected: Data cache clean to Point of Persistence531client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns532worker2 # [ 0.005723] CPU features: detected: ARMv8.4 Translation Table Level533worker1 # [ 0.005444] CPU features: detected: Data independent timing control (DIT)534client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).535worker1 # [ 0.005447] CPU features: detected: E0PD536worker2 # [ 0.005726] CPU features: detected: Instruction cache invalidation not required for I/D coherence537worker1 # [ 0.005450] CPU features: detected: Enhanced Counter Virtualization538lb # [ 0.170020] usbcore: registered new interface driver usbfs539client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns540lb # [ 0.170061] usbcore: registered new interface driver hub541worker2 # [ 0.005729] CPU features: detected: Data cache clean to the PoU not required for I/D coherence542worker1 # [ 0.005453] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)543client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns544lb # [ 0.170081] usbcore: registered new device driver usb545worker2 # [ 0.005733] CPU features: detected: Common not Private translations546worker1 # [ 0.005456] CPU features: detected: Enhanced Virtualization Traps547client # [ 0.000034] arm-pv: using stolen time PV548lb # [ 0.170384] pps_core: LinuxPPS API ver. 1 registered549worker2 # [ 0.005736] CPU features: detected: CRC32 instructions550worker1 # [ 0.005459] CPU features: detected: Fine Grained Traps551client # [ 0.000404] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)552worker2 # [ 0.005739] CPU features: detected: Data cache clean to Point of Deep Persistence553lb # [ 0.170391] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>554worker1 # [ 0.005463] CPU features: detected: Generic authentication (architected QARMA5 algorithm)555client # [ 0.000592] Console: colour dummy device 80x25556lb # [ 0.170401] PTP clock support registered557worker1 # [ 0.005469] CPU features: detected: RCpc load-acquire (LDAPR)558client # [ 0.000601] printk: legacy console [tty0] enabled559lb # [ 0.170450] EDAC MC: Ver: 3.0.0560worker1 # [ 0.005472] CPU features: detected: LSE atomic instructions561worker2 # [ 0.005743] CPU features: detected: Data cache clean to Point of Persistence562lb # [ 0.175025] scmi_core: SCMI protocol bus registered563worker1 # [ 0.005475] CPU features: detected: Privileged Access Never564client # [ 0.000837] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)565worker1 # [ 0.005478] CPU features: detected: PMUv3566worker2 # [ 0.005746] CPU features: detected: Data independent timing control (DIT)567client # [ 0.000844] pid_max: default: 32768 minimum: 301568lb # [ 0.176028] FPGA manager framework569worker2 # [ 0.005749] CPU features: detected: E0PD570worker1 # [ 0.005480] CPU features: detected: RAS Extension Support571client # [ 0.000915] LSM: initializing lsm=capability,landlock,yama,bpf,ima572lb # [ 0.177061] vgaarb: loaded573client # [ 0.001036] landlock: Up and running.574worker1 # [ 0.005483] CPU features: detected: RASv1p1 Extension Support575worker2 # [ 0.005752] CPU features: detected: Enhanced Counter Virtualization576client # [ 0.001039] Yama: becoming mindful.577worker1 # [ 0.005486] CPU features: detected: Random Number Generator578lb # [ 0.177706] clocksource: Switched to clocksource arch_sys_counter579worker2 # [ 0.005755] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)580client # [ 0.001509] LSM support for eBPF active581worker1 # [ 0.005488] CPU features: detected: Speculation barrier (SB)582worker2 # [ 0.005759] CPU features: detected: Enhanced Virtualization Traps583client # [ 0.001651] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)584worker1 # [ 0.005491] CPU features: detected: Stage-2 Force Write-Back585worker2 # [ 0.005762] CPU features: detected: Fine Grained Traps586client # [ 0.001692] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)587worker1 # [ 0.005494] CPU features: detected: TLB range maintenance instructions588worker2 # [ 0.005766] CPU features: detected: Generic authentication (architected QARMA5 algorithm)589client # [ 0.002844] cacheinfo: Unable to detect cache hierarchy for CPU 0590worker1 # [ 0.005499] CPU features: detected: Speculative Store Bypassing Safe (SSBS)591client # [ 0.003662] rcu: Hierarchical SRCU implementation.592worker2 # [ 0.005771] CPU features: detected: RCpc load-acquire (LDAPR)593worker1 # [ 0.005541] alternatives: applying system-wide alternatives594client # [ 0.003667] rcu: Max phase no-delay instances is 1000.595worker2 # [ 0.005774] CPU features: detected: LSE atomic instructions596worker1 # [ 0.008749] CPU features: detected: BBM Level 2 without TLB conflict abort597lb # [ 0.182287] VFS: Disk quotas dquot_6.6.0598client # [ 0.004952] fsl-mc MSI: its@8080000 domain created599worker2 # [ 0.005777] CPU features: detected: Privileged Access Never600client # [ 0.005046] EFI services will not be available.601worker2 # [ 0.005780] CPU features: detected: PMUv3602lb # [ 0.182331] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)603client # [ 0.005143] smp: Bringing up secondary CPUs ...604worker2 # [ 0.005783] CPU features: detected: RAS Extension Support605worker1 # [ 0.008958] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)606client # [ 0.005153] smp: Brought up 1 node, 1 CPU607worker1 # [ 0.009444] devtmpfs: initialized608worker2 # [ 0.005786] CPU features: detected: RASv1p1 Extension Support609client # [ 0.005156] SMP: Total of 1 processors activated.610client # [ 0.005162] CPU: All CPU(s) started at EL1611worker2 # [ 0.005788] CPU features: detected: Random Number Generator612worker1 # [ 0.011440] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)613client # [ 0.005173] CPU features: detected: Branch Target Identification614worker2 # [ 0.005791] CPU features: detected: Speculation barrier (SB)615worker1 # [ 0.011466] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).616lb # [ 0.186230] netfs: FS-Cache loaded617worker2 # [ 0.005794] CPU features: detected: Stage-2 Force Write-Back618client # [ 0.005179] CPU features: detected: ARMv8.4 Translation Table Level619lb # [ 0.186378] pnp: PnP ACPI: disabled620worker1 # [ 0.011694] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL621worker2 # [ 0.005797] CPU features: detected: TLB range maintenance instructions622worker1 # [ 0.011698] 0 pages in range for non-PLT usage623client # [ 0.005182] CPU features: detected: Instruction cache invalidation not required for I/D coherence624worker1 # [ 0.011699] 508288 pages in range for PLT usage625worker2 # [ 0.005803] CPU features: detected: Speculative Store Bypassing Safe (SSBS)626worker1 # [ 0.011832] pinctrl core: initialized pinctrl subsystem627client # [ 0.005185] CPU features: detected: Data cache clean to the PoU not required for I/D coherence628worker2 # [ 0.005842] alternatives: applying system-wide alternatives629worker1 # [ 0.012659] DMI not present or invalid.630client # [ 0.005189] CPU features: detected: Common not Private translations631worker2 # [ 0.009068] CPU features: detected: BBM Level 2 without TLB conflict abort632worker1 # [ 0.016091] NET: Registered PF_NETLINK/PF_ROUTE protocol family633client # [ 0.005192] CPU features: detected: CRC32 instructions634worker1 # [ 0.019021] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations635client # [ 0.005195] CPU features: detected: Data cache clean to Point of Deep Persistence636worker2 # [ 0.009306] Memory: 1406552K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)637worker1 # [ 0.019225] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations638worker2 # [ 0.009847] devtmpfs: initialized639worker1 # [ 0.019448] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations640client # [ 0.005199] CPU features: detected: Data cache clean to Point of Persistence641worker2 # [ 0.011843] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)642worker1 # [ 0.019479] audit: initializing netlink subsys (disabled)643client # [ 0.005202] CPU features: detected: Data independent timing control (DIT)644worker2 # [ 0.011869] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).645client # [ 0.005205] CPU features: detected: E0PD646worker1 # [ 0.020168] thermal_sys: Registered thermal governor 'fair_share'647lb # [ 0.190546] NET: Registered PF_INET protocol family648worker2 # [ 0.012095] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL649client # [ 0.005207] CPU features: detected: Enhanced Counter Virtualization650worker1 # [ 0.020170] thermal_sys: Registered thermal governor 'bang_bang'651lb # [ 0.190854] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)652worker2 # [ 0.012101] 0 pages in range for non-PLT usage653worker1 # [ 0.020174] thermal_sys: Registered thermal governor 'step_wise'654client # [ 0.005210] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)655worker2 # [ 0.012102] 508288 pages in range for PLT usage656worker1 # [ 0.020182] thermal_sys: Registered thermal governor 'user_space'657worker2 # [ 0.012228] pinctrl core: initialized pinctrl subsystem658client # [ 0.005214] CPU features: detected: Enhanced Virtualization Traps659worker2 # [ 0.013657] DMI not present or invalid.660worker1 # [ 0.020185] thermal_sys: Registered thermal governor 'power_allocator'661client # [ 0.005217] CPU features: detected: Fine Grained Traps662worker2 # [ 0.016937] NET: Registered PF_NETLINK/PF_ROUTE protocol family663worker1 # [ 0.020213] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1664client # [ 0.005220] CPU features: detected: Generic authentication (architected QARMA5 algorithm)665worker1 # [ 0.020223] cpuidle: using governor ladder666worker2 # [ 0.019347] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations667client # [ 0.005225] CPU features: detected: RCpc load-acquire (LDAPR)668worker1 # [ 0.020229] cpuidle: using governor menu669client # [ 0.005228] CPU features: detected: LSE atomic instructions670worker2 # [ 0.019574] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations671worker1 # [ 0.020458] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.672client # [ 0.005232] CPU features: detected: Privileged Access Never673worker2 # [ 0.019792] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations674worker1 # [ 0.020475] ASID allocator initialised with 65536 entries675client # [ 0.005234] CPU features: detected: PMUv3676worker1 # [ 0.021831] Serial: AMBA PL011 UART driver677worker2 # [ 0.019821] audit: initializing netlink subsys (disabled)678client # [ 0.005237] CPU features: detected: RAS Extension Support679worker2 # [ 0.020517] thermal_sys: Registered thermal governor 'fair_share'680worker1 # [ 0.027237] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1681client # [ 0.005240] CPU features: detected: RASv1p1 Extension Support682worker1 # [ 0.027396] printk: console [ttyAMA0] enabled683worker2 # [ 0.020519] thermal_sys: Registered thermal governor 'bang_bang'684client # [ 0.005242] CPU features: detected: Random Number Generator685client # [ 0.005245] CPU features: detected: Speculation barrier (SB)686worker2 # [ 0.020523] thermal_sys: Registered thermal governor 'step_wise'687client # [ 0.005248] CPU features: detected: Stage-2 Force Write-Back688worker2 # [ 0.020528] thermal_sys: Registered thermal governor 'user_space'689client # [ 0.005251] CPU features: detected: TLB range maintenance instructions690worker2 # [ 0.020531] thermal_sys: Registered thermal governor 'power_allocator'691client # [ 0.005257] CPU features: detected: Speculative Store Bypassing Safe (SSBS)692worker2 # [ 0.020567] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1693client # [ 0.005295] alternatives: applying system-wide alternatives694worker2 # [ 0.020576] cpuidle: using governor ladder695worker2 # [ 0.020582] cpuidle: using governor menu696client # [ 0.008424] CPU features: detected: BBM Level 2 without TLB conflict abort697worker2 # [ 0.020779] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.698worker2 # [ 0.020796] ASID allocator initialised with 65536 entries699worker2 # [ 0.022050] Serial: AMBA PL011 UART driver700client # [ 0.008739] Memory: 1406532K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)701client # [ 0.009195] devtmpfs: initialized702worker2 # [ 0.027571] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1703client # [ 0.011071] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)704worker2 # [ 0.027770] printk: console [ttyAMA0] enabled705client # [ 0.011096] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).706client # [ 0.011311] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL707worker1 # [ 0.149014] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages708client # [ 0.011315] 0 pages in range for non-PLT usage709worker1 # [ 0.149074] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page710client # [ 0.011316] 508288 pages in range for PLT usage711client # [ 0.011443] pinctrl core: initialized pinctrl subsystem712worker1 # [ 0.149080] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages713client # [ 0.012280] DMI not present or invalid.714worker1 # [ 0.149084] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page715client # [ 0.016009] NET: Registered PF_NETLINK/PF_ROUTE protocol family716worker1 # [ 0.149089] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages717client # [ 0.018471] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations718worker1 # [ 0.149093] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page719client # [ 0.018661] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations720worker1 # [ 0.149098] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages721client # [ 0.018877] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations722worker1 # [ 0.149102] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page723client # [ 0.018904] audit: initializing netlink subsys (disabled)724client # [ 0.019556] thermal_sys: Registered thermal governor 'fair_share'725worker2 # [ 0.154552] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages726client # [ 0.019558] thermal_sys: Registered thermal governor 'bang_bang'727worker1 # [ 0.156860] fbcon: Taking over console728worker2 # [ 0.154577] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page729worker1 # [ 0.156879] ACPI: Interpreter disabled.730client # [ 0.019562] thermal_sys: Registered thermal governor 'step_wise'731worker2 # [ 0.154582] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages732client # [ 0.019569] thermal_sys: Registered thermal governor 'user_space'733worker2 # [ 0.154586] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page734client # [ 0.019572] thermal_sys: Registered thermal governor 'power_allocator'735worker2 # [ 0.154591] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages736client # [ 0.019596] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1737worker2 # [ 0.154595] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page738client # [ 0.019606] cpuidle: using governor ladder739client # [ 0.019611] cpuidle: using governor menu740worker2 # [ 0.154599] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages741client # [ 0.019808] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.742worker2 # [ 0.154603] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page743client # [ 0.019825] ASID allocator initialised with 65536 entries744client # [ 0.021140] Serial: AMBA PL011 UART driver745client # [ 0.026422] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1746worker2 # [ 0.162559] fbcon: Taking over console747client # [ 0.026569] printk: console [ttyAMA0] enabled748worker2 # [ 0.162579] ACPI: Interpreter disabled.749worker1 # [ 0.165453] iommu: Default domain type: Translated750worker1 # [ 0.165467] iommu: DMA domain TLB invalidation policy: strict mode751worker1 # [ 0.165891] SCSI subsystem initialized752lb # [ 0.223153] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)753worker1 # [ 0.167953] usbcore: registered new interface driver usbfs754lb # [ 0.223252] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)755worker1 # [ 0.167992] usbcore: registered new interface driver hub756worker1 # [ 0.168010] usbcore: registered new device driver usb757lb # [ 0.223293] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)758worker1 # [ 0.168326] pps_core: LinuxPPS API ver. 1 registered759lb # [ 0.223389] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)760worker1 # [ 0.168332] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>761lb # [ 0.223536] TCP: Hash tables configured (established 16384 bind 16384)762worker1 # [ 0.168342] PTP clock support registered763worker1 # [ 0.168402] EDAC MC: Ver: 3.0.0764lb # [ 0.223649] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)765lb # [ 0.223696] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)766worker1 # [ 0.173186] scmi_core: SCMI protocol bus registered767worker2 # [ 0.171009] iommu: Default domain type: Translated768worker2 # [ 0.171024] iommu: DMA domain TLB invalidation policy: strict mode769client # [ 0.149032] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages770lb # [ 0.223737] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)771worker2 # [ 0.172793] SCSI subsystem initialized772worker1 # [ 0.174231] FPGA manager framework773client # [ 0.149055] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page774lb # [ 0.223840] NET: Registered PF_UNIX/PF_LOCAL protocol family775worker1 # [ 0.175212] vgaarb: loaded776client # [ 0.149060] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages777lb # [ 0.223929] NET: Registered PF_XDP protocol family778lb # [ 0.223951] PCI: CLS 0 bytes, default 64779worker2 # [ 0.173484] usbcore: registered new interface driver usbfs780worker1 # [ 0.175869] clocksource: Switched to clocksource arch_sys_counter781client # [ 0.149065] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page782worker2 # [ 0.173520] usbcore: registered new interface driver hub783lb # [ 0.224229] Trying to unpack rootfs image as initramfs...784client # [ 0.149070] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages785worker2 # [ 0.173540] usbcore: registered new device driver usb786worker2 # [ 0.173874] pps_core: LinuxPPS API ver. 1 registered787client # [ 0.149074] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page788client # [ 0.149078] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages789worker2 # [ 0.173882] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>790worker1 # [ 0.178779] VFS: Disk quotas dquot_6.6.0791worker2 # [ 0.173901] PTP clock support registered792client # [ 0.149083] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page793worker2 # [ 0.173951] EDAC MC: Ver: 3.0.0794worker1 # [ 0.178817] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)795worker2 # [ 0.178593] scmi_core: SCMI protocol bus registered796client # [ 0.156534] fbcon: Taking over console797worker2 # [ 0.179620] FPGA manager framework798client # [ 0.156552] ACPI: Interpreter disabled.799worker2 # [ 0.180659] vgaarb: loaded800worker1 # [ 0.182733] netfs: FS-Cache loaded801worker1 # [ 0.182875] pnp: PnP ACPI: disabled802worker2 # [ 0.181329] clocksource: Switched to clocksource arch_sys_counter803lb # [ 0.239531] kvm [1]: HYP mode not available804worker2 # [ 0.184251] VFS: Disk quotas dquot_6.6.0805worker2 # [ 0.184295] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)806worker1 # [ 0.186960] NET: Registered PF_INET protocol family807worker1 # [ 0.187250] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)808worker2 # [ 0.188227] netfs: FS-Cache loaded809client # [ 0.165266] iommu: Default domain type: Translated810worker2 # [ 0.188379] pnp: PnP ACPI: disabled811client # [ 0.165281] iommu: DMA domain TLB invalidation policy: strict mode812client # [ 0.165675] SCSI subsystem initialized813client # [ 0.167691] usbcore: registered new interface driver usbfs814client # [ 0.167731] usbcore: registered new interface driver hub815client # [ 0.167750] usbcore: registered new device driver usb816client # [ 0.168073] pps_core: LinuxPPS API ver. 1 registered817worker2 # [ 0.192344] NET: Registered PF_INET protocol family818client # [ 0.168079] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>819worker2 # [ 0.192618] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)820client # [ 0.168088] PTP clock support registered821client # [ 0.168139] EDAC MC: Ver: 3.0.0822client # [ 0.172843] scmi_core: SCMI protocol bus registered823client # [ 0.173877] FPGA manager framework824client # [ 0.174895] vgaarb: loaded825client # [ 0.175563] clocksource: Switched to clocksource arch_sys_counter826client # [ 0.180253] VFS: Disk quotas dquot_6.6.0827client # [ 0.180316] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)828client # [ 0.182074] netfs: FS-Cache loaded829client # [ 0.182219] pnp: PnP ACPI: disabled830client # [ 0.186245] NET: Registered PF_INET protocol family831client # [ 0.186539] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832worker1 # [ 0.219249] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833worker1 # [ 0.219316] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834worker1 # [ 0.219353] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835worker1 # [ 0.219446] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836worker1 # [ 0.219589] TCP: Hash tables configured (established 16384 bind 16384)837worker1 # [ 0.219689] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838worker1 # [ 0.219729] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839worker1 # [ 0.219770] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840worker1 # [ 0.219869] NET: Registered PF_UNIX/PF_LOCAL protocol family841worker2 # [ 0.229112] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)842worker2 # [ 0.229184] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)843worker2 # [ 0.229223] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)844worker2 # [ 0.229324] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)845worker1 # [ 0.227949] NET: Registered PF_XDP protocol family846worker1 # [ 0.227974] PCI: CLS 0 bytes, default 64847worker1 # [ 0.228242] Trying to unpack rootfs image as initramfs...848worker2 # [ 0.233672] TCP: Hash tables configured (established 16384 bind 16384)849worker1 # [ 0.237843] kvm [1]: HYP mode not available850worker2 # [ 0.233854] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)851worker2 # [ 0.233911] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)852worker2 # [ 0.233962] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)853worker2 # [ 0.234090] NET: Registered PF_UNIX/PF_LOCAL protocol family854worker2 # [ 0.234151] NET: Registered PF_XDP protocol family855worker2 # [ 0.234178] PCI: CLS 0 bytes, default 64856worker2 # [ 0.234511] Trying to unpack rootfs image as initramfs...857worker2 # [ 0.247193] kvm [1]: HYP mode not available858client # [ 0.220606] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)859client # [ 0.220693] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)860client # [ 0.220729] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)861client # [ 0.220820] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)862client # [ 0.220962] TCP: Hash tables configured (established 16384 bind 16384)863client # [ 0.221062] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)864client # [ 0.221101] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)865client # [ 0.221140] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)866client # [ 0.221240] NET: Registered PF_UNIX/PF_LOCAL protocol family867client # [ 0.221268] NET: Registered PF_XDP protocol family868client # [ 0.221287] PCI: CLS 0 bytes, default 64869client # [ 0.221554] Trying to unpack rootfs image as initramfs...870client # [ 0.237383] kvm [1]: HYP mode not available871lb # [ 0.426295] Initialise system trusted keyrings872lb # [ 0.427087] workingset: timestamp_bits=42 max_order=19 bucket_order=0873lb # [ 0.434022] squashfs: version 4.0 (2009/01/31) Phillip Lougher874lb # [ 0.434848] 9p: Installing v9fs 9p2000 file system support875lb # [ 0.454903] Key type asymmetric registered876lb # [ 0.454934] Asymmetric key parser 'x509' registered877lb # [ 0.455032] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878lb # [ 0.457267] io scheduler mq-deadline registered879lb # [ 0.457279] io scheduler kyber registered880lb # [ 0.470919] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881lb # [ 0.472314] ledtrig-cpu: registered to indicate activity on CPUs882lb # [ 0.472754] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:883lb # [ 0.472772] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000884lb # [ 0.472786] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000885lb # [ 0.472794] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000886lb # [ 0.472816] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits887lb # [ 0.472838] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]888worker1 # [ 0.418141] Initialise system trusted keyrings889lb # [ 0.472924] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00890worker1 # [ 0.418963] workingset: timestamp_bits=42 max_order=19 bucket_order=0891lb # [ 0.472934] pci_bus 0000:00: root bus resource [bus 00-ff]892lb # [ 0.472941] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]893worker1 # [ 0.420338] squashfs: version 4.0 (2009/01/31) Phillip Lougher894lb # [ 0.472947] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]895lb # [ 0.472952] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]896lb # [ 0.473014] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint897lb # [ 0.473452] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint898worker1 # [ 0.421192] 9p: Installing v9fs 9p2000 file system support899lb # [ 0.473637] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]900lb # [ 0.473654] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]901lb # [ 0.473683] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]902lb # [ 0.473699] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]903lb # [ 0.490015] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint904lb # [ 0.490203] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]905lb # [ 0.490219] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]906lb # [ 0.490248] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]907lb # [ 0.490700] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint908lb # [ 0.490879] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]909lb # [ 0.490895] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]910lb # [ 0.490924] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]911lb # [ 0.491377] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint912lb # [ 0.491556] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]913worker2 # [ 0.437263] Initialise system trusted keyrings914lb # [ 0.491572] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]915worker2 # [ 0.438217] workingset: timestamp_bits=42 max_order=19 bucket_order=0916lb # [ 0.491604] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]917lb # [ 0.492073] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint918worker2 # [ 0.439561] squashfs: version 4.0 (2009/01/31) Phillip Lougher919lb # [ 0.492252] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]920lb # [ 0.492267] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]921worker2 # [ 0.440328] 9p: Installing v9fs 9p2000 file system support922lb # [ 0.492296] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]923lb # [ 0.492788] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint924lb # [ 0.492968] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]925lb # [ 0.492983] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]926lb # [ 0.493012] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]927lb # [ 0.493688] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint928client # [ 0.424148] Initialise system trusted keyrings929worker1 # [ 0.449271] Key type asymmetric registered930client # [ 0.424954] workingset: timestamp_bits=42 max_order=19 bucket_order=0931worker1 # [ 0.449303] Asymmetric key parser 'x509' registered932client # [ 0.426285] squashfs: version 4.0 (2009/01/31) Phillip Lougher933worker1 # [ 0.449386] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)934worker1 # [ 0.451565] io scheduler mq-deadline registered935client # [ 0.427023] 9p: Installing v9fs 9p2000 file system support936worker1 # [ 0.451578] io scheduler kyber registered937lb # [ 0.518006] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]938lb # [ 0.518050] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]939lb # [ 0.518080] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]940lb # [ 0.518096] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]941lb # [ 0.518634] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint942worker2 # [ 0.460973] Key type asymmetric registered943worker2 # [ 0.461007] Asymmetric key parser 'x509' registered944lb # [ 0.518822] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]945worker2 # [ 0.461097] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)946lb # [ 0.518851] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]947lb # [ 0.519331] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint948lb # [ 0.519518] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]949lb # [ 0.519548] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]950lb # [ 0.519952] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint951lb # [ 0.520133] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]952lb # [ 0.520385] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint953lb # [ 0.520685] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]954lb # [ 0.520703] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]955worker2 # [ 0.469400] io scheduler mq-deadline registered956worker2 # [ 0.469430] io scheduler kyber registered957lb # [ 0.520732] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]958worker1 # [ 0.465320] pl061_gpio 9030000.pl061: PL061 GPIO chip registered959worker1 # [ 0.465922] ledtrig-cpu: registered to indicate activity on CPUs960lb # [ 0.521187] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint961lb # [ 0.521368] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]962worker1 # [ 0.466293] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:963lb # [ 0.521384] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]964worker1 # [ 0.466313] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000965lb # [ 0.521413] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]966worker1 # [ 0.466326] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000967worker1 # [ 0.466335] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000968worker1 # [ 0.466369] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits969worker1 # [ 0.466393] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]970worker1 # [ 0.466491] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00971client # [ 0.455828] Key type asymmetric registered972worker1 # [ 0.466501] pci_bus 0000:00: root bus resource [bus 00-ff]973client # [ 0.455864] Asymmetric key parser 'x509' registered974worker1 # [ 0.466507] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]975client # [ 0.455954] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)976worker1 # [ 0.466512] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]977client # [ 0.458166] io scheduler mq-deadline registered978client # [ 0.458182] io scheduler kyber registered979worker1 # [ 0.466517] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]980lb # [ 0.542164] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned981worker2 # [ 0.481543] pl061_gpio 9030000.pl061: PL061 GPIO chip registered982worker1 # [ 0.466626] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint983lb # [ 0.542199] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned984worker1 # [ 0.467082] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint985lb # [ 0.542206] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned986worker1 # [ 0.467276] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]987lb # [ 0.542261] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned988worker1 # [ 0.467293] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]989lb # [ 0.542312] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned990worker1 # [ 0.467323] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]991lb # [ 0.542361] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned992worker1 # [ 0.467339] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]993lb # [ 0.542409] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned994worker1 # [ 0.467813] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint995worker1 # [ 0.468033] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]996lb # [ 0.542458] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned997worker2 # [ 0.483078] ledtrig-cpu: registered to indicate activity on CPUs998worker1 # [ 0.468049] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]999lb # [ 0.542509] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1000worker2 # [ 0.483560] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1001worker1 # [ 0.468080] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1002lb # [ 0.542558] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1003client # [ 0.467770] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1004worker2 # [ 0.483580] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001005worker1 # [ 0.468565] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1006lb # [ 0.542607] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1007worker1 # [ 0.468777] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1008worker2 # [ 0.483593] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001009lb # [ 0.542656] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1010worker1 # [ 0.468795] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1011worker2 # [ 0.483602] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001012worker1 # [ 0.468825] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1013lb # [ 0.542798] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1014client # [ 0.469254] ledtrig-cpu: registered to indicate activity on CPUs1015lb # [ 0.542883] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1016worker2 # [ 0.483626] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1017worker1 # [ 0.469342] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1018worker1 # [ 0.469533] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1019lb # [ 0.542906] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1020client # [ 0.469705] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1021worker2 # [ 0.483654] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1022worker1 # [ 0.469549] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1023lb # [ 0.542928] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1024client # [ 0.469723] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001025worker2 # [ 0.483739] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001026worker1 # [ 0.469582] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1027lb # [ 0.542950] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1028worker2 # [ 0.483748] pci_bus 0000:00: root bus resource [bus 00-ff]1029client # [ 0.469737] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001030lb # [ 0.542977] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1031worker1 # [ 0.470072] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1032worker2 # [ 0.483754] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1033worker1 # [ 0.470307] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1034lb # [ 0.543000] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1035client # [ 0.469746] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001036worker2 # [ 0.483759] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1037worker1 # [ 0.470324] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1038lb # [ 0.543022] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1039worker2 # [ 0.483764] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1040client # [ 0.469783] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1041worker1 # [ 0.470355] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1042lb # [ 0.543044] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1043worker2 # [ 0.483864] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1044client # [ 0.469814] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1045worker1 # [ 0.470831] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1046lb # [ 0.543068] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1047worker2 # [ 0.484320] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1048worker1 # [ 0.471026] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1049client # [ 0.469895] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001050lb # [ 0.543090] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1051worker2 # [ 0.484514] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1052client # [ 0.469905] pci_bus 0000:00: root bus resource [bus 00-ff]1053worker1 # [ 0.471042] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1054lb # [ 0.543115] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1055client # [ 0.469912] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1056worker2 # [ 0.484531] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1057worker1 # [ 0.471072] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1058lb # [ 0.543138] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1059worker2 # [ 0.484561] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1060client # [ 0.469918] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1061worker1 # [ 0.471547] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1062lb # [ 0.543159] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1063worker2 # [ 0.484576] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1064client # [ 0.469923] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1065worker1 # [ 0.471741] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1066lb # [ 0.543181] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1067worker1 # [ 0.471757] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1068worker2 # [ 0.485056] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1069lb # [ 0.543214] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1070client # [ 0.469985] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1071worker2 # [ 0.485243] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1072worker1 # [ 0.471787] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1073lb # [ 0.543239] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1074client # [ 0.470427] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1075worker2 # [ 0.485258] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1076worker1 # [ 0.471803] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1077lb # [ 0.543261] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1078client # [ 0.470619] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1079worker2 # [ 0.485288] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1080lb # [ 0.543283] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1081client # [ 0.470636] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1082lb # [ 0.543304] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1083worker2 # [ 0.485791] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1084client # [ 0.470666] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1085worker2 # [ 0.485985] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1086lb # [ 0.543326] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1087client # [ 0.470685] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1088worker2 # [ 0.486001] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1089lb # [ 0.543349] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1090client # [ 0.471151] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1091lb # [ 0.543378] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1092worker2 # [ 0.486031] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1093client # [ 0.471340] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1094lb # [ 0.543388] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1095worker2 # [ 0.486525] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1096client # [ 0.471356] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1097lb # [ 0.543393] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1098worker2 # [ 0.486712] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1099client # [ 0.471386] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1100lb # [ 0.544575] pci 0000:00:0a.0: enabling device (0000 -> 0002)1101worker2 # [ 0.486730] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1102worker2 # [ 0.486762] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1103worker2 # [ 0.487244] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1104client # [ 0.490363] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1105worker1 # [ 0.512455] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1106worker2 # [ 0.487448] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1107client # [ 0.490552] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1108worker1 # [ 0.512677] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1109worker2 # [ 0.487465] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1110client # [ 0.490568] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1111worker1 # [ 0.512708] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1112worker2 # [ 0.487494] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1113client # [ 0.490598] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1114worker1 # [ 0.513225] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1115worker2 # [ 0.487962] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1116client # [ 0.491051] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117worker1 # [ 0.513422] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1118worker2 # [ 0.488146] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1119client # [ 0.491237] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1120worker2 # [ 0.488161] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1121worker1 # [ 0.513452] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1122client # [ 0.491253] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1123worker2 # [ 0.488190] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1124client # [ 0.491286] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1125worker1 # [ 0.513860] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1126worker2 # [ 0.488650] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1127worker1 # [ 0.514050] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1128worker2 # [ 0.488835] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1129worker1 # [ 0.514304] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1130worker2 # [ 0.488850] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1131worker1 # [ 0.514617] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1132worker2 # [ 0.488880] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1133worker1 # [ 0.514635] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1134worker2 # [ 0.488895] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1135worker1 # [ 0.514665] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1136worker1 # [ 0.515149] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1137worker1 # [ 0.515340] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1138worker1 # [ 0.515355] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1139worker1 # [ 0.515385] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1140worker2 # [ 0.529487] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1141worker2 # [ 0.529712] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1142client # [ 0.503888] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1143client # [ 0.504103] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1144worker2 # [ 0.529744] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1145client # [ 0.504121] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1146worker2 # [ 0.530301] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1147client # [ 0.504151] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1148worker2 # [ 0.530490] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1149client # [ 0.504681] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1150worker2 # [ 0.530519] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1151client # [ 0.504864] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1152worker1 # [ 0.536189] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1153lb # [ 0.601206] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1154worker2 # [ 0.530929] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1155client # [ 0.504880] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1156worker1 # [ 0.536225] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1157worker2 # [ 0.531111] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1158client # [ 0.504909] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1159worker1 # [ 0.536231] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1160worker2 # [ 0.531394] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1161client # [ 0.505360] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1162worker2 # [ 0.531683] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1163worker1 # [ 0.536289] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1164client # [ 0.505539] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1165worker2 # [ 0.531701] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1166client # [ 0.505556] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1167worker1 # [ 0.536341] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1168worker2 # [ 0.531730] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1169client # [ 0.505585] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1170worker1 # [ 0.536391] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1171worker2 # [ 0.532201] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1172client # [ 0.505601] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1173worker2 # [ 0.532384] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1174worker1 # [ 0.536440] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1175client # [ 0.506067] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1176worker2 # [ 0.532405] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1177client # [ 0.506249] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1178worker1 # [ 0.536489] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1179worker2 # [ 0.532435] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1180client # [ 0.506279] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1181worker1 # [ 0.536540] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1182worker2 # [ 0.533035] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1183client # [ 0.506722] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1184worker2 # [ 0.533048] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1185worker1 # [ 0.536590] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1186client # [ 0.506907] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1187worker2 # [ 0.533054] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1188worker1 # [ 0.536640] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1189client # [ 0.506936] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1190worker2 # [ 0.533100] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1191worker1 # [ 0.536691] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1192client # [ 0.507323] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1193worker2 # [ 0.533148] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1194client # [ 0.507502] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1195worker1 # [ 0.536832] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1196lb # [ 0.611336] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1197worker2 # [ 0.533196] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1198client # [ 0.507759] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1199worker1 # [ 0.536884] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1200client # [ 0.508048] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1201worker2 # [ 0.533243] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1202worker1 # [ 0.536907] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1203client # [ 0.508067] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1204worker1 # [ 0.536930] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1205worker2 # [ 0.533290] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1206client # [ 0.508096] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1207worker1 # [ 0.536952] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1208client # [ 0.508549] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1209worker1 # [ 0.536979] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1210client # [ 0.508761] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1211worker1 # [ 0.537001] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1212client # [ 0.508778] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1213worker1 # [ 0.537024] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1214client # [ 0.508807] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1215worker1 # [ 0.537078] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1216client # [ 0.509400] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1217worker2 # [ 0.553704] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1218worker1 # [ 0.537101] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1219client # [ 0.509412] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1220client # [ 0.509418] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1221worker1 # [ 0.537123] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1222worker2 # [ 0.553762] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1223worker1 # [ 0.537148] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1224worker2 # [ 0.553809] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1225client # [ 0.509461] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1226worker2 # [ 0.553856] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1227worker1 # [ 0.537171] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1228client # [ 0.509509] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1229worker1 # [ 0.537192] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1230worker2 # [ 0.553947] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1231lb # [ 0.622480] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1232worker1 # [ 0.537214] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1233client # [ 0.509556] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1234worker2 # [ 0.553993] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1235lb # [ 0.624763] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1236worker1 # [ 0.537235] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1237client # [ 0.509603] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1238worker2 # [ 0.554014] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1239worker1 # [ 0.537256] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1240worker2 # [ 0.554036] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1241client # [ 0.509649] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1242worker1 # [ 0.537277] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1243worker2 # [ 0.554058] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1244worker1 # [ 0.537299] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1245client # [ 0.509696] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1246worker2 # [ 0.554084] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1247worker1 # [ 0.537320] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1248client # [ 0.509743] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1249lb # [ 0.628646] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1250worker2 # [ 0.554106] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1251worker1 # [ 0.537342] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1252client # [ 0.509795] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1253worker2 # [ 0.554128] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1254worker1 # [ 0.537364] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1255worker1 # [ 0.537394] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1256client # [ 0.509842] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1257worker2 # [ 0.554150] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1258worker1 # [ 0.537404] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1259worker2 # [ 0.554171] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1260client # [ 0.509918] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1261worker1 # [ 0.537409] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1262worker2 # [ 0.554193] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1263client # [ 0.509965] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1264worker1 # [ 0.538589] pci 0000:00:0a.0: enabling device (0000 -> 0002)1265worker2 # [ 0.554216] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1266client # [ 0.509987] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1267worker2 # [ 0.554238] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1268client # [ 0.510009] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1269worker2 # [ 0.554259] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1270client # [ 0.510031] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1271worker2 # [ 0.554280] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1272client # [ 0.510058] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1273worker2 # [ 0.554301] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1274client # [ 0.510080] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1275worker2 # [ 0.554322] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1276client # [ 0.510102] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1277worker2 # [ 0.554343] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1278lb # [ 0.637606] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1279client # [ 0.510123] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1280worker2 # [ 0.554364] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1281client # [ 0.510146] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1282worker2 # [ 0.554385] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1283client # [ 0.510168] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1284worker2 # [ 0.554406] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1285client # [ 0.510191] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1286worker2 # [ 0.554428] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1287worker2 # [ 0.554456] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1288client # [ 0.510214] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1289worker2 # [ 0.554466] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1290client # [ 0.510236] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1291worker2 # [ 0.554471] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1292client # [ 0.510257] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1293worker2 # [ 0.555683] pci 0000:00:0a.0: enabling device (0000 -> 0002)1294client # [ 0.510279] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1295client # [ 0.510300] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1296client # [ 0.510321] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1297client # [ 0.510343] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1298client # [ 0.510365] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1299client # [ 0.510386] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1300client # [ 0.510408] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1301lb # [ 0.647270] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1302client # [ 0.510435] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1303client # [ 0.510445] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1304client # [ 0.510450] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1305lb # [ 0.655006] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1306worker1 # [ 0.595114] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1307lb # [ 0.657403] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1308client # [ 0.571761] pci 0000:00:0a.0: enabling device (0000 -> 0002)1309worker2 # [ 0.604450] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1310lb # [ 0.668699] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1311worker1 # [ 0.605550] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1312worker1 # [ 0.609418] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1313worker1 # [ 0.611835] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1314lb # [ 0.679830] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1315worker2 # [ 0.614926] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1316client # [ 0.593116] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1317client # [ 0.595469] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1318worker1 # [ 0.623274] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1319lb # [ 0.691092] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1320worker2 # [ 0.626072] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1321client # [ 0.605801] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1322worker2 # [ 0.628527] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1323lb # [ 0.694158] msm_serial: driver initialized1324worker2 # [ 0.632727] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1325lb # [ 0.694299] SuperH (H)SCI(F) driver initialized1326lb # [ 0.694357] STM32 USART driver initialized1327worker1 # [ 0.633502] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1328worker2 # [ 0.641924] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1329worker2 # [ 0.644256] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1330worker1 # [ 0.644596] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1331client # [ 0.620373] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1332worker1 # [ 0.647042] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1333client # [ 0.622673] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1334worker1 # [ 0.651122] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1335client # [ 0.626653] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1336client # [ 0.629973] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1337worker1 # [ 0.659461] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1338worker2 # [ 0.663058] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1339client # [ 0.641290] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1340lb # [ 0.730774] loop: module loaded1341lb # [ 0.730998] virtio_blk virtio5: 1/0/0 default/read/poll queues1342worker2 # [ 0.666384] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1343worker1 # [ 0.669587] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1344worker2 # [ 0.668480] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1345lb # [ 0.732124] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1346client # [ 0.647913] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1347client # [ 0.650386] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1348worker2 # [ 0.679169] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1349worker1 # [ 0.685210] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1350client # [ 0.661427] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1351lb # [ 0.746582] megasas: 07.734.00.00-rc11352worker1 # [ 0.688209] msm_serial: driver initialized1353worker1 # [ 0.688374] SuperH (H)SCI(F) driver initialized1354lb # [ 0.747475] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1355worker1 # [ 0.688427] STM32 USART driver initialized1356worker2 # [ 0.690629] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1357lb # [ 0.750229] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001358lb # [ 0.750267] Intel/Sharp Extended Query Table at 0x00311359lb # [ 0.751997] Using buffer write method1360lb # [ 0.752099] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1361worker2 # [ 0.693563] msm_serial: driver initialized1362worker2 # [ 0.693716] SuperH (H)SCI(F) driver initialized1363worker2 # [ 0.693770] STM32 USART driver initialized1364lb # [ 0.759017] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001365lb # [ 0.759057] Intel/Sharp Extended Query Table at 0x00311366client # [ 0.677028] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1367lb # [ 0.769743] Using buffer write method1368client # [ 0.679994] msm_serial: driver initialized1369lb # [ 0.769792] Concatenating MTD devices:1370lb # [ 0.769797] (0): "0.flash"1371client # [ 0.680148] SuperH (H)SCI(F) driver initialized1372lb # [ 0.769801] (1): "0.flash"1373client # [ 0.680202] STM32 USART driver initialized1374lb # [ 0.769804] into device "0.flash"1375worker1 # [ 0.725777] loop: module loaded1376worker1 # [ 0.726026] virtio_blk virtio5: 1/0/0 default/read/poll queues1377worker1 # [ 0.727026] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1378worker2 # [ 0.730314] loop: module loaded1379worker2 # [ 0.730545] virtio_blk virtio5: 1/0/0 default/read/poll queues1380worker2 # [ 0.731666] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1381client # [ 0.717340] loop: module loaded1382client # [ 0.717592] virtio_blk virtio5: 1/0/0 default/read/poll queues1383client # [ 0.718461] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1384worker2 # [ 0.738125] megasas: 07.734.00.00-rc11385worker2 # [ 0.738898] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1386worker1 # [ 0.740801] megasas: 07.734.00.00-rc11387worker1 # [ 0.741760] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1388worker1 # [ 0.744033] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001389worker1 # [ 0.744071] Intel/Sharp Extended Query Table at 0x00311390worker1 # [ 0.745952] Using buffer write method1391worker1 # [ 0.746068] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1392client # [ 0.732519] megasas: 07.734.00.00-rc11393worker2 # [ 0.758761] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001394worker1 # [ 0.759911] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001395worker2 # [ 0.758816] Intel/Sharp Extended Query Table at 0x00311396client # [ 0.733390] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1397worker2 # [ 0.760792] Using buffer write method1398worker1 # [ 0.759959] Intel/Sharp Extended Query Table at 0x00311399worker1 # [ 0.761958] Using buffer write method1400worker2 # [ 0.760900] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1401worker1 # [ 0.762012] Concatenating MTD devices:1402client # [ 0.736088] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001403worker1 # [ 0.762017] (0): "0.flash"1404client # [ 0.736128] Intel/Sharp Extended Query Table at 0x00311405worker1 # [ 0.762022] (1): "0.flash"1406client # [ 0.738224] Using buffer write method1407worker1 # [ 0.762026] into device "0.flash"1408client # [ 0.738340] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1409worker2 # [ 0.766478] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001410worker2 # [ 0.766525] Intel/Sharp Extended Query Table at 0x00311411client # [ 0.746422] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001412worker2 # [ 0.769273] Using buffer write method1413worker2 # [ 0.769311] Concatenating MTD devices:1414client # [ 0.746477] Intel/Sharp Extended Query Table at 0x00311415worker2 # [ 0.769315] (0): "0.flash"1416worker2 # [ 0.769320] (1): "0.flash"1417worker2 # [ 0.769323] into device "0.flash"1418client # [ 0.752222] Using buffer write method1419client # [ 0.752278] Concatenating MTD devices:1420client # [ 0.752282] (0): "0.flash"1421client # [ 0.752287] (1): "0.flash"1422client # [ 0.752290] into device "0.flash"1423lb # [ 1.049664] Freeing initrd memory: 26140K1424lb # [ 1.056092] tun: Universal TUN/TAP device driver, 1.61425lb # [ 1.060048] thunder_xcv, ver 1.01426lb # [ 1.060101] thunder_bgx, ver 1.01427lb # [ 1.060126] nicpf, ver 1.01428lb # [ 1.060690] e1000: Intel(R) PRO/1000 Network Driver1429lb # [ 1.060699] e1000: Copyright (c) 1999-2006 Intel Corporation.1430lb # [ 1.060724] e1000e: Intel(R) PRO/1000 Network Driver1431lb # [ 1.060735] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432lb # [ 1.060766] igb: Intel(R) Gigabit Ethernet Network Driver1433lb # [ 1.060772] igb: Copyright (c) 2007-2014 Intel Corporation.1434lb # [ 1.060795] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435lb # [ 1.060802] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436lb # [ 1.060939] sky2: driver version 1.301437lb # [ 1.070516] ehci-pci 0000:00:0a.0: EHCI Host Controller1438lb # [ 1.070557] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11439lb # [ 1.070736] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001440lb # [ 1.073211] usbcore: registered new interface driver usb-storage1441lb # [ 1.073303] usbcore: registered new interface driver usbserial_generic1442lb # [ 1.073319] usbserial: USB Serial support registered for generic1443lb # [ 1.076255] hv_vmbus: registering driver hyperv_keyboard1444lb # [ 1.077858] rtc-pl031 9010000.pl031: registered as rtc01445lb # [ 1.077884] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:15:58 UTC (1789892158)1446lb # [ 1.078198] i2c_dev: i2c /dev entries driver1447lb # [ 1.083398] sdhci: Secure Digital Host Controller Interface driver1448lb # [ 1.083410] sdhci: Copyright(c) Pierre Ossman1449lb # [ 1.083677] Synopsys Designware Multimedia Card Interface Driver1450lb # [ 1.084054] sdhci-pltfm: SDHCI platform and OF driver helper1451lb # [ 1.088415] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001452lb # [ 1.089519] hub 1-0:1.0: USB hub found1453lb # [ 1.089540] hub 1-0:1.0: 6 ports detected1454lb # [ 1.091083] hid: raw HID events driver (C) Jiri Kosina1455lb # [ 1.091359] usbcore: registered new interface driver usbhid1456lb # [ 1.091366] usbhid: USB HID core driver1457lb # [ 1.094358] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1458lb # [ 1.095943] drop_monitor: Initializing network drop monitor service1459lb # [ 1.096097] NET: Registered PF_INET6 protocol family1460lb # [ 1.099237] Segment Routing with IPv61461lb # [ 1.099263] In-situ OAM (IOAM) with IPv61462lb # [ 1.099301] NET: Registered PF_PACKET protocol family1463lb # [ 1.100969] 9pnet: Installing 9P2000 support1464lb # [ 1.103893] Key type dns_resolver registered1465lb # [ 1.110571] registered taskstats version 11466lb # [ 1.110737] Loading compiled-in X.509 certificates1467worker2 # [ 1.051321] Freeing initrd memory: 26148K1468lb # [ 1.120213] Demotion targets for Node 0: null1469lb # [ 1.120358] Key type .fscrypt registered1470worker2 # [ 1.057734] tun: Universal TUN/TAP device driver, 1.61471lb # [ 1.120367] Key type fscrypt-provisioning registered1472lb # [ 1.120470] ima: No TPM chip found, activating TPM-bypass!1473lb # [ 1.120491] ima: Allocated hash algorithm: sha11474lb # [ 1.120516] ima: No architecture policies found1475lb # [ 1.124837] input: gpio-keys as /devices/platform/gpio-keys/input/input01476client # [ 1.042332] Freeing initrd memory: 26160K1477worker2 # [ 1.061910] thunder_xcv, ver 1.01478worker2 # [ 1.061959] thunder_bgx, ver 1.01479worker2 # [ 1.061982] nicpf, ver 1.01480worker2 # [ 1.062550] e1000: Intel(R) PRO/1000 Network Driver1481worker2 # [ 1.062558] e1000: Copyright (c) 1999-2006 Intel Corporation.1482worker2 # [ 1.062582] e1000e: Intel(R) PRO/1000 Network Driver1483worker2 # [ 1.062591] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1484worker2 # [ 1.062620] igb: Intel(R) Gigabit Ethernet Network Driver1485worker2 # [ 1.062625] igb: Copyright (c) 2007-2014 Intel Corporation.1486worker2 # [ 1.062651] igbvf: Intel(R) Gigabit Virtual Function Network Driver1487client # [ 1.048976] tun: Universal TUN/TAP device driver, 1.61488worker1 # [ 1.072157] Freeing initrd memory: 26148K1489worker2 # [ 1.062657] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1490worker2 # [ 1.062793] sky2: driver version 1.301491worker2 # [ 1.064433] usbcore: registered new interface driver usb-storage1492worker2 # [ 1.064535] usbcore: registered new interface driver usbserial_generic1493worker2 # [ 1.064551] usbserial: USB Serial support registered for generic1494worker2 # [ 1.065158] hv_vmbus: registering driver hyperv_keyboard1495worker2 # [ 1.066097] ehci-pci 0000:00:0a.0: EHCI Host Controller1496worker1 # [ 1.078939] tun: Universal TUN/TAP device driver, 1.61497worker2 # [ 1.066127] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11498client # [ 1.053598] thunder_xcv, ver 1.01499worker2 # [ 1.066361] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001500client # [ 1.053659] thunder_bgx, ver 1.01501client # [ 1.053684] nicpf, ver 1.01502client # [ 1.054251] e1000: Intel(R) PRO/1000 Network Driver1503worker2 # [ 1.078902] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001504client # [ 1.054259] e1000: Copyright (c) 1999-2006 Intel Corporation.1505worker2 # [ 1.079312] hub 1-0:1.0: USB hub found1506client # [ 1.054285] e1000e: Intel(R) PRO/1000 Network Driver1507worker2 # [ 1.079344] hub 1-0:1.0: 6 ports detected1508client # [ 1.054295] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1509lb # [ 1.145586] clk: Disabling unused clocks1510worker1 # [ 1.083538] thunder_xcv, ver 1.01511client # [ 1.054329] igb: Intel(R) Gigabit Ethernet Network Driver1512lb # [ 1.145630] PM: genpd: Disabling unused power domains1513worker1 # [ 1.083595] thunder_bgx, ver 1.01514client # [ 1.054334] igb: Copyright (c) 2007-2014 Intel Corporation.1515worker1 # [ 1.083617] nicpf, ver 1.01516worker2 # [ 1.082355] rtc-pl031 9010000.pl031: registered as rtc01517client # [ 1.054363] igbvf: Intel(R) Gigabit Virtual Function Network Driver1518client # [ 1.054369] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1519worker2 # [ 1.082387] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:15:58 UTC (1789892158)1520client # [ 1.054504] sky2: driver version 1.301521worker2 # [ 1.082713] i2c_dev: i2c /dev entries driver1522client # [ 1.063371] usbcore: registered new interface driver usb-storage1523lb # [ 1.150016] Freeing unused kernel memory: 4736K1524lb # [ 1.150209] Run /init as init process1525client # [ 1.063534] usbcore: registered new interface driver usbserial_generic1526worker1 # [ 1.085678] e1000: Intel(R) PRO/1000 Network Driver1527client # [ 1.063549] usbserial: USB Serial support registered for generic1528worker1 # [ 1.085692] e1000: Copyright (c) 1999-2006 Intel Corporation.1529worker1 # [ 1.085720] e1000e: Intel(R) PRO/1000 Network Driver1530worker2 # [ 1.087875] sdhci: Secure Digital Host Controller Interface driver1531client # [ 1.066703] ehci-pci 0000:00:0a.0: EHCI Host Controller1532worker2 # [ 1.087889] sdhci: Copyright(c) Pierre Ossman1533worker1 # [ 1.085729] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1534worker2 # [ 1.088159] Synopsys Designware Multimedia Card Interface Driver1535client # [ 1.066752] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11536worker1 # [ 1.085759] igb: Intel(R) Gigabit Ethernet Network Driver1537worker2 # [ 1.088534] sdhci-pltfm: SDHCI platform and OF driver helper1538client # [ 1.067047] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001539worker1 # [ 1.085764] igb: Copyright (c) 2007-2014 Intel Corporation.1540worker1 # [ 1.085788] igbvf: Intel(R) Gigabit Virtual Function Network Driver1541worker2 # [ 1.093006] hid: raw HID events driver (C) Jiri Kosina1542worker1 # [ 1.085793] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1543client # [ 1.070080] hv_vmbus: registering driver hyperv_keyboard1544worker1 # [ 1.085931] sky2: driver version 1.301545worker2 # [ 1.093278] usbcore: registered new interface driver usbhid1546worker2 # [ 1.093284] usbhid: USB HID core driver1547worker1 # [ 1.087573] usbcore: registered new interface driver usb-storage1548client # [ 1.071695] rtc-pl031 9010000.pl031: registered as rtc01549worker1 # [ 1.087685] usbcore: registered new interface driver usbserial_generic1550worker1 # [ 1.087700] usbserial: USB Serial support registered for generic1551client # [ 1.071723] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:15:58 UTC (1789892158)1552client # [ 1.072043] i2c_dev: i2c /dev entries driver1553worker1 # [ 1.088738] ehci-pci 0000:00:0a.0: EHCI Host Controller1554worker2 # [ 1.096282] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1555worker1 # [ 1.088799] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11556worker1 # [ 1.089159] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001557worker2 # [ 1.098948] drop_monitor: Initializing network drop monitor service1558worker2 # [ 1.099115] NET: Registered PF_INET6 protocol family1559worker1 # [ 1.101708] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001560worker1 # [ 1.102118] hub 1-0:1.0: USB hub found1561worker1 # [ 1.102156] hub 1-0:1.0: 6 ports detected1562worker2 # [ 1.101151] Segment Routing with IPv61563worker2 # [ 1.101172] In-situ OAM (IOAM) with IPv61564worker2 # [ 1.101203] NET: Registered PF_PACKET protocol family1565worker1 # [ 1.105326] hv_vmbus: registering driver hyperv_keyboard1566client # [ 1.077129] sdhci: Secure Digital Host Controller Interface driver1567client # [ 1.077141] sdhci: Copyright(c) Pierre Ossman1568client # [ 1.077403] Synopsys Designware Multimedia Card Interface Driver1569client # [ 1.077780] sdhci-pltfm: SDHCI platform and OF driver helper1570client # [ 1.079518] hid: raw HID events driver (C) Jiri Kosina1571lb # [ 1.168322] systemd[1]: Successfully made /usr/ read-only.1572worker2 # [ 1.103040] 9pnet: Installing 9P2000 support1573client # [ 1.082719] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001574worker1 # [ 1.107127] rtc-pl031 9010000.pl031: registered as rtc01575client # [ 1.083894] hub 1-0:1.0: USB hub found1576client # [ 1.083916] hub 1-0:1.0: 6 ports detected1577worker1 # [ 1.107163] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:15:58 UTC (1789892158)1578worker1 # [ 1.107498] i2c_dev: i2c /dev entries driver1579worker2 # [ 1.106091] Key type dns_resolver registered1580client # [ 1.085546] usbcore: registered new interface driver usbhid1581client # [ 1.085558] usbhid: USB HID core driver1582client # [ 1.087955] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1583worker2 # [ 1.112583] registered taskstats version 11584worker2 # [ 1.112748] Loading compiled-in X.509 certificates1585client # [ 1.089535] drop_monitor: Initializing network drop monitor service1586worker1 # [ 1.112665] sdhci: Secure Digital Host Controller Interface driver1587client # [ 1.089767] NET: Registered PF_INET6 protocol family1588worker1 # [ 1.112676] sdhci: Copyright(c) Pierre Ossman1589client # [ 1.092912] Segment Routing with IPv61590worker1 # [ 1.112949] Synopsys Designware Multimedia Card Interface Driver1591client # [ 1.092935] In-situ OAM (IOAM) with IPv61592worker1 # [ 1.113351] sdhci-pltfm: SDHCI platform and OF driver helper1593client # [ 1.092966] NET: Registered PF_PACKET protocol family1594worker1 # [ 1.115163] hid: raw HID events driver (C) Jiri Kosina1595worker1 # [ 1.115430] usbcore: registered new interface driver usbhid1596client # [ 1.094676] 9pnet: Installing 9P2000 support1597worker1 # [ 1.115436] usbhid: USB HID core driver1598worker2 # [ 1.121613] Demotion targets for Node 0: null1599worker1 # [ 1.121330] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1600client # [ 1.097744] Key type dns_resolver registered1601worker2 # [ 1.121754] Key type .fscrypt registered1602worker1 # [ 1.122880] drop_monitor: Initializing network drop monitor service1603worker2 # [ 1.121762] Key type fscrypt-provisioning registered1604worker1 # [ 1.123093] NET: Registered PF_INET6 protocol family1605worker2 # [ 1.121867] ima: No TPM chip found, activating TPM-bypass!1606worker2 # [ 1.121887] ima: Allocated hash algorithm: sha11607worker1 # [ 1.126552] Segment Routing with IPv61608worker2 # [ 1.121912] ima: No architecture policies found1609worker1 # [ 1.126574] In-situ OAM (IOAM) with IPv61610worker1 # [ 1.126607] NET: Registered PF_PACKET protocol family1611worker2 # [ 1.126376] input: gpio-keys as /devices/platform/gpio-keys/input/input01612worker1 # [ 1.128345] 9pnet: Installing 9P2000 support1613client # [ 1.104380] registered taskstats version 11614worker1 # [ 1.130868] Key type dns_resolver registered1615client # [ 1.104555] Loading compiled-in X.509 certificates1616client # [ 1.113866] Demotion targets for Node 0: null1617client # [ 1.114009] Key type .fscrypt registered1618client # [ 1.114016] Key type fscrypt-provisioning registered1619worker1 # [ 1.138288] registered taskstats version 11620worker1 # [ 1.138483] Loading compiled-in X.509 certificates1621client # [ 1.114122] ima: No TPM chip found, activating TPM-bypass!1622client # [ 1.114143] ima: Allocated hash algorithm: sha11623client # [ 1.114168] ima: No architecture policies found1624client # [ 1.118532] input: gpio-keys as /devices/platform/gpio-keys/input/input01625worker1 # [ 1.147562] Demotion targets for Node 0: null1626worker1 # [ 1.147705] Key type .fscrypt registered1627worker1 # [ 1.147712] Key type fscrypt-provisioning registered1628worker1 # [ 1.147823] ima: No TPM chip found, activating TPM-bypass!1629worker1 # [ 1.147843] ima: Allocated hash algorithm: sha11630worker1 # [ 1.147868] ima: No architecture policies found1631worker2 # [ 1.147491] clk: Disabling unused clocks1632worker2 # [ 1.147530] PM: genpd: Disabling unused power domains1633worker1 # [ 1.152338] input: gpio-keys as /devices/platform/gpio-keys/input/input01634worker2 # [ 1.151916] Freeing unused kernel memory: 4736K1635worker2 # [ 1.152112] Run /init as init process1636client # [ 1.139090] clk: Disabling unused clocks1637client # [ 1.139138] PM: genpd: Disabling unused power domains1638client # [ 1.143626] Freeing unused kernel memory: 4736K1639client # [ 1.143924] Run /init as init process1640worker2 # [ 1.167872] systemd[1]: Successfully made /usr/ read-only.1641worker1 # [ 1.172645] clk: Disabling unused clocks1642worker1 # [ 1.172690] PM: genpd: Disabling unused power domains1643worker1 # [ 1.177117] Freeing unused kernel memory: 4736K1644worker1 # [ 1.177349] Run /init as init process1645client # [ 1.162057] systemd[1]: Successfully made /usr/ read-only.1646worker1 # [ 1.194493] systemd[1]: Successfully made /usr/ read-only.1647lb # [ 1.337799] usb 1-1: new high-speed USB device number 2 using ehci-pci1648worker2 # [ 1.326428] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.347959] usb 1-1: new high-speed USB device number 2 using ehci-pci1650client # [ 1.331645] usb 1-1: new high-speed USB device number 2 using ehci-pci1651lb # [ 1.498265] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652lb # [ 1.503120] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653lb # [ 1.510527] systemd[1]: Detected virtualization qemu.1654lb # [ 1.511776] systemd[1]: Detected architecture arm64.1655lb # [ 1.513097] systemd[1]: Running in initrd.1656lb # [ 1.514726] systemd[1]: Initializing machine ID from random generator.1657lb # [ 1.516470] systemd[1]: Hostname set to <lb>.1658worker2 # [ 1.483729] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659worker1 # [ 1.500356] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660client # [ 1.485978] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661worker2 # [ 1.502867] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1662worker2 # [ 1.515404] systemd[1]: Detected virtualization qemu.1663worker2 # [ 1.517595] systemd[1]: Detected architecture arm64.1664worker2 # [ 1.519577] systemd[1]: Running in initrd.1665lb # [ 1.585966] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01666worker2 # [ 1.522277] systemd[1]: Initializing machine ID from random generator.1667worker2 # [ 1.525221] systemd[1]: Hostname set to <worker2>.1668client # [ 1.497092] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1669client # [ 1.509779] systemd[1]: Detected virtualization qemu.1670client # [ 1.511939] systemd[1]: Detected architecture arm64.1671client # [ 1.513942] systemd[1]: Running in initrd.1672worker1 # [ 1.529682] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1673client # [ 1.516712] systemd[1]: Initializing machine ID from random generator.1674worker1 # [ 1.542142] systemd[1]: Detected virtualization qemu.1675client # [ 1.519857] systemd[1]: Hostname set to <client>.1676worker1 # [ 1.544315] systemd[1]: Detected architecture arm64.1677worker1 # [ 1.546342] systemd[1]: Running in initrd.1678worker1 # [ 1.548973] systemd[1]: Initializing machine ID from random generator.1679worker1 # [ 1.551973] systemd[1]: Hostname set to <worker1>.1680worker2 # [ 1.573606] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681worker1 # [ 1.596362] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682client # [ 1.579853] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683lb # [ 1.705790] usb 1-2: new high-speed USB device number 3 using ehci-pci1684worker2 # [ 1.693457] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker1 # [ 1.719965] usb 1-2: new high-speed USB device number 3 using ehci-pci1686client # [ 1.703633] usb 1-2: new high-speed USB device number 3 using ehci-pci1687lb # [ 1.800352] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688worker2 # [ 1.782172] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689lb # [ 1.863109] systemd[1]: Queued start job for default target Initrd Default Target.1690lb # [ 1.866590] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21691lb # [ 1.868518] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01692lb # [ 1.872680] systemd[1]: Created slice Slice /system/modprobe.1693lb # [ 1.873796] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1694lb # [ 1.874830] systemd[1]: Expecting device /dev/disk/by-label/nixos...1695lb # [ 1.876001] systemd[1]: Reached target Path Units.1696lb # [ 1.876641] systemd[1]: Reached target Slice Units.1697lb # [ 1.877291] systemd[1]: Reached target Swaps.1698lb # [ 1.877936] systemd[1]: Reached target Timer Units.1699lb # [ 1.878884] systemd[1]: Listening on D-Bus System Message Bus Socket.1700lb # [ 1.879934] systemd[1]: Listening on Journal Socket (/dev/log).1701lb # [ 1.880839] systemd[1]: Listening on Journal Sockets.1702lb # [ 1.881878] systemd[1]: Listening on udev Control Socket.1703lb # [ 1.882738] systemd[1]: Listening on udev Kernel Socket.1704lb # [ 1.883506] systemd[1]: Reached target Socket Units.1705lb # [ 1.885867] systemd[1]: Starting Create List of Static Device Nodes...1706lb # [ 1.893995] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1707lb # [ 1.895129] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1708lb # [ 1.901807] systemd[1]: Mounting Kernel Configuration File System...1709worker2 # [ 1.848423] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21710worker2 # [ 1.850428] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01711worker2 # [ 1.852717] systemd[1]: Queued start job for default target Initrd Default Target.1712worker2 # [ 1.863476] systemd[1]: Created slice Slice /system/modprobe.1713lb # [ 1.928607] systemd[1]: Starting Journal Service...1714worker2 # [ 1.864744] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1715worker2 # [ 1.866082] systemd[1]: Expecting device /dev/disk/by-label/nixos...1716worker2 # [ 1.866924] systemd[1]: Reached target Path Units.1717worker2 # [ 1.867605] systemd[1]: Reached target Slice Units.1718worker2 # [ 1.868263] systemd[1]: Reached target Swaps.1719worker2 # [ 1.868923] systemd[1]: Reached target Timer Units.1720worker1 # [ 1.868892] systemd[1]: bpf-restrict-fs: LSM BPF program attached1721worker2 # [ 1.869836] systemd[1]: Listening on D-Bus System Message Bus Socket.1722worker2 # [ 1.870824] systemd[1]: Listening on Journal Socket (/dev/log).1723worker2 # [ 1.871743] systemd[1]: Listening on Journal Sockets.1724worker2 # [ 1.872554] systemd[1]: Listening on udev Control Socket.1725client # [ 1.848495] systemd[1]: bpf-restrict-fs: LSM BPF program attached1726worker2 # [ 1.873426] systemd[1]: Listening on udev Kernel Socket.1727worker2 # [ 1.874162] systemd[1]: Reached target Socket Units.1728lb # [ 1.938186] systemd[1]: Starting Load Kernel Modules...1729lb # [ 1.939084] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1730worker2 # [ 1.876577] systemd[1]: Starting Create List of Static Device Nodes...1731worker1 # [ 1.882916] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21732worker2 # [ 1.885566] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1733worker2 # [ 1.885677] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1734client # [ 1.866063] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21735worker2 # [ 1.893716] systemd[1]: Mounting Kernel Configuration File System...1736worker1 # [ 1.892283] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01737lb # [ 1.962069] systemd[1]: Starting Coldplug All udev Devices...1738client # [ 1.875938] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01739lb # [ 1.973041] systemd-journald[73]: Collecting audit messages is disabled.1740worker2 # [ 1.917767] systemd[1]: Starting Journal Service...1741lb # [ 1.981929] systemd[1]: Finished Create List of Static Device Nodes.1742lb # [ 1.983129] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1743lb # [ 1.983521] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1744worker2 # [ 1.929636] systemd[1]: Starting Load Kernel Modules...1745worker2 # [ 1.930674] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1746worker2 # [ 1.937707] systemd[1]: Starting Coldplug All udev Devices...1747lb # [ 2.005374] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1748lb # [ 2.022054] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1749lb # [ 2.024604] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1750worker2 # [ 1.961598] systemd[1]: Finished Create List of Static Device Nodes.1751worker2 # [ 1.962966] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1752worker2 # [ 1.963349] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1753worker2 # [ 1.963668] systemd[1]: Mounted Kernel Configuration File System.1754lb # [ 2.034038] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01755lb # [ 2.034402] [drm] features: -virgl +edid -resource_blob -host_visible1756lb # [ 2.034414] [drm] features: -context_init1757lb # [ 2.035246] [drm] number of scanouts: 11758lb # [ 2.035267] [drm] number of cap sets: 01759lb # [ 2.039150] systemd[1]: Mounted Kernel Configuration File System.1760worker1 # [ 1.980583] systemd[1]: Queued start job for default target Initrd Default Target.1761client # [ 1.961949] systemd[1]: Queued start job for default target Initrd Default Target.1762worker2 # [ 1.977962] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1763worker1 # [ 1.990380] systemd[1]: Created slice Slice /system/modprobe.1764worker1 # [ 1.991705] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1765worker1 # [ 1.993148] systemd[1]: Expecting device /dev/disk/by-label/nixos...1766worker1 # [ 1.994179] systemd[1]: Reached target Path Units.1767client # [ 1.969834] systemd[1]: Created slice Slice /system/modprobe.1768worker1 # [ 1.994992] systemd[1]: Reached target Slice Units.1769client # [ 1.970944] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1770lb # [ 2.054463] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1771worker1 # [ 1.995797] systemd[1]: Reached target Swaps.1772lb # [ 2.054497] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01773worker1 # [ 1.996592] systemd[1]: Reached target Timer Units.1774client # [ 1.972163] systemd[1]: Expecting device /dev/disk/by-label/nixos...1775client # [ 1.973075] systemd[1]: Reached target Path Units.1776worker1 # [ 1.997626] systemd[1]: Listening on D-Bus System Message Bus Socket.1777client # [ 1.973776] systemd[1]: Reached target Slice Units.1778client # [ 1.974476] systemd[1]: Reached target Swaps.1779worker1 # [ 1.998836] systemd[1]: Listening on Journal Socket (/dev/log).1780client # [ 1.975119] systemd[1]: Reached target Timer Units.1781worker1 # [ 2.000015] systemd[1]: Listening on Journal Sockets.1782client # [ 1.976054] systemd[1]: Listening on D-Bus System Message Bus Socket.1783worker1 # [ 2.000986] systemd[1]: Listening on udev Control Socket.1784client # [ 1.977129] systemd[1]: Listening on Journal Socket (/dev/log).1785worker1 # [ 2.002035] systemd[1]: Listening on udev Kernel Socket.1786client # [ 1.978110] systemd[1]: Listening on Journal Sockets.1787worker1 # [ 2.002923] systemd[1]: Reached target Socket Units.1788client # [ 1.978966] systemd[1]: Listening on udev Control Socket.1789client # [ 1.979882] systemd[1]: Listening on udev Kernel Socket.1790worker1 # [ 2.005566] systemd[1]: Starting Create List of Static Device Nodes...1791client # [ 1.979908] systemd[1]: Reached target Socket Units.1792client # [ 1.982952] systemd[1]: Starting Create List of Static Device Nodes...1793worker2 # [ 2.006870] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1794worker1 # [ 2.012643] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1795worker1 # [ 2.013853] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1796client # [ 1.991804] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1797worker2 # [ 2.014989] systemd-journald[73]: Collecting audit messages is disabled.1798client # [ 1.992882] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1799lb # [ 2.082471] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1800client # [ 1.998496] systemd[1]: Mounting Kernel Configuration File System...1801lb # [ 2.085379] systemd[1]: Starting Create Static Device Nodes in /dev...1802worker1 # [ 2.025095] systemd[1]: Mounting Kernel Configuration File System...1803worker2 # [ 2.025444] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1804lb # [ 2.098090] Console: switching to colour frame buffer device 160x501805lb # [ 2.098745] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1806client # [ 2.019223] systemd[1]: Starting Journal Service...1807worker2 # [ 2.047644] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01808worker2 # [ 2.047925] [drm] features: -virgl +edid -resource_blob -host_visible1809worker2 # [ 2.047938] [drm] features: -context_init1810worker2 # [ 2.048732] [drm] number of scanouts: 11811worker2 # [ 2.048752] [drm] number of cap sets: 01812client # [ 2.031855] systemd[1]: Starting Load Kernel Modules...1813client # [ 2.032793] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1814worker1 # [ 2.060246] systemd[1]: Starting Journal Service...1815worker1 # [ 2.063038] systemd[1]: Starting Load Kernel Modules...1816worker2 # [ 2.057748] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1817worker2 # [ 2.057781] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01818lb # [ 2.126516] systemd[1]: Finished Load Kernel Modules.1819worker1 # [ 2.064148] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1820client # [ 2.041296] systemd[1]: Starting Coldplug All udev Devices...1821worker2 # [ 2.065592] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1822lb # [ 2.131822] systemd[1]: Starting Apply Kernel Variables...1823worker2 # [ 2.069860] systemd[1]: Starting Create Static Device Nodes in /dev...1824client # [ 2.047846] systemd[1]: Finished Create List of Static Device Nodes.1825client # [ 2.049800] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1826worker1 # [ 2.075644] systemd[1]: Starting Coldplug All udev Devices...1827client # [ 2.068205] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1828worker1 # [ 2.088859] systemd[1]: Finished Create List of Static Device Nodes.1829worker1 # [ 2.089960] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1830worker1 # [ 2.090288] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1831worker1 # [ 2.090561] systemd[1]: Mounted Kernel Configuration File System.1832worker2 # [ 2.093948] Console: switching to colour frame buffer device 160x501833lb # [ 2.170237] systemd[1]: Finished Create Static Device Nodes in /dev.1834lb # [ 2.170560] systemd[1]: Reached target Preparation for Local File Systems.1835lb # [ 2.170605] systemd[1]: Reached target Local File Systems.1836lb # [ 2.178304] systemd[1]: Starting Rule-based Manager for Device Events and Files...1837client # [ 2.094851] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1838worker1 # [ 2.120260] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1839client # [ 2.099525] systemd-journald[73]: Collecting audit messages is disabled.1840worker1 # [ 2.125761] systemd-journald[73]: Collecting audit messages is disabled.1841client # [ 2.099799] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1842client # [ 2.100484] systemd[1]: Mounted Kernel Configuration File System.1843lb # [ 2.168634] systemd-modules-load[74]: Inserted module 'dm_mod'1844lb # [ 2.170172] systemd-modules-load[74]: Module 'virtio_balloon' is built in1845lb # [ 2.171377] systemd-modules-load[74]: Module 'virtio_console' is built in1846client # [ 2.107807] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1847worker2 # [ 2.130055] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1848lb # [ 2.176706] systemd-modules-load[74]: Inserted module 'virtio_gpu'1849lb # [ 2.199708] systemd[1]: Started Journal Service.1850worker2 # [ 2.142952] systemd[1]: Finished Load Kernel Modules.1851lb # [ 2.187982] systemd-modules-load[74]: Module 'virtio_rng' is built in1852worker2 # [ 2.148222] systemd[1]: Starting Apply Kernel Variables...1853client # [ 2.126558] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01854client # [ 2.126846] [drm] features: -virgl +edid -resource_blob -host_visible1855client # [ 2.126857] [drm] features: -context_init1856lb # [ 2.202374] systemd[1]: Finished Apply Kernel Variables.1857client # [ 2.143849] [drm] number of scanouts: 11858worker1 # [ 2.166103] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1859client # [ 2.143887] [drm] number of cap sets: 01860worker2 # [ 2.166878] systemd[1]: Finished Create Static Device Nodes in /dev.1861client # [ 2.145535] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1862client # [ 2.145556] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01863worker1 # [ 2.176726] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1864worker2 # [ 2.173739] systemd[1]: Reached target Preparation for Local File Systems.1865worker2 # [ 2.173811] systemd[1]: Reached target Local File Systems.1866lb # [ 2.221239] systemd[1]: Starting Create System Files and Directories...1867worker1 # [ 2.184082] systemd[1]: Starting Create Static Device Nodes in /dev...1868worker2 # [ 2.182119] systemd[1]: Starting Rule-based Manager for Device Events and Files...1869client # [ 2.160409] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1870worker1 # [ 2.188152] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1871client # [ 2.168162] systemd[1]: Starting Create Static Device Nodes in /dev...1872worker1 # [ 2.196147] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01873worker1 # [ 2.196433] [drm] features: -virgl +edid -resource_blob -host_visible1874worker1 # [ 2.196444] [drm] features: -context_init1875worker1 # [ 2.197325] [drm] number of scanouts: 11876worker1 # [ 2.197348] [drm] number of cap sets: 01877client # [ 2.181076] Console: switching to colour frame buffer device 160x501878worker2 # [ 2.221768] systemd[1]: Finished Apply Kernel Variables.1879worker2 # [ 2.203238] systemd-modules-load[74]: Inserted module 'dm_mod'1880worker1 # [ 2.220276] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1881worker1 # [ 2.220308] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01882worker2 # [ 2.225830] systemd[1]: Started Journal Service.1883worker2 # [ 2.208197] systemd-modules-load[74]: Module 'virtio_balloon' is built in1884lb # [ 2.273728] systemd-udevd[81]: Using default interface naming scheme 'v261'.1885worker2 # [ 2.213878] systemd-modules-load[74]: Module 'virtio_console' is built in1886client # [ 2.213895] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1887lb # [ 2.283399] systemd[1]: Finished Create System Files and Directories.1888worker2 # [ 2.224572] systemd-modules-load[74]: Inserted module 'virtio_gpu'1889client # [ 2.225298] systemd[1]: Finished Load Kernel Modules.1890worker2 # [ 2.228535] systemd-modules-load[74]: Module 'virtio_rng' is built in1891worker2 # [ 2.232492] systemd[1]: Starting Create System Files and Directories...1892client # [ 2.234315] systemd[1]: Starting Apply Kernel Variables...1893worker1 # [ 2.256265] Console: switching to colour frame buffer device 160x501894worker1 # [ 2.261118] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1895worker1 # [ 2.264630] systemd[1]: Finished Create Static Device Nodes in /dev.1896worker1 # [ 2.265091] systemd[1]: Reached target Preparation for Local File Systems.1897worker1 # [ 2.265128] systemd[1]: Reached target Local File Systems.1898worker1 # [ 2.270863] systemd[1]: Starting Rule-based Manager for Device Events and Files...1899lb # [ 2.313135] systemd[1]: Started Rule-based Manager for Device Events and Files.1900client # [ 2.255930] systemd[1]: Finished Create Static Device Nodes in /dev.1901client # [ 2.256218] systemd[1]: Reached target Preparation for Local File Systems.1902client # [ 2.256260] systemd[1]: Reached target Local File Systems.1903client # [ 2.266445] systemd[1]: Starting Rule-based Manager for Device Events and Files...1904worker1 # [ 2.296553] systemd[1]: Finished Load Kernel Modules.1905worker2 # [ 2.278361] systemd[1]: Finished Create System Files and Directories.1906worker2 # [ 2.296499] systemd-udevd[81]: Using default interface naming scheme 'v261'.1907worker1 # [ 2.320197] systemd[1]: Starting Apply Kernel Variables...1908client # [ 2.304067] systemd[1]: Finished Apply Kernel Variables.1909worker1 # [ 2.328223] systemd[1]: Started Journal Service.1910client # [ 2.291509] systemd-modules-load[74]: Inserted module 'dm_mod'1911client # [ 2.308294] systemd[1]: Started Journal Service.1912worker1 # [ 2.320439] systemd-modules-load[74]: Inserted module 'dm_mod'1913worker1 # [ 2.321945] systemd-modules-load[74]: Module 'virtio_balloon' is built in1914lb # [ 2.378919] systemd[1]: Starting Virtual Console Setup...1915worker2 # [ 2.320955] systemd[1]: Started Rule-based Manager for Device Events and Files.1916client # [ 2.304698] systemd-modules-load[74]: Module 'virtio_balloon' is built in1917client # [ 2.305953] systemd-modules-load[74]: Module 'virtio_console' is built in1918client # [ 2.307035] systemd-modules-load[74]: Inserted module 'virtio_gpu'1919worker1 # [ 2.336506] systemd-modules-load[74]: Module 'virtio_console' is built in1920client # [ 2.316241] systemd-modules-load[74]: Module 'virtio_rng' is built in1921worker1 # [ 2.340386] systemd-modules-load[74]: Inserted module 'virtio_gpu'1922client # [ 2.318522] systemd[1]: Starting Create System Files and Directories...1923worker1 # [ 2.344639] systemd-modules-load[74]: Module 'virtio_rng' is built in1924worker1 # [ 2.352366] systemd[1]: Starting Create System Files and Directories...1925worker1 # [ 2.356391] systemd[1]: Finished Apply Kernel Variables.1926lb # [ 2.432582] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1927lb # [ 2.436650] systemd[1]: Finished Virtual Console Setup.1928client # [ 2.362058] systemd[1]: Finished Create System Files and Directories.1929worker1 # [ 2.390812] systemd-udevd[79]: Using default interface naming scheme 'v261'.1930client # [ 2.367541] systemd-udevd[80]: Using default interface naming scheme 'v261'.1931worker2 # [ 2.389404] systemd[1]: Starting Virtual Console Setup...1932worker1 # [ 2.406062] systemd[1]: Finished Create System Files and Directories.1933client # [ 2.401886] systemd[1]: Started Rule-based Manager for Device Events and Files.1934worker1 # [ 2.429768] systemd[1]: Started Rule-based Manager for Device Events and Files.1935worker2 # [ 2.444571] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1936worker2 # [ 2.452230] systemd[1]: Finished Virtual Console Setup.1937client # [ 2.468359] systemd[1]: Starting Virtual Console Setup...1938worker1 # [ 2.494465] systemd[1]: Starting Virtual Console Setup...1939client # [ 2.524565] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1940client # [ 2.528582] systemd[1]: Finished Virtual Console Setup.1941worker1 # [ 2.556571] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942worker1 # [ 2.560654] systemd[1]: Finished Virtual Console Setup.1943lb # [ 3.041193] systemd[1]: Finished Coldplug All udev Devices.1944lb # [ 3.043512] systemd[1]: Reached target System Initialization.1945lb # [ 3.044551] systemd[1]: Reached target Basic System.1946worker2 # [ 3.032473] systemd[1]: Finished Coldplug All udev Devices.1947worker2 # [ 3.033872] systemd[1]: Reached target System Initialization.1948worker2 # [ 3.040295] systemd[1]: Reached target Basic System.1949lb # [ 3.175639] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1950worker1 # [ 3.149936] systemd[1]: Finished Coldplug All udev Devices.1951worker1 # [ 3.152183] systemd[1]: Reached target System Initialization.1952worker1 # [ 3.156145] systemd[1]: Reached target Basic System.1953client # [ 3.161218] systemd[1]: Finished Coldplug All udev Devices.1954client # [ 3.162232] systemd[1]: Reached target System Initialization.1955client # [ 3.163067] systemd[1]: Reached target Basic System.1956lb # [ 3.243130] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1957worker2 # [ 3.180185] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958lb # [ 3.248416] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1959worker2 # [ 3.202327] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1960worker2 # [ 3.223788] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1961lb # [ 3.304635] systemd[1]: Found device /dev/disk/by-label/nixos.1962lb # [ 3.308922] systemd[1]: Reached target Initrd Root Device.1963lb # [ 3.316808] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1964worker2 # [ 3.296324] systemd[1]: Found device /dev/disk/by-label/nixos.1965worker2 # [ 3.301585] systemd[1]: Reached target Initrd Root Device.1966worker2 # [ 3.304716] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1967lb # [ 3.373391] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1968lb # [ 3.381429] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1969worker1 # [ 3.327615] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1970lb # [ 3.396320] systemd[1]: Mounting /sysroot...1971client # [ 3.330419] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1972worker1 # [ 3.359741] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1973worker1 # [ 3.365783] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1974client # [ 3.342345] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1975worker2 # [ 3.361527] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1976client # [ 3.348370] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1977worker2 # [ 3.367689] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1978lb # [ 3.453701] EXT4-fs (vda): mounted filesystem 3faef092-bc18-4198-9413-3d057e500187 r/w with ordered data mode. Quota mode: none.1979lb # [ 3.441650] systemd[1]: Mounted /sysroot.1980worker2 # [ 3.378501] systemd[1]: Mounting /sysroot...1981lb # [ 3.442754] systemd[1]: Reached target Initrd Root File System.1982lb # [ 3.446282] systemd[1]: Starting Mountpoints Configured in the Real Root...1983lb # [ 3.480904] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1984worker2 # [ 3.438378] EXT4-fs (vda): mounted filesystem c5e7dc43-1556-4841-aee5-bb80ca2546dc r/w with ordered data mode. Quota mode: none.1985worker2 # [ 3.422980] systemd[1]: Mounted /sysroot.1986lb # [ 3.485894] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1987lb # [ 3.488835] systemd[1]: Reloading...1988worker2 # [ 3.426043] systemd[1]: Reached target Initrd Root File System.1989worker1 # [ 3.444162] systemd[1]: Found device /dev/disk/by-label/nixos.1990worker2 # [ 3.431962] systemd[1]: Starting Mountpoints Configured in the Real Root...1991client # [ 3.423675] systemd[1]: Found device /dev/disk/by-label/nixos.1992worker1 # [ 3.448121] systemd[1]: Reached target Initrd Root Device.1993worker1 # [ 3.451730] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1994client # [ 3.428560] systemd[1]: Reached target Initrd Root Device.1995client # [ 3.433205] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1996worker2 # [ 3.465220] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1997worker2 # [ 3.472121] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1998worker2 # [ 3.477017] systemd[1]: Reloading...1999worker1 # [ 3.503963] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks2000worker1 # [ 3.514540] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.
loading 1,171 hidden lines…
3172client # [ 13.462027] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3173client # [ 13.469184] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23174client # [ 13.469579] cfg80211: failed to load regulatory.db3175worker2 # [ 13.475498] dhcpcd[606]: dhcpcd-10.3.2 starting3176worker2 # [ 13.483610] network-addresses-eth1-start[607]: adding address 192.168.1.4/24... done3177client # [ 13.489641] 8021q: adding VLAN 0 to HW filter on device eth13178worker2 # [ 13.497962] dhcpcd[658]: dev: loaded udev3179client # [ 13.496593] mousedev: PS/2 mouse device common for all mice3180worker2 # [ 13.515971] network-addresses-eth1-start[607]: adding address 2001:db8:1::4/64... done3181worker1 # [ 13.540396] dhcpcd[603]: dhcpcd-10.3.2 starting3182client # [ 13.517157] network-addresses-eth1-start[560]: adding address 192.168.1.1/24... done3183worker2 # [ 13.557523] 8021q: 802.1Q VLAN Support v1.83184worker2 # [ 13.558018] 8021q: adding VLAN 0 to HW filter on device eth13185worker1 # [ 13.557135] dhcpcd[635]: dev: loaded udev3186worker1 # [ 13.565356] dhcpcd[635]: no valid interfaces found3187worker1 # [ 13.568266] dhcpcd[635]: no valid interfaces found3188worker2 # [ 13.562615] systemd[1]: Finished Address configuration of eth1.3189worker1 # [ 13.572626] dhcpcd[635]: libudev: received NULL device3190client # [ 13.549895] network-addresses-eth1-start[560]: adding address 2001:db8:1::1/64... done3191worker1 # [ 13.575685] dhcpcd[635]: libudev: received NULL device3192client # [ 13.597984] dhcpcd[586]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (562) - Operation not permitted3193client # [ 13.599917] dhcpcd[586]: .resolvconf-wrapped: clearing stale lock pid 5623194lb # [ 13.689875] postgresql-pre-start[686]: selecting default "shared_buffers" ... 128MB3195client # [ 13.610731] systemd[1]: Finished Address configuration of eth1.3196worker1 # [ 13.642892] systemd[1]: Starting Virtual Console Setup...3197worker2 # [ 13.660753] cfg80211: Loading compiled-in X.509 certificates for regulatory database3198worker2 # [ 13.642494] systemd[1]: Finished Extra networking commands..3199worker1 # [ 13.649967] systemd[1]: Finished Extra networking commands..3200worker2 # [ 13.643489] systemd[1]: Reached target Network.3201worker1 # [ 13.657399] systemd[1]: Reached target Network.3202worker2 # [ 13.650463] systemd[1]: Starting Permit User Sessions...3203worker1 # [ 13.660385] systemd[1]: Starting Permit User Sessions...3204worker2 # [ 13.699021] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3205worker2 # [ 13.699590] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3206worker2 # [ 13.704942] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23207worker2 # [ 13.705291] cfg80211: failed to load regulatory.db3208client # [ 13.704993] 8021q: adding VLAN 0 to HW filter on device eth03209client # [ 13.692455] dhcpcd[551]: eth0: waiting for carrier3210worker1 # [ 13.721087] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3211client # [ 13.697531] dhcpcd[551]: libudev: received NULL device3212client # [ 13.698408] dhcpcd[551]: libudev: received NULL device3213client # [ 13.699326] dhcpcd[551]: eth0: carrier acquired3214worker1 # [ 13.731411] systemd[1]: Stopped Virtual Console Setup.3215worker1 # [ 13.735592] systemd[1]: Starting Virtual Console Setup...3216worker2 # [ 13.730602] systemd[1]: Finished Permit User Sessions.3217worker1 # [ 13.741772] systemd[1]: Finished Permit User Sessions.3218worker2 # [ 13.735558] systemd[1]: Started Getty on tty1.3219worker2 # [ 13.738860] systemd[1]: Reached target Login Prompts.3220worker1 # [ 13.752454] systemd[1]: Started Getty on tty1.3221worker2 # [ 13.746656] systemd-logind[511]: Watching system buttons on /dev/input/event0 (gpio-keys)3222worker1 # [ 13.755028] systemd[1]: Reached target Login Prompts.3223client # [ 13.733877] dhcpcd[551]: DUID 00:01:00:01:32:42:52:cb:52:54:00:12:34:563224worker1 # [ 13.758259] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs3225client # [ 13.737677] dhcpcd[551]: eth0: IAID 00:12:34:563226client # [ 13.741589] dhcpcd[551]: eth0: adding address fe80::5054:ff:fe12:34563227client: (finished: waiting for unit network-addresses-eth1.service, in 14.21 seconds)3228client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3229client # [ 13.778789] systemd-logind[432]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3230worker2 # [ 13.818005] 8021q: adding VLAN 0 to HW filter on device eth03231worker2 # [ 13.799786] dhcpcd[658]: eth0: waiting for carrier3232worker2 # [ 13.801721] dhcpcd[658]: eth0: carrier acquired3233client # [ 13.795905] systemd[1]: Finished Extra networking commands..3234worker2 # [ 13.817580] dhcpcd[658]: DUID 00:01:00:01:32:42:52:cb:52:54:00:12:34:563235worker2 # [ 13.818640] dhcpcd[658]: eth0: IAID 00:12:34:563236client # [ 13.802157] systemd[1]: Reached target Network.3237worker2 # [ 13.819312] dhcpcd[658]: eth0: adding address fe80::5054:ff:fe12:34563238client # [ 13.813403] systemd[1]: Starting Permit User Sessions...3239client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.09 seconds)3240lb: waiting for unit network-addresses-eth1.service3241lb: waiting for the VM to finish booting3242client # [ 13.882114] systemd[1]: Finished Permit User Sessions.3243worker2 # [ 13.922937] mousedev: PS/2 mouse device common for all mice3244client # [ 13.889967] systemd[1]: Started Getty on tty1.3245client # [ 13.892291] systemd[1]: Reached target Login Prompts.3246worker1 # [ 13.973091] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.3247worker1 # [ 14.024174] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.3248lb # [ 14.083294] systemd[1]: Starting Virtual Console Setup...3249worker1 # [ 14.030226] systemd[1]: Started backdoor.service.3250worker2 # [ 14.035333] systemd-logind[511]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3251lb # [ 14.115147] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3252lb # [ 14.121001] systemd[1]: Stopped Virtual Console Setup.3253lb # [ 14.131118] systemd[1]: Starting Virtual Console Setup...3254lb # [ 14.159857] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs3255worker1 # [ 14.119246] 8021q: 802.1Q VLAN Support v1.83256client # [ 14.120411] dhcpcd[551]: eth0: soliciting a DHCP lease3257client # [ 14.128726] dhcpcd[551]: eth0: offered 10.0.2.15 from 10.0.2.23258client # [ 14.136287] dhcpcd[551]: eth0: probing address 10.0.2.15/243259worker1 # connecting to host...3260worker1 # [ 14.217476] cfg80211: Loading compiled-in X.509 certificates for regulatory database3261worker1 # [ 14.253937] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3262worker1 # [ 14.254522] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3263worker1 # [ 14.260081] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23264worker1 # [ 14.260506] cfg80211: failed to load regulatory.db3265worker1 # [ 14.260211] (udev-worker)[576]: Network interface NamePolicy= disabled on kernel command line.3266worker1 # [ 14.266515] (udev-worker)[592]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3267worker1 # [ 14.272391] (udev-worker)[592]: Network interface NamePolicy= disabled on kernel command line.3268worker1 # [ 14.399223] systemd-vconsole-setup[659]: Configuration of first virtual console was skipped, ignoring remaining ones.3269worker1 # [ 14.406698] systemd[1]: Finished Virtual Console Setup.3270lb # [ 14.463381] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.3271worker1 # [ 14.480843] systemd[1]: Condition check resulted in Virtio network device being skipped.3272worker1 # [ 14.486332] systemd[1]: Starting Address configuration of eth1...3273lb # [ 14.550923] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.3274lb # [ 14.555690] systemd[1]: Started backdoor.service.3275lb # [ 14.667515] 8021q: 802.1Q VLAN Support v1.83276worker1 # [ 14.614123] 8021q: adding VLAN 0 to HW filter on device eth03277worker1 # [ 14.601737] dhcpcd[635]: eth0: waiting for carrier3278worker1 # [ 14.602545] dhcpcd[635]: eth0: carrier acquired3279worker1 # [ 14.610394] systemd-logind[503]: Watching system buttons on /dev/input/event0 (gpio-keys)3280worker1 # [ 14.632481] 8021q: adding VLAN 0 to HW filter on device eth13281worker1 # [ 14.627980] dhcpcd[635]: DUID 00:01:00:01:32:42:52:cc:52:54:00:12:34:563282worker1 # [ 14.629281] dhcpcd[635]: eth0: IAID 00:12:34:563283worker1 # [ 14.629944] dhcpcd[635]: eth0: adding address fe80::5054:ff:fe12:34563284lb # [ 14.685612] systemd-vconsole-setup[708]: Configuration of first virtual console was skipped, ignoring remaining ones.3285lb # [ 14.697814] systemd[1]: Finished Virtual Console Setup.3286worker1 # [ 14.645007] network-addresses-eth1-start[680]: adding address 192.168.1.3/24... done3287worker1 # [ 14.661540] network-addresses-eth1-start[680]: adding address 2001:db8:1::3/64... done3288lb # connecting to host...3289worker1 # [ 14.684375] systemd[1]: Finished Address configuration of eth1.3290client # [ 14.690888] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33291lb: Guest shell says: b'Spawning backdoor root shell...\n'3292lb: connected to guest root shell3293lb: (connecting took 0.83 seconds)3294lb: (finished: waiting for the VM to finish booting, in 0.83 seconds)3295worker1 # [ 14.759954] mousedev: PS/2 mouse device common for all mice3296lb # [ 14.794949] (udev-worker)[687]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3297worker2 # [ 14.760175] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33298lb # [ 14.805575] (udev-worker)[687]: Network interface NamePolicy= disabled on kernel command line.3299lb # [ 14.813687] (udev-worker)[679]: Network interface NamePolicy= disabled on kernel command line.3300lb # [ 14.847934] cfg80211: Loading compiled-in X.509 certificates for regulatory database3301lb # [ 14.905630] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3302lb # [ 14.909342] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3303lb # [ 14.915055] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23304lb # [ 14.915457] cfg80211: failed to load regulatory.db3305worker1 # [ 14.868199] systemd-logind[503]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3306lb # [ 15.102158] systemd[1]: Condition check resulted in Virtio network device being skipped.3307lb # [ 15.118456] systemd[1]: Starting Address configuration of eth1...3308client # [ 15.043423] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3309client # [ 15.062723] systemd[1]: Starting Virtual Console Setup...3310worker2 # [ 15.082621] systemd[1]: Starting Virtual Console Setup...3311worker2 # [ 15.110752] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3312worker2 # [ 15.112548] systemd[1]: Stopped Virtual Console Setup.3313client # [ 15.095424] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3314worker2 # [ 15.115888] systemd[1]: Starting Virtual Console Setup...3315client # [ 15.100484] systemd[1]: Stopped Virtual Console Setup.3316client # [ 15.108596] systemd[1]: Starting Virtual Console Setup...3317worker2 # [ 15.127594] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3318lb # [ 15.247317] 8021q: adding VLAN 0 to HW filter on device eth03319worker2 # [ 15.166102] dhcpcd[658]: eth0: soliciting a DHCP lease3320client # [ 15.149291] systemd-logind[432]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3321lb # [ 15.232148] dhcpcd[644]: eth0: waiting for carrier3322worker2 # [ 15.172744] dhcpcd[658]: eth0: offered 10.0.2.15 from 10.0.2.23323lb # [ 15.235662] dhcpcd[644]: eth0: carrier acquired3324worker2 # [ 15.180934] dhcpcd[658]: eth0: probing address 10.0.2.15/243325lb # [ 15.266107] 8021q: adding VLAN 0 to HW filter on device eth13326lb # [ 15.259737] dhcpcd[644]: DUID 00:01:00:01:32:42:52:cc:52:54:00:12:34:563327lb # [ 15.263952] dhcpcd[644]: eth0: IAID 00:12:34:563328lb # [ 15.266004] dhcpcd[644]: eth0: adding address fe80::5054:ff:fe12:34563329lb # [ 15.277925] network-addresses-eth1-start[737]: adding address 192.168.1.2/24... done3330worker2 # [ 15.215083] systemd-logind[511]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3331lb # [ 15.293565] network-addresses-eth1-start[737]: adding address 2001:db8:1::2/64... done3332lb # [ 15.319219] systemd[1]: Finished Address configuration of eth1.3333lb # [ 15.442217] systemd-logind[521]: Watching system buttons on /dev/input/event0 (gpio-keys)3334lb # [ 15.518413] mousedev: PS/2 mouse device common for all mice3335worker2 # [ 15.568747] dhcpcd[658]: eth0: soliciting an IPv6 router3336client # [ 15.551837] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones.3337worker2 # [ 15.570387] dhcpcd[658]: eth0: Router Advertisement from fe80::23338worker2 # [ 15.572271] dhcpcd[658]: eth0: adding address fec0::5054:ff:fe12:3456/643339worker2 # [ 15.573469] dhcpcd[658]: eth0: adding route to fec0::/643340client # [ 15.556794] systemd[1]: Finished Virtual Console Setup.3341worker2 # [ 15.574508] dhcpcd[658]: eth0: adding default route via fe80::23342client # [ 15.560971] dhcpcd[551]: eth0: soliciting an IPv6 router3343client # [ 15.562161] dhcpcd[551]: eth0: Router Advertisement from fe80::23344client # [ 15.563284] dhcpcd[551]: eth0: adding address fec0::5054:ff:fe12:3456/643345client # [ 15.564749] dhcpcd[551]: eth0: adding route to fec0::/643346client # [ 15.565564] dhcpcd[551]: eth0: adding default route via fe80::23347lb # [ 15.653719] dhcpcd[644]: eth0: soliciting a DHCP lease3348lb # [ 15.663084] dhcpcd[644]: eth0: offered 10.0.2.15 from 10.0.2.23349worker2 # [ 15.601095] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones.3350lb # [ 15.669027] dhcpcd[644]: eth0: probing address 10.0.2.15/243351worker2 # [ 15.605703] systemd[1]: Finished Virtual Console Setup.3352lb # [ 15.672703] systemd-logind[521]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3353worker1 # [ 16.004525] dhcpcd[635]: eth0: soliciting a DHCP lease3354worker1 # [ 16.009057] dhcpcd[635]: eth0: offered 10.0.2.15 from 10.0.2.23355lb: (finished: waiting for unit network-addresses-eth1.service, in 2.13 seconds)3356lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3357worker1 # [ 16.016346] dhcpcd[635]: eth0: probing address 10.0.2.15/243358lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.06 seconds)3359worker1: waiting for unit network-addresses-eth1.service3360worker1: waiting for the VM to finish booting3361worker1: Guest shell says: b'Spawning backdoor root shell...\n'3362worker1: connected to guest root shell3363worker1: (connecting took 0.00 seconds)3364worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3365worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.13 seconds)3366worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3367worker1 # [ 16.248641] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3368worker1 # [ 16.250071] systemd[1]: Stopped Virtual Console Setup.3369worker1 # [ 16.251012] systemd[1]: Stopping Virtual Console Setup...3370worker1 # [ 16.263624] systemd[1]: Starting Virtual Console Setup...3371worker1 # [ 16.296665] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3372worker1 # [ 16.298197] systemd[1]: Stopped Virtual Console Setup.3373worker1 # [ 16.306648] systemd[1]: Starting Virtual Console Setup...3374worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.12 seconds)3375worker2: waiting for unit network-addresses-eth1.service3376worker2: waiting for the VM to finish booting3377worker2: Guest shell says: b'Spawning backdoor root shell...\n'3378worker2: connected to guest root shell3379worker2: (connecting took 0.00 seconds)3380worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3381worker1 # [ 16.394105] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3382worker1 # [ 16.411833] systemd-logind[503]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3383worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3384worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3385worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3386lb: waiting for unit niks3.service3387worker1 # [ 16.701530] systemd-vconsole-setup[724]: Configuration of first virtual console was skipped, ignoring remaining ones.3388worker1 # [ 16.707740] systemd[1]: Finished Virtual Console Setup.3389lb # [ 16.861773] postgresql-pre-start[686]: selecting default time zone ... UTC3390lb # [ 16.867680] postgresql-pre-start[686]: creating configuration files ... ok3391lb # [ 16.999344] dhcpcd[644]: eth0: soliciting an IPv6 router3392lb # [ 17.004230] dhcpcd[644]: eth0: Router Advertisement from fe80::23393lb # [ 17.005200] dhcpcd[644]: eth0: adding address fec0::5054:ff:fe12:3456/643394lb # [ 17.006129] dhcpcd[644]: eth0: adding route to fec0::/643395lb # [ 17.006841] dhcpcd[644]: eth0: adding default route via fe80::23396worker1 # [ 17.013178] dhcpcd[635]: eth0: soliciting an IPv6 router3397worker1 # [ 17.014688] dhcpcd[635]: eth0: Router Advertisement from fe80::23398worker1 # [ 17.016550] dhcpcd[635]: eth0: adding address fec0::5054:ff:fe12:3456/643399worker1 # [ 17.018223] dhcpcd[635]: eth0: adding route to fec0::/643400worker1 # [ 17.019475] dhcpcd[635]: eth0: adding default route via fe80::23401lb # [ 17.485813] postgresql-pre-start[686]: running bootstrap script ... ok3402lb # [ 18.412740] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3403lb # [ 18.412949] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3404lb # [ 18.413004] systemd[1]: Stopped Virtual Console Setup.3405lb # [ 18.413052] systemd[1]: Stopping Virtual Console Setup...3406lb # [ 18.427420] systemd[1]: Starting Virtual Console Setup...3407lb # [ 18.490038] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3408lb # [ 18.491274] systemd[1]: Stopped Virtual Console Setup.3409lb # [ 18.498376] systemd[1]: Starting Virtual Console Setup...3410lb # [ 18.543268] systemd-logind[521]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3411lb # [ 18.959576] postgresql-pre-start[686]: performing post-bootstrap initialization ... ok3412lb # [ 18.990124] systemd-vconsole-setup[802]: Configuration of first virtual console was skipped, ignoring remaining ones.3413lb # [ 18.996777] systemd[1]: Finished Virtual Console Setup.3414lb # [ 19.171336] postgresql-pre-start[686]: syncing data to disk ... ok3415lb # [ 19.172403] postgresql-pre-start[686]: initdb: warning: enabling "trust" authentication for local connections3416lb # [ 19.173743] postgresql-pre-start[686]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3417lb # [ 19.175902] postgresql-pre-start[686]: Success. You can now start the database server using:3418lb # [ 19.177209] postgresql-pre-start[686]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3419lb # [ 19.320756] postgres[822]: [822] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3420lb # [ 19.325934] postgres[822]: [822] LOG: listening on IPv6 address "::1", port 54323421lb # [ 19.327187] postgres[822]: [822] LOG: listening on IPv4 address "127.0.0.1", port 54323422lb # [ 19.329441] postgres[822]: [822] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3423lb # [ 19.346460] postgres[831]: [831] LOG: database system was shut down at 2026-09-20 08:16:16 GMT3424lb # [ 19.351714] postgres[822]: [822] LOG: database system is ready to accept connections3425lb # [ 19.358034] systemd[1]: Started PostgreSQL Server.3426lb # [ 19.369289] systemd[1]: Starting PostgreSQL Setup Scripts...3427lb # [ 19.632586] postgresql-setup-start[842]: CREATE DATABASE3428lb # [ 19.694229] postgresql-setup-start[847]: CREATE ROLE3429lb # [ 19.724138] postgresql-setup-start[849]: ALTER DATABASE3430lb # [ 19.733090] systemd[1]: Finished PostgreSQL Setup Scripts.3431lb # [ 19.735056] systemd[1]: Reached target PostgreSQL.3432client # [ 19.718481] dhcpcd[551]: eth0: leased 10.0.2.15 for 86400 seconds3433client # [ 19.723810] dhcpcd[551]: eth0: adding route to 10.0.2.0/243434client # [ 19.728333] dhcpcd[551]: eth0: adding default route via 10.0.2.23435client # [ 19.912201] systemd[1]: Started DHCP Client.3436client # [ 19.915984] systemd[1]: Reached target Multi-User System.3437client # [ 19.918340] systemd[1]: Startup finished in 1.133s (kernel) + 5.533s (initrd) + 13.251s (userspace) = 19.917s.3438worker2 # [ 20.082441] dhcpcd[658]: eth0: leased 10.0.2.15 for 86400 seconds3439worker2 # [ 20.082894] dhcpcd[658]: eth0: adding route to 10.0.2.0/243440worker2 # [ 20.083134] dhcpcd[658]: eth0: adding default route via 10.0.2.23441worker2 # [ 20.320279] systemd[1]: Started DHCP Client.3442worker2 # [ 20.322610] systemd[1]: Reached target Multi-User System.3443worker2 # [ 20.323471] systemd[1]: Startup finished in 1.135s (kernel) + 5.451s (initrd) + 13.735s (userspace) = 20.322s.3444lb # [ 20.869066] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds3445lb # [ 20.872384] dhcpcd[644]: eth0: adding route to 10.0.2.0/243446lb # [ 20.873948] dhcpcd[644]: eth0: adding default route via 10.0.2.23447lb # [ 21.034243] systemd[1]: Started DHCP Client.3448lb # [ 21.037686] systemd[1]: Reached target Network is Online.3449lb # [ 21.043968] systemd[1]: Started Envoy reverse proxy.3450lb # [ 21.053735] systemd[1]: Started mock-oidc.service.3451lb # [ 21.167434] mock-oidc-server[917]: Mock OIDC Server running3452lb # [ 21.169422] mock-oidc-server[917]: OIDC Address: 192.168.1.2:80803453lb # [ 21.170548] mock-oidc-server[917]: Issue Address: 0.0.0.0:80813454lb # [ 21.171688] mock-oidc-server[917]: Issuer: http://192.168.1.2:8080/oidc3455lb # [ 21.173389] mock-oidc-server[917]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3456lb # [ 21.174866] mock-oidc-server[917]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3457lb # [ 21.177450] mock-oidc-server[917]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3458worker1 # [ 21.346483] dhcpcd[635]: eth0: leased 10.0.2.15 for 86400 seconds3459worker1 # [ 21.352231] dhcpcd[635]: eth0: adding route to 10.0.2.0/243460worker1 # [ 21.355335] dhcpcd[635]: eth0: adding default route via 10.0.2.23461worker1 # [ 21.557598] systemd[1]: Started DHCP Client.3462worker1 # [ 21.559176] systemd[1]: Reached target Multi-User System.3463worker1 # [ 21.560626] systemd[1]: Startup finished in 1.166s (kernel) + 4.921s (initrd) + 15.471s (userspace) = 21.558s.3464lb # [ 21.986905] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3465lb # [ 21.987167] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:469] statically linked extensions:3466lb # [ 21.987224] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3467lb # [ 21.987267] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3468lb # [ 21.987340] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3469lb # [ 21.987376] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3470lb # [ 22.020571] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3471lb # [ 22.023214] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3472lb # [ 22.025568] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3473lb # [ 22.028581] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3474lb # [ 22.030429] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3475lb # [ 22.034075] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3476lb # [ 22.036436] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3477lb # [ 22.039076] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23478lb # [ 22.042942] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3479lb # [ 22.045069] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3480lb # [ 22.048190] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3481lb # [ 22.049985] envoy[916]: [2026-09-20 08:16:19.428][916][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3482lb # [ 22.057335] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3483lb # [ 22.059195] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3484lb # [ 22.065387] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3485lb # [ 22.070462] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3486lb # [ 22.072690] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3487lb # [ 22.078098] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3488lb # [ 22.081708] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3489lb # [ 22.083956] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3490lb # [ 22.086136] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3491lb # [ 22.089784] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3492lb # [ 22.092107] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3493lb # [ 22.093882] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3494lb # [ 22.096030] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23495lb # [ 22.097973] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3496lb # [ 22.101198] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3497lb # [ 22.105842] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3498lb # [ 22.110916] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3499lb # [ 22.116853] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3500lb # [ 22.119138] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3501lb # [ 22.121404] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3502lb # [ 22.130062] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3503lb # [ 22.132388] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3504lb # [ 22.135578] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3505lb # [ 22.137739] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3506lb # [ 22.144196] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3507lb # [ 22.177148] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3508lb # [ 22.186045] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3509lb # [ 22.190372] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3510lb # [ 22.193555] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3511lb # [ 22.195746] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3512lb # [ 22.201128] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3513lb # [ 22.203809] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3514lb # [ 22.206608] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3515lb # [ 22.214336] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3516lb # [ 22.216726] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3517lb # [ 22.218556] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3518lb # [ 22.220484] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3519lb # [ 22.222480] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3520lb # [ 22.226438] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3521lb # [ 22.229754] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3522lb # [ 22.236277] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3523lb # [ 22.238046] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3524lb # [ 22.241339] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3525lb # [ 22.252714] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3526lb # [ 22.254683] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3527lb # [ 22.257564] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3528lb # [ 22.259657] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3529lb # [ 22.263430] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3530lb # [ 22.266269] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3531lb # [ 22.274112] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3532lb # [ 22.280427] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3533lb # [ 22.288857] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3534lb # [ 22.291140] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3535lb # [ 22.293183] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13536lb # [ 22.295722] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3537lb # [ 22.298631] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3538lb # [ 22.301039] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83539lb # [ 22.303154] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3540lb # [ 22.305599] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3541lb # [ 22.309255] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3542lb # [ 22.312889] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3543lb # [ 22.315196] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3544lb # [ 22.318391] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3545lb # [ 22.320489] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3546lb # [ 22.326774] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3547lb # [ 22.342229] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3548lb # [ 22.345582] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23549lb # [ 22.347560] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3550lb # [ 22.350438] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3551lb # [ 22.353621] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3552lb # [ 22.356672] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3553lb # [ 22.361760] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3554lb # [ 22.365694] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3555lb # [ 22.376672] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3556lb # [ 22.380705] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3557lb # [ 22.385011] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3558lb # [ 22.388305] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3559lb # [ 22.390794] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3560lb # [ 22.394031] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3561lb # [ 22.396764] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3562lb # [ 22.402082] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3563lb # [ 22.407524] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3564lb # [ 22.416752] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3565lb # [ 22.420614] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3566lb # [ 22.424333] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3567lb # [ 22.427228] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3568lb # [ 22.433146] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3569lb # [ 22.436567] envoy[916]: [2026-09-20 08:16:19.429][916][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3570lb # [ 22.442507] envoy[916]: [2026-09-20 08:16:19.463][916][info][main] [source/server/server.cc:531] HTTP header map info:3571lb # [ 22.444235] envoy[916]: [2026-09-20 08:16:19.486][916][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3572lb # [ 22.461825] envoy[916]: [2026-09-20 08:16:19.486][916][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3573lb # [ 22.463877] envoy[916]: [2026-09-20 08:16:19.486][916][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3574lb # [ 22.475488] envoy[916]: [2026-09-20 08:16:19.486][916][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3575lb # [ 22.479190] envoy[916]: [2026-09-20 08:16:19.758][916][info][main] [source/server/server.cc:968] runtime: {}3576lb # [ 22.481746] envoy[916]: [2026-09-20 08:16:19.788][916][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3577lb # [ 22.483724] envoy[916]: [2026-09-20 08:16:19.788][916][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013578lb # [ 22.486149] envoy[916]: [2026-09-20 08:16:19.788][916][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013579lb # [ 22.488051] envoy[916]: [2026-09-20 08:16:19.797][916][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3580lb # [ 22.490002] envoy[916]: [2026-09-20 08:16:19.797][916][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3581lb # [ 22.493364] envoy[916]: [2026-09-20 08:16:19.797][916][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3582lb # [ 22.519012] envoy[916]: [2026-09-20 08:16:19.962][916][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3583worker1 # [ 22.462965] systemd[1]: Starting Nix worker-protocol over gRPC...3584worker2 # [ 22.470515] systemd[1]: Starting Nix worker-protocol over gRPC...3585lb # [ 22.538730] envoy[916]: [2026-09-20 08:16:19.982][916][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3586lb # [ 22.542871] envoy[916]: [2026-09-20 08:16:19.985][916][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3587lb # [ 22.546988] envoy[916]: [2026-09-20 08:16:19.985][916][info][main] [source/server/server.cc:1077] starting main dispatch loop3588worker1 # [ 22.757345] nix-grpc-daemon[788]: ts=2026-09-20T08:16:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3589worker1 # [ 22.771110] nix-grpc-daemon[788]: ts=2026-09-20T08:16:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13590worker2 # [ 22.765092] nix-grpc-daemon[774]: ts=2026-09-20T08:16:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3591worker2 # [ 22.778041] nix-grpc-daemon[774]: ts=2026-09-20T08:16:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13592worker1 # [ 22.823699] nix-grpc-daemon[788]: ts=2026-09-20T08:16:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3593worker1 # [ 22.838163] systemd[1]: Started Nix worker-protocol over gRPC.3594worker2 # [ 22.832832] nix-grpc-daemon[774]: ts=2026-09-20T08:16:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3595worker2 # [ 22.834732] systemd[1]: Started Nix worker-protocol over gRPC.3596lb # [ 22.935569] envoy[916]: [2026-09-20 08:16:20.378][916][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3597lb # [ 22.948284] envoy[916]: [2026-09-20 08:16:20.378][916][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3598lb # [ 22.956468] envoy[916]: [2026-09-20 08:16:20.378][916][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3599lb # [ 22.964348] envoy[916]: [2026-09-20 08:16:20.378][916][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3600worker1 # [ 22.914039] nix-grpc-daemon[788]: ts=2026-09-20T08:16:20Z level=info event=scheduler_connected addr=lb:500513601worker2 # [ 22.907004] nix-grpc-daemon[774]: ts=2026-09-20T08:16:20Z level=info event=scheduler_connected addr=lb:500513602worker1 # [ 22.923227] nix-grpc-daemon[788]: ts=2026-09-20T08:16:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3603worker2 # [ 22.920064] nix-grpc-daemon[774]: ts=2026-09-20T08:16:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3604worker1 # [ 23.124882] nix-grpc-daemon[788]: ts=2026-09-20T08:16:20Z level=info event=scheduler_connected addr=lb:500513605worker2 # [ 23.122247] nix-grpc-daemon[774]: ts=2026-09-20T08:16:20Z level=info event=scheduler_connected addr=lb:500513606worker1 # [ 23.133113] nix-grpc-daemon[788]: ts=2026-09-20T08:16:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3607worker2 # [ 23.128465] nix-grpc-daemon[774]: ts=2026-09-20T08:16:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3608worker1 # [ 23.333944] nix-grpc-daemon[788]: ts=2026-09-20T08:16:20Z level=info event=scheduler_connected addr=lb:500513609worker2 # [ 23.330357] nix-grpc-daemon[774]: ts=2026-09-20T08:16:20Z level=info event=scheduler_connected addr=lb:500513610worker1 # [ 23.341195] nix-grpc-daemon[788]: ts=2026-09-20T08:16:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3611worker2 # [ 23.335959] nix-grpc-daemon[774]: ts=2026-09-20T08:16:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3612worker2 # [ 23.536860] nix-grpc-daemon[774]: ts=2026-09-20T08:16:20Z level=info event=scheduler_connected addr=lb:500513613worker1 # [ 23.542464] nix-grpc-daemon[788]: ts=2026-09-20T08:16:20Z level=info event=scheduler_connected addr=lb:500513614worker2 # [ 23.544728] nix-grpc-daemon[774]: ts=2026-09-20T08:16:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3615worker1 # [ 23.551484] nix-grpc-daemon[788]: ts=2026-09-20T08:16:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3616worker2 # [ 23.745900] nix-grpc-daemon[774]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500513617worker1 # [ 23.753402] nix-grpc-daemon[788]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500513618worker2 # [ 23.754220] nix-grpc-daemon[774]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3619worker1 # [ 23.762938] nix-grpc-daemon[788]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3620worker1 # [ 23.962830] nix-grpc-daemon[788]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500513621worker2 # [ 23.958211] nix-grpc-daemon[774]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500513622worker2 # [ 23.965002] nix-grpc-daemon[774]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3623worker1 # [ 23.973538] nix-grpc-daemon[788]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3624worker2 # [ 24.165837] nix-grpc-daemon[774]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500513625worker1 # [ 24.177077] nix-grpc-daemon[788]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500513626worker2 # [ 24.173337] nix-grpc-daemon[774]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3627worker1 # [ 24.183319] nix-grpc-daemon[788]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3628worker1 # [ 24.384450] nix-grpc-daemon[788]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500513629worker2 # [ 24.375086] nix-grpc-daemon[774]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500513630worker1 # [ 24.390565] nix-grpc-daemon[788]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3631worker2 # [ 24.383336] nix-grpc-daemon[774]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3632worker2 # [ 24.584733] nix-grpc-daemon[774]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500513633worker1 # [ 24.592257] nix-grpc-daemon[788]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500513634worker2 # [ 24.590761] nix-grpc-daemon[774]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3635worker1 # [ 24.600189] nix-grpc-daemon[788]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3636worker2 # [ 24.792701] nix-grpc-daemon[774]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500513637worker1 # [ 24.805283] nix-grpc-daemon[788]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500513638worker2 # [ 24.800487] nix-grpc-daemon[774]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3639worker1 # [ 24.811277] nix-grpc-daemon[788]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3640worker1 # [ 25.012985] nix-grpc-daemon[788]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500513641worker2 # [ 25.007028] nix-grpc-daemon[774]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500513642worker2 # [ 25.011551] nix-grpc-daemon[774]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3643worker1 # [ 25.020632] nix-grpc-daemon[788]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3644worker2 # [ 25.207218] nix-grpc-daemon[774]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500513645worker1 # [ 25.222287] nix-grpc-daemon[788]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500513646worker2 # [ 25.215681] nix-grpc-daemon[774]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3647worker1 # [ 25.230636] nix-grpc-daemon[788]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3648worker2 # [ 25.416744] nix-grpc-daemon[774]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500513649worker2 # [ 25.421767] nix-grpc-daemon[774]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3650worker1 # [ 25.432141] nix-grpc-daemon[788]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500513651worker1 # [ 25.440187] nix-grpc-daemon[788]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3652worker2 # [ 25.623727] nix-grpc-daemon[774]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500513653worker2 # [ 25.632313] nix-grpc-daemon[774]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3654worker1 # [ 25.641860] nix-grpc-daemon[788]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500513655worker1 # [ 25.649825] nix-grpc-daemon[788]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3656worker2 # [ 25.833989] nix-grpc-daemon[774]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500513657worker2 # [ 25.842262] nix-grpc-daemon[774]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3658worker1 # [ 25.853200] nix-grpc-daemon[788]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500513659worker1 # [ 25.860850] nix-grpc-daemon[788]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3660worker2 # [ 26.048784] nix-grpc-daemon[774]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500513661worker2 # [ 26.053394] nix-grpc-daemon[774]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3662worker1 # [ 26.062685] nix-grpc-daemon[788]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500513663worker1 # [ 26.071669] nix-grpc-daemon[788]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3664worker2 # [ 26.250026] nix-grpc-daemon[774]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500513665worker2 # [ 26.258213] nix-grpc-daemon[774]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3666worker1 # [ 26.273562] nix-grpc-daemon[788]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500513667worker1 # [ 26.282057] nix-grpc-daemon[788]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3668worker2 # [ 26.460210] nix-grpc-daemon[774]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500513669worker2 # [ 26.468845] nix-grpc-daemon[774]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3670worker1 # [ 26.484127] nix-grpc-daemon[788]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500513671worker1 # [ 26.492300] nix-grpc-daemon[788]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3672worker2 # [ 26.670736] nix-grpc-daemon[774]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500513673worker2 # [ 26.679247] nix-grpc-daemon[774]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3674worker1 # [ 26.693762] nix-grpc-daemon[788]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500513675worker1 # [ 26.702819] nix-grpc-daemon[788]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3676worker2 # [ 26.885519] nix-grpc-daemon[774]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 26.900980] nix-grpc-daemon[774]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3678worker1 # [ 26.910685] nix-grpc-daemon[788]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500513679worker1 # [ 26.916332] nix-grpc-daemon[788]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3680worker2 # [ 27.101061] nix-grpc-daemon[774]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500513681worker1 # [ 27.111368] nix-grpc-daemon[788]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500513682worker2 # [ 27.118954] nix-grpc-daemon[774]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3683worker1 # [ 27.126436] nix-grpc-daemon[788]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3684lb # [ 27.347101] rustfs-bucket-start[987]: mb s3://farm3685lb # [ 27.355996] systemd[1]: Finished rustfs-bucket.service.3686lb # [ 27.366236] systemd[1]: Starting niks3 server...3687worker2 # [ 27.320635] nix-grpc-daemon[774]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500513688worker1 # [ 27.328137] nix-grpc-daemon[788]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 27.328282] nix-grpc-daemon[774]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3690worker1 # [ 27.335731] nix-grpc-daemon[788]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3691worker2 # [ 27.530017] nix-grpc-daemon[774]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500513692worker1 # [ 27.537572] nix-grpc-daemon[788]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500513693worker2 # [ 27.537929] nix-grpc-daemon[774]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3694worker1 # [ 27.546297] nix-grpc-daemon[788]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3695lb # [ 27.663621] postgres[1006]: [1006] ERROR: relation "goose_db_version" does not exist at character 363696lb # [ 27.668310] postgres[1006]: [1006] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3697lb # [ 27.707641] niks3-server[1000]: 2026/09/20 08:16:25 OK 20241026095416_initial_model.sql (26.71ms)3698lb # [ 27.712294] niks3-server[1000]: 2026/09/20 08:16:25 OK 20251210153512_drop_unused_gin_index.sql (5.07ms)3699lb # [ 27.719938] niks3-server[1000]: 2026/09/20 08:16:25 OK 20251218171726_add_pins.sql (7.57ms)3700lb # [ 27.726598] niks3-server[1000]: 2026/09/20 08:16:25 OK 20260628120000_add_object_size_and_stats.sql (6.62ms)3701lb # [ 27.733892] niks3-server[1000]: 2026/09/20 08:16:25 OK 20260905000000_add_claims.sql (7.25ms)3702lb # [ 27.740196] niks3-server[1000]: 2026/09/20 08:16:25 OK 20260920000000_drop_claims.sql (6.08ms)3703lb # [ 27.741612] niks3-server[1000]: 2026/09/20 08:16:25 goose: successfully migrated database to version: 202609200000003704lb # [ 27.748508] niks3-server[1000]: 2026/09/20 08:16:25 OK 1_commit_pending_closure.sql (8.29ms)3705lb # [ 27.751897] niks3-server[1000]: 2026/09/20 08:16:25 OK 2_object_stats_trigger.sql (3.21ms)3706lb # [ 27.753509] niks3-server[1000]: 2026/09/20 08:16:25 goose: up to current file version: 23707lb # [ 27.758231] niks3-server[1000]: 2026/09/20 08:16:25 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3708worker1 # [ 27.746875] nix-grpc-daemon[788]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500513709worker2 # [ 27.739187] nix-grpc-daemon[774]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500513710worker1 # [ 27.752642] nix-grpc-daemon[788]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3711worker2 # [ 27.747194] nix-grpc-daemon[774]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3712lb # [ 27.825368] niks3-server[1000]: 2026/09/20 08:16:25 INFO Read proxy enabled — serving cache objects from S33713lb # [ 27.827297] niks3-server[1000]: 2026/09/20 08:16:25 INFO Using socket-activated listener address=0.0.0.0:57513714lb # [ 27.834510] niks3-server[1000]: 2026/09/20 08:16:25 INFO systemd watchdog enabled interval=15s3715lb # [ 27.841978] niks3-server[1000]: 2026/09/20 08:16:25 INFO Starting HTTP server address=0.0.0.0:57513716lb # [ 27.843519] systemd[1]: Started niks3 server.3717worker2 # [ 27.779393] nix-grpc-daemon[774]: ts=2026-09-20T08:16:25Z level=info event=scheduler_take_over3718lb # [ 27.847487] niks3-server[1000]: 2026/09/20 08:16:25 INFO lead: acquired remote=192.168.1.4:487043719lb # [ 27.852144] systemd[1]: Reached target Multi-User System.3720lb # [ 27.853153] systemd[1]: Startup finished in 1.133s (kernel) + 4.750s (initrd) + 21.956s (userspace) = 27.840s.3721worker1 # [ 27.956424] nix-grpc-daemon[788]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500513722worker2 # [ 27.948821] nix-grpc-daemon[774]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500513723worker2 # [ 27.957039] nix-grpc-daemon[774]: ts=2026-09-20T08:16:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03724worker2 # [ 27.963653] nix-grpc-daemon[774]: ts=2026-09-20T08:16:25Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03725lb: (finished: waiting for unit niks3.service, in 11.86 seconds)3726lb: waiting for TCP port 5751 on localhost3727lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3728lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)3729lb: waiting for unit envoy.service3730lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3731lb: waiting for TCP port 50051 on localhost3732lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3733lb # [ 28.578114] envoy[916]: conn peer=[::1]:58872 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=43734lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3735lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3736??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3737 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283738lb: must succeed: curl -sf localhost:9901/clusters3739lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)3740lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.12 seconds)3741subtest: one node schedules and both builders hold a WorkerSession on it3742lb: must succeed: curl -sf localhost:9901/clusters3743lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3744worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3745worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)3746(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.16 seconds)3747subtest: balancer auth: client cert, bearer token, nothing, unknown CN3748worker2 # [ 29.390313] nix-grpc-daemon[774]: ts=2026-09-20T08:16:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:438783749worker2 # [ 29.420330] systemd[1]: Started Nix Daemon.3750worker2 # [ 29.778045] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3751worker2 # [ 29.818999] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 1/5)3752worker2 # [ 29.835096] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 2/5)3753worker2 # [ 29.920612] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 3/5)3754worker2 # [ 29.985099] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 209 ms (attempt 4/5)3755worker2 # [ 30.200978] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3756worker1 # [ 30.265061] nix-grpc-daemon[788]: ts=2026-09-20T08:16:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:507943757worker1 # [ 30.277991] systemd[1]: Started Nix Daemon.3758worker1 # [ 30.626730] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)3759worker1 # [ 30.666091] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 1/5)3760worker1 # [ 30.694509] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 2/5)3761worker1 # [ 30.845642] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 342 ms (attempt 3/5)3762worker1 # [ 31.197284] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 459 ms (attempt 4/5)3763worker1 # [ 31.666254] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3764worker1 # [ 31.675199] nix-grpc-daemon[788]: ts=2026-09-20T08:16:29Z level=debug event=path_info_miss path=08rrs8i91ayi9z7hmrkavgm4mxank57z-nixos-system-client-test error="error: path '/nix/store/08rrs8i91ayi9z7hmrkavgm4mxank57z-nixos-system-client-test' is required, but there is no substituter that can build it"3765worker1 # [ 31.690038] nix-grpc-daemon[788]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:507943766worker1 # [ 31.701700] nix-grpc-daemon[788]: ts=2026-09-20T08:16:29Z level=debug event=path_info_miss path=08rrs8i91ayi9z7hmrkavgm4mxank57z-nixos-system-client-test error="error: path '/nix/store/08rrs8i91ayi9z7hmrkavgm4mxank57z-nixos-system-client-test' is required, but there is no substituter that can build it"3767client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3768client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds)3769client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3770client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3771worker2 # [ 32.132179] nix-grpc-daemon[774]: ts=2026-09-20T08:16:29Z level=info event=oidc_jwks provider=mock keys=13772worker2 # [ 32.134664] nix-grpc-daemon[774]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:438783773worker1 # [ 32.162933] nix-grpc-daemon[788]: ts=2026-09-20T08:16:29Z level=info event=oidc_jwks provider=mock keys=13774worker1 # [ 32.171738] nix-grpc-daemon[788]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:507943775worker2 # [ 32.179631] nix-grpc-daemon[774]: ts=2026-09-20T08:16:29Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:438783776worker1 # [ 32.180932] nix-grpc-daemon[788]: ts=2026-09-20T08:16:29Z level=debug event=path_info_miss path=08rrs8i91ayi9z7hmrkavgm4mxank57z-nixos-system-client-test error="error: path '/nix/store/08rrs8i91ayi9z7hmrkavgm4mxank57z-nixos-system-client-test' is required, but there is no substituter that can build it"3777worker2 # [ 32.196186] nix-grpc-daemon[774]: ts=2026-09-20T08:16:29Z level=debug event=path_info_miss path=08rrs8i91ayi9z7hmrkavgm4mxank57z-nixos-system-client-test error="error: path '/nix/store/08rrs8i91ayi9z7hmrkavgm4mxank57z-nixos-system-client-test' is required, but there is no substituter that can build it"3778client: must succeed: rm -r /var/lib/nix-grpc-store3779client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)3780lb # [ 32.529169] envoy[916]: conn peer=[2001:db8:1::1]:34630 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=23523781lb # [ 32.534514] envoy[916]: conn peer=[2001:db8:1::1]:45232 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=933782worker2 # [ 32.489767] nix-grpc-daemon[774]: ts=2026-09-20T08:16:29Z level=info event=denied method=QueryMissing cn=- role=none3783worker1 # [ 32.767187] nix-grpc-daemon[788]: ts=2026-09-20T08:16:30Z level=info event=denied method=QueryMissing cn=stranger role=none3784(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.83 seconds)3785subtest: DAG build is scheduled across workers and lands in the cache3786client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&23787worker1 # [ 33.036745] nix-grpc-daemon[788]: ts=2026-09-20T08:16:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:507943788client # don't know how to build these paths:3789client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3790worker2 # [ 33.073522] nix-grpc-daemon[774]: ts=2026-09-20T08:16:30Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03791worker2 # [ 33.077575] nix-grpc-daemon[774]: ts=2026-09-20T08:16:30Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13792worker1 # [ 33.137060] nix-grpc-daemon[788]: ts=2026-09-20T08:16:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507943793worker1 # [ 33.165944] nix-grpc-daemon[788]: ts=2026-09-20T08:16:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507943794client # copying 1 paths to 'lb:50051'...3795worker1 # [ 33.189143] nix-grpc-daemon[788]: ts=2026-09-20T08:16:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:507943796client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3797worker1 # [ 33.227739] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)3798worker1 # [ 33.275796] nix-grpc-daemon[788]: ts=2026-09-20T08:16:30Z level=info event=niks3_push_started pid=8543799worker1 # [ 33.894674] nix-daemon[844]: accepted connection from pid 867, user nix-grpc-daemon (trusted)3800worker1 # [ 33.922480] nix-daemon[844]: reaped child process 870, status = succeeded3801worker1 # [ 34.144174] nix-daemon[844]: accepted connection from pid 872, user nix-grpc-daemon (trusted)3802worker1 # [ 34.167297] nix-daemon[844]: reaped child process 875, status = succeeded3803lb # [ 34.241735] niks3-server[1000]: 2026/09/20 08:16:31 INFO Received uploads request method=POST path=/api/pending_closures3804worker1 # [ 34.223974] nix-grpc-daemon[854]: time=2026-09-20T08:16:31.629Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3805worker1 # [ 34.229527] nix-grpc-daemon[854]: time=2026-09-20T08:16:31.630Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3806lb # [ 34.354839] niks3-server[1000]: 2026/09/20 08:16:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3807lb # [ 34.367349] niks3-server[1000]: 2026/09/20 08:16:31 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3808lb # [ 34.382237] niks3-server[1000]: 2026/09/20 08:16:31 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3809lb # [ 34.407340] niks3-server[1000]: 2026/09/20 08:16:31 INFO Signed narinfos id=1 count=13810worker1 # [ 34.355330] nix-grpc-daemon[854]: time=2026-09-20T08:16:31.762Z level=INFO msg="Uploading 1 narinfos"3811lb # [ 34.434114] niks3-server[1000]: 2026/09/20 08:16:31 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3812lb # [ 34.451717] niks3-server[1000]: 2026/09/20 08:16:31 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3813lb # [ 34.469721] niks3-server[1000]: 2026/09/20 08:16:31 INFO Completed upload id=13814worker1 # [ 34.415715] nix-grpc-daemon[854]: time=2026-09-20T08:16:31.822Z level=INFO msg="Upload complete. (762ms)"3815worker1 # [ 34.429256] nix-grpc-daemon[788]: ts=2026-09-20T08:16:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=1 paths=1 nar_bytes_in=5043816worker1 # [ 34.431982] nix-grpc-daemon[788]: ts=2026-09-20T08:16:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507943817worker1 # [ 34.448407] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)3818worker1 # [ 34.456254] nix-daemon[844]: reaped child process 852, status = succeeded3819client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3820worker1 # [ 34.464785] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)3821client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3822client # farm-a> LOG-farm-a-t13823worker1 # [ 35.927470] nix-daemon[844]: reaped child process 880, status = succeeded3824worker1 # [ 36.167789] nix-daemon[844]: accepted connection from pid 895, user nix-grpc-daemon (trusted)3825worker1 # [ 36.196515] nix-daemon[844]: reaped child process 898, status = succeeded3826lb # [ 36.270889] niks3-server[1000]: 2026/09/20 08:16:33 INFO Received uploads request method=POST path=/api/pending_closures3827worker1 # [ 36.238230] nix-grpc-daemon[854]: time=2026-09-20T08:16:33.643Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3828worker1 # [ 36.241194] nix-grpc-daemon[854]: time=2026-09-20T08:16:33.643Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3829lb # [ 36.376684] niks3-server[1000]: 2026/09/20 08:16:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3830lb # [ 36.396803] niks3-server[1000]: 2026/09/20 08:16:33 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3831lb # [ 36.405089] niks3-server[1000]: 2026/09/20 08:16:33 INFO Signed narinfos id=2 count=13832worker1 # [ 36.350381] nix-grpc-daemon[854]: time=2026-09-20T08:16:33.756Z level=INFO msg="Uploading 1 narinfos"3833lb # [ 36.410059] niks3-server[1000]: 2026/09/20 08:16:33 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3834lb # [ 36.436159] niks3-server[1000]: 2026/09/20 08:16:33 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3835lb # [ 36.449827] niks3-server[1000]: 2026/09/20 08:16:33 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3836lb # [ 36.453667] niks3-server[1000]: 2026/09/20 08:16:33 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3837lb # [ 36.459835] niks3-server[1000]: 2026/09/20 08:16:33 INFO Completed upload id=23838worker1 # [ 36.404332] nix-grpc-daemon[854]: time=2026-09-20T08:16:33.812Z level=INFO msg="Upload complete. (524ms)"3839worker1 # [ 36.422013] nix-grpc-daemon[788]: ts=2026-09-20T08:16:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13840worker2 # [ 36.430374] nix-grpc-daemon[774]: ts=2026-09-20T08:16:33Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03841worker2 # [ 36.431045] nix-grpc-daemon[774]: ts=2026-09-20T08:16:33Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13842worker1 # [ 36.448182] nix-daemon[844]: reaped child process 878, status = succeeded3843worker1 # [ 36.490408] nix-grpc-daemon[788]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507943844worker1 # [ 36.514627] nix-grpc-daemon[788]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507943845worker1 # [ 36.536994] nix-grpc-daemon[854]: time=2026-09-20T08:16:33.945Z level=INFO msg="All 1 paths already cached"3846worker1 # [ 36.545856] nix-grpc-daemon[788]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:507943847client # copying 1 paths to 'lb:50051'...3848client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3849worker1 # [ 36.576412] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)3850worker1 # [ 36.854595] nix-daemon[844]: accepted connection from pid 902, user nix-grpc-daemon (trusted)3851worker1 # [ 36.885297] nix-daemon[844]: reaped child process 905, status = succeeded3852worker1 # [ 37.116962] nix-daemon[844]: accepted connection from pid 907, user nix-grpc-daemon (trusted)3853worker1 # [ 37.144701] nix-daemon[844]: reaped child process 910, status = succeeded3854lb # [ 37.215916] niks3-server[1000]: 2026/09/20 08:16:34 INFO Received uploads request method=POST path=/api/pending_closures3855worker1 # [ 37.173478] nix-grpc-daemon[854]: time=2026-09-20T08:16:34.582Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3856worker1 # [ 37.176152] nix-grpc-daemon[854]: time=2026-09-20T08:16:34.584Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3857lb # [ 37.258100] niks3-server[1000]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3858lb # [ 37.283293] niks3-server[1000]: 2026/09/20 08:16:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3859worker1 # [ 37.234430] nix-grpc-daemon[854]: time=2026-09-20T08:16:34.642Z level=INFO msg="Uploading 1 narinfos"3860lb # [ 37.300712] niks3-server[1000]: 2026/09/20 08:16:34 INFO Signed narinfos id=3 count=13861lb # [ 37.303744] niks3-server[1000]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3862lb # [ 37.322935] niks3-server[1000]: 2026/09/20 08:16:34 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3863lb # [ 37.330602] niks3-server[1000]: 2026/09/20 08:16:34 INFO Completed upload id=33864worker1 # [ 37.275259] nix-grpc-daemon[854]: time=2026-09-20T08:16:34.683Z level=INFO msg="Upload complete. (676ms)"3865lb # [ 37.333880] niks3-server[1000]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3866worker1 # [ 37.280360] nix-grpc-daemon[788]: ts=2026-09-20T08:16:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=0 paths=1 nar_bytes_in=6243867worker1 # [ 37.290718] nix-grpc-daemon[788]: ts=2026-09-20T08:16:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507943868worker1 # [ 37.297996] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)3869worker1 # [ 37.305850] nix-daemon[844]: reaped child process 900, status = succeeded3870worker1 # [ 37.323922] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)3871client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3872client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3873client # farm-b> LOG-farm-b-t13874worker1 # [ 38.406433] nix-daemon[844]: reaped child process 914, status = succeeded3875worker1 # [ 38.683102] nix-daemon[844]: accepted connection from pid 930, user nix-grpc-daemon (trusted)3876worker1 # [ 38.711747] nix-daemon[844]: reaped child process 933, status = succeeded3877lb # [ 38.783720] niks3-server[1000]: 2026/09/20 08:16:36 INFO Received uploads request method=POST path=/api/pending_closures3878worker1 # [ 38.756304] nix-grpc-daemon[854]: time=2026-09-20T08:16:36.163Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3879worker1 # [ 38.758667] nix-grpc-daemon[854]: time=2026-09-20T08:16:36.163Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3880lb # [ 38.845444] niks3-server[1000]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3881lb # [ 38.868585] niks3-server[1000]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3882lb # [ 38.887279] niks3-server[1000]: 2026/09/20 08:16:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3883worker1 # [ 38.837988] nix-grpc-daemon[854]: time=2026-09-20T08:16:36.245Z level=INFO msg="Uploading 1 narinfos"3884lb # [ 38.898000] niks3-server[1000]: 2026/09/20 08:16:36 INFO Signed narinfos id=4 count=13885lb # [ 38.904278] niks3-server[1000]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3886lb # [ 38.920600] niks3-server[1000]: 2026/09/20 08:16:36 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3887lb # [ 38.931107] niks3-server[1000]: 2026/09/20 08:16:36 INFO Completed upload id=43888worker1 # [ 38.875595] nix-grpc-daemon[854]: time=2026-09-20T08:16:36.284Z level=INFO msg="Upload complete. (533ms)"3889lb # [ 38.934127] niks3-server[1000]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3890worker1 # [ 38.894310] nix-grpc-daemon[788]: ts=2026-09-20T08:16:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13891worker2 # [ 38.894337] nix-grpc-daemon[774]: ts=2026-09-20T08:16:36Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03892worker2 # [ 38.895022] nix-grpc-daemon[774]: ts=2026-09-20T08:16:36Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13893worker1 # [ 38.921669] nix-daemon[844]: reaped child process 912, status = succeeded3894worker1 # [ 38.951159] nix-grpc-daemon[788]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507943895worker1 # [ 38.977180] nix-grpc-daemon[788]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507943896worker1 # [ 39.001651] nix-grpc-daemon[854]: time=2026-09-20T08:16:36.410Z level=INFO msg="All 2 paths already cached"3897client # copying 1 paths to 'lb:50051'...3898worker1 # [ 39.014523] nix-grpc-daemon[788]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:507943899client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3900worker1 # [ 39.037075] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)3901worker1 # [ 39.311020] nix-daemon[844]: accepted connection from pid 937, user nix-grpc-daemon (trusted)3902worker1 # [ 39.333270] nix-daemon[844]: reaped child process 940, status = succeeded3903worker1 # [ 39.563072] nix-daemon[844]: accepted connection from pid 942, user nix-grpc-daemon (trusted)3904worker1 # [ 39.591000] nix-daemon[844]: reaped child process 945, status = succeeded3905lb # [ 39.661267] niks3-server[1000]: 2026/09/20 08:16:37 INFO Received uploads request method=POST path=/api/pending_closures3906worker1 # [ 39.624825] nix-grpc-daemon[854]: time=2026-09-20T08:16:37.032Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3907worker1 # [ 39.626817] nix-grpc-daemon[854]: time=2026-09-20T08:16:37.032Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3908lb # [ 39.716640] niks3-server[1000]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3909worker1 # [ 39.675610] nix-grpc-daemon[854]: time=2026-09-20T08:16:37.083Z level=INFO msg="Uploading 1 narinfos"3910lb # [ 39.731347] niks3-server[1000]: 2026/09/20 08:16:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3911lb # [ 39.738171] niks3-server[1000]: 2026/09/20 08:16:37 INFO Signed narinfos id=5 count=13912lb # [ 39.745233] niks3-server[1000]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3913lb # [ 39.771905] niks3-server[1000]: 2026/09/20 08:16:37 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3914worker1 # [ 39.722343] nix-grpc-daemon[854]: time=2026-09-20T08:16:37.130Z level=INFO msg="Upload complete. (660ms)"3915lb # [ 39.780787] niks3-server[1000]: 2026/09/20 08:16:37 INFO Completed upload id=53916worker1 # [ 39.728361] nix-grpc-daemon[788]: ts=2026-09-20T08:16:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=0 paths=1 nar_bytes_in=7523917lb # [ 39.786555] niks3-server[1000]: 2026/09/20 08:16:37 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3918worker1 # [ 39.736821] nix-grpc-daemon[788]: ts=2026-09-20T08:16:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507943919worker1 # [ 39.747789] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)3920worker1 # [ 39.753519] nix-daemon[844]: reaped child process 935, status = succeeded3921client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3922worker1 # [ 39.767458] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)3923client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3924client # farm-top> LOG-farm-top-t13925worker1 # [ 41.397038] nix-daemon[844]: reaped child process 949, status = succeeded3926worker1 # [ 41.614194] nix-daemon[844]: accepted connection from pid 965, user nix-grpc-daemon (trusted)3927worker1 # [ 41.643927] nix-daemon[844]: reaped child process 968, status = succeeded3928lb # [ 41.713217] niks3-server[1000]: 2026/09/20 08:16:39 INFO Received uploads request method=POST path=/api/pending_closures3929worker1 # [ 41.674230] nix-grpc-daemon[854]: time=2026-09-20T08:16:39.082Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3930worker1 # [ 41.678750] nix-grpc-daemon[854]: time=2026-09-20T08:16:39.084Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3931lb # [ 41.778481] niks3-server[1000]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3932worker1 # [ 41.744088] nix-grpc-daemon[854]: time=2026-09-20T08:16:39.151Z level=INFO msg="Uploading 1 narinfos"3933lb # [ 41.794764] niks3-server[1000]: 2026/09/20 08:16:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3934lb # [ 41.805009] niks3-server[1000]: 2026/09/20 08:16:39 INFO Signed narinfos id=6 count=13935lb # [ 41.807010] niks3-server[1000]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3936lb # [ 41.815914] niks3-server[1000]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3937lb # [ 41.822860] niks3-server[1000]: 2026/09/20 08:16:39 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3938worker1 # [ 41.774294] nix-grpc-daemon[854]: time=2026-09-20T08:16:39.182Z level=INFO msg="Upload complete. (395ms)"3939lb # [ 41.830896] niks3-server[1000]: 2026/09/20 08:16:39 INFO Completed upload id=63940lb # [ 41.833856] niks3-server[1000]: 2026/09/20 08:16:39 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3941worker1 # [ 41.785823] nix-grpc-daemon[788]: ts=2026-09-20T08:16:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13942worker1 # [ 41.809406] nix-daemon[844]: reaped child process 947, status = succeeded3943client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 9.06 seconds)3944client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath3945client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.30 seconds)3946client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3947client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds)3948client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3949lb # [ 42.529443] envoy[916]: conn peer=[2001:db8:1::1]:45244 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=193950lb # [ 42.531223] envoy[916]: conn peer=[2001:db8:1::1]:45260 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=203951lb # [ 42.532944] envoy[916]: conn peer=[2001:db8:1::1]:45276 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9427 tx=3835 ms=87813952client # copying 3 paths...3953client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3954client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3955client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3956client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.40 seconds)3957(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 9.93 seconds)3958subtest: repeat is answered Cached by the scheduler without building3959worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3960worker1 # finding garbage collector roots...3961worker1 # deleting specified paths...3962worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3963worker1 # deleting unused links...3964worker1 # note: hard linking is currently saving 0.0 KiB3965worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.36 seconds)3966worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3967worker2 # finding garbage collector roots...3968worker2 # deleting specified paths...3969worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3970worker2 # deleting unused links...3971worker2 # note: hard linking is currently saving 0.0 KiB3972worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.38 seconds)3973client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&23974worker1 # [ 43.775413] nix-grpc-daemon[788]: ts=2026-09-20T08:16:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:507943975client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):3976client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3977worker2 # [ 43.823247] nix-grpc-daemon[774]: ts=2026-09-20T08:16:41Z level=debug event=want client=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=13978worker2 # [ 43.842505] nix-grpc-daemon[774]: ts=2026-09-20T08:16:41Z level=debug event=want client=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=13979worker2 # [ 43.862786] nix-grpc-daemon[774]: ts=2026-09-20T08:16:41Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=13980client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 0.45 seconds)3981client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath3982client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.29 seconds)3983lb: must succeed: curl -sf localhost:9901/clusters3984lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)3985lb: must succeed: curl -sf localhost:9901/clusters3986lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)3987worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true3988worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.12 seconds)3989(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.93 seconds)3990subtest: two clients wanting the same drv build it once3991client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup3992client # [ 44.739585] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.3993client # Running as unit: dedup1.service; invocation ID: 1fc24f3364374c6fa91b63c709772f473994client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.13 seconds)3995client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup3996worker1 # [ 45.078151] nix-grpc-daemon[788]: ts=2026-09-20T08:16:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:507943997client # [ 45.064841] nix[864]: don't know how to build these paths:3998client # [ 45.065944] nix[864]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv3999worker2 # [ 45.107275] nix-grpc-daemon[774]: ts=2026-09-20T08:16:42Z level=debug event=want client=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04000worker2 # [ 45.107919] nix-grpc-daemon[774]: ts=2026-09-20T08:16:42Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14001worker2 # [ 45.125445] nix-grpc-daemon[774]: ts=2026-09-20T08:16:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438784002worker2 # [ 45.155568] nix-grpc-daemon[774]: ts=2026-09-20T08:16:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438784003client # [ 45.158385] nix[864]: copying 1 paths to 'lb:50051'...4004worker2 # [ 45.175711] nix-grpc-daemon[774]: ts=2026-09-20T08:16:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:438784005client # [ 45.164516] nix[864]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4006worker2 # [ 45.204410] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4007worker2 # [ 45.242467] nix-grpc-daemon[774]: ts=2026-09-20T08:16:42Z level=info event=niks3_push_started pid=8824008worker2 # [ 45.784466] nix-daemon[835]: accepted connection from pid 895, user nix-grpc-daemon (trusted)4009worker2 # [ 45.810861] nix-daemon[835]: reaped child process 898, status = succeeded4010client # [ 45.893873] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4011client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.16 seconds)4012worker2 # [ 46.027355] nix-daemon[835]: accepted connection from pid 900, user nix-grpc-daemon (trusted)4013worker2 # [ 46.049289] nix-daemon[835]: reaped child process 903, status = succeeded4014lb # [ 46.127534] niks3-server[1000]: 2026/09/20 08:16:43 INFO Received uploads request method=POST path=/api/pending_closures4015worker2 # [ 46.083828] nix-grpc-daemon[882]: time=2026-09-20T08:16:43.519Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4016worker2 # [ 46.088351] nix-grpc-daemon[882]: time=2026-09-20T08:16:43.520Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4017lb # [ 46.181352] niks3-server[1000]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4018lb # [ 46.199667] niks3-server[1000]: 2026/09/20 08:16:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4019worker2 # [ 46.142926] nix-grpc-daemon[882]: time=2026-09-20T08:16:43.581Z level=INFO msg="Uploading 1 narinfos"4020lb # [ 46.210848] niks3-server[1000]: 2026/09/20 08:16:43 INFO Signed narinfos id=7 count=14021lb # [ 46.220307] niks3-server[1000]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4022lb # [ 46.240301] niks3-server[1000]: 2026/09/20 08:16:43 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4023lb # [ 46.247942] niks3-server[1000]: 2026/09/20 08:16:43 INFO Completed upload id=74024worker2 # [ 46.184917] nix-grpc-daemon[882]: time=2026-09-20T08:16:43.623Z level=INFO msg="Upload complete. (620ms)"4025lb # [ 46.250799] niks3-server[1000]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4026worker2 # [ 46.192623] nix-grpc-daemon[774]: ts=2026-09-20T08:16:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43878 duration_s=1 paths=1 nar_bytes_in=4324027worker2 # [ 46.201102] nix-grpc-daemon[774]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438784028worker2 # [ 46.210422] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4029worker2 # [ 46.214654] nix-daemon[835]: reaped child process 880, status = succeeded4030client # Running as unit: dedup2.service; invocation ID: 6ead849bf9fe4a01bccc4895ed341a9c4031client # [ 46.207963] nix[864]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4032worker2 # [ 46.227118] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4033client # [ 46.303863] nix[879]: don't know how to build these paths:4034worker1 # [ 46.326528] nix-grpc-daemon[788]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:507944035client # [ 46.306094] nix[879]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4036worker2 # [ 46.335513] nix-grpc-daemon[774]: ts=2026-09-20T08:16:43Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04037worker2 # [ 46.347442] nix-grpc-daemon[774]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438784038client # [ 46.339363] nix[879]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4039client: must succeed: sleep 24040client: (finished: must succeed: sleep 2, in 2.07 seconds)4041??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4042 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394043client: waiting for success: ! systemctl is-active dedup1 dedup24044??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4045 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394046worker2 # [ 50.868374] nix-daemon[835]: reaped child process 911, status = succeeded4047worker2 # [ 51.047115] nix-daemon[835]: accepted connection from pid 943, user nix-grpc-daemon (trusted)4048worker2 # [ 51.067485] nix-daemon[835]: reaped child process 946, status = succeeded4049lb # [ 51.146310] niks3-server[1000]: 2026/09/20 08:16:48 INFO Received uploads request method=POST path=/api/pending_closures4050worker2 # [ 51.095131] nix-grpc-daemon[882]: time=2026-09-20T08:16:48.532Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4051worker2 # [ 51.098476] nix-grpc-daemon[882]: time=2026-09-20T08:16:48.532Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4052lb # [ 51.199118] niks3-server[1000]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4053lb # [ 51.211034] niks3-server[1000]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4054worker2 # [ 51.160221] nix-grpc-daemon[882]: time=2026-09-20T08:16:48.597Z level=INFO msg="Uploading 1 narinfos"4055lb # [ 51.223809] niks3-server[1000]: 2026/09/20 08:16:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4056lb # [ 51.232460] niks3-server[1000]: 2026/09/20 08:16:48 INFO Signed narinfos id=8 count=14057lb # [ 51.234706] niks3-server[1000]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4058lb # [ 51.246686] niks3-server[1000]: 2026/09/20 08:16:48 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4059lb # [ 51.254498] niks3-server[1000]: 2026/09/20 08:16:48 INFO Completed upload id=84060worker2 # [ 51.190563] nix-grpc-daemon[882]: time=2026-09-20T08:16:48.629Z level=INFO msg="Upload complete. (350ms)"4061lb # [ 51.257980] niks3-server[1000]: 2026/09/20 08:16:48 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4062worker2 # [ 51.205288] nix-grpc-daemon[774]: ts=2026-09-20T08:16:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43878 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14063worker2 # [ 51.224381] nix-grpc-daemon[774]: ts=2026-09-20T08:16:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43878 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14064worker2 # [ 51.233860] nix-daemon[835]: reaped child process 909, status = succeeded4065client # [ 51.238694] systemd[1]: dedup2.service: Deactivated successfully.4066client # [ 51.247698] systemd[1]: dedup2.service: Consumed 227ms CPU time over 5.353s wall clock time, 31M memory peak, 7.2K incoming IP traffic, 6.3K outgoing IP traffic.4067client # [ 51.287952] systemd[1]: dedup1.service: Deactivated successfully.4068client # [ 51.290599] systemd[1]: dedup1.service: Consumed 208ms CPU time over 6.551s wall clock time, 37.1M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.4069client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.16 seconds)4070client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4071client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4072worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4073worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4074worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4075worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4076worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4077worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.10 seconds)4078worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4079worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4080(finished: subtest: two clients wanting the same drv build it once, in 7.66 seconds)4081subtest: build hook: nix-daemon with builders = grpc://lb4082client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log4083lb # [ 52.530488] envoy[916]: conn peer=[2001:db8:1::1]:34966 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1162 tx=481 ms=1234084lb # [ 52.533488] envoy[916]: conn peer=[2001:db8:1::1]:34978 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=49084085lb # [ 52.536069] envoy[916]: conn peer=[2001:db8:1::1]:34970 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1375 ms=61964086client # [ 52.550973] systemd[1]: Started Nix Daemon.4087client # [ 52.758432] nix-daemon[921]: accepted connection from pid 918, user root (trusted)4088worker2 # [ 53.004311] nix-grpc-daemon[774]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:438784089worker2 # [ 53.012512] nix-grpc-daemon[774]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438784090worker2 # [ 53.031541] nix-grpc-daemon[774]: ts=2026-09-20T08:16:50Z level=debug event=want client=5 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04091worker2 # [ 53.038390] nix-grpc-daemon[774]: ts=2026-09-20T08:16:50Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14092worker1 # [ 53.087739] nix-grpc-daemon[788]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507944093worker1 # [ 53.107339] nix-grpc-daemon[788]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507944094worker1 # [ 53.124587] nix-grpc-daemon[788]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:507944095worker1 # [ 53.146037] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4096worker1 # [ 53.374641] nix-daemon[844]: accepted connection from pid 1014, user nix-grpc-daemon (trusted)4097worker1 # [ 53.397502] nix-daemon[844]: reaped child process 1017, status = succeeded4098worker1 # [ 53.584437] nix-daemon[844]: accepted connection from pid 1019, user nix-grpc-daemon (trusted)4099worker1 # [ 53.606101] nix-daemon[844]: reaped child process 1022, status = succeeded4100lb # [ 53.675414] niks3-server[1000]: 2026/09/20 08:16:51 INFO Received uploads request method=POST path=/api/pending_closures4101worker1 # [ 53.630471] nix-grpc-daemon[854]: time=2026-09-20T08:16:51.038Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4102worker1 # [ 53.632175] nix-grpc-daemon[854]: time=2026-09-20T08:16:51.038Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4103lb # [ 53.710461] niks3-server[1000]: 2026/09/20 08:16:51 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4104lb # [ 53.723910] niks3-server[1000]: 2026/09/20 08:16:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4105worker1 # [ 53.674549] nix-grpc-daemon[854]: time=2026-09-20T08:16:51.082Z level=INFO msg="Uploading 1 narinfos"4106lb # [ 53.740409] niks3-server[1000]: 2026/09/20 08:16:51 INFO Signed narinfos id=9 count=14107lb # [ 53.753200] niks3-server[1000]: 2026/09/20 08:16:51 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4108lb # [ 53.765489] niks3-server[1000]: 2026/09/20 08:16:51 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4109worker1 # [ 53.714264] nix-grpc-daemon[854]: time=2026-09-20T08:16:51.122Z level=INFO msg="Upload complete. (548ms)"4110lb # [ 53.773617] niks3-server[1000]: 2026/09/20 08:16:51 INFO Completed upload id=94111lb # [ 53.777710] niks3-server[1000]: 2026/09/20 08:16:51 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4112worker1 # [ 53.724369] nix-grpc-daemon[788]: ts=2026-09-20T08:16:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=0 paths=1 nar_bytes_in=5124113worker1 # [ 53.740460] nix-grpc-daemon[788]: ts=2026-09-20T08:16:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507944114worker1 # [ 53.748621] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4115worker1 # [ 53.754421] nix-daemon[844]: reaped child process 1012, status = succeeded4116worker1 # [ 53.767587] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4117worker1 # [ 54.797202] nix-daemon[844]: reaped child process 1026, status = succeeded4118worker1 # [ 54.964671] nix-daemon[844]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)4119worker1 # [ 54.986409] nix-daemon[844]: reaped child process 1044, status = succeeded4120lb # [ 55.054816] niks3-server[1000]: 2026/09/20 08:16:52 INFO Received uploads request method=POST path=/api/pending_closures4121worker1 # [ 55.012469] nix-grpc-daemon[854]: time=2026-09-20T08:16:52.419Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4122worker1 # [ 55.014116] nix-grpc-daemon[854]: time=2026-09-20T08:16:52.420Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4123lb # [ 55.103649] niks3-server[1000]: 2026/09/20 08:16:52 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4124lb # [ 55.114817] niks3-server[1000]: 2026/09/20 08:16:52 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4125lb # [ 55.129166] niks3-server[1000]: 2026/09/20 08:16:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4126worker1 # [ 55.080332] nix-grpc-daemon[854]: time=2026-09-20T08:16:52.488Z level=INFO msg="Uploading 1 narinfos"4127lb # [ 55.138069] niks3-server[1000]: 2026/09/20 08:16:52 INFO Signed narinfos id=10 count=14128lb # [ 55.144473] niks3-server[1000]: 2026/09/20 08:16:52 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4129lb # [ 55.156185] niks3-server[1000]: 2026/09/20 08:16:52 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4130lb # [ 55.164372] niks3-server[1000]: 2026/09/20 08:16:52 INFO Completed upload id=104131worker1 # [ 55.108690] nix-grpc-daemon[854]: time=2026-09-20T08:16:52.517Z level=INFO msg="Upload complete. (326ms)"4132lb # [ 55.168654] niks3-server[1000]: 2026/09/20 08:16:52 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4133worker2 # [ 55.122244] nix-grpc-daemon[774]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:438784134worker1 # [ 55.121266] nix-grpc-daemon[788]: ts=2026-09-20T08:16:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=5 outputs=14135worker1 # [ 55.137163] nix-daemon[844]: reaped child process 1024, status = succeeded4136worker2 # [ 55.136536] nix-grpc-daemon[774]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4137worker1 # [ 55.193480] nix-grpc-daemon[788]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:507944138worker1 # [ 55.202274] nix-grpc-daemon[788]: ts=2026-09-20T08:16:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=0 paths=1 nar_bytes_out=1284139worker2 # [ 55.467918] nix-grpc-daemon[774]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:438784140worker1 # [ 55.481165] nix-grpc-daemon[788]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507944141worker1 # [ 55.494131] nix-grpc-daemon[854]: time=2026-09-20T08:16:52.902Z level=INFO msg="All 1 paths already cached"4142worker2 # [ 55.508968] nix-grpc-daemon[774]: ts=2026-09-20T08:16:52Z level=debug event=want client=6 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04143worker2 # [ 55.515563] nix-grpc-daemon[774]: ts=2026-09-20T08:16:52Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14144worker1 # [ 55.527040] nix-grpc-daemon[788]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507944145worker1 # [ 55.544649] nix-grpc-daemon[788]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507944146worker1 # [ 55.560891] nix-grpc-daemon[854]: time=2026-09-20T08:16:52.969Z level=INFO msg="All 1 paths already cached"4147worker1 # [ 55.571810] nix-grpc-daemon[788]: ts=2026-09-20T08:16:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:507944148worker1 # [ 55.586482] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4149worker1 # [ 55.814019] nix-daemon[844]: accepted connection from pid 1048, user nix-grpc-daemon (trusted)4150worker1 # [ 55.837590] nix-daemon[844]: reaped child process 1051, status = succeeded4151worker1 # [ 56.021196] nix-daemon[844]: accepted connection from pid 1053, user nix-grpc-daemon (trusted)4152worker1 # [ 56.041641] nix-daemon[844]: reaped child process 1056, status = succeeded4153lb # [ 56.113810] niks3-server[1000]: 2026/09/20 08:16:53 INFO Received uploads request method=POST path=/api/pending_closures4154worker1 # [ 56.070335] nix-grpc-daemon[854]: time=2026-09-20T08:16:53.478Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4155worker1 # [ 56.071915] nix-grpc-daemon[854]: time=2026-09-20T08:16:53.478Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4156lb # [ 56.151403] niks3-server[1000]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4157worker1 # [ 56.114084] nix-grpc-daemon[854]: time=2026-09-20T08:16:53.522Z level=INFO msg="Uploading 1 narinfos"4158lb # [ 56.165595] niks3-server[1000]: 2026/09/20 08:16:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4159lb # [ 56.175358] niks3-server[1000]: 2026/09/20 08:16:53 INFO Signed narinfos id=11 count=14160lb # [ 56.181972] niks3-server[1000]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4161lb # [ 56.193889] niks3-server[1000]: 2026/09/20 08:16:53 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4162worker1 # [ 56.142771] nix-grpc-daemon[854]: time=2026-09-20T08:16:53.551Z level=INFO msg="Upload complete. (538ms)"4163lb # [ 56.200908] niks3-server[1000]: 2026/09/20 08:16:53 INFO Completed upload id=114164lb # [ 56.204289] niks3-server[1000]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4165worker1 # [ 56.154084] nix-grpc-daemon[788]: ts=2026-09-20T08:16:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=0 paths=1 nar_bytes_in=6244166worker1 # [ 56.168304] nix-grpc-daemon[788]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507944167worker1 # [ 56.174530] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4168worker1 # [ 56.179771] nix-daemon[844]: reaped child process 1046, status = succeeded4169worker1 # [ 56.195264] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4170worker1 # [ 57.242691] nix-daemon[844]: reaped child process 1060, status = succeeded4171worker1 # [ 57.429208] nix-daemon[844]: accepted connection from pid 1075, user nix-grpc-daemon (trusted)4172worker1 # [ 57.450391] nix-daemon[844]: reaped child process 1078, status = succeeded4173lb # [ 57.526026] niks3-server[1000]: 2026/09/20 08:16:54 INFO Received uploads request method=POST path=/api/pending_closures4174worker1 # [ 57.480468] nix-grpc-daemon[854]: time=2026-09-20T08:16:54.887Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4175worker1 # [ 57.482063] nix-grpc-daemon[854]: time=2026-09-20T08:16:54.887Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4176lb # [ 57.572911] niks3-server[1000]: 2026/09/20 08:16:55 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4177worker1 # [ 57.530531] nix-grpc-daemon[854]: time=2026-09-20T08:16:54.938Z level=INFO msg="Uploading 1 narinfos"4178lb # [ 57.590386] niks3-server[1000]: 2026/09/20 08:16:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4179lb # [ 57.598300] niks3-server[1000]: 2026/09/20 08:16:55 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4180lb # [ 57.602553] niks3-server[1000]: 2026/09/20 08:16:55 INFO Signed narinfos id=12 count=14181lb # [ 57.609374] niks3-server[1000]: 2026/09/20 08:16:55 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4182lb # [ 57.613555] niks3-server[1000]: 2026/09/20 08:16:55 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4183worker1 # [ 57.556956] nix-grpc-daemon[854]: time=2026-09-20T08:16:54.965Z level=INFO msg="Upload complete. (348ms)"4184lb # [ 57.617054] niks3-server[1000]: 2026/09/20 08:16:55 INFO Completed upload id=124185lb # [ 57.619805] niks3-server[1000]: 2026/09/20 08:16:55 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4186worker1 # [ 57.569093] nix-grpc-daemon[788]: ts=2026-09-20T08:16:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=6 outputs=14187worker1 # [ 57.585540] nix-grpc-daemon[788]: ts=2026-09-20T08:16:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:507944188worker1 # [ 57.590662] nix-daemon[844]: reaped child process 1058, status = succeeded4189worker1 # [ 57.616140] nix-grpc-daemon[788]: ts=2026-09-20T08:16:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:507944190worker1 # [ 57.622098] nix-grpc-daemon[788]: ts=2026-09-20T08:16:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=0 paths=1 nar_bytes_out=1764191worker2 # [ 57.934545] nix-grpc-daemon[774]: ts=2026-09-20T08:16:55Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:438784192worker2 # [ 57.942603] nix-grpc-daemon[774]: ts=2026-09-20T08:16:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438784193worker2 # [ 57.961604] nix-grpc-daemon[882]: time=2026-09-20T08:16:55.399Z level=INFO msg="All 1 paths already cached"4194worker2 # [ 57.984337] nix-grpc-daemon[774]: ts=2026-09-20T08:16:55Z level=debug event=want client=7 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04195worker2 # [ 57.991067] nix-grpc-daemon[774]: ts=2026-09-20T08:16:55Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14196worker1 # [ 58.002875] nix-grpc-daemon[788]: ts=2026-09-20T08:16:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507944197worker1 # [ 58.021384] nix-grpc-daemon[788]: ts=2026-09-20T08:16:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507944198worker1 # [ 58.037751] nix-grpc-daemon[854]: time=2026-09-20T08:16:55.446Z level=INFO msg="All 2 paths already cached"4199worker1 # [ 58.048140] nix-grpc-daemon[788]: ts=2026-09-20T08:16:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:507944200worker1 # [ 58.056653] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4201worker1 # [ 58.250995] nix-daemon[844]: accepted connection from pid 1082, user nix-grpc-daemon (trusted)4202worker1 # [ 58.274389] nix-daemon[844]: reaped child process 1085, status = succeeded4203worker1 # [ 58.447627] nix-daemon[844]: accepted connection from pid 1087, user nix-grpc-daemon (trusted)4204worker1 # [ 58.466321] nix-daemon[844]: reaped child process 1090, status = succeeded4205lb # [ 58.535849] niks3-server[1000]: 2026/09/20 08:16:55 INFO Received uploads request method=POST path=/api/pending_closures4206worker1 # [ 58.491103] nix-grpc-daemon[854]: time=2026-09-20T08:16:55.899Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4207worker1 # [ 58.492850] nix-grpc-daemon[854]: time=2026-09-20T08:16:55.899Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4208lb # [ 58.565574] niks3-server[1000]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4209lb # [ 58.581045] niks3-server[1000]: 2026/09/20 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4210worker1 # [ 58.531032] nix-grpc-daemon[854]: time=2026-09-20T08:16:55.939Z level=INFO msg="Uploading 1 narinfos"4211lb # [ 58.594376] niks3-server[1000]: 2026/09/20 08:16:56 INFO Signed narinfos id=13 count=14212lb # [ 58.601363] niks3-server[1000]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4213lb # [ 58.609608] niks3-server[1000]: 2026/09/20 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4214worker1 # [ 58.561612] nix-grpc-daemon[854]: time=2026-09-20T08:16:55.970Z level=INFO msg="Upload complete. (494ms)"4215lb # [ 58.617708] niks3-server[1000]: 2026/09/20 08:16:56 INFO Completed upload id=134216lb # [ 58.621307] niks3-server[1000]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4217worker1 # [ 58.568139] nix-grpc-daemon[788]: ts=2026-09-20T08:16:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=0 paths=1 nar_bytes_in=7524218worker1 # [ 58.576496] nix-grpc-daemon[788]: ts=2026-09-20T08:16:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507944219worker1 # [ 58.582628] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4220worker1 # [ 58.583887] nix-daemon[844]: reaped child process 1080, status = succeeded4221worker1 # [ 58.592145] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4222worker1 # [ 60.017930] nix-daemon[844]: reaped child process 1094, status = succeeded4223worker1 # [ 60.191020] nix-daemon[844]: accepted connection from pid 1109, user nix-grpc-daemon (trusted)4224worker1 # [ 60.213850] nix-daemon[844]: reaped child process 1112, status = succeeded4225lb # [ 60.283183] niks3-server[1000]: 2026/09/20 08:16:57 INFO Received uploads request method=POST path=/api/pending_closures4226worker1 # [ 60.236067] nix-grpc-daemon[854]: time=2026-09-20T08:16:57.641Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4227worker1 # [ 60.237724] nix-grpc-daemon[854]: time=2026-09-20T08:16:57.641Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4228lb # [ 60.319245] niks3-server[1000]: 2026/09/20 08:16:57 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4229worker1 # [ 60.287678] nix-grpc-daemon[854]: time=2026-09-20T08:16:57.696Z level=INFO msg="Uploading 1 narinfos"4230lb # [ 60.338142] niks3-server[1000]: 2026/09/20 08:16:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4231lb # [ 60.348628] niks3-server[1000]: 2026/09/20 08:16:57 INFO Signed narinfos id=14 count=14232lb # [ 60.356457] niks3-server[1000]: 2026/09/20 08:16:57 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4233lb # [ 60.368723] niks3-server[1000]: 2026/09/20 08:16:57 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4234worker1 # [ 60.316845] nix-grpc-daemon[854]: time=2026-09-20T08:16:57.725Z level=INFO msg="Upload complete. (314ms)"4235lb # [ 60.374780] niks3-server[1000]: 2026/09/20 08:16:57 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4236lb # [ 60.379694] niks3-server[1000]: 2026/09/20 08:16:57 INFO Completed upload id=144237worker1 # [ 60.323674] nix-grpc-daemon[788]: ts=2026-09-20T08:16:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=7 outputs=14238lb # [ 60.382225] niks3-server[1000]: 2026/09/20 08:16:57 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4239worker1 # [ 60.332488] nix-daemon[844]: reaped child process 1092, status = succeeded4240worker2 # [ 60.366232] nix-grpc-daemon[774]: ts=2026-09-20T08:16:57Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:438784241worker2 # [ 60.380195] nix-grpc-daemon[774]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4242worker2 # [ 60.393490] nix-grpc-daemon[774]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4243worker2 # [ 60.429999] nix-grpc-daemon[774]: ts=2026-09-20T08:16:57Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:438784244worker2 # [ 60.437310] nix-grpc-daemon[774]: ts=2026-09-20T08:16:57Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43878 duration_s=0 paths=1 nar_bytes_out=2324245client # [ 60.558513] nix-daemon[921]: reaped child process 923, status = succeeded4246client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.27 seconds)4247client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4248client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4249client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4250client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4251client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4252client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4253(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.40 seconds)4254subtest: an input only one worker has still reaches the builder4255client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4256client # this derivation will be built:4257client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4258client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4259client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.47 seconds)4260client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4261client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.22 seconds)4262worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4263worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.23 seconds)4264worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4265worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds)4266client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24267client # [ 61.883631] nix-daemon[921]: accepted connection from pid 1001, user root (trusted)4268client # this derivation will be built:4269client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4270worker2 # [ 62.105274] nix-grpc-daemon[774]: ts=2026-09-20T08:16:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:438784271client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4272worker1 # [ 62.125687] nix-grpc-daemon[788]: ts=2026-09-20T08:16:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507944273worker1 # [ 62.339314] nix-daemon[844]: accepted connection from pid 1119, user nix-grpc-daemon (trusted)4274worker1 # [ 62.360590] nix-daemon[844]: reaped child process 1122, status = succeeded4275lb # [ 62.430489] niks3-server[1000]: 2026/09/20 08:16:59 INFO Received uploads request method=POST path=/api/pending_closures4276worker1 # [ 62.386460] nix-grpc-daemon[854]: time=2026-09-20T08:16:59.794Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4277worker1 # [ 62.389088] nix-grpc-daemon[854]: time=2026-09-20T08:16:59.794Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4278lb # [ 62.469105] niks3-server[1000]: 2026/09/20 08:16:59 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4279lb # [ 62.487968] niks3-server[1000]: 2026/09/20 08:16:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4280worker1 # [ 62.440226] nix-grpc-daemon[854]: time=2026-09-20T08:16:59.848Z level=INFO msg="Uploading 1 narinfos"4281lb # [ 62.499619] niks3-server[1000]: 2026/09/20 08:16:59 INFO Signed narinfos id=15 count=14282lb # [ 62.508625] niks3-server[1000]: 2026/09/20 08:16:59 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4283lb # [ 62.520841] niks3-server[1000]: 2026/09/20 08:16:59 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4284worker1 # [ 62.475262] nix-grpc-daemon[854]: time=2026-09-20T08:16:59.883Z level=INFO msg="Upload complete. (350ms)"4285lb # [ 62.531701] niks3-server[1000]: 2026/09/20 08:16:59 INFO Completed upload id=154286lb # [ 62.538389] niks3-server[1000]: 2026/09/20 08:16:59 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4287lb # [ 62.544733] envoy[916]: conn peer=[2001:db8:1::1]:36952 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=334 ms=314288lb # [ 62.548224] envoy[916]: conn peer=[2001:db8:1::1]:36940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3401 tx=1775 ms=22134289lb # [ 62.552931] envoy[916]: conn peer=[2001:db8:1::1]:36966 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3899 tx=1874 ms=22094290lb # [ 62.556582] envoy[916]: conn peer=[2001:db8:1::1]:36972 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=764291lb # [ 62.560314] envoy[916]: conn peer=[2001:db8:1::1]:36986 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4325 tx=2198 ms=25664292lb # [ 62.563985] envoy[916]: conn peer=[2001:db8:1::1]:36992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=744293worker2 # [ 62.506599] nix-grpc-daemon[774]: ts=2026-09-20T08:16:59Z level=debug event=want client=8 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04294worker2 # [ 62.514218] nix-grpc-daemon[774]: ts=2026-09-20T08:16:59Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14295worker2 # [ 62.554369] nix-grpc-daemon[774]: ts=2026-09-20T08:16:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438784296worker2 # [ 62.574095] nix-grpc-daemon[774]: ts=2026-09-20T08:17:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438784297client # copying 2 paths to 'lb:50051'...4298client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4299worker2 # [ 62.597957] nix-grpc-daemon[774]: ts=2026-09-20T08:17:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:438784300client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4301worker2 # [ 62.614117] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4302worker2 # [ 62.845906] nix-daemon[835]: accepted connection from pid 975, user nix-grpc-daemon (trusted)4303worker2 # [ 62.871578] nix-daemon[835]: reaped child process 978, status = succeeded4304worker2 # [ 63.050468] nix-daemon[835]: accepted connection from pid 980, user nix-grpc-daemon (trusted)4305worker2 # [ 63.072879] nix-daemon[835]: reaped child process 983, status = succeeded4306lb # [ 63.148390] niks3-server[1000]: 2026/09/20 08:17:00 INFO Received uploads request method=POST path=/api/pending_closures4307lb # [ 63.159257] niks3-server[1000]: 2026/09/20 08:17:00 INFO Received uploads request method=POST path=/api/pending_closures4308worker2 # [ 63.106947] nix-grpc-daemon[882]: time=2026-09-20T08:17:00.544Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4309worker2 # [ 63.108718] nix-grpc-daemon[882]: time=2026-09-20T08:17:00.544Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4310worker2 # [ 63.110637] nix-grpc-daemon[882]: time=2026-09-20T08:17:00.544Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4311lb # [ 63.196717] niks3-server[1000]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4312lb # [ 63.214901] niks3-server[1000]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4313lb # [ 63.225029] niks3-server[1000]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4314lb # [ 63.233369] niks3-server[1000]: 2026/09/20 08:17:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4315lb # [ 63.238219] niks3-server[1000]: 2026/09/20 08:17:00 INFO Signed narinfos id=16 count=14316lb # [ 63.241924] niks3-server[1000]: 2026/09/20 08:17:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4317worker2 # [ 63.179080] nix-grpc-daemon[882]: time=2026-09-20T08:17:00.616Z level=INFO msg="Uploading 3 narinfos"4318lb # [ 63.248675] niks3-server[1000]: 2026/09/20 08:17:00 INFO Signed narinfos id=17 count=24319lb # [ 63.251393] niks3-server[1000]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4320lb # [ 63.272385] niks3-server[1000]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4321lb # [ 63.280585] niks3-server[1000]: 2026/09/20 08:17:00 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4322lb # [ 63.291049] niks3-server[1000]: 2026/09/20 08:17:00 INFO Completed upload id=164323lb # [ 63.294096] niks3-server[1000]: 2026/09/20 08:17:00 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4324lb # [ 63.297422] niks3-server[1000]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4325worker2 # [ 63.234390] nix-grpc-daemon[882]: time=2026-09-20T08:17:00.673Z level=INFO msg="Upload complete. (600ms)"4326lb # [ 63.299951] niks3-server[1000]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4327lb # [ 63.302536] niks3-server[1000]: 2026/09/20 08:17:00 INFO Completed upload id=174328worker2 # [ 63.246682] nix-grpc-daemon[774]: ts=2026-09-20T08:17:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43878 duration_s=0 paths=2 nar_bytes_in=9844329worker2 # [ 63.264449] nix-grpc-daemon[774]: ts=2026-09-20T08:17:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438784330worker2 # [ 63.271280] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4331worker2 # [ 63.277575] nix-daemon[835]: reaped child process 973, status = succeeded4332worker2 # [ 63.296787] nix-grpc-daemon[774]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4333client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4334worker2 # [ 63.315700] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4335client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4336worker2 # [ 64.749671] nix-daemon[835]: reaped child process 988, status = succeeded4337worker2 # [ 64.930054] nix-daemon[835]: accepted connection from pid 1003, user nix-grpc-daemon (trusted)4338worker2 # [ 64.954006] nix-daemon[835]: reaped child process 1006, status = succeeded4339lb # [ 65.032771] niks3-server[1000]: 2026/09/20 08:17:02 INFO Received uploads request method=POST path=/api/pending_closures4340worker2 # [ 64.979539] nix-grpc-daemon[882]: time=2026-09-20T08:17:02.417Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4341lb # [ 65.067995] niks3-server[1000]: 2026/09/20 08:17:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4342worker2 # [ 65.016575] nix-grpc-daemon[882]: time=2026-09-20T08:17:02.455Z level=INFO msg="Uploading 1 narinfos"4343lb # [ 65.083474] niks3-server[1000]: 2026/09/20 08:17:02 INFO Signed narinfos id=18 count=14344lb # [ 65.091982] niks3-server[1000]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4345lb # [ 65.095748] niks3-server[1000]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4346lb # [ 65.107989] niks3-server[1000]: 2026/09/20 08:17:02 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4347lb # [ 65.113587] niks3-server[1000]: 2026/09/20 08:17:02 INFO Completed upload id=184348worker2 # [ 65.050421] nix-grpc-daemon[882]: time=2026-09-20T08:17:02.489Z level=INFO msg="Upload complete. (318ms)"4349lb # [ 65.116460] niks3-server[1000]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4350worker2 # [ 65.060965] nix-grpc-daemon[774]: ts=2026-09-20T08:17:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43878 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=8 outputs=14351worker2 # [ 65.076432] nix-daemon[835]: reaped child process 985, status = succeeded4352client # copying 1 paths...4353worker2 # [ 65.108238] nix-grpc-daemon[774]: ts=2026-09-20T08:17:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:438784354client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4355worker2 # [ 65.132170] nix-grpc-daemon[774]: ts=2026-09-20T08:17:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:438784356worker2 # [ 65.139986] nix-grpc-daemon[774]: ts=2026-09-20T08:17:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43878 duration_s=0 paths=1 nar_bytes_out=1204357client # [ 65.247996] nix-daemon[921]: reaped child process 1004, status = succeeded4358client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.61 seconds)4359client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24360client # [ 65.475442] nix-daemon[921]: accepted connection from pid 1021, user root (trusted)4361client # this derivation will be built:4362client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4363worker2 # [ 65.697409] nix-grpc-daemon[774]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:438784364client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4365worker1 # [ 65.717647] nix-grpc-daemon[788]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507944366worker1 # [ 65.725058] nix-grpc-daemon[854]: time=2026-09-20T08:17:03.132Z level=INFO msg="All 1 paths already cached"4367worker2 # [ 65.738534] nix-grpc-daemon[774]: ts=2026-09-20T08:17:03Z level=debug event=want client=9 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04368worker2 # [ 65.746128] nix-grpc-daemon[774]: ts=2026-09-20T08:17:03Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14369worker1 # [ 65.757173] nix-grpc-daemon[788]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507944370worker1 # [ 65.775870] nix-grpc-daemon[788]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507944371client # copying 1 paths to 'lb:50051'...4372client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4373worker1 # [ 65.801472] nix-grpc-daemon[788]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:507944374worker1 # [ 65.817859] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4375worker1 # [ 65.843510] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5)4376worker1 # [ 65.891454] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 104 ms (attempt 2/5)4377worker1 # [ 66.003850] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 3/5)4378worker1 # [ 66.081498] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 547 ms (attempt 4/5)4379worker1 # [ 66.630246] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4380worker1 # [ 66.640381] nix-grpc-daemon[788]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4381worker1 # [ 66.886234] nix-daemon[844]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)4382worker1 # [ 66.906904] nix-daemon[844]: reaped child process 1133, status = succeeded4383worker1 # [ 67.087644] nix-daemon[844]: accepted connection from pid 1135, user nix-grpc-daemon (trusted)4384worker1 # [ 67.106804] nix-daemon[844]: reaped child process 1138, status = succeeded4385lb # [ 67.177135] niks3-server[1000]: 2026/09/20 08:17:04 INFO Received uploads request method=POST path=/api/pending_closures4386worker1 # [ 67.131715] nix-grpc-daemon[854]: time=2026-09-20T08:17:04.539Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4387worker1 # [ 67.133958] nix-grpc-daemon[854]: time=2026-09-20T08:17:04.542Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4388lb # [ 67.212604] niks3-server[1000]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4389worker1 # [ 67.179166] nix-grpc-daemon[854]: time=2026-09-20T08:17:04.587Z level=INFO msg="Uploading 1 narinfos"4390lb # [ 67.234913] niks3-server[1000]: 2026/09/20 08:17:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4391lb # [ 67.240794] niks3-server[1000]: 2026/09/20 08:17:04 INFO Signed narinfos id=19 count=14392lb # [ 67.249513] niks3-server[1000]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4393lb # [ 67.263948] niks3-server[1000]: 2026/09/20 08:17:04 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4394lb # [ 67.272335] niks3-server[1000]: 2026/09/20 08:17:04 INFO Completed upload id=194395worker1 # [ 67.214428] nix-grpc-daemon[854]: time=2026-09-20T08:17:04.623Z level=INFO msg="Upload complete. (547ms)"4396worker1 # [ 67.220236] nix-grpc-daemon[788]: ts=2026-09-20T08:17:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=1 paths=1 nar_bytes_in=5684397lb # [ 67.276444] niks3-server[1000]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4398worker1 # [ 67.228221] nix-grpc-daemon[788]: ts=2026-09-20T08:17:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:507944399worker1 # [ 67.241321] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4400worker1 # [ 67.243618] nix-daemon[844]: reaped child process 1124, status = succeeded4401client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4402worker1 # [ 67.255381] nix-daemon[844]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4403client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4404worker1 # [ 68.095169] nix-daemon[844]: reaped child process 1142, status = succeeded4405worker1 # [ 68.275145] nix-daemon[844]: accepted connection from pid 1157, user nix-grpc-daemon (trusted)4406worker1 # [ 68.299063] nix-daemon[844]: reaped child process 1160, status = succeeded4407lb # [ 68.367695] niks3-server[1000]: 2026/09/20 08:17:05 INFO Received uploads request method=POST path=/api/pending_closures4408worker1 # [ 68.323305] nix-grpc-daemon[854]: time=2026-09-20T08:17:05.730Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4409lb # [ 68.402802] niks3-server[1000]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4410lb # [ 68.414403] niks3-server[1000]: 2026/09/20 08:17:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4411worker1 # [ 68.364195] nix-grpc-daemon[854]: time=2026-09-20T08:17:05.772Z level=INFO msg="Uploading 1 narinfos"4412lb # [ 68.428057] niks3-server[1000]: 2026/09/20 08:17:05 INFO Signed narinfos id=20 count=14413lb # [ 68.431271] niks3-server[1000]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4414lb # [ 68.444132] niks3-server[1000]: 2026/09/20 08:17:05 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4415lb # [ 68.451717] niks3-server[1000]: 2026/09/20 08:17:05 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4416lb # [ 68.456043] niks3-server[1000]: 2026/09/20 08:17:05 INFO Completed upload id=204417worker1 # [ 68.400109] nix-grpc-daemon[854]: time=2026-09-20T08:17:05.808Z level=INFO msg="Upload complete. (335ms)"4418worker1 # [ 68.413092] nix-grpc-daemon[788]: ts=2026-09-20T08:17:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=9 outputs=14419worker1 # [ 68.427720] nix-daemon[844]: reaped child process 1140, status = succeeded4420client # copying 1 paths...4421worker2 # [ 68.455149] nix-grpc-daemon[774]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:438784422worker2 # [ 68.469608] nix-grpc-daemon[774]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4423client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4424worker2 # [ 68.521728] nix-grpc-daemon[774]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:438784425worker2 # [ 68.527399] nix-grpc-daemon[774]: ts=2026-09-20T08:17:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43878 duration_s=0 paths=1 nar_bytes_out=1204426client # [ 68.637352] nix-daemon[921]: reaped child process 1024, status = succeeded4427client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.39 seconds)4428client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24429client # [ 68.870596] nix-daemon[921]: accepted connection from pid 1042, user root (trusted)4430client # this derivation will be built:4431client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4432worker2 # [ 69.091119] nix-grpc-daemon[774]: ts=2026-09-20T08:17:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:438784433client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4434worker1 # [ 69.108306] nix-grpc-daemon[788]: ts=2026-09-20T08:17:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:507944435worker1 # [ 69.277518] nix-grpc-daemon[854]: time=2026-09-20T08:17:06.685Z level=INFO msg="All 1 paths already cached"4436worker2 # [ 69.289008] nix-grpc-daemon[774]: ts=2026-09-20T08:17:06Z level=debug event=want client=10 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04437worker2 # [ 69.297144] nix-grpc-daemon[774]: ts=2026-09-20T08:17:06Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14438worker2 # [ 69.306960] nix-grpc-daemon[774]: ts=2026-09-20T08:17:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438784439worker2 # [ 69.319142] nix-grpc-daemon[774]: ts=2026-09-20T08:17:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438784440worker2 # [ 69.337280] nix-grpc-daemon[882]: time=2026-09-20T08:17:06.775Z level=INFO msg="All 1 paths already cached"4441client # copying 1 paths to 'lb:50051'...4442client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4443worker2 # [ 69.349126] nix-grpc-daemon[774]: ts=2026-09-20T08:17:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:438784444worker2 # [ 69.365186] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4445worker2 # [ 69.568168] nix-daemon[835]: accepted connection from pid 1015, user nix-grpc-daemon (trusted)4446worker2 # [ 69.589042] nix-daemon[835]: reaped child process 1018, status = succeeded4447worker2 # [ 69.767347] nix-daemon[835]: accepted connection from pid 1020, user nix-grpc-daemon (trusted)4448worker2 # [ 69.789167] nix-daemon[835]: reaped child process 1023, status = succeeded4449lb # [ 69.863373] niks3-server[1000]: 2026/09/20 08:17:07 INFO Received uploads request method=POST path=/api/pending_closures4450worker2 # [ 69.810756] nix-grpc-daemon[882]: time=2026-09-20T08:17:07.249Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4451worker2 # [ 69.812421] nix-grpc-daemon[882]: time=2026-09-20T08:17:07.249Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4452lb # [ 69.897583] niks3-server[1000]: 2026/09/20 08:17:07 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4453lb # [ 69.910485] niks3-server[1000]: 2026/09/20 08:17:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4454worker2 # [ 69.854107] nix-grpc-daemon[882]: time=2026-09-20T08:17:07.292Z level=INFO msg="Uploading 1 narinfos"4455lb # [ 69.921830] niks3-server[1000]: 2026/09/20 08:17:07 INFO Signed narinfos id=21 count=14456lb # [ 69.927325] niks3-server[1000]: 2026/09/20 08:17:07 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4457lb # [ 69.937839] niks3-server[1000]: 2026/09/20 08:17:07 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4458lb # [ 69.942616] niks3-server[1000]: 2026/09/20 08:17:07 INFO Completed upload id=214459worker2 # [ 69.878702] nix-grpc-daemon[882]: time=2026-09-20T08:17:07.317Z level=INFO msg="Upload complete. (496ms)"4460lb # [ 69.945231] niks3-server[1000]: 2026/09/20 08:17:07 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4461worker2 # [ 69.889033] nix-grpc-daemon[774]: ts=2026-09-20T08:17:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43878 duration_s=0 paths=1 nar_bytes_in=5684462worker2 # [ 69.903766] nix-grpc-daemon[774]: ts=2026-09-20T08:17:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438784463worker2 # [ 69.910822] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4464worker2 # [ 69.915951] nix-daemon[835]: reaped child process 1013, status = succeeded4465worker2 # [ 69.928286] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4466client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4467client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4468worker2 # [ 71.367785] nix-daemon[835]: reaped child process 1027, status = succeeded4469worker2 # [ 71.543662] nix-daemon[835]: accepted connection from pid 1042, user nix-grpc-daemon (trusted)4470worker2 # [ 71.563787] nix-daemon[835]: reaped child process 1045, status = succeeded4471lb # [ 71.641132] niks3-server[1000]: 2026/09/20 08:17:09 INFO Received uploads request method=POST path=/api/pending_closures4472worker2 # [ 71.592487] nix-grpc-daemon[882]: time=2026-09-20T08:17:09.030Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4473worker2 # [ 71.622299] nix-grpc-daemon[882]: time=2026-09-20T08:17:09.060Z level=INFO msg="Uploading 1 narinfos"4474lb # [ 71.677202] niks3-server[1000]: 2026/09/20 08:17:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4475lb # [ 71.692718] niks3-server[1000]: 2026/09/20 08:17:09 INFO Signed narinfos id=22 count=14476lb # [ 71.701590] niks3-server[1000]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4477lb # [ 71.708722] niks3-server[1000]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4478lb # [ 71.714556] niks3-server[1000]: 2026/09/20 08:17:09 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4479worker2 # [ 71.658327] nix-grpc-daemon[882]: time=2026-09-20T08:17:09.097Z level=INFO msg="Upload complete. (315ms)"4480lb # [ 71.722106] niks3-server[1000]: 2026/09/20 08:17:09 INFO Completed upload id=224481lb # [ 71.726123] niks3-server[1000]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4482client # copying 1 paths...4483worker2 # [ 71.667936] nix-grpc-daemon[774]: ts=2026-09-20T08:17:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43878 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=10 outputs=14484worker2 # [ 71.677072] nix-daemon[835]: reaped child process 1025, status = succeeded4485worker1 # [ 71.681509] nix-grpc-daemon[788]: ts=2026-09-20T08:17:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:507944486worker1 # [ 71.699575] nix-grpc-daemon[788]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4487client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4488worker1 # [ 71.745597] nix-grpc-daemon[788]: ts=2026-09-20T08:17:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:507944489worker1 # [ 71.752232] nix-grpc-daemon[788]: ts=2026-09-20T08:17:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50794 duration_s=0 paths=1 nar_bytes_out=1204490client # [ 71.857264] nix-daemon[921]: reaped child process 1045, status = succeeded4491client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.22 seconds)4492(finished: subtest: an input only one worker has still reaches the builder, in 11.17 seconds)4493subtest: upload whose reference the worker lacks is completed from the cache4494client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4495client # this derivation will be built:4496client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4497lb # [ 72.537096] envoy[916]: conn peer=[2001:db8:1::1]:48236 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3862 tx=1767 ms=30934498lb # [ 72.542267] envoy[916]: conn peer=[2001:db8:1::1]:48244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=664499lb # [ 72.548168] envoy[916]: conn peer=[2001:db8:1::1]:48260 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3723 tx=1917 ms=28854500lb # [ 72.553917] envoy[916]: conn peer=[2001:db8:1::1]:48276 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=674501lb # [ 72.558683] envoy[916]: conn peer=[2001:db8:1::1]:48292 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3728 tx=1935 ms=27074502lb # [ 72.563610] envoy[916]: conn peer=[2001:db8:1::1]:39146 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=634503client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4504client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.72 seconds)4505client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4506client # this derivation will be built:4507client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4508client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4509client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.45 seconds)4510client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4511client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4512worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4513worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4514worker2 # [ 73.577632] systemd[1]: Stopping Nix worker-protocol over gRPC...4515worker2 # [ 73.871809] nix-grpc-daemon[774]: ts=2026-09-20T08:17:11Z level=info event=signal_exit4516worker2 # [ 74.125415] nix-grpc-daemon[774]: ts=2026-09-20T08:17:11Z level=info event=scheduler_yield4517worker2 # [ 74.131263] nix-grpc-daemon[774]: ts=2026-09-20T08:17:11Z level=info event=scheduler_restarting addr=lb:500514518lb # [ 74.196398] niks3-server[1000]: 2026/09/20 08:17:11 INFO lead: released remote=192.168.1.4:487044519worker2 # [ 74.137121] nix-grpc-daemon[774]: ts=2026-09-20T08:17:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:438644520worker2 # [ 74.142044] nix-grpc-daemon[774]: ts=2026-09-20T08:17:11Z level=info event=worker_gone addr=192.168.1.4:500514521worker1 # [ 74.150788] nix-grpc-daemon[788]: ts=2026-09-20T08:17:11Z level=info event=scheduler_restarting addr=lb:500514522worker2 # [ 74.148317] nix-grpc-daemon[774]: ts=2026-09-20T08:17:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:438644523worker2 # [ 74.153002] nix-grpc-daemon[774]: ts=2026-09-20T08:17:11Z level=info event=worker_gone addr=192.168.1.3:500514524worker2 # [ 74.332542] nix-grpc-daemon[774]: ts=2026-09-20T08:17:11Z level=info event=scheduler_connected addr=lb:500514525worker1 # [ 74.350935] nix-grpc-daemon[788]: ts=2026-09-20T08:17:11Z level=info event=scheduler_connected addr=lb:500514526worker1 # [ 74.358949] nix-grpc-daemon[788]: ts=2026-09-20T08:17:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4527worker2 # [ 74.355181] nix-grpc-daemon[774]: ts=2026-09-20T08:17:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4528worker1 # [ 74.560087] nix-grpc-daemon[788]: ts=2026-09-20T08:17:11Z level=info event=scheduler_connected addr=lb:500514529worker2 # [ 74.556696] nix-grpc-daemon[774]: ts=2026-09-20T08:17:11Z level=info event=scheduler_connected addr=lb:500514530worker1 # [ 74.567140] nix-grpc-daemon[788]: ts=2026-09-20T08:17:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4531worker2 # [ 74.562946] nix-grpc-daemon[774]: ts=2026-09-20T08:17:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4532worker1 # [ 74.768403] nix-grpc-daemon[788]: ts=2026-09-20T08:17:12Z level=info event=scheduler_connected addr=lb:500514533worker2 # [ 74.764379] nix-grpc-daemon[774]: ts=2026-09-20T08:17:12Z level=info event=scheduler_connected addr=lb:500514534worker1 # [ 74.775615] nix-grpc-daemon[788]: ts=2026-09-20T08:17:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4535worker2 # [ 74.770568] nix-grpc-daemon[774]: ts=2026-09-20T08:17:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4536worker1 # [ 74.976108] nix-grpc-daemon[788]: ts=2026-09-20T08:17:12Z level=info event=scheduler_connected addr=lb:500514537worker2 # [ 74.973086] nix-grpc-daemon[774]: ts=2026-09-20T08:17:12Z level=info event=scheduler_connected addr=lb:500514538worker2 # [ 74.979304] nix-grpc-daemon[774]: ts=2026-09-20T08:17:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4539worker1 # [ 74.987477] nix-grpc-daemon[788]: ts=2026-09-20T08:17:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4540worker2 # [ 75.131116] nix-grpc-daemon[774]: ts=2026-09-20T08:17:12Z level=info event=scheduler_restarting4541worker1 # [ 75.190311] nix-grpc-daemon[788]: ts=2026-09-20T08:17:12Z level=info event=scheduler_connected addr=lb:500514542worker2 # [ 75.191513] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4543worker2 # [ 75.215955] nix-grpc-daemon[774]: E0000 00:00:1789892232.624741 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true4544worker2 # [ 75.222038] nix-grpc-daemon[774]: ts=2026-09-20T08:17:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4545worker2 # [ 75.227107] nix-daemon[835]: reaped child process 837, status = succeeded4546worker2 # [ 76.058537] nix-grpc-daemon[774]: E0000 00:00:1789892233.495852 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4547worker2 # [ 76.059008] nix-grpc-daemon[774]: E0000 00:00:1789892233.496084 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4548worker1 # [ 76.376191] nix-grpc-daemon[788]: ts=2026-09-20T08:17:13Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4549worker2 # [ 76.391318] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4550worker2 # [ 76.399604] systemd[1]: Stopped Nix worker-protocol over gRPC.4551worker2 # [ 76.403357] systemd[1]: nix-grpc-daemon.service: Consumed 2.105s CPU time over 53.918s wall clock time, 54.8M memory peak, 50.4K incoming IP traffic, 87.9K outgoing IP traffic.4552worker2 # [ 76.415754] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4553worker2 # [ 76.421636] systemd[1]: Closed Nix worker-protocol over gRPC.4554worker2 # [ 76.424426] systemd[1]: nix-grpc-daemon.socket: Consumed 798us CPU time over 1min 4.100s wall clock time, 256K memory peak, 85.3K incoming IP traffic, 71.1K outgoing IP traffic.4555lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4556lb: must succeed: curl -sf localhost:9901/clusters4557lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4558lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4559client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24560worker1 # [ 76.576196] nix-grpc-daemon[788]: ts=2026-09-20T08:17:13Z level=info event=scheduler_connected addr=lb:500514561worker1 # [ 76.584122] nix-grpc-daemon[788]: ts=2026-09-20T08:17:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4562worker1 # [ 76.767494] nix-grpc-daemon[788]: ts=2026-09-20T08:17:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:507944563client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4564worker1 # [ 76.777245] nix-grpc-daemon[788]: ts=2026-09-20T08:17:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:507944565worker1 # [ 76.785172] nix-grpc-daemon[788]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500514566worker1 # [ 76.790842] nix-grpc-daemon[788]: ts=2026-09-20T08:17:14Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4567client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.28 seconds)4568worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4569worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4570worker2 # [ 76.910668] systemd[1]: Listening on Nix worker-protocol over gRPC.4571worker1 # [ 76.982548] systemd[1]: Stopping Nix worker-protocol over gRPC...4572worker1 # [ 76.991596] nix-grpc-daemon[788]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500514573worker1 # [ 76.996466] nix-grpc-daemon[788]: ts=2026-09-20T08:17:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4574worker1 # [ 77.197493] nix-grpc-daemon[788]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500514575worker2 # [ 77.205061] systemd[1]: Starting Nix worker-protocol over gRPC...4576worker2 # [ 77.432084] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4577worker2 # [ 77.434703] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14578worker2 # [ 77.443281] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4579worker2 # [ 77.461032] systemd[1]: Started Nix worker-protocol over gRPC.4580lb # [ 77.525987] niks3-server[1000]: 2026/09/20 08:17:14 INFO lead: acquired remote=192.168.1.4:374984581worker2 # [ 77.473423] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:14Z level=info event=scheduler_take_over4582worker2 # [ 77.480249] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04583worker2 # [ 77.494343] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500514584worker2 # [ 77.496404] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04585worker1 # [ 77.863453] nix-grpc-daemon[788]: ts=2026-09-20T08:17:15Z level=info event=signal_exit4586worker1 # [ 79.133959] nix-grpc-daemon[788]: ts=2026-09-20T08:17:16Z level=info event=scheduler_restarting4587worker2 # [ 79.137440] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:520764588worker2 # [ 79.142269] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:16Z level=info event=worker_gone addr=192.168.1.3:500514589worker1 # [ 79.177972] nix-grpc-daemon[788]: ts=2026-09-20T08:17:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4590worker1 # [ 79.194775] nix-daemon[844]: reaped child process 846, status = succeeded4591worker1 # [ 79.994831] nix-grpc-daemon[788]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4592worker1 # [ 79.999878] nix-grpc-daemon[788]: E0000 00:00:1789892237.403117 831 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4593worker1 # [ 80.076478] nix-grpc-daemon[788]: E0000 00:00:1789892237.484859 831 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4594worker1 # [ 80.306611] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4595worker1 # [ 80.315818] systemd[1]: Stopped Nix worker-protocol over gRPC.4596worker1 # [ 80.325269] systemd[1]: nix-grpc-daemon.service: Consumed 4.016s CPU time over 57.842s wall clock time, 62.2M memory peak, 76.9K incoming IP traffic, 136.4K outgoing IP traffic.4597worker1 # [ 80.339928] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4598worker1 # [ 80.343443] systemd[1]: Closed Nix worker-protocol over gRPC.4599worker1 # [ 80.346961] systemd[1]: nix-grpc-daemon.socket: Consumed 727us CPU time over 1min 7.825s wall clock time, 256K memory peak, 87.8K incoming IP traffic, 73.4K outgoing IP traffic.4600lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4601lb: must succeed: curl -sf localhost:9901/clusters4602lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4603lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4604client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24605worker2 # [ 80.682802] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:521004606worker2 # [ 80.697285] nix-daemon[835]: accepted connection from pid 1066, user nix-grpc-daemon (trusted)4607worker2 # [ 80.727410] nix-grpc-daemon[1066]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 1/5)4608worker2 # [ 80.794603] nix-grpc-daemon[1066]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 2/5)4609worker2 # [ 80.828967] nix-grpc-daemon[1066]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 374 ms (attempt 3/5)4610worker2 # [ 81.210763] nix-grpc-daemon[1066]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 795 ms (attempt 4/5)4611worker2 # [ 82.016767] nix-grpc-daemon[1066]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4612client # copying 2 paths...4613client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4614worker2 # [ 82.045804] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:521004615client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4616worker2 # [ 82.065340] nix-daemon[835]: accepted connection from pid 1066, user nix-grpc-daemon (trusted)4617worker2 # [ 82.096160] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:19Z level=info event=niks3_push_started pid=11224618lb # [ 82.536472] envoy[916]: conn peer=[2001:db8:1::4]:37028 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4751 tx=1469 ms=522854619lb # [ 82.536859] envoy[916]: conn peer=[2001:db8:1::1]:39152 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=244620lb # [ 82.536977] envoy[916]: conn peer=[2001:db8:1::3]:53852 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6325 tx=2013 ms=562444621worker2 # [ 82.488579] nix-daemon[835]: accepted connection from pid 1135, user nix-grpc-daemon (trusted)4622worker2 # [ 82.509827] nix-daemon[835]: reaped child process 1138, status = succeeded4623lb # [ 82.587043] niks3-server[1000]: 2026/09/20 08:17:20 INFO Received uploads request method=POST path=/api/pending_closures4624lb # [ 82.596777] niks3-server[1000]: 2026/09/20 08:17:20 INFO Received uploads request method=POST path=/api/pending_closures4625worker2 # [ 82.544513] nix-grpc-daemon[1122]: time=2026-09-20T08:17:19.981Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4626worker2 # [ 82.546132] nix-grpc-daemon[1122]: time=2026-09-20T08:17:19.981Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4627worker2 # [ 82.547840] nix-grpc-daemon[1122]: time=2026-09-20T08:17:19.981Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4628lb # [ 82.654308] niks3-server[1000]: 2026/09/20 08:17:20 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4629lb # [ 82.664614] niks3-server[1000]: 2026/09/20 08:17:20 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4630lb # [ 82.677340] niks3-server[1000]: 2026/09/20 08:17:20 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4631worker2 # [ 82.619225] nix-grpc-daemon[1122]: time=2026-09-20T08:17:20.057Z level=INFO msg="Uploading 3 narinfos"4632lb # [ 82.686273] niks3-server[1000]: 2026/09/20 08:17:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4633lb # [ 82.693936] niks3-server[1000]: 2026/09/20 08:17:20 INFO Signed narinfos id=23 count=14634lb # [ 82.697642] niks3-server[1000]: 2026/09/20 08:17:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4635lb # [ 82.705010] niks3-server[1000]: 2026/09/20 08:17:20 INFO Signed narinfos id=24 count=24636lb # [ 82.707039] niks3-server[1000]: 2026/09/20 08:17:20 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4637lb # [ 82.718582] niks3-server[1000]: 2026/09/20 08:17:20 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4638lb # [ 82.728523] niks3-server[1000]: 2026/09/20 08:17:20 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4639lb # [ 82.730860] niks3-server[1000]: 2026/09/20 08:17:20 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4640lb # [ 82.740318] niks3-server[1000]: 2026/09/20 08:17:20 INFO Completed upload id=234641lb # [ 82.744606] niks3-server[1000]: 2026/09/20 08:17:20 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4642worker2 # [ 82.681495] nix-grpc-daemon[1122]: time=2026-09-20T08:17:20.120Z level=INFO msg="Upload complete. (371ms)"4643lb # [ 82.747885] niks3-server[1000]: 2026/09/20 08:17:20 INFO Completed upload id=244644lb # [ 82.756292] niks3-server[1000]: 2026/09/20 08:17:20 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4645worker2 # [ 82.692546] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52100 duration_s=0 paths=2 nar_bytes_in=3124646worker2 # [ 82.712159] nix-daemon[835]: reaped child process 1120, status = succeeded4647client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 2.31 seconds)4648worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4649worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4650worker1 # [ 82.879290] systemd[1]: Listening on Nix worker-protocol over gRPC.4651worker1 # [ 82.891075] systemd[1]: Starting Nix worker-protocol over gRPC...4652worker1 # [ 83.099688] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4653worker1 # [ 83.103271] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14654worker1 # [ 83.111930] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4655worker1 # [ 83.120918] systemd[1]: Started Nix worker-protocol over gRPC.4656lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4657lb: must succeed: curl -sf localhost:9901/clusters4658worker1 # [ 83.164535] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:20Z level=info event=scheduler_connected addr=lb:500514659worker2 # [ 83.163906] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04660lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4661lb: must succeed: curl -sf localhost:9901/clusters4662lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4663lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)4664(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.42 seconds)4665subtest: scheduler down: the other node takes the lock and keeps it4666lb: must succeed: curl -sf localhost:9901/clusters4667lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4668lb: must succeed: curl -sf localhost:9901/clusters4669lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4670lb: must succeed: curl -sf localhost:9901/clusters4671lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4672lb: must succeed: curl -sf localhost:9901/clusters4673lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4674worker2 # [ 84.567050] systemd[1]: Stopping Nix worker-protocol over gRPC...4675worker2 # [ 85.456389] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:22Z level=info event=signal_exit4676worker2 # [ 85.665333] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=scheduler_yield4677lb # [ 85.733632] niks3-server[1000]: 2026/09/20 08:17:23 INFO lead: released remote=192.168.1.4:374984678worker1 # [ 85.681618] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:23Z level=info event=scheduler_restarting addr=lb:500514679worker2 # [ 85.677261] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:520764680worker2 # [ 85.686195] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=worker_gone addr=192.168.1.3:500514681worker2 # [ 85.690775] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:520764682worker2 # [ 85.695627] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=worker_gone addr=192.168.1.4:500514683worker2 # [ 85.700060] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=scheduler_restarting addr=lb:500514684worker1 # [ 85.881770] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500514685worker2 # [ 85.887726] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500514686worker1 # [ 85.895385] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4687worker2 # [ 85.909506] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4688worker1 # [ 86.096724] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500514689worker1 # [ 86.105157] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4690worker2 # [ 86.110773] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500514691worker2 # [ 86.118734] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4692worker1 # [ 86.306491] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500514693worker1 # [ 86.315639] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4694worker2 # [ 86.319899] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500514695worker2 # [ 86.327280] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4696worker1 # [ 86.516671] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500514697worker1 # [ 86.524718] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4698worker2 # [ 86.531682] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500514699worker2 # [ 86.537934] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4700worker2 # [ 86.671612] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:24Z level=info event=scheduler_restarting4701worker2 # [ 86.705541] nix-daemon[835]: reaped child process 1115, status = succeeded4702worker1 # [ 86.730592] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500514703worker1 # [ 86.735572] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4704worker2 # [ 86.754616] nix-grpc-daemon[1066]: ts=2026-09-20T08:17:24Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4705worker1 # [ 86.931453] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500514706worker2 # [ 86.927072] nix-grpc-daemon[1066]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4707worker2 # [ 86.932084] nix-grpc-daemon[1066]: E0000 00:00:1789892244.365486 1109 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4708worker1 # [ 87.471293] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4709worker2 # [ 87.486921] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4710worker2 # [ 87.495972] systemd[1]: Stopped Nix worker-protocol over gRPC.4711worker2 # [ 87.499566] systemd[1]: nix-grpc-daemon.service: Consumed 530ms CPU time over 10.281s wall clock time, 33.4M memory peak, 17.7K incoming IP traffic, 22K outgoing IP traffic.4712worker2 # [ 87.516585] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4713worker2 # [ 87.518715] systemd[1]: Closed Nix worker-protocol over gRPC.4714worker2 # [ 87.523185] systemd[1]: nix-grpc-daemon.socket: Consumed 884us CPU time over 10.616s wall clock time, 256K memory peak, 28.1K incoming IP traffic, 24.4K outgoing IP traffic.4715worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4716worker1 # [ 87.672697] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500514717worker1 # [ 87.680704] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4718worker1 # [ 87.883704] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500514719worker1 # [ 87.889731] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4720worker1 # [ 88.090786] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500514721worker1 # [ 88.098884] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4722worker1 # [ 88.122637] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:25Z level=info event=scheduler_take_over4723lb # [ 88.179761] niks3-server[1000]: 2026/09/20 08:17:25 INFO lead: acquired remote=192.168.1.3:359344724worker1 # [ 88.300356] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500514725worker1 # [ 88.306558] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4726worker1 # [ 88.507665] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500514727worker1 # [ 88.514402] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04728worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.17 seconds)4729worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4730worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)4731client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&24732worker1 # [ 89.046883] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:457744733worker1 # [ 89.065579] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4734client # don't know how to build these paths:4735client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4736worker1 # [ 89.096360] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:26Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04737worker1 # [ 89.103382] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:26Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14738worker1 # [ 89.149357] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457744739worker1 # [ 89.170333] nix-grpc-daemon[1184]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 1/5)4740worker1 # [ 89.180715] nix-grpc-daemon[1184]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 2/5)4741worker1 # [ 89.373861] nix-grpc-daemon[1184]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 322 ms (attempt 3/5)4742worker1 # [ 89.696440] nix-grpc-daemon[1184]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 701 ms (attempt 4/5)4743worker1 # [ 90.407583] nix-grpc-daemon[1184]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4744worker1 # [ 90.432907] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457744745client # copying 1 paths to 'lb:50051'...4746client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4747worker1 # [ 90.452122] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457744748worker1 # [ 90.469103] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4749worker1 # [ 90.501481] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:27Z level=info event=niks3_push_started pid=12594750worker1 # [ 90.911270] nix-daemon[844]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)4751worker1 # [ 90.932973] nix-daemon[844]: reaped child process 1275, status = succeeded4752worker1 # [ 91.119806] nix-daemon[844]: accepted connection from pid 1277, user nix-grpc-daemon (trusted)4753worker1 # [ 91.140210] nix-daemon[844]: reaped child process 1280, status = succeeded4754lb # [ 91.208910] niks3-server[1000]: 2026/09/20 08:17:28 INFO Received uploads request method=POST path=/api/pending_closures4755worker1 # [ 91.164643] nix-grpc-daemon[1259]: time=2026-09-20T08:17:28.571Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4756worker1 # [ 91.166271] nix-grpc-daemon[1259]: time=2026-09-20T08:17:28.571Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4757lb # [ 91.248532] niks3-server[1000]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4758worker1 # [ 91.208610] nix-grpc-daemon[1259]: time=2026-09-20T08:17:28.617Z level=INFO msg="Uploading 1 narinfos"4759lb # [ 91.264689] niks3-server[1000]: 2026/09/20 08:17:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4760lb # [ 91.277805] niks3-server[1000]: 2026/09/20 08:17:28 INFO Signed narinfos id=25 count=14761lb # [ 91.286247] niks3-server[1000]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4762worker1 # [ 91.245074] nix-grpc-daemon[1259]: time=2026-09-20T08:17:28.653Z level=INFO msg="Upload complete. (514ms)"4763lb # [ 91.300339] niks3-server[1000]: 2026/09/20 08:17:28 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4764lb # [ 91.307318] niks3-server[1000]: 2026/09/20 08:17:28 INFO Completed upload id=254765worker1 # [ 91.256368] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45774 duration_s=0 paths=1 nar_bytes_in=5204766worker1 # [ 91.265305] nix-grpc-daemon[1259]: time=2026-09-20T08:17:28.658Z level=WARN msg="Failed to register uploaded object" key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo error="server returned 404: object is not pending upload\n"4767worker1 # [ 91.275894] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457744768worker1 # [ 91.283860] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4769worker1 # [ 91.286429] nix-daemon[844]: reaped child process 1257, status = succeeded4770client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4771worker1 # [ 91.298742] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4772client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4773client # farm-a> LOG-farm-a-on-standby4774worker1 # [ 92.353773] nix-daemon[844]: reaped child process 1284, status = succeeded4775lb # [ 92.536918] envoy[916]: conn peer=[2001:db8:1::1]:39160 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1007 tx=305 ms=20324776lb # [ 92.537212] envoy[916]: conn peer=[2001:db8:1::4]:54330 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1003 tx=362 ms=92524777worker1 # [ 92.536658] nix-daemon[844]: accepted connection from pid 1299, user nix-grpc-daemon (trusted)4778worker1 # [ 92.556319] nix-daemon[844]: reaped child process 1302, status = succeeded4779lb # [ 92.625151] niks3-server[1000]: 2026/09/20 08:17:30 INFO Received uploads request method=POST path=/api/pending_closures4780worker1 # [ 92.580526] nix-grpc-daemon[1259]: time=2026-09-20T08:17:29.986Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4781worker1 # [ 92.585150] nix-grpc-daemon[1259]: time=2026-09-20T08:17:29.986Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4782lb # [ 92.661270] niks3-server[1000]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4783lb # [ 92.681281] niks3-server[1000]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4784lb # [ 92.697860] niks3-server[1000]: 2026/09/20 08:17:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4785worker1 # [ 92.649872] nix-grpc-daemon[1259]: time=2026-09-20T08:17:30.056Z level=INFO msg="Uploading 1 narinfos"4786lb # [ 92.705332] niks3-server[1000]: 2026/09/20 08:17:30 INFO Signed narinfos id=26 count=14787lb # [ 92.712799] niks3-server[1000]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4788lb # [ 92.726423] niks3-server[1000]: 2026/09/20 08:17:30 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4789worker1 # [ 92.677158] nix-grpc-daemon[1259]: time=2026-09-20T08:17:30.085Z level=INFO msg="Upload complete. (367ms)"4790lb # [ 92.734943] niks3-server[1000]: 2026/09/20 08:17:30 INFO Completed upload id=264791lb # [ 92.738412] niks3-server[1000]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4792worker1 # [ 92.708891] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45774 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14793worker1 # [ 92.720486] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:30Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04794worker1 # [ 92.726636] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:30Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14795worker1 # [ 92.730631] nix-daemon[844]: reaped child process 1282, status = succeeded4796worker1 # [ 92.748631] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457744797worker1 # [ 92.766704] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457744798worker1 # [ 92.785608] nix-grpc-daemon[1259]: time=2026-09-20T08:17:30.194Z level=INFO msg="All 1 paths already cached"4799client # copying 1 paths to 'lb:50051'...4800client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4801worker1 # [ 92.795804] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457744802worker1 # [ 92.811049] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4803worker1 # [ 93.021835] nix-daemon[844]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)4804worker1 # [ 93.043279] nix-daemon[844]: reaped child process 1311, status = succeeded4805worker1 # [ 93.224717] nix-daemon[844]: accepted connection from pid 1313, user nix-grpc-daemon (trusted)4806worker1 # [ 93.244064] nix-daemon[844]: reaped child process 1316, status = succeeded4807lb # [ 93.312439] niks3-server[1000]: 2026/09/20 08:17:30 INFO Received uploads request method=POST path=/api/pending_closures4808worker1 # [ 93.270591] nix-grpc-daemon[1259]: time=2026-09-20T08:17:30.678Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4809worker1 # [ 93.272327] nix-grpc-daemon[1259]: time=2026-09-20T08:17:30.678Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4810lb # [ 93.349455] niks3-server[1000]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4811lb # [ 93.363672] niks3-server[1000]: 2026/09/20 08:17:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4812worker1 # [ 93.314604] nix-grpc-daemon[1259]: time=2026-09-20T08:17:30.722Z level=INFO msg="Uploading 1 narinfos"4813lb # [ 93.374799] niks3-server[1000]: 2026/09/20 08:17:30 INFO Signed narinfos id=27 count=14814lb # [ 93.381650] niks3-server[1000]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4815lb # [ 93.391075] niks3-server[1000]: 2026/09/20 08:17:30 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4816worker1 # [ 93.341104] nix-grpc-daemon[1259]: time=2026-09-20T08:17:30.749Z level=INFO msg="Upload complete. (512ms)"4817lb # [ 93.398773] niks3-server[1000]: 2026/09/20 08:17:30 INFO Completed upload id=274818lb # [ 93.402854] niks3-server[1000]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4819worker1 # [ 93.352277] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45774 duration_s=0 paths=1 nar_bytes_in=6404820worker1 # [ 93.363954] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457744821worker1 # [ 93.371766] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4822worker1 # [ 93.377449] nix-daemon[844]: reaped child process 1306, status = succeeded4823client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4824worker1 # [ 93.391609] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4825client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4826client # farm-b> LOG-farm-b-on-standby4827worker1 # [ 94.415590] nix-daemon[844]: reaped child process 1320, status = succeeded4828worker1 # [ 94.574337] nix-daemon[844]: accepted connection from pid 1335, user nix-grpc-daemon (trusted)4829worker1 # [ 94.596651] nix-daemon[844]: reaped child process 1338, status = succeeded4830lb # [ 94.665158] niks3-server[1000]: 2026/09/20 08:17:32 INFO Received uploads request method=POST path=/api/pending_closures4831worker1 # [ 94.620429] nix-grpc-daemon[1259]: time=2026-09-20T08:17:32.027Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4832worker1 # [ 94.622050] nix-grpc-daemon[1259]: time=2026-09-20T08:17:32.028Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4833lb # [ 94.701224] niks3-server[1000]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4834worker1 # [ 94.665027] nix-grpc-daemon[1259]: time=2026-09-20T08:17:32.073Z level=INFO msg="Uploading 1 narinfos"4835lb # [ 94.720508] niks3-server[1000]: 2026/09/20 08:17:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4836lb # [ 94.731364] niks3-server[1000]: 2026/09/20 08:17:32 INFO Signed narinfos id=28 count=14837lb # [ 94.737681] niks3-server[1000]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4838lb # [ 94.755295] niks3-server[1000]: 2026/09/20 08:17:32 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4839lb # [ 94.764320] niks3-server[1000]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4840lb # [ 94.767208] niks3-server[1000]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4841lb # [ 94.781393] niks3-server[1000]: 2026/09/20 08:17:32 INFO Completed upload id=284842worker1 # [ 94.725502] nix-grpc-daemon[1259]: time=2026-09-20T08:17:32.134Z level=INFO msg="Upload complete. (323ms)"4843worker1 # [ 94.743784] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45774 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14844worker1 # [ 94.760441] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:32Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04845worker1 # [ 94.767528] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:32Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=14846worker1 # [ 94.772128] nix-daemon[844]: reaped child process 1318, status = succeeded4847worker1 # [ 94.789770] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457744848worker1 # [ 94.805335] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457744849worker1 # [ 94.821116] nix-grpc-daemon[1259]: time=2026-09-20T08:17:32.229Z level=INFO msg="All 2 paths already cached"4850client # copying 1 paths to 'lb:50051'...4851client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4852worker1 # [ 94.831948] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457744853worker1 # [ 94.846397] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4854worker1 # [ 95.049951] nix-daemon[844]: accepted connection from pid 1344, user nix-grpc-daemon (trusted)4855worker1 # [ 95.071766] nix-daemon[844]: reaped child process 1347, status = succeeded4856worker1 # [ 95.250955] nix-daemon[844]: accepted connection from pid 1349, user nix-grpc-daemon (trusted)4857worker1 # [ 95.272332] nix-daemon[844]: reaped child process 1352, status = succeeded4858lb # [ 95.341004] niks3-server[1000]: 2026/09/20 08:17:32 INFO Received uploads request method=POST path=/api/pending_closures4859worker1 # [ 95.297730] nix-grpc-daemon[1259]: time=2026-09-20T08:17:32.706Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4860worker1 # [ 95.299855] nix-grpc-daemon[1259]: time=2026-09-20T08:17:32.708Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4861lb # [ 95.380994] niks3-server[1000]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst4862worker1 # [ 95.337982] nix-grpc-daemon[1259]: time=2026-09-20T08:17:32.746Z level=INFO msg="Uploading 1 narinfos"4863lb # [ 95.400821] niks3-server[1000]: 2026/09/20 08:17:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4864lb # [ 95.408743] niks3-server[1000]: 2026/09/20 08:17:32 INFO Signed narinfos id=29 count=14865lb # [ 95.411114] niks3-server[1000]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls4866lb # [ 95.416180] niks3-server[1000]: 2026/09/20 08:17:32 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4867lb # [ 95.424432] niks3-server[1000]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo4868lb # [ 95.428170] niks3-server[1000]: 2026/09/20 08:17:32 INFO Completed upload id=294869worker1 # [ 95.372163] nix-grpc-daemon[1259]: time=2026-09-20T08:17:32.780Z level=INFO msg="Upload complete. (508ms)"4870worker1 # [ 95.380308] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45774 duration_s=0 paths=1 nar_bytes_in=7684871worker1 # [ 95.396597] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457744872worker1 # [ 95.403351] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4873worker1 # [ 95.409410] nix-daemon[844]: reaped child process 1342, status = succeeded4874client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...4875client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4876worker1 # [ 95.425464] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4877client # farm-top> LOG-farm-top-on-standby4878worker1 # [ 96.251987] nix-daemon[844]: reaped child process 1356, status = succeeded4879worker1 # [ 96.414859] nix-daemon[844]: accepted connection from pid 1371, user nix-grpc-daemon (trusted)4880worker1 # [ 96.436181] nix-daemon[844]: reaped child process 1374, status = succeeded4881lb # [ 96.506009] niks3-server[1000]: 2026/09/20 08:17:33 INFO Received uploads request method=POST path=/api/pending_closures4882worker1 # [ 96.458446] nix-grpc-daemon[1259]: time=2026-09-20T08:17:33.866Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4883worker1 # [ 96.459999] nix-grpc-daemon[1259]: time=2026-09-20T08:17:33.866Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"4884lb # [ 96.542692] niks3-server[1000]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4885lb # [ 96.555342] niks3-server[1000]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst4886lb # [ 96.565709] niks3-server[1000]: 2026/09/20 08:17:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4887worker1 # [ 96.516059] nix-grpc-daemon[1259]: time=2026-09-20T08:17:33.924Z level=INFO msg="Uploading 1 narinfos"4888lb # [ 96.571925] niks3-server[1000]: 2026/09/20 08:17:34 INFO Signed narinfos id=30 count=14889lb # [ 96.577303] niks3-server[1000]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls4890lb # [ 96.590356] niks3-server[1000]: 2026/09/20 08:17:34 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4891lb # [ 96.597837] niks3-server[1000]: 2026/09/20 08:17:34 INFO Completed upload id=304892worker1 # [ 96.541157] nix-grpc-daemon[1259]: time=2026-09-20T08:17:33.949Z level=INFO msg="Upload complete. (305ms)"4893lb # [ 96.600870] niks3-server[1000]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo4894worker1 # [ 96.553089] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45774 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=14895worker1 # [ 96.571309] nix-daemon[844]: reaped child process 1354, status = succeeded4896client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&2, in 7.83 seconds)4897client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath4898client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath, in 0.24 seconds)4899worker2 # [ 96.921070] systemd[1]: Listening on Nix worker-protocol over gRPC.4900worker2 # [ 96.927907] systemd[1]: Starting Nix worker-protocol over gRPC...4901worker2 # [ 97.122763] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4902worker2 # [ 97.125339] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14903worker2 # [ 97.133137] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4904worker2 # [ 97.134934] systemd[1]: Started Nix worker-protocol over gRPC.4905lb: must succeed: curl -sf localhost:9901/clusters4906worker2 # [ 97.177886] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:34Z level=info event=scheduler_connected addr=lb:500514907worker1 # [ 97.187334] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04908lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4909worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4910worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4911lb: must succeed: curl -sf localhost:9901/clusters4912lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4913lb: must succeed: curl -sf localhost:9901/clusters4914lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4915worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4916worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)4917(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.32 seconds)4918subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise4919client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs4920client # [ 97.673790] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.4921client # Running as unit: rs.service; invocation ID: d7146d97f0304ccd84467709d1cd523d4922client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds)4923worker2 # [ 97.934655] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519404924worker2 # [ 97.950133] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)4925client # [ 97.951267] nix[1144]: don't know how to build these paths:4926client # [ 97.952489] nix[1144]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv4927worker1 # [ 97.990684] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:35Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=04928worker1 # [ 97.996919] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:35Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=14929worker1 # [ 98.036891] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457744930worker1 # [ 98.050560] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457744931client # [ 98.039975] nix[1144]: copying 1 paths to 'lb:50051'...4932client # [ 98.044382] nix[1144]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...4933worker1 # [ 98.069848] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457744934worker1 # [ 98.085607] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4935worker1 # [ 98.298004] nix-daemon[844]: accepted connection from pid 1389, user nix-grpc-daemon (trusted)4936worker1 # [ 98.319417] nix-daemon[844]: reaped child process 1392, status = succeeded4937worker1 # [ 98.496757] nix-daemon[844]: accepted connection from pid 1394, user nix-grpc-daemon (trusted)4938worker1 # [ 98.515506] nix-daemon[844]: reaped child process 1397, status = succeeded4939lb # [ 98.586481] niks3-server[1000]: 2026/09/20 08:17:36 INFO Received uploads request method=POST path=/api/pending_closures4940worker1 # [ 98.538900] nix-grpc-daemon[1259]: time=2026-09-20T08:17:35.947Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4941worker1 # [ 98.540989] nix-grpc-daemon[1259]: time=2026-09-20T08:17:35.949Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"4942lb # [ 98.617252] niks3-server[1000]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst4943worker1 # [ 98.582044] nix-grpc-daemon[1259]: time=2026-09-20T08:17:35.990Z level=INFO msg="Uploading 1 narinfos"4944lb # [ 98.637877] niks3-server[1000]: 2026/09/20 08:17:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4945lb # [ 98.643214] niks3-server[1000]: 2026/09/20 08:17:36 INFO Signed narinfos id=31 count=14946lb # [ 98.650582] niks3-server[1000]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls4947lb # [ 98.664513] niks3-server[1000]: 2026/09/20 08:17:36 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete4948lb # [ 98.670577] niks3-server[1000]: 2026/09/20 08:17:36 INFO Completed upload id=314949worker1 # [ 98.614322] nix-grpc-daemon[1259]: time=2026-09-20T08:17:36.022Z level=WARN msg="Failed to register uploaded object" key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo error="server returned 404: object is not pending upload\n"4950worker1 # [ 98.628288] nix-grpc-daemon[1259]: time=2026-09-20T08:17:36.022Z level=INFO msg="Upload complete. (511ms)"4951worker1 # [ 98.631374] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45774 duration_s=0 paths=1 nar_bytes_in=4164952worker1 # [ 98.643730] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457744953worker1 # [ 98.652220] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4954worker1 # [ 98.654849] nix-daemon[844]: reaped child process 1387, status = succeeded4955client # [ 98.640525] nix[1144]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...4956worker1 # [ 98.668498] nix-daemon[844]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4957lb: must succeed: curl -sf localhost:9901/clusters4958lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4959lb: must succeed: curl -sf localhost:9901/clusters4960lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4961lb: must succeed: curl -sf localhost:9901/clusters4962lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4963lb: must succeed: curl -sf localhost:9901/clusters4964lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4965worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true4966worker2 # [ 100.688931] systemd-journald[275]: Received client request to rotate journal, rotating.4967worker2 # [ 100.710126] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/564215b21402401c9b7de2f16b6bb8be.4968worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)4969worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service4970worker1 # [ 100.772424] systemd[1]: Stopping Nix worker-protocol over gRPC...4971worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)4972??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.4973 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5734974client: must succeed: sleep 5.04975worker1 # [ 101.129583] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:38Z level=info event=draining4976lb # [ 102.541365] envoy[916]: conn peer=[2001:db8:1::1]:42856 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9484 tx=3819 ms=75264977client: (finished: must succeed: sleep 5.0, in 5.06 seconds)4978worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='4979worker1 # [ 106.323032] nix-daemon[844]: reaped child process 1401, status = succeeded4980worker1 # [ 106.502831] nix-daemon[844]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)4981worker1 # [ 106.522344] nix-daemon[844]: reaped child process 1444, status = succeeded4982lb # [ 106.592527] niks3-server[1000]: 2026/09/20 08:17:44 INFO Received uploads request method=POST path=/api/pending_closures4983worker1 # [ 106.551420] nix-grpc-daemon[1259]: time=2026-09-20T08:17:43.957Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4984worker1 # [ 106.553223] nix-grpc-daemon[1259]: time=2026-09-20T08:17:43.957Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"4985lb # [ 106.640443] niks3-server[1000]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv4986lb # [ 106.658102] niks3-server[1000]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst4987lb # [ 106.667522] niks3-server[1000]: 2026/09/20 08:17:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign4988worker1 # [ 106.617459] nix-grpc-daemon[1259]: time=2026-09-20T08:17:44.025Z level=INFO msg="Uploading 1 narinfos"4989lb # [ 106.676796] niks3-server[1000]: 2026/09/20 08:17:44 INFO Signed narinfos id=32 count=14990lb # [ 106.679152] niks3-server[1000]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls4991lb # [ 106.694365] niks3-server[1000]: 2026/09/20 08:17:44 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete4992lb # [ 106.702107] niks3-server[1000]: 2026/09/20 08:17:44 INFO Completed upload id=324993worker1 # [ 106.645114] nix-grpc-daemon[1259]: time=2026-09-20T08:17:44.053Z level=INFO msg="Upload complete. (359ms)"4994lb # [ 106.705454] niks3-server[1000]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo4995worker1 # [ 106.661270] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45774 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=14996worker1 # [ 106.679628] nix-daemon[844]: reaped child process 1399, status = succeeded4997client # [ 106.677027] systemd[1]: rs.service: Deactivated successfully.4998client # [ 106.681462] systemd[1]: rs.service: Consumed 157ms CPU time over 9.007s wall clock time, 39.1M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.4999worker1 # [ 107.131555] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:44Z level=info event=signal_exit5000worker1 # [ 107.347298] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:44Z level=info event=scheduler_yield5001worker1 # [ 107.357800] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:44Z level=info event=scheduler_restarting addr=lb:500515002lb # [ 107.412871] niks3-server[1000]: 2026/09/20 08:17:44 INFO lead: released remote=192.168.1.3:359345003worker2 # [ 107.352727] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:44Z level=info event=scheduler_restarting addr=lb:500515004worker1 # [ 107.363341] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:457645005worker1 # [ 107.369562] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:44Z level=info event=worker_gone addr=192.168.1.3:500515006worker1 # [ 107.374876] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:457645007worker1 # [ 107.379594] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:44Z level=info event=worker_gone addr=192.168.1.4:500515008worker1 # [ 107.558952] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:44Z level=info event=scheduler_connected addr=lb:500515009worker2 # [ 107.552278] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:44Z level=info event=scheduler_connected addr=lb:500515010worker2 # [ 107.563882] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5011worker1 # [ 107.580843] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5012worker2 # [ 107.765053] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500515013worker2 # [ 107.770725] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5014worker1 # [ 107.783038] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500515015worker1 # [ 107.788462] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5016worker2 # [ 107.971598] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500515017worker2 # [ 107.977386] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5018worker1 # [ 107.989135] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500515019worker1 # [ 107.994486] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5020worker2 # [ 108.178196] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500515021worker2 # [ 108.183739] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5022worker1 # [ 108.195111] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500515023worker1 # [ 108.200864] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5024worker1 # [ 108.353449] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:45Z level=info event=scheduler_restarting5025worker1 # [ 108.372353] nix-grpc-daemon[1184]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5026worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.21 seconds)5027worker1 # [ 108.380471] nix-grpc-daemon[1184]: E0000 00:00:1789892265.780452 1227 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5028client: waiting for success: ! systemctl is-active rs5029worker2 # [ 108.386063] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500515030worker1 # [ 108.396565] nix-grpc-daemon[1184]: E0000 00:00:1789892265.780916 1227 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5031worker1 # [ 108.424333] nix-grpc-daemon[1184]: E0000 00:00:1789892265.804832 1227 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5032worker1 # [ 108.428584] nix-grpc-daemon[1184]: ts=2026-09-20T08:17:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5033worker1 # [ 108.431975] nix-daemon[844]: reaped child process 1250, status = succeeded5034client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5035client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5036client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5037client: must fail: journalctl -u rs | grep -q 'reconnecting'5038client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5039lb: must succeed: curl -sf localhost:9901/clusters5040lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5041worker2 # [ 109.375739] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:46Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5042worker1 # [ 109.404992] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5043worker1 # [ 109.410049] systemd[1]: Stopped Nix worker-protocol over gRPC.5044worker1 # [ 109.415844] systemd[1]: nix-grpc-daemon.service: Consumed 1.932s CPU time over 26.513s wall clock time, 36.4M memory peak, 45.7K incoming IP traffic, 83.7K outgoing IP traffic.5045worker1 # [ 109.434567] systemd[1]: Starting Nix worker-protocol over gRPC...5046worker2 # [ 109.577899] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:47Z level=info event=scheduler_connected addr=lb:500515047worker2 # [ 109.584619] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5048worker1 # [ 109.636734] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5049worker1 # [ 109.639024] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15050lb: must succeed: curl -sf localhost:9901/clusters5051worker1 # [ 109.646798] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5052worker1 # [ 109.651166] systemd[1]: Started Nix worker-protocol over gRPC.5053worker1 # [ 109.660435] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:47Z level=info event=scheduler_take_over5054lb # [ 109.714809] niks3-server[1000]: 2026/09/20 08:17:47 INFO lead: acquired remote=192.168.1.3:345785055worker1 # [ 109.689751] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:47Z level=info event=scheduler_connected addr=lb:500515056worker1 # [ 109.703294] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05057lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5058worker2 # [ 109.785750] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:47Z level=info event=scheduler_connected addr=lb:500515059worker2 # [ 109.793017] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5060worker2 # [ 109.994040] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:47Z level=info event=scheduler_connected addr=lb:500515061worker1 # [ 110.003474] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05062lb: must succeed: curl -sf localhost:9901/clusters5063lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5064worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5065worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5066(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.29 seconds)5067subtest: scheduler restart mid-build: build finishes, no double build5068client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5069client # [ 110.965092] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5070client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5071client # Running as unit: mid.service; invocation ID: 418a542002e24cc3b0347269fb7f81915072client # [ 111.210201] nix[1179]: don't know how to build these paths:5073client # [ 111.212031] nix[1179]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5074worker2 # [ 111.226041] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519405075worker1 # [ 111.249506] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:48Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05076worker1 # [ 111.256249] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:48Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15077worker1 # [ 111.309740] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471105078worker1 # [ 111.325295] nix-daemon[844]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)5079worker1 # [ 111.349871] nix-grpc-daemon[1451]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5)5080worker1 # [ 111.398601] nix-grpc-daemon[1451]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 2/5)5081worker1 # [ 111.408214] nix-grpc-daemon[1451]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 144 ms (attempt 3/5)5082worker1 # [ 111.551107] nix-grpc-daemon[1451]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 794 ms (attempt 4/5)5083worker1 # [ 112.354946] nix-grpc-daemon[1451]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5084worker1 # [ 112.377587] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471105085client # [ 112.369240] nix[1179]: copying 1 paths to 'lb:50051'...5086worker1 # [ 112.396463] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471105087client # [ 112.374430] nix[1179]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5088worker1 # [ 112.416514] nix-daemon[844]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)5089worker1 # [ 112.445461] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:49Z level=info event=niks3_push_started pid=15225090lb # [ 112.540554] envoy[916]: conn peer=[2001:db8:1::1]:45046 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2940 tx=1326 ms=87335091lb # [ 112.540913] envoy[916]: conn peer=[2001:db8:1::3]:54892 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3350 tx=1207 ms=252665092worker1 # [ 112.841180] nix-daemon[844]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5093worker1 # [ 112.861930] nix-daemon[844]: reaped child process 1538, status = succeeded5094worker1 # [ 113.044535] nix-daemon[844]: accepted connection from pid 1540, user nix-grpc-daemon (trusted)5095worker1 # [ 113.062802] nix-daemon[844]: reaped child process 1543, status = succeeded5096lb # [ 113.133998] niks3-server[1000]: 2026/09/20 08:17:50 INFO Received uploads request method=POST path=/api/pending_closures5097worker1 # [ 113.089779] nix-grpc-daemon[1522]: time=2026-09-20T08:17:50.496Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5098worker1 # [ 113.091382] nix-grpc-daemon[1522]: time=2026-09-20T08:17:50.496Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5099lb # [ 113.168319] niks3-server[1000]: 2026/09/20 08:17:50 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5100lb # [ 113.178887] niks3-server[1000]: 2026/09/20 08:17:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5101worker1 # [ 113.128220] nix-grpc-daemon[1522]: time=2026-09-20T08:17:50.536Z level=INFO msg="Uploading 1 narinfos"5102lb # [ 113.189012] niks3-server[1000]: 2026/09/20 08:17:50 INFO Signed narinfos id=33 count=15103lb # [ 113.194394] niks3-server[1000]: 2026/09/20 08:17:50 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5104lb # [ 113.201456] niks3-server[1000]: 2026/09/20 08:17:50 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5105lb # [ 113.210636] niks3-server[1000]: 2026/09/20 08:17:50 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5106lb # [ 113.214333] niks3-server[1000]: 2026/09/20 08:17:50 INFO Completed upload id=335107worker1 # [ 113.158197] nix-grpc-daemon[1522]: time=2026-09-20T08:17:50.566Z level=INFO msg="Upload complete. (497ms)"5108worker1 # [ 113.164327] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47110 duration_s=0 paths=1 nar_bytes_in=4245109worker1 # [ 113.178356] nix-grpc-daemon[1451]: ts=2026-09-20T08:17:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471105110worker1 # [ 113.185383] nix-daemon[844]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)5111worker1 # [ 113.190370] nix-daemon[844]: reaped child process 1520, status = succeeded5112client # [ 113.175562] nix[1179]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5113worker1 # [ 113.202970] nix-daemon[844]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)5114lb: must succeed: curl -sf localhost:9901/clusters5115lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5116lb: must succeed: curl -sf localhost:9901/clusters5117lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5118worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5119worker1 # [ 115.022679] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1451 (nix-grpc-daemon) on client request.5120worker1 # [ 115.025646] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5121client # [ 115.002274] nix[1179]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5122worker2 # [ 115.018963] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5123client # [ 115.008665] nix[1179]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5124lb # [ 115.089310] niks3-server[1000]: 2026/09/20 08:17:52 INFO lead: released remote=192.168.1.3:345785125worker1 # [ 115.057310] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5126worker1 # [ 115.059031] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5127worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.09 seconds)5128client: must succeed: sleep 5.05129worker1 # [ 115.070469] systemd[1]: nix-grpc-daemon.service: Consumed 528ms CPU time over 5.621s wall clock time, 34.2M memory peak, 11.6K incoming IP traffic, 14.5K outgoing IP traffic.5130worker1 # [ 115.080139] nix-daemon[844]: reaped child process 1511, status = succeeded5131worker1 # [ 115.082587] nix-daemon[844]: reaped child process 1545, status = succeeded5132worker1 # [ 115.092721] nix-daemon[1547]: unexpected Nix daemon error: error: interrupted by the user5133worker1 # [ 115.097900] nix-daemon[844]: reaped child process 1547, status = failed with exit code 15134worker2 # [ 115.218819] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:52Z level=info event=scheduler_connected addr=lb:500515135worker1 # [ 115.228617] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5136worker1 # [ 115.238869] systemd[1]: Starting Nix worker-protocol over gRPC...5137worker1 # [ 115.443375] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5138worker1 # [ 115.445894] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15139worker1 # [ 115.453131] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5140worker1 # [ 115.467034] systemd[1]: Started Nix worker-protocol over gRPC.5141worker2 # [ 115.461360] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5142lb # [ 115.531398] niks3-server[1000]: 2026/09/20 08:17:52 INFO lead: acquired remote=192.168.1.3:584545143worker1 # [ 115.480762] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:52Z level=info event=scheduler_take_over5144worker1 # [ 115.503214] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:52Z level=info event=scheduler_connected addr=lb:500515145worker1 # [ 115.505351] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05146worker1 # [ 115.534575] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:52Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05147worker1 # [ 115.537753] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:52Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15148worker1 # [ 115.583330] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471525149worker1 # [ 115.592543] nix-daemon[844]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)5150worker1 # [ 115.606458] nix-daemon[844]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)5151worker1 # [ 115.617361] nix-daemon[844]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)5152client # [ 115.592392] nix[1179]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5153worker2 # [ 115.662209] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:53Z level=info event=scheduler_connected addr=lb:500515154worker1 # [ 115.671045] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05155client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5156client: waiting for success: ! systemctl is-active mid5157worker1 # [ 120.437048] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:57Z level=info event=niks3_push_started pid=16625158worker1 # [ 120.466124] nix-daemon[844]: reaped child process 1638, status = succeeded5159worker1 # [ 120.824614] nix-daemon[844]: accepted connection from pid 1675, user nix-grpc-daemon (trusted)5160worker1 # [ 120.844940] nix-daemon[844]: reaped child process 1678, status = succeeded5161lb # [ 120.914037] niks3-server[1000]: 2026/09/20 08:17:58 INFO Received uploads request method=POST path=/api/pending_closures5162worker1 # [ 120.868462] nix-grpc-daemon[1662]: time=2026-09-20T08:17:58.276Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5163worker1 # [ 120.870066] nix-grpc-daemon[1662]: time=2026-09-20T08:17:58.276Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5164lb # [ 120.963348] niks3-server[1000]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5165lb # [ 120.978664] niks3-server[1000]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5166worker1 # [ 120.932108] nix-grpc-daemon[1662]: time=2026-09-20T08:17:58.339Z level=INFO msg="Uploading 1 narinfos"5167lb # [ 120.989685] niks3-server[1000]: 2026/09/20 08:17:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5168lb # [ 121.000754] niks3-server[1000]: 2026/09/20 08:17:58 INFO Signed narinfos id=34 count=15169lb # [ 121.009979] niks3-server[1000]: 2026/09/20 08:17:58 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5170lb # [ 121.071553] niks3-server[1000]: 2026/09/20 08:17:58 INFO Completed upload id=345171worker1 # [ 121.015946] nix-grpc-daemon[1662]: time=2026-09-20T08:17:58.424Z level=INFO msg="Upload complete. (364ms)"5172lb # [ 121.091402] niks3-server[1000]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5173worker1 # [ 121.032515] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47152 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15174lb # [ 121.098575] niks3-server[1000]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5175worker1 # [ 121.055251] nix-daemon[844]: reaped child process 1636, status = succeeded5176client # [ 121.049341] systemd[1]: mid.service: Deactivated successfully.5177client # [ 121.054586] systemd[1]: mid.service: Consumed 172ms CPU time over 10.085s wall clock time, 37M memory peak, 9.5K incoming IP traffic, 10.8K outgoing IP traffic.5178client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5179client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5180client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5181(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.71 seconds)5182subtest: interrupting the client stops the build on the worker5183client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5184client # [ 121.648974] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5185client # Running as unit: intr.service; invocation ID: 623ea7d81c574e2ea3199f22e5248b465186client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5187client # [ 121.883560] nix[1214]: don't know how to build these paths:5188client # [ 121.884745] nix[1214]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5189worker1 # [ 121.905904] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:471525190worker1 # [ 121.922965] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:59Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05191worker1 # [ 121.929235] nix-grpc-daemon[1583]: ts=2026-09-20T08:17:59Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15192worker2 # [ 121.963450] nix-grpc-daemon[1159]: ts=2026-09-20T08:17:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519405193worker2 # [ 121.979777] nix-grpc-daemon[1159]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 1/5)5194worker2 # [ 121.989459] nix-grpc-daemon[1159]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 2/5)5195worker2 # [ 122.055111] nix-grpc-daemon[1159]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 307 ms (attempt 3/5)5196worker2 # [ 122.370019] nix-grpc-daemon[1159]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 558 ms (attempt 4/5)5197lb # [ 122.542646] envoy[916]: conn peer=[2001:db8:1::3]:39662 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=475 tx=226 ms=53455198lb # [ 122.542999] envoy[916]: conn peer=[2001:db8:1::1]:57160 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3871 tx=1675 ms=98165199worker2 # [ 122.928945] nix-grpc-daemon[1159]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5200worker2 # [ 122.954551] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519405201client # [ 122.953256] nix[1214]: copying 1 paths to 'lb:50051'...5202worker2 # [ 122.970741] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519405203client # [ 122.953577] nix[1214]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5204worker2 # [ 122.990777] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5205worker2 # [ 123.019036] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:00Z level=info event=niks3_push_started pid=13035206worker2 # [ 123.407770] nix-daemon[835]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5207worker2 # [ 123.428049] nix-daemon[835]: reaped child process 1319, status = succeeded5208worker2 # [ 123.608580] nix-daemon[835]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5209worker2 # [ 123.627511] nix-daemon[835]: reaped child process 1324, status = succeeded5210lb # [ 123.703727] niks3-server[1000]: 2026/09/20 08:18:01 INFO Received uploads request method=POST path=/api/pending_closures5211worker2 # [ 123.655205] nix-grpc-daemon[1303]: time=2026-09-20T08:18:01.093Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5212worker2 # [ 123.658662] nix-grpc-daemon[1303]: time=2026-09-20T08:18:01.095Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5213lb # [ 123.749946] niks3-server[1000]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5214worker2 # [ 123.698132] nix-grpc-daemon[1303]: time=2026-09-20T08:18:01.136Z level=INFO msg="Uploading 1 narinfos"5215lb # [ 123.760880] niks3-server[1000]: 2026/09/20 08:18:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5216lb # [ 123.769043] niks3-server[1000]: 2026/09/20 08:18:01 INFO Signed narinfos id=35 count=15217lb # [ 123.780154] niks3-server[1000]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5218lb # [ 123.795228] niks3-server[1000]: 2026/09/20 08:18:01 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5219lb # [ 123.802026] niks3-server[1000]: 2026/09/20 08:18:01 INFO Completed upload id=355220worker2 # [ 123.737711] nix-grpc-daemon[1303]: time=2026-09-20T08:18:01.176Z level=INFO msg="Upload complete. (502ms)"5221lb # [ 123.804594] niks3-server[1000]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5222worker2 # [ 123.749095] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=0 paths=1 nar_bytes_in=4245223worker2 # [ 123.761040] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519405224worker2 # [ 123.773069] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5225worker2 # [ 123.779399] nix-daemon[835]: reaped child process 1300, status = succeeded5226worker2 # [ 123.791354] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5227client # [ 123.772631] nix[1214]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5228client: must succeed: systemctl kill -s INT intr5229client # [ 125.442800] systemd[1]: intr.service: Sent signal SIGINT to main process 1214 (nix) on client request.5230client # [ 125.452762] nix[1214]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5231client # [ 125.455463] nix[1214]: error: interrupted by the user5232client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5233client # [ 125.500886] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5234client # [ 125.506083] systemd[1]: intr.service: Failed with result 'exit-code'.5235client # [ 125.508425] systemd[1]: intr.service: Consumed 152ms CPU time over 3.855s wall clock time, 39.2M memory peak, 7.9K incoming IP traffic, 8.7K outgoing IP traffic.5236worker2 # [ 125.636446] nix-daemon[835]: reaped child process 1326, status = succeeded5237worker2 # [ 125.640666] nix-daemon[1328]: unexpected Nix daemon error: error: interrupted by the user5238(finished: subtest: interrupting the client stops the build on the worker, in 4.02 seconds)5239subtest: a deploy mid-build drains: the build finishes, the new generation takes over5240client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5241worker2 # [ 125.650272] nix-daemon[835]: reaped child process 1328, status = failed with exit code 15242client # [ 125.699698] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5243client # Running as unit: sw.service; invocation ID: c5a59b2ffb8b429884bc72aef6223f315244client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds)5245client # [ 125.944239] nix[1233]: don't know how to build these paths:5246client # [ 125.945252] nix[1233]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5247worker2 # [ 125.960099] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519405248worker1 # [ 125.977439] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:03Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05249worker1 # [ 125.985069] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:03Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15250worker1 # [ 126.029222] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471525251worker1 # [ 126.046569] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5)5252worker1 # [ 126.115887] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 157 ms (attempt 2/5)5253worker1 # [ 126.281018] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 345 ms (attempt 3/5)5254worker1 # [ 126.634505] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 111 ms (attempt 4/5)5255worker1 # [ 126.753909] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5256worker1 # [ 126.776566] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471525257client # [ 126.766753] nix[1233]: copying 1 paths to 'lb:50051'...5258client # [ 126.772741] nix[1233]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5259worker1 # [ 126.797711] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471525260worker1 # [ 126.813315] nix-daemon[844]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)5261worker1 # [ 127.041840] nix-daemon[844]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)5262worker1 # [ 127.060734] nix-daemon[844]: reaped child process 1720, status = succeeded5263worker1 # [ 127.240406] nix-daemon[844]: accepted connection from pid 1722, user nix-grpc-daemon (trusted)5264worker1 # [ 127.258361] nix-daemon[844]: reaped child process 1725, status = succeeded5265lb # [ 127.330270] niks3-server[1000]: 2026/09/20 08:18:04 INFO Received uploads request method=POST path=/api/pending_closures5266worker1 # [ 127.284686] nix-grpc-daemon[1662]: time=2026-09-20T08:18:04.692Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5267worker1 # [ 127.286234] nix-grpc-daemon[1662]: time=2026-09-20T08:18:04.692Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5268lb # [ 127.368869] niks3-server[1000]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5269lb # [ 127.389624] niks3-server[1000]: 2026/09/20 08:18:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5270worker1 # [ 127.338277] nix-grpc-daemon[1662]: time=2026-09-20T08:18:04.746Z level=INFO msg="Uploading 1 narinfos"5271lb # [ 127.398749] niks3-server[1000]: 2026/09/20 08:18:04 INFO Signed narinfos id=36 count=15272lb # [ 127.403673] niks3-server[1000]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5273lb # [ 127.419158] niks3-server[1000]: 2026/09/20 08:18:04 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5274lb # [ 127.425623] niks3-server[1000]: 2026/09/20 08:18:04 INFO Completed upload id=365275worker1 # [ 127.367541] nix-grpc-daemon[1662]: time=2026-09-20T08:18:04.776Z level=INFO msg="Upload complete. (536ms)"5276lb # [ 127.428234] niks3-server[1000]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5277worker1 # [ 127.381035] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47152 duration_s=0 paths=1 nar_bytes_in=4165278worker1 # [ 127.396439] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471525279worker1 # [ 127.403193] nix-daemon[844]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)5280worker1 # [ 127.408989] nix-daemon[844]: reaped child process 1711, status = succeeded5281client # [ 127.396904] nix[1233]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5282worker1 # [ 127.424345] nix-daemon[844]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)5283worker1: must succeed: systemctl reload nix-grpc-daemon.service5284worker1 # [ 129.631808] systemd[1]: Reloading Nix worker-protocol over gRPC...5285worker1 # [ 129.685188] systemd[1]: Reloaded Nix worker-protocol over gRPC.5286worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5287worker1: must succeed: pgrep -f 'read -t [9]0 x'5288worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5289client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&25290client # don't know how to build these paths:5291client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5292worker2 # [ 130.005524] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519405293worker1 # [ 130.023293] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:07Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05294worker1 # [ 130.028179] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:07Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15295worker2 # [ 130.065078] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519405296worker2 # [ 130.082919] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519405297client # copying 1 paths to 'lb:50051'...5298worker2 # [ 130.101364] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519405299client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5300worker2 # [ 130.127953] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5301worker2 # [ 130.354001] nix-daemon[835]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5302worker2 # [ 130.374208] nix-daemon[835]: reaped child process 1381, status = succeeded5303worker1 # [ 130.465363] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:07Z level=info event=draining5304worker2 # [ 130.554875] nix-daemon[835]: accepted connection from pid 1383, user nix-grpc-daemon (trusted)5305worker2 # [ 130.574801] nix-daemon[835]: reaped child process 1386, status = succeeded5306lb # [ 130.650806] niks3-server[1000]: 2026/09/20 08:18:08 INFO Received uploads request method=POST path=/api/pending_closures5307worker2 # [ 130.600654] nix-grpc-daemon[1303]: time=2026-09-20T08:18:08.038Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5308worker2 # [ 130.603149] nix-grpc-daemon[1303]: time=2026-09-20T08:18:08.038Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5309lb # [ 130.688980] niks3-server[1000]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5310worker2 # [ 130.638786] nix-grpc-daemon[1303]: time=2026-09-20T08:18:08.077Z level=INFO msg="Uploading 1 narinfos"5311lb # [ 130.706021] niks3-server[1000]: 2026/09/20 08:18:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5312lb # [ 130.718068] niks3-server[1000]: 2026/09/20 08:18:08 INFO Signed narinfos id=37 count=15313lb # [ 130.722550] niks3-server[1000]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5314lb # [ 130.731589] niks3-server[1000]: 2026/09/20 08:18:08 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5315lb # [ 130.736698] niks3-server[1000]: 2026/09/20 08:18:08 INFO Completed upload id=375316worker2 # [ 130.666997] nix-grpc-daemon[1303]: time=2026-09-20T08:18:08.105Z level=INFO msg="Upload complete. (520ms)"5317lb # [ 130.739809] niks3-server[1000]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5318worker2 # [ 130.677608] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=0 paths=1 nar_bytes_in=5285319worker2 # [ 130.692310] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519405320worker2 # [ 130.698267] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5321worker2 # [ 130.703435] nix-daemon[835]: reaped child process 1376, status = succeeded5322client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5323worker2 # [ 130.716294] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5324client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5325client # farm-a> LOG-farm-a-during-drain5326worker2 # [ 131.962137] nix-daemon[835]: reaped child process 1390, status = succeeded5327worker2 # [ 132.144323] nix-daemon[835]: accepted connection from pid 1405, user nix-grpc-daemon (trusted)5328worker2 # [ 132.166943] nix-daemon[835]: reaped child process 1408, status = succeeded5329lb # [ 132.242435] niks3-server[1000]: 2026/09/20 08:18:09 INFO Received uploads request method=POST path=/api/pending_closures5330worker2 # [ 132.189768] nix-grpc-daemon[1303]: time=2026-09-20T08:18:09.628Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5331worker2 # [ 132.195049] nix-grpc-daemon[1303]: time=2026-09-20T08:18:09.630Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5332lb # [ 132.284912] niks3-server[1000]: 2026/09/20 08:18:09 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5333lb # [ 132.296759] niks3-server[1000]: 2026/09/20 08:18:09 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5334lb # [ 132.308392] niks3-server[1000]: 2026/09/20 08:18:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5335worker2 # [ 132.250855] nix-grpc-daemon[1303]: time=2026-09-20T08:18:09.688Z level=INFO msg="Uploading 1 narinfos"5336lb # [ 132.317441] niks3-server[1000]: 2026/09/20 08:18:09 INFO Signed narinfos id=38 count=15337lb # [ 132.323589] niks3-server[1000]: 2026/09/20 08:18:09 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5338lb # [ 132.333334] niks3-server[1000]: 2026/09/20 08:18:09 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5339lb # [ 132.341313] niks3-server[1000]: 2026/09/20 08:18:09 INFO Completed upload id=385340worker2 # [ 132.278131] nix-grpc-daemon[1303]: time=2026-09-20T08:18:09.716Z level=INFO msg="Upload complete. (350ms)"5341lb # [ 132.344249] niks3-server[1000]: 2026/09/20 08:18:09 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5342worker1 # [ 132.301123] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:09Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05343worker2 # [ 132.289415] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15344worker1 # [ 132.302996] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:09Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15345worker2 # [ 132.311838] nix-daemon[835]: reaped child process 1388, status = succeeded5346worker2 # [ 132.347326] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519405347worker2 # [ 132.365079] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519405348worker2 # [ 132.382315] nix-grpc-daemon[1303]: time=2026-09-20T08:18:09.821Z level=INFO msg="All 1 paths already cached"5349client # copying 1 paths to 'lb:50051'...5350worker2 # [ 132.392980] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519405351client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5352worker2 # [ 132.418291] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5353lb # [ 132.541923] envoy[916]: conn peer=[2001:db8:1::1]:58010 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=756 ms=35965354worker2 # [ 132.631126] nix-daemon[835]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5355worker2 # [ 132.652870] nix-daemon[835]: reaped child process 1415, status = succeeded5356worker2 # [ 132.829588] nix-daemon[835]: accepted connection from pid 1417, user nix-grpc-daemon (trusted)5357worker2 # [ 132.848921] nix-daemon[835]: reaped child process 1420, status = succeeded5358lb # [ 132.924971] niks3-server[1000]: 2026/09/20 08:18:10 INFO Received uploads request method=POST path=/api/pending_closures5359worker2 # [ 133.032185] nix-grpc-daemon[1303]: time=2026-09-20T08:18:10.470Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5360worker2 # [ 133.038303] nix-grpc-daemon[1303]: time=2026-09-20T08:18:10.470Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5361lb # [ 133.125362] niks3-server[1000]: 2026/09/20 08:18:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5362worker2 # [ 133.068899] nix-grpc-daemon[1303]: time=2026-09-20T08:18:10.506Z level=INFO msg="Uploading 1 narinfos"5363lb # [ 133.136374] niks3-server[1000]: 2026/09/20 08:18:10 INFO Signed narinfos id=39 count=15364lb # [ 133.139586] niks3-server[1000]: 2026/09/20 08:18:10 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5365lb # [ 133.155248] niks3-server[1000]: 2026/09/20 08:18:10 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5366lb # [ 133.164312] niks3-server[1000]: 2026/09/20 08:18:10 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5367lb # [ 133.169491] niks3-server[1000]: 2026/09/20 08:18:10 INFO Completed upload id=395368worker2 # [ 133.105910] nix-grpc-daemon[1303]: time=2026-09-20T08:18:10.544Z level=INFO msg="Upload complete. (669ms)"5369lb # [ 133.176106] niks3-server[1000]: 2026/09/20 08:18:10 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5370worker2 # [ 133.116342] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=0 paths=1 nar_bytes_in=6405371worker2 # [ 133.136582] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519405372worker2 # [ 133.146996] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5373worker2 # [ 133.154656] nix-daemon[835]: reaped child process 1410, status = succeeded5374client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5375client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5376worker2 # [ 133.172267] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5377client # farm-b> LOG-farm-b-during-drain5378worker2 # [ 134.621961] nix-daemon[835]: reaped child process 1424, status = succeeded5379worker2 # [ 134.812205] nix-daemon[835]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5380worker2 # [ 134.832485] nix-daemon[835]: reaped child process 1442, status = succeeded5381lb # [ 134.909333] niks3-server[1000]: 2026/09/20 08:18:12 INFO Received uploads request method=POST path=/api/pending_closures5382worker2 # [ 134.858645] nix-grpc-daemon[1303]: time=2026-09-20T08:18:12.296Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5383worker2 # [ 134.860819] nix-grpc-daemon[1303]: time=2026-09-20T08:18:12.296Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5384lb # [ 134.945747] niks3-server[1000]: 2026/09/20 08:18:12 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5385lb # [ 134.960237] niks3-server[1000]: 2026/09/20 08:18:12 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5386lb # [ 134.972221] niks3-server[1000]: 2026/09/20 08:18:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5387lb # [ 134.978956] niks3-server[1000]: 2026/09/20 08:18:12 INFO Signed narinfos id=40 count=15388worker2 # [ 134.915921] nix-grpc-daemon[1303]: time=2026-09-20T08:18:12.354Z level=INFO msg="Uploading 1 narinfos"5389lb # [ 134.983357] niks3-server[1000]: 2026/09/20 08:18:12 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5390lb # [ 134.995819] niks3-server[1000]: 2026/09/20 08:18:12 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5391lb # [ 135.010592] niks3-server[1000]: 2026/09/20 08:18:12 INFO Completed upload id=405392worker2 # [ 134.947553] nix-grpc-daemon[1303]: time=2026-09-20T08:18:12.386Z level=INFO msg="Upload complete. (360ms)"5393lb # [ 135.013992] niks3-server[1000]: 2026/09/20 08:18:12 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5394worker1 # [ 134.969019] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:12Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05395worker1 # [ 134.971333] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:12Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15396worker2 # [ 134.961293] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15397worker2 # [ 134.981285] nix-daemon[835]: reaped child process 1422, status = succeeded5398worker2 # [ 135.010820] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519405399worker2 # [ 135.027762] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519405400worker2 # [ 135.043504] nix-grpc-daemon[1303]: time=2026-09-20T08:18:12.482Z level=INFO msg="All 2 paths already cached"5401client # copying 1 paths to 'lb:50051'...5402client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5403worker2 # [ 135.054680] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519405404worker2 # [ 135.073272] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5405worker2 # [ 135.278889] nix-daemon[835]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5406worker2 # [ 135.300930] nix-daemon[835]: reaped child process 1449, status = succeeded5407worker2 # [ 135.483211] nix-daemon[835]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)5408worker2 # [ 135.501798] nix-daemon[835]: reaped child process 1454, status = succeeded5409lb # [ 135.577518] niks3-server[1000]: 2026/09/20 08:18:13 INFO Received uploads request method=POST path=/api/pending_closures5410worker2 # [ 135.597545] nix-grpc-daemon[1303]: time=2026-09-20T08:18:13.035Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5411worker2 # [ 135.599912] nix-grpc-daemon[1303]: time=2026-09-20T08:18:13.035Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5412lb # [ 135.687416] niks3-server[1000]: 2026/09/20 08:18:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5413worker2 # [ 135.632370] nix-grpc-daemon[1303]: time=2026-09-20T08:18:13.070Z level=INFO msg="Uploading 1 narinfos"5414lb # [ 135.698394] niks3-server[1000]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5415lb # [ 135.717318] niks3-server[1000]: 2026/09/20 08:18:13 INFO Signed narinfos id=41 count=15416lb # [ 135.721936] niks3-server[1000]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5417lb # [ 135.726414] niks3-server[1000]: 2026/09/20 08:18:13 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5418lb # [ 135.731691] niks3-server[1000]: 2026/09/20 08:18:13 INFO Completed upload id=415419worker2 # [ 135.667896] nix-grpc-daemon[1303]: time=2026-09-20T08:18:13.106Z level=INFO msg="Upload complete. (574ms)"5420lb # [ 135.735164] niks3-server[1000]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5421worker2 # [ 135.680553] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=0 paths=1 nar_bytes_in=7685422worker2 # [ 135.696387] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519405423worker2 # [ 135.707586] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5424worker2 # [ 135.714826] nix-daemon[835]: reaped child process 1444, status = succeeded5425client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5426worker2 # [ 135.728671] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5427client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5428client # farm-top> LOG-farm-top-during-drain5429worker2 # [ 136.377344] nix-daemon[835]: reaped child process 1458, status = succeeded5430worker2 # [ 136.558145] nix-daemon[835]: accepted connection from pid 1473, user nix-grpc-daemon (trusted)5431worker2 # [ 136.577510] nix-daemon[835]: reaped child process 1476, status = succeeded5432lb # [ 136.655374] niks3-server[1000]: 2026/09/20 08:18:14 INFO Received uploads request method=POST path=/api/pending_closures5433worker2 # [ 136.603469] nix-grpc-daemon[1303]: time=2026-09-20T08:18:14.040Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5434worker2 # [ 136.605477] nix-grpc-daemon[1303]: time=2026-09-20T08:18:14.040Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5435lb # [ 136.693496] niks3-server[1000]: 2026/09/20 08:18:14 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5436lb # [ 136.704587] niks3-server[1000]: 2026/09/20 08:18:14 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5437worker2 # [ 136.654289] nix-grpc-daemon[1303]: time=2026-09-20T08:18:14.092Z level=INFO msg="Uploading 1 narinfos"5438lb # [ 136.721769] niks3-server[1000]: 2026/09/20 08:18:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5439lb # [ 136.730238] niks3-server[1000]: 2026/09/20 08:18:14 INFO Signed narinfos id=42 count=15440lb # [ 136.737570] niks3-server[1000]: 2026/09/20 08:18:14 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5441worker2 # [ 136.678389] nix-grpc-daemon[1303]: time=2026-09-20T08:18:14.117Z level=INFO msg="Upload complete. (333ms)"5442lb # [ 136.742153] niks3-server[1000]: 2026/09/20 08:18:14 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5443lb # [ 136.746573] niks3-server[1000]: 2026/09/20 08:18:14 INFO Completed upload id=425444lb # [ 136.750005] niks3-server[1000]: 2026/09/20 08:18:14 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5445worker2 # [ 136.689233] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15446worker2 # [ 136.709868] nix-daemon[835]: reaped child process 1456, status = succeeded5447client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&2, in 7.00 seconds)5448client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath5449client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath, in 0.24 seconds)5450worker1: must succeed: pkill -f 'read -t [9]0 x'5451worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.07 seconds)5452client: waiting for success: ! systemctl is-active sw5453worker1 # [ 137.284761] nix-daemon[844]: reaped child process 1729, status = succeeded5454worker1 # [ 137.472133] nix-daemon[844]: accepted connection from pid 1775, user nix-grpc-daemon (trusted)5455worker1 # [ 137.493302] nix-daemon[844]: reaped child process 1778, status = succeeded5456lb # [ 137.564079] niks3-server[1000]: 2026/09/20 08:18:15 INFO Received uploads request method=POST path=/api/pending_closures5457worker1 # [ 137.521962] nix-grpc-daemon[1662]: time=2026-09-20T08:18:14.929Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5458worker1 # [ 137.523728] nix-grpc-daemon[1662]: time=2026-09-20T08:18:14.929Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5459lb # [ 137.603492] niks3-server[1000]: 2026/09/20 08:18:15 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5460lb # [ 137.616427] niks3-server[1000]: 2026/09/20 08:18:15 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5461lb # [ 137.624283] niks3-server[1000]: 2026/09/20 08:18:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5462worker1 # [ 137.575197] nix-grpc-daemon[1662]: time=2026-09-20T08:18:14.982Z level=INFO msg="Uploading 1 narinfos"5463lb # [ 137.630916] niks3-server[1000]: 2026/09/20 08:18:15 INFO Signed narinfos id=43 count=15464lb # [ 137.634626] niks3-server[1000]: 2026/09/20 08:18:15 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5465lb # [ 137.647351] niks3-server[1000]: 2026/09/20 08:18:15 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5466lb # [ 137.654035] niks3-server[1000]: 2026/09/20 08:18:15 INFO Completed upload id=435467worker1 # [ 137.597519] nix-grpc-daemon[1662]: time=2026-09-20T08:18:15.006Z level=INFO msg="Upload complete. (351ms)"5468lb # [ 137.658071] niks3-server[1000]: 2026/09/20 08:18:15 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5469worker1 # [ 137.610781] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47152 duration_s=10 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15470worker1 # [ 137.630261] nix-daemon[844]: reaped child process 1727, status = succeeded5471client # [ 137.629218] systemd[1]: sw.service: Deactivated successfully.5472client # [ 137.633981] systemd[1]: sw.service: Consumed 168ms CPU time over 11.932s wall clock time, 37M memory peak, 8.7K incoming IP traffic, 9.1K outgoing IP traffic.5473client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5474client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5475client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5476worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5477worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.07 seconds)5478lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5479lb: must succeed: curl -sf localhost:9901/clusters5480lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5481worker1 # [ 138.468153] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:15Z level=info event=signal_exit5482worker1 # [ 138.701350] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=scheduler_yield5483lb # [ 138.758388] niks3-server[1000]: 2026/09/20 08:18:16 INFO lead: released remote=192.168.1.3:584545484worker2 # [ 138.697865] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:16Z level=info event=scheduler_restarting addr=lb:500515485worker1 # [ 138.709738] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:471225486worker1 # [ 138.717775] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=worker_gone addr=192.168.1.4:500515487worker1 # [ 138.722295] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=scheduler_restarting addr=lb:500515488worker1 # [ 138.726613] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:471225489worker1 # [ 138.731380] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=worker_gone addr=192.168.1.3:500515490worker2 # [ 138.897857] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500515491worker2 # [ 138.905314] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5492worker1 # [ 138.917888] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500515493worker1 # [ 138.929089] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5494worker2 # [ 139.106380] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500515495worker2 # [ 139.113000] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5496worker1 # [ 139.130466] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500515497worker1 # [ 139.137986] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5498worker2 # [ 139.314119] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500515499worker2 # [ 139.320950] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5500worker1 # [ 139.338899] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500515501worker1 # [ 139.347048] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5502lb: must succeed: curl -sf localhost:9901/clusters5503lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5504worker2 # [ 139.522014] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500515505worker2 # [ 139.528758] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5506worker1 # [ 139.548298] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500515507worker1 # [ 139.555695] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5508worker1 # [ 139.706430] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:17Z level=info event=scheduler_restarting5509worker1 # [ 139.735292] nix-daemon[844]: reaped child process 1634, status = succeeded5510worker2 # [ 139.731976] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:17Z level=info event=scheduler_connected addr=lb:500515511worker2 # [ 139.737278] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5512worker1 # [ 139.776796] nix-grpc-daemon[1583]: ts=2026-09-20T08:18:17Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5513worker2 # [ 139.938214] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:17Z level=info event=scheduler_connected addr=lb:500515514worker1 # [ 139.947879] nix-grpc-daemon[1583]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5515worker1 # [ 139.952580] nix-grpc-daemon[1583]: E0000 00:00:1789892297.356068 1626 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5516lb: must succeed: curl -sf localhost:9901/clusters5517worker1 # [ 140.528138] nix-grpc-daemon[1583]: E0000 00:00:1789892297.936398 1626 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5518worker1 # [ 140.534734] nix-grpc-daemon[1583]: E0000 00:00:1789892297.936687 1626 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5519lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5520worker2 # [ 141.485413] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:18Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5521worker1 # [ 141.515642] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5522worker1 # [ 141.518960] systemd[1]: nix-grpc-daemon.service: Consumed 946ms CPU time over 26.457s wall clock time, 34.5M memory peak, 24K incoming IP traffic, 32.3K outgoing IP traffic.5523lb: must succeed: curl -sf localhost:9901/clusters5524lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5525worker2 # [ 141.685202] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:19Z level=info event=scheduler_connected addr=lb:500515526worker2 # [ 141.692756] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5527worker2 # [ 141.893822] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:19Z level=info event=scheduler_connected addr=lb:500515528worker1 # [ 141.915526] systemd[1]: Starting Nix worker-protocol over gRPC...5529worker1 # [ 142.140263] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5530worker1 # [ 142.143084] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15531worker1 # [ 142.151432] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5532lb # [ 142.210240] niks3-server[1000]: 2026/09/20 08:18:19 INFO lead: acquired remote=192.168.1.4:588465533worker2 # [ 142.147967] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:19Z level=info event=scheduler_take_over5534worker1 # [ 142.160185] systemd[1]: Started Nix worker-protocol over gRPC.5535worker2 # [ 142.162787] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5536worker1 # [ 142.192108] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:19Z level=info event=scheduler_connected addr=lb:500515537worker2 # [ 142.186575] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05538worker2 # [ 142.363911] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:19Z level=info event=scheduler_connected addr=lb:500515539worker2 # [ 142.369556] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5540lb # [ 142.546113] envoy[916]: conn peer=[2001:db8:1::1]:58030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9499 tx=3808 ms=67065541lb # [ 142.552675] envoy[916]: conn peer=[2001:db8:1::1]:58018 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2969 tx=1368 ms=116585542lb # [ 142.558352] envoy[916]: conn peer=[2001:db8:1::3]:47470 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1426 tx=529 ms=242625543worker2 # [ 142.572420] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:20Z level=info event=scheduler_connected addr=lb:500515544worker2 # [ 142.576698] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:20Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05545lb: must succeed: curl -sf localhost:9901/clusters5546lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5547lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 4.43 seconds)5548lb: must succeed: curl -sf localhost:9901/clusters5549lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5550worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5551worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5552(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.24 seconds)5553subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5554client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15555worker2 # [ 143.135590] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519405556worker2 # [ 143.154388] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:20Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05557worker2 # [ 143.161176] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:20Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15558worker2 # [ 143.167126] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:20Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05559worker2 # [ 143.172502] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:20Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05560worker1 # [ 143.216906] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885561worker1 # [ 143.231725] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5562worker1 # [ 143.257686] nix-grpc-daemon[1790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)5563worker1 # [ 143.304365] nix-grpc-daemon[1790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 2/5)5564worker1 # [ 143.330083] nix-grpc-daemon[1790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 300 ms (attempt 3/5)5565worker1 # [ 143.637891] nix-grpc-daemon[1790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 4/5)5566worker1 # [ 143.700677] nix-grpc-daemon[1790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5567worker1 # [ 143.721155] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425885568worker1 # [ 143.737423] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425885569worker1 # [ 143.751694] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5570worker1 # [ 143.779428] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:21Z level=info event=niks3_push_started pid=18465571worker1 # [ 144.181013] nix-daemon[844]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)5572worker1 # [ 144.199299] nix-daemon[844]: reaped child process 1862, status = succeeded5573worker1 # [ 144.375926] nix-daemon[844]: accepted connection from pid 1864, user nix-grpc-daemon (trusted)5574worker1 # [ 144.392858] nix-daemon[844]: reaped child process 1867, status = succeeded5575lb # [ 144.463889] niks3-server[1000]: 2026/09/20 08:18:21 INFO Received uploads request method=POST path=/api/pending_closures5576worker1 # [ 144.419088] nix-grpc-daemon[1846]: time=2026-09-20T08:18:21.826Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5577worker1 # [ 144.420978] nix-grpc-daemon[1846]: time=2026-09-20T08:18:21.826Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5578lb # [ 144.497726] niks3-server[1000]: 2026/09/20 08:18:21 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5579worker1 # [ 144.463761] nix-grpc-daemon[1846]: time=2026-09-20T08:18:21.871Z level=INFO msg="Uploading 1 narinfos"5580lb # [ 144.513480] niks3-server[1000]: 2026/09/20 08:18:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5581lb # [ 144.526781] niks3-server[1000]: 2026/09/20 08:18:21 INFO Signed narinfos id=44 count=15582lb # [ 144.533735] niks3-server[1000]: 2026/09/20 08:18:21 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5583lb # [ 144.542391] niks3-server[1000]: 2026/09/20 08:18:21 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5584lb # [ 144.550111] niks3-server[1000]: 2026/09/20 08:18:21 INFO Completed upload id=445585lb # [ 144.552944] niks3-server[1000]: 2026/09/20 08:18:21 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5586worker1 # [ 144.493553] nix-grpc-daemon[1846]: time=2026-09-20T08:18:21.902Z level=INFO msg="Upload complete. (491ms)"5587worker1 # [ 144.505972] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=0 paths=1 nar_bytes_in=5125588worker1 # [ 144.518178] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885589worker1 # [ 144.525070] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5590worker1 # [ 144.530850] nix-daemon[844]: reaped child process 1844, status = succeeded5591worker1 # [ 144.543417] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5592worker1 # [ 145.773474] nix-daemon[844]: reaped child process 1871, status = succeeded5593worker1 # [ 145.940754] nix-daemon[844]: accepted connection from pid 1886, user nix-grpc-daemon (trusted)5594worker1 # [ 145.959267] nix-daemon[844]: reaped child process 1889, status = succeeded5595lb # [ 146.030537] niks3-server[1000]: 2026/09/20 08:18:23 INFO Received uploads request method=POST path=/api/pending_closures5596worker1 # [ 145.984410] nix-grpc-daemon[1846]: time=2026-09-20T08:18:23.390Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5597worker1 # [ 145.987428] nix-grpc-daemon[1846]: time=2026-09-20T08:18:23.390Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5598lb # [ 146.071734] niks3-server[1000]: 2026/09/20 08:18:23 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5599worker1 # [ 146.036200] nix-grpc-daemon[1846]: time=2026-09-20T08:18:23.443Z level=INFO msg="Uploading 1 narinfos"5600lb # [ 146.084828] niks3-server[1000]: 2026/09/20 08:18:23 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5601lb # [ 146.095649] niks3-server[1000]: 2026/09/20 08:18:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5602lb # [ 146.104707] niks3-server[1000]: 2026/09/20 08:18:23 INFO Signed narinfos id=45 count=15603lb # [ 146.107501] niks3-server[1000]: 2026/09/20 08:18:23 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5604lb # [ 146.117403] niks3-server[1000]: 2026/09/20 08:18:23 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5605lb # [ 146.124716] niks3-server[1000]: 2026/09/20 08:18:23 INFO Completed upload id=455606worker1 # [ 146.068757] nix-grpc-daemon[1846]: time=2026-09-20T08:18:23.477Z level=INFO msg="Upload complete. (315ms)"5607lb # [ 146.127718] niks3-server[1000]: 2026/09/20 08:18:23 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5608worker1 # [ 146.081094] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=15609worker2 # [ 146.076957] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:23Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15610worker1 # [ 146.097968] nix-daemon[844]: reaped child process 1869, status = succeeded5611worker2 # [ 146.088862] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:23Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05612worker1 # [ 146.128774] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885613worker1 # [ 146.145030] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425885614worker1 # [ 146.160119] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425885615worker1 # [ 146.174011] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5616worker1 # [ 146.376144] nix-daemon[844]: accepted connection from pid 1893, user nix-grpc-daemon (trusted)5617worker1 # [ 146.395778] nix-daemon[844]: reaped child process 1896, status = succeeded5618worker1 # [ 146.577651] nix-daemon[844]: accepted connection from pid 1898, user nix-grpc-daemon (trusted)5619worker1 # [ 146.595259] nix-daemon[844]: reaped child process 1901, status = succeeded5620lb # [ 146.662749] niks3-server[1000]: 2026/09/20 08:18:24 INFO Received uploads request method=POST path=/api/pending_closures5621worker1 # [ 146.616106] nix-grpc-daemon[1846]: time=2026-09-20T08:18:24.024Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5622worker1 # [ 146.617630] nix-grpc-daemon[1846]: time=2026-09-20T08:18:24.024Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5623lb # [ 146.694778] niks3-server[1000]: 2026/09/20 08:18:24 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5624lb # [ 146.709116] niks3-server[1000]: 2026/09/20 08:18:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5625worker1 # [ 146.658530] nix-grpc-daemon[1846]: time=2026-09-20T08:18:24.067Z level=INFO msg="Uploading 1 narinfos"5626lb # [ 146.720768] niks3-server[1000]: 2026/09/20 08:18:24 INFO Signed narinfos id=46 count=15627lb # [ 146.723493] niks3-server[1000]: 2026/09/20 08:18:24 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5628worker1 # [ 146.681619] nix-grpc-daemon[1846]: time=2026-09-20T08:18:24.090Z level=INFO msg="Upload complete. (491ms)"5629lb # [ 146.737882] niks3-server[1000]: 2026/09/20 08:18:24 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5630lb # [ 146.743262] niks3-server[1000]: 2026/09/20 08:18:24 INFO Completed upload id=465631lb # [ 146.746849] niks3-server[1000]: 2026/09/20 08:18:24 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5632worker1 # [ 146.688522] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=0 paths=1 nar_bytes_in=5125633worker1 # [ 146.703052] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885634worker1 # [ 146.711874] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5635worker1 # [ 146.714554] nix-daemon[844]: reaped child process 1891, status = succeeded5636worker1 # [ 146.727845] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5637worker1 # [ 147.975948] nix-daemon[844]: reaped child process 1905, status = succeeded5638worker1 # [ 148.157065] nix-daemon[844]: accepted connection from pid 1920, user nix-grpc-daemon (trusted)5639worker1 # [ 148.175474] nix-daemon[844]: reaped child process 1923, status = succeeded5640lb # [ 148.245755] niks3-server[1000]: 2026/09/20 08:18:25 INFO Received uploads request method=POST path=/api/pending_closures5641worker1 # [ 148.198822] nix-grpc-daemon[1846]: time=2026-09-20T08:18:25.607Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5642worker1 # [ 148.201246] nix-grpc-daemon[1846]: time=2026-09-20T08:18:25.609Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5643lb # [ 148.283209] niks3-server[1000]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5644worker1 # [ 148.240261] nix-grpc-daemon[1846]: time=2026-09-20T08:18:25.648Z level=INFO msg="Uploading 1 narinfos"5645lb # [ 148.296261] niks3-server[1000]: 2026/09/20 08:18:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5646lb # [ 148.310640] niks3-server[1000]: 2026/09/20 08:18:25 INFO Signed narinfos id=47 count=15647lb # [ 148.318055] niks3-server[1000]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5648lb # [ 148.323707] niks3-server[1000]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5649lb # [ 148.332431] niks3-server[1000]: 2026/09/20 08:18:25 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5650worker1 # [ 148.281015] nix-grpc-daemon[1846]: time=2026-09-20T08:18:25.689Z level=INFO msg="Upload complete. (341ms)"5651lb # [ 148.338100] niks3-server[1000]: 2026/09/20 08:18:25 INFO Completed upload id=475652lb # [ 148.341476] niks3-server[1000]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5653worker2 # [ 148.286039] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:25Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15654worker1 # [ 148.294099] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=15655worker2 # [ 148.299230] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:25Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05656worker1 # [ 148.312356] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885657worker1 # [ 148.320918] nix-daemon[844]: reaped child process 1903, status = succeeded5658worker1 # [ 148.325622] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425885659worker1 # [ 148.335568] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425885660worker1 # [ 148.346984] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5661worker1 # [ 148.537035] nix-daemon[844]: accepted connection from pid 1927, user nix-grpc-daemon (trusted)5662worker1 # [ 148.557031] nix-daemon[844]: reaped child process 1930, status = succeeded5663worker1 # [ 148.732813] nix-daemon[844]: accepted connection from pid 1932, user nix-grpc-daemon (trusted)5664worker1 # [ 148.749977] nix-daemon[844]: reaped child process 1935, status = succeeded5665lb # [ 148.818914] niks3-server[1000]: 2026/09/20 08:18:26 INFO Received uploads request method=POST path=/api/pending_closures5666worker1 # [ 148.771698] nix-grpc-daemon[1846]: time=2026-09-20T08:18:26.180Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5667worker1 # [ 148.773525] nix-grpc-daemon[1846]: time=2026-09-20T08:18:26.180Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5668lb # [ 148.844663] niks3-server[1000]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5669worker1 # [ 148.802809] nix-grpc-daemon[1846]: time=2026-09-20T08:18:26.211Z level=INFO msg="Uploading 1 narinfos"5670lb # [ 148.860104] niks3-server[1000]: 2026/09/20 08:18:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5671lb # [ 148.871183] niks3-server[1000]: 2026/09/20 08:18:26 INFO Signed narinfos id=48 count=15672lb # [ 148.878333] niks3-server[1000]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5673worker1 # [ 148.832659] nix-grpc-daemon[1846]: time=2026-09-20T08:18:26.241Z level=INFO msg="Upload complete. (473ms)"5674lb # [ 148.889379] niks3-server[1000]: 2026/09/20 08:18:26 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5675lb # [ 148.894926] niks3-server[1000]: 2026/09/20 08:18:26 INFO Completed upload id=485676worker1 # [ 148.838514] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=0 paths=1 nar_bytes_in=5125677lb # [ 148.898366] niks3-server[1000]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5678worker1 # [ 148.851188] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885679worker1 # [ 148.857114] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5680worker1 # [ 148.861434] nix-daemon[844]: reaped child process 1925, status = succeeded5681worker1 # [ 148.873721] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5682worker1 # [ 149.522177] nix-daemon[844]: reaped child process 1939, status = succeeded5683worker1 # [ 149.705033] nix-daemon[844]: accepted connection from pid 1954, user nix-grpc-daemon (trusted)5684worker1 # [ 149.722947] nix-daemon[844]: reaped child process 1957, status = succeeded5685lb # [ 149.791746] niks3-server[1000]: 2026/09/20 08:18:27 INFO Received uploads request method=POST path=/api/pending_closures5686worker1 # [ 149.748416] nix-grpc-daemon[1846]: time=2026-09-20T08:18:27.154Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5687worker1 # [ 149.750433] nix-grpc-daemon[1846]: time=2026-09-20T08:18:27.154Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5688lb # [ 149.832785] niks3-server[1000]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5689worker1 # [ 149.789828] nix-grpc-daemon[1846]: time=2026-09-20T08:18:27.197Z level=INFO msg="Uploading 1 narinfos"5690lb # [ 149.848117] niks3-server[1000]: 2026/09/20 08:18:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5691lb # [ 149.860694] niks3-server[1000]: 2026/09/20 08:18:27 INFO Signed narinfos id=49 count=15692lb # [ 149.862868] niks3-server[1000]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5693lb # [ 149.876325] niks3-server[1000]: 2026/09/20 08:18:27 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5694worker1 # [ 149.818632] nix-grpc-daemon[1846]: time=2026-09-20T08:18:27.227Z level=INFO msg="Upload complete. (334ms)"5695lb # [ 149.878836] niks3-server[1000]: 2026/09/20 08:18:27 INFO Completed upload id=495696lb # [ 149.881257] niks3-server[1000]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5697worker2 # [ 149.820362] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:27Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15698worker1 # [ 149.831870] nix-grpc-daemon[1846]: time=2026-09-20T08:18:27.232Z level=WARN msg="Failed to register uploaded object" key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo error="server returned 404: object is not pending upload\n"5699worker2 # [ 149.833835] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:27Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05700worker1 # [ 149.849159] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=0 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=15701worker1 # [ 149.863175] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885702worker1 # [ 149.869731] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425885703worker1 # [ 149.875797] nix-daemon[844]: reaped child process 1937, status = succeeded5704worker1 # [ 149.879401] nix-grpc-daemon[1846]: time=2026-09-20T08:18:27.287Z level=INFO msg="All 1 paths already cached"5705worker1 # [ 149.883791] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425885706worker1 # [ 149.895078] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5707worker1 # [ 150.091240] nix-daemon[844]: accepted connection from pid 1961, user nix-grpc-daemon (trusted)5708worker1 # [ 150.108675] nix-daemon[844]: reaped child process 1964, status = succeeded5709worker1 # [ 150.282839] nix-daemon[844]: accepted connection from pid 1966, user nix-grpc-daemon (trusted)5710worker1 # [ 150.300287] nix-daemon[844]: reaped child process 1969, status = succeeded5711lb # [ 150.368103] niks3-server[1000]: 2026/09/20 08:18:27 INFO Received uploads request method=POST path=/api/pending_closures5712worker1 # [ 150.321124] nix-grpc-daemon[1846]: time=2026-09-20T08:18:27.729Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5713worker1 # [ 150.322659] nix-grpc-daemon[1846]: time=2026-09-20T08:18:27.729Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5714lb # [ 150.394863] niks3-server[1000]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5715lb # [ 150.409627] niks3-server[1000]: 2026/09/20 08:18:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5716worker1 # [ 150.359724] nix-grpc-daemon[1846]: time=2026-09-20T08:18:27.768Z level=INFO msg="Uploading 1 narinfos"5717lb # [ 150.423245] niks3-server[1000]: 2026/09/20 08:18:27 INFO Signed narinfos id=50 count=15718lb # [ 150.428925] niks3-server[1000]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5719worker1 # [ 150.381458] nix-grpc-daemon[1846]: time=2026-09-20T08:18:27.790Z level=INFO msg="Upload complete. (474ms)"5720lb # [ 150.438390] niks3-server[1000]: 2026/09/20 08:18:27 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5721lb # [ 150.443763] niks3-server[1000]: 2026/09/20 08:18:27 INFO Completed upload id=505722worker1 # [ 150.387650] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=0 paths=1 nar_bytes_in=6245723lb # [ 150.447248] niks3-server[1000]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5724worker1 # [ 150.400407] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885725worker1 # [ 150.406970] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5726worker1 # [ 150.411388] nix-daemon[844]: reaped child process 1959, status = succeeded5727worker1 # [ 150.422044] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5728worker1 # [ 151.255921] nix-daemon[844]: reaped child process 1973, status = succeeded5729worker1 # [ 151.427981] nix-daemon[844]: accepted connection from pid 1988, user nix-grpc-daemon (trusted)5730worker1 # [ 151.448213] nix-daemon[844]: reaped child process 1991, status = succeeded5731lb # [ 151.516927] niks3-server[1000]: 2026/09/20 08:18:28 INFO Received uploads request method=POST path=/api/pending_closures5732worker1 # [ 151.472383] nix-grpc-daemon[1846]: time=2026-09-20T08:18:28.879Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5733worker1 # [ 151.473913] nix-grpc-daemon[1846]: time=2026-09-20T08:18:28.879Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5734lb # [ 151.553911] niks3-server[1000]: 2026/09/20 08:18:28 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5735lb # [ 151.567122] niks3-server[1000]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5736lb # [ 151.582530] niks3-server[1000]: 2026/09/20 08:18:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5737worker1 # [ 151.532269] nix-grpc-daemon[1846]: time=2026-09-20T08:18:28.940Z level=INFO msg="Uploading 1 narinfos"5738lb # [ 151.593286] niks3-server[1000]: 2026/09/20 08:18:29 INFO Signed narinfos id=51 count=15739lb # [ 151.600305] niks3-server[1000]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5740lb # [ 151.608626] niks3-server[1000]: 2026/09/20 08:18:29 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5741lb # [ 151.614518] niks3-server[1000]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5742lb # [ 151.622377] niks3-server[1000]: 2026/09/20 08:18:29 INFO Completed upload id=515743worker1 # [ 151.566462] nix-grpc-daemon[1846]: time=2026-09-20T08:18:28.974Z level=INFO msg="Upload complete. (329ms)"5744worker2 # [ 151.567385] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:29Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15745worker1 # [ 151.581134] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=15746worker2 # [ 151.580578] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:29Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05747worker1 # [ 151.596390] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885748worker1 # [ 151.607835] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425885749worker1 # [ 151.614026] nix-daemon[844]: reaped child process 1971, status = succeeded5750worker1 # [ 151.620606] nix-grpc-daemon[1846]: time=2026-09-20T08:18:29.029Z level=INFO msg="All 1 paths already cached"5751worker1 # [ 151.628098] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425885752worker1 # [ 151.642153] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5753worker1 # [ 151.831318] nix-daemon[844]: accepted connection from pid 1995, user nix-grpc-daemon (trusted)5754worker1 # [ 151.851643] nix-daemon[844]: reaped child process 1998, status = succeeded5755worker1 # [ 152.030943] nix-daemon[844]: accepted connection from pid 2000, user nix-grpc-daemon (trusted)5756worker1 # [ 152.048712] nix-daemon[844]: reaped child process 2003, status = succeeded5757lb # [ 152.119257] niks3-server[1000]: 2026/09/20 08:18:29 INFO Received uploads request method=POST path=/api/pending_closures5758worker1 # [ 152.071955] nix-grpc-daemon[1846]: time=2026-09-20T08:18:29.480Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5759worker1 # [ 152.073717] nix-grpc-daemon[1846]: time=2026-09-20T08:18:29.480Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5760lb # [ 152.145137] niks3-server[1000]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5761lb # [ 152.159068] niks3-server[1000]: 2026/09/20 08:18:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5762worker1 # [ 152.109522] nix-grpc-daemon[1846]: time=2026-09-20T08:18:29.517Z level=INFO msg="Uploading 1 narinfos"5763lb # [ 152.171839] niks3-server[1000]: 2026/09/20 08:18:29 INFO Signed narinfos id=52 count=15764lb # [ 152.177326] niks3-server[1000]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5765worker1 # [ 152.128311] nix-grpc-daemon[1846]: time=2026-09-20T08:18:29.536Z level=INFO msg="Upload complete. (472ms)"5766lb # [ 152.186065] niks3-server[1000]: 2026/09/20 08:18:29 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5767lb # [ 152.191413] niks3-server[1000]: 2026/09/20 08:18:29 INFO Completed upload id=525768worker1 # [ 152.135203] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=0 paths=1 nar_bytes_in=6245769lb # [ 152.194822] niks3-server[1000]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5770worker1 # [ 152.144727] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885771worker1 # [ 152.154991] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5772worker1 # [ 152.159430] nix-daemon[844]: reaped child process 1993, status = succeeded5773worker1 # [ 152.173279] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5774worker1 # [ 153.421832] nix-daemon[844]: reaped child process 2007, status = succeeded5775worker1 # [ 153.603149] nix-daemon[844]: accepted connection from pid 2022, user nix-grpc-daemon (trusted)5776worker1 # [ 153.620600] nix-daemon[844]: reaped child process 2025, status = succeeded5777lb # [ 153.693592] niks3-server[1000]: 2026/09/20 08:18:31 INFO Received uploads request method=POST path=/api/pending_closures5778worker1 # [ 153.648454] nix-grpc-daemon[1846]: time=2026-09-20T08:18:31.055Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5779worker1 # [ 153.650139] nix-grpc-daemon[1846]: time=2026-09-20T08:18:31.055Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5780lb # [ 153.745528] niks3-server[1000]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5781worker1 # [ 153.702074] nix-grpc-daemon[1846]: time=2026-09-20T08:18:31.110Z level=INFO msg="Uploading 1 narinfos"5782lb # [ 153.760475] niks3-server[1000]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5783lb # [ 153.768778] niks3-server[1000]: 2026/09/20 08:18:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5784lb # [ 153.771784] niks3-server[1000]: 2026/09/20 08:18:31 INFO Signed narinfos id=53 count=15785lb # [ 153.774812] niks3-server[1000]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5786lb # [ 153.781203] niks3-server[1000]: 2026/09/20 08:18:31 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5787lb # [ 153.785261] niks3-server[1000]: 2026/09/20 08:18:31 INFO Completed upload id=535788lb # [ 153.787515] niks3-server[1000]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5789worker1 # [ 153.729012] nix-grpc-daemon[1846]: time=2026-09-20T08:18:31.137Z level=INFO msg="Upload complete. (344ms)"5790worker2 # [ 153.731372] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:31Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15791worker1 # [ 153.742058] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=15792worker2 # [ 153.744422] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:31Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05793worker1 # [ 153.764908] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885794worker1 # [ 153.769270] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425885795worker1 # [ 153.774935] nix-daemon[844]: reaped child process 2005, status = succeeded5796worker1 # [ 153.781237] nix-grpc-daemon[1846]: time=2026-09-20T08:18:31.189Z level=INFO msg="All 1 paths already cached"5797worker1 # [ 153.789632] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425885798worker1 # [ 153.800920] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5799worker1 # [ 153.994648] nix-daemon[844]: accepted connection from pid 2029, user nix-grpc-daemon (trusted)5800worker1 # [ 154.014737] nix-daemon[844]: reaped child process 2032, status = succeeded5801worker1 # [ 154.186548] nix-daemon[844]: accepted connection from pid 2034, user nix-grpc-daemon (trusted)5802worker1 # [ 154.204798] nix-daemon[844]: reaped child process 2037, status = succeeded5803lb # [ 154.274558] niks3-server[1000]: 2026/09/20 08:18:31 INFO Received uploads request method=POST path=/api/pending_closures5804worker1 # [ 154.228058] nix-grpc-daemon[1846]: time=2026-09-20T08:18:31.636Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5805worker1 # [ 154.229674] nix-grpc-daemon[1846]: time=2026-09-20T08:18:31.636Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5806lb # [ 154.304472] niks3-server[1000]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5807worker1 # [ 154.262463] nix-grpc-daemon[1846]: time=2026-09-20T08:18:31.670Z level=INFO msg="Uploading 1 narinfos"5808lb # [ 154.318595] niks3-server[1000]: 2026/09/20 08:18:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5809lb # [ 154.331388] niks3-server[1000]: 2026/09/20 08:18:31 INFO Signed narinfos id=54 count=15810lb # [ 154.338083] niks3-server[1000]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5811lb # [ 154.349484] niks3-server[1000]: 2026/09/20 08:18:31 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5812lb # [ 154.357043] niks3-server[1000]: 2026/09/20 08:18:31 INFO Completed upload id=545813worker1 # [ 154.304226] nix-grpc-daemon[1846]: time=2026-09-20T08:18:31.712Z level=INFO msg="Upload complete. (489ms)"5814lb # [ 154.365225] niks3-server[1000]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5815worker1 # [ 154.312131] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=0 paths=1 nar_bytes_in=6245816worker1 # [ 154.320817] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885817worker1 # [ 154.331886] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5818worker1 # [ 154.337413] nix-daemon[844]: reaped child process 2027, status = succeeded5819worker1 # [ 154.351127] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5820worker1 # [ 155.800216] nix-daemon[844]: reaped child process 2041, status = succeeded5821worker1 # [ 155.979416] nix-daemon[844]: accepted connection from pid 2056, user nix-grpc-daemon (trusted)5822worker1 # [ 155.996612] nix-daemon[844]: reaped child process 2059, status = succeeded5823lb # [ 156.068784] niks3-server[1000]: 2026/09/20 08:18:33 INFO Received uploads request method=POST path=/api/pending_closures5824worker1 # [ 156.023308] nix-grpc-daemon[1846]: time=2026-09-20T08:18:33.430Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5825worker1 # [ 156.025209] nix-grpc-daemon[1846]: time=2026-09-20T08:18:33.430Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5826lb # [ 156.103714] niks3-server[1000]: 2026/09/20 08:18:33 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5827lb # [ 156.115782] niks3-server[1000]: 2026/09/20 08:18:33 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5828lb # [ 156.128114] niks3-server[1000]: 2026/09/20 08:18:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5829worker1 # [ 156.078255] nix-grpc-daemon[1846]: time=2026-09-20T08:18:33.486Z level=INFO msg="Uploading 1 narinfos"5830lb # [ 156.133902] niks3-server[1000]: 2026/09/20 08:18:33 INFO Signed narinfos id=55 count=15831lb # [ 156.138540] niks3-server[1000]: 2026/09/20 08:18:33 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5832lb # [ 156.149203] niks3-server[1000]: 2026/09/20 08:18:33 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5833worker1 # [ 156.098426] nix-grpc-daemon[1846]: time=2026-09-20T08:18:33.506Z level=INFO msg="Upload complete. (336ms)"5834lb # [ 156.156670] niks3-server[1000]: 2026/09/20 08:18:33 INFO Completed upload id=555835lb # [ 156.159661] niks3-server[1000]: 2026/09/20 08:18:33 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5836worker2 # [ 156.103644] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:33Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15837worker1 # [ 156.111915] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=15838worker2 # [ 156.117535] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:33Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05839worker1 # [ 156.130653] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885840worker1 # [ 156.136179] nix-daemon[844]: reaped child process 2039, status = succeeded5841worker1 # [ 156.144235] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425885842worker1 # [ 156.155919] nix-grpc-daemon[1846]: time=2026-09-20T08:18:33.564Z level=INFO msg="All 2 paths already cached"5843worker1 # [ 156.163900] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425885844worker1 # [ 156.175506] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5845worker1 # [ 156.365616] nix-daemon[844]: accepted connection from pid 2063, user nix-grpc-daemon (trusted)5846worker1 # [ 156.383884] nix-daemon[844]: reaped child process 2066, status = succeeded5847worker1 # [ 156.555703] nix-daemon[844]: accepted connection from pid 2068, user nix-grpc-daemon (trusted)5848worker1 # [ 156.572343] nix-daemon[844]: reaped child process 2071, status = succeeded5849lb # [ 156.642974] niks3-server[1000]: 2026/09/20 08:18:34 INFO Received uploads request method=POST path=/api/pending_closures5850worker1 # [ 156.595649] nix-grpc-daemon[1846]: time=2026-09-20T08:18:34.003Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5851worker1 # [ 156.597326] nix-grpc-daemon[1846]: time=2026-09-20T08:18:34.004Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5852lb # [ 156.670022] niks3-server[1000]: 2026/09/20 08:18:34 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5853worker1 # [ 156.625674] nix-grpc-daemon[1846]: time=2026-09-20T08:18:34.034Z level=INFO msg="Uploading 1 narinfos"5854lb # [ 156.686116] niks3-server[1000]: 2026/09/20 08:18:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5855lb # [ 156.697040] niks3-server[1000]: 2026/09/20 08:18:34 INFO Signed narinfos id=56 count=15856lb # [ 156.699728] niks3-server[1000]: 2026/09/20 08:18:34 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5857lb # [ 156.707008] niks3-server[1000]: 2026/09/20 08:18:34 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5858lb # [ 156.713462] niks3-server[1000]: 2026/09/20 08:18:34 INFO Completed upload id=565859worker1 # [ 156.657328] nix-grpc-daemon[1846]: time=2026-09-20T08:18:34.065Z level=INFO msg="Upload complete. (468ms)"5860lb # [ 156.716361] niks3-server[1000]: 2026/09/20 08:18:34 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5861worker1 # [ 156.664122] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=0 paths=1 nar_bytes_in=7525862worker1 # [ 156.676595] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885863worker1 # [ 156.680654] nix-daemon[844]: reaped child process 2061, status = succeeded5864worker1 # [ 156.687487] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5865worker1 # [ 156.701496] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5866worker1 # [ 157.546164] nix-daemon[844]: reaped child process 2075, status = succeeded5867worker1 # [ 157.727324] nix-daemon[844]: accepted connection from pid 2090, user nix-grpc-daemon (trusted)5868worker1 # [ 157.744685] nix-daemon[844]: reaped child process 2093, status = succeeded5869lb # [ 157.818218] niks3-server[1000]: 2026/09/20 08:18:35 INFO Received uploads request method=POST path=/api/pending_closures5870worker1 # [ 157.772473] nix-grpc-daemon[1846]: time=2026-09-20T08:18:35.178Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5871worker1 # [ 157.774333] nix-grpc-daemon[1846]: time=2026-09-20T08:18:35.178Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5872lb # [ 157.857333] niks3-server[1000]: 2026/09/20 08:18:35 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5873lb # [ 157.873789] niks3-server[1000]: 2026/09/20 08:18:35 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5874lb # [ 157.882579] niks3-server[1000]: 2026/09/20 08:18:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5875worker1 # [ 157.831872] nix-grpc-daemon[1846]: time=2026-09-20T08:18:35.239Z level=INFO msg="Uploading 1 narinfos"5876lb # [ 157.891882] niks3-server[1000]: 2026/09/20 08:18:35 INFO Signed narinfos id=57 count=15877lb # [ 157.897097] niks3-server[1000]: 2026/09/20 08:18:35 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5878worker1 # [ 157.846663] nix-grpc-daemon[1846]: time=2026-09-20T08:18:35.255Z level=INFO msg="Upload complete. (333ms)"5879lb # [ 157.904449] niks3-server[1000]: 2026/09/20 08:18:35 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5880lb # [ 157.907595] niks3-server[1000]: 2026/09/20 08:18:35 INFO Completed upload id=575881lb # [ 157.910985] niks3-server[1000]: 2026/09/20 08:18:35 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo5882worker2 # [ 157.849381] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:35Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=15883worker1 # [ 157.859535] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=15884worker1 # [ 157.879063] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885885worker1 # [ 157.885624] nix-daemon[844]: reaped child process 2073, status = succeeded5886worker1 # [ 157.912722] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425885887worker1 # [ 157.927583] nix-grpc-daemon[1846]: time=2026-09-20T08:18:35.336Z level=INFO msg="All 2 paths already cached"5888worker1 # [ 157.937076] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425885889worker1 # [ 157.951510] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5890worker1 # [ 158.149694] nix-daemon[844]: accepted connection from pid 2097, user nix-grpc-daemon (trusted)5891worker1 # [ 158.168716] nix-daemon[844]: reaped child process 2100, status = succeeded5892worker1 # [ 158.344106] nix-daemon[844]: accepted connection from pid 2102, user nix-grpc-daemon (trusted)5893worker1 # [ 158.361904] nix-daemon[844]: reaped child process 2105, status = succeeded5894lb # [ 158.429992] niks3-server[1000]: 2026/09/20 08:18:35 INFO Received uploads request method=POST path=/api/pending_closures5895worker1 # [ 158.382849] nix-grpc-daemon[1846]: time=2026-09-20T08:18:35.791Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5896worker1 # [ 158.384574] nix-grpc-daemon[1846]: time=2026-09-20T08:18:35.791Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"5897lb # [ 158.462689] niks3-server[1000]: 2026/09/20 08:18:35 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst5898worker1 # [ 158.413603] nix-grpc-daemon[1846]: time=2026-09-20T08:18:35.821Z level=INFO msg="Uploading 1 narinfos"5899lb # [ 158.474653] niks3-server[1000]: 2026/09/20 08:18:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5900lb # [ 158.485463] niks3-server[1000]: 2026/09/20 08:18:35 INFO Signed narinfos id=58 count=15901lb # [ 158.494607] niks3-server[1000]: 2026/09/20 08:18:35 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls5902worker1 # [ 158.442336] nix-grpc-daemon[1846]: time=2026-09-20T08:18:35.850Z level=INFO msg="Upload complete. (474ms)"5903lb # [ 158.503453] niks3-server[1000]: 2026/09/20 08:18:35 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5904worker1 # [ 158.448322] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=0 paths=1 nar_bytes_in=7525905lb # [ 158.508587] niks3-server[1000]: 2026/09/20 08:18:35 INFO Completed upload id=585906lb # [ 158.510368] niks3-server[1000]: 2026/09/20 08:18:35 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo5907worker1 # [ 158.456908] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885908worker1 # [ 158.469415] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5909worker1 # [ 158.471942] nix-daemon[844]: reaped child process 2095, status = succeeded5910worker1 # [ 158.482788] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5911worker1 # [ 159.725724] nix-daemon[844]: reaped child process 2109, status = succeeded5912worker1 # [ 159.907359] nix-daemon[844]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)5913worker1 # [ 159.927088] nix-daemon[844]: reaped child process 2127, status = succeeded5914lb # [ 159.997512] niks3-server[1000]: 2026/09/20 08:18:37 INFO Received uploads request method=POST path=/api/pending_closures5915worker1 # [ 159.953784] nix-grpc-daemon[1846]: time=2026-09-20T08:18:37.361Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5916worker1 # [ 159.955652] nix-grpc-daemon[1846]: time=2026-09-20T08:18:37.361Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"5917lb # [ 160.031142] niks3-server[1000]: 2026/09/20 08:18:37 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv5918lb # [ 160.048597] niks3-server[1000]: 2026/09/20 08:18:37 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst5919lb # [ 160.062140] niks3-server[1000]: 2026/09/20 08:18:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5920worker1 # [ 160.006559] nix-grpc-daemon[1846]: time=2026-09-20T08:18:37.414Z level=INFO msg="Uploading 1 narinfos"5921lb # [ 160.070499] niks3-server[1000]: 2026/09/20 08:18:37 INFO Signed narinfos id=59 count=15922lb # [ 160.075879] niks3-server[1000]: 2026/09/20 08:18:37 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls5923lb # [ 160.086827] niks3-server[1000]: 2026/09/20 08:18:37 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5924lb # [ 160.092285] niks3-server[1000]: 2026/09/20 08:18:37 INFO Completed upload id=595925worker1 # [ 160.035474] nix-grpc-daemon[1846]: time=2026-09-20T08:18:37.444Z level=INFO msg="Upload complete. (340ms)"5926lb # [ 160.095608] niks3-server[1000]: 2026/09/20 08:18:37 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo5927worker2 # [ 160.039275] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:37Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=15928worker1 # [ 160.049139] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=15929worker1 # [ 160.068286] nix-daemon[844]: reaped child process 2107, status = succeeded5930worker1 # [ 160.100260] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885931worker1 # [ 160.116911] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425885932worker1 # [ 160.132571] nix-grpc-daemon[1846]: time=2026-09-20T08:18:37.541Z level=INFO msg="All 2 paths already cached"5933worker1 # [ 160.141894] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425885934worker1 # [ 160.155561] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5935worker1 # [ 160.354972] nix-daemon[844]: accepted connection from pid 2131, user nix-grpc-daemon (trusted)5936worker1 # [ 160.373018] nix-daemon[844]: reaped child process 2134, status = succeeded5937worker1 # [ 160.547923] nix-daemon[844]: accepted connection from pid 2136, user nix-grpc-daemon (trusted)5938worker1 # [ 160.566194] nix-daemon[844]: reaped child process 2139, status = succeeded5939lb # [ 160.636139] niks3-server[1000]: 2026/09/20 08:18:38 INFO Received uploads request method=POST path=/api/pending_closures5940worker1 # [ 160.591811] nix-grpc-daemon[1846]: time=2026-09-20T08:18:38.000Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5941worker1 # [ 160.593556] nix-grpc-daemon[1846]: time=2026-09-20T08:18:38.000Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"5942lb # [ 160.667346] niks3-server[1000]: 2026/09/20 08:18:38 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst5943lb # [ 160.680954] niks3-server[1000]: 2026/09/20 08:18:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign5944worker1 # [ 160.631565] nix-grpc-daemon[1846]: time=2026-09-20T08:18:38.039Z level=INFO msg="Uploading 1 narinfos"5945lb # [ 160.692280] niks3-server[1000]: 2026/09/20 08:18:38 INFO Signed narinfos id=60 count=15946lb # [ 160.694862] niks3-server[1000]: 2026/09/20 08:18:38 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls5947lb # [ 160.703109] niks3-server[1000]: 2026/09/20 08:18:38 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete5948lb # [ 160.711184] niks3-server[1000]: 2026/09/20 08:18:38 INFO Completed upload id=605949worker1 # [ 160.654489] nix-grpc-daemon[1846]: time=2026-09-20T08:18:38.063Z level=INFO msg="Upload complete. (480ms)"5950lb # [ 160.713214] niks3-server[1000]: 2026/09/20 08:18:38 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo5951worker1 # [ 160.663954] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=0 paths=1 nar_bytes_in=7525952worker1 # [ 160.675318] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425885953worker1 # [ 160.681822] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5954worker1 # [ 160.686823] nix-daemon[844]: reaped child process 2129, status = succeeded5955worker1 # [ 160.698503] nix-daemon[844]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5956worker1 # [ 162.148773] nix-daemon[844]: reaped child process 2143, status = succeeded5957worker1 # [ 162.330146] nix-daemon[844]: accepted connection from pid 2158, user nix-grpc-daemon (trusted)5958worker1 # [ 162.350197] nix-daemon[844]: reaped child process 2161, status = succeeded5959lb # [ 162.419302] niks3-server[1000]: 2026/09/20 08:18:39 INFO Received uploads request method=POST path=/api/pending_closures5960worker1 # [ 162.375797] nix-grpc-daemon[1846]: time=2026-09-20T08:18:39.781Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5961worker1 # [ 162.378332] nix-grpc-daemon[1846]: time=2026-09-20T08:18:39.781Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"5962lb # [ 162.457648] niks3-server[1000]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv5963lb # [ 162.469013] niks3-server[1000]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst5964lb # [ 162.479355] niks3-server[1000]: 2026/09/20 08:18:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign5965worker1 # [ 162.428830] nix-grpc-daemon[1846]: time=2026-09-20T08:18:39.836Z level=INFO msg="Uploading 1 narinfos"5966lb # [ 162.488450] niks3-server[1000]: 2026/09/20 08:18:39 INFO Signed narinfos id=61 count=15967lb # [ 162.490937] niks3-server[1000]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls5968lb # [ 162.501118] niks3-server[1000]: 2026/09/20 08:18:39 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete5969lb # [ 162.507260] niks3-server[1000]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo5970lb # [ 162.512914] niks3-server[1000]: 2026/09/20 08:18:39 INFO Completed upload id=615971worker1 # [ 162.456929] nix-grpc-daemon[1846]: time=2026-09-20T08:18:39.865Z level=INFO msg="Upload complete. (344ms)"5972worker1 # [ 162.469113] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42588 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=15973worker1 # [ 162.488471] nix-daemon[844]: reaped child process 2141, status = succeeded5974lb # [ 162.552832] envoy[916]: conn peer=[2001:db8:1::1]:60942 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26759 tx=10620 ms=193435975client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.66 seconds)5976worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'5977worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.09 seconds)5978client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&15979worker2 # [ 162.871100] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519405980worker2 # [ 162.885276] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:40Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=05981client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.29 seconds)5982(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 20.04 seconds)5983subtest: low disk drains a worker and builds go to the other5984worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill5985worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds)5986worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'5987worker1 # [ 164.178851] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:41Z level=info event=unhealthy reason=min_free5988worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds)5989client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&25990client # don't know how to build these paths:5991client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv5992worker2 # [ 165.427542] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:519405993worker2 # [ 165.447986] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:42Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=05994worker2 # [ 165.455649] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:42Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=15995worker2 # [ 165.495747] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519405996worker2 # [ 165.514046] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519405997client # copying 1 paths to 'lb:50051'...5998client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...5999worker2 # [ 165.531281] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519406000worker2 # [ 165.547558] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)6001worker2 # [ 165.757660] nix-daemon[835]: accepted connection from pid 1503, user nix-grpc-daemon (trusted)6002worker2 # [ 165.779752] nix-daemon[835]: reaped child process 1506, status = succeeded6003worker2 # [ 165.965726] nix-daemon[835]: accepted connection from pid 1508, user nix-grpc-daemon (trusted)6004worker2 # [ 165.985741] nix-daemon[835]: reaped child process 1511, status = succeeded6005lb # [ 166.061638] niks3-server[1000]: 2026/09/20 08:18:43 INFO Received uploads request method=POST path=/api/pending_closures6006worker2 # [ 166.010368] nix-grpc-daemon[1303]: time=2026-09-20T08:18:43.448Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6007worker2 # [ 166.011917] nix-grpc-daemon[1303]: time=2026-09-20T08:18:43.448Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6008lb # [ 166.096788] niks3-server[1000]: 2026/09/20 08:18:43 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6009worker2 # [ 166.048247] nix-grpc-daemon[1303]: time=2026-09-20T08:18:43.487Z level=INFO msg="Uploading 1 narinfos"6010lb # [ 166.115326] niks3-server[1000]: 2026/09/20 08:18:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6011lb # [ 166.127824] niks3-server[1000]: 2026/09/20 08:18:43 INFO Signed narinfos id=62 count=16012lb # [ 166.134737] niks3-server[1000]: 2026/09/20 08:18:43 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6013worker2 # [ 166.082942] nix-grpc-daemon[1303]: time=2026-09-20T08:18:43.521Z level=INFO msg="Upload complete. (518ms)"6014lb # [ 166.146438] niks3-server[1000]: 2026/09/20 08:18:43 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6015lb # [ 166.152167] niks3-server[1000]: 2026/09/20 08:18:43 INFO Completed upload id=626016lb # [ 166.155731] niks3-server[1000]: 2026/09/20 08:18:43 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6017worker2 # [ 166.093375] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=0 paths=1 nar_bytes_in=5126018worker2 # [ 166.107513] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519406019worker2 # [ 166.114657] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)6020worker2 # [ 166.120381] nix-daemon[835]: reaped child process 1501, status = succeeded6021client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6022client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6023worker2 # [ 166.135279] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)6024client # farm-a> LOG-farm-a-drain6025worker2 # [ 167.184628] nix-daemon[835]: reaped child process 1515, status = succeeded6026worker2 # [ 167.359048] nix-daemon[835]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)6027worker2 # [ 167.377213] nix-daemon[835]: reaped child process 1533, status = succeeded6028lb # [ 167.459071] niks3-server[1000]: 2026/09/20 08:18:44 INFO Received uploads request method=POST path=/api/pending_closures6029worker2 # [ 167.407201] nix-grpc-daemon[1303]: time=2026-09-20T08:18:44.843Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6030worker2 # [ 167.408894] nix-grpc-daemon[1303]: time=2026-09-20T08:18:44.843Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6031lb # [ 167.508113] niks3-server[1000]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6032worker2 # [ 167.455199] nix-grpc-daemon[1303]: time=2026-09-20T08:18:44.893Z level=INFO msg="Uploading 1 narinfos"6033lb # [ 167.516706] niks3-server[1000]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6034lb # [ 167.528777] niks3-server[1000]: 2026/09/20 08:18:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6035lb # [ 167.531511] niks3-server[1000]: 2026/09/20 08:18:44 INFO Signed narinfos id=63 count=16036lb # [ 167.535830] niks3-server[1000]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6037lb # [ 167.543575] niks3-server[1000]: 2026/09/20 08:18:44 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6038lb # [ 167.548030] niks3-server[1000]: 2026/09/20 08:18:44 INFO Completed upload id=636039worker2 # [ 167.484861] nix-grpc-daemon[1303]: time=2026-09-20T08:18:44.923Z level=INFO msg="Upload complete. (338ms)"6040lb # [ 167.550868] niks3-server[1000]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6041worker2 # [ 167.505083] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=16042worker2 # [ 167.516430] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:44Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06043worker2 # [ 167.523104] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:44Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16044worker2 # [ 167.526934] nix-daemon[835]: reaped child process 1513, status = succeeded6045worker2 # [ 167.546956] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519406046worker2 # [ 167.564554] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519406047worker2 # [ 167.581359] nix-grpc-daemon[1303]: time=2026-09-20T08:18:45.020Z level=INFO msg="All 1 paths already cached"6048client # copying 1 paths to 'lb:50051'...6049client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6050worker2 # [ 167.594967] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519406051worker2 # [ 167.610331] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)6052worker2 # [ 167.831233] nix-daemon[835]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6053worker2 # [ 167.855005] nix-daemon[835]: reaped child process 1542, status = succeeded6054worker2 # [ 168.040120] nix-daemon[835]: accepted connection from pid 1544, user nix-grpc-daemon (trusted)6055worker2 # [ 168.062335] nix-daemon[835]: reaped child process 1547, status = succeeded6056lb # [ 168.136766] niks3-server[1000]: 2026/09/20 08:18:45 INFO Received uploads request method=POST path=/api/pending_closures6057worker2 # [ 168.083221] nix-grpc-daemon[1303]: time=2026-09-20T08:18:45.521Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6058worker2 # [ 168.084928] nix-grpc-daemon[1303]: time=2026-09-20T08:18:45.521Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6059lb # [ 168.165952] niks3-server[1000]: 2026/09/20 08:18:45 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6060lb # [ 168.181673] niks3-server[1000]: 2026/09/20 08:18:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6061worker2 # [ 168.126297] nix-grpc-daemon[1303]: time=2026-09-20T08:18:45.564Z level=INFO msg="Uploading 1 narinfos"6062lb # [ 168.194548] niks3-server[1000]: 2026/09/20 08:18:45 INFO Signed narinfos id=64 count=16063lb # [ 168.201714] niks3-server[1000]: 2026/09/20 08:18:45 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6064lb # [ 168.212455] niks3-server[1000]: 2026/09/20 08:18:45 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6065lb # [ 168.217644] niks3-server[1000]: 2026/09/20 08:18:45 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6066lb # [ 168.221552] niks3-server[1000]: 2026/09/20 08:18:45 INFO Completed upload id=646067worker2 # [ 168.158455] nix-grpc-daemon[1303]: time=2026-09-20T08:18:45.597Z level=INFO msg="Upload complete. (530ms)"6068worker2 # [ 168.168698] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=0 paths=1 nar_bytes_in=6326069worker2 # [ 168.180631] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519406070worker2 # [ 168.195774] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)6071worker2 # [ 168.199829] nix-daemon[835]: reaped child process 1537, status = succeeded6072client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6073worker2 # [ 168.211503] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)6074client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6075client # farm-b> LOG-farm-b-drain6076worker2 # [ 169.667506] nix-daemon[835]: reaped child process 1551, status = succeeded6077worker2 # [ 169.856636] nix-daemon[835]: accepted connection from pid 1566, user nix-grpc-daemon (trusted)6078worker2 # [ 169.875165] nix-daemon[835]: reaped child process 1569, status = succeeded6079lb # [ 169.951694] niks3-server[1000]: 2026/09/20 08:18:47 INFO Received uploads request method=POST path=/api/pending_closures6080worker2 # [ 169.900457] nix-grpc-daemon[1303]: time=2026-09-20T08:18:47.336Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6081worker2 # [ 169.901962] nix-grpc-daemon[1303]: time=2026-09-20T08:18:47.336Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6082lb # [ 169.986046] niks3-server[1000]: 2026/09/20 08:18:47 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6083lb # [ 169.999875] niks3-server[1000]: 2026/09/20 08:18:47 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6084worker2 # [ 169.956286] nix-grpc-daemon[1303]: time=2026-09-20T08:18:47.394Z level=INFO msg="Uploading 1 narinfos"6085lb # [ 170.014781] niks3-server[1000]: 2026/09/20 08:18:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6086lb # [ 170.025180] niks3-server[1000]: 2026/09/20 08:18:47 INFO Signed narinfos id=65 count=16087lb # [ 170.027872] niks3-server[1000]: 2026/09/20 08:18:47 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6088lb # [ 170.036082] niks3-server[1000]: 2026/09/20 08:18:47 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6089lb # [ 170.044955] niks3-server[1000]: 2026/09/20 08:18:47 INFO Completed upload id=656090worker2 # [ 169.980863] nix-grpc-daemon[1303]: time=2026-09-20T08:18:47.419Z level=INFO msg="Upload complete. (354ms)"6091lb # [ 170.047792] niks3-server[1000]: 2026/09/20 08:18:47 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6092worker2 # [ 169.995294] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=16093worker2 # [ 170.015904] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:47Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06094worker2 # [ 170.020566] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:47Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16095worker2 # [ 170.025014] nix-daemon[835]: reaped child process 1549, status = succeeded6096worker2 # [ 170.057366] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519406097worker2 # [ 170.072936] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:519406098worker2 # [ 170.087377] nix-grpc-daemon[1303]: time=2026-09-20T08:18:47.526Z level=INFO msg="All 2 paths already cached"6099client # copying 1 paths to 'lb:50051'...6100client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6101worker2 # [ 170.098495] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:519406102worker2 # [ 170.112333] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)6103worker2 # [ 170.318195] nix-daemon[835]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)6104worker2 # [ 170.335908] nix-daemon[835]: reaped child process 1578, status = succeeded6105worker2 # [ 170.509418] nix-daemon[835]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6106worker2 # [ 170.526928] nix-daemon[835]: reaped child process 1583, status = succeeded6107lb # [ 170.601860] niks3-server[1000]: 2026/09/20 08:18:48 INFO Received uploads request method=POST path=/api/pending_closures6108worker2 # [ 170.548172] nix-grpc-daemon[1303]: time=2026-09-20T08:18:47.987Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6109worker2 # [ 170.550072] nix-grpc-daemon[1303]: time=2026-09-20T08:18:47.987Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6110lb # [ 170.632057] niks3-server[1000]: 2026/09/20 08:18:48 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6111lb # [ 170.644873] niks3-server[1000]: 2026/09/20 08:18:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6112worker2 # [ 170.588069] nix-grpc-daemon[1303]: time=2026-09-20T08:18:48.026Z level=INFO msg="Uploading 1 narinfos"6113lb # [ 170.655043] niks3-server[1000]: 2026/09/20 08:18:48 INFO Signed narinfos id=66 count=16114lb # [ 170.664838] niks3-server[1000]: 2026/09/20 08:18:48 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6115lb # [ 170.675147] niks3-server[1000]: 2026/09/20 08:18:48 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6116lb # [ 170.680378] niks3-server[1000]: 2026/09/20 08:18:48 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6117lb # [ 170.691171] niks3-server[1000]: 2026/09/20 08:18:48 INFO Completed upload id=666118worker2 # [ 170.628036] nix-grpc-daemon[1303]: time=2026-09-20T08:18:48.066Z level=INFO msg="Upload complete. (498ms)"6119worker2 # [ 170.635999] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=0 paths=1 nar_bytes_in=7606120worker2 # [ 170.650401] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:519406121worker2 # [ 170.657841] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)6122worker2 # [ 170.663181] nix-daemon[835]: reaped child process 1573, status = succeeded6123client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6124client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6125worker2 # [ 170.678934] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)6126client # farm-top> LOG-farm-top-drain6127worker2 # [ 172.121644] nix-daemon[835]: reaped child process 1587, status = succeeded6128worker2 # [ 172.310431] nix-daemon[835]: accepted connection from pid 1602, user nix-grpc-daemon (trusted)6129worker2 # [ 172.329350] nix-daemon[835]: reaped child process 1605, status = succeeded6130lb # [ 172.407471] niks3-server[1000]: 2026/09/20 08:18:49 INFO Received uploads request method=POST path=/api/pending_closures6131worker2 # [ 172.357975] nix-grpc-daemon[1303]: time=2026-09-20T08:18:49.795Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6132worker2 # [ 172.359484] nix-grpc-daemon[1303]: time=2026-09-20T08:18:49.795Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6133lb # [ 172.456213] niks3-server[1000]: 2026/09/20 08:18:49 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6134worker2 # [ 172.404554] nix-grpc-daemon[1303]: time=2026-09-20T08:18:49.843Z level=INFO msg="Uploading 1 narinfos"6135lb # [ 172.470148] niks3-server[1000]: 2026/09/20 08:18:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6136lb # [ 172.478689] niks3-server[1000]: 2026/09/20 08:18:49 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6137lb # [ 172.488647] niks3-server[1000]: 2026/09/20 08:18:49 INFO Signed narinfos id=67 count=16138lb # [ 172.490870] niks3-server[1000]: 2026/09/20 08:18:49 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6139lb # [ 172.495237] niks3-server[1000]: 2026/09/20 08:18:49 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6140worker2 # [ 172.425381] nix-grpc-daemon[1303]: time=2026-09-20T08:18:49.864Z level=INFO msg="Upload complete. (333ms)"6141lb # [ 172.499967] niks3-server[1000]: 2026/09/20 08:18:49 INFO Completed upload id=676142lb # [ 172.502625] niks3-server[1000]: 2026/09/20 08:18:49 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6143worker2 # [ 172.438632] nix-grpc-daemon[1159]: ts=2026-09-20T08:18:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51940 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=16144worker2 # [ 172.454670] nix-daemon[835]: reaped child process 1585, status = succeeded6145client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&2, in 7.32 seconds)6146client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath6147lb # [ 172.556957] envoy[916]: conn peer=[2001:db8:1::1]:38796 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=710 tx=439 ms=366148lb # [ 172.561791] envoy[916]: conn peer=[2001:db8:1::1]:38808 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9423 tx=3813 ms=70306149client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath, in 0.24 seconds)6150worker1: must succeed: rm /nix/.rw-store/fill6151worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6152worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6153worker1 # [ 173.183553] nix-grpc-daemon[1790]: ts=2026-09-20T08:18:50Z level=info event=healthy reason=min_free6154worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6155(finished: subtest: low disk drains a worker and builds go to the other, in 11.19 seconds)6156(finished: run the VM test script, in 175.13 seconds)6157test script finished in 175.43s6158cleanup6159kill QemuMachine (pid 50)6160client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6161kill QemuMachine (pid 49)6162lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6163kill QemuMachine (pid 51)6164worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6165kill QemuMachine (pid 52)6166worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6167(finished: cleanup, in 1.27 seconds)6168additionally exposed symbols:6169 client, lb, worker1, worker2,6170 vlan1,6171 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh