vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #312
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb # Formatting '/build/vm-state-lb/tmp.6y7QYG580J', fmt=raw size=107374182414worker2 # Disk image does not exist, creating the virtualisation disk image...15client # Disk image does not exist, creating the virtualisation disk image...16lb # mke2fs 1.47.4 (6-Mar-2025)17worker2 # Formatting '/build/vm-state-worker2/tmp.knFYPcFtco', fmt=raw size=107374182418lb: QEMU running (pid 49)19worker2: QEMU running (pid 51)20client: QEMU running (pid 50)21client # Formatting '/build/vm-state-client/tmp.dNCbCt1DfO', fmt=raw size=107374182422worker1 # Disk image does not exist, creating the virtualisation disk image...23worker1: QEMU running (pid 52)24client # mke2fs 1.47.4 (6-Mar-2025)25worker1 # Formatting '/build/vm-state-worker1/tmp.I8Mo8MZfuM', fmt=raw size=107374182426worker2 # mke2fs 1.47.4 (6-Mar-2025)27lb # Discarding device blocks: 0/262144 done28(finished: start all VMs, in 0.68 seconds)29worker2 # Discarding device blocks: 0/262144 done30lb # Creating filesystem with 262144 4k blocks and 65536 inodes31client: waiting for unit network-addresses-eth1.service32worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes33lb # Filesystem UUID: 88d17a17-871f-45d5-b152-2dce3d80204d34client: waiting for the VM to finish booting35worker2 # Filesystem UUID: 5f06c356-a9ad-4131-936c-cf6187c49e8e36lb # Superblock backups stored on blocks:37worker1 # mke2fs 1.47.4 (6-Mar-2025)38client # Discarding device blocks: 0/262144 done39lb # 32768, 98304, 163840, 22937640worker1 # Discarding device blocks: 0/262144 done41worker2 # Superblock backups stored on blocks:42worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes43worker2 # 32768, 98304, 163840, 22937644lb # 45client # Creating filesystem with 262144 4k blocks and 65536 inodes46worker1 # Filesystem UUID: 28fc10b0-c676-4346-adde-bee7bfa0d5c447worker2 # 48lb # Allocating group tables: 0/8 done49client # Filesystem UUID: 74e73c33-48e3-4652-ac4e-4ab33af2f06250worker1 # Superblock backups stored on blocks:51worker2 # Allocating group tables: 0/8 done52lb # Writing inode tables: 0/8 done53client # Superblock backups stored on blocks:54worker1 # 32768, 98304, 163840, 22937655worker2 # Writing inode tables: 0/8 done56lb # Creating journal (8192 blocks): done57client # 32768, 98304, 163840, 22937658worker1 # 59worker2 # Creating journal (8192 blocks): done60lb # Writing superblocks and filesystem accounting information: 0/8 done61client # 62worker1 # Allocating group tables: 0/8 done63worker2 # Writing superblocks and filesystem accounting information: 0/8 done64lb # 65client # Allocating group tables: 0/8 done66worker1 # Writing inode tables: 0/8 done67worker2 # 68lb # Virtualisation disk image created.69client # Writing inode tables: 0/8 done70worker1 # Creating journal (8192 blocks): done71client # Creating journal (8192 blocks): done72worker1 # Writing superblocks and filesystem accounting information: 0/8 done73client # Writing superblocks and filesystem accounting information: 0/8 done74worker1 # 75client # 76worker1 # Virtualisation disk image created.77client # Virtualisation disk image created.78worker2 # Virtualisation disk image created.79client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681client # [ 0.000000] KASLR enabled82client # [ 0.000000] random: crng init done83client # [ 0.000000] Machine model: linux,dummy-virt84client # [ 0.000000] efi: UEFI not found.85client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88client # [ 0.000000] Zone ranges:89client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90client # [ 0.000000] DMA32 empty91client # [ 0.000000] Normal empty92client # [ 0.000000] Device empty93client # [ 0.000000] Movable zone start for each node94client # [ 0.000000] Early memory node ranges95client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098client # [ 0.000000] psci: probing for conduit method from DT.99client # [ 0.000000] psci: PSCIv1.3 detected in firmware.100client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101client # [ 0.000000] psci: Trusted OS migration not required102client # [ 0.000000] psci: SMC Calling Convention v1.1103client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105client # [ 0.000000] Detected PIPT I-cache on CPU0106client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107client # [ 0.000000] CPU features: detected: GICv3 CPU interface108client # [ 0.000000] CPU features: detected: Spectre-v4109client # [ 0.000000] CPU features: detected: Spectre-BHB110client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112client # [ 0.000000] alternatives: applying boot alternatives113client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3j2y8kv31agsjn1yas4ma4lb219pab3y-nixos-system-client-test/init regInfo=/nix/store/63g88aq44m01b06ba7pqisx5pysznrkm-closure-info/registration console=ttyAMA0,115200n8 console=tty0114client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/63g88aq44m01b06ba7pqisx5pysznrkm-closure-info/registration", will be passed to user space.115client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119client # [ 0.000000] software IO TLB: area num 1.120client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122client # [ 0.000000] Fallback order for Node 0: 0123lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]124client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216125lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026126lb # [ 0.000000] KASLR enabled127client # [ 0.000000] Policy zone: DMA128lb # [ 0.000000] random: crng init done129lb # [ 0.000000] Machine model: linux,dummy-virt130client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off131lb # [ 0.000000] efi: UEFI not found.132client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1133lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT134client # [ 0.000000] allocated 3145728 bytes of page_ext135lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]136client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages137client # [ 0.000000] ftrace: allocated 294 pages with 4 groups138lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]139lb # [ 0.000000] Zone ranges:140client # [ 0.000000] rcu: Hierarchical RCU implementation.141client # [ 0.000000] rcu: RCU event tracing is enabled.142lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]143lb # [ 0.000000] DMA32 empty144lb # [ 0.000000] Normal empty145client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.146lb # [ 0.000000] Device empty147client # [ 0.000000] Trampoline variant of Tasks RCU enabled.148lb # [ 0.000000] Movable zone start for each node149client # [ 0.000000] Rude variant of Tasks RCU enabled.150lb # [ 0.000000] Early memory node ranges151client # [ 0.000000] Tracing variant of Tasks RCU enabled.152lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]153client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.154lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]155client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1156lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000157lb # [ 0.000000] psci: probing for conduit method from DT.158client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.159lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.160lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs161client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.162lb # [ 0.000000] psci: Trusted OS migration not required163lb # [ 0.000000] psci: SMC Calling Convention v1.1164client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.165client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0166lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)167client # [ 0.000000] GICv3: 256 SPIs implemented168lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296169client # [ 0.000000] GICv3: 0 Extended SPIs implemented170lb # [ 0.000000] Detected PIPT I-cache on CPU0171client # [ 0.000000] Root IRQ handler: gic_handle_irq172client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI173lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)174client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0175lb # [ 0.000000] CPU features: detected: GICv3 CPU interface176client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000177lb # [ 0.000000] CPU features: detected: Spectre-v4178client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]179lb # [ 0.000000] CPU features: detected: Spectre-BHB180lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38181client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)182lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23183lb # [ 0.000000] alternatives: applying boot alternatives184client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)185client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000186client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000187client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.188worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]189client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns190lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty0191client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).192worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026193worker2 # [ 0.000000] KASLR enabled194lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space.195worker2 # [ 0.000000] random: crng init done196client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns197worker2 # [ 0.000000] Machine model: linux,dummy-virt198lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes199worker2 # [ 0.000000] efi: UEFI not found.200client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns201client # [ 0.000041] arm-pv: using stolen time PV202lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)203worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT204worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]205lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)206client # [ 0.000845] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)207client # [ 0.001022] Console: colour dummy device 80x25208worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]209lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB210worker2 # [ 0.000000] Zone ranges:211client # [ 0.001030] printk: legacy console [tty0] enabled212lb # [ 0.000000] software IO TLB: area num 1.213worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]214lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB215worker2 # [ 0.000000] DMA32 empty216client # [ 0.001221] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)217worker2 # [ 0.000000] Normal empty218worker2 # [ 0.000000] Device empty219client # [ 0.001228] pid_max: default: 32768 minimum: 301220lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)221worker2 # [ 0.000000] Movable zone start for each node222lb # [ 0.000000] Fallback order for Node 0: 0223client # [ 0.001327] LSM: initializing lsm=capability,landlock,yama,bpf,ima224worker2 # [ 0.000000] Early memory node ranges225client # [ 0.001555] landlock: Up and running.226lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216227worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]228client # [ 0.001558] Yama: becoming mindful.229lb # [ 0.000000] Policy zone: DMA230client # [ 0.002356] LSM support for eBPF active231worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]232lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off233client # [ 0.002534] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)234worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000235lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1236worker2 # [ 0.000000] psci: probing for conduit method from DT.237lb # [ 0.000000] allocated 3145728 bytes of page_ext238client # [ 0.002567] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)239worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.240lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages241client # [ 0.003878] cacheinfo: Unable to detect cache hierarchy for CPU 0242worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs243lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups244client # [ 0.004762] rcu: Hierarchical SRCU implementation.245worker2 # [ 0.000000] psci: Trusted OS migration not required246lb # [ 0.000000] rcu: Hierarchical RCU implementation.247client # [ 0.004768] rcu: Max phase no-delay instances is 1000.248worker2 # [ 0.000000] psci: SMC Calling Convention v1.1249lb # [ 0.000000] rcu: RCU event tracing is enabled.250client # [ 0.006023] fsl-mc MSI: its@8080000 domain created251client # [ 0.006115] EFI services will not be available.252lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.253worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)254client # [ 0.006207] smp: Bringing up secondary CPUs ...255lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.256client # [ 0.006216] smp: Brought up 1 node, 1 CPU257worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296258lb # [ 0.000000] Rude variant of Tasks RCU enabled.259worker2 # [ 0.000000] Detected PIPT I-cache on CPU0260client # [ 0.006219] SMP: Total of 1 processors activated.261lb # [ 0.000000] Tracing variant of Tasks RCU enabled.262client # [ 0.006225] CPU: All CPU(s) started at EL1263worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)264lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.265client # [ 0.006237] CPU features: detected: Branch Target Identification266worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface267lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1268client # [ 0.006242] CPU features: detected: ARMv8.4 Translation Table Level269worker2 # [ 0.000000] CPU features: detected: Spectre-v4270worker2 # [ 0.000000] CPU features: detected: Spectre-BHB271client # [ 0.006245] CPU features: detected: Instruction cache invalidation not required for I/D coherence272lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.273worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38274client # [ 0.006249] CPU features: detected: Data cache clean to the PoU not required for I/D coherence275worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23276lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.277client # [ 0.006252] CPU features: detected: Common not Private translations278worker2 # [ 0.000000] alternatives: applying boot alternatives279lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.280client # [ 0.006256] CPU features: detected: CRC32 instructions281lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0282client # [ 0.006259] CPU features: detected: Data cache clean to Point of Deep Persistence283lb # [ 0.000000] GICv3: 256 SPIs implemented284lb # [ 0.000000] GICv3: 0 Extended SPIs implemented285client # [ 0.006262] CPU features: detected: Data cache clean to Point of Persistence286lb # [ 0.000000] Root IRQ handler: gic_handle_irq287client # [ 0.006266] CPU features: detected: Data independent timing control (DIT)288lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI289client # [ 0.006269] CPU features: detected: E0PD290worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/x3wrb820mgrcywzswk6nh05hlfl2n0yn-nixos-system-worker2-test/init regInfo=/nix/store/grixp6b70l7ywiwly7vpncr31bs6dh52-closure-info/registration console=ttyAMA0,115200n8 console=tty0291lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0292client # [ 0.006271] CPU features: detected: Enhanced Counter Virtualization293lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000294lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]295client # [ 0.006274] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)296worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/grixp6b70l7ywiwly7vpncr31bs6dh52-closure-info/registration", will be passed to user space.297client # [ 0.006277] CPU features: detected: Enhanced Virtualization Traps298lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)299worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes300client # [ 0.006280] CPU features: detected: Fine Grained Traps301client # [ 0.006290] CPU features: detected: Generic authentication (architected QARMA5 algorithm)302worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)303lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)304client # [ 0.006296] CPU features: detected: RCpc load-acquire (LDAPR)305lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000306worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)307client # [ 0.006299] CPU features: detected: LSE atomic instructions308lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000309worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB310client # [ 0.006302] CPU features: detected: Privileged Access Never311worker2 # [ 0.000000] software IO TLB: area num 1.312client # [ 0.006305] CPU features: detected: PMUv3313lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.314worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB315client # [ 0.006307] CPU features: detected: RAS Extension Support316lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns317client # [ 0.006310] CPU features: detected: RASv1p1 Extension Support318worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)319worker2 # [ 0.000000] Fallback order for Node 0: 0320lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).321client # [ 0.006313] CPU features: detected: Random Number Generator322client # [ 0.006315] CPU features: detected: Speculation barrier (SB)323worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216324worker2 # [ 0.000000] Policy zone: DMA325lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns326client # [ 0.006318] CPU features: detected: Stage-2 Force Write-Back327worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off328client # [ 0.006321] CPU features: detected: TLB range maintenance instructions329lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns330lb # [ 0.000035] arm-pv: using stolen time PV331worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1332client # [ 0.006325] CPU features: detected: Speculative Store Bypassing Safe (SSBS)333worker2 # [ 0.000000] allocated 3145728 bytes of page_ext334client # [ 0.006373] alternatives: applying system-wide alternatives335worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages336lb # [ 0.000687] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)337client # [ 0.009484] CPU features: detected: BBM Level 2 without TLB conflict abort338lb # [ 0.000871] Console: colour dummy device 80x25339worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups340lb # [ 0.000880] printk: legacy console [tty0] enabled341worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.342worker2 # [ 0.000000] rcu: RCU event tracing is enabled.343client # [ 0.009674] Memory: 1406564K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)344lb # [ 0.001070] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)345worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.346client # [ 0.010162] devtmpfs: initialized347lb # [ 0.001076] pid_max: default: 32768 minimum: 301348worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.349client # [ 0.012170] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)350lb # [ 0.001164] LSM: initializing lsm=capability,landlock,yama,bpf,ima351worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.352lb # [ 0.001320] landlock: Up and running.353worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.354client # [ 0.012194] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).355lb # [ 0.001323] Yama: becoming mindful.356lb # [ 0.001939] LSM support for eBPF active357worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.358client # [ 0.012391] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL359client # [ 0.012396] 0 pages in range for non-PLT usage360lb # [ 0.002096] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)361worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1362client # [ 0.012397] 508288 pages in range for PLT usage363lb # [ 0.002132] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)364client # [ 0.012528] pinctrl core: initialized pinctrl subsystem365worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.366client # [ 0.013337] DMI not present or invalid.367lb # [ 0.003401] cacheinfo: Unable to detect cache hierarchy for CPU 0368worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.369lb # [ 0.004225] rcu: Hierarchical SRCU implementation.370client # [ 0.017458] NET: Registered PF_NETLINK/PF_ROUTE protocol family371lb # [ 0.004230] rcu: Max phase no-delay instances is 1000.372client # [ 0.019895] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations373worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.374lb # [ 0.005486] fsl-mc MSI: its@8080000 domain created375worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0376lb # [ 0.005592] EFI services will not be available.377client # [ 0.020076] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations378worker2 # [ 0.000000] GICv3: 256 SPIs implemented379lb # [ 0.005747] smp: Bringing up secondary CPUs ...380client # [ 0.020282] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations381worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented382lb # [ 0.005758] smp: Brought up 1 node, 1 CPU383worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq384lb # [ 0.005761] SMP: Total of 1 processors activated.385client # [ 0.020305] audit: initializing netlink subsys (disabled)386worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI387lb # [ 0.005767] CPU: All CPU(s) started at EL1388client # [ 0.020942] thermal_sys: Registered thermal governor 'fair_share'389worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0390lb # [ 0.005778] CPU features: detected: Branch Target Identification391client # [ 0.020944] thermal_sys: Registered thermal governor 'bang_bang'392worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000393lb # [ 0.005783] CPU features: detected: ARMv8.4 Translation Table Level394client # [ 0.020948] thermal_sys: Registered thermal governor 'step_wise'395worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]396client # [ 0.020954] thermal_sys: Registered thermal governor 'user_space'397lb # [ 0.005786] CPU features: detected: Instruction cache invalidation not required for I/D coherence398worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)399client # [ 0.020957] thermal_sys: Registered thermal governor 'power_allocator'400lb # [ 0.005790] CPU features: detected: Data cache clean to the PoU not required for I/D coherence401client # [ 0.020992] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1402lb # [ 0.005817] CPU features: detected: Common not Private translations403client # [ 0.021003] cpuidle: using governor ladder404lb # [ 0.005820] CPU features: detected: CRC32 instructions405worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)406client # [ 0.021009] cpuidle: using governor menu407worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000408client # [ 0.021206] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.409lb # [ 0.005823] CPU features: detected: Data cache clean to Point of Deep Persistence410client # [ 0.021223] ASID allocator initialised with 65536 entries411worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000412lb # [ 0.005827] CPU features: detected: Data cache clean to Point of Persistence413client # [ 0.022496] Serial: AMBA PL011 UART driver414worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.415lb # [ 0.005830] CPU features: detected: Data independent timing control (DIT)416lb # [ 0.005834] CPU features: detected: E0PD417client # [ 0.028115] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1418client # [ 0.028305] printk: console [ttyAMA0] enabled419worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns420lb # [ 0.005836] CPU features: detected: Enhanced Counter Virtualization421worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).422lb # [ 0.005839] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)423lb # [ 0.005842] CPU features: detected: Enhanced Virtualization Traps424worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns425lb # [ 0.005845] CPU features: detected: Fine Grained Traps426worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns427lb # [ 0.005849] CPU features: detected: Generic authentication (architected QARMA5 algorithm)428worker2 # [ 0.000034] arm-pv: using stolen time PV429lb # [ 0.005854] CPU features: detected: RCpc load-acquire (LDAPR)430worker2 # [ 0.000531] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)431lb # [ 0.005857] CPU features: detected: LSE atomic instructions432worker2 # [ 0.000733] Console: colour dummy device 80x25433lb # [ 0.005860] CPU features: detected: Privileged Access Never434worker2 # [ 0.000742] printk: legacy console [tty0] enabled435lb # [ 0.005863] CPU features: detected: PMUv3436lb # [ 0.005865] CPU features: detected: RAS Extension Support437worker2 # [ 0.000936] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)438worker2 # [ 0.000943] pid_max: default: 32768 minimum: 301439lb # [ 0.005868] CPU features: detected: RASv1p1 Extension Support440worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]441lb # [ 0.005870] CPU features: detected: Random Number Generator442worker2 # [ 0.001024] LSM: initializing lsm=capability,landlock,yama,bpf,ima443lb # [ 0.005873] CPU features: detected: Speculation barrier (SB)444worker2 # [ 0.001222] landlock: Up and running.445worker2 # [ 0.001225] Yama: becoming mindful.446lb # [ 0.005875] CPU features: detected: Stage-2 Force Write-Back447client # [ 0.153077] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages448worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026449worker2 # [ 0.001802] LSM support for eBPF active450worker1 # [ 0.000000] KASLR enabled451lb # [ 0.005878] CPU features: detected: TLB range maintenance instructions452client # [ 0.153097] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page453worker1 # [ 0.000000] random: crng init done454worker2 # [ 0.001975] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)455worker1 # [ 0.000000] Machine model: linux,dummy-virt456client # [ 0.153102] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages457lb # [ 0.005882] CPU features: detected: Speculative Store Bypassing Safe (SSBS)458worker1 # [ 0.000000] efi: UEFI not found.459worker2 # [ 0.002010] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)460lb # [ 0.005924] alternatives: applying system-wide alternatives461client # [ 0.153107] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page462worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT463worker2 # [ 0.003133] cacheinfo: Unable to detect cache hierarchy for CPU 0464lb # [ 0.008925] CPU features: detected: BBM Level 2 without TLB conflict abort465client # [ 0.153111] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages466worker2 # [ 0.003863] rcu: Hierarchical SRCU implementation.467worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]468client # [ 0.153116] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page469worker2 # [ 0.003867] rcu: Max phase no-delay instances is 1000.470worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]471worker2 # [ 0.005120] fsl-mc MSI: its@8080000 domain created472worker1 # [ 0.000000] Zone ranges:473client # [ 0.153120] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages474lb # [ 0.009109] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)475lb # [ 0.009543] devtmpfs: initialized476worker2 # [ 0.005212] EFI services will not be available.477worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]478client # [ 0.153124] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page479worker2 # [ 0.005297] smp: Bringing up secondary CPUs ...480worker1 # [ 0.000000] DMA32 empty481lb # [ 0.011536] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)482worker1 # [ 0.000000] Normal empty483worker2 # [ 0.005306] smp: Brought up 1 node, 1 CPU484worker1 # [ 0.000000] Device empty485worker2 # [ 0.005310] SMP: Total of 1 processors activated.486worker1 # [ 0.000000] Movable zone start for each node487lb # [ 0.011560] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).488worker2 # [ 0.005315] CPU: All CPU(s) started at EL1489worker1 # [ 0.000000] Early memory node ranges490lb # [ 0.011753] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL491client # [ 0.160522] fbcon: Taking over console492worker2 # [ 0.005327] CPU features: detected: Branch Target Identification493worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]494client # [ 0.160541] ACPI: Interpreter disabled.495lb # [ 0.011759] 0 pages in range for non-PLT usage496worker2 # [ 0.005332] CPU features: detected: ARMv8.4 Translation Table Level497lb # [ 0.011759] 508288 pages in range for PLT usage498worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]499client # [ 0.162464] iommu: Default domain type: Translated500lb # [ 0.011853] pinctrl core: initialized pinctrl subsystem501worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000502worker2 # [ 0.005335] CPU features: detected: Instruction cache invalidation not required for I/D coherence503lb # [ 0.012636] DMI not present or invalid.504client # [ 0.162473] iommu: DMA domain TLB invalidation policy: strict mode505worker1 # [ 0.000000] psci: probing for conduit method from DT.506lb # [ 0.016519] NET: Registered PF_NETLINK/PF_ROUTE protocol family507worker2 # [ 0.005339] CPU features: detected: Data cache clean to the PoU not required for I/D coherence508client # [ 0.164131] SCSI subsystem initialized509worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.510worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs511lb # [ 0.018870] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations512worker2 # [ 0.005343] CPU features: detected: Common not Private translations513worker1 # [ 0.000000] psci: Trusted OS migration not required514worker2 # [ 0.005346] CPU features: detected: CRC32 instructions515client # [ 0.164834] usbcore: registered new interface driver usbfs516lb # [ 0.019050] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations517worker1 # [ 0.000000] psci: SMC Calling Convention v1.1518client # [ 0.164867] usbcore: registered new interface driver hub519worker2 # [ 0.005348] CPU features: detected: Data cache clean to Point of Deep Persistence520client # [ 0.164885] usbcore: registered new device driver usb521lb # [ 0.019259] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations522worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)523worker2 # [ 0.005352] CPU features: detected: Data cache clean to Point of Persistence524client # [ 0.165169] pps_core: LinuxPPS API ver. 1 registered525lb # [ 0.019284] audit: initializing netlink subsys (disabled)526worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296527worker2 # [ 0.005355] CPU features: detected: Data independent timing control (DIT)528worker1 # [ 0.000000] Detected PIPT I-cache on CPU0529client # [ 0.165179] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>530worker2 # [ 0.005358] CPU features: detected: E0PD531client # [ 0.165189] PTP clock support registered532lb # [ 0.019901] thermal_sys: Registered thermal governor 'fair_share'533worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)534client # [ 0.165238] EDAC MC: Ver: 3.0.0535worker2 # [ 0.005361] CPU features: detected: Enhanced Counter Virtualization536lb # [ 0.019904] thermal_sys: Registered thermal governor 'bang_bang'537worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface538worker2 # [ 0.005364] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)539worker1 # [ 0.000000] CPU features: detected: Spectre-v4540client # [ 0.169783] scmi_core: SCMI protocol bus registered541lb # [ 0.019907] thermal_sys: Registered thermal governor 'step_wise'542worker1 # [ 0.000000] CPU features: detected: Spectre-BHB543worker2 # [ 0.005367] CPU features: detected: Enhanced Virtualization Traps544lb # [ 0.019914] thermal_sys: Registered thermal governor 'user_space'545worker2 # [ 0.005370] CPU features: detected: Fine Grained Traps546worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38547lb # [ 0.019917] thermal_sys: Registered thermal governor 'power_allocator'548worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23549worker2 # [ 0.005373] CPU features: detected: Generic authentication (architected QARMA5 algorithm)550lb # [ 0.019943] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1551worker1 # [ 0.000000] alternatives: applying boot alternatives552worker2 # [ 0.005379] CPU features: detected: RCpc load-acquire (LDAPR)553lb # [ 0.019952] cpuidle: using governor ladder554worker2 # [ 0.005382] CPU features: detected: LSE atomic instructions555lb # [ 0.019958] cpuidle: using governor menu556worker2 # [ 0.005384] CPU features: detected: Privileged Access Never557lb # [ 0.020178] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.558worker2 # [ 0.005387] CPU features: detected: PMUv3559lb # [ 0.020199] ASID allocator initialised with 65536 entries560worker2 # [ 0.005390] CPU features: detected: RAS Extension Support561lb # [ 0.021512] Serial: AMBA PL011 UART driver562worker2 # [ 0.005393] CPU features: detected: RASv1p1 Extension Support563worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c67lwc2h6a7f85im32ri7jaa42wrs5q4-nixos-system-worker1-test/init regInfo=/nix/store/5h5p9hzk8zchvd2q3dfwp2n50g1kl7yc-closure-info/registration console=ttyAMA0,115200n8 console=tty0564lb # [ 0.027062] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1565worker2 # [ 0.005395] CPU features: detected: Random Number Generator566lb # [ 0.027230] printk: console [ttyAMA0] enabled567worker2 # [ 0.005398] CPU features: detected: Speculation barrier (SB)568worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/5h5p9hzk8zchvd2q3dfwp2n50g1kl7yc-closure-info/registration", will be passed to user space.569worker2 # [ 0.005401] CPU features: detected: Stage-2 Force Write-Back570client # [ 0.177812] FPGA manager framework571worker2 # [ 0.005404] CPU features: detected: TLB range maintenance instructions572client # [ 0.178841] vgaarb: loaded573worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes574worker2 # [ 0.005408] CPU features: detected: Speculative Store Bypassing Safe (SSBS)575worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)576client # [ 0.179523] clocksource: Switched to clocksource arch_sys_counter577worker2 # [ 0.005445] alternatives: applying system-wide alternatives578worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)579worker2 # [ 0.008461] CPU features: detected: BBM Level 2 without TLB conflict abort580worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB581client # [ 0.181592] VFS: Disk quotas dquot_6.6.0582worker1 # [ 0.000000] software IO TLB: area num 1.583client # [ 0.181633] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)584worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB585worker2 # [ 0.008707] Memory: 1406756K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)586worker2 # [ 0.009160] devtmpfs: initialized587worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)588worker2 # [ 0.011346] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)589worker1 # [ 0.000000] Fallback order for Node 0: 0590worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216591worker2 # [ 0.011376] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).592worker1 # [ 0.000000] Policy zone: DMA593client # [ 0.185404] netfs: FS-Cache loaded594worker2 # [ 0.011573] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL595client # [ 0.185552] pnp: PnP ACPI: disabled596worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off597worker2 # [ 0.011577] 0 pages in range for non-PLT usage598lb # [ 0.151344] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages599worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1600worker2 # [ 0.011578] 508288 pages in range for PLT usage601worker1 # [ 0.000000] allocated 3145728 bytes of page_ext602lb # [ 0.151369] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page603worker2 # [ 0.011693] pinctrl core: initialized pinctrl subsystem604worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages605worker2 # [ 0.012557] DMI not present or invalid.606lb # [ 0.151374] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages607worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups608worker2 # [ 0.016218] NET: Registered PF_NETLINK/PF_ROUTE protocol family609lb # [ 0.151379] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page610worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.611worker2 # [ 0.018574] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations612worker1 # [ 0.000000] rcu: RCU event tracing is enabled.613lb # [ 0.151383] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages614worker2 # [ 0.018767] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations615worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.616lb # [ 0.151388] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page617worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.618lb # [ 0.151392] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages619worker2 # [ 0.018969] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations620worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.621client # [ 0.189595] NET: Registered PF_INET protocol family622lb # [ 0.151396] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page623worker2 # [ 0.018995] audit: initializing netlink subsys (disabled)624worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.625client # [ 0.189879] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)626worker2 # [ 0.019608] thermal_sys: Registered thermal governor 'fair_share'627worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.628worker2 # [ 0.019611] thermal_sys: Registered thermal governor 'bang_bang'629worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1630worker2 # [ 0.019615] thermal_sys: Registered thermal governor 'step_wise'631lb # [ 0.158826] fbcon: Taking over console632worker2 # [ 0.019620] thermal_sys: Registered thermal governor 'user_space'633worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.634lb # [ 0.158841] ACPI: Interpreter disabled.635worker2 # [ 0.019623] thermal_sys: Registered thermal governor 'power_allocator'636worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.637worker2 # [ 0.019660] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1638worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.639worker2 # [ 0.019671] cpuidle: using governor ladder640worker2 # [ 0.019677] cpuidle: using governor menu641worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0642worker1 # [ 0.000000] GICv3: 256 SPIs implemented643worker2 # [ 0.019877] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.644worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented645worker2 # [ 0.019894] ASID allocator initialised with 65536 entries646worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq647worker2 # [ 0.021235] Serial: AMBA PL011 UART driver648worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI649worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0650worker2 # [ 0.026645] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1651worker2 # [ 0.026783] printk: console [ttyAMA0] enabled652worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000653worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]654lb # [ 0.166801] iommu: Default domain type: Translated655lb # [ 0.166814] iommu: DMA domain TLB invalidation policy: strict mode656worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)657lb # [ 0.167246] SCSI subsystem initialized658worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)659lb # [ 0.169296] usbcore: registered new interface driver usbfs660worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000661lb # [ 0.169332] usbcore: registered new interface driver hub662worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000663lb # [ 0.169357] usbcore: registered new device driver usb664worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.665lb # [ 0.169704] pps_core: LinuxPPS API ver. 1 registered666lb # [ 0.169713] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>667worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns668lb # [ 0.169723] PTP clock support registered669worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).670lb # [ 0.169777] EDAC MC: Ver: 3.0.0671lb # [ 0.174615] scmi_core: SCMI protocol bus registered672worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns673worker2 # [ 0.149535] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages674lb # [ 0.175676] FPGA manager framework675worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns676worker2 # [ 0.149560] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page677lb # [ 0.176744] vgaarb: loaded678worker1 # [ 0.000033] arm-pv: using stolen time PV679worker2 # [ 0.149565] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages680lb # [ 0.177421] clocksource: Switched to clocksource arch_sys_counter681worker2 # [ 0.149570] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page682worker1 # [ 0.000429] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)683worker1 # [ 0.000607] Console: colour dummy device 80x25684worker2 # [ 0.149575] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages685worker1 # [ 0.000616] printk: legacy console [tty0] enabled686worker2 # [ 0.149579] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page687worker1 # [ 0.000822] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)688worker2 # [ 0.149584] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages689worker1 # [ 0.000829] pid_max: default: 32768 minimum: 301690lb # [ 0.180655] VFS: Disk quotas dquot_6.6.0691worker2 # [ 0.149588] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page692worker1 # [ 0.000901] LSM: initializing lsm=capability,landlock,yama,bpf,ima693lb # [ 0.180698] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)694worker1 # [ 0.001063] landlock: Up and running.695worker1 # [ 0.001066] Yama: becoming mindful.696worker1 # [ 0.001499] LSM support for eBPF active697worker2 # [ 0.157342] fbcon: Taking over console698worker1 # [ 0.001646] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)699worker2 # [ 0.157365] ACPI: Interpreter disabled.700worker1 # [ 0.001688] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)701lb # [ 0.184666] netfs: FS-Cache loaded702lb # [ 0.184813] pnp: PnP ACPI: disabled703worker1 # [ 0.002842] cacheinfo: Unable to detect cache hierarchy for CPU 0704worker1 # [ 0.003659] rcu: Hierarchical SRCU implementation.705worker1 # [ 0.003665] rcu: Max phase no-delay instances is 1000.706worker1 # [ 0.004939] fsl-mc MSI: its@8080000 domain created707worker1 # [ 0.005037] EFI services will not be available.708worker1 # [ 0.005136] smp: Bringing up secondary CPUs ...709worker1 # [ 0.005145] smp: Brought up 1 node, 1 CPU710worker1 # [ 0.005149] SMP: Total of 1 processors activated.711worker1 # [ 0.005155] CPU: All CPU(s) started at EL1712lb # [ 0.188835] NET: Registered PF_INET protocol family713worker1 # [ 0.005166] CPU features: detected: Branch Target Identification714lb # [ 0.189154] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)715worker1 # [ 0.005171] CPU features: detected: ARMv8.4 Translation Table Level716worker2 # [ 0.165856] iommu: Default domain type: Translated717worker2 # [ 0.165869] iommu: DMA domain TLB invalidation policy: strict mode718worker1 # [ 0.005174] CPU features: detected: Instruction cache invalidation not required for I/D coherence719worker2 # [ 0.167685] SCSI subsystem initialized720worker1 # [ 0.005178] CPU features: detected: Data cache clean to the PoU not required for I/D coherence721client # [ 0.221029] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)722worker1 # [ 0.005181] CPU features: detected: Common not Private translations723client # [ 0.221090] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)724worker2 # [ 0.168489] usbcore: registered new interface driver usbfs725worker1 # [ 0.005184] CPU features: detected: CRC32 instructions726client # [ 0.221126] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)727worker2 # [ 0.168522] usbcore: registered new interface driver hub728worker1 # [ 0.005187] CPU features: detected: Data cache clean to Point of Deep Persistence729worker2 # [ 0.168541] usbcore: registered new device driver usb730client # [ 0.221214] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)731worker1 # [ 0.005191] CPU features: detected: Data cache clean to Point of Persistence732worker2 # [ 0.168852] pps_core: LinuxPPS API ver. 1 registered733client # [ 0.221359] TCP: Hash tables configured (established 16384 bind 16384)734worker1 # [ 0.005194] CPU features: detected: Data independent timing control (DIT)735worker2 # [ 0.168858] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>736worker1 # [ 0.005197] CPU features: detected: E0PD737client # [ 0.221457] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)738worker2 # [ 0.168869] PTP clock support registered739worker2 # [ 0.168926] EDAC MC: Ver: 3.0.0740worker1 # [ 0.005200] CPU features: detected: Enhanced Counter Virtualization741client # [ 0.221497] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)742worker1 # [ 0.005203] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)743worker2 # [ 0.173534] scmi_core: SCMI protocol bus registered744client # [ 0.221536] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)745worker1 # [ 0.005206] CPU features: detected: Enhanced Virtualization Traps746client # [ 0.221633] NET: Registered PF_UNIX/PF_LOCAL protocol family747worker2 # [ 0.174548] FPGA manager framework748worker1 # [ 0.005209] CPU features: detected: Fine Grained Traps749client # [ 0.221688] NET: Registered PF_XDP protocol family750worker2 # [ 0.175586] vgaarb: loaded751client # [ 0.221712] PCI: CLS 0 bytes, default 64752worker1 # [ 0.005212] CPU features: detected: Generic authentication (architected QARMA5 algorithm)753client # [ 0.221974] Trying to unpack rootfs image as initramfs...754worker2 # [ 0.176232] clocksource: Switched to clocksource arch_sys_counter755worker1 # [ 0.005217] CPU features: detected: RCpc load-acquire (LDAPR)756worker1 # [ 0.005220] CPU features: detected: LSE atomic instructions757worker1 # [ 0.005223] CPU features: detected: Privileged Access Never758worker1 # [ 0.005226] CPU features: detected: PMUv3759worker1 # [ 0.005228] CPU features: detected: RAS Extension Support760client # [ 0.237363] kvm [1]: HYP mode not available761worker2 # [ 0.179398] VFS: Disk quotas dquot_6.6.0762worker1 # [ 0.005231] CPU features: detected: RASv1p1 Extension Support763worker2 # [ 0.179443] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)764worker1 # [ 0.005234] CPU features: detected: Random Number Generator765worker1 # [ 0.005236] CPU features: detected: Speculation barrier (SB)766worker1 # [ 0.005239] CPU features: detected: Stage-2 Force Write-Back767worker1 # [ 0.005242] CPU features: detected: TLB range maintenance instructions768worker2 # [ 0.183276] netfs: FS-Cache loaded769worker1 # [ 0.005247] CPU features: detected: Speculative Store Bypassing Safe (SSBS)770worker2 # [ 0.183411] pnp: PnP ACPI: disabled771worker1 # [ 0.005289] alternatives: applying system-wide alternatives772worker1 # [ 0.008381] CPU features: detected: BBM Level 2 without TLB conflict abort773worker1 # [ 0.008598] Memory: 1406572K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)774worker1 # [ 0.009033] devtmpfs: initialized775worker1 # [ 0.011397] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)776worker1 # [ 0.011422] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).777worker1 # [ 0.011646] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL778worker1 # [ 0.011650] 0 pages in range for non-PLT usage779worker1 # [ 0.011651] 508288 pages in range for PLT usage780worker2 # [ 0.188668] NET: Registered PF_INET protocol family781worker1 # [ 0.011778] pinctrl core: initialized pinctrl subsystem782worker1 # [ 0.012589] DMI not present or invalid.783worker2 # [ 0.188966] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)784worker1 # [ 0.015905] NET: Registered PF_NETLINK/PF_ROUTE protocol family785worker1 # [ 0.018360] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations786worker1 # [ 0.018571] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations787worker1 # [ 0.018780] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations788worker1 # [ 0.018803] audit: initializing netlink subsys (disabled)789worker1 # [ 0.019447] thermal_sys: Registered thermal governor 'fair_share'790worker1 # [ 0.019449] thermal_sys: Registered thermal governor 'bang_bang'791worker1 # [ 0.019453] thermal_sys: Registered thermal governor 'step_wise'792worker1 # [ 0.019458] thermal_sys: Registered thermal governor 'user_space'793lb # [ 0.219910] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)794worker1 # [ 0.019461] thermal_sys: Registered thermal governor 'power_allocator'795lb # [ 0.219968] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)796worker1 # [ 0.019490] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1797worker1 # [ 0.019498] cpuidle: using governor ladder798lb # [ 0.219999] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)799worker1 # [ 0.019503] cpuidle: using governor menu800lb # [ 0.220080] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)801worker1 # [ 0.019693] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.802worker1 # [ 0.019709] ASID allocator initialised with 65536 entries803lb # [ 0.220223] TCP: Hash tables configured (established 16384 bind 16384)804worker1 # [ 0.020975] Serial: AMBA PL011 UART driver805lb # [ 0.220314] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)806worker1 # [ 0.026355] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1807lb # [ 0.220352] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)808worker1 # [ 0.026541] printk: console [ttyAMA0] enabled809lb # [ 0.220389] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)810lb # [ 0.220478] NET: Registered PF_UNIX/PF_LOCAL protocol family811lb # [ 0.220536] NET: Registered PF_XDP protocol family812lb # [ 0.220557] PCI: CLS 0 bytes, default 64813lb # [ 0.220798] Trying to unpack rootfs image as initramfs...814lb # [ 0.235403] kvm [1]: HYP mode not available815worker1 # [ 0.148090] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages816worker1 # [ 0.148111] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page817worker1 # [ 0.148117] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages818worker1 # [ 0.148121] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page819worker1 # [ 0.148125] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages820worker1 # [ 0.148130] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page821worker1 # [ 0.148134] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages822worker1 # [ 0.148138] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page823worker1 # [ 0.155795] fbcon: Taking over console824worker1 # [ 0.155810] ACPI: Interpreter disabled.825worker2 # [ 0.220398] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)826worker2 # [ 0.220467] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)827worker1 # [ 0.164890] iommu: Default domain type: Translated828worker2 # [ 0.220502] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)829worker1 # [ 0.164905] iommu: DMA domain TLB invalidation policy: strict mode830worker2 # [ 0.220595] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)831worker1 # [ 0.166628] SCSI subsystem initialized832worker2 # [ 0.220739] TCP: Hash tables configured (established 16384 bind 16384)833worker1 # [ 0.167357] usbcore: registered new interface driver usbfs834worker2 # [ 0.220833] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)835worker1 # [ 0.167390] usbcore: registered new interface driver hub836worker2 # [ 0.220871] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)837worker1 # [ 0.167409] usbcore: registered new device driver usb838worker1 # [ 0.167674] pps_core: LinuxPPS API ver. 1 registered839worker2 # [ 0.220909] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840worker2 # [ 0.221020] NET: Registered PF_UNIX/PF_LOCAL protocol family841worker1 # [ 0.167680] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>842worker2 # [ 0.221047] NET: Registered PF_XDP protocol family843worker1 # [ 0.167691] PTP clock support registered844worker2 # [ 0.221065] PCI: CLS 0 bytes, default 64845worker1 # [ 0.167740] EDAC MC: Ver: 3.0.0846worker2 # [ 0.221328] Trying to unpack rootfs image as initramfs...847worker1 # [ 0.172430] scmi_core: SCMI protocol bus registered848worker1 # [ 0.173495] FPGA manager framework849worker1 # [ 0.174475] vgaarb: loaded850worker1 # [ 0.175127] clocksource: Switched to clocksource arch_sys_counter851worker2 # [ 0.238291] kvm [1]: HYP mode not available852worker1 # [ 0.179583] VFS: Disk quotas dquot_6.6.0853worker1 # [ 0.179630] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)854worker1 # [ 0.183552] netfs: FS-Cache loaded855worker1 # [ 0.183694] pnp: PnP ACPI: disabled856worker1 # [ 0.187817] NET: Registered PF_INET protocol family857worker1 # [ 0.188100] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)858client # [ 0.349232] Initialise system trusted keyrings859client # [ 0.350008] workingset: timestamp_bits=42 max_order=19 bucket_order=0860client # [ 0.351427] squashfs: version 4.0 (2009/01/31) Phillip Lougher861worker1 # [ 0.219619] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)862worker1 # [ 0.219674] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)863worker1 # [ 0.219708] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)864client # [ 0.352297] 9p: Installing v9fs 9p2000 file system support865worker1 # [ 0.219796] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)866worker1 # [ 0.219941] TCP: Hash tables configured (established 16384 bind 16384)867worker1 # [ 0.220036] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)868worker1 # [ 0.220073] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)869worker1 # [ 0.220111] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)870worker1 # [ 0.220203] NET: Registered PF_UNIX/PF_LOCAL protocol family871worker1 # [ 0.220235] NET: Registered PF_XDP protocol family872worker1 # [ 0.220255] PCI: CLS 0 bytes, default 64873worker1 # [ 0.220531] Trying to unpack rootfs image as initramfs...874worker1 # [ 0.237270] kvm [1]: HYP mode not available875client # [ 0.380334] Key type asymmetric registered876lb # [ 0.346078] Initialise system trusted keyrings877client # [ 0.380370] Asymmetric key parser 'x509' registered878lb # [ 0.346852] workingset: timestamp_bits=42 max_order=19 bucket_order=0879client # [ 0.380449] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)880client # [ 0.382689] io scheduler mq-deadline registered881lb # [ 0.348181] squashfs: version 4.0 (2009/01/31) Phillip Lougher882client # [ 0.382701] io scheduler kyber registered883lb # [ 0.353489] 9p: Installing v9fs 9p2000 file system support884client # [ 0.396803] pl061_gpio 9030000.pl061: PL061 GPIO chip registered885client # [ 0.398190] ledtrig-cpu: registered to indicate activity on CPUs886client # [ 0.398599] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:887client # [ 0.398618] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000888client # [ 0.398631] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000889client # [ 0.398639] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000890client # [ 0.398661] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits891client # [ 0.398682] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]892client # [ 0.398757] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00893client # [ 0.398767] pci_bus 0000:00: root bus resource [bus 00-ff]894client # [ 0.398773] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]895lb # [ 0.374260] Key type asymmetric registered896client # [ 0.398778] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]897lb # [ 0.374292] Asymmetric key parser 'x509' registered898client # [ 0.398784] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]899lb # [ 0.374387] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)900client # [ 0.398845] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint901lb # [ 0.376604] io scheduler mq-deadline registered902lb # [ 0.376616] io scheduler kyber registered903client # [ 0.399305] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint904client # [ 0.399495] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]905client # [ 0.399512] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]906client # [ 0.414219] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]907client # [ 0.414241] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]908client # [ 0.414710] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint909client # [ 0.414893] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]910client # [ 0.414911] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]911client # [ 0.414942] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]912client # [ 0.415405] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint913worker2 # [ 0.360910] Initialise system trusted keyrings914worker2 # [ 0.361700] workingset: timestamp_bits=42 max_order=19 bucket_order=0915worker2 # [ 0.363053] squashfs: version 4.0 (2009/01/31) Phillip Lougher916client # [ 0.421513] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]917client # [ 0.421535] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]918worker2 # [ 0.363851] 9p: Installing v9fs 9p2000 file system support919client # [ 0.421566] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]920lb # [ 0.389619] pl061_gpio 9030000.pl061: PL061 GPIO chip registered921client # [ 0.422034] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint922client # [ 0.422222] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]923client # [ 0.422239] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]924lb # [ 0.391114] ledtrig-cpu: registered to indicate activity on CPUs925client # [ 0.422273] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]926lb # [ 0.391543] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:927client # [ 0.422756] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint928client # [ 0.422941] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]929lb # [ 0.391565] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000930client # [ 0.422959] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]931lb # [ 0.391578] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000932client # [ 0.422989] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]933lb # [ 0.391586] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000934client # [ 0.423438] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint935lb # [ 0.391610] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits936lb # [ 0.391636] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]937lb # [ 0.391715] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00938lb # [ 0.391725] pci_bus 0000:00: root bus resource [bus 00-ff]939lb # [ 0.391732] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]940lb # [ 0.391737] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]941lb # [ 0.391742] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]942lb # [ 0.391803] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint943lb # [ 0.392245] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint944lb # [ 0.392438] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]945lb # [ 0.392455] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]946lb # [ 0.392485] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]947lb # [ 0.392501] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]948lb # [ 0.392969] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint949lb # [ 0.393163] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]950lb # [ 0.393181] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]951lb # [ 0.393214] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]952client # [ 0.439733] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]953client # [ 0.439773] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]954lb # [ 0.413108] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint955client # [ 0.439806] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]956lb # [ 0.413310] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]957lb # [ 0.413327] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]958client # [ 0.440377] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint959lb # [ 0.413358] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]960client # [ 0.440582] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]961client # [ 0.440598] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]962client # [ 0.440629] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]963worker2 # [ 0.392602] Key type asymmetric registered964client # [ 0.440646] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]965worker2 # [ 0.392634] Asymmetric key parser 'x509' registered966client # [ 0.441116] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint967worker2 # [ 0.392710] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)968client # [ 0.441314] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]969worker2 # [ 0.394933] io scheduler mq-deadline registered970worker2 # [ 0.394946] io scheduler kyber registered971client # [ 0.441345] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]972client # [ 0.441815] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint973client # [ 0.442006] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]974client # [ 0.442038] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]975client # [ 0.442437] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint976client # [ 0.442623] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]977lb # [ 0.421996] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint978client # [ 0.442877] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint979lb # [ 0.422217] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]980client # [ 0.443178] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]981lb # [ 0.422234] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]982client # [ 0.443197] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]983lb # [ 0.422270] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]984client # [ 0.443228] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]985lb # [ 0.422746] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint986client # [ 0.443735] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint987lb # [ 0.422933] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]988client # [ 0.443925] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]989worker2 # [ 0.404390] pl061_gpio 9030000.pl061: PL061 GPIO chip registered990lb # [ 0.422949] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]991client # [ 0.443948] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]992lb # [ 0.422980] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]993client # [ 0.443981] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]994lb # [ 0.423439] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint995client # [ 0.444657] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned996lb # [ 0.423624] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]997client # [ 0.444670] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned998lb # [ 0.423640] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]999client # [ 0.444676] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1000lb # [ 0.423670] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1001client # [ 0.444723] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1002lb # [ 0.424149] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1003lb # [ 0.424342] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1004client # [ 0.444774] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1005lb # [ 0.424364] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1006client # [ 0.444828] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1007worker2 # [ 0.405885] ledtrig-cpu: registered to indicate activity on CPUs1008lb # [ 0.424395] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1009worker2 # [ 0.406308] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1010client # [ 0.444879] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1011lb # [ 0.424411] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1012worker1 # [ 0.348632] Initialise system trusted keyrings1013client # [ 0.444929] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1014worker2 # [ 0.406327] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001015lb # [ 0.424878] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1016worker1 # [ 0.349520] workingset: timestamp_bits=42 max_order=19 bucket_order=01017lb # [ 0.425071] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1018client # [ 0.444979] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1019worker2 # [ 0.406348] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001020lb # [ 0.425104] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1021client # [ 0.445030] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1022worker1 # [ 0.350948] squashfs: version 4.0 (2009/01/31) Phillip Lougher1023worker2 # [ 0.406356] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001024client # [ 0.445078] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1025worker2 # [ 0.406377] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1026client # [ 0.445129] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1027worker2 # [ 0.406401] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1028client # [ 0.445206] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1029worker2 # [ 0.406480] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001030client # [ 0.445255] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1031worker2 # [ 0.406490] pci_bus 0000:00: root bus resource [bus 00-ff]1032lb # [ 0.442264] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1033client # [ 0.445279] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1034worker2 # [ 0.406497] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1035lb # [ 0.442464] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1036client # [ 0.445302] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1037worker2 # [ 0.406502] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1038lb # [ 0.442498] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1039client # [ 0.445327] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1040worker2 # [ 0.406507] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1041lb # [ 0.442923] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1042client # [ 0.445354] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1043lb # [ 0.443119] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1044worker2 # [ 0.406609] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1045client # [ 0.445380] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1046worker1 # [ 0.351832] 9p: Installing v9fs 9p2000 file system support1047lb # [ 0.443375] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1048worker2 # [ 0.407061] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1049client # [ 0.445403] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1050lb # [ 0.443679] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1051worker2 # [ 0.407256] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1052client # [ 0.445428] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1053lb # [ 0.443697] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1054worker2 # [ 0.407273] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1055client # [ 0.445451] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1056lb # [ 0.443727] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1057worker2 # [ 0.407306] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1058client # [ 0.445476] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1059worker2 # [ 0.407323] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1060lb # [ 0.444187] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1061client # [ 0.445500] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1062lb # [ 0.444377] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1063worker2 # [ 0.407795] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1064client # [ 0.445525] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1065lb # [ 0.444394] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1066worker2 # [ 0.407983] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1067client # [ 0.445550] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1068lb # [ 0.444423] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1069worker2 # [ 0.407999] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1070client # [ 0.445575] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1071lb # [ 0.445046] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1072worker2 # [ 0.408029] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1073client # [ 0.445598] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1074lb # [ 0.445058] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1075worker2 # [ 0.408531] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1076client # [ 0.445623] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1077worker2 # [ 0.408723] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1078lb # [ 0.445064] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1079client # [ 0.445646] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1080worker2 # [ 0.408740] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1081client # [ 0.445669] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1082lb # [ 0.445112] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1083worker2 # [ 0.408770] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1084client # [ 0.445692] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1085lb # [ 0.445160] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1086client # [ 0.445718] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1087worker2 # [ 0.409239] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1088lb # [ 0.445208] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1089worker2 # [ 0.409427] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1090client # [ 0.445743] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1091client # [ 0.445772] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1092worker2 # [ 0.409444] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1093lb # [ 0.445258] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1094client # [ 0.445782] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1095worker2 # [ 0.409479] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1096worker1 # [ 0.371829] Key type asymmetric registered1097lb # [ 0.445305] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1098client # [ 0.445786] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1099worker1 # [ 0.371861] Asymmetric key parser 'x509' registered1100worker2 # [ 0.409964] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1101lb # [ 0.445352] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1102client # [ 0.446986] pci 0000:00:0a.0: enabling device (0000 -> 0002)1103worker1 # [ 0.371955] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1104worker2 # [ 0.410158] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1105lb # [ 0.445402] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1106worker2 # [ 0.410175] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1107worker2 # [ 0.410204] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1108worker2 # [ 0.410664] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1109worker2 # [ 0.410847] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1110worker2 # [ 0.410863] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1111worker2 # [ 0.410904] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1112worker2 # [ 0.411363] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1113worker1 # [ 0.379184] io scheduler mq-deadline registered1114client # [ 0.503595] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 55287 usecs1115worker1 # [ 0.379208] io scheduler kyber registered1116worker2 # [ 0.411552] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1117worker2 # [ 0.411568] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1118worker2 # [ 0.411598] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1119worker2 # [ 0.411614] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1120lb # [ 0.469519] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1121worker2 # [ 0.412127] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1122lb # [ 0.469584] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1123lb # [ 0.469714] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1124lb # [ 0.469766] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1125lb # [ 0.469788] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1126lb # [ 0.469830] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1127lb # [ 0.469852] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1128lb # [ 0.469878] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1129lb # [ 0.469903] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1130lb # [ 0.469925] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1131lb # [ 0.469948] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1132worker1 # [ 0.391336] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1133lb # [ 0.469971] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1134lb # [ 0.469993] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1135lb # [ 0.470016] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1136worker1 # [ 0.392901] ledtrig-cpu: registered to indicate activity on CPUs1137lb # [ 0.470040] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1138lb # [ 0.470063] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1139worker1 # [ 0.393328] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1140lb # [ 0.470085] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1141worker1 # [ 0.393348] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001142lb # [ 0.470107] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1143lb # [ 0.470130] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1144worker1 # [ 0.393359] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001145lb # [ 0.470152] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1146worker1 # [ 0.393368] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001147lb # [ 0.470174] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1148worker1 # [ 0.393394] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1149lb # [ 0.470196] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1150lb # [ 0.470219] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1151worker1 # [ 0.393419] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1152lb # [ 0.470241] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1153worker1 # [ 0.393500] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001154lb # [ 0.470274] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1155worker2 # [ 0.460405] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1156worker1 # [ 0.393518] pci_bus 0000:00: root bus resource [bus 00-ff]1157lb # [ 0.470284] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1158worker2 # [ 0.460453] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1159worker1 # [ 0.393524] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1160lb # [ 0.470289] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1161worker2 # [ 0.460983] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1162worker1 # [ 0.393529] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1163lb # [ 0.471487] pci 0000:00:0a.0: enabling device (0000 -> 0002)1164worker2 # [ 0.461185] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1165worker1 # [ 0.393534] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1166worker2 # [ 0.461215] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1167client # [ 0.530605] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1168worker1 # [ 0.393601] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1169worker2 # [ 0.461635] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1170worker1 # [ 0.394054] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1171worker2 # [ 0.461822] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1172worker1 # [ 0.394261] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1173worker1 # [ 0.394283] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1174worker2 # [ 0.462080] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1175worker2 # [ 0.462415] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1176worker1 # [ 0.394313] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1177client # [ 0.533750] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1178worker2 # [ 0.462433] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1179worker1 # [ 0.394332] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1180worker2 # [ 0.462463] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1181worker1 # [ 0.394823] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1182worker2 # [ 0.462932] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1183worker1 # [ 0.395020] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1184worker2 # [ 0.463118] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1185worker1 # [ 0.395039] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1186worker2 # [ 0.463134] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1187worker1 # [ 0.395069] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1188worker2 # [ 0.463164] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1189worker2 # [ 0.463776] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1190worker2 # [ 0.463788] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1191worker2 # [ 0.463794] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1192worker2 # [ 0.463846] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1193worker1 # [ 0.415269] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1194worker2 # [ 0.463896] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1195worker1 # [ 0.415463] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1196worker2 # [ 0.463944] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1197worker1 # [ 0.415480] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1198worker2 # [ 0.463992] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1199worker1 # [ 0.415510] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1200client # [ 0.543790] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1201worker2 # [ 0.464043] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1202worker1 # [ 0.415969] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1203client # [ 0.545992] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1204worker1 # [ 0.416154] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1205worker2 # [ 0.464091] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1206worker1 # [ 0.416172] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1207worker2 # [ 0.464141] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1208worker1 # [ 0.416205] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1209worker2 # [ 0.464188] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1210worker1 # [ 0.416675] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1211client # [ 0.549770] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1212worker1 # [ 0.416866] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1213worker2 # [ 0.464299] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1214worker1 # [ 0.416883] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1215worker2 # [ 0.464427] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1216worker1 # [ 0.416913] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1217worker2 # [ 0.464476] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1218worker1 # [ 0.417378] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1219worker2 # [ 0.464498] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1220worker1 # [ 0.417564] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1221worker2 # [ 0.464520] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1222worker1 # [ 0.417581] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1223lb # [ 0.520364] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1224worker2 # [ 0.464542] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1225worker1 # [ 0.417612] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1226worker2 # [ 0.464567] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1227worker1 # [ 0.418072] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1228worker2 # [ 0.464589] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1229worker1 # [ 0.418262] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1230worker2 # [ 0.464611] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1231worker1 # [ 0.418278] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1232client # [ 0.556095] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1233worker2 # [ 0.464634] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1234worker1 # [ 0.418309] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1235worker2 # [ 0.464658] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1236worker1 # [ 0.418327] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1237worker2 # [ 0.464681] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1238worker1 # [ 0.418840] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1239worker2 # [ 0.464704] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1240worker1 # [ 0.419030] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1241worker2 # [ 0.464727] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1242worker1 # [ 0.419061] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1243worker2 # [ 0.464748] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1244worker2 # [ 0.464772] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1245worker2 # [ 0.464794] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1246lb # [ 0.526957] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1247worker2 # [ 0.464815] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1248lb # [ 0.529120] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1249worker2 # [ 0.464837] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1250worker2 # [ 0.464858] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1251client # [ 0.564893] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1252worker2 # [ 0.464880] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1253worker2 # [ 0.464903] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1254worker2 # [ 0.464925] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1255client # [ 0.567161] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1256worker2 # [ 0.464953] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1257worker2 # [ 0.464963] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1258worker2 # [ 0.464968] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1259worker2 # [ 0.466172] pci 0000:00:0a.0: enabling device (0000 -> 0002)1260lb # [ 0.539040] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1261lb # [ 0.541158] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1262worker1 # [ 0.447713] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1263worker1 # [ 0.447930] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1264worker1 # [ 0.447961] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1265worker1 # [ 0.448389] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1266worker1 # [ 0.448575] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1267client # [ 0.581667] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1268worker1 # [ 0.448838] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1269worker1 # [ 0.449169] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1270worker1 # [ 0.449188] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1271worker1 # [ 0.449217] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1272worker1 # [ 0.449717] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1273lb # [ 0.552241] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1274worker1 # [ 0.449902] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1275worker1 # [ 0.449918] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1276worker1 # [ 0.449948] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1277worker1 # [ 0.450561] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1278client # [ 0.584754] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1279worker1 # [ 0.450574] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1280worker1 # [ 0.450581] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1281client # [ 0.587216] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1282worker1 # [ 0.450629] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1283worker1 # [ 0.450677] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1284worker1 # [ 0.450725] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1285worker1 # [ 0.450774] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1286lb # [ 0.558744] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1287worker1 # [ 0.450821] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1288lb # [ 0.561211] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1289worker1 # [ 0.450869] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1290worker1 # [ 0.450919] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1291worker1 # [ 0.450966] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1292worker1 # [ 0.451013] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1293worker1 # [ 0.451085] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1294worker1 # [ 0.451150] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1295worker2 # [ 0.540898] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1296worker1 # [ 0.451170] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1297worker2 # [ 0.543370] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1298worker1 # [ 0.451192] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1299worker1 # [ 0.451215] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1300worker1 # [ 0.451261] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1301worker1 # [ 0.451284] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1302worker1 # [ 0.451306] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1303client # [ 0.608881] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1304worker1 # [ 0.451328] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1305worker1 # [ 0.451352] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1306worker1 # [ 0.451375] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1307lb # [ 0.575440] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1308worker1 # [ 0.451398] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1309worker1 # [ 0.451420] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1310worker1 # [ 0.451442] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1311worker1 # [ 0.451464] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1312client # [ 0.611785] msm_serial: driver initialized1313worker1 # [ 0.451485] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1314client # [ 0.611958] SuperH (H)SCI(F) driver initialized1315client # [ 0.612014] STM32 USART driver initialized1316worker1 # [ 0.451509] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1317worker2 # [ 0.554923] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1318lb # [ 0.578342] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1319worker1 # [ 0.451531] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1320lb # [ 0.580786] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1321worker1 # [ 0.451553] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1322worker1 # [ 0.451576] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1323worker1 # [ 0.451599] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1324worker1 # [ 0.451621] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1325worker2 # [ 0.558236] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1326worker1 # [ 0.451650] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1327worker1 # [ 0.451660] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1328worker1 # [ 0.451665] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1329worker1 # [ 0.452870] pci 0000:00:0a.0: enabling device (0000 -> 0002)1330lb # [ 0.594213] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1331worker2 # [ 0.568550] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1332worker2 # [ 0.571067] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1333lb # [ 0.602890] msm_serial: driver initialized1334worker2 # [ 0.573482] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1335lb # [ 0.603056] SuperH (H)SCI(F) driver initialized1336worker2 # [ 0.575966] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1337lb # [ 0.603111] STM32 USART driver initialized1338client # [ 0.642616] loop: module loaded1339client # [ 0.642850] virtio_blk virtio5: 1/0/0 default/read/poll queues1340worker1 # [ 0.522071] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1341client # [ 0.651811] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1342worker2 # [ 0.594396] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1343worker1 # [ 0.533074] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1344client # [ 0.656233] megasas: 07.734.00.00-rc11345client # [ 0.657107] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1346worker1 # [ 0.536344] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1347client # [ 0.659699] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001348worker1 # [ 0.538564] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1349worker2 # [ 0.597598] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1350client # [ 0.659727] Intel/Sharp Extended Query Table at 0x00311351client # [ 0.661467] Using buffer write method1352worker2 # [ 0.600053] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1353client # [ 0.661558] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1354client # [ 0.663491] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001355client # [ 0.663518] Intel/Sharp Extended Query Table at 0x00311356lb # [ 0.636672] loop: module loaded1357lb # [ 0.636911] virtio_blk virtio5: 1/0/0 default/read/poll queues1358lb # [ 0.637771] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1359worker2 # [ 0.614081] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1360worker1 # [ 0.548732] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1361worker1 # [ 0.551012] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1362client # [ 0.682099] Using buffer write method1363client # [ 0.682149] Concatenating MTD devices:1364client # [ 0.682153] (0): "0.flash"1365client # [ 0.682158] (1): "0.flash"1366client # [ 0.682162] into device "0.flash"1367worker2 # [ 0.622002] msm_serial: driver initialized1368worker2 # [ 0.622199] SuperH (H)SCI(F) driver initialized1369lb # [ 0.642133] megasas: 07.734.00.00-rc11370worker2 # [ 0.622260] STM32 USART driver initialized1371lb # [ 0.642870] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1372worker1 # [ 0.561781] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1373worker1 # [ 0.565363] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1374worker1 # [ 0.575431] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1375lb # [ 0.666814] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001376worker1 # [ 0.577906] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1377lb # [ 0.666861] Intel/Sharp Extended Query Table at 0x00311378lb # [ 0.668707] Using buffer write method1379lb # [ 0.668795] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1380lb # [ 0.674228] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001381lb # [ 0.674269] Intel/Sharp Extended Query Table at 0x00311382lb # [ 0.676239] Using buffer write method1383lb # [ 0.676275] Concatenating MTD devices:1384lb # [ 0.676281] (0): "0.flash"1385lb # [ 0.676285] (1): "0.flash"1386lb # [ 0.676288] into device "0.flash"1387worker1 # [ 0.590108] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1388worker2 # [ 0.659054] loop: module loaded1389worker2 # [ 0.659294] virtio_blk virtio5: 1/0/0 default/read/poll queues1390worker2 # [ 0.660165] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1391worker1 # [ 0.600507] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1392worker1 # [ 0.603533] msm_serial: driver initialized1393worker1 # [ 0.603748] SuperH (H)SCI(F) driver initialized1394worker1 # [ 0.603805] STM32 USART driver initialized1395worker2 # [ 0.672554] megasas: 07.734.00.00-rc11396worker2 # [ 0.673603] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1397worker2 # [ 0.676069] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001398worker2 # [ 0.676113] Intel/Sharp Extended Query Table at 0x00311399worker2 # [ 0.678007] Using buffer write method1400worker2 # [ 0.678076] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1401worker2 # [ 0.680001] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001402worker2 # [ 0.680055] Intel/Sharp Extended Query Table at 0x00311403worker2 # [ 0.698509] Using buffer write method1404worker2 # [ 0.698585] Concatenating MTD devices:1405worker2 # [ 0.698592] (0): "0.flash"1406worker2 # [ 0.698597] (1): "0.flash"1407worker2 # [ 0.698600] into device "0.flash"1408worker1 # [ 0.642630] loop: module loaded1409worker1 # [ 0.642886] virtio_blk virtio5: 1/0/0 default/read/poll queues1410worker1 # [ 0.645111] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1411worker1 # [ 0.656060] megasas: 07.734.00.00-rc11412worker1 # [ 0.656915] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1413worker1 # [ 0.659085] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001414worker1 # [ 0.659180] Intel/Sharp Extended Query Table at 0x00311415worker1 # [ 0.661150] Using buffer write method1416worker1 # [ 0.661254] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1417worker1 # [ 0.675267] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001418worker1 # [ 0.675323] Intel/Sharp Extended Query Table at 0x00311419worker1 # [ 0.677506] Using buffer write method1420worker1 # [ 0.677553] Concatenating MTD devices:1421worker1 # [ 0.677557] (0): "0.flash"1422worker1 # [ 0.677561] (1): "0.flash"1423worker1 # [ 0.677564] into device "0.flash"1424client # [ 0.983983] Freeing initrd memory: 26160K1425client # [ 0.990734] tun: Universal TUN/TAP device driver, 1.61426client # [ 0.994860] thunder_xcv, ver 1.01427client # [ 0.994912] thunder_bgx, ver 1.01428client # [ 0.994933] nicpf, ver 1.01429client # [ 0.995498] e1000: Intel(R) PRO/1000 Network Driver1430client # [ 0.995506] e1000: Copyright (c) 1999-2006 Intel Corporation.1431client # [ 0.998100] e1000e: Intel(R) PRO/1000 Network Driver1432client # [ 0.998114] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1433client # [ 0.998150] igb: Intel(R) Gigabit Ethernet Network Driver1434client # [ 0.998156] igb: Copyright (c) 2007-2014 Intel Corporation.1435client # [ 0.998179] igbvf: Intel(R) Gigabit Virtual Function Network Driver1436client # [ 0.998185] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1437client # [ 0.998342] sky2: driver version 1.301438client # [ 1.004977] usbcore: registered new interface driver usb-storage1439client # [ 1.005092] usbcore: registered new interface driver usbserial_generic1440client # [ 1.005107] usbserial: USB Serial support registered for generic1441client # [ 1.005732] hv_vmbus: registering driver hyperv_keyboard1442client # [ 1.007086] ehci-pci 0000:00:0a.0: EHCI Host Controller1443client # [ 1.007119] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11444client # [ 1.007379] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001445client # [ 1.013102] rtc-pl031 9010000.pl031: registered as rtc01446client # [ 1.013135] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:22:19 UTC (1789906939)1447client # [ 1.013526] i2c_dev: i2c /dev entries driver1448client # [ 1.016747] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001449client # [ 1.017066] hub 1-0:1.0: USB hub found1450client # [ 1.017102] hub 1-0:1.0: 6 ports detected1451lb # [ 0.984359] Freeing initrd memory: 26140K1452client # [ 1.021230] sdhci: Secure Digital Host Controller Interface driver1453client # [ 1.021247] sdhci: Copyright(c) Pierre Ossman1454client # [ 1.021543] Synopsys Designware Multimedia Card Interface Driver1455client # [ 1.021950] sdhci-pltfm: SDHCI platform and OF driver helper1456lb # [ 0.990796] tun: Universal TUN/TAP device driver, 1.61457client # [ 1.026507] hid: raw HID events driver (C) Jiri Kosina1458client # [ 1.026782] usbcore: registered new interface driver usbhid1459client # [ 1.026789] usbhid: USB HID core driver1460client # [ 1.029849] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1461client # [ 1.031466] drop_monitor: Initializing network drop monitor service1462lb # [ 0.994795] thunder_xcv, ver 1.01463lb # [ 0.994849] thunder_bgx, ver 1.01464lb # [ 0.994871] nicpf, ver 1.01465client # [ 1.033570] NET: Registered PF_INET6 protocol family1466lb # [ 0.995440] e1000: Intel(R) PRO/1000 Network Driver1467client # [ 1.035271] Segment Routing with IPv61468lb # [ 0.995447] e1000: Copyright (c) 1999-2006 Intel Corporation.1469client # [ 1.035294] In-situ OAM (IOAM) with IPv61470lb # [ 0.995471] e1000e: Intel(R) PRO/1000 Network Driver1471client # [ 1.035323] NET: Registered PF_PACKET protocol family1472lb # [ 0.995480] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1473lb # [ 0.995510] igb: Intel(R) Gigabit Ethernet Network Driver1474lb # [ 0.995515] igb: Copyright (c) 2007-2014 Intel Corporation.1475lb # [ 0.995540] igbvf: Intel(R) Gigabit Virtual Function Network Driver1476lb # [ 0.995546] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1477client # [ 1.037065] 9pnet: Installing 9P2000 support1478lb # [ 0.995688] sky2: driver version 1.301479client # [ 1.039449] Key type dns_resolver registered1480lb # [ 0.997409] usbcore: registered new interface driver usb-storage1481lb # [ 0.998322] ehci-pci 0000:00:0a.0: EHCI Host Controller1482lb # [ 0.998350] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11483lb # [ 0.998617] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001484lb # [ 1.009126] usbcore: registered new interface driver usbserial_generic1485lb # [ 1.009145] usbserial: USB Serial support registered for generic1486lb # [ 1.009469] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001487lb # [ 1.009851] hub 1-0:1.0: USB hub found1488client # [ 1.046980] registered taskstats version 11489lb # [ 1.009873] hub 1-0:1.0: 6 ports detected1490client # [ 1.047172] Loading compiled-in X.509 certificates1491lb # [ 1.013993] hv_vmbus: registering driver hyperv_keyboard1492lb # [ 1.015607] rtc-pl031 9010000.pl031: registered as rtc01493lb # [ 1.015637] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:22:19 UTC (1789906939)1494lb # [ 1.015979] i2c_dev: i2c /dev entries driver1495lb # [ 1.021220] sdhci: Secure Digital Host Controller Interface driver1496client # [ 1.056188] Demotion targets for Node 0: null1497lb # [ 1.021236] sdhci: Copyright(c) Pierre Ossman1498client # [ 1.056333] Key type .fscrypt registered1499client # [ 1.056344] Key type fscrypt-provisioning registered1500client # [ 1.056454] ima: No TPM chip found, activating TPM-bypass!1501client # [ 1.056475] ima: Allocated hash algorithm: sha11502client # [ 1.056498] ima: No architecture policies found1503lb # [ 1.022871] Synopsys Designware Multimedia Card Interface Driver1504client # [ 1.060741] input: gpio-keys as /devices/platform/gpio-keys/input/input01505lb # [ 1.023266] sdhci-pltfm: SDHCI platform and OF driver helper1506lb # [ 1.025101] hid: raw HID events driver (C) Jiri Kosina1507lb # [ 1.025363] usbcore: registered new interface driver usbhid1508lb # [ 1.025374] usbhid: USB HID core driver1509lb # [ 1.029920] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1510lb # [ 1.031547] drop_monitor: Initializing network drop monitor service1511lb # [ 1.031762] NET: Registered PF_INET6 protocol family1512lb # [ 1.035191] Segment Routing with IPv61513lb # [ 1.035215] In-situ OAM (IOAM) with IPv61514lb # [ 1.035252] NET: Registered PF_PACKET protocol family1515lb # [ 1.036950] 9pnet: Installing 9P2000 support1516lb # [ 1.039926] Key type dns_resolver registered1517worker2 # [ 1.021291] Freeing initrd memory: 26148K1518client # [ 1.079567] clk: Disabling unused clocks1519client # [ 1.079601] PM: genpd: Disabling unused power domains1520lb # [ 1.046466] registered taskstats version 11521client # [ 1.083972] Freeing unused kernel memory: 4736K1522client # [ 1.084192] Run /init as init process1523lb # [ 1.046651] Loading compiled-in X.509 certificates1524worker2 # [ 1.027782] tun: Universal TUN/TAP device driver, 1.61525lb # [ 1.055649] Demotion targets for Node 0: null1526lb # [ 1.055776] Key type .fscrypt registered1527lb # [ 1.055783] Key type fscrypt-provisioning registered1528worker2 # [ 1.031960] thunder_xcv, ver 1.01529worker2 # [ 1.032021] thunder_bgx, ver 1.01530lb # [ 1.055887] ima: No TPM chip found, activating TPM-bypass!1531worker2 # [ 1.032045] nicpf, ver 1.01532lb # [ 1.055907] ima: Allocated hash algorithm: sha11533lb # [ 1.055934] ima: No architecture policies found1534lb # [ 1.060398] input: gpio-keys as /devices/platform/gpio-keys/input/input01535worker2 # [ 1.033993] e1000: Intel(R) PRO/1000 Network Driver1536worker2 # [ 1.034006] e1000: Copyright (c) 1999-2006 Intel Corporation.1537worker2 # [ 1.034031] e1000e: Intel(R) PRO/1000 Network Driver1538worker2 # [ 1.034038] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1539worker2 # [ 1.034069] igb: Intel(R) Gigabit Ethernet Network Driver1540worker2 # [ 1.034074] igb: Copyright (c) 2007-2014 Intel Corporation.1541worker2 # [ 1.034099] igbvf: Intel(R) Gigabit Virtual Function Network Driver1542client # [ 1.102059] systemd[1]: Successfully made /usr/ read-only.1543worker2 # [ 1.034105] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1544worker2 # [ 1.034248] sky2: driver version 1.301545worker2 # [ 1.035953] usbcore: registered new interface driver usb-storage1546worker2 # [ 1.036051] usbcore: registered new interface driver usbserial_generic1547worker2 # [ 1.036066] usbserial: USB Serial support registered for generic1548worker2 # [ 1.037130] ehci-pci 0000:00:0a.0: EHCI Host Controller1549worker2 # [ 1.037161] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11550worker2 # [ 1.037381] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001551worker2 # [ 1.048376] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001552worker2 # [ 1.048816] hub 1-0:1.0: USB hub found1553worker2 # [ 1.048837] hub 1-0:1.0: 6 ports detected1554worker2 # [ 1.051601] hv_vmbus: registering driver hyperv_keyboard1555worker2 # [ 1.053414] rtc-pl031 9010000.pl031: registered as rtc01556worker2 # [ 1.053451] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:22:20 UTC (1789906940)1557lb # [ 1.079891] clk: Disabling unused clocks1558worker2 # [ 1.053808] i2c_dev: i2c /dev entries driver1559lb # [ 1.079928] PM: genpd: Disabling unused power domains1560worker1 # [ 0.991508] Freeing initrd memory: 26148K1561lb # [ 1.084424] Freeing unused kernel memory: 4736K1562lb # [ 1.084626] Run /init as init process1563worker2 # [ 1.059066] sdhci: Secure Digital Host Controller Interface driver1564worker2 # [ 1.059081] sdhci: Copyright(c) Pierre Ossman1565worker2 # [ 1.059368] Synopsys Designware Multimedia Card Interface Driver1566worker2 # [ 1.059759] sdhci-pltfm: SDHCI platform and OF driver helper1567worker1 # [ 0.997951] tun: Universal TUN/TAP device driver, 1.61568worker2 # [ 1.064557] hid: raw HID events driver (C) Jiri Kosina1569worker2 # [ 1.064834] usbcore: registered new interface driver usbhid1570worker2 # [ 1.064841] usbhid: USB HID core driver1571worker1 # [ 1.002071] thunder_xcv, ver 1.01572worker1 # [ 1.002133] thunder_bgx, ver 1.01573worker2 # [ 1.067898] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1574worker1 # [ 1.002155] nicpf, ver 1.01575worker1 # [ 1.002742] e1000: Intel(R) PRO/1000 Network Driver1576worker1 # [ 1.002754] e1000: Copyright (c) 1999-2006 Intel Corporation.1577worker1 # [ 1.002778] e1000e: Intel(R) PRO/1000 Network Driver1578worker2 # [ 1.070724] drop_monitor: Initializing network drop monitor service1579worker1 # [ 1.002787] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1580worker2 # [ 1.070946] NET: Registered PF_INET6 protocol family1581worker1 # [ 1.002825] igb: Intel(R) Gigabit Ethernet Network Driver1582worker1 # [ 1.002835] igb: Copyright (c) 2007-2014 Intel Corporation.1583worker2 # [ 1.073231] Segment Routing with IPv61584worker2 # [ 1.073266] In-situ OAM (IOAM) with IPv61585worker1 # [ 1.002862] igbvf: Intel(R) Gigabit Virtual Function Network Driver1586worker2 # [ 1.073300] NET: Registered PF_PACKET protocol family1587worker1 # [ 1.002867] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1588lb # [ 1.100210] systemd[1]: Successfully made /usr/ read-only.1589worker1 # [ 1.003017] sky2: driver version 1.301590worker2 # [ 1.075001] 9pnet: Installing 9P2000 support1591worker2 # [ 1.077964] Key type dns_resolver registered1592worker1 # [ 1.012288] usbcore: registered new interface driver usb-storage1593worker1 # [ 1.012442] usbcore: registered new interface driver usbserial_generic1594worker1 # [ 1.012457] usbserial: USB Serial support registered for generic1595worker1 # [ 1.013079] hv_vmbus: registering driver hyperv_keyboard1596worker1 # [ 1.014816] ehci-pci 0000:00:0a.0: EHCI Host Controller1597worker1 # [ 1.014847] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11598worker1 # [ 1.015023] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001599worker1 # [ 1.020847] rtc-pl031 9010000.pl031: registered as rtc01600worker1 # [ 1.020882] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:22:20 UTC (1789906940)1601worker2 # [ 1.084722] registered taskstats version 11602worker1 # [ 1.021282] i2c_dev: i2c /dev entries driver1603worker2 # [ 1.084912] Loading compiled-in X.509 certificates1604worker1 # [ 1.024529] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001605worker1 # [ 1.024856] hub 1-0:1.0: USB hub found1606worker1 # [ 1.024877] hub 1-0:1.0: 6 ports detected1607worker2 # [ 1.094664] Demotion targets for Node 0: null1608worker2 # [ 1.094788] Key type .fscrypt registered1609worker2 # [ 1.094795] Key type fscrypt-provisioning registered1610worker1 # [ 1.029091] sdhci: Secure Digital Host Controller Interface driver1611worker1 # [ 1.029109] sdhci: Copyright(c) Pierre Ossman1612worker2 # [ 1.094895] ima: No TPM chip found, activating TPM-bypass!1613worker2 # [ 1.094915] ima: Allocated hash algorithm: sha11614worker1 # [ 1.029382] Synopsys Designware Multimedia Card Interface Driver1615worker2 # [ 1.094939] ima: No architecture policies found1616worker1 # [ 1.029763] sdhci-pltfm: SDHCI platform and OF driver helper1617worker2 # [ 1.099397] input: gpio-keys as /devices/platform/gpio-keys/input/input01618worker1 # [ 1.034527] hid: raw HID events driver (C) Jiri Kosina1619worker1 # [ 1.034807] usbcore: registered new interface driver usbhid1620worker1 # [ 1.034818] usbhid: USB HID core driver1621worker1 # [ 1.038326] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1622worker1 # [ 1.041145] drop_monitor: Initializing network drop monitor service1623worker1 # [ 1.041299] NET: Registered PF_INET6 protocol family1624worker1 # [ 1.043364] Segment Routing with IPv61625worker1 # [ 1.043401] In-situ OAM (IOAM) with IPv61626worker1 # [ 1.043434] NET: Registered PF_PACKET protocol family1627worker1 # [ 1.045130] 9pnet: Installing 9P2000 support1628worker1 # [ 1.048317] Key type dns_resolver registered1629worker1 # [ 1.055067] registered taskstats version 11630worker2 # [ 1.122921] clk: Disabling unused clocks1631worker1 # [ 1.055831] Loading compiled-in X.509 certificates1632worker2 # [ 1.122956] PM: genpd: Disabling unused power domains1633worker2 # [ 1.127510] Freeing unused kernel memory: 4736K1634worker2 # [ 1.127738] Run /init as init process1635worker1 # [ 1.064240] Demotion targets for Node 0: null1636worker1 # [ 1.064377] Key type .fscrypt registered1637worker1 # [ 1.064384] Key type fscrypt-provisioning registered1638worker1 # [ 1.064487] ima: No TPM chip found, activating TPM-bypass!1639worker1 # [ 1.064508] ima: Allocated hash algorithm: sha11640worker1 # [ 1.064535] ima: No architecture policies found1641worker1 # [ 1.068826] input: gpio-keys as /devices/platform/gpio-keys/input/input01642worker2 # [ 1.146909] systemd[1]: Successfully made /usr/ read-only.1643worker1 # [ 1.087787] clk: Disabling unused clocks1644worker1 # [ 1.087820] PM: genpd: Disabling unused power domains1645worker1 # [ 1.092387] Freeing unused kernel memory: 4736K1646worker1 # [ 1.092603] Run /init as init process1647worker1 # [ 1.109644] systemd[1]: Successfully made /usr/ read-only.1648client # [ 1.263660] usb 1-1: new high-speed USB device number 2 using ehci-pci1649lb # [ 1.257523] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker2 # [ 1.296369] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker1 # [ 1.271270] usb 1-1: new high-speed USB device number 2 using ehci-pci1652client # [ 1.418506] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653lb # [ 1.409987] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11654client # [ 1.437176] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1655client # [ 1.450246] systemd[1]: Detected virtualization qemu.1656client # [ 1.450366] systemd[1]: Detected architecture arm64.1657client # [ 1.450393] systemd[1]: Running in initrd.1658client # [ 1.451479] systemd[1]: Initializing machine ID from random generator.1659client # [ 1.460505] systemd[1]: Hostname set to <client>.1660lb # [ 1.435289] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1661lb # [ 1.448201] systemd[1]: Detected virtualization qemu.1662lb # [ 1.450526] systemd[1]: Detected architecture arm64.1663lb # [ 1.452579] systemd[1]: Running in initrd.1664lb # [ 1.455667] systemd[1]: Initializing machine ID from random generator.1665lb # [ 1.458884] systemd[1]: Hostname set to <lb>.1666worker2 # [ 1.448603] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11667client # [ 1.511933] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01668lb # [ 1.509900] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01669worker2 # [ 1.482112] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1670worker1 # [ 1.425832] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11671worker2 # [ 1.495451] systemd[1]: Detected virtualization qemu.1672worker2 # [ 1.497825] systemd[1]: Detected architecture arm64.1673worker2 # [ 1.499918] systemd[1]: Running in initrd.1674worker2 # [ 1.502925] systemd[1]: Initializing machine ID from random generator.1675worker2 # [ 1.506368] systemd[1]: Hostname set to <worker2>.1676worker1 # [ 1.444801] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1677worker1 # [ 1.457582] systemd[1]: Detected virtualization qemu.1678worker1 # [ 1.459860] systemd[1]: Detected architecture arm64.1679worker1 # [ 1.461919] systemd[1]: Running in initrd.1680worker1 # [ 1.464880] systemd[1]: Initializing machine ID from random generator.1681worker1 # [ 1.468595] systemd[1]: Hostname set to <worker1>.1682worker2 # [ 1.536865] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683client # [ 1.635605] usb 1-2: new high-speed USB device number 3 using ehci-pci1684worker1 # [ 1.515473] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01685lb # [ 1.633505] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker2 # [ 1.660275] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker1 # [ 1.635194] usb 1-2: new high-speed USB device number 3 using ehci-pci1688client # [ 1.785094] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689client # [ 1.799994] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690client # [ 1.807807] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691lb # [ 1.789914] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21692lb # [ 1.797870] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01693lb # [ 1.816589] systemd[1]: bpf-restrict-fs: LSM BPF program attached1694worker2 # [ 1.816467] systemd[1]: bpf-restrict-fs: LSM BPF program attached1695worker2 # [ 1.831063] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696worker1 # [ 1.775046] systemd[1]: bpf-restrict-fs: LSM BPF program attached1697client # [ 1.902737] systemd[1]: Queued start job for default target Initrd Default Target.1698worker2 # [ 1.840752] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01699client # [ 1.914104] systemd[1]: Created slice Slice /system/modprobe.1700client # [ 1.915316] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1701client # [ 1.916806] systemd[1]: Expecting device /dev/disk/by-label/nixos...1702client # [ 1.917814] systemd[1]: Reached target Path Units.1703client # [ 1.918561] systemd[1]: Reached target Slice Units.1704client # [ 1.919383] systemd[1]: Reached target Swaps.1705client # [ 1.920150] systemd[1]: Reached target Timer Units.1706client # [ 1.921273] systemd[1]: Listening on D-Bus System Message Bus Socket.1707client # [ 1.922455] systemd[1]: Listening on Journal Socket (/dev/log).1708client # [ 1.923521] systemd[1]: Listening on Journal Sockets.1709client # [ 1.924484] systemd[1]: Listening on udev Control Socket.1710worker1 # [ 1.796025] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21711client # [ 1.925524] systemd[1]: Listening on udev Kernel Socket.1712client # [ 1.926353] systemd[1]: Reached target Socket Units.1713client # [ 1.929156] systemd[1]: Starting Create List of Static Device Nodes...1714worker1 # [ 1.803488] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01715client # [ 1.939883] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1716client # [ 1.941106] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1717lb # [ 1.912146] systemd[1]: Queued start job for default target Initrd Default Target.1718client # [ 1.949140] systemd[1]: Mounting Kernel Configuration File System...1719lb # [ 1.924036] systemd[1]: Created slice Slice /system/modprobe.1720lb # [ 1.925271] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1721lb # [ 1.926721] systemd[1]: Expecting device /dev/disk/by-label/nixos...1722lb # [ 1.927783] systemd[1]: Reached target Path Units.1723lb # [ 1.928606] systemd[1]: Reached target Slice Units.1724lb # [ 1.929495] systemd[1]: Reached target Swaps.1725lb # [ 1.930263] systemd[1]: Reached target Timer Units.1726lb # [ 1.931323] systemd[1]: Listening on D-Bus System Message Bus Socket.1727lb # [ 1.932721] systemd[1]: Listening on Journal Socket (/dev/log).1728lb # [ 1.933971] systemd[1]: Listening on Journal Sockets.1729lb # [ 1.934979] systemd[1]: Listening on udev Control Socket.1730lb # [ 1.936016] systemd[1]: Listening on udev Kernel Socket.1731lb # [ 1.936914] systemd[1]: Reached target Socket Units.1732lb # [ 1.939543] systemd[1]: Starting Create List of Static Device Nodes...1733client # [ 1.973325] systemd[1]: Starting Journal Service...1734lb # [ 1.949700] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1735lb # [ 1.950898] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1736lb # [ 1.957836] systemd[1]: Mounting Kernel Configuration File System...1737worker2 # [ 1.933083] systemd[1]: Queued start job for default target Initrd Default Target.1738client # [ 2.001947] systemd[1]: Starting Load Kernel Modules...1739worker2 # [ 1.942591] systemd[1]: Created slice Slice /system/modprobe.1740client # [ 2.002997] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1741worker2 # [ 1.943644] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1742worker2 # [ 1.944828] systemd[1]: Expecting device /dev/disk/by-label/nixos...1743worker2 # [ 1.945686] systemd[1]: Reached target Path Units.1744worker2 # [ 1.946350] systemd[1]: Reached target Slice Units.1745worker2 # [ 1.947001] systemd[1]: Reached target Swaps.1746worker2 # [ 1.947608] systemd[1]: Reached target Timer Units.1747lb # [ 1.973881] systemd[1]: Starting Journal Service...1748worker2 # [ 1.948507] systemd[1]: Listening on D-Bus System Message Bus Socket.1749worker2 # [ 1.949551] systemd[1]: Listening on Journal Socket (/dev/log).1750worker2 # [ 1.950467] systemd[1]: Listening on Journal Sockets.1751worker2 # [ 1.951381] systemd[1]: Listening on udev Control Socket.1752worker2 # [ 1.952216] systemd[1]: Listening on udev Kernel Socket.1753worker2 # [ 1.953010] systemd[1]: Reached target Socket Units.1754worker1 # [ 1.888078] systemd[1]: Queued start job for default target Initrd Default Target.1755worker2 # [ 1.955264] systemd[1]: Starting Create List of Static Device Nodes...1756client # [ 2.020795] systemd[1]: Starting Coldplug All udev Devices...1757worker1 # [ 1.897352] systemd[1]: Created slice Slice /system/modprobe.1758worker1 # [ 1.898435] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1759worker2 # [ 1.964394] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1760worker1 # [ 1.899699] systemd[1]: Expecting device /dev/disk/by-label/nixos...1761worker1 # [ 1.900623] systemd[1]: Reached target Path Units.1762worker2 # [ 1.965450] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1763lb # [ 1.991616] systemd[1]: Starting Load Kernel Modules...1764worker1 # [ 1.901451] systemd[1]: Reached target Slice Units.1765worker1 # [ 1.902143] systemd[1]: Reached target Swaps.1766lb # [ 1.992430] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1767worker1 # [ 1.902788] systemd[1]: Reached target Timer Units.1768worker1 # [ 1.903758] systemd[1]: Listening on D-Bus System Message Bus Socket.1769worker1 # [ 1.904828] systemd[1]: Listening on Journal Socket (/dev/log).1770worker1 # [ 1.905820] systemd[1]: Listening on Journal Sockets.1771worker1 # [ 1.906715] systemd[1]: Listening on udev Control Socket.1772worker1 # [ 1.907658] systemd[1]: Listening on udev Kernel Socket.1773worker1 # [ 1.908436] systemd[1]: Reached target Socket Units.1774worker1 # [ 1.910901] systemd[1]: Starting Create List of Static Device Nodes...1775lb # [ 2.004526] systemd[1]: Starting Coldplug All udev Devices...1776client # [ 2.040310] systemd[1]: Finished Create List of Static Device Nodes.1777client # [ 2.041591] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1778worker2 # [ 1.978453] systemd[1]: Mounting Kernel Configuration File System...1779client # [ 2.041923] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1780client # [ 2.042219] systemd[1]: Mounted Kernel Configuration File System.1781worker1 # [ 1.919428] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1782worker1 # [ 1.919537] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1783worker1 # [ 1.927522] systemd[1]: Mounting Kernel Configuration File System...1784worker2 # [ 1.997500] systemd[1]: Starting Journal Service...1785client # [ 2.058501] systemd-journald[73]: Collecting audit messages is disabled.1786lb # [ 2.025610] systemd[1]: Finished Create List of Static Device Nodes.1787lb # [ 2.026893] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1788client # [ 2.064005] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1789lb # [ 2.027219] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1790lb # [ 2.027503] systemd[1]: Mounted Kernel Configuration File System.1791client # [ 2.067831] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1792worker2 # [ 2.008645] systemd[1]: Starting Load Kernel Modules...1793worker2 # [ 2.009552] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1794client # [ 2.079637] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1795lb # [ 2.041933] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1796worker1 # [ 1.959497] systemd[1]: Starting Journal Service...1797worker2 # [ 2.024644] systemd[1]: Starting Coldplug All udev Devices...1798worker2 # [ 2.029366] systemd[1]: Finished Create List of Static Device Nodes.1799worker1 # [ 1.967444] systemd[1]: Starting Load Kernel Modules...1800client # [ 2.092229] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01801worker1 # [ 1.968335] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1802worker2 # [ 2.033730] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1803client # [ 2.092496] [drm] features: -virgl +edid -resource_blob -host_visible1804client # [ 2.092506] [drm] features: -context_init1805client # [ 2.093317] [drm] number of scanouts: 11806client # [ 2.093337] [drm] number of cap sets: 01807worker2 # [ 2.037000] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1808lb # [ 2.065331] systemd-journald[73]: Collecting audit messages is disabled.1809worker1 # [ 1.979051] systemd[1]: Starting Coldplug All udev Devices...1810client # [ 2.111961] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1811client # [ 2.111992] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01812lb # [ 2.081050] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1813worker2 # [ 2.066131] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1814worker1 # [ 1.999463] systemd[1]: Finished Create List of Static Device Nodes.1815client # [ 2.128352] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1816lb # [ 2.093555] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1817worker1 # [ 2.000789] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1818worker1 # [ 2.001126] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1819worker1 # [ 2.001378] systemd[1]: Mounted Kernel Configuration File System.1820client # [ 2.135696] systemd[1]: Starting Create Static Device Nodes in /dev...1821worker1 # [ 2.011564] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1822worker2 # [ 2.076667] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1823worker2 # [ 2.078523] systemd[1]: Mounted Kernel Configuration File System.1824worker2 # [ 2.080420] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1825lb # [ 2.105800] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01826lb # [ 2.106053] [drm] features: -virgl +edid -resource_blob -host_visible1827lb # [ 2.106063] [drm] features: -context_init1828lb # [ 2.106790] [drm] number of scanouts: 11829lb # [ 2.106808] [drm] number of cap sets: 01830worker2 # [ 2.089087] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01831worker2 # [ 2.089373] [drm] features: -virgl +edid -resource_blob -host_visible1832worker2 # [ 2.089385] [drm] features: -context_init1833worker2 # [ 2.090181] [drm] number of scanouts: 11834worker2 # [ 2.090201] [drm] number of cap sets: 01835client # [ 2.147887] Console: switching to colour frame buffer device 160x501836worker2 # [ 2.097120] systemd-journald[73]: Collecting audit messages is disabled.1837lb # [ 2.122216] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1838lb # [ 2.125019] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1839worker1 # [ 2.034979] systemd-journald[73]: Collecting audit messages is disabled.1840lb # [ 2.125049] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01841lb # [ 2.133968] systemd[1]: Starting Create Static Device Nodes in /dev...1842worker1 # [ 2.048919] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1843client # [ 2.180253] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1844worker2 # [ 2.118405] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1845worker2 # [ 2.118456] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01846lb # [ 2.153856] Console: switching to colour frame buffer device 160x501847worker1 # [ 2.071274] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1848client # [ 2.196985] systemd[1]: Finished Load Kernel Modules.1849client # [ 2.199503] systemd[1]: Starting Apply Kernel Variables...1850worker1 # [ 2.075945] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1851worker2 # [ 2.145103] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1852worker1 # [ 2.081660] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01853worker1 # [ 2.081930] [drm] features: -virgl +edid -resource_blob -host_visible1854worker1 # [ 2.081939] [drm] features: -context_init1855worker1 # [ 2.082697] [drm] number of scanouts: 11856worker1 # [ 2.082715] [drm] number of cap sets: 01857worker2 # [ 2.152798] systemd[1]: Starting Create Static Device Nodes in /dev...1858worker1 # [ 2.087758] systemd[1]: Starting Create Static Device Nodes in /dev...1859lb # [ 2.188207] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1860worker2 # [ 2.156752] Console: switching to colour frame buffer device 160x501861worker2 # [ 2.163962] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1862lb # [ 2.191579] systemd[1]: Finished Create Static Device Nodes in /dev.1863lb # [ 2.192718] systemd[1]: Reached target Preparation for Local File Systems.1864worker1 # [ 2.102145] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1865worker1 # [ 2.102186] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01866lb # [ 2.193668] systemd[1]: Reached target Local File Systems.1867lb # [ 2.197824] systemd[1]: Starting Rule-based Manager for Device Events and Files...1868client # [ 2.232070] systemd[1]: Finished Create Static Device Nodes in /dev.1869client # [ 2.232772] systemd[1]: Reached target Preparation for Local File Systems.1870client # [ 2.232829] systemd[1]: Reached target Local File Systems.1871client # [ 2.244088] systemd[1]: Starting Rule-based Manager for Device Events and Files...1872worker2 # [ 2.193048] systemd[1]: Finished Load Kernel Modules.1873lb # [ 2.217635] systemd[1]: Finished Load Kernel Modules.1874client # [ 2.245825] systemd-modules-load[74]: Inserted module 'dm_mod'1875lb # [ 2.225940] systemd[1]: Starting Apply Kernel Variables...1876client # [ 2.266684] systemd[1]: Started Journal Service.1877worker2 # [ 2.204609] systemd[1]: Starting Apply Kernel Variables...1878worker1 # [ 2.138763] Console: switching to colour frame buffer device 160x501879client # [ 2.253532] systemd-modules-load[74]: Module 'virtio_balloon' is built in1880worker1 # [ 2.146294] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1881client # [ 2.258060] systemd-modules-load[74]: Module 'virtio_console' is built in1882worker1 # [ 2.155376] systemd[1]: Finished Create Static Device Nodes in /dev.1883worker1 # [ 2.155641] systemd[1]: Reached target Preparation for Local File Systems.1884worker1 # [ 2.155679] systemd[1]: Reached target Local File Systems.1885worker2 # [ 2.224078] systemd[1]: Finished Create Static Device Nodes in /dev.1886client # [ 2.268654] systemd-modules-load[74]: Inserted module 'virtio_gpu'1887worker2 # [ 2.226572] systemd[1]: Reached target Preparation for Local File Systems.1888worker2 # [ 2.226632] systemd[1]: Reached target Local File Systems.1889client # [ 2.271425] systemd-modules-load[74]: Module 'virtio_rng' is built in1890worker1 # [ 2.163742] systemd[1]: Starting Rule-based Manager for Device Events and Files...1891worker2 # [ 2.232995] systemd[1]: Starting Rule-based Manager for Device Events and Files...1892client # [ 2.276671] systemd[1]: Starting Create System Files and Directories...1893client # [ 2.292180] systemd[1]: Finished Apply Kernel Variables.1894lb # [ 2.280939] systemd[1]: Started Journal Service.1895lb # [ 2.267465] systemd-modules-load[74]: Inserted module 'dm_mod'1896worker1 # [ 2.195481] systemd[1]: Finished Load Kernel Modules.1897lb # [ 2.272491] systemd-modules-load[74]: Module 'virtio_balloon' is built in1898lb # [ 2.273665] systemd-modules-load[74]: Module 'virtio_console' is built in1899worker1 # [ 2.199614] systemd[1]: Starting Apply Kernel Variables...1900lb # [ 2.274828] systemd-modules-load[74]: Inserted module 'virtio_gpu'1901lb # [ 2.275873] systemd-modules-load[74]: Module 'virtio_rng' is built in1902worker2 # [ 2.281179] systemd[1]: Finished Apply Kernel Variables.1903client # [ 2.326047] systemd[1]: Finished Create System Files and Directories.1904lb # [ 2.293975] systemd[1]: Starting Create System Files and Directories...1905lb # [ 2.304332] systemd[1]: Finished Apply Kernel Variables.1906worker2 # [ 2.300516] systemd[1]: Started Journal Service.1907client # [ 2.349331] systemd-udevd[81]: Using default interface naming scheme 'v261'.1908worker1 # [ 2.232579] systemd-modules-load[74]: Inserted module 'dm_mod'1909lb # [ 2.323613] systemd-udevd[79]: Using default interface naming scheme 'v261'.1910worker1 # [ 2.248898] systemd[1]: Started Journal Service.1911worker2 # [ 2.300380] systemd-modules-load[74]: Inserted module 'dm_mod'1912worker2 # [ 2.301623] systemd-modules-load[74]: Module 'virtio_balloon' is built in1913worker2 # [ 2.302822] systemd-modules-load[74]: Module 'virtio_console' is built in1914worker2 # [ 2.303933] systemd-modules-load[74]: Inserted module 'virtio_gpu'1915worker1 # [ 2.244344] systemd-modules-load[74]: Module 'virtio_balloon' is built in1916worker1 # [ 2.245598] systemd-modules-load[74]: Module 'virtio_console' is built in1917worker1 # [ 2.246706] systemd-modules-load[74]: Inserted module 'virtio_gpu'1918worker1 # [ 2.247719] systemd-modules-load[74]: Module 'virtio_rng' is built in1919worker2 # [ 2.312545] systemd-modules-load[74]: Module 'virtio_rng' is built in1920worker2 # [ 2.316800] systemd[1]: Starting Create System Files and Directories...1921lb # [ 2.351978] systemd[1]: Finished Create System Files and Directories.1922client # [ 2.384901] systemd[1]: Started Rule-based Manager for Device Events and Files.1923worker1 # [ 2.264567] systemd[1]: Starting Create System Files and Directories...1924worker1 # [ 2.265958] systemd-udevd[79]: Using default interface naming scheme 'v261'.1925worker1 # [ 2.276135] systemd[1]: Finished Apply Kernel Variables.1926lb # [ 2.371519] systemd[1]: Started Rule-based Manager for Device Events and Files.1927worker2 # [ 2.348869] systemd-udevd[81]: Using default interface naming scheme 'v261'.1928worker2 # [ 2.357546] systemd[1]: Finished Create System Files and Directories.1929worker2 # [ 2.382508] systemd[1]: Started Rule-based Manager for Device Events and Files.1930worker1 # [ 2.319597] systemd[1]: Started Rule-based Manager for Device Events and Files.1931worker1 # [ 2.321743] systemd[1]: Finished Create System Files and Directories.1932client # [ 2.456154] systemd[1]: Starting Virtual Console Setup...1933lb # [ 2.444232] systemd[1]: Starting Virtual Console Setup...1934client # [ 2.504549] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1935worker2 # [ 2.450727] systemd[1]: Starting Virtual Console Setup...1936client # [ 2.508642] systemd[1]: Finished Virtual Console Setup.1937worker1 # [ 2.390075] systemd[1]: Starting Virtual Console Setup...1938lb # [ 2.492693] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1939lb # [ 2.495477] systemd[1]: Finished Virtual Console Setup.1940worker1 # [ 2.448619] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1941worker2 # [ 2.512637] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942worker1 # [ 2.452540] systemd[1]: Finished Virtual Console Setup.1943worker2 # [ 2.520480] systemd[1]: Finished Virtual Console Setup.1944client # [ 3.162162] systemd[1]: Finished Coldplug All udev Devices.1945lb # [ 3.129824] systemd[1]: Finished Coldplug All udev Devices.1946client # [ 3.163128] systemd[1]: Reached target System Initialization.1947lb # [ 3.130802] systemd[1]: Reached target System Initialization.1948client # [ 3.163934] systemd[1]: Reached target Basic System.1949lb # [ 3.131616] systemd[1]: Reached target Basic System.1950worker2 # [ 3.164631] systemd[1]: Finished Coldplug All udev Devices.1951worker2 # [ 3.166370] systemd[1]: Reached target System Initialization.1952worker2 # [ 3.168217] systemd[1]: Reached target Basic System.1953worker1 # [ 3.113809] systemd[1]: Finished Coldplug All udev Devices.1954worker1 # [ 3.114789] systemd[1]: Reached target System Initialization.1955worker1 # [ 3.115626] systemd[1]: Reached target Basic System.1956lb # [ 3.288303] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1957client # [ 3.340187] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1958client # [ 3.355604] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1959client # [ 3.364291] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1960lb # [ 3.332788] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1961lb # [ 3.339750] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1962worker1 # [ 3.275714] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1963worker1 # [ 3.292912] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1964worker1 # [ 3.300301] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1965lb # [ 3.392434] systemd[1]: Found device /dev/disk/by-label/nixos.1966worker2 # [ 3.367609] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1967lb # [ 3.395616] systemd[1]: Reached target Initrd Root Device.1968lb # [ 3.400132] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1969worker2 # [ 3.392686] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1970client # [ 3.457247] systemd[1]: Found device /dev/disk/by-label/nixos.1971client # [ 3.458428] systemd[1]: Reached target Initrd Root Device.1972client # [ 3.464106] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1973worker2 # [ 3.409903] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1974lb # [ 3.457464] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1975lb # [ 3.463270] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1976lb # [ 3.472504] systemd[1]: Mounting /sysroot...1977worker1 # [ 3.388690] systemd[1]: Found device /dev/disk/by-label/nixos.1978client # [ 3.512081] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1979worker1 # [ 3.392233] systemd[1]: Reached target Initrd Root Device.1980client # [ 3.519641] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1981worker1 # [ 3.398957] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1982client # [ 3.528345] systemd[1]: Mounting /sysroot...1983worker2 # [ 3.489394] systemd[1]: Found device /dev/disk/by-label/nixos.1984worker2 # [ 3.493330] systemd[1]: Reached target Initrd Root Device.1985lb # [ 3.533116] EXT4-fs (vda): mounted filesystem 88d17a17-871f-45d5-b152-2dce3d80204d r/w with ordered data mode. Quota mode: none.1986worker2 # [ 3.496487] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1987lb # [ 3.522506] systemd[1]: Mounted /sysroot.1988lb # [ 3.525125] systemd[1]: Reached target Initrd Root File System.1989lb # [ 3.528709] systemd[1]: Starting Mountpoints Configured in the Real Root...1990client # [ 3.584231] EXT4-fs (vda): mounted filesystem 74e73c33-48e3-4652-ac4e-4ab33af2f062 r/w with ordered data mode. Quota mode: none.1991client # [ 3.573533] systemd[1]: Mounted /sysroot.1992worker1 # [ 3.453252] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1993client # [ 3.575578] systemd[1]: Reached target Initrd Root File System.1994client # [ 3.576992] systemd[1]: Starting Mountpoints Configured in the Real Root...1995worker1 # [ 3.460275] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1996worker1 # [ 3.468342] systemd[1]: Mounting /sysroot...1997lb # [ 3.556447] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1998lb # [ 3.565400] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1999lb # [ 3.569180] systemd[1]: Reloading...2000client # [ 3.608428] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.
loading 1,322 hidden lines…
3323lb # [ 14.920681] systemd-logind[527]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3324client # [ 14.977894] systemd[1]: Starting Virtual Console Setup...3325client # [ 15.026556] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3326client # [ 15.037202] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3327client # [ 15.044239] systemd[1]: Stopped Virtual Console Setup.3328client # [ 15.055008] systemd[1]: Starting Virtual Console Setup...3329client # [ 15.091524] systemd-logind[431]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3330worker2 # [ 15.088023] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33331worker1 # [ 15.117325] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33332client # [ 15.226524] dhcpcd[554]: eth0: soliciting a DHCP lease3333client # [ 15.232767] dhcpcd[554]: eth0: offered 10.0.2.15 from 10.0.2.23334client # [ 15.240301] dhcpcd[554]: eth0: probing address 10.0.2.15/243335lb: (finished: waiting for unit network-addresses-eth1.service, in 1.37 seconds)3336lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3337client # [ 15.313643] dhcpcd[554]: eth0: soliciting an IPv6 router3338client # [ 15.315579] dhcpcd[554]: eth0: Router Advertisement from fe80::23339client # [ 15.316845] dhcpcd[554]: eth0: adding address fec0::5054:ff:fe12:3456/643340client # [ 15.318081] dhcpcd[554]: eth0: adding route to fec0::/643341client # [ 15.318998] dhcpcd[554]: eth0: adding default route via fe80::23342lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.06 seconds)3343worker1: waiting for unit network-addresses-eth1.service3344worker1: waiting for the VM to finish booting3345worker1: Guest shell says: b'Spawning backdoor root shell...\n'3346worker1: connected to guest root shell3347worker1: (connecting took 0.00 seconds)3348worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3349worker2 # [ 15.395778] dhcpcd[658]: eth0: soliciting a DHCP lease3350worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3351worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3352worker2 # [ 15.403607] dhcpcd[658]: eth0: offered 10.0.2.15 from 10.0.2.23353client # [ 15.461256] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones.3354worker2 # [ 15.407451] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3355client # [ 15.466006] systemd[1]: Finished Virtual Console Setup.3356worker2 # [ 15.410899] dhcpcd[658]: eth0: probing address 10.0.2.15/243357worker2 # [ 15.430567] systemd[1]: Starting Virtual Console Setup...3358worker2 # [ 15.453676] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3359worker2 # [ 15.461395] systemd[1]: Stopped Virtual Console Setup.3360worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.06 seconds)3361worker2: waiting for unit network-addresses-eth1.service3362worker2: waiting for the VM to finish booting3363worker2: Guest shell says: b'Spawning backdoor root shell...\n'3364worker2: connected to guest root shell3365worker2: (connecting took 0.00 seconds)3366worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3367worker2 # [ 15.467407] systemd[1]: Starting Virtual Console Setup...3368worker2 # [ 15.555852] systemd-logind[510]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3369worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.12 seconds)3370worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3371worker1 # [ 15.544804] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3372worker1 # [ 15.560078] systemd[1]: Starting Virtual Console Setup...3373worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3374lb: waiting for unit niks3.service3375worker1 # [ 15.580551] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3376worker1 # [ 15.584994] systemd[1]: Stopped Virtual Console Setup.3377worker1 # [ 15.594348] systemd[1]: Starting Virtual Console Setup...3378worker1 # [ 15.667757] systemd-logind[516]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3379lb # [ 15.875997] dhcpcd[665]: eth0: soliciting a DHCP lease3380lb # [ 15.880606] dhcpcd[665]: eth0: offered 10.0.2.15 from 10.0.2.23381lb # [ 15.888331] dhcpcd[665]: eth0: probing address 10.0.2.15/243382worker2 # [ 15.967934] systemd-vconsole-setup[699]: Configuration of first virtual console was skipped, ignoring remaining ones.3383worker2 # [ 15.974530] systemd[1]: Finished Virtual Console Setup.3384worker1 # [ 16.004152] systemd-vconsole-setup[710]: Configuration of first virtual console was skipped, ignoring remaining ones.3385worker1 # [ 16.009089] systemd[1]: Finished Virtual Console Setup.3386lb # [ 16.164308] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33387lb # [ 16.194782] dhcpcd[665]: eth0: soliciting an IPv6 router3388lb # [ 16.196586] dhcpcd[665]: eth0: Router Advertisement from fe80::23389lb # [ 16.198036] dhcpcd[665]: eth0: adding address fec0::5054:ff:fe12:3456/643390lb # [ 16.199390] dhcpcd[665]: eth0: adding route to fec0::/643391lb # [ 16.201592] dhcpcd[665]: eth0: adding default route via fe80::23392worker1 # [ 16.349851] dhcpcd[645]: eth0: soliciting an IPv6 router3393worker1 # [ 16.353183] dhcpcd[645]: eth0: Router Advertisement from fe80::23394worker1 # [ 16.355779] dhcpcd[645]: eth0: adding address fec0::5054:ff:fe12:3456/643395worker1 # [ 16.358768] dhcpcd[645]: eth0: adding route to fec0::/643396worker1 # [ 16.361729] dhcpcd[645]: eth0: adding default route via fe80::23397lb # [ 16.778009] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3398lb # [ 16.789795] systemd[1]: Starting Virtual Console Setup...3399worker2 # [ 16.794101] dhcpcd[658]: eth0: soliciting an IPv6 router3400worker2 # [ 16.796730] dhcpcd[658]: eth0: Router Advertisement from fe80::23401worker2 # [ 16.799359] dhcpcd[658]: eth0: adding address fec0::5054:ff:fe12:3456/643402worker2 # [ 16.802319] dhcpcd[658]: eth0: adding route to fec0::/643403worker2 # [ 16.804846] dhcpcd[658]: eth0: adding default route via fe80::23404lb # [ 16.981258] systemd-logind[527]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3405lb # [ 17.313028] systemd-vconsole-setup[783]: Configuration of first virtual console was skipped, ignoring remaining ones.3406lb # [ 17.317371] systemd[1]: Finished Virtual Console Setup.3407lb # [ 17.322098] postgresql-pre-start[706]: selecting default time zone ... UTC3408lb # [ 17.326156] postgresql-pre-start[706]: creating configuration files ... ok3409lb # [ 17.630398] postgresql-pre-start[706]: running bootstrap script ... ok3410lb # [ 18.448358] postgresql-pre-start[706]: performing post-bootstrap initialization ... ok3411lb # [ 18.604369] postgresql-pre-start[706]: syncing data to disk ... ok3412lb # [ 18.606667] postgresql-pre-start[706]: initdb: warning: enabling "trust" authentication for local connections3413lb # [ 18.608275] postgresql-pre-start[706]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3414lb # [ 18.610416] postgresql-pre-start[706]: Success. You can now start the database server using:3415lb # [ 18.611609] postgresql-pre-start[706]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3416lb # [ 18.794366] postgres[816]: [816] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3417lb # [ 18.801441] postgres[816]: [816] LOG: listening on IPv6 address "::1", port 54323418lb # [ 18.803521] postgres[816]: [816] LOG: listening on IPv4 address "127.0.0.1", port 54323419lb # [ 18.806790] postgres[816]: [816] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3420lb # [ 18.821412] postgres[825]: [825] LOG: database system was shut down at 2026-09-20 12:22:36 GMT3421lb # [ 18.829741] postgres[816]: [816] LOG: database system is ready to accept connections3422lb # [ 18.834244] systemd[1]: Started PostgreSQL Server.3423lb # [ 18.847688] systemd[1]: Starting PostgreSQL Setup Scripts...3424lb # [ 19.131232] postgresql-setup-start[836]: CREATE DATABASE3425lb # [ 19.237304] postgresql-setup-start[845]: CREATE ROLE3426lb # [ 19.278144] postgresql-setup-start[851]: ALTER DATABASE3427lb # [ 19.285129] systemd[1]: Finished PostgreSQL Setup Scripts.3428lb # [ 19.287260] systemd[1]: Reached target PostgreSQL.3429worker1 # [ 19.283380] dhcpcd[645]: eth0: leased 10.0.2.15 for 86400 seconds3430worker1 # [ 19.285730] dhcpcd[645]: eth0: adding route to 10.0.2.0/243431worker1 # [ 19.287732] dhcpcd[645]: eth0: adding default route via 10.0.2.23432client # [ 19.506388] dhcpcd[554]: eth0: leased 10.0.2.15 for 86400 seconds3433client # [ 19.511160] dhcpcd[554]: eth0: adding route to 10.0.2.0/243434client # [ 19.514774] dhcpcd[554]: eth0: adding default route via 10.0.2.23435worker1 # [ 19.462319] systemd[1]: Started DHCP Client.3436worker1 # [ 19.465119] systemd[1]: Reached target Multi-User System.3437worker1 # [ 19.466059] systemd[1]: Startup finished in 1.082s (kernel) + 5.633s (initrd) + 12.748s (userspace) = 19.464s.3438client # [ 19.736657] systemd[1]: Started DHCP Client.3439client # [ 19.740512] systemd[1]: Reached target Multi-User System.3440client # [ 19.744834] systemd[1]: Startup finished in 1.069s (kernel) + 5.638s (initrd) + 13.036s (userspace) = 19.744s.3441worker2 # [ 20.433592] dhcpcd[658]: eth0: leased 10.0.2.15 for 86400 seconds3442worker2 # [ 20.439626] dhcpcd[658]: eth0: adding route to 10.0.2.0/243443worker2 # [ 20.442353] dhcpcd[658]: eth0: adding default route via 10.0.2.23444worker2 # [ 20.703356] systemd[1]: Started DHCP Client.3445worker2 # [ 20.705419] systemd[1]: Reached target Multi-User System.3446worker2 # [ 20.706821] systemd[1]: Startup finished in 1.116s (kernel) + 5.715s (initrd) + 13.874s (userspace) = 20.706s.3447lb # [ 20.974051] dhcpcd[665]: eth0: leased 10.0.2.15 for 86400 seconds3448lb # [ 20.979137] dhcpcd[665]: eth0: adding route to 10.0.2.0/243449lb # [ 20.979504] dhcpcd[665]: eth0: adding default route via 10.0.2.23450lb # [ 21.189868] systemd[1]: Started DHCP Client.3451lb # [ 21.196989] systemd[1]: Reached target Network is Online.3452lb # [ 21.201299] systemd[1]: Started Envoy reverse proxy.3453lb # [ 21.211315] systemd[1]: Started mock-oidc.service.3454lb # [ 21.326260] mock-oidc-server[921]: Mock OIDC Server running3455lb # [ 21.327392] mock-oidc-server[921]: OIDC Address: 192.168.1.2:80803456lb # [ 21.329192] mock-oidc-server[921]: Issue Address: 0.0.0.0:80813457lb # [ 21.330872] mock-oidc-server[921]: Issuer: http://192.168.1.2:8080/oidc3458lb # [ 21.333124] mock-oidc-server[921]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3459lb # [ 21.334899] mock-oidc-server[921]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3460lb # [ 21.336893] mock-oidc-server[921]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3461lb # [ 21.934963] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3462lb # [ 21.937063] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:469] statically linked extensions:3463lb # [ 21.938899] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3464lb # [ 21.944648] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3465lb # [ 21.947207] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3466lb # [ 21.949949] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3467lb # [ 21.952138] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3468lb # [ 21.954712] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3469lb # [ 21.958654] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3470lb # [ 21.961070] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3471lb # [ 21.963808] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3472lb # [ 21.966849] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3473lb # [ 21.969130] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3474lb # [ 21.989606] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3475lb # [ 21.992808] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3476lb # [ 21.995293] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3477lb # [ 22.004060] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3478lb # [ 22.006457] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3479lb # [ 22.008694] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3480lb # [ 22.011865] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3481lb # [ 22.019646] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3482lb # [ 22.028522] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3483lb # [ 22.035173] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3484lb # [ 22.037344] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3485lb # [ 22.039293] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3486lb # [ 22.041398] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3487lb # [ 22.043709] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3488lb # [ 22.047577] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3489lb # [ 22.054004] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3490lb # [ 22.055964] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3491lb # [ 22.059959] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83492lb # [ 22.062921] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3493lb # [ 22.065170] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3494lb # [ 22.068180] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3495lb # [ 22.070497] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3496lb # [ 22.077446] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3497lb # [ 22.110599] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3498lb # [ 22.113931] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3499lb # [ 22.116315] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3500lb # [ 22.119581] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3501lb # [ 22.123521] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3502lb # [ 22.127016] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3503lb # [ 22.131387] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3504lb # [ 22.134749] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3505lb # [ 22.139517] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3506lb # [ 22.143498] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3507lb # [ 22.145641] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3508lb # [ 22.147954] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3509lb # [ 22.155660] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3510lb # [ 22.158123] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3511lb # [ 22.160491] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3512lb # [ 22.162698] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3513lb # [ 22.166528] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3514lb # [ 22.168694] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3515lb # [ 22.170626] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3516lb # [ 22.175567] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23517lb # [ 22.178666] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3518lb # [ 22.181376] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3519lb # [ 22.183355] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3520lb # [ 22.186083] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3521lb # [ 22.189291] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3522lb # [ 22.192107] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3523lb # [ 22.194185] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3524lb # [ 22.197109] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3525lb # [ 22.199102] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3526lb # [ 22.208902] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3527lb # [ 22.211476] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3528lb # [ 22.217788] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3529lb # [ 22.219684] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13530lb # [ 22.222225] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3531lb # [ 22.224411] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3532lb # [ 22.226402] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3533lb # [ 22.229437] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23534lb # [ 22.231283] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3535lb # [ 22.233789] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3536lb # [ 22.239496] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3537lb # [ 22.243903] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3538lb # [ 22.247557] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3539lb # [ 22.250333] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3540lb # [ 22.255623] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3541lb # [ 22.258079] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3542lb # [ 22.260454] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3543lb # [ 22.262726] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3544lb # [ 22.265663] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3545lb # [ 22.269060] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3546lb # [ 22.270730] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3547lb # [ 22.273019] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3548lb # [ 22.287088] envoy[920]: [2026-09-20 12:22:40.435][920][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3549lb # [ 22.289326] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3550lb # [ 22.294262] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3551lb # [ 22.299401] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3552lb # [ 22.303791] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3553lb # [ 22.311349] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3554lb # [ 22.313453] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3555lb # [ 22.315938] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3556lb # [ 22.319017] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3557lb # [ 22.322145] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3558lb # [ 22.324691] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3559lb # [ 22.326740] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23560lb # [ 22.328764] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3561lb # [ 22.342708] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3562lb # [ 22.345317] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3563lb # [ 22.348250] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3564lb # [ 22.350697] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3565lb # [ 22.353748] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3566lb # [ 22.356679] envoy[920]: [2026-09-20 12:22:40.436][920][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3567lb # [ 22.364878] envoy[920]: [2026-09-20 12:22:40.483][920][info][main] [source/server/server.cc:531] HTTP header map info:3568lb # [ 22.366410] envoy[920]: [2026-09-20 12:22:40.486][920][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3569lb # [ 22.382756] envoy[920]: [2026-09-20 12:22:40.486][920][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3570lb # [ 22.384570] envoy[920]: [2026-09-20 12:22:40.486][920][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3571lb # [ 22.393625] envoy[920]: [2026-09-20 12:22:40.486][920][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3572lb # [ 22.395592] envoy[920]: [2026-09-20 12:22:40.687][920][info][main] [source/server/server.cc:968] runtime: {}3573lb # [ 22.397064] envoy[920]: [2026-09-20 12:22:40.718][920][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3574lb # [ 22.399665] envoy[920]: [2026-09-20 12:22:40.719][920][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013575lb # [ 22.402267] envoy[920]: [2026-09-20 12:22:40.719][920][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013576lb # [ 22.403919] envoy[920]: [2026-09-20 12:22:40.725][920][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3577lb # [ 22.409560] envoy[920]: [2026-09-20 12:22:40.726][920][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3578lb # [ 22.411278] envoy[920]: [2026-09-20 12:22:40.726][920][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3579lb # [ 22.433475] envoy[920]: [2026-09-20 12:22:40.935][920][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3580worker2 # [ 22.413394] systemd[1]: Reached target Network is Online.3581lb # [ 22.445301] envoy[920]: [2026-09-20 12:22:40.946][920][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3582worker2 # [ 22.422553] systemd[1]: Starting scheduler-token.service...3583lb # [ 22.448607] envoy[920]: [2026-09-20 12:22:40.949][920][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3584lb # [ 22.452266] envoy[920]: [2026-09-20 12:22:40.949][920][info][main] [source/server/server.cc:1077] starting main dispatch loop3585worker1 # [ 22.362796] systemd[1]: Starting Nix worker-protocol over gRPC...3586worker2 # [ 22.564843] systemd[1]: scheduler-token.service: Deactivated successfully.3587worker2 # [ 22.567677] systemd[1]: Finished scheduler-token.service.3588worker2 # [ 22.572969] systemd[1]: scheduler-token.service: Consumed 49ms CPU time over 144ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3589worker2 # [ 22.583784] systemd[1]: Starting Nix worker-protocol over gRPC...3590worker1 # [ 22.669279] nix-grpc-daemon[775]: ts=2026-09-20T12:22:42Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3591worker1 # [ 22.682275] nix-grpc-daemon[775]: ts=2026-09-20T12:22:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3592worker1 # [ 22.684620] nix-grpc-daemon[775]: ts=2026-09-20T12:22:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13593worker1 # [ 22.737023] nix-grpc-daemon[775]: ts=2026-09-20T12:22:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3594worker1 # [ 22.738824] systemd[1]: Started Nix worker-protocol over gRPC.3595worker2 # [ 22.834602] nix-grpc-daemon[776]: ts=2026-09-20T12:22:42Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3596worker1 # [ 22.771833] nix-grpc-daemon[775]: ts=2026-09-20T12:22:42Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3597lb # [ 22.861614] envoy[920]: [2026-09-20 12:22:41.362][920][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3598worker2 # [ 22.847190] nix-grpc-daemon[776]: ts=2026-09-20T12:22:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3599lb # [ 22.868775] envoy[920]: [2026-09-20 12:22:41.362][920][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3600worker2 # [ 22.849705] nix-grpc-daemon[776]: ts=2026-09-20T12:22:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13601lb # [ 22.874422] envoy[920]: [2026-09-20 12:22:41.362][920][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3602lb # [ 22.879773] envoy[920]: [2026-09-20 12:22:41.362][920][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3603worker2 # [ 22.901173] nix-grpc-daemon[776]: ts=2026-09-20T12:22:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3604worker2 # [ 22.907282] systemd[1]: Started Nix worker-protocol over gRPC.3605worker2 # [ 22.945674] nix-grpc-daemon[776]: ts=2026-09-20T12:22:42Z level=info event=scheduler_connected addr=lb:500513606worker2 # [ 22.950537] nix-grpc-daemon[776]: ts=2026-09-20T12:22:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3607worker1 # [ 22.973076] nix-grpc-daemon[775]: ts=2026-09-20T12:22:42Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3608worker2 # [ 23.152690] nix-grpc-daemon[776]: ts=2026-09-20T12:22:42Z level=info event=scheduler_connected addr=lb:500513609worker2 # [ 23.159233] nix-grpc-daemon[776]: ts=2026-09-20T12:22:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3610worker2 # [ 23.359828] nix-grpc-daemon[776]: ts=2026-09-20T12:22:42Z level=info event=scheduler_connected addr=lb:500513611worker2 # [ 23.366215] nix-grpc-daemon[776]: ts=2026-09-20T12:22:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3612worker1 # [ 23.373876] nix-grpc-daemon[775]: ts=2026-09-20T12:22:42Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3613worker2 # [ 23.567297] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:500513614worker2 # [ 23.570788] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3615worker2 # [ 23.773091] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 23.780598] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3617worker2 # [ 23.980458] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:500513618worker2 # [ 23.982786] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3619worker2 # [ 24.184507] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:500513620worker2 # [ 24.189860] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3621worker1 # [ 24.176657] nix-grpc-daemon[775]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:500513622worker1 # [ 24.181717] nix-grpc-daemon[775]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3623worker2 # [ 24.391081] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:500513624worker2 # [ 24.396793] nix-grpc-daemon[776]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3625worker1 # [ 24.383002] nix-grpc-daemon[775]: ts=2026-09-20T12:22:43Z level=info event=scheduler_connected addr=lb:500513626worker1 # [ 24.388967] nix-grpc-daemon[775]: ts=2026-09-20T12:22:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker2 # [ 24.598083] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 24.603561] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3629worker1 # [ 24.590106] nix-grpc-daemon[775]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:500513630worker1 # [ 24.596373] nix-grpc-daemon[775]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3631worker2 # [ 24.805128] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:500513632worker2 # [ 24.810470] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3633worker1 # [ 24.797037] nix-grpc-daemon[775]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:500513634worker1 # [ 24.802637] nix-grpc-daemon[775]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker2 # [ 25.013195] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 25.017994] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3637worker1 # [ 25.003672] nix-grpc-daemon[775]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:500513638worker1 # [ 25.009373] nix-grpc-daemon[775]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker2 # [ 25.219161] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 25.223286] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3641worker1 # [ 25.212104] nix-grpc-daemon[775]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:500513642worker1 # [ 25.216582] nix-grpc-daemon[775]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker2 # [ 25.424777] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 25.430191] nix-grpc-daemon[776]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3645worker1 # [ 25.412780] nix-grpc-daemon[775]: ts=2026-09-20T12:22:44Z level=info event=scheduler_connected addr=lb:500513646worker1 # [ 25.418116] nix-grpc-daemon[775]: ts=2026-09-20T12:22:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker2 # [ 25.631498] nix-grpc-daemon[776]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 25.637306] nix-grpc-daemon[776]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3649worker1 # [ 25.619019] nix-grpc-daemon[775]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:500513650worker1 # [ 25.624454] nix-grpc-daemon[775]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker2 # [ 25.838635] nix-grpc-daemon[776]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 25.844352] nix-grpc-daemon[776]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3653worker1 # [ 25.825205] nix-grpc-daemon[775]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:500513654worker1 # [ 25.830518] nix-grpc-daemon[775]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker2 # [ 26.046903] nix-grpc-daemon[776]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 26.050102] nix-grpc-daemon[776]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3657worker1 # [ 26.031240] nix-grpc-daemon[775]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:500513658worker1 # [ 26.035781] nix-grpc-daemon[775]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker2 # [ 26.248473] nix-grpc-daemon[776]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:500513660worker2 # [ 26.253784] nix-grpc-daemon[776]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3661worker1 # [ 26.238660] nix-grpc-daemon[775]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:500513662worker1 # [ 26.242897] nix-grpc-daemon[775]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker2 # [ 26.455296] nix-grpc-daemon[776]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:500513664worker2 # [ 26.460970] nix-grpc-daemon[776]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3665worker1 # [ 26.439316] nix-grpc-daemon[775]: ts=2026-09-20T12:22:45Z level=info event=scheduler_connected addr=lb:500513666worker1 # [ 26.444996] nix-grpc-daemon[775]: ts=2026-09-20T12:22:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker2 # [ 26.662609] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500513668worker2 # [ 26.668380] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3669worker1 # [ 26.646088] nix-grpc-daemon[775]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500513670worker1 # [ 26.651809] nix-grpc-daemon[775]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker2 # [ 26.869754] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500513672worker2 # [ 26.875309] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3673worker1 # [ 26.852833] nix-grpc-daemon[775]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500513674worker1 # [ 26.858217] nix-grpc-daemon[775]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker2 # [ 27.078632] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500513676worker2 # [ 27.083054] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3677worker1 # [ 27.059136] nix-grpc-daemon[775]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500513678worker1 # [ 27.064937] nix-grpc-daemon[775]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker2 # [ 27.279816] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500513680worker2 # [ 27.285756] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3681lb # [ 27.345830] rustfs-bucket-start[992]: mb s3://farm3682lb # [ 27.353521] systemd[1]: Finished rustfs-bucket.service.3683worker1 # [ 27.266919] nix-grpc-daemon[775]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500513684lb # [ 27.363799] systemd[1]: Starting niks3 server...3685worker1 # [ 27.272492] nix-grpc-daemon[775]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3686worker2 # [ 27.487213] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500513687worker2 # [ 27.493214] nix-grpc-daemon[776]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3688worker1 # [ 27.473338] nix-grpc-daemon[775]: ts=2026-09-20T12:22:46Z level=info event=scheduler_connected addr=lb:500513689worker1 # [ 27.478900] nix-grpc-daemon[775]: ts=2026-09-20T12:22:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3690lb # [ 27.589454] postgres[1008]: [1008] ERROR: relation "goose_db_version" does not exist at character 363691lb # [ 27.592219] postgres[1008]: [1008] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3692lb # [ 27.623514] niks3-server[1003]: 2026/09/20 12:22:46 OK 20241026095416_initial_model.sql (19.95ms)3693lb # [ 27.627036] niks3-server[1003]: 2026/09/20 12:22:46 OK 20251210153512_drop_unused_gin_index.sql (3.95ms)3694lb # [ 27.633349] niks3-server[1003]: 2026/09/20 12:22:46 OK 20251218171726_add_pins.sql (6.24ms)3695lb # [ 27.638414] niks3-server[1003]: 2026/09/20 12:22:46 OK 20260628120000_add_object_size_and_stats.sql (5.02ms)3696lb # [ 27.643857] niks3-server[1003]: 2026/09/20 12:22:46 OK 20260905000000_add_claims.sql (5.4ms)3697lb # [ 27.648562] niks3-server[1003]: 2026/09/20 12:22:46 OK 20260920000000_drop_claims.sql (4.58ms)3698lb # [ 27.649814] niks3-server[1003]: 2026/09/20 12:22:46 goose: successfully migrated database to version: 202609200000003699lb # [ 27.654911] niks3-server[1003]: 2026/09/20 12:22:46 OK 1_commit_pending_closure.sql (6.31ms)3700lb # [ 27.657920] niks3-server[1003]: 2026/09/20 12:22:46 OK 2_object_stats_trigger.sql (2.84ms)3701lb # [ 27.659342] niks3-server[1003]: 2026/09/20 12:22:46 goose: up to current file version: 23702lb # [ 27.663299] niks3-server[1003]: 2026/09/20 12:22:46 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3703lb # [ 27.704965] niks3-server[1003]: 2026/09/20 12:22:46 INFO Read proxy enabled — serving cache objects from S33704lb # [ 27.706400] niks3-server[1003]: 2026/09/20 12:22:46 INFO Using socket-activated listener address=0.0.0.0:57513705lb # [ 27.711757] niks3-server[1003]: 2026/09/20 12:22:46 INFO systemd watchdog enabled interval=15s3706lb # [ 27.715092] systemd[1]: Started niks3 server.3707lb # [ 27.716765] niks3-server[1003]: 2026/09/20 12:22:46 INFO Starting HTTP server address=0.0.0.0:57513708lb # [ 27.720213] systemd[1]: Reached target Multi-User System.3709lb # [ 27.721052] systemd[1]: Startup finished in 1.072s (kernel) + 5.626s (initrd) + 21.015s (userspace) = 27.714s.3710worker2 # [ 27.694667] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:500513711lb # [ 27.727542] niks3-server[1003]: 2026/09/20 12:22:46 INFO lead: acquired remote=192.168.1.4:555183712worker2 # [ 27.700314] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3713worker2 # [ 27.707856] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=scheduler_take_over3714worker1 # [ 27.679688] nix-grpc-daemon[775]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:500513715worker1 # [ 27.685142] nix-grpc-daemon[775]: ts=2026-09-20T12:22:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3716worker2 # [ 27.901692] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:500513717worker2 # [ 27.908354] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3718worker1 # [ 27.886289] nix-grpc-daemon[775]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:500513719worker2 # [ 27.956677] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:390223720worker2 # [ 27.962998] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03721worker2 # [ 28.110708] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=scheduler_connected addr=lb:500513722worker2 # [ 28.133897] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=oidc_jwks provider=mock keys=13723worker2 # [ 28.139480] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:390223724worker2 # [ 28.145381] nix-grpc-daemon[776]: ts=2026-09-20T12:22:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03725lb: (finished: waiting for unit niks3.service, in 12.63 seconds)3726lb: waiting for TCP port 5751 on localhost3727lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3728lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds)3729lb: waiting for unit envoy.service3730lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3731lb: waiting for TCP port 50051 on localhost3732lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3733lb # [ 28.485229] envoy[920]: conn peer=[::1]:33880 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33734lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3735worker2 # [ 28.652903] systemd[1]: Starting scheduler-token.service...3736worker2 # [ 28.744909] systemd[1]: scheduler-token.service: Deactivated successfully.3737worker2 # [ 28.749470] systemd[1]: Finished scheduler-token.service.3738worker2 # [ 28.750959] systemd[1]: scheduler-token.service: Consumed 39ms CPU time over 97ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3739lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3740??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3741 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283742lb: must succeed: curl -sf localhost:9901/clusters3743lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)3744lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds)3745subtest: one node schedules and both builders hold a WorkerSession on it3746lb: must succeed: curl -sf localhost:9901/clusters3747lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3748worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3749worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)3750lb: must succeed: curl -sf localhost:9901/clusters3751lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3752lb: must succeed: curl -sf localhost:9901/clusters3753lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3754worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'3755worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.05 seconds)3756(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.33 seconds)3757subtest: balancer auth: client cert, bearer token, nothing, unknown CN3758worker1 # [ 29.481092] nix-grpc-daemon[775]: ts=2026-09-20T12:22:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592463759worker1 # [ 29.491591] systemd[1]: Started Nix Daemon.3760worker1 # [ 29.967171] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3761worker1 # [ 30.005895] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 1/5)3762worker1 # [ 30.062760] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 2/5)3763worker1 # [ 30.110509] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 170 ms (attempt 3/5)3764worker1 # [ 30.281137] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 355 ms (attempt 4/5)3765worker1 # [ 30.647551] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3766worker1 # [ 30.671758] nix-grpc-daemon[775]: ts=2026-09-20T12:22:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:592463767worker1 # [ 30.687300] nix-grpc-daemon[775]: ts=2026-09-20T12:22:50Z level=debug event=path_info_miss path=3j2y8kv31agsjn1yas4ma4lb219pab3y-nixos-system-client-test error="error: path '/nix/store/3j2y8kv31agsjn1yas4ma4lb219pab3y-nixos-system-client-test' is required, but there is no substituter that can build it"3768worker1 # [ 30.697571] nix-grpc-daemon[775]: ts=2026-09-20T12:22:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:592463769worker1 # [ 30.708977] nix-grpc-daemon[775]: ts=2026-09-20T12:22:50Z level=debug event=path_info_miss path=3j2y8kv31agsjn1yas4ma4lb219pab3y-nixos-system-client-test error="error: path '/nix/store/3j2y8kv31agsjn1yas4ma4lb219pab3y-nixos-system-client-test' is required, but there is no substituter that can build it"3770client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3771client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)3772client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3773client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3774worker1 # [ 31.172227] nix-grpc-daemon[775]: ts=2026-09-20T12:22:50Z level=info event=oidc_jwks provider=mock keys=13775worker1 # [ 31.179576] nix-grpc-daemon[775]: ts=2026-09-20T12:22:50Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:592463776worker1 # [ 31.193307] nix-grpc-daemon[775]: ts=2026-09-20T12:22:50Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:592463777worker1 # [ 31.206269] nix-grpc-daemon[775]: ts=2026-09-20T12:22:50Z level=debug event=path_info_miss path=3j2y8kv31agsjn1yas4ma4lb219pab3y-nixos-system-client-test error="error: path '/nix/store/3j2y8kv31agsjn1yas4ma4lb219pab3y-nixos-system-client-test' is required, but there is no substituter that can build it"3778worker1 # [ 31.221848] nix-grpc-daemon[775]: ts=2026-09-20T12:22:50Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:592463779worker1 # [ 31.229962] nix-grpc-daemon[775]: ts=2026-09-20T12:22:50Z level=debug event=path_info_miss path=3j2y8kv31agsjn1yas4ma4lb219pab3y-nixos-system-client-test error="error: path '/nix/store/3j2y8kv31agsjn1yas4ma4lb219pab3y-nixos-system-client-test' is required, but there is no substituter that can build it"3780client: must succeed: rm -r /var/lib/nix-grpc-store3781client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds)3782worker2 # [ 31.613870] nix-grpc-daemon[776]: ts=2026-09-20T12:22:51Z level=info event=denied method=QueryMissing cn=- role=none3783worker2 # [ 31.863072] nix-grpc-daemon[776]: ts=2026-09-20T12:22:51Z level=info event=denied method=QueryMissing cn=stranger role=none3784(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.70 seconds)3785subtest: DAG build is scheduled across workers and lands in the cache3786client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23787worker1 # [ 32.047394] nix-grpc-daemon[775]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592463788client # don't know how to build these paths:3789client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3790worker1 # [ 32.058576] nix-grpc-daemon[775]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592463791worker2 # [ 32.161215] nix-grpc-daemon[776]: ts=2026-09-20T12:22:51Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03792worker2 # [ 32.167496] nix-grpc-daemon[776]: ts=2026-09-20T12:22:51Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13793worker1 # [ 32.150509] nix-grpc-daemon[775]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592463794worker1 # [ 32.173242] nix-grpc-daemon[775]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592463795client # copying 1 paths to 'lb:50051'...3796worker1 # [ 32.191073] nix-grpc-daemon[775]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592463797client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3798worker1 # [ 32.215048] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3799worker1 # [ 32.233775] nix-grpc-daemon[775]: ts=2026-09-20T12:22:51Z level=info event=niks3_push_started pid=8413800lb # [ 32.434976] envoy[920]: conn peer=[2001:db8:1::1]:35934 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=12963801lb # [ 32.437573] envoy[920]: conn peer=[2001:db8:1::1]:45070 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=823802lb # [ 32.439746] envoy[920]: conn peer=[2001:db8:1::1]:45082 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=199 ms=303803lb # [ 32.442112] envoy[920]: conn peer=[2001:db8:1::1]:45086 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=143804worker1 # [ 32.509203] nix-grpc-daemon[841]: time=2026-09-20T12:22:52.001Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""3805worker1 # [ 32.701721] nix-daemon[831]: accepted connection from pid 854, user nix-grpc-daemon (trusted)3806worker1 # [ 32.722629] nix-daemon[831]: reaped child process 857, status = succeeded3807worker1 # [ 32.905207] nix-daemon[831]: accepted connection from pid 859, user nix-grpc-daemon (trusted)3808worker1 # [ 32.925063] nix-daemon[831]: reaped child process 862, status = succeeded3809lb # [ 33.026444] niks3-server[1003]: 2026/09/20 12:22:51 INFO Received uploads request method=POST path=/api/pending_closures3810worker1 # [ 32.962534] nix-grpc-daemon[841]: time=2026-09-20T12:22:52.456Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3811worker1 # [ 32.966209] nix-grpc-daemon[841]: time=2026-09-20T12:22:52.456Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3812lb # [ 33.101309] niks3-server[1003]: 2026/09/20 12:22:51 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3813lb # [ 33.112717] niks3-server[1003]: 2026/09/20 12:22:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3814lb # [ 33.126877] niks3-server[1003]: 2026/09/20 12:22:51 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3815lb # [ 33.148830] niks3-server[1003]: 2026/09/20 12:22:51 INFO Signed narinfos id=1 count=13816worker1 # [ 33.065126] nix-grpc-daemon[841]: time=2026-09-20T12:22:52.558Z level=INFO msg="Uploading 1 narinfos"3817lb # [ 33.173248] niks3-server[1003]: 2026/09/20 12:22:51 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3818lb # [ 33.182221] niks3-server[1003]: 2026/09/20 12:22:51 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3819lb # [ 33.201553] niks3-server[1003]: 2026/09/20 12:22:51 INFO Completed upload id=13820worker1 # [ 33.114136] nix-grpc-daemon[841]: time=2026-09-20T12:22:52.608Z level=INFO msg="Upload complete. (595ms)"3821worker1 # [ 33.127699] nix-grpc-daemon[775]: ts=2026-09-20T12:22:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=0 paths=1 nar_bytes_in=5043822worker1 # [ 33.147849] nix-grpc-daemon[775]: ts=2026-09-20T12:22:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592463823worker1 # [ 33.156654] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3824worker1 # [ 33.164951] nix-daemon[831]: reaped child process 839, status = succeeded3825client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3826client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3827worker1 # [ 33.184134] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3828client # farm-a> LOG-farm-a-t13829worker1 # [ 34.410194] nix-daemon[831]: reaped child process 866, status = succeeded3830worker1 # [ 34.576167] nix-daemon[831]: accepted connection from pid 882, user nix-grpc-daemon (trusted)3831worker1 # [ 34.595565] nix-daemon[831]: reaped child process 885, status = succeeded3832lb # [ 34.698332] niks3-server[1003]: 2026/09/20 12:22:53 INFO Received uploads request method=POST path=/api/pending_closures3833worker1 # [ 34.622456] nix-grpc-daemon[841]: time=2026-09-20T12:22:54.115Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3834worker1 # [ 34.624393] nix-grpc-daemon[841]: time=2026-09-20T12:22:54.115Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3835lb # [ 34.761822] niks3-server[1003]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3836lb # [ 34.771377] niks3-server[1003]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3837worker1 # [ 34.689573] nix-grpc-daemon[841]: time=2026-09-20T12:22:54.182Z level=INFO msg="Uploading 1 narinfos"3838lb # [ 34.777409] niks3-server[1003]: 2026/09/20 12:22:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3839lb # [ 34.782232] niks3-server[1003]: 2026/09/20 12:22:53 INFO Signed narinfos id=2 count=13840lb # [ 34.787444] niks3-server[1003]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3841lb # [ 34.798117] niks3-server[1003]: 2026/09/20 12:22:53 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3842lb # [ 34.804355] niks3-server[1003]: 2026/09/20 12:22:53 INFO Completed upload id=23843worker1 # [ 34.716525] nix-grpc-daemon[841]: time=2026-09-20T12:22:54.210Z level=INFO msg="Upload complete. (317ms)"3844lb # [ 34.807142] niks3-server[1003]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3845worker2 # [ 34.796546] nix-grpc-daemon[776]: ts=2026-09-20T12:22:54Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03846worker1 # [ 34.729045] nix-grpc-daemon[775]: ts=2026-09-20T12:22:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13847worker2 # [ 34.796709] nix-grpc-daemon[776]: ts=2026-09-20T12:22:54Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13848worker1 # [ 34.742756] nix-daemon[831]: reaped child process 864, status = succeeded3849worker1 # [ 34.785875] nix-grpc-daemon[775]: ts=2026-09-20T12:22:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592463850worker1 # [ 34.799108] nix-grpc-daemon[775]: ts=2026-09-20T12:22:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592463851worker1 # [ 34.815979] nix-grpc-daemon[841]: time=2026-09-20T12:22:54.310Z level=INFO msg="All 1 paths already cached"3852client # copying 1 paths to 'lb:50051'...3853worker1 # [ 34.825678] nix-grpc-daemon[775]: ts=2026-09-20T12:22:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592463854client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3855worker1 # [ 34.851112] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3856worker1 # [ 35.060140] nix-daemon[831]: accepted connection from pid 889, user nix-grpc-daemon (trusted)3857worker1 # [ 35.083317] nix-daemon[831]: reaped child process 892, status = succeeded3858worker1 # [ 35.266794] nix-daemon[831]: accepted connection from pid 894, user nix-grpc-daemon (trusted)3859worker1 # [ 35.288974] nix-daemon[831]: reaped child process 897, status = succeeded3860lb # [ 35.388441] niks3-server[1003]: 2026/09/20 12:22:53 INFO Received uploads request method=POST path=/api/pending_closures3861worker1 # [ 35.312855] nix-grpc-daemon[841]: time=2026-09-20T12:22:54.806Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3862worker1 # [ 35.314402] nix-grpc-daemon[841]: time=2026-09-20T12:22:54.806Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3863lb # [ 35.421762] niks3-server[1003]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3864lb # [ 35.437633] niks3-server[1003]: 2026/09/20 12:22:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3865worker1 # [ 35.357050] nix-grpc-daemon[841]: time=2026-09-20T12:22:54.850Z level=INFO msg="Uploading 1 narinfos"3866lb # [ 35.451019] niks3-server[1003]: 2026/09/20 12:22:53 INFO Signed narinfos id=3 count=13867lb # [ 35.457671] niks3-server[1003]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3868lb # [ 35.466669] niks3-server[1003]: 2026/09/20 12:22:53 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3869worker1 # [ 35.384599] nix-grpc-daemon[841]: time=2026-09-20T12:22:54.878Z level=INFO msg="Upload complete. (515ms)"3870lb # [ 35.474233] niks3-server[1003]: 2026/09/20 12:22:53 INFO Completed upload id=33871lb # [ 35.478296] niks3-server[1003]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3872worker1 # [ 35.396084] nix-grpc-daemon[775]: ts=2026-09-20T12:22:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=0 paths=1 nar_bytes_in=6243873worker1 # [ 35.407909] nix-grpc-daemon[775]: ts=2026-09-20T12:22:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592463874worker1 # [ 35.419293] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3875worker1 # [ 35.421963] nix-daemon[831]: reaped child process 887, status = succeeded3876client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3877client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3878worker1 # [ 35.436756] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3879worker1 # [ 36.258415] nix-daemon[831]: reaped child process 901, status = succeeded3880client # farm-b> LOG-farm-b-t13881worker1 # [ 36.420639] nix-daemon[831]: accepted connection from pid 916, user nix-grpc-daemon (trusted)3882worker1 # [ 36.441691] nix-daemon[831]: reaped child process 919, status = succeeded3883lb # [ 36.542435] niks3-server[1003]: 2026/09/20 12:22:55 INFO Received uploads request method=POST path=/api/pending_closures3884worker1 # [ 36.466131] nix-grpc-daemon[841]: time=2026-09-20T12:22:55.959Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3885worker1 # [ 36.467652] nix-grpc-daemon[841]: time=2026-09-20T12:22:55.959Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3886lb # [ 36.575284] niks3-server[1003]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3887lb # [ 36.591232] niks3-server[1003]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3888lb # [ 36.607207] niks3-server[1003]: 2026/09/20 12:22:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3889worker1 # [ 36.524512] nix-grpc-daemon[841]: time=2026-09-20T12:22:56.018Z level=INFO msg="Uploading 1 narinfos"3890lb # [ 36.618207] niks3-server[1003]: 2026/09/20 12:22:55 INFO Signed narinfos id=4 count=13891lb # [ 36.625027] niks3-server[1003]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3892lb # [ 36.631062] niks3-server[1003]: 2026/09/20 12:22:55 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3893lb # [ 36.641171] niks3-server[1003]: 2026/09/20 12:22:55 INFO Completed upload id=43894worker1 # [ 36.553395] nix-grpc-daemon[841]: time=2026-09-20T12:22:56.047Z level=INFO msg="Upload complete. (306ms)"3895lb # [ 36.643958] niks3-server[1003]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3896worker1 # [ 36.565275] nix-grpc-daemon[775]: ts=2026-09-20T12:22:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13897worker2 # [ 36.635762] nix-grpc-daemon[776]: ts=2026-09-20T12:22:56Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03898worker2 # [ 36.642155] nix-grpc-daemon[776]: ts=2026-09-20T12:22:56Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13899worker1 # [ 36.584852] nix-daemon[831]: reaped child process 899, status = succeeded3900worker1 # [ 36.616410] nix-grpc-daemon[775]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592463901worker1 # [ 36.628713] nix-grpc-daemon[775]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592463902worker1 # [ 36.640801] nix-grpc-daemon[841]: time=2026-09-20T12:22:56.134Z level=INFO msg="All 2 paths already cached"3903client # copying 1 paths to 'lb:50051'...3904client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3905worker1 # [ 36.652003] nix-grpc-daemon[775]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592463906worker1 # [ 36.670708] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3907worker1 # [ 36.878563] nix-daemon[831]: accepted connection from pid 923, user nix-grpc-daemon (trusted)3908worker1 # [ 36.898022] nix-daemon[831]: reaped child process 926, status = succeeded3909worker1 # [ 37.076605] nix-daemon[831]: accepted connection from pid 928, user nix-grpc-daemon (trusted)3910worker1 # [ 37.099299] nix-daemon[831]: reaped child process 931, status = succeeded3911lb # [ 37.202290] niks3-server[1003]: 2026/09/20 12:22:55 INFO Received uploads request method=POST path=/api/pending_closures3912worker1 # [ 37.124546] nix-grpc-daemon[841]: time=2026-09-20T12:22:56.618Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3913worker1 # [ 37.126946] nix-grpc-daemon[841]: time=2026-09-20T12:22:56.620Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3914lb # [ 37.235092] niks3-server[1003]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3915worker1 # [ 37.161839] nix-grpc-daemon[841]: time=2026-09-20T12:22:56.655Z level=INFO msg="Uploading 1 narinfos"3916lb # [ 37.251821] niks3-server[1003]: 2026/09/20 12:22:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3917lb # [ 37.263398] niks3-server[1003]: 2026/09/20 12:22:55 INFO Signed narinfos id=5 count=13918lb # [ 37.269787] niks3-server[1003]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3919worker1 # [ 37.191638] nix-grpc-daemon[841]: time=2026-09-20T12:22:56.685Z level=INFO msg="Upload complete. (502ms)"3920lb # [ 37.279935] niks3-server[1003]: 2026/09/20 12:22:55 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3921worker1 # [ 37.196228] nix-grpc-daemon[775]: ts=2026-09-20T12:22:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=0 paths=1 nar_bytes_in=7523922lb # [ 37.285338] niks3-server[1003]: 2026/09/20 12:22:55 INFO Completed upload id=53923lb # [ 37.288293] niks3-server[1003]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3924worker1 # [ 37.204059] nix-daemon[831]: reaped child process 921, status = succeeded3925worker1 # [ 37.206500] nix-grpc-daemon[775]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592463926worker1 # [ 37.211952] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3927worker1 # [ 37.220444] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3928client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3929client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3930client # farm-top> LOG-farm-top-t13931worker1 # [ 38.264180] nix-daemon[831]: reaped child process 936, status = succeeded3932worker1 # [ 38.448130] nix-daemon[831]: accepted connection from pid 951, user nix-grpc-daemon (trusted)3933worker1 # [ 38.467826] nix-daemon[831]: reaped child process 954, status = succeeded3934lb # [ 38.570022] niks3-server[1003]: 2026/09/20 12:22:57 INFO Received uploads request method=POST path=/api/pending_closures3935worker1 # [ 38.495590] nix-grpc-daemon[841]: time=2026-09-20T12:22:57.986Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3936worker1 # [ 38.498125] nix-grpc-daemon[841]: time=2026-09-20T12:22:57.987Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3937lb # [ 38.615816] niks3-server[1003]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3938lb # [ 38.627437] niks3-server[1003]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3939lb # [ 38.639585] niks3-server[1003]: 2026/09/20 12:22:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3940worker1 # [ 38.557957] nix-grpc-daemon[841]: time=2026-09-20T12:22:58.051Z level=INFO msg="Uploading 1 narinfos"3941lb # [ 38.648221] niks3-server[1003]: 2026/09/20 12:22:57 INFO Signed narinfos id=6 count=13942lb # [ 38.653618] niks3-server[1003]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3943lb # [ 38.663785] niks3-server[1003]: 2026/09/20 12:22:57 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3944lb # [ 38.672122] niks3-server[1003]: 2026/09/20 12:22:57 INFO Completed upload id=63945worker1 # [ 38.583382] nix-grpc-daemon[841]: time=2026-09-20T12:22:58.077Z level=INFO msg="Upload complete. (352ms)"3946lb # [ 38.674685] niks3-server[1003]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3947worker1 # [ 38.597261] nix-grpc-daemon[775]: ts=2026-09-20T12:22:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13948worker1 # [ 38.614999] nix-daemon[831]: reaped child process 934, status = succeeded3949client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 6.82 seconds)3950client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3951client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.25 seconds)3952client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3953client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds)3954client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3955client # copying 3 paths...3956client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3957client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3958client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3959client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)3960(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.52 seconds)3961subtest: repeat is answered Cached by the scheduler without building3962worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3963worker1 # finding garbage collector roots...3964worker1 # deleting specified paths...3965worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3966worker1 # deleting unused links...3967worker1 # note: hard linking is currently saving 0.0 KiB3968worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)3969worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3970worker2 # finding garbage collector roots...3971worker2 # deleting specified paths...3972worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3973worker2 # deleting unused links...3974worker2 # note: hard linking is currently saving 0.0 KiB3975worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.37 seconds)3976client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23977worker1 # [ 40.276823] nix-grpc-daemon[775]: ts=2026-09-20T12:22:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592463978client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):3979client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3980worker2 # [ 40.362863] nix-grpc-daemon[776]: ts=2026-09-20T12:22:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403623981worker2 # [ 40.382388] systemd[1]: Started Nix Daemon.3982worker2 # [ 40.641320] nix-daemon[861]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3983worker2 # [ 40.671128] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 1/5)3984worker2 # [ 40.762054] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 2/5)3985worker2 # [ 40.827255] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 235 ms (attempt 3/5)3986worker2 # [ 41.066864] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 429 ms (attempt 4/5)3987worker2 # [ 41.505683] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3988worker2 # [ 41.546040] nix-grpc-daemon[776]: ts=2026-09-20T12:23:01Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=13989client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 1.54 seconds)3990client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3991client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds)3992lb: must succeed: curl -sf localhost:9901/clusters3993lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3994lb: must succeed: curl -sf localhost:9901/clusters3995lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3996worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3997worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)3998(finished: subtest: repeat is answered Cached by the scheduler without building, in 2.78 seconds)3999subtest: inputs already in the cache are not sent to the scheduler4000lb: must succeed: curl -sf localhost:9901/clusters4001lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4002lb: must succeed: curl -sf localhost:9901/clusters4003lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4004worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4005worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4006client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24007lb # [ 42.434204] envoy[920]: conn peer=[2001:db8:1::1]:45094 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9506 tx=3844 ms=65764008lb # [ 42.439639] envoy[920]: conn peer=[2001:db8:1::1]:45106 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1010 tx=521 ms=12294009client # don't know how to build these paths:4010client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4011worker2 # [ 42.643100] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:403624012worker2 # [ 42.646985] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403624013worker2 # [ 42.658089] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04014worker2 # [ 42.660757] nix-grpc-daemon[776]: ts=2026-09-20T12:23:02Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14015worker1 # [ 42.642480] nix-grpc-daemon[775]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592464016worker1 # [ 42.660837] nix-grpc-daemon[775]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592464017worker1 # [ 42.676988] nix-grpc-daemon[841]: time=2026-09-20T12:23:02.170Z level=INFO msg="All 2 paths already cached"4018client # copying 1 paths to 'lb:50051'...4019client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4020worker1 # [ 42.688113] nix-grpc-daemon[775]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592464021worker1 # [ 42.705259] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4022worker1 # [ 42.915049] nix-daemon[831]: accepted connection from pid 972, user nix-grpc-daemon (trusted)4023worker1 # [ 42.938245] nix-daemon[831]: reaped child process 975, status = succeeded4024worker1 # [ 43.119364] nix-daemon[831]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4025worker1 # [ 43.139525] nix-daemon[831]: reaped child process 980, status = succeeded4026lb # [ 43.241419] niks3-server[1003]: 2026/09/20 12:23:01 INFO Received uploads request method=POST path=/api/pending_closures4027worker1 # [ 43.163583] nix-grpc-daemon[841]: time=2026-09-20T12:23:02.657Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4028worker1 # [ 43.165304] nix-grpc-daemon[841]: time=2026-09-20T12:23:02.657Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4029lb # [ 43.270604] niks3-server[1003]: 2026/09/20 12:23:01 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4030lb # [ 43.286855] niks3-server[1003]: 2026/09/20 12:23:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4031worker1 # [ 43.204702] nix-grpc-daemon[841]: time=2026-09-20T12:23:02.698Z level=INFO msg="Uploading 1 narinfos"4032lb # [ 43.299783] niks3-server[1003]: 2026/09/20 12:23:01 INFO Signed narinfos id=7 count=14033lb # [ 43.308936] niks3-server[1003]: 2026/09/20 12:23:01 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4034worker1 # [ 43.226311] nix-grpc-daemon[841]: time=2026-09-20T12:23:02.720Z level=INFO msg="Upload complete. (501ms)"4035lb # [ 43.315235] niks3-server[1003]: 2026/09/20 12:23:01 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4036lb # [ 43.319659] niks3-server[1003]: 2026/09/20 12:23:01 INFO Completed upload id=74037worker1 # [ 43.232486] nix-grpc-daemon[775]: ts=2026-09-20T12:23:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=0 paths=1 nar_bytes_in=7524038lb # [ 43.323050] niks3-server[1003]: 2026/09/20 12:23:01 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4039worker1 # [ 43.243669] nix-grpc-daemon[775]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592464040worker1 # [ 43.248801] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4041worker1 # [ 43.252748] nix-daemon[831]: reaped child process 970, status = succeeded4042client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4043worker1 # [ 43.264133] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4044client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4045client # farm-top> LOG-farm-top-t1b4046worker1 # [ 44.495921] nix-daemon[831]: reaped child process 984, status = succeeded4047worker1 # [ 44.664339] nix-daemon[831]: accepted connection from pid 1000, user nix-grpc-daemon (trusted)4048worker1 # [ 44.685905] nix-daemon[831]: reaped child process 1003, status = succeeded4049lb # [ 44.787235] niks3-server[1003]: 2026/09/20 12:23:03 INFO Received uploads request method=POST path=/api/pending_closures4050worker1 # [ 44.724451] nix-grpc-daemon[841]: time=2026-09-20T12:23:04.216Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4051worker1 # [ 44.726068] nix-grpc-daemon[841]: time=2026-09-20T12:23:04.216Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4052lb # [ 44.857132] niks3-server[1003]: 2026/09/20 12:23:03 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4053worker1 # [ 44.780716] nix-grpc-daemon[841]: time=2026-09-20T12:23:04.274Z level=INFO msg="Uploading 1 narinfos"4054lb # [ 44.876952] niks3-server[1003]: 2026/09/20 12:23:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4055lb # [ 44.889735] niks3-server[1003]: 2026/09/20 12:23:03 INFO Signed narinfos id=8 count=14056lb # [ 44.904410] niks3-server[1003]: 2026/09/20 12:23:03 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4057lb # [ 44.917481] niks3-server[1003]: 2026/09/20 12:23:03 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4058worker1 # [ 44.828704] nix-grpc-daemon[841]: time=2026-09-20T12:23:04.322Z level=INFO msg="Upload complete. (355ms)"4059lb # [ 44.925655] niks3-server[1003]: 2026/09/20 12:23:03 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4060lb # [ 44.931346] niks3-server[1003]: 2026/09/20 12:23:03 INFO Completed upload id=84061worker1 # [ 44.841614] nix-grpc-daemon[775]: ts=2026-09-20T12:23:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14062lb # [ 44.936756] niks3-server[1003]: 2026/09/20 12:23:03 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4063worker1 # [ 44.862950] nix-daemon[831]: reaped child process 982, status = succeeded4064client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.57 seconds)4065client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4066client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds)4067lb: must succeed: curl -sf localhost:9901/clusters4068lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4069lb: must succeed: curl -sf localhost:9901/clusters4070lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4071worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4072worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4073(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.21 seconds)4074subtest: two clients wanting the same drv build it once4075client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4076client # [ 45.525118] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4077client # Running as unit: dedup1.service; invocation ID: ef1779e934f547f8983a883610604d884078client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4079client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4080worker1 # [ 45.661392] nix-grpc-daemon[775]: ts=2026-09-20T12:23:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592464081client # [ 45.790976] nix[883]: don't know how to build these paths:4082client # [ 45.792177] nix[883]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4083worker2 # [ 45.750528] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04084worker2 # [ 45.750921] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14085worker2 # [ 45.763992] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403624086worker2 # [ 45.785822] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403624087client # [ 45.859275] nix[883]: copying 1 paths to 'lb:50051'...4088client # [ 45.861620] nix[883]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4089worker2 # [ 45.802626] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:403624090worker2 # [ 45.819173] nix-daemon[861]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4091worker2 # [ 45.845882] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=info event=niks3_push_started pid=8954092worker2 # [ 46.123282] nix-grpc-daemon[895]: time=2026-09-20T12:23:05.584Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4093worker2 # [ 46.316151] nix-daemon[861]: accepted connection from pid 908, user nix-grpc-daemon (trusted)4094worker2 # [ 46.336356] nix-daemon[861]: reaped child process 911, status = succeeded4095worker2 # [ 46.516136] nix-daemon[861]: accepted connection from pid 913, user nix-grpc-daemon (trusted)4096worker2 # [ 46.535619] nix-daemon[861]: reaped child process 916, status = succeeded4097lb # [ 46.573092] niks3-server[1003]: 2026/09/20 12:23:05 INFO Received uploads request method=POST path=/api/pending_closures4098worker2 # [ 46.562987] nix-grpc-daemon[895]: time=2026-09-20T12:23:06.025Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4099worker2 # [ 46.566704] nix-grpc-daemon[895]: time=2026-09-20T12:23:06.027Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4100lb # [ 46.620303] niks3-server[1003]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4101client # [ 46.650773] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4102worker2 # [ 46.606278] nix-grpc-daemon[895]: time=2026-09-20T12:23:06.068Z level=INFO msg="Uploading 1 narinfos"4103lb # [ 46.633331] niks3-server[1003]: 2026/09/20 12:23:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4104client # Running as unit: dedup2.service; invocation ID: e0d6d59c39ef4452a59253f0b3dff26b4105lb # [ 46.645685] niks3-server[1003]: 2026/09/20 12:23:05 INFO Signed narinfos id=9 count=14106client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds)4107lb # [ 46.651677] niks3-server[1003]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4108lb # [ 46.661252] niks3-server[1003]: 2026/09/20 12:23:05 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4109lb # [ 46.668499] niks3-server[1003]: 2026/09/20 12:23:05 INFO Completed upload id=94110worker2 # [ 46.644610] nix-grpc-daemon[895]: time=2026-09-20T12:23:06.107Z level=INFO msg="Upload complete. (512ms)"4111lb # [ 46.671568] niks3-server[1003]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4112worker2 # [ 46.652365] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=0 paths=1 nar_bytes_in=4324113worker2 # [ 46.668588] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403624114worker2 # [ 46.675474] nix-daemon[861]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4115worker2 # [ 46.680951] nix-daemon[861]: reaped child process 893, status = succeeded4116client # [ 46.748330] nix[883]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4117worker2 # [ 46.695695] nix-daemon[861]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4118worker1 # [ 46.937345] nix-grpc-daemon[775]: ts=2026-09-20T12:23:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592464119client # [ 47.066637] nix[898]: don't know how to build these paths:4120client # [ 47.068970] nix[898]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4121worker2 # [ 47.022598] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04122worker2 # [ 47.036159] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403624123client # [ 47.100567] nix[898]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4124client: must succeed: sleep 24125client: (finished: must succeed: sleep 2, in 2.05 seconds)4126??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4127 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394128client: waiting for success: ! systemctl is-active dedup1 dedup24129??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4130 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394131worker2 # [ 50.344900] nix-daemon[861]: reaped child process 920, status = succeeded4132worker2 # [ 50.529450] nix-daemon[861]: accepted connection from pid 952, user nix-grpc-daemon (trusted)4133worker2 # [ 50.549704] nix-daemon[861]: reaped child process 955, status = succeeded4134lb # [ 50.586044] niks3-server[1003]: 2026/09/20 12:23:09 INFO Received uploads request method=POST path=/api/pending_closures4135worker2 # [ 50.573053] nix-grpc-daemon[895]: time=2026-09-20T12:23:10.034Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4136worker2 # [ 50.575017] nix-grpc-daemon[895]: time=2026-09-20T12:23:10.034Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4137lb # [ 50.636181] niks3-server[1003]: 2026/09/20 12:23:09 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4138lb # [ 50.647334] niks3-server[1003]: 2026/09/20 12:23:09 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4139lb # [ 50.659643] niks3-server[1003]: 2026/09/20 12:23:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4140worker2 # [ 50.642415] nix-grpc-daemon[895]: time=2026-09-20T12:23:10.103Z level=INFO msg="Uploading 1 narinfos"4141lb # [ 50.668876] niks3-server[1003]: 2026/09/20 12:23:09 INFO Signed narinfos id=10 count=14142lb # [ 50.671309] niks3-server[1003]: 2026/09/20 12:23:09 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4143lb # [ 50.682996] niks3-server[1003]: 2026/09/20 12:23:09 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4144lb # [ 50.693154] niks3-server[1003]: 2026/09/20 12:23:09 INFO Completed upload id=104145worker2 # [ 50.669687] nix-grpc-daemon[895]: time=2026-09-20T12:23:10.132Z level=INFO msg="Upload complete. (360ms)"4146lb # [ 50.697109] niks3-server[1003]: 2026/09/20 12:23:09 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4147worker2 # [ 50.685460] nix-grpc-daemon[776]: ts=2026-09-20T12:23:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14148worker2 # [ 50.703517] nix-grpc-daemon[776]: ts=2026-09-20T12:23:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14149worker2 # [ 50.710038] nix-daemon[861]: reaped child process 918, status = succeeded4150client # [ 50.783130] systemd[1]: dedup1.service: Deactivated successfully.4151client # [ 50.789633] systemd[1]: dedup1.service: Consumed 160ms CPU time over 5.263s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.4152client # [ 50.831107] systemd[1]: dedup2.service: Deactivated successfully.4153client # [ 50.833621] systemd[1]: dedup2.service: Consumed 193ms CPU time over 4.183s wall clock time, 31M memory peak, 7.3K incoming IP traffic, 6.3K outgoing IP traffic.4154client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds)4155client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4156client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4157worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4158worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4159worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4160worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4161worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4162worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4163worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4164worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4165(finished: subtest: two clients wanting the same drv build it once, in 6.30 seconds)4166subtest: build hook: nix-daemon with builders = grpc://lb4167client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4168client # [ 51.982632] systemd[1]: Started Nix Daemon.4169client # [ 52.174360] nix-daemon[940]: accepted connection from pid 937, user root (trusted)4170worker2 # [ 52.320876] nix-grpc-daemon[776]: ts=2026-09-20T12:23:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:403624171worker1 # [ 52.271979] nix-grpc-daemon[775]: ts=2026-09-20T12:23:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592464172worker2 # [ 52.349105] nix-grpc-daemon[776]: ts=2026-09-20T12:23:11Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04173worker2 # [ 52.355783] nix-grpc-daemon[776]: ts=2026-09-20T12:23:11Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14174worker1 # [ 52.332761] nix-grpc-daemon[775]: ts=2026-09-20T12:23:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592464175lb # [ 52.434874] envoy[920]: conn peer=[2001:db8:1::1]:35078 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4185 tx=1727 ms=22804176lb # [ 52.435225] envoy[920]: conn peer=[2001:db8:1::1]:35080 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1374 ms=49714177lb # [ 52.435356] envoy[920]: conn peer=[2001:db8:1::1]:35096 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=37554178worker1 # [ 52.364153] nix-grpc-daemon[775]: ts=2026-09-20T12:23:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592464179worker1 # [ 52.381590] nix-grpc-daemon[775]: ts=2026-09-20T12:23:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592464180worker1 # [ 52.397644] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4181worker1 # [ 52.610803] nix-daemon[831]: accepted connection from pid 1029, user nix-grpc-daemon (trusted)4182worker1 # [ 52.632563] nix-daemon[831]: reaped child process 1032, status = succeeded4183worker1 # [ 52.805525] nix-daemon[831]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4184worker1 # [ 52.825215] nix-daemon[831]: reaped child process 1037, status = succeeded4185lb # [ 52.929767] niks3-server[1003]: 2026/09/20 12:23:11 INFO Received uploads request method=POST path=/api/pending_closures4186worker1 # [ 52.849387] nix-grpc-daemon[841]: time=2026-09-20T12:23:12.342Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4187worker1 # [ 52.850952] nix-grpc-daemon[841]: time=2026-09-20T12:23:12.342Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4188lb # [ 52.958604] niks3-server[1003]: 2026/09/20 12:23:11 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4189worker1 # [ 52.886267] nix-grpc-daemon[841]: time=2026-09-20T12:23:12.380Z level=INFO msg="Uploading 1 narinfos"4190lb # [ 52.976276] niks3-server[1003]: 2026/09/20 12:23:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4191lb # [ 52.986937] niks3-server[1003]: 2026/09/20 12:23:11 INFO Signed narinfos id=11 count=14192lb # [ 52.993360] niks3-server[1003]: 2026/09/20 12:23:11 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4193lb # [ 53.004469] niks3-server[1003]: 2026/09/20 12:23:11 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4194lb # [ 53.010902] niks3-server[1003]: 2026/09/20 12:23:11 INFO Completed upload id=114195worker1 # [ 52.922932] nix-grpc-daemon[841]: time=2026-09-20T12:23:12.417Z level=INFO msg="Upload complete. (507ms)"4196lb # [ 53.014062] niks3-server[1003]: 2026/09/20 12:23:11 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4197worker1 # [ 52.932291] nix-grpc-daemon[775]: ts=2026-09-20T12:23:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=0 paths=1 nar_bytes_in=5124198worker1 # [ 52.941177] nix-grpc-daemon[775]: ts=2026-09-20T12:23:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592464199worker1 # [ 52.953650] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4200worker1 # [ 52.959136] nix-daemon[831]: reaped child process 1027, status = succeeded4201worker1 # [ 52.971049] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4202worker1 # [ 54.021385] nix-daemon[831]: reaped child process 1041, status = succeeded4203worker1 # [ 54.202839] nix-daemon[831]: accepted connection from pid 1056, user nix-grpc-daemon (trusted)4204worker1 # [ 54.222803] nix-daemon[831]: reaped child process 1059, status = succeeded4205lb # [ 54.327451] niks3-server[1003]: 2026/09/20 12:23:12 INFO Received uploads request method=POST path=/api/pending_closures4206worker1 # [ 54.252498] nix-grpc-daemon[841]: time=2026-09-20T12:23:13.743Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4207worker1 # [ 54.254028] nix-grpc-daemon[841]: time=2026-09-20T12:23:13.743Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4208lb # [ 54.364592] niks3-server[1003]: 2026/09/20 12:23:12 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4209lb # [ 54.384232] niks3-server[1003]: 2026/09/20 12:23:12 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4210worker1 # [ 54.310067] nix-grpc-daemon[841]: time=2026-09-20T12:23:13.803Z level=INFO msg="Uploading 1 narinfos"4211lb # [ 54.398806] niks3-server[1003]: 2026/09/20 12:23:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4212lb # [ 54.409869] niks3-server[1003]: 2026/09/20 12:23:12 INFO Signed narinfos id=12 count=14213lb # [ 54.415669] niks3-server[1003]: 2026/09/20 12:23:12 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4214lb # [ 54.422581] niks3-server[1003]: 2026/09/20 12:23:12 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4215lb # [ 54.429230] niks3-server[1003]: 2026/09/20 12:23:12 INFO Completed upload id=124216worker1 # [ 54.340815] nix-grpc-daemon[841]: time=2026-09-20T12:23:13.834Z level=INFO msg="Upload complete. (355ms)"4217lb # [ 54.431712] niks3-server[1003]: 2026/09/20 12:23:12 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4218worker1 # [ 54.353312] nix-grpc-daemon[775]: ts=2026-09-20T12:23:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14219worker1 # [ 54.374314] nix-grpc-daemon[775]: ts=2026-09-20T12:23:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:592464220worker1 # [ 54.379398] nix-daemon[831]: reaped child process 1039, status = succeeded4221worker2 # [ 54.456940] nix-grpc-daemon[776]: ts=2026-09-20T12:23:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:403624222worker2 # [ 54.473516] nix-grpc-daemon[776]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4223worker2 # [ 54.496502] nix-grpc-daemon[776]: ts=2026-09-20T12:23:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=0 paths=1 nar_bytes_out=1284224worker1 # [ 54.748518] nix-grpc-daemon[775]: ts=2026-09-20T12:23:14Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:592464225worker2 # [ 54.816518] nix-grpc-daemon[776]: ts=2026-09-20T12:23:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403624226worker2 # [ 54.829612] nix-grpc-daemon[895]: time=2026-09-20T12:23:14.291Z level=INFO msg="All 1 paths already cached"4227worker2 # [ 54.848273] nix-grpc-daemon[776]: ts=2026-09-20T12:23:14Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04228worker2 # [ 54.854607] nix-grpc-daemon[776]: ts=2026-09-20T12:23:14Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14229worker1 # [ 54.793904] nix-grpc-daemon[775]: ts=2026-09-20T12:23:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592464230worker1 # [ 54.810230] nix-grpc-daemon[775]: ts=2026-09-20T12:23:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592464231worker1 # [ 54.824738] nix-grpc-daemon[841]: time=2026-09-20T12:23:14.318Z level=INFO msg="All 1 paths already cached"4232worker1 # [ 54.833735] nix-grpc-daemon[775]: ts=2026-09-20T12:23:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592464233worker1 # [ 54.848239] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4234worker1 # [ 55.060967] nix-daemon[831]: accepted connection from pid 1063, user nix-grpc-daemon (trusted)4235worker1 # [ 55.081124] nix-daemon[831]: reaped child process 1066, status = succeeded4236worker1 # [ 55.254117] nix-daemon[831]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4237worker1 # [ 55.273345] nix-daemon[831]: reaped child process 1071, status = succeeded4238lb # [ 55.373263] niks3-server[1003]: 2026/09/20 12:23:13 INFO Received uploads request method=POST path=/api/pending_closures4239worker1 # [ 55.351851] nix-grpc-daemon[841]: time=2026-09-20T12:23:14.844Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4240worker1 # [ 55.354499] nix-grpc-daemon[841]: time=2026-09-20T12:23:14.845Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4241lb # [ 55.459352] niks3-server[1003]: 2026/09/20 12:23:13 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4242worker1 # [ 55.387208] nix-grpc-daemon[841]: time=2026-09-20T12:23:14.880Z level=INFO msg="Uploading 1 narinfos"4243lb # [ 55.474613] niks3-server[1003]: 2026/09/20 12:23:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4244lb # [ 55.487721] niks3-server[1003]: 2026/09/20 12:23:13 INFO Signed narinfos id=13 count=14245lb # [ 55.495831] niks3-server[1003]: 2026/09/20 12:23:13 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4246lb # [ 55.504387] niks3-server[1003]: 2026/09/20 12:23:14 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4247lb # [ 55.513565] niks3-server[1003]: 2026/09/20 12:23:14 INFO Completed upload id=134248worker1 # [ 55.425480] nix-grpc-daemon[841]: time=2026-09-20T12:23:14.919Z level=INFO msg="Upload complete. (559ms)"4249lb # [ 55.517161] niks3-server[1003]: 2026/09/20 12:23:14 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4250worker1 # [ 55.437315] nix-grpc-daemon[775]: ts=2026-09-20T12:23:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=0 paths=1 nar_bytes_in=6244251worker1 # [ 55.461760] nix-grpc-daemon[775]: ts=2026-09-20T12:23:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592464252worker1 # [ 55.471611] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4253worker1 # [ 55.477186] nix-daemon[831]: reaped child process 1061, status = succeeded4254worker1 # [ 55.495054] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4255worker1 # [ 56.950719] nix-daemon[831]: reaped child process 1075, status = succeeded4256worker1 # [ 57.126722] nix-daemon[831]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4257worker1 # [ 57.146613] nix-daemon[831]: reaped child process 1093, status = succeeded4258lb # [ 57.246569] niks3-server[1003]: 2026/09/20 12:23:15 INFO Received uploads request method=POST path=/api/pending_closures4259worker1 # [ 57.170499] nix-grpc-daemon[841]: time=2026-09-20T12:23:16.662Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4260worker1 # [ 57.172507] nix-grpc-daemon[841]: time=2026-09-20T12:23:16.663Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4261lb # [ 57.289066] niks3-server[1003]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4262lb # [ 57.300397] niks3-server[1003]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4263worker1 # [ 57.225230] nix-grpc-daemon[841]: time=2026-09-20T12:23:16.718Z level=INFO msg="Uploading 1 narinfos"4264lb # [ 57.314211] niks3-server[1003]: 2026/09/20 12:23:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4265lb # [ 57.322656] niks3-server[1003]: 2026/09/20 12:23:15 INFO Signed narinfos id=14 count=14266lb # [ 57.328588] niks3-server[1003]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4267lb # [ 57.336401] niks3-server[1003]: 2026/09/20 12:23:15 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4268lb # [ 57.344978] niks3-server[1003]: 2026/09/20 12:23:15 INFO Completed upload id=144269worker1 # [ 57.257082] nix-grpc-daemon[841]: time=2026-09-20T12:23:16.751Z level=INFO msg="Upload complete. (347ms)"4270lb # [ 57.348659] niks3-server[1003]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4271worker1 # [ 57.269318] nix-grpc-daemon[775]: ts=2026-09-20T12:23:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14272worker1 # [ 57.292531] nix-grpc-daemon[775]: ts=2026-09-20T12:23:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:592464273worker1 # [ 57.297915] nix-daemon[831]: reaped child process 1073, status = succeeded4274worker1 # [ 57.311525] nix-grpc-daemon[775]: ts=2026-09-20T12:23:16Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:592464275worker1 # [ 57.318569] nix-grpc-daemon[775]: ts=2026-09-20T12:23:16Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=0 paths=1 nar_bytes_out=1764276worker2 # [ 57.697085] nix-grpc-daemon[776]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:403624277worker1 # [ 57.637280] nix-grpc-daemon[775]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592464278worker1 # [ 57.753692] nix-grpc-daemon[841]: time=2026-09-20T12:23:17.247Z level=INFO msg="All 2 paths already cached"4279worker2 # [ 57.845829] nix-grpc-daemon[776]: ts=2026-09-20T12:23:17Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04280worker2 # [ 57.852849] nix-grpc-daemon[776]: ts=2026-09-20T12:23:17Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14281worker1 # [ 57.795659] nix-grpc-daemon[775]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592464282worker1 # [ 57.815382] nix-grpc-daemon[775]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592464283worker1 # [ 57.836723] nix-grpc-daemon[841]: time=2026-09-20T12:23:17.330Z level=INFO msg="All 2 paths already cached"4284worker1 # [ 57.849071] nix-grpc-daemon[775]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592464285worker1 # [ 57.864470] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4286worker1 # [ 58.075938] nix-daemon[831]: accepted connection from pid 1097, user nix-grpc-daemon (trusted)4287worker1 # [ 58.097512] nix-daemon[831]: reaped child process 1100, status = succeeded4288worker1 # [ 58.274253] nix-daemon[831]: accepted connection from pid 1102, user nix-grpc-daemon (trusted)4289worker1 # [ 58.293653] nix-daemon[831]: reaped child process 1105, status = succeeded4290lb # [ 58.393563] niks3-server[1003]: 2026/09/20 12:23:16 INFO Received uploads request method=POST path=/api/pending_closures4291worker1 # [ 58.316567] nix-grpc-daemon[841]: time=2026-09-20T12:23:17.809Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4292worker1 # [ 58.318068] nix-grpc-daemon[841]: time=2026-09-20T12:23:17.810Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4293lb # [ 58.425385] niks3-server[1003]: 2026/09/20 12:23:16 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4294worker1 # [ 58.352914] nix-grpc-daemon[841]: time=2026-09-20T12:23:17.846Z level=INFO msg="Uploading 1 narinfos"4295lb # [ 58.440672] niks3-server[1003]: 2026/09/20 12:23:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4296lb # [ 58.454431] niks3-server[1003]: 2026/09/20 12:23:16 INFO Signed narinfos id=15 count=14297lb # [ 58.461677] niks3-server[1003]: 2026/09/20 12:23:16 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4298lb # [ 58.471467] niks3-server[1003]: 2026/09/20 12:23:16 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4299lb # [ 58.479052] niks3-server[1003]: 2026/09/20 12:23:16 INFO Completed upload id=154300worker1 # [ 58.391142] nix-grpc-daemon[841]: time=2026-09-20T12:23:17.885Z level=INFO msg="Upload complete. (505ms)"4301lb # [ 58.481981] niks3-server[1003]: 2026/09/20 12:23:16 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4302worker1 # [ 58.401045] nix-grpc-daemon[775]: ts=2026-09-20T12:23:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=0 paths=1 nar_bytes_in=7524303worker1 # [ 58.416520] nix-grpc-daemon[775]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592464304worker1 # [ 58.423459] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4305worker1 # [ 58.429154] nix-daemon[831]: reaped child process 1095, status = succeeded4306worker1 # [ 58.442294] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4307worker1 # [ 59.499136] nix-daemon[831]: reaped child process 1109, status = succeeded4308worker1 # [ 59.692181] nix-daemon[831]: accepted connection from pid 1124, user nix-grpc-daemon (trusted)4309worker1 # [ 59.713028] nix-daemon[831]: reaped child process 1127, status = succeeded4310lb # [ 59.817335] niks3-server[1003]: 2026/09/20 12:23:18 INFO Received uploads request method=POST path=/api/pending_closures4311worker1 # [ 59.744542] nix-grpc-daemon[841]: time=2026-09-20T12:23:19.234Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4312worker1 # [ 59.746408] nix-grpc-daemon[841]: time=2026-09-20T12:23:19.234Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4313lb # [ 59.861368] niks3-server[1003]: 2026/09/20 12:23:18 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4314lb # [ 59.875085] niks3-server[1003]: 2026/09/20 12:23:18 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4315lb # [ 59.892466] niks3-server[1003]: 2026/09/20 12:23:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4316worker1 # [ 59.811275] nix-grpc-daemon[841]: time=2026-09-20T12:23:19.304Z level=INFO msg="Uploading 1 narinfos"4317lb # [ 59.904966] niks3-server[1003]: 2026/09/20 12:23:18 INFO Signed narinfos id=16 count=14318lb # [ 59.911634] niks3-server[1003]: 2026/09/20 12:23:18 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4319lb # [ 59.919324] niks3-server[1003]: 2026/09/20 12:23:18 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4320lb # [ 59.933936] niks3-server[1003]: 2026/09/20 12:23:18 INFO Completed upload id=164321worker1 # [ 59.846137] nix-grpc-daemon[841]: time=2026-09-20T12:23:19.340Z level=INFO msg="Upload complete. (386ms)"4322lb # [ 59.936990] niks3-server[1003]: 2026/09/20 12:23:18 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4323worker1 # [ 59.857440] nix-grpc-daemon[775]: ts=2026-09-20T12:23:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14324worker1 # [ 59.880122] nix-daemon[831]: reaped child process 1107, status = succeeded4325worker2 # [ 59.971704] nix-grpc-daemon[776]: ts=2026-09-20T12:23:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:403624326worker2 # [ 59.996385] nix-grpc-daemon[776]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4327worker2 # [ 60.018581] nix-grpc-daemon[776]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4328worker2 # [ 60.067362] nix-grpc-daemon[776]: ts=2026-09-20T12:23:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:403624329worker2 # [ 60.073237] nix-grpc-daemon[776]: ts=2026-09-20T12:23:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=0 paths=1 nar_bytes_out=2324330client # [ 60.263438] nix-daemon[940]: reaped child process 942, status = succeeded4331client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.53 seconds)4332client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4333client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4334client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4335client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4336client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4337client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4338(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.66 seconds)4339subtest: an input only one worker has still reaches the builder4340client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4341client # this derivation will be built:4342client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4343client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4344client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.61 seconds)4345client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4346client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.25 seconds)4347worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4348worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds)4349worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4350worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4351client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24352client # [ 61.805561] nix-daemon[940]: accepted connection from pid 1020, user root (trusted)4353client # this derivation will be built:4354client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4355worker1 # [ 61.892652] nix-grpc-daemon[775]: ts=2026-09-20T12:23:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:592464356client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4357worker2 # [ 61.961769] nix-grpc-daemon[776]: ts=2026-09-20T12:23:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403624358client # copying 1 paths...4359client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4360worker2 # [ 61.978359] nix-grpc-daemon[776]: ts=2026-09-20T12:23:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:403624361worker2 # [ 61.994626] nix-daemon[861]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4362worker2 # [ 62.220385] nix-daemon[861]: accepted connection from pid 980, user nix-grpc-daemon (trusted)4363worker2 # [ 62.243069] nix-daemon[861]: reaped child process 983, status = succeeded4364lb # [ 62.279037] niks3-server[1003]: 2026/09/20 12:23:20 INFO Received uploads request method=POST path=/api/pending_closures4365worker2 # [ 62.264969] nix-grpc-daemon[895]: time=2026-09-20T12:23:21.726Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4366worker2 # [ 62.266652] nix-grpc-daemon[895]: time=2026-09-20T12:23:21.726Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4367lb # [ 62.309439] niks3-server[1003]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4368worker2 # [ 62.297558] nix-grpc-daemon[895]: time=2026-09-20T12:23:21.759Z level=INFO msg="Uploading 1 narinfos"4369lb # [ 62.323700] niks3-server[1003]: 2026/09/20 12:23:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4370lb # [ 62.336231] niks3-server[1003]: 2026/09/20 12:23:20 INFO Signed narinfos id=17 count=14371lb # [ 62.338968] niks3-server[1003]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4372lb # [ 62.348205] niks3-server[1003]: 2026/09/20 12:23:20 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4373lb # [ 62.356553] niks3-server[1003]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4374lb # [ 62.360845] niks3-server[1003]: 2026/09/20 12:23:20 INFO Completed upload id=174375worker2 # [ 62.337697] nix-grpc-daemon[895]: time=2026-09-20T12:23:21.800Z level=INFO msg="Upload complete. (323ms)"4376worker2 # [ 62.348355] nix-grpc-daemon[776]: ts=2026-09-20T12:23:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=0 paths=1 nar_bytes_in=1204377worker2 # [ 62.365391] nix-daemon[861]: reaped child process 978, status = succeeded4378worker2 # [ 62.370608] nix-grpc-daemon[776]: ts=2026-09-20T12:23:21Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04379worker2 # [ 62.375935] nix-grpc-daemon[776]: ts=2026-09-20T12:23:21Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14380lb # [ 62.435777] envoy[920]: conn peer=[2001:db8:1::1]:47350 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3446 tx=1680 ms=22384381lb # [ 62.441943] envoy[920]: conn peer=[2001:db8:1::1]:47366 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=1074382lb # [ 62.448309] envoy[920]: conn peer=[2001:db8:1::1]:47368 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3900 tx=1877 ms=26314383worker2 # [ 62.424704] nix-grpc-daemon[776]: ts=2026-09-20T12:23:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403624384lb # [ 62.453604] envoy[920]: conn peer=[2001:db8:1::1]:47372 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=764385lb # [ 62.461771] envoy[920]: conn peer=[2001:db8:1::1]:47384 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=684386lb # [ 62.468189] envoy[920]: conn peer=[2001:db8:1::1]:47376 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4356 tx=2240 ms=24354387worker2 # [ 62.453428] nix-grpc-daemon[776]: ts=2026-09-20T12:23:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403624388client # copying 2 paths to 'lb:50051'...4389worker2 # [ 62.472975] nix-grpc-daemon[776]: ts=2026-09-20T12:23:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:403624390client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4391client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4392worker2 # [ 62.497873] nix-daemon[861]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4393worker2 # [ 62.711281] nix-daemon[861]: accepted connection from pid 989, user nix-grpc-daemon (trusted)4394worker2 # [ 62.733126] nix-daemon[861]: reaped child process 992, status = succeeded4395worker2 # [ 62.909749] nix-daemon[861]: accepted connection from pid 994, user nix-grpc-daemon (trusted)4396worker2 # [ 62.928668] nix-daemon[861]: reaped child process 997, status = succeeded4397lb # [ 62.962973] niks3-server[1003]: 2026/09/20 12:23:21 INFO Received uploads request method=POST path=/api/pending_closures4398lb # [ 62.977113] niks3-server[1003]: 2026/09/20 12:23:21 INFO Received uploads request method=POST path=/api/pending_closures4399worker2 # [ 62.963820] nix-grpc-daemon[895]: time=2026-09-20T12:23:22.425Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4400worker2 # [ 62.965581] nix-grpc-daemon[895]: time=2026-09-20T12:23:22.425Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4401worker2 # [ 62.967274] nix-grpc-daemon[895]: time=2026-09-20T12:23:22.425Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4402lb # [ 63.008718] niks3-server[1003]: 2026/09/20 12:23:21 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4403lb # [ 63.028925] niks3-server[1003]: 2026/09/20 12:23:21 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4404lb # [ 63.040085] niks3-server[1003]: 2026/09/20 12:23:21 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4405lb # [ 63.048556] niks3-server[1003]: 2026/09/20 12:23:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4406lb # [ 63.055955] niks3-server[1003]: 2026/09/20 12:23:21 INFO Signed narinfos id=18 count=14407worker2 # [ 63.032953] nix-grpc-daemon[895]: time=2026-09-20T12:23:22.494Z level=INFO msg="Uploading 3 narinfos"4408lb # [ 63.059246] niks3-server[1003]: 2026/09/20 12:23:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4409lb # [ 63.065518] niks3-server[1003]: 2026/09/20 12:23:21 INFO Signed narinfos id=19 count=24410lb # [ 63.067396] niks3-server[1003]: 2026/09/20 12:23:21 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4411lb # [ 63.084652] niks3-server[1003]: 2026/09/20 12:23:21 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4412lb # [ 63.091650] niks3-server[1003]: 2026/09/20 12:23:21 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4413lb # [ 63.098255] niks3-server[1003]: 2026/09/20 12:23:21 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4414lb # [ 63.102218] niks3-server[1003]: 2026/09/20 12:23:21 INFO Completed upload id=184415lb # [ 63.104792] niks3-server[1003]: 2026/09/20 12:23:21 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4416lb # [ 63.108888] niks3-server[1003]: 2026/09/20 12:23:21 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4417lb # [ 63.111473] niks3-server[1003]: 2026/09/20 12:23:21 INFO Completed upload id=194418worker2 # [ 63.085047] nix-grpc-daemon[895]: time=2026-09-20T12:23:22.547Z level=INFO msg="Upload complete. (567ms)"4419worker2 # [ 63.100657] nix-grpc-daemon[776]: ts=2026-09-20T12:23:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=0 paths=2 nar_bytes_in=9844420worker2 # [ 63.112587] nix-grpc-daemon[776]: ts=2026-09-20T12:23:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403624421worker2 # [ 63.123074] nix-daemon[861]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4422worker2 # [ 63.129231] nix-daemon[861]: reaped child process 987, status = succeeded4423client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4424worker2 # [ 63.143150] nix-daemon[861]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4425client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4426worker2 # [ 63.992601] nix-daemon[861]: reaped child process 1001, status = succeeded4427worker2 # [ 64.181886] nix-daemon[861]: accepted connection from pid 1016, user nix-grpc-daemon (trusted)4428worker2 # [ 64.201201] nix-daemon[861]: reaped child process 1019, status = succeeded4429lb # [ 64.237850] niks3-server[1003]: 2026/09/20 12:23:22 INFO Received uploads request method=POST path=/api/pending_closures4430worker2 # [ 64.224486] nix-grpc-daemon[895]: time=2026-09-20T12:23:23.686Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4431lb # [ 64.267725] niks3-server[1003]: 2026/09/20 12:23:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4432worker2 # [ 64.253009] nix-grpc-daemon[895]: time=2026-09-20T12:23:23.715Z level=INFO msg="Uploading 1 narinfos"4433lb # [ 64.282892] niks3-server[1003]: 2026/09/20 12:23:22 INFO Signed narinfos id=20 count=14434lb # [ 64.291110] niks3-server[1003]: 2026/09/20 12:23:22 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4435lb # [ 64.305767] niks3-server[1003]: 2026/09/20 12:23:22 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4436lb # [ 64.310665] niks3-server[1003]: 2026/09/20 12:23:22 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4437worker2 # [ 64.286662] nix-grpc-daemon[895]: time=2026-09-20T12:23:23.749Z level=INFO msg="Upload complete. (329ms)"4438lb # [ 64.314597] niks3-server[1003]: 2026/09/20 12:23:22 INFO Completed upload id=204439lb # [ 64.317323] niks3-server[1003]: 2026/09/20 12:23:22 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4440worker2 # [ 64.301247] nix-grpc-daemon[776]: ts=2026-09-20T12:23:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14441worker2 # [ 64.318120] nix-daemon[861]: reaped child process 999, status = succeeded4442client # copying 1 paths...4443worker1 # [ 64.286713] nix-grpc-daemon[775]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:592464444worker1 # [ 64.303406] nix-grpc-daemon[775]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4445client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4446worker2 # [ 64.420142] nix-grpc-daemon[776]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:403624447worker2 # [ 64.426394] nix-grpc-daemon[776]: ts=2026-09-20T12:23:23Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=0 paths=1 nar_bytes_out=1204448client # [ 64.570755] nix-daemon[940]: reaped child process 1023, status = succeeded4449client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.01 seconds)4450client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24451client # [ 64.799047] nix-daemon[940]: accepted connection from pid 1040, user root (trusted)4452client # this derivation will be built:4453client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4454worker2 # [ 64.938268] nix-grpc-daemon[776]: ts=2026-09-20T12:23:24Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:403624455client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4456worker1 # [ 64.878495] nix-grpc-daemon[775]: ts=2026-09-20T12:23:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592464457worker1 # [ 64.890843] nix-grpc-daemon[841]: time=2026-09-20T12:23:24.384Z level=INFO msg="All 1 paths already cached"4458worker2 # [ 64.973910] nix-grpc-daemon[776]: ts=2026-09-20T12:23:24Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04459worker2 # [ 64.980958] nix-grpc-daemon[776]: ts=2026-09-20T12:23:24Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14460worker1 # [ 64.920007] nix-grpc-daemon[775]: ts=2026-09-20T12:23:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592464461worker1 # [ 64.935508] nix-grpc-daemon[775]: ts=2026-09-20T12:23:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592464462client # copying 1 paths to 'lb:50051'...4463client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4464worker1 # [ 64.956420] nix-grpc-daemon[775]: ts=2026-09-20T12:23:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592464465worker1 # [ 64.969898] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4466worker1 # [ 64.992552] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 1/5)4467worker1 # [ 65.086556] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 2/5)4468worker1 # [ 65.226995] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 216 ms (attempt 3/5)4469worker1 # [ 65.444614] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 366 ms (attempt 4/5)4470worker1 # [ 65.819350] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4471worker1 # [ 65.831086] nix-grpc-daemon[775]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4472worker1 # [ 66.074943] nix-daemon[831]: accepted connection from pid 1141, user nix-grpc-daemon (trusted)4473worker1 # [ 66.097977] nix-daemon[831]: reaped child process 1144, status = succeeded4474worker1 # [ 66.282268] nix-daemon[831]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)4475worker1 # [ 66.302465] nix-daemon[831]: reaped child process 1149, status = succeeded4476lb # [ 66.403175] niks3-server[1003]: 2026/09/20 12:23:24 INFO Received uploads request method=POST path=/api/pending_closures4477worker1 # [ 66.550304] nix-grpc-daemon[841]: time=2026-09-20T12:23:26.042Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4478worker1 # [ 66.555253] nix-grpc-daemon[841]: time=2026-09-20T12:23:26.042Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4479lb # [ 66.660568] niks3-server[1003]: 2026/09/20 12:23:25 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4480lb # [ 66.673709] niks3-server[1003]: 2026/09/20 12:23:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4481worker1 # [ 66.592731] nix-grpc-daemon[841]: time=2026-09-20T12:23:26.086Z level=INFO msg="Uploading 1 narinfos"4482lb # [ 66.684423] niks3-server[1003]: 2026/09/20 12:23:25 INFO Signed narinfos id=21 count=14483lb # [ 66.692362] niks3-server[1003]: 2026/09/20 12:23:25 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4484lb # [ 66.702915] niks3-server[1003]: 2026/09/20 12:23:25 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4485lb # [ 66.713631] niks3-server[1003]: 2026/09/20 12:23:25 INFO Completed upload id=214486lb # [ 66.717072] niks3-server[1003]: 2026/09/20 12:23:25 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4487worker1 # [ 66.625722] nix-grpc-daemon[841]: time=2026-09-20T12:23:26.119Z level=INFO msg="Upload complete. (759ms)"4488worker1 # [ 66.638745] nix-grpc-daemon[775]: ts=2026-09-20T12:23:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=1 paths=1 nar_bytes_in=5684489worker1 # [ 66.653254] nix-grpc-daemon[775]: ts=2026-09-20T12:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592464490worker1 # [ 66.670331] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4491worker1 # [ 66.679610] nix-daemon[831]: reaped child process 1135, status = succeeded4492client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4493worker1 # [ 66.692169] nix-daemon[831]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4494client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4495worker1 # [ 67.516916] nix-daemon[831]: reaped child process 1153, status = succeeded4496worker1 # [ 67.680671] nix-daemon[831]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4497worker1 # [ 67.701358] nix-daemon[831]: reaped child process 1171, status = succeeded4498lb # [ 67.801190] niks3-server[1003]: 2026/09/20 12:23:26 INFO Received uploads request method=POST path=/api/pending_closures4499worker1 # [ 67.724307] nix-grpc-daemon[841]: time=2026-09-20T12:23:27.216Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4500lb # [ 67.832453] niks3-server[1003]: 2026/09/20 12:23:26 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4501worker1 # [ 67.755052] nix-grpc-daemon[841]: time=2026-09-20T12:23:27.249Z level=INFO msg="Uploading 1 narinfos"4502lb # [ 67.846386] niks3-server[1003]: 2026/09/20 12:23:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4503lb # [ 67.857191] niks3-server[1003]: 2026/09/20 12:23:26 INFO Signed narinfos id=22 count=14504lb # [ 67.862059] niks3-server[1003]: 2026/09/20 12:23:26 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4505worker1 # [ 67.783380] nix-grpc-daemon[841]: time=2026-09-20T12:23:27.277Z level=INFO msg="Upload complete. (279ms)"4506lb # [ 67.871519] niks3-server[1003]: 2026/09/20 12:23:26 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4507lb # [ 67.877906] niks3-server[1003]: 2026/09/20 12:23:26 INFO Completed upload id=224508lb # [ 67.880637] niks3-server[1003]: 2026/09/20 12:23:26 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4509worker1 # [ 67.792914] nix-grpc-daemon[775]: ts=2026-09-20T12:23:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59246 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14510client # copying 1 paths...4511worker1 # [ 67.805134] nix-daemon[831]: reaped child process 1151, status = succeeded4512worker2 # [ 67.869761] nix-grpc-daemon[776]: ts=2026-09-20T12:23:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:403624513worker2 # [ 67.877866] nix-grpc-daemon[776]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4514client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4515worker2 # [ 67.925758] nix-grpc-daemon[776]: ts=2026-09-20T12:23:27Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:403624516worker2 # [ 67.931672] nix-grpc-daemon[776]: ts=2026-09-20T12:23:27Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=0 paths=1 nar_bytes_out=1204517client # [ 68.113195] nix-daemon[940]: reaped child process 1043, status = succeeded4518client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.54 seconds)4519client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24520client # [ 68.340512] nix-daemon[940]: accepted connection from pid 1061, user root (trusted)4521client # this derivation will be built:4522client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4523worker1 # [ 68.423428] nix-grpc-daemon[775]: ts=2026-09-20T12:23:27Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:592464524client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4525worker2 # [ 68.494030] nix-grpc-daemon[776]: ts=2026-09-20T12:23:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403624526worker2 # [ 68.506568] nix-grpc-daemon[895]: time=2026-09-20T12:23:27.968Z level=INFO msg="All 1 paths already cached"4527worker2 # [ 68.526335] nix-grpc-daemon[776]: ts=2026-09-20T12:23:27Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04528worker2 # [ 68.534238] nix-grpc-daemon[776]: ts=2026-09-20T12:23:27Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14529worker2 # [ 68.543523] nix-grpc-daemon[776]: ts=2026-09-20T12:23:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403624530worker2 # [ 68.556533] nix-grpc-daemon[776]: ts=2026-09-20T12:23:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403624531worker2 # [ 68.571427] nix-grpc-daemon[895]: time=2026-09-20T12:23:28.034Z level=INFO msg="All 1 paths already cached"4532client # copying 1 paths to 'lb:50051'...4533client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4534worker2 # [ 68.583232] nix-grpc-daemon[776]: ts=2026-09-20T12:23:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:403624535worker2 # [ 68.598810] nix-daemon[861]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4536worker2 # [ 68.809757] nix-daemon[861]: accepted connection from pid 1028, user nix-grpc-daemon (trusted)4537worker2 # [ 68.828911] nix-daemon[861]: reaped child process 1031, status = succeeded4538worker2 # [ 69.008152] nix-daemon[861]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)4539worker2 # [ 69.028295] nix-daemon[861]: reaped child process 1036, status = succeeded4540lb # [ 69.065023] niks3-server[1003]: 2026/09/20 12:23:27 INFO Received uploads request method=POST path=/api/pending_closures4541worker2 # [ 69.051141] nix-grpc-daemon[895]: time=2026-09-20T12:23:28.513Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4542worker2 # [ 69.052861] nix-grpc-daemon[895]: time=2026-09-20T12:23:28.513Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4543lb # [ 69.094416] niks3-server[1003]: 2026/09/20 12:23:27 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4544lb # [ 69.109611] niks3-server[1003]: 2026/09/20 12:23:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4545worker2 # [ 69.091616] nix-grpc-daemon[895]: time=2026-09-20T12:23:28.553Z level=INFO msg="Uploading 1 narinfos"4546lb # [ 69.121507] niks3-server[1003]: 2026/09/20 12:23:27 INFO Signed narinfos id=23 count=14547lb # [ 69.130378] niks3-server[1003]: 2026/09/20 12:23:27 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4548lb # [ 69.395995] niks3-server[1003]: 2026/09/20 12:23:27 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4549lb # [ 69.420928] niks3-server[1003]: 2026/09/20 12:23:27 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4550lb # [ 69.431421] niks3-server[1003]: 2026/09/20 12:23:27 INFO Completed upload id=234551worker2 # [ 69.407752] nix-grpc-daemon[895]: time=2026-09-20T12:23:28.870Z level=INFO msg="Upload complete. (790ms)"4552worker2 # [ 69.419373] nix-grpc-daemon[776]: ts=2026-09-20T12:23:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=0 paths=1 nar_bytes_in=5684553worker2 # [ 69.436700] nix-grpc-daemon[776]: ts=2026-09-20T12:23:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403624554worker2 # [ 69.448745] nix-daemon[861]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4555worker2 # [ 69.456770] nix-daemon[861]: reaped child process 1026, status = succeeded4556client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4557worker2 # [ 69.474816] nix-daemon[861]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4558client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4559worker2 # [ 70.725223] nix-daemon[861]: reaped child process 1040, status = succeeded4560worker2 # [ 70.907415] nix-daemon[861]: accepted connection from pid 1055, user nix-grpc-daemon (trusted)4561worker2 # [ 70.928577] nix-daemon[861]: reaped child process 1058, status = succeeded4562lb # [ 70.965454] niks3-server[1003]: 2026/09/20 12:23:29 INFO Received uploads request method=POST path=/api/pending_closures4563worker2 # [ 70.951665] nix-grpc-daemon[895]: time=2026-09-20T12:23:30.413Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4564lb # [ 70.996173] niks3-server[1003]: 2026/09/20 12:23:29 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4565lb # [ 71.013900] niks3-server[1003]: 2026/09/20 12:23:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4566worker2 # [ 70.995876] nix-grpc-daemon[895]: time=2026-09-20T12:23:30.458Z level=INFO msg="Uploading 1 narinfos"4567lb # [ 71.027547] niks3-server[1003]: 2026/09/20 12:23:29 INFO Signed narinfos id=24 count=14568lb # [ 71.035953] niks3-server[1003]: 2026/09/20 12:23:29 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4569lb # [ 71.045317] niks3-server[1003]: 2026/09/20 12:23:29 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4570lb # [ 71.056455] niks3-server[1003]: 2026/09/20 12:23:29 INFO Completed upload id=244571worker2 # [ 71.031849] nix-grpc-daemon[895]: time=2026-09-20T12:23:30.494Z level=INFO msg="Upload complete. (341ms)"4572lb # [ 71.059270] niks3-server[1003]: 2026/09/20 12:23:29 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4573client # copying 1 paths...4574worker2 # [ 71.045182] nix-grpc-daemon[776]: ts=2026-09-20T12:23:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14575client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4576worker2 # [ 71.066935] nix-grpc-daemon[776]: ts=2026-09-20T12:23:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:403624577worker2 # [ 71.072889] nix-daemon[861]: reaped child process 1038, status = succeeded4578worker2 # [ 71.087409] nix-grpc-daemon[776]: ts=2026-09-20T12:23:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:403624579worker2 # [ 71.093212] nix-grpc-daemon[776]: ts=2026-09-20T12:23:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40362 duration_s=0 paths=1 nar_bytes_out=1204580client # [ 71.270309] nix-daemon[940]: reaped child process 1064, status = succeeded4581client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.16 seconds)4582(finished: subtest: an input only one worker has still reaches the builder, in 10.87 seconds)4583subtest: upload whose reference the worker lacks is completed from the cache4584client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4585client # this derivation will be built:4586client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4587client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4588client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.48 seconds)4589client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4590client # this derivation will be built:4591client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4592lb # [ 72.434020] envoy[920]: conn peer=[2001:db8:1::1]:59116 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=334593lb # [ 72.439008] envoy[920]: conn peer=[2001:db8:1::1]:59110 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4231 tx=1909 ms=24934594lb # [ 72.444200] envoy[920]: conn peer=[2001:db8:1::1]:59120 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1940 ms=30464595lb # [ 72.449008] envoy[920]: conn peer=[2001:db8:1::1]:59128 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=654596lb # [ 72.453722] envoy[920]: conn peer=[2001:db8:1::1]:59142 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1781 ms=26574597lb # [ 72.458527] envoy[920]: conn peer=[2001:db8:1::1]:56702 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=634598client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4599client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.82 seconds)4600client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4601client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4602worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4603worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4604worker2 # [ 73.053484] systemd[1]: Stopping Nix worker-protocol over gRPC...4605worker2 # [ 73.935567] nix-grpc-daemon[776]: ts=2026-09-20T12:23:33Z level=info event=signal_exit4606worker2 # [ 74.181114] nix-grpc-daemon[776]: ts=2026-09-20T12:23:33Z level=info event=scheduler_yield4607worker2 # [ 74.186412] nix-grpc-daemon[776]: ts=2026-09-20T12:23:33Z level=info event=scheduler_restarting addr=lb:500514608lb # [ 74.213560] niks3-server[1003]: 2026/09/20 12:23:32 INFO lead: released remote=192.168.1.4:555184609worker1 # [ 74.126902] nix-grpc-daemon[775]: ts=2026-09-20T12:23:33Z level=info event=scheduler_restarting addr=lb:500514610worker2 # [ 74.193724] nix-grpc-daemon[776]: ts=2026-09-20T12:23:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:390224611worker2 # [ 74.198568] nix-grpc-daemon[776]: ts=2026-09-20T12:23:33Z level=info event=worker_gone addr=192.168.1.4:500514612worker2 # [ 74.202627] nix-grpc-daemon[776]: ts=2026-09-20T12:23:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:390224613worker2 # [ 74.207101] nix-grpc-daemon[776]: ts=2026-09-20T12:23:33Z level=info event=worker_gone addr=192.168.1.3:500514614worker2 # [ 74.387656] nix-grpc-daemon[776]: ts=2026-09-20T12:23:33Z level=info event=scheduler_connected addr=lb:500514615worker1 # [ 74.327128] nix-grpc-daemon[775]: ts=2026-09-20T12:23:33Z level=info event=scheduler_connected addr=lb:500514616worker2 # [ 74.393152] nix-grpc-daemon[776]: ts=2026-09-20T12:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4617worker1 # [ 74.332526] nix-grpc-daemon[775]: ts=2026-09-20T12:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4618worker2 # [ 74.594360] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500514619worker1 # [ 74.533381] nix-grpc-daemon[775]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500514620worker2 # [ 74.600197] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4621worker1 # [ 74.538256] nix-grpc-daemon[775]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4622worker2 # [ 74.801342] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500514623worker1 # [ 74.739176] nix-grpc-daemon[775]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500514624worker2 # [ 74.806811] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4625worker1 # [ 74.744616] nix-grpc-daemon[775]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4626worker1 # [ 74.945349] nix-grpc-daemon[775]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500514627worker2 # [ 75.010285] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500514628worker2 # [ 75.014562] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4629worker1 # [ 74.950680] nix-grpc-daemon[775]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4630worker2 # [ 75.186790] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=info event=scheduler_restarting4631worker1 # [ 75.153442] nix-grpc-daemon[775]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500514632worker1 # [ 75.157634] nix-grpc-daemon[775]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4633worker2 # [ 75.228856] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4634worker2 # [ 75.246874] nix-daemon[861]: reaped child process 864, status = succeeded4635worker1 # [ 75.354389] nix-grpc-daemon[775]: ts=2026-09-20T12:23:34Z level=info event=scheduler_connected addr=lb:500514636worker1 # [ 75.359870] nix-grpc-daemon[775]: ts=2026-09-20T12:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4637worker1 # [ 75.560774] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500514638worker1 # [ 75.566199] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4639worker2 # [ 75.767826] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4640worker2 # [ 75.775769] systemd[1]: Stopped Nix worker-protocol over gRPC.4641worker2 # [ 75.781596] systemd[1]: nix-grpc-daemon.service: Consumed 2.020s CPU time over 53.179s wall clock time, 52.4M memory peak, 53.5K incoming IP traffic, 114.4K outgoing IP traffic.4642worker2 # [ 75.797416] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4643worker2 # [ 75.800997] systemd[1]: Closed Nix worker-protocol over gRPC.4644worker2 # [ 75.804672] systemd[1]: nix-grpc-daemon.socket: Consumed 813us CPU time over 1min 3.256s wall clock time, 256K memory peak, 69.7K incoming IP traffic, 61.4K outgoing IP traffic.4645lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4646lb: must succeed: curl -sf localhost:9901/clusters4647worker1 # [ 75.767075] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500514648worker1 # [ 75.773293] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4649lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4650lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4651client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24652worker1 # [ 75.974075] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500514653worker1 # [ 75.979509] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4654worker1 # [ 76.073934] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592464655client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4656worker1 # [ 76.081657] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:592464657client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.28 seconds)4658worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4659worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4660worker1 # [ 76.182157] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500514661worker1 # [ 76.186398] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4662worker2 # [ 76.294989] systemd[1]: Listening on Nix worker-protocol over gRPC.4663worker1 # [ 76.314558] systemd[1]: Stopping Nix worker-protocol over gRPC...4664worker1 # [ 76.382977] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=info event=scheduler_connected addr=lb:500514665worker1 # [ 76.388407] nix-grpc-daemon[775]: ts=2026-09-20T12:23:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4666worker1 # [ 76.589254] nix-grpc-daemon[775]: ts=2026-09-20T12:23:36Z level=info event=scheduler_connected addr=lb:500514667worker1 # [ 76.594854] nix-grpc-daemon[775]: ts=2026-09-20T12:23:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4668worker1 # [ 76.772947] nix-grpc-daemon[775]: ts=2026-09-20T12:23:36Z level=info event=signal_exit4669worker1 # [ 76.795628] nix-grpc-daemon[775]: ts=2026-09-20T12:23:36Z level=info event=scheduler_connected addr=lb:500514670worker1 # [ 76.801117] nix-grpc-daemon[775]: ts=2026-09-20T12:23:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4671worker2 # [ 77.051241] systemd[1]: Starting scheduler-token.service...4672worker1 # [ 77.001846] nix-grpc-daemon[775]: ts=2026-09-20T12:23:36Z level=info event=scheduler_connected addr=lb:500514673worker1 # [ 77.007301] nix-grpc-daemon[775]: ts=2026-09-20T12:23:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4674worker2 # [ 77.161461] systemd[1]: scheduler-token.service: Deactivated successfully.4675worker2 # [ 77.168203] systemd[1]: Finished scheduler-token.service.4676worker2 # [ 77.169888] systemd[1]: scheduler-token.service: Consumed 53ms CPU time over 114ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4677worker2 # [ 77.177856] systemd[1]: Starting Nix worker-protocol over gRPC...4678worker1 # [ 77.210196] nix-grpc-daemon[775]: ts=2026-09-20T12:23:36Z level=info event=scheduler_connected addr=lb:500514679worker1 # [ 77.214433] nix-grpc-daemon[775]: ts=2026-09-20T12:23:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4680worker2 # [ 77.362479] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:36Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4681worker2 # [ 77.365115] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4682worker2 # [ 77.369173] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14683worker2 # [ 77.377076] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:36Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4684worker2 # [ 77.378781] systemd[1]: Started Nix worker-protocol over gRPC.4685worker2 # [ 77.393798] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:36Z level=info event=scheduler_take_over4686lb # [ 77.419165] niks3-server[1003]: 2026/09/20 12:23:35 INFO lead: acquired remote=192.168.1.4:513664687worker2 # [ 77.411368] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:36Z level=info event=scheduler_connected addr=lb:500514688worker2 # [ 77.419220] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:36Z level=info event=oidc_jwks provider=mock keys=14689worker2 # [ 77.420781] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:36Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:600104690worker2 # [ 77.422483] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:36Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04691worker1 # [ 77.411135] nix-grpc-daemon[775]: ts=2026-09-20T12:23:36Z level=info event=scheduler_connected addr=lb:500514692worker2 # [ 77.476882] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:36Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:600104693worker2 # [ 77.480722] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:36Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04694worker1 # [ 78.021862] nix-grpc-daemon[775]: ts=2026-09-20T12:23:37Z level=info event=scheduler_restarting4695worker2 # [ 78.094672] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:600104696worker2 # [ 78.099747] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:37Z level=info event=worker_gone addr=192.168.1.3:500514697worker1 # [ 78.054822] nix-grpc-daemon[775]: ts=2026-09-20T12:23:37Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4698worker1 # [ 78.079559] nix-daemon[831]: reaped child process 833, status = succeeded4699worker1 # [ 78.867982] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4700worker1 # [ 78.868457] nix-grpc-daemon[775]: E0000 00:00:1789907018.360724 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4701worker1 # [ 78.932270] nix-grpc-daemon[775]: E0000 00:00:1789907018.426196 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4702worker1 # [ 79.624937] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4703worker1 # [ 79.631078] systemd[1]: Stopped Nix worker-protocol over gRPC.4704worker1 # [ 79.636760] systemd[1]: nix-grpc-daemon.service: Consumed 3.564s CPU time over 57.263s wall clock time, 59.7M memory peak, 79.6K incoming IP traffic, 143.3K outgoing IP traffic.4705worker1 # [ 79.651814] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4706worker1 # [ 79.657620] systemd[1]: Closed Nix worker-protocol over gRPC.4707worker1 # [ 79.662042] systemd[1]: nix-grpc-daemon.socket: Consumed 717us CPU time over 1min 7.059s wall clock time, 256K memory peak, 76.7K incoming IP traffic, 61.6K outgoing IP traffic.4708lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4709lb: must succeed: curl -sf localhost:9901/clusters4710lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4711lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4712client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24713worker2 # [ 80.075859] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600204714worker2 # [ 80.088307] nix-daemon[861]: accepted connection from pid 1082, user nix-grpc-daemon (trusted)4715worker2 # [ 80.114207] nix-grpc-daemon[1082]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5)4716worker2 # [ 80.213501] nix-grpc-daemon[1082]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 120 ms (attempt 2/5)4717worker2 # [ 80.341167] nix-grpc-daemon[1082]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 3/5)4718worker2 # [ 80.349600] nix-grpc-daemon[1082]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 651 ms (attempt 4/5)4719worker2 # [ 81.002686] nix-grpc-daemon[1082]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4720client # copying 2 paths...4721client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4722worker2 # [ 81.029720] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600204723client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4724worker2 # [ 81.049046] nix-daemon[861]: accepted connection from pid 1082, user nix-grpc-daemon (trusted)4725worker2 # [ 81.082070] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:40Z level=info event=niks3_push_started pid=11384726worker2 # [ 81.303073] nix-grpc-daemon[1138]: time=2026-09-20T12:23:40.764Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4727worker2 # [ 81.483816] nix-daemon[861]: accepted connection from pid 1151, user nix-grpc-daemon (trusted)4728worker2 # [ 81.502799] nix-daemon[861]: reaped child process 1154, status = succeeded4729lb # [ 81.542812] niks3-server[1003]: 2026/09/20 12:23:40 INFO Received uploads request method=POST path=/api/pending_closures4730lb # [ 81.552715] niks3-server[1003]: 2026/09/20 12:23:40 INFO Received uploads request method=POST path=/api/pending_closures4731worker2 # [ 81.540089] nix-grpc-daemon[1138]: time=2026-09-20T12:23:41.000Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4732worker2 # [ 81.541633] nix-grpc-daemon[1138]: time=2026-09-20T12:23:41.001Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4733worker2 # [ 81.543298] nix-grpc-daemon[1138]: time=2026-09-20T12:23:41.001Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4734lb # [ 81.610001] niks3-server[1003]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4735lb # [ 81.625939] niks3-server[1003]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4736lb # [ 81.635301] niks3-server[1003]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4737lb # [ 81.643763] niks3-server[1003]: 2026/09/20 12:23:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4738lb # [ 81.650339] niks3-server[1003]: 2026/09/20 12:23:40 INFO Signed narinfos id=25 count=14739worker2 # [ 81.628179] nix-grpc-daemon[1138]: time=2026-09-20T12:23:41.088Z level=INFO msg="Uploading 3 narinfos"4740lb # [ 81.653741] niks3-server[1003]: 2026/09/20 12:23:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4741lb # [ 81.659969] niks3-server[1003]: 2026/09/20 12:23:40 INFO Signed narinfos id=26 count=24742lb # [ 81.662381] niks3-server[1003]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4743lb # [ 81.683744] niks3-server[1003]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4744lb # [ 81.694836] niks3-server[1003]: 2026/09/20 12:23:40 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4745lb # [ 81.704416] niks3-server[1003]: 2026/09/20 12:23:40 INFO Completed upload id=254746lb # [ 81.705913] niks3-server[1003]: 2026/09/20 12:23:40 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4747worker2 # [ 81.680553] nix-grpc-daemon[1138]: time=2026-09-20T12:23:41.143Z level=INFO msg="Upload complete. (373ms)"4748lb # [ 81.713657] niks3-server[1003]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4749lb # [ 81.717302] niks3-server[1003]: 2026/09/20 12:23:40 INFO Completed upload id=264750worker2 # [ 81.692908] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60020 duration_s=0 paths=2 nar_bytes_in=3124751worker2 # [ 81.708458] nix-grpc-daemon[1138]: time=2026-09-20T12:23:41.155Z level=WARN msg="Failed to register uploaded object" key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo error="server returned 404: object is not pending upload\n"4752worker2 # [ 81.718030] nix-daemon[861]: reaped child process 1136, status = succeeded4753client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.92 seconds)4754worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4755worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4756worker1 # [ 81.789179] systemd[1]: Listening on Nix worker-protocol over gRPC.4757worker1 # [ 81.796417] systemd[1]: Starting Nix worker-protocol over gRPC...4758worker1 # [ 81.997922] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:41Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4759worker1 # [ 82.000660] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:41Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4760worker1 # [ 82.004797] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:41Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14761worker1 # [ 82.012823] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:41Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4762worker1 # [ 82.014592] systemd[1]: Started Nix worker-protocol over gRPC.4763lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4764lb: must succeed: curl -sf localhost:9901/clusters4765worker1 # [ 82.042326] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:41Z level=info event=scheduler_connected addr=lb:500514766worker2 # [ 82.110131] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:41Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:600104767worker2 # [ 82.115167] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04768lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4769lb # [ 82.435384] envoy[920]: conn peer=[2001:db8:1::4]:59384 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=23811 tx=1461 ms=522824770lb # [ 82.440823] envoy[920]: conn peer=[2001:db8:1::1]:56714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=214771lb # [ 82.440973] envoy[920]: conn peer=192.168.1.3:50600 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6655 tx=1996 ms=544304772lb # [ 82.441089] envoy[920]: conn peer=[2001:db8:1::1]:56730 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1009 tx=305 ms=16374773lb: must succeed: curl -sf localhost:9901/clusters4774lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4775lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds)4776(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.04 seconds)4777subtest: scheduler down: the other node takes the lock and keeps it4778lb: must succeed: curl -sf localhost:9901/clusters4779lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4780lb: must succeed: curl -sf localhost:9901/clusters4781lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4782lb: must succeed: curl -sf localhost:9901/clusters4783lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4784lb: must succeed: curl -sf localhost:9901/clusters4785lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4786worker2 # [ 83.541499] systemd[1]: Stopping Nix worker-protocol over gRPC...4787worker2 # [ 84.382880] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:43Z level=info event=signal_exit4788worker2 # [ 84.596175] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=scheduler_yield4789lb # [ 84.629333] niks3-server[1003]: 2026/09/20 12:23:43 INFO lead: released remote=192.168.1.4:513664790worker1 # [ 84.545204] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:44Z level=info event=scheduler_restarting addr=lb:500514791worker2 # [ 84.611533] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:600104792worker2 # [ 84.619627] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=worker_gone addr=192.168.1.3:500514793worker2 # [ 84.624081] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=scheduler_restarting addr=lb:500514794worker2 # [ 84.628118] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:600104795worker2 # [ 84.632485] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=worker_gone addr=192.168.1.4:500514796worker1 # [ 84.745298] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:44Z level=info event=scheduler_connected addr=lb:500514797worker1 # [ 84.750767] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4798worker2 # [ 84.819704] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=scheduler_connected addr=lb:500514799worker2 # [ 84.825235] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4800worker1 # [ 84.951253] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:44Z level=info event=scheduler_connected addr=lb:500514801worker1 # [ 84.954295] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4802worker2 # [ 85.026276] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=scheduler_connected addr=lb:500514803worker2 # [ 85.031553] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4804worker1 # [ 85.155399] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:44Z level=info event=scheduler_connected addr=lb:500514805worker1 # [ 85.160927] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4806worker2 # [ 85.232867] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=scheduler_connected addr=lb:500514807worker2 # [ 85.238035] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4808worker1 # [ 85.362010] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:44Z level=info event=scheduler_connected addr=lb:500514809worker1 # [ 85.367432] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4810worker2 # [ 85.440842] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=scheduler_connected addr=lb:500514811worker2 # [ 85.444970] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4812worker2 # [ 85.602117] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:45Z level=info event=scheduler_restarting4813worker2 # [ 85.633453] nix-daemon[861]: reaped child process 1131, status = succeeded4814worker1 # [ 85.570322] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:45Z level=info event=scheduler_connected addr=lb:500514815worker1 # [ 85.574625] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4816worker2 # [ 85.657688] nix-grpc-daemon[1082]: ts=2026-09-20T12:23:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4817worker1 # [ 85.771047] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:45Z level=info event=scheduler_connected addr=lb:500514818worker1 # [ 85.776410] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4819worker1 # [ 85.977373] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:45Z level=info event=scheduler_connected addr=lb:500514820worker1 # [ 85.982582] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4821worker1 # [ 86.183644] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:45Z level=info event=scheduler_connected addr=lb:500514822worker1 # [ 86.189296] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4823worker2 # [ 86.433705] nix-grpc-daemon[1082]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4824worker2 # [ 86.434047] nix-grpc-daemon[1082]: E0000 00:00:1789907025.896065 1125 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4825worker2 # [ 86.434231] nix-grpc-daemon[1082]: E0000 00:00:1789907025.896316 1125 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4826worker1 # [ 86.390108] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:45Z level=info event=scheduler_connected addr=lb:500514827worker1 # [ 86.395625] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4828worker1 # [ 86.598499] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:46Z level=info event=scheduler_connected addr=lb:500514829worker1 # [ 86.602833] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4830worker1 # [ 86.799409] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:46Z level=info event=scheduler_connected addr=lb:500514831worker1 # [ 86.804883] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4832worker1 # [ 87.005815] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:46Z level=info event=scheduler_connected addr=lb:500514833worker1 # [ 87.011273] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4834worker1 # [ 87.024450] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:46Z level=info event=scheduler_take_over4835lb # [ 87.113417] niks3-server[1003]: 2026/09/20 12:23:45 INFO lead: acquired remote=192.168.1.3:431284836worker1 # [ 87.212230] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:46Z level=info event=scheduler_connected addr=lb:500514837worker1 # [ 87.217505] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4838worker2 # [ 87.419792] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4839worker2 # [ 87.425601] systemd[1]: Stopped Nix worker-protocol over gRPC.4840worker2 # [ 87.431694] systemd[1]: nix-grpc-daemon.service: Consumed 454ms CPU time over 10.240s wall clock time, 31.1M memory peak, 19.5K incoming IP traffic, 25.7K outgoing IP traffic.4841worker2 # [ 87.449802] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4842worker2 # [ 87.457741] systemd[1]: Closed Nix worker-protocol over gRPC.4843worker2 # [ 87.460248] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 11.168s wall clock time, 256K memory peak, 21K incoming IP traffic, 15.8K outgoing IP traffic.4844worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4845worker1 # [ 87.420376] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:46Z level=info event=scheduler_connected addr=lb:500514846worker1 # [ 87.425402] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4847worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.10 seconds)4848worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4849worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4850worker1 # [ 87.622696] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:47Z level=info event=scheduler_connected addr=lb:500514851worker1 # [ 87.627862] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4852worker1 # [ 87.828659] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:47Z level=info event=scheduler_connected addr=lb:500514853worker1 # [ 87.838827] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:47Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:373264854worker1 # [ 87.845262] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04855worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4856worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4857client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24858worker1 # [ 88.897305] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:373384859worker1 # [ 88.913117] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)4860client # don't know how to build these paths:4861client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4862worker1 # [ 88.936675] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:373384863worker1 # [ 88.953050] nix-grpc-daemon[1194]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 1/5)4864worker1 # [ 88.968524] nix-grpc-daemon[1194]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 2/5)4865worker1 # [ 89.049126] nix-grpc-daemon[1194]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 3/5)4866worker1 # [ 89.069438] nix-grpc-daemon[1194]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 290 ms (attempt 4/5)4867worker1 # [ 89.368159] nix-grpc-daemon[1194]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4868worker1 # [ 89.401861] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:48Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04869worker1 # [ 89.409304] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:48Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14870worker1 # [ 89.448839] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:373384871worker1 # [ 89.465543] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:373384872client # copying 1 paths to 'lb:50051'...4873client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4874worker1 # [ 89.482372] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:373384875worker1 # [ 89.497166] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)4876worker1 # [ 89.525942] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:49Z level=info event=niks3_push_started pid=12644877worker1 # [ 89.745110] nix-grpc-daemon[1264]: time=2026-09-20T12:23:49.238Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""4878worker1 # [ 89.924101] nix-daemon[831]: accepted connection from pid 1277, user nix-grpc-daemon (trusted)4879worker1 # [ 89.942311] nix-daemon[831]: reaped child process 1280, status = succeeded4880worker1 # [ 90.119193] nix-daemon[831]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)4881worker1 # [ 90.136394] nix-daemon[831]: reaped child process 1285, status = succeeded4882lb # [ 90.239685] niks3-server[1003]: 2026/09/20 12:23:48 INFO Received uploads request method=POST path=/api/pending_closures4883worker1 # [ 90.165955] nix-grpc-daemon[1264]: time=2026-09-20T12:23:49.658Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4884worker1 # [ 90.167544] nix-grpc-daemon[1264]: time=2026-09-20T12:23:49.658Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4885lb # [ 90.283068] niks3-server[1003]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4886worker1 # [ 90.208094] nix-grpc-daemon[1264]: time=2026-09-20T12:23:49.701Z level=INFO msg="Uploading 1 narinfos"4887lb # [ 90.295546] niks3-server[1003]: 2026/09/20 12:23:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4888lb # [ 90.307353] niks3-server[1003]: 2026/09/20 12:23:48 INFO Signed narinfos id=27 count=14889lb # [ 90.316275] niks3-server[1003]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4890worker1 # [ 90.237951] nix-grpc-daemon[1264]: time=2026-09-20T12:23:49.732Z level=INFO msg="Upload complete. (488ms)"4891lb # [ 90.328269] niks3-server[1003]: 2026/09/20 12:23:48 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4892lb # [ 90.334417] niks3-server[1003]: 2026/09/20 12:23:48 INFO Completed upload id=274893worker1 # [ 90.246554] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37338 duration_s=0 paths=1 nar_bytes_in=5204894lb # [ 90.338652] niks3-server[1003]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4895worker1 # [ 90.262196] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:373384896worker1 # [ 90.268480] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)4897worker1 # [ 90.273545] nix-daemon[831]: reaped child process 1262, status = succeeded4898client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4899worker1 # [ 90.284690] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)4900client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4901client # farm-a> LOG-farm-a-on-standby4902worker1 # [ 91.113379] nix-daemon[831]: reaped child process 1289, status = succeeded4903worker1 # [ 91.276392] nix-daemon[831]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)4904worker1 # [ 91.297360] nix-daemon[831]: reaped child process 1307, status = succeeded4905lb # [ 91.399309] niks3-server[1003]: 2026/09/20 12:23:49 INFO Received uploads request method=POST path=/api/pending_closures4906worker1 # [ 91.597104] nix-grpc-daemon[1264]: time=2026-09-20T12:23:51.086Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4907worker1 # [ 91.609273] nix-grpc-daemon[1264]: time=2026-09-20T12:23:51.087Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4908lb # [ 91.722890] niks3-server[1003]: 2026/09/20 12:23:50 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4909lb # [ 91.742393] niks3-server[1003]: 2026/09/20 12:23:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4910worker1 # [ 91.663361] nix-grpc-daemon[1264]: time=2026-09-20T12:23:51.155Z level=INFO msg="Uploading 1 narinfos"4911lb # [ 91.754265] niks3-server[1003]: 2026/09/20 12:23:50 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4912lb # [ 91.766582] niks3-server[1003]: 2026/09/20 12:23:50 INFO Signed narinfos id=28 count=14913lb # [ 91.776164] niks3-server[1003]: 2026/09/20 12:23:50 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4914lb # [ 91.781240] niks3-server[1003]: 2026/09/20 12:23:50 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4915lb # [ 91.785284] niks3-server[1003]: 2026/09/20 12:23:50 INFO Completed upload id=284916lb # [ 91.789309] niks3-server[1003]: 2026/09/20 12:23:50 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4917worker1 # [ 91.692659] nix-grpc-daemon[1264]: time=2026-09-20T12:23:51.186Z level=INFO msg="Upload complete. (595ms)"4918worker1 # [ 91.720444] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37338 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14919worker1 # [ 91.739783] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:51Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04920worker1 # [ 91.744385] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:51Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14921worker1 # [ 91.748886] nix-daemon[831]: reaped child process 1287, status = succeeded4922worker1 # [ 91.765000] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:373384923worker1 # [ 91.781076] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:373384924worker1 # [ 91.795557] nix-grpc-daemon[1264]: time=2026-09-20T12:23:51.289Z level=INFO msg="All 1 paths already cached"4925client # copying 1 paths to 'lb:50051'...4926client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4927worker1 # [ 91.804702] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:373384928worker1 # [ 91.818935] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)4929worker1 # [ 92.026370] nix-daemon[831]: accepted connection from pid 1313, user nix-grpc-daemon (trusted)4930worker1 # [ 92.045449] nix-daemon[831]: reaped child process 1316, status = succeeded4931worker1 # [ 92.222375] nix-daemon[831]: accepted connection from pid 1318, user nix-grpc-daemon (trusted)4932worker1 # [ 92.241042] nix-daemon[831]: reaped child process 1321, status = succeeded4933lb # [ 92.340773] niks3-server[1003]: 2026/09/20 12:23:50 INFO Received uploads request method=POST path=/api/pending_closures4934worker1 # [ 92.261688] nix-grpc-daemon[1264]: time=2026-09-20T12:23:51.755Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4935worker1 # [ 92.263198] nix-grpc-daemon[1264]: time=2026-09-20T12:23:51.755Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4936lb # [ 92.368911] niks3-server[1003]: 2026/09/20 12:23:50 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4937worker1 # [ 92.291318] nix-grpc-daemon[1264]: time=2026-09-20T12:23:51.785Z level=INFO msg="Uploading 1 narinfos"4938lb # [ 92.384718] niks3-server[1003]: 2026/09/20 12:23:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4939lb # [ 92.395133] niks3-server[1003]: 2026/09/20 12:23:50 INFO Signed narinfos id=29 count=14940lb # [ 92.404424] niks3-server[1003]: 2026/09/20 12:23:50 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4941lb # [ 92.409398] niks3-server[1003]: 2026/09/20 12:23:50 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4942worker1 # [ 92.325716] nix-grpc-daemon[1264]: time=2026-09-20T12:23:51.819Z level=INFO msg="Upload complete. (490ms)"4943lb # [ 92.414080] niks3-server[1003]: 2026/09/20 12:23:50 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4944lb # [ 92.418607] niks3-server[1003]: 2026/09/20 12:23:50 INFO Completed upload id=294945worker1 # [ 92.332272] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37338 duration_s=0 paths=1 nar_bytes_in=6404946worker1 # [ 92.345565] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:373384947lb # [ 92.435826] envoy[920]: conn peer=[2001:db8:1::4]:45818 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4158 tx=326 ms=82424948worker1 # [ 92.352883] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)4949worker1 # [ 92.357462] nix-daemon[831]: reaped child process 1311, status = succeeded4950client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4951client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4952worker1 # [ 92.371340] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)4953client # farm-b> LOG-farm-b-on-standby4954worker1 # [ 93.619224] nix-daemon[831]: reaped child process 1325, status = succeeded4955worker1 # [ 93.801183] nix-daemon[831]: accepted connection from pid 1340, user nix-grpc-daemon (trusted)4956worker1 # [ 93.820223] nix-daemon[831]: reaped child process 1343, status = succeeded4957lb # [ 93.922046] niks3-server[1003]: 2026/09/20 12:23:52 INFO Received uploads request method=POST path=/api/pending_closures4958worker1 # [ 93.843840] nix-grpc-daemon[1264]: time=2026-09-20T12:23:53.336Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4959worker1 # [ 93.845538] nix-grpc-daemon[1264]: time=2026-09-20T12:23:53.336Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4960lb # [ 93.954844] niks3-server[1003]: 2026/09/20 12:23:52 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4961lb # [ 93.970941] niks3-server[1003]: 2026/09/20 12:23:52 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4962lb # [ 93.981564] niks3-server[1003]: 2026/09/20 12:23:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4963worker1 # [ 93.899875] nix-grpc-daemon[1264]: time=2026-09-20T12:23:53.393Z level=INFO msg="Uploading 1 narinfos"4964lb # [ 93.991878] niks3-server[1003]: 2026/09/20 12:23:52 INFO Signed narinfos id=30 count=14965lb # [ 93.997562] niks3-server[1003]: 2026/09/20 12:23:52 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4966lb # [ 94.005776] niks3-server[1003]: 2026/09/20 12:23:52 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4967lb # [ 94.012334] niks3-server[1003]: 2026/09/20 12:23:52 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4968lb # [ 94.017861] niks3-server[1003]: 2026/09/20 12:23:52 INFO Completed upload id=304969worker1 # [ 93.929937] nix-grpc-daemon[1264]: time=2026-09-20T12:23:53.424Z level=INFO msg="Upload complete. (348ms)"4970worker1 # [ 93.946827] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37338 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14971worker1 # [ 93.964309] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:53Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04972worker1 # [ 93.968983] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:53Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=14973worker1 # [ 93.973152] nix-daemon[831]: reaped child process 1323, status = succeeded4974worker1 # [ 93.993608] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:373384975worker1 # [ 94.009056] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:373384976worker1 # [ 94.278156] nix-grpc-daemon[1264]: time=2026-09-20T12:23:53.772Z level=INFO msg="All 2 paths already cached"4977client # copying 1 paths to 'lb:50051'...4978client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4979worker1 # [ 94.288726] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:373384980worker1 # [ 94.303363] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)4981worker1 # [ 94.543269] nix-daemon[831]: accepted connection from pid 1349, user nix-grpc-daemon (trusted)4982worker1 # [ 94.565258] nix-daemon[831]: reaped child process 1352, status = succeeded4983worker1 # [ 94.744725] nix-daemon[831]: accepted connection from pid 1354, user nix-grpc-daemon (trusted)4984worker1 # [ 94.766845] nix-daemon[831]: reaped child process 1357, status = succeeded4985lb # [ 94.867516] niks3-server[1003]: 2026/09/20 12:23:53 INFO Received uploads request method=POST path=/api/pending_closures4986worker1 # [ 94.790333] nix-grpc-daemon[1264]: time=2026-09-20T12:23:54.284Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4987worker1 # [ 94.791879] nix-grpc-daemon[1264]: time=2026-09-20T12:23:54.284Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4988lb # [ 94.897552] niks3-server[1003]: 2026/09/20 12:23:53 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst4989worker1 # [ 94.823634] nix-grpc-daemon[1264]: time=2026-09-20T12:23:54.317Z level=INFO msg="Uploading 1 narinfos"4990lb # [ 94.913471] niks3-server[1003]: 2026/09/20 12:23:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4991lb # [ 94.926058] niks3-server[1003]: 2026/09/20 12:23:53 INFO Signed narinfos id=31 count=14992lb # [ 94.933198] niks3-server[1003]: 2026/09/20 12:23:53 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls4993worker1 # [ 94.856596] nix-grpc-daemon[1264]: time=2026-09-20T12:23:54.347Z level=INFO msg="Upload complete. (529ms)"4994lb # [ 94.944435] niks3-server[1003]: 2026/09/20 12:23:53 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete4995lb # [ 94.949300] niks3-server[1003]: 2026/09/20 12:23:53 INFO Completed upload id=314996worker1 # [ 94.859600] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37338 duration_s=0 paths=1 nar_bytes_in=7684997lb # [ 94.951522] niks3-server[1003]: 2026/09/20 12:23:53 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo4998worker1 # [ 94.878018] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:373384999worker1 # [ 94.884144] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)5000worker1 # [ 94.889416] nix-daemon[831]: reaped child process 1347, status = succeeded5001client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5002client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5003worker1 # [ 94.903969] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)5004client # farm-top> LOG-farm-top-on-standby5005worker1 # [ 95.749137] nix-daemon[831]: reaped child process 1361, status = succeeded5006worker1 # [ 95.938211] nix-daemon[831]: accepted connection from pid 1376, user nix-grpc-daemon (trusted)5007worker1 # [ 95.959449] nix-daemon[831]: reaped child process 1379, status = succeeded5008lb # [ 96.063729] niks3-server[1003]: 2026/09/20 12:23:54 INFO Received uploads request method=POST path=/api/pending_closures5009worker1 # [ 95.987128] nix-grpc-daemon[1264]: time=2026-09-20T12:23:55.479Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5010worker1 # [ 95.989220] nix-grpc-daemon[1264]: time=2026-09-20T12:23:55.479Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5011lb # [ 96.103653] niks3-server[1003]: 2026/09/20 12:23:54 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5012lb # [ 96.114924] niks3-server[1003]: 2026/09/20 12:23:54 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5013lb # [ 96.124775] niks3-server[1003]: 2026/09/20 12:23:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5014worker1 # [ 96.041843] nix-grpc-daemon[1264]: time=2026-09-20T12:23:55.535Z level=INFO msg="Uploading 1 narinfos"5015lb # [ 96.132853] niks3-server[1003]: 2026/09/20 12:23:54 INFO Signed narinfos id=32 count=15016lb # [ 96.134919] niks3-server[1003]: 2026/09/20 12:23:54 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5017lb # [ 96.144366] niks3-server[1003]: 2026/09/20 12:23:54 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5018lb # [ 96.151642] niks3-server[1003]: 2026/09/20 12:23:54 INFO Completed upload id=325019worker1 # [ 96.063115] nix-grpc-daemon[1264]: time=2026-09-20T12:23:55.557Z level=INFO msg="Upload complete. (345ms)"5020lb # [ 96.154501] niks3-server[1003]: 2026/09/20 12:23:54 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5021worker1 # [ 96.077171] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37338 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15022worker1 # [ 96.096309] nix-daemon[831]: reaped child process 1359, status = succeeded5023client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.50 seconds)5024client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5025client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5026worker2 # [ 96.544228] systemd[1]: Listening on Nix worker-protocol over gRPC.5027worker2 # [ 96.548673] systemd[1]: Starting scheduler-token.service...5028worker2 # [ 96.662189] systemd[1]: scheduler-token.service: Deactivated successfully.5029worker2 # [ 96.669013] systemd[1]: Finished scheduler-token.service.5030worker2 # [ 96.670495] systemd[1]: scheduler-token.service: Consumed 45ms CPU time over 116ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5031worker2 # [ 96.679334] systemd[1]: Starting Nix worker-protocol over gRPC...5032worker2 # [ 96.872576] nix-grpc-daemon[1178]: ts=2026-09-20T12:23:56Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5033worker2 # [ 96.875369] nix-grpc-daemon[1178]: ts=2026-09-20T12:23:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5034worker2 # [ 96.880389] nix-grpc-daemon[1178]: ts=2026-09-20T12:23:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15035worker2 # [ 96.888782] nix-grpc-daemon[1178]: ts=2026-09-20T12:23:56Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5036worker2 # [ 96.890577] systemd[1]: Started Nix worker-protocol over gRPC.5037lb: must succeed: curl -sf localhost:9901/clusters5038worker2 # [ 96.918325] nix-grpc-daemon[1178]: ts=2026-09-20T12:23:56Z level=info event=scheduler_connected addr=lb:500515039worker1 # [ 96.872219] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:56Z level=info event=oidc_jwks provider=mock keys=15040worker1 # [ 96.878535] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:56Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:373265041worker1 # [ 96.884251] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:56Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05042lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5043worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5044worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)5045lb: must succeed: curl -sf localhost:9901/clusters5046lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5047lb: must succeed: curl -sf localhost:9901/clusters5048lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5049worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5050worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5051(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.06 seconds)5052subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5053client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5054client # [ 97.465519] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5055client # Running as unit: rs.service; invocation ID: 9e19a6f358d647189bf15e5e128b481e5056client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.11 seconds)5057client # [ 97.713199] nix[1163]: don't know how to build these paths:5058client # [ 97.714221] nix[1163]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5059worker1 # [ 97.591307] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:373385060worker1 # [ 97.609431] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:57Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05061worker1 # [ 97.618782] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:57Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15062worker1 # [ 97.657224] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:373385063worker1 # [ 97.676780] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:373385064client # [ 97.813213] nix[1163]: copying 1 paths to 'lb:50051'...5065worker1 # [ 97.694319] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:373385066client # [ 97.819506] nix[1163]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5067worker1 # [ 97.711626] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)5068worker1 # [ 97.941443] nix-daemon[831]: accepted connection from pid 1392, user nix-grpc-daemon (trusted)5069worker1 # [ 97.962576] nix-daemon[831]: reaped child process 1395, status = succeeded5070worker1 # [ 98.136496] nix-daemon[831]: accepted connection from pid 1397, user nix-grpc-daemon (trusted)5071worker1 # [ 98.156838] nix-daemon[831]: reaped child process 1400, status = succeeded5072lb # [ 98.257041] niks3-server[1003]: 2026/09/20 12:23:56 INFO Received uploads request method=POST path=/api/pending_closures5073worker1 # [ 98.179231] nix-grpc-daemon[1264]: time=2026-09-20T12:23:57.672Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5074worker1 # [ 98.180936] nix-grpc-daemon[1264]: time=2026-09-20T12:23:57.672Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5075lb # [ 98.285316] niks3-server[1003]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5076lb # [ 98.300264] niks3-server[1003]: 2026/09/20 12:23:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5077worker1 # [ 98.217989] nix-grpc-daemon[1264]: time=2026-09-20T12:23:57.711Z level=INFO msg="Uploading 1 narinfos"5078lb # [ 98.312677] niks3-server[1003]: 2026/09/20 12:23:56 INFO Signed narinfos id=33 count=15079lb # [ 98.315874] niks3-server[1003]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5080lb # [ 98.329008] niks3-server[1003]: 2026/09/20 12:23:56 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5081lb # [ 98.334918] niks3-server[1003]: 2026/09/20 12:23:56 INFO Completed upload id=335082lb # [ 98.338758] niks3-server[1003]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5083worker1 # [ 98.245741] nix-grpc-daemon[1264]: time=2026-09-20T12:23:57.739Z level=INFO msg="Upload complete. (513ms)"5084worker1 # [ 98.256424] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37338 duration_s=0 paths=1 nar_bytes_in=4165085worker1 # [ 98.267615] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:373385086worker1 # [ 98.274662] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)5087worker1 # [ 98.279482] nix-daemon[831]: reaped child process 1390, status = succeeded5088client # [ 98.410145] nix[1163]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5089worker1 # [ 98.292659] nix-daemon[831]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)5090lb: must succeed: curl -sf localhost:9901/clusters5091lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5092lb: must succeed: curl -sf localhost:9901/clusters5093lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5094lb: must succeed: curl -sf localhost:9901/clusters5095lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5096lb: must succeed: curl -sf localhost:9901/clusters5097lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5098worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5099worker2 # [ 100.423653] systemd-journald[273]: Received client request to rotate journal, rotating.5100worker2 # [ 100.444082] systemd-journald[273]: Vacuuming done, freed 0B of archived journals from /var/log/journal/48bb4563a2fb48fb95582b1f271d92f1.5101worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)5102worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5103worker1 # [ 100.435375] systemd[1]: Stopping Nix worker-protocol over gRPC...5104worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5105??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5106 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735107client: must succeed: sleep 5.05108worker1 # [ 101.026520] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:00Z level=info event=draining5109lb # [ 102.435324] envoy[920]: conn peer=[2001:db8:1::1]:56950 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9580 tx=3846 ms=72095110client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5111worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5112worker1 # [ 105.946317] nix-daemon[831]: reaped child process 1404, status = succeeded5113worker1 # [ 106.126442] nix-daemon[831]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5114worker1 # [ 106.147936] nix-daemon[831]: reaped child process 1447, status = succeeded5115lb # [ 106.248934] niks3-server[1003]: 2026/09/20 12:24:04 INFO Received uploads request method=POST path=/api/pending_closures5116worker1 # [ 106.176354] nix-grpc-daemon[1264]: time=2026-09-20T12:24:05.670Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5117worker1 # [ 106.181316] nix-grpc-daemon[1264]: time=2026-09-20T12:24:05.672Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5118lb # [ 106.300944] niks3-server[1003]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5119lb # [ 106.311431] niks3-server[1003]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5120worker1 # [ 106.238633] nix-grpc-daemon[1264]: time=2026-09-20T12:24:05.732Z level=INFO msg="Uploading 1 narinfos"5121lb # [ 106.322285] niks3-server[1003]: 2026/09/20 12:24:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5122lb # [ 106.330261] niks3-server[1003]: 2026/09/20 12:24:04 INFO Signed narinfos id=34 count=15123lb # [ 106.335351] niks3-server[1003]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5124lb # [ 106.342905] niks3-server[1003]: 2026/09/20 12:24:04 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5125lb # [ 106.350981] niks3-server[1003]: 2026/09/20 12:24:04 INFO Completed upload id=345126worker1 # [ 106.263121] nix-grpc-daemon[1264]: time=2026-09-20T12:24:05.757Z level=INFO msg="Upload complete. (354ms)"5127lb # [ 106.353795] niks3-server[1003]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5128worker1 # [ 106.277304] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37338 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15129worker1 # [ 106.295422] nix-daemon[831]: reaped child process 1402, status = succeeded5130client # [ 106.437532] systemd[1]: rs.service: Deactivated successfully.5131client # [ 106.441904] systemd[1]: rs.service: Consumed 165ms CPU time over 8.975s wall clock time, 39M memory peak, 8.5K incoming IP traffic, 8.8K outgoing IP traffic.5132worker1 # [ 107.027953] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:06Z level=info event=signal_exit5133worker1 # [ 107.051966] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:06Z level=info event=scheduler_yield5134lb # [ 107.147470] niks3-server[1003]: 2026/09/20 12:24:05 INFO lead: released remote=192.168.1.3:431285135worker1 # [ 107.061546] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:06Z level=info event=scheduler_restarting addr=lb:500515136worker2 # [ 107.127196] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:06Z level=info event=scheduler_restarting addr=lb:500515137worker1 # [ 107.067657] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:373265138worker1 # [ 107.072358] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:06Z level=info event=worker_gone addr=192.168.1.3:500515139worker1 # [ 107.076276] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:373265140worker1 # [ 107.080616] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:06Z level=info event=worker_gone addr=192.168.1.4:500515141worker1 # [ 107.262732] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:06Z level=info event=scheduler_connected addr=lb:500515142worker2 # [ 107.327626] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:06Z level=info event=scheduler_connected addr=lb:500515143worker1 # [ 107.270450] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5144worker2 # [ 107.335029] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5145worker2 # [ 107.536361] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:06Z level=info event=scheduler_connected addr=lb:500515146worker1 # [ 107.473845] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:06Z level=info event=scheduler_connected addr=lb:500515147worker2 # [ 107.541708] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5148worker1 # [ 107.479537] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5149worker2 # [ 107.742828] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:07Z level=info event=scheduler_connected addr=lb:500515150worker1 # [ 107.680308] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:07Z level=info event=scheduler_connected addr=lb:500515151worker2 # [ 107.748858] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5152worker1 # [ 107.685538] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5153worker2 # [ 107.950105] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:07Z level=info event=scheduler_connected addr=lb:500515154worker1 # [ 107.886497] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:07Z level=info event=scheduler_connected addr=lb:500515155worker2 # [ 107.955438] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5156worker1 # [ 107.892000] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5157worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.20 seconds)5158client: waiting for success: ! systemctl is-active rs5159worker1 # [ 108.057999] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:07Z level=info event=scheduler_restarting5160client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5161client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5162worker2 # [ 108.158388] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:07Z level=info event=scheduler_connected addr=lb:500515163worker2 # [ 108.162605] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5164worker1 # [ 108.113093] nix-daemon[831]: reaped child process 1255, status = succeeded5165worker1 # [ 108.115821] nix-grpc-daemon[1194]: ts=2026-09-20T12:24:07Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5166client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5167client: must fail: journalctl -u rs | grep -q 'reconnecting'5168client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5169lb: must succeed: curl -sf localhost:9901/clusters5170lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5171worker2 # [ 108.359458] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:07Z level=info event=scheduler_connected addr=lb:500515172worker2 # [ 108.364732] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5173worker2 # [ 108.565799] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:08Z level=info event=scheduler_connected addr=lb:500515174worker2 # [ 108.571096] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5175worker1 # [ 108.681967] nix-grpc-daemon[1194]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5176worker1 # [ 108.686509] nix-grpc-daemon[1194]: E0000 00:00:1789907048.174698 1237 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5177worker1 # [ 108.693128] nix-grpc-daemon[1194]: E0000 00:00:1789907048.174973 1237 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5178worker2 # [ 108.772151] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:08Z level=info event=scheduler_connected addr=lb:500515179worker2 # [ 108.777241] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5180worker2 # [ 108.978372] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:08Z level=info event=scheduler_connected addr=lb:500515181worker2 # [ 108.983578] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5182worker1 # [ 109.077550] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5183worker1 # [ 109.083589] systemd[1]: Stopped Nix worker-protocol over gRPC.5184worker1 # [ 109.090340] systemd[1]: nix-grpc-daemon.service: Consumed 1.939s CPU time over 27.278s wall clock time, 34.4M memory peak, 49K incoming IP traffic, 87.9K outgoing IP traffic.5185worker1 # [ 109.104421] systemd[1]: Starting Nix worker-protocol over gRPC...5186worker2 # [ 109.186536] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:08Z level=info event=scheduler_connected addr=lb:500515187worker2 # [ 109.190705] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5188lb: must succeed: curl -sf localhost:9901/clusters5189worker1 # [ 109.305573] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:08Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5190worker1 # [ 109.309229] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5191worker1 # [ 109.311767] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15192worker1 # [ 109.319958] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:08Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5193worker2 # [ 109.386888] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:08Z level=info event=scheduler_connected addr=lb:500515194worker1 # [ 109.324469] systemd[1]: Started Nix worker-protocol over gRPC.5195worker2 # [ 109.389686] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5196worker1 # [ 109.328675] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:08Z level=info event=scheduler_take_over5197lb # [ 109.417685] niks3-server[1003]: 2026/09/20 12:24:07 INFO lead: acquired remote=192.168.1.3:564045198worker1 # [ 109.343687] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:08Z level=info event=scheduler_connected addr=lb:500515199worker1 # [ 109.345764] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5200lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5201worker2 # [ 109.590806] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:09Z level=info event=scheduler_connected addr=lb:500515202worker2 # [ 109.596002] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5203worker1 # [ 109.546832] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=scheduler_connected addr=lb:500515204worker1 # [ 109.552396] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5205worker2 # [ 109.797303] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:09Z level=info event=scheduler_connected addr=lb:500515206worker2 # [ 109.802550] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5207worker1 # [ 109.753066] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=scheduler_connected addr=lb:500515208worker1 # [ 109.758138] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5209worker2 # [ 110.003834] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:09Z level=info event=scheduler_connected addr=lb:500515210worker2 # [ 110.009278] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5211worker1 # [ 109.958967] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=scheduler_connected addr=lb:500515212worker1 # [ 109.964249] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5213worker2 # [ 110.211693] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:09Z level=info event=scheduler_connected addr=lb:500515214worker1 # [ 110.160253] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=oidc_jwks provider=mock keys=15215worker1 # [ 110.165530] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:408865216worker1 # [ 110.172208] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05217worker1 # [ 110.177607] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=scheduler_connected addr=lb:500515218worker1 # [ 110.181765] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:408865219worker1 # [ 110.186584] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05220lb: must succeed: curl -sf localhost:9901/clusters5221lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5222worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5223worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5224(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.26 seconds)5225subtest: scheduler restart mid-build: build finishes, no double build5226client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5227client # [ 110.714825] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5228client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5229worker1 # [ 110.839992] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:605725230worker1 # [ 110.854875] nix-daemon[831]: accepted connection from pid 1454, user nix-grpc-daemon (trusted)5231client # Running as unit: mid.service; invocation ID: 22842e89346a475e8a789519876accc35232client # [ 110.993498] nix[1198]: don't know how to build these paths:5233client # [ 110.995390] nix[1198]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5234worker1 # [ 110.881715] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:10Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05235worker1 # [ 110.887753] nix-grpc-daemon[1454]: ts=2026-09-20T12:24:10Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15236worker2 # [ 111.008156] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476345237worker2 # [ 111.024359] nix-daemon[861]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)5238worker2 # [ 111.050106] nix-grpc-daemon[1178]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 19 ms (attempt 1/5)5239worker2 # [ 111.076779] nix-grpc-daemon[1178]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 2/5)5240worker2 # [ 111.153257] nix-grpc-daemon[1178]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 299 ms (attempt 3/5)5241worker2 # [ 111.453862] nix-grpc-daemon[1178]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 4/5)5242worker2 # [ 111.499589] nix-grpc-daemon[1178]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5243worker2 # [ 111.521756] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476345244client # [ 111.592375] nix[1198]: copying 1 paths to 'lb:50051'...5245client # [ 111.597264] nix[1198]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5246worker2 # [ 111.541054] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476345247worker2 # [ 111.555821] nix-daemon[861]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)5248worker2 # [ 111.584329] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:11Z level=info event=niks3_push_started pid=12885249worker2 # [ 111.802739] nix-grpc-daemon[1288]: time=2026-09-20T12:24:11.264Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""5250worker2 # [ 111.987149] nix-daemon[861]: accepted connection from pid 1301, user nix-grpc-daemon (trusted)5251worker2 # [ 112.010726] nix-daemon[861]: reaped child process 1308, status = succeeded5252worker2 # [ 112.193550] nix-daemon[861]: accepted connection from pid 1310, user nix-grpc-daemon (trusted)5253worker2 # [ 112.211317] nix-daemon[861]: reaped child process 1313, status = succeeded5254lb # [ 112.247702] niks3-server[1003]: 2026/09/20 12:24:10 INFO Received uploads request method=POST path=/api/pending_closures5255worker2 # [ 112.235572] nix-grpc-daemon[1288]: time=2026-09-20T12:24:11.696Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5256worker2 # [ 112.237457] nix-grpc-daemon[1288]: time=2026-09-20T12:24:11.697Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5257lb # [ 112.284158] niks3-server[1003]: 2026/09/20 12:24:10 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5258lb # [ 112.297191] niks3-server[1003]: 2026/09/20 12:24:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5259worker2 # [ 112.280122] nix-grpc-daemon[1288]: time=2026-09-20T12:24:11.742Z level=INFO msg="Uploading 1 narinfos"5260lb # [ 112.310745] niks3-server[1003]: 2026/09/20 12:24:10 INFO Signed narinfos id=35 count=15261lb # [ 112.318586] niks3-server[1003]: 2026/09/20 12:24:10 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5262lb # [ 112.330348] niks3-server[1003]: 2026/09/20 12:24:10 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5263lb # [ 112.340723] niks3-server[1003]: 2026/09/20 12:24:10 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5264lb # [ 112.361390] niks3-server[1003]: 2026/09/20 12:24:10 INFO Completed upload id=355265worker2 # [ 112.340306] nix-grpc-daemon[1288]: time=2026-09-20T12:24:11.802Z level=INFO msg="Upload complete. (533ms)"5266worker2 # [ 112.351224] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47634 duration_s=0 paths=1 nar_bytes_in=4245267worker2 # [ 112.368930] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476345268worker2 # [ 112.378210] nix-daemon[861]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)5269worker2 # [ 112.383936] nix-daemon[861]: reaped child process 1286, status = succeeded5270client # [ 112.453416] nix[1198]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5271worker2 # [ 112.400341] nix-daemon[861]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)5272lb # [ 112.434571] envoy[920]: conn peer=[2001:db8:1::1]:59004 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1325 ms=87025273lb # [ 112.439761] envoy[920]: conn peer=[2001:db8:1::3]:46272 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4012 tx=1293 ms=260675274lb: must succeed: curl -sf localhost:9901/clusters5275lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5276lb: must succeed: curl -sf localhost:9901/clusters5277lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5278worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5279worker1 # [ 114.641838] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1454 (nix-grpc-daemon) on client request.5280worker1 # [ 114.663270] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5281lb # [ 114.757414] niks3-server[1003]: 2026/09/20 12:24:13 INFO lead: released remote=192.168.1.3:564045282worker2 # [ 114.742200] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5283client # [ 114.799548] nix[1198]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5284worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.11 seconds)5285client: must succeed: sleep 5.05286worker1 # [ 114.705536] nix-daemon[831]: reaped child process 1510, status = succeeded5287worker1 # [ 114.712203] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5288worker1 # [ 114.714186] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5289worker1 # [ 114.715739] systemd[1]: nix-grpc-daemon.service: Consumed 194ms CPU time over 5.607s wall clock time, 11.8M memory peak, 9.9K incoming IP traffic, 10K outgoing IP traffic.5290worker2 # [ 114.942461] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:14Z level=info event=scheduler_connected addr=lb:500515291worker1 # [ 114.883207] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5292worker1 # [ 114.895710] systemd[1]: Starting Nix worker-protocol over gRPC...5293worker1 # [ 115.109250] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:14Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5294worker1 # [ 115.111875] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5295worker1 # [ 115.115975] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15296worker1 # [ 115.123843] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5297worker1 # [ 115.135088] systemd[1]: Started Nix worker-protocol over gRPC.5298worker1 # [ 115.139854] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:14Z level=info event=scheduler_take_over5299lb # [ 115.228265] niks3-server[1003]: 2026/09/20 12:24:13 INFO lead: acquired remote=192.168.1.3:476685300worker1 # [ 115.163675] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:14Z level=info event=scheduler_connected addr=lb:500515301worker1 # [ 115.167149] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:14Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:605805302worker1 # [ 115.169012] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05303worker1 # [ 115.170920] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:14Z level=info event=oidc_jwks provider=mock keys=15304worker1 # [ 115.172317] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:14Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:605805305worker1 # [ 115.174162] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=15306client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5307client: waiting for success: ! systemctl is-active mid5308worker2 # [ 120.231002] nix-daemon[861]: reaped child process 1317, status = succeeded5309worker2 # [ 120.394102] nix-daemon[861]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5310worker2 # [ 120.412317] nix-daemon[861]: reaped child process 1356, status = succeeded5311lb # [ 120.449284] niks3-server[1003]: 2026/09/20 12:24:18 INFO Received uploads request method=POST path=/api/pending_closures5312worker2 # [ 120.436437] nix-grpc-daemon[1288]: time=2026-09-20T12:24:19.897Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5313worker2 # [ 120.437957] nix-grpc-daemon[1288]: time=2026-09-20T12:24:19.897Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5314lb # [ 120.492555] niks3-server[1003]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5315lb # [ 120.504556] niks3-server[1003]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5316lb # [ 120.518252] niks3-server[1003]: 2026/09/20 12:24:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5317worker2 # [ 120.502014] nix-grpc-daemon[1288]: time=2026-09-20T12:24:19.963Z level=INFO msg="Uploading 1 narinfos"5318lb # [ 120.530388] niks3-server[1003]: 2026/09/20 12:24:19 INFO Signed narinfos id=36 count=15319lb # [ 120.544843] niks3-server[1003]: 2026/09/20 12:24:19 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5320lb # [ 120.554880] niks3-server[1003]: 2026/09/20 12:24:19 INFO Completed upload id=365321worker2 # [ 120.529107] nix-grpc-daemon[1288]: time=2026-09-20T12:24:19.991Z level=INFO msg="Upload complete. (312ms)"5322worker2 # [ 120.544582] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47634 duration_s=8 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15323lb # [ 120.579693] niks3-server[1003]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5324worker2 # [ 120.556794] nix-grpc-daemon[1288]: time=2026-09-20T12:24:20.019Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5325worker2 # [ 120.564632] nix-daemon[861]: reaped child process 1315, status = succeeded5326client # [ 120.640444] systemd[1]: mid.service: Deactivated successfully.5327client # [ 120.644741] systemd[1]: mid.service: Consumed 164ms CPU time over 9.929s wall clock time, 39M memory peak, 9.1K incoming IP traffic, 9.3K outgoing IP traffic.5328client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5329client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5330client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)5331(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.73 seconds)5332subtest: interrupting the client stops the build on the worker5333client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5334client # [ 121.414725] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5335client # Running as unit: intr.service; invocation ID: 2a9522f979974b3ab76038b6a794480b5336client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5337client # [ 121.638916] nix[1233]: don't know how to build these paths:5338client # [ 121.639880] nix[1233]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5339worker2 # [ 121.580974] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:476345340worker1 # [ 121.535728] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:21Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05341worker1 # [ 121.541191] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:21Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15342worker1 # [ 121.584951] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785343worker1 # [ 121.601298] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5344worker1 # [ 121.625639] nix-grpc-daemon[1538]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5)5345worker1 # [ 121.658122] nix-grpc-daemon[1538]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 2/5)5346worker1 # [ 121.723464] nix-grpc-daemon[1538]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 170 ms (attempt 3/5)5347worker1 # [ 121.901219] nix-grpc-daemon[1538]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 645 ms (attempt 4/5)5348lb # [ 122.432329] envoy[920]: conn peer=[2001:db8:1::3]:60558 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=972 tx=385 ms=53415349lb # [ 122.437287] envoy[920]: conn peer=[2001:db8:1::1]:48148 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3035 tx=1400 ms=96595350worker1 # [ 122.549963] nix-grpc-daemon[1538]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5351worker1 # [ 122.573854] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785352client # [ 122.705336] nix[1233]: copying 1 paths to 'lb:50051'...5353worker1 # [ 122.586841] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473785354client # [ 122.710647] nix[1233]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5355worker1 # [ 122.603856] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5356worker1 # [ 122.623983] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:22Z level=info event=niks3_push_started pid=16125357worker1 # [ 122.829144] nix-grpc-daemon[1612]: time=2026-09-20T12:24:22.322Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5358worker1 # [ 123.008980] nix-daemon[831]: accepted connection from pid 1625, user nix-grpc-daemon (trusted)5359worker1 # [ 123.027356] nix-daemon[831]: reaped child process 1628, status = succeeded5360worker1 # [ 123.205816] nix-daemon[831]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)5361worker1 # [ 123.223744] nix-daemon[831]: reaped child process 1633, status = succeeded5362lb # [ 123.325970] niks3-server[1003]: 2026/09/20 12:24:21 INFO Received uploads request method=POST path=/api/pending_closures5363worker1 # [ 123.252079] nix-grpc-daemon[1612]: time=2026-09-20T12:24:22.745Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5364worker1 # [ 123.253581] nix-grpc-daemon[1612]: time=2026-09-20T12:24:22.745Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5365lb # [ 123.369796] niks3-server[1003]: 2026/09/20 12:24:21 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5366lb # [ 123.379607] niks3-server[1003]: 2026/09/20 12:24:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5367worker1 # [ 123.299860] nix-grpc-daemon[1612]: time=2026-09-20T12:24:22.793Z level=INFO msg="Uploading 1 narinfos"5368lb # [ 123.395806] niks3-server[1003]: 2026/09/20 12:24:21 INFO Signed narinfos id=37 count=15369lb # [ 123.413208] niks3-server[1003]: 2026/09/20 12:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5370lb # [ 123.423789] niks3-server[1003]: 2026/09/20 12:24:21 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5371lb # [ 123.429227] niks3-server[1003]: 2026/09/20 12:24:21 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5372lb # [ 123.432981] niks3-server[1003]: 2026/09/20 12:24:21 INFO Completed upload id=375373worker1 # [ 123.345239] nix-grpc-daemon[1612]: time=2026-09-20T12:24:22.839Z level=INFO msg="Upload complete. (512ms)"5374worker1 # [ 123.355110] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=4245375worker1 # [ 123.372279] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785376worker1 # [ 123.378359] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5377worker1 # [ 123.383169] nix-daemon[831]: reaped child process 1610, status = succeeded5378worker1 # [ 123.395512] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5379client # [ 123.514161] nix[1233]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5380client: must succeed: systemctl kill -s INT intr5381client # [ 125.141119] systemd[1]: intr.service: Sent signal SIGINT to main process 1233 (nix) on client request.5382client # [ 125.148942] nix[1233]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5383client # [ 125.152908] nix[1233]: error: interrupted by the user5384client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5385client # [ 125.191040] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5386client # [ 125.193989] systemd[1]: intr.service: Failed with result 'exit-code'.5387client # [ 125.197923] systemd[1]: intr.service: Consumed 142ms CPU time over 3.781s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.5388worker1 # [ 125.219814] nix-daemon[831]: reaped child process 1635, status = succeeded5389worker1 # [ 125.227737] nix-daemon[1637]: unexpected Nix daemon error: error: interrupted by the user5390worker1 # [ 125.232561] nix-daemon[831]: reaped child process 1637, status = failed with exit code 15391(finished: subtest: interrupting the client stops the build on the worker, in 5.11 seconds)5392subtest: a deploy mid-build drains: the build finishes, the new generation takes over5393client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5394client # [ 126.547209] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5395client # Running as unit: sw.service; invocation ID: 66ab2e62daf74e93996ae91c44e7b1e15396client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5397worker2 # [ 126.722790] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:476345398client # [ 126.787171] nix[1252]: don't know how to build these paths:5399client # [ 126.788438] nix[1252]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5400worker1 # [ 126.681310] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:26Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05401worker1 # [ 126.687387] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:26Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15402worker2 # [ 126.797299] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476345403worker2 # [ 126.814987] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476345404client # [ 126.886071] nix[1252]: copying 1 paths to 'lb:50051'...5405worker2 # [ 126.831220] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476345406client # [ 126.891793] nix[1252]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5407worker2 # [ 126.847434] nix-daemon[861]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)5408worker2 # [ 127.064862] nix-daemon[861]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5409worker2 # [ 127.083847] nix-daemon[861]: reaped child process 1391, status = succeeded5410worker2 # [ 127.256488] nix-daemon[861]: accepted connection from pid 1393, user nix-grpc-daemon (trusted)5411worker2 # [ 127.274004] nix-daemon[861]: reaped child process 1396, status = succeeded5412lb # [ 127.313896] niks3-server[1003]: 2026/09/20 12:24:25 INFO Received uploads request method=POST path=/api/pending_closures5413worker2 # [ 127.301031] nix-grpc-daemon[1288]: time=2026-09-20T12:24:26.762Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5414worker2 # [ 127.302531] nix-grpc-daemon[1288]: time=2026-09-20T12:24:26.762Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5415lb # [ 127.343944] niks3-server[1003]: 2026/09/20 12:24:25 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5416lb # [ 127.360460] niks3-server[1003]: 2026/09/20 12:24:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5417worker2 # [ 127.343538] nix-grpc-daemon[1288]: time=2026-09-20T12:24:26.805Z level=INFO msg="Uploading 1 narinfos"5418lb # [ 127.374139] niks3-server[1003]: 2026/09/20 12:24:25 INFO Signed narinfos id=38 count=15419lb # [ 127.380291] niks3-server[1003]: 2026/09/20 12:24:25 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5420lb # [ 127.390632] niks3-server[1003]: 2026/09/20 12:24:25 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5421lb # [ 127.397677] niks3-server[1003]: 2026/09/20 12:24:25 INFO Completed upload id=385422worker2 # [ 127.373764] nix-grpc-daemon[1288]: time=2026-09-20T12:24:26.836Z level=INFO msg="Upload complete. (508ms)"5423lb # [ 127.400811] niks3-server[1003]: 2026/09/20 12:24:25 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5424worker2 # [ 127.381793] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47634 duration_s=0 paths=1 nar_bytes_in=4165425worker2 # [ 127.393121] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476345426worker2 # [ 127.405096] nix-daemon[861]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)5427worker2 # [ 127.410771] nix-daemon[861]: reaped child process 1386, status = succeeded5428client # [ 127.478202] nix[1252]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5429worker2 # [ 127.422463] nix-daemon[861]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)5430worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25431worker2 # Checking switch inhibitors... done5432worker2 # [ 129.962844] nixos[1431]: switching to system configuration /nix/store/cqnvc85jyhybfa65ynwa5hqz0xa0dibx-nixos-system-worker2-test5433worker2 # [ 129.965881] systemd[1]: Stopped target Remote File Systems.5434worker2 # activating the configuration...5435worker2 # [ 129.973251] systemd[1]: Stopped target Local File Systems.5436worker2 # setting up /etc...5437worker2 # [ 130.751569] systemd[1]: Reload requested from client PID 1431 ('.switch-to-conf') (unit backdoor.service)...5438worker2 # [ 130.753492] systemd[1]: Reloading...5439worker2 # [ 131.640109] systemd[1]: Reloading finished in 884 ms.5440worker2 # restarting sysinit-reactivation.target5441worker2 # [ 131.721840] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5442worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5443worker2 # [ 131.881752] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5444worker2 # [ 131.882888] systemd[1]: Reached target Reactivate sysinit units.5445worker2 # [ 131.889139] systemd[1]: Reloading D-Bus System Message Bus...5446worker2 # [ 131.890361] dbus-broker-launch[499]: Caught SIGHUP, trigger reload.5447worker2 # [ 131.894099] systemd[1]: Reloading Nix worker-protocol over gRPC...5448worker2 # [ 131.924178] dbus-broker-launch[499]: Looking up NSS user entry for 'systemd-timesync'...5449worker2 # [ 131.926223] dbus-broker-launch[499]: NSS returned no entry for 'systemd-timesync'5450worker2 # [ 131.936953] dbus-broker-launch[499]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5451worker2 # [ 131.952073] systemd[1]: Reloaded Nix worker-protocol over gRPC.5452worker2 # [ 131.971153] systemd[1]: Reloaded D-Bus System Message Bus.5453worker2 # [ 131.978574] systemd[1]: Reached target Remote File Systems.5454worker2 # [ 131.981737] systemd[1]: Starting linger-users.service...5455worker2 # [ 131.988248] systemd[1]: Reached target Local File Systems.5456worker2 # [ 131.989943] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5457worker2 # [ 132.002646] systemd[1]: Starting Create SUID/SGID Wrappers...5458worker2 # [ 132.008257] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5459worker2 # [ 132.020637] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675460worker2 # [ 132.022807] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5461worker2 # [ 132.027806] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5462worker2 # [ 132.033404] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5463worker2 # [ 132.037927] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5464worker2 # [ 132.041993] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5465worker2 # [ 132.077741] systemd[1]: linger-users.service: Deactivated successfully.5466worker2 # [ 132.078761] systemd[1]: Finished linger-users.service.5467lb # [ 132.435666] envoy[920]: conn peer=[2001:db8:1::1]:43756 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=753 ms=35355468worker2 # [ 132.533439] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5469worker2 # [ 132.534549] systemd[1]: Finished Create SUID/SGID Wrappers.5470worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5471worker2 # [ 132.796602] nixos[1431]: finished switching to system configuration /nix/store/cqnvc85jyhybfa65ynwa5hqz0xa0dibx-nixos-system-worker2-test5472worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.65 seconds)5473worker2: must succeed: pgrep -f 'read -t [9]0 x'5474worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.07 seconds)5475client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25476worker2 # [ 132.908572] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:32Z level=info event=draining5477client # don't know how to build these paths:5478client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5479worker2 # [ 133.137675] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476345480worker1 # [ 133.071550] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473785481worker1 # [ 133.105255] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:32Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05482worker1 # [ 133.113608] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:32Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15483worker1 # [ 133.157464] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785484worker1 # [ 133.177351] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785485client # copying 1 paths to 'lb:50051'...5486worker1 # [ 133.197036] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473785487client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5488worker1 # [ 133.222722] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5489worker1 # [ 133.474066] nix-daemon[831]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5490worker1 # [ 133.495499] nix-daemon[831]: reaped child process 1694, status = succeeded5491worker1 # [ 133.704670] nix-daemon[831]: accepted connection from pid 1696, user nix-grpc-daemon (trusted)5492worker1 # [ 133.730240] nix-daemon[831]: reaped child process 1699, status = succeeded5493lb # [ 133.835653] niks3-server[1003]: 2026/09/20 12:24:32 INFO Received uploads request method=POST path=/api/pending_closures5494worker1 # [ 133.761972] nix-grpc-daemon[1612]: time=2026-09-20T12:24:33.255Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5495worker1 # [ 133.764879] nix-grpc-daemon[1612]: time=2026-09-20T12:24:33.257Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5496lb # [ 133.877808] niks3-server[1003]: 2026/09/20 12:24:32 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5497lb # [ 133.896438] niks3-server[1003]: 2026/09/20 12:24:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5498worker1 # [ 133.813772] nix-grpc-daemon[1612]: time=2026-09-20T12:24:33.307Z level=INFO msg="Uploading 1 narinfos"5499lb # [ 133.907321] niks3-server[1003]: 2026/09/20 12:24:32 INFO Signed narinfos id=39 count=15500lb # [ 133.913694] niks3-server[1003]: 2026/09/20 12:24:32 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5501lb # [ 133.923063] niks3-server[1003]: 2026/09/20 12:24:32 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5502worker1 # [ 133.845056] nix-grpc-daemon[1612]: time=2026-09-20T12:24:33.339Z level=INFO msg="Upload complete. (601ms)"5503lb # [ 133.935049] niks3-server[1003]: 2026/09/20 12:24:32 INFO Completed upload id=395504lb # [ 133.938378] niks3-server[1003]: 2026/09/20 12:24:32 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5505worker1 # [ 133.857452] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=5285506worker1 # [ 133.872743] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785507worker1 # [ 133.898669] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5508worker1 # [ 133.902738] nix-daemon[831]: reaped child process 1689, status = succeeded5509client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5510client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5511worker1 # [ 133.923059] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5512client # farm-a> LOG-farm-a-during-drain5513worker1 # [ 135.388681] nix-daemon[831]: reaped child process 1703, status = succeeded5514worker1 # [ 135.605237] nix-daemon[831]: accepted connection from pid 1718, user nix-grpc-daemon (trusted)5515worker1 # [ 135.629426] nix-daemon[831]: reaped child process 1721, status = succeeded5516lb # [ 135.734784] niks3-server[1003]: 2026/09/20 12:24:34 INFO Received uploads request method=POST path=/api/pending_closures5517worker1 # [ 135.660618] nix-grpc-daemon[1612]: time=2026-09-20T12:24:35.151Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5518worker1 # [ 135.662181] nix-grpc-daemon[1612]: time=2026-09-20T12:24:35.151Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5519lb # [ 135.779537] niks3-server[1003]: 2026/09/20 12:24:34 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5520lb # [ 135.794078] niks3-server[1003]: 2026/09/20 12:24:34 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5521lb # [ 135.811934] niks3-server[1003]: 2026/09/20 12:24:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5522worker1 # [ 135.731990] nix-grpc-daemon[1612]: time=2026-09-20T12:24:35.224Z level=INFO msg="Uploading 1 narinfos"5523lb # [ 135.822331] niks3-server[1003]: 2026/09/20 12:24:34 INFO Signed narinfos id=40 count=15524lb # [ 135.829028] niks3-server[1003]: 2026/09/20 12:24:34 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5525lb # [ 135.842233] niks3-server[1003]: 2026/09/20 12:24:34 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5526lb # [ 135.850563] niks3-server[1003]: 2026/09/20 12:24:34 INFO Completed upload id=405527worker1 # [ 135.760682] nix-grpc-daemon[1612]: time=2026-09-20T12:24:35.254Z level=INFO msg="Upload complete. (421ms)"5528lb # [ 135.857880] niks3-server[1003]: 2026/09/20 12:24:34 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5529worker1 # [ 135.785529] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=15530worker1 # [ 135.804343] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:35Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05531worker1 # [ 135.809489] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:35Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15532worker1 # [ 135.814235] nix-daemon[831]: reaped child process 1701, status = succeeded5533worker1 # [ 135.835520] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785534worker1 # [ 135.855248] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785535worker1 # [ 135.874025] nix-grpc-daemon[1612]: time=2026-09-20T12:24:35.368Z level=INFO msg="All 1 paths already cached"5536client # copying 1 paths to 'lb:50051'...5537worker1 # [ 135.887118] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473785538client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5539worker1 # [ 135.912921] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5540worker1 # [ 136.165295] nix-daemon[831]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5541worker1 # [ 136.186932] nix-daemon[831]: reaped child process 1730, status = succeeded5542worker1 # [ 136.395653] nix-daemon[831]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)5543worker1 # [ 136.418641] nix-daemon[831]: reaped child process 1735, status = succeeded5544lb # [ 136.523711] niks3-server[1003]: 2026/09/20 12:24:35 INFO Received uploads request method=POST path=/api/pending_closures5545worker1 # [ 136.448072] nix-grpc-daemon[1612]: time=2026-09-20T12:24:35.942Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5546worker1 # [ 136.450617] nix-grpc-daemon[1612]: time=2026-09-20T12:24:35.943Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5547lb # [ 136.570406] niks3-server[1003]: 2026/09/20 12:24:35 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5548lb # [ 136.589507] niks3-server[1003]: 2026/09/20 12:24:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5549worker1 # [ 136.507768] nix-grpc-daemon[1612]: time=2026-09-20T12:24:36.001Z level=INFO msg="Uploading 1 narinfos"5550lb # [ 136.602063] niks3-server[1003]: 2026/09/20 12:24:35 INFO Signed narinfos id=41 count=15551lb # [ 136.608775] niks3-server[1003]: 2026/09/20 12:24:35 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5552lb # [ 136.624442] niks3-server[1003]: 2026/09/20 12:24:35 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5553lb # [ 136.632195] niks3-server[1003]: 2026/09/20 12:24:35 INFO Completed upload id=415554worker1 # [ 136.544410] nix-grpc-daemon[1612]: time=2026-09-20T12:24:36.038Z level=INFO msg="Upload complete. (609ms)"5555lb # [ 136.635492] niks3-server[1003]: 2026/09/20 12:24:35 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5556worker1 # [ 136.557176] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=6405557worker1 # [ 136.572547] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785558worker1 # [ 136.587349] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5559worker1 # [ 136.593594] nix-daemon[831]: reaped child process 1725, status = succeeded5560client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5561client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5562worker1 # [ 136.609612] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5563client # farm-b> LOG-farm-b-during-drain5564worker1 # [ 138.259365] nix-daemon[831]: reaped child process 1739, status = succeeded5565worker1 # [ 138.431278] nix-daemon[831]: accepted connection from pid 1754, user nix-grpc-daemon (trusted)5566worker1 # [ 138.450902] nix-daemon[831]: reaped child process 1757, status = succeeded5567lb # [ 138.551642] niks3-server[1003]: 2026/09/20 12:24:37 INFO Received uploads request method=POST path=/api/pending_closures5568worker1 # [ 138.479533] nix-grpc-daemon[1612]: time=2026-09-20T12:24:37.972Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5569worker1 # [ 138.481727] nix-grpc-daemon[1612]: time=2026-09-20T12:24:37.972Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5570lb # [ 138.595752] niks3-server[1003]: 2026/09/20 12:24:37 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5571lb # [ 138.608996] niks3-server[1003]: 2026/09/20 12:24:37 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5572lb # [ 138.620120] niks3-server[1003]: 2026/09/20 12:24:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5573worker1 # [ 138.537992] nix-grpc-daemon[1612]: time=2026-09-20T12:24:38.031Z level=INFO msg="Uploading 1 narinfos"5574lb # [ 138.628765] niks3-server[1003]: 2026/09/20 12:24:37 INFO Signed narinfos id=42 count=15575lb # [ 138.637028] niks3-server[1003]: 2026/09/20 12:24:37 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5576lb # [ 138.646598] niks3-server[1003]: 2026/09/20 12:24:37 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5577lb # [ 138.654623] niks3-server[1003]: 2026/09/20 12:24:37 INFO Completed upload id=425578worker1 # [ 138.565578] nix-grpc-daemon[1612]: time=2026-09-20T12:24:38.059Z level=INFO msg="Upload complete. (341ms)"5579lb # [ 138.657455] niks3-server[1003]: 2026/09/20 12:24:37 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5580worker1 # [ 138.580785] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=2 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=15581worker1 # [ 138.603868] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:38Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05582worker1 # [ 138.609242] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:38Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15583worker1 # [ 138.614624] nix-daemon[831]: reaped child process 1737, status = succeeded5584worker1 # [ 138.642168] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785585worker1 # [ 138.658737] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785586worker1 # [ 138.673328] nix-grpc-daemon[1612]: time=2026-09-20T12:24:38.167Z level=INFO msg="All 2 paths already cached"5587client # copying 1 paths to 'lb:50051'...5588client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5589worker1 # [ 138.684972] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473785590worker1 # [ 138.703285] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5591worker1 # [ 138.911584] nix-daemon[831]: accepted connection from pid 1763, user nix-grpc-daemon (trusted)5592worker1 # [ 138.932207] nix-daemon[831]: reaped child process 1766, status = succeeded5593worker1 # [ 139.109904] nix-daemon[831]: accepted connection from pid 1768, user nix-grpc-daemon (trusted)5594worker1 # [ 139.127638] nix-daemon[831]: reaped child process 1771, status = succeeded5595lb # [ 139.226930] niks3-server[1003]: 2026/09/20 12:24:37 INFO Received uploads request method=POST path=/api/pending_closures5596worker1 # [ 139.148859] nix-grpc-daemon[1612]: time=2026-09-20T12:24:38.642Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5597worker1 # [ 139.150557] nix-grpc-daemon[1612]: time=2026-09-20T12:24:38.642Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5598lb # [ 139.254747] niks3-server[1003]: 2026/09/20 12:24:37 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5599worker1 # [ 139.179350] nix-grpc-daemon[1612]: time=2026-09-20T12:24:38.673Z level=INFO msg="Uploading 1 narinfos"5600lb # [ 139.270469] niks3-server[1003]: 2026/09/20 12:24:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5601lb # [ 139.281497] niks3-server[1003]: 2026/09/20 12:24:37 INFO Signed narinfos id=43 count=15602lb # [ 139.286747] niks3-server[1003]: 2026/09/20 12:24:37 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5603lb # [ 139.295577] niks3-server[1003]: 2026/09/20 12:24:37 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5604lb # [ 139.300861] niks3-server[1003]: 2026/09/20 12:24:37 INFO Completed upload id=435605worker1 # [ 139.211942] nix-grpc-daemon[1612]: time=2026-09-20T12:24:38.706Z level=INFO msg="Upload complete. (490ms)"5606lb # [ 139.303656] niks3-server[1003]: 2026/09/20 12:24:37 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5607worker1 # [ 139.223402] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=7685608worker1 # [ 139.234157] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785609worker1 # [ 139.239738] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5610worker1 # [ 139.244292] nix-daemon[831]: reaped child process 1761, status = succeeded5611client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5612client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5613worker1 # [ 139.257914] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5614client # farm-top> LOG-farm-top-during-drain5615worker1 # [ 139.898454] nix-daemon[831]: reaped child process 1775, status = succeeded5616worker1 # [ 140.080652] nix-daemon[831]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5617worker1 # [ 140.098176] nix-daemon[831]: reaped child process 1793, status = succeeded5618lb # [ 140.202180] niks3-server[1003]: 2026/09/20 12:24:38 INFO Received uploads request method=POST path=/api/pending_closures5619worker1 # [ 140.123972] nix-grpc-daemon[1612]: time=2026-09-20T12:24:39.616Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5620worker1 # [ 140.126071] nix-grpc-daemon[1612]: time=2026-09-20T12:24:39.616Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5621lb # [ 140.236801] niks3-server[1003]: 2026/09/20 12:24:38 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5622worker1 # [ 140.167201] nix-grpc-daemon[1612]: time=2026-09-20T12:24:39.660Z level=INFO msg="Uploading 1 narinfos"5623lb # [ 140.254595] niks3-server[1003]: 2026/09/20 12:24:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5624lb # [ 140.269028] niks3-server[1003]: 2026/09/20 12:24:38 INFO Signed narinfos id=44 count=15625lb # [ 140.276926] niks3-server[1003]: 2026/09/20 12:24:38 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5626lb # [ 140.282556] niks3-server[1003]: 2026/09/20 12:24:38 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5627lb # [ 140.291498] niks3-server[1003]: 2026/09/20 12:24:38 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5628lb # [ 140.297180] niks3-server[1003]: 2026/09/20 12:24:38 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5629lb # [ 140.302100] niks3-server[1003]: 2026/09/20 12:24:38 INFO Completed upload id=445630worker1 # [ 140.214536] nix-grpc-daemon[1612]: time=2026-09-20T12:24:39.708Z level=INFO msg="Upload complete. (341ms)"5631worker1 # [ 140.229230] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=15632worker1 # [ 140.247175] nix-daemon[831]: reaped child process 1773, status = succeeded5633client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 7.47 seconds)5634client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5635client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds)5636worker2: must succeed: pkill -f 'read -t [9]0 x'5637worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.07 seconds)5638client: waiting for success: ! systemctl is-active sw5639worker2 # [ 140.897296] nix-daemon[861]: reaped child process 1400, status = succeeded5640worker2 # [ 141.081495] nix-daemon[861]: accepted connection from pid 1572, user nix-grpc-daemon (trusted)5641worker2 # [ 141.100504] nix-daemon[861]: reaped child process 1575, status = succeeded5642lb # [ 141.137194] niks3-server[1003]: 2026/09/20 12:24:39 INFO Received uploads request method=POST path=/api/pending_closures5643worker2 # [ 141.123775] nix-grpc-daemon[1288]: time=2026-09-20T12:24:40.585Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5644worker2 # [ 141.125845] nix-grpc-daemon[1288]: time=2026-09-20T12:24:40.585Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5645lb # [ 141.168739] niks3-server[1003]: 2026/09/20 12:24:39 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5646lb # [ 141.187501] niks3-server[1003]: 2026/09/20 12:24:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5647worker2 # [ 141.171621] nix-grpc-daemon[1288]: time=2026-09-20T12:24:40.633Z level=INFO msg="Uploading 1 narinfos"5648lb # [ 141.203652] niks3-server[1003]: 2026/09/20 12:24:39 INFO Signed narinfos id=45 count=15649lb # [ 141.211781] niks3-server[1003]: 2026/09/20 12:24:39 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5650lb # [ 141.223451] niks3-server[1003]: 2026/09/20 12:24:39 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5651lb # [ 141.230147] niks3-server[1003]: 2026/09/20 12:24:39 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5652lb # [ 141.234914] niks3-server[1003]: 2026/09/20 12:24:39 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5653worker2 # [ 141.211051] nix-grpc-daemon[1288]: time=2026-09-20T12:24:40.673Z level=INFO msg="Upload complete. (357ms)"5654lb # [ 141.238583] niks3-server[1003]: 2026/09/20 12:24:39 INFO Completed upload id=455655worker2 # [ 141.225212] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47634 duration_s=13 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=15656worker2 # [ 141.243652] nix-daemon[861]: reaped child process 1398, status = succeeded5657client # [ 141.322229] systemd[1]: sw.service: Deactivated successfully.5658client # [ 141.327879] systemd[1]: sw.service: Consumed 161ms CPU time over 14.778s wall clock time, 37.1M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.5659client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds)5660client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5661client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5662worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5663worker2 # [ 141.912311] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:41Z level=info event=signal_exit5664worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.07 seconds)5665lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5666lb: must succeed: curl -sf localhost:9901/clusters5667lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5668lb # [ 142.434190] envoy[920]: conn peer=[2001:db8:1::1]:58604 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9586 tx=3871 ms=71755669lb # [ 142.439300] envoy[920]: conn peer=[2001:db8:1::1]:43772 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2939 tx=1328 ms=145145670lb: must succeed: curl -sf localhost:9901/clusters5671lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5672worker2 # [ 143.159029] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:42Z level=info event=scheduler_restarting5673worker1 # [ 143.094703] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:605805674worker1 # [ 143.095103] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:42Z level=info event=worker_gone addr=192.168.1.4:500515675worker2 # [ 143.182404] nix-grpc-daemon[1178]: ts=2026-09-20T12:24:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5676worker2 # [ 143.211645] nix-daemon[861]: reaped child process 1281, status = succeeded5677worker2 # [ 143.408511] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5678worker2 # [ 143.416737] systemd[1]: nix-grpc-daemon.service: Consumed 1.182s CPU time over 46.728s wall clock time, 31.6M memory peak, 27.6K incoming IP traffic, 51.2K outgoing IP traffic.5679worker2 # [ 143.541995] systemd[1]: Starting scheduler-token.service...5680worker2 # [ 143.652569] systemd[1]: scheduler-token.service: Deactivated successfully.5681worker2 # [ 143.660470] systemd[1]: Finished scheduler-token.service.5682worker2 # [ 143.663075] systemd[1]: scheduler-token.service: Consumed 53ms CPU time over 114ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5683worker2 # [ 143.670493] systemd[1]: Starting Nix worker-protocol over gRPC...5684worker2 # [ 143.857639] nix-grpc-daemon[1590]: ts=2026-09-20T12:24:43Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5685worker2 # [ 143.860449] nix-grpc-daemon[1590]: ts=2026-09-20T12:24:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5686worker2 # [ 143.863713] nix-grpc-daemon[1590]: ts=2026-09-20T12:24:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15687worker2 # [ 143.871853] nix-grpc-daemon[1590]: ts=2026-09-20T12:24:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5688worker2 # [ 143.880909] systemd[1]: Started Nix worker-protocol over gRPC.5689worker2 # [ 143.900096] nix-grpc-daemon[1590]: ts=2026-09-20T12:24:43Z level=info event=scheduler_connected addr=lb:500515690worker1 # [ 143.839437] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:43Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:605805691worker1 # [ 143.845577] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05692lb: must succeed: curl -sf localhost:9901/clusters5693lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5694lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 2.25 seconds)5695lb: must succeed: curl -sf localhost:9901/clusters5696lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5697worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5698worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5699(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.88 seconds)5700subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5701client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15702worker2 # [ 144.555704] nix-grpc-daemon[1590]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:334885703worker2 # [ 144.571587] nix-daemon[861]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)5704worker1 # [ 144.529562] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785705worker1 # [ 144.575868] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:44Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05706worker1 # [ 144.583208] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:44Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15707worker1 # [ 144.589127] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:44Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05708worker1 # [ 144.594251] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:44Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05709worker1 # [ 144.624748] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785710worker1 # [ 144.640376] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785711worker1 # [ 144.654795] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473785712worker1 # [ 144.669448] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5713worker1 # [ 144.876504] nix-daemon[831]: accepted connection from pid 1802, user nix-grpc-daemon (trusted)5714worker1 # [ 144.897293] nix-daemon[831]: reaped child process 1805, status = succeeded5715worker1 # [ 145.074700] nix-daemon[831]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5716worker1 # [ 145.091805] nix-daemon[831]: reaped child process 1810, status = succeeded5717lb # [ 145.198264] niks3-server[1003]: 2026/09/20 12:24:43 INFO Received uploads request method=POST path=/api/pending_closures5718worker1 # [ 145.121124] nix-grpc-daemon[1612]: time=2026-09-20T12:24:44.614Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5719worker1 # [ 145.123045] nix-grpc-daemon[1612]: time=2026-09-20T12:24:44.614Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5720lb # [ 145.230205] niks3-server[1003]: 2026/09/20 12:24:43 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5721lb # [ 145.243957] niks3-server[1003]: 2026/09/20 12:24:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5722worker1 # [ 145.162526] nix-grpc-daemon[1612]: time=2026-09-20T12:24:44.656Z level=INFO msg="Uploading 1 narinfos"5723lb # [ 145.257031] niks3-server[1003]: 2026/09/20 12:24:43 INFO Signed narinfos id=46 count=15724lb # [ 145.263183] niks3-server[1003]: 2026/09/20 12:24:43 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5725lb # [ 145.271396] niks3-server[1003]: 2026/09/20 12:24:43 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5726lb # [ 145.276370] niks3-server[1003]: 2026/09/20 12:24:43 INFO Completed upload id=465727worker1 # [ 145.188380] nix-grpc-daemon[1612]: time=2026-09-20T12:24:44.682Z level=INFO msg="Upload complete. (502ms)"5728lb # [ 145.279277] niks3-server[1003]: 2026/09/20 12:24:43 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5729worker1 # [ 145.196336] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=5125730worker1 # [ 145.211875] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785731worker1 # [ 145.218337] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5732worker1 # [ 145.222933] nix-daemon[831]: reaped child process 1800, status = succeeded5733worker1 # [ 145.234735] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5734worker1 # [ 146.263248] nix-daemon[831]: reaped child process 1814, status = succeeded5735worker1 # [ 146.428084] nix-daemon[831]: accepted connection from pid 1829, user nix-grpc-daemon (trusted)5736worker1 # [ 146.449461] nix-daemon[831]: reaped child process 1832, status = succeeded5737lb # [ 146.550026] niks3-server[1003]: 2026/09/20 12:24:45 INFO Received uploads request method=POST path=/api/pending_closures5738worker1 # [ 146.471981] nix-grpc-daemon[1612]: time=2026-09-20T12:24:45.965Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5739worker1 # [ 146.476670] nix-grpc-daemon[1612]: time=2026-09-20T12:24:45.967Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5740lb # [ 146.590867] niks3-server[1003]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5741lb # [ 146.603794] niks3-server[1003]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5742worker1 # [ 146.529886] nix-grpc-daemon[1612]: time=2026-09-20T12:24:46.023Z level=INFO msg="Uploading 1 narinfos"5743lb # [ 146.612905] niks3-server[1003]: 2026/09/20 12:24:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5744lb # [ 146.620991] niks3-server[1003]: 2026/09/20 12:24:45 INFO Signed narinfos id=47 count=15745lb # [ 146.623170] niks3-server[1003]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5746lb # [ 146.632212] niks3-server[1003]: 2026/09/20 12:24:45 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5747lb # [ 146.637279] niks3-server[1003]: 2026/09/20 12:24:45 INFO Completed upload id=475748worker1 # [ 146.549329] nix-grpc-daemon[1612]: time=2026-09-20T12:24:46.043Z level=INFO msg="Upload complete. (302ms)"5749lb # [ 146.639549] niks3-server[1003]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5750worker1 # [ 146.565002] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=15751worker1 # [ 146.578448] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:46Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15752worker1 # [ 146.588236] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785753worker1 # [ 146.591290] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:46Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05754worker1 # [ 146.597051] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785755worker1 # [ 146.601522] nix-daemon[831]: reaped child process 1812, status = succeeded5756worker1 # [ 146.604677] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473785757worker1 # [ 146.613691] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5758worker1 # [ 146.795827] nix-daemon[831]: accepted connection from pid 1838, user nix-grpc-daemon (trusted)5759worker1 # [ 146.817198] nix-daemon[831]: reaped child process 1841, status = succeeded5760worker1 # [ 146.996393] nix-daemon[831]: accepted connection from pid 1843, user nix-grpc-daemon (trusted)5761worker1 # [ 147.014272] nix-daemon[831]: reaped child process 1846, status = succeeded5762lb # [ 147.114955] niks3-server[1003]: 2026/09/20 12:24:45 INFO Received uploads request method=POST path=/api/pending_closures5763worker1 # [ 147.036245] nix-grpc-daemon[1612]: time=2026-09-20T12:24:46.530Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5764worker1 # [ 147.038245] nix-grpc-daemon[1612]: time=2026-09-20T12:24:46.532Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5765lb # [ 147.145039] niks3-server[1003]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5766lb # [ 147.156448] niks3-server[1003]: 2026/09/20 12:24:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5767worker1 # [ 147.075109] nix-grpc-daemon[1612]: time=2026-09-20T12:24:46.569Z level=INFO msg="Uploading 1 narinfos"5768lb # [ 147.167799] niks3-server[1003]: 2026/09/20 12:24:45 INFO Signed narinfos id=48 count=15769lb # [ 147.174557] niks3-server[1003]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5770lb # [ 147.181360] niks3-server[1003]: 2026/09/20 12:24:45 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5771lb # [ 147.188224] niks3-server[1003]: 2026/09/20 12:24:45 INFO Completed upload id=485772worker1 # [ 147.099439] nix-grpc-daemon[1612]: time=2026-09-20T12:24:46.593Z level=INFO msg="Upload complete. (476ms)"5773lb # [ 147.190793] niks3-server[1003]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5774worker1 # [ 147.108251] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=5125775worker1 # [ 147.122954] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785776worker1 # [ 147.129165] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5777worker1 # [ 147.134145] nix-daemon[831]: reaped child process 1836, status = succeeded5778worker1 # [ 147.145866] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5779worker1 # [ 148.193972] nix-daemon[831]: reaped child process 1850, status = succeeded5780worker1 # [ 148.393117] nix-daemon[831]: accepted connection from pid 1865, user nix-grpc-daemon (trusted)5781worker1 # [ 148.411242] nix-daemon[831]: reaped child process 1868, status = succeeded5782lb # [ 148.511556] niks3-server[1003]: 2026/09/20 12:24:47 INFO Received uploads request method=POST path=/api/pending_closures5783worker1 # [ 148.436510] nix-grpc-daemon[1612]: time=2026-09-20T12:24:47.927Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5784worker1 # [ 148.438528] nix-grpc-daemon[1612]: time=2026-09-20T12:24:47.927Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5785lb # [ 148.548959] niks3-server[1003]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5786lb # [ 148.567063] niks3-server[1003]: 2026/09/20 12:24:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5787worker1 # [ 148.486359] nix-grpc-daemon[1612]: time=2026-09-20T12:24:47.980Z level=INFO msg="Uploading 1 narinfos"5788lb # [ 148.579912] niks3-server[1003]: 2026/09/20 12:24:47 INFO Signed narinfos id=49 count=15789lb # [ 148.585855] niks3-server[1003]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5790lb # [ 148.590151] niks3-server[1003]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5791lb # [ 148.597080] niks3-server[1003]: 2026/09/20 12:24:47 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5792lb # [ 148.601071] niks3-server[1003]: 2026/09/20 12:24:47 INFO Completed upload id=495793worker1 # [ 148.512604] nix-grpc-daemon[1612]: time=2026-09-20T12:24:48.006Z level=INFO msg="Upload complete. (352ms)"5794lb # [ 148.603483] niks3-server[1003]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5795worker1 # [ 148.531760] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=15796worker1 # [ 148.548775] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:48Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15797worker1 # [ 148.557449] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785798worker1 # [ 148.561992] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:48Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05799worker1 # [ 148.566516] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785800worker1 # [ 148.571021] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473785801worker1 # [ 148.575072] nix-daemon[831]: reaped child process 1848, status = succeeded5802worker1 # [ 148.581163] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5803worker1 # [ 148.770551] nix-daemon[831]: accepted connection from pid 1874, user nix-grpc-daemon (trusted)5804worker1 # [ 148.790396] nix-daemon[831]: reaped child process 1877, status = succeeded5805worker1 # [ 148.977288] nix-daemon[831]: accepted connection from pid 1879, user nix-grpc-daemon (trusted)5806worker1 # [ 148.996185] nix-daemon[831]: reaped child process 1882, status = succeeded5807lb # [ 149.098795] niks3-server[1003]: 2026/09/20 12:24:47 INFO Received uploads request method=POST path=/api/pending_closures5808worker1 # [ 149.019411] nix-grpc-daemon[1612]: time=2026-09-20T12:24:48.513Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5809worker1 # [ 149.021073] nix-grpc-daemon[1612]: time=2026-09-20T12:24:48.513Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5810lb # [ 149.123917] niks3-server[1003]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5811worker1 # [ 149.048849] nix-grpc-daemon[1612]: time=2026-09-20T12:24:48.542Z level=INFO msg="Uploading 1 narinfos"5812lb # [ 149.138840] niks3-server[1003]: 2026/09/20 12:24:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5813lb # [ 149.150857] niks3-server[1003]: 2026/09/20 12:24:47 INFO Signed narinfos id=50 count=15814worker1 # [ 149.071423] nix-grpc-daemon[1612]: time=2026-09-20T12:24:48.565Z level=INFO msg="Upload complete. (479ms)"5815lb # [ 149.160084] niks3-server[1003]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5816lb # [ 149.165232] niks3-server[1003]: 2026/09/20 12:24:47 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5817worker1 # [ 149.079989] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=5125818lb # [ 149.170634] niks3-server[1003]: 2026/09/20 12:24:47 INFO Completed upload id=505819lb # [ 149.172916] niks3-server[1003]: 2026/09/20 12:24:47 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5820worker1 # [ 149.091102] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785821worker1 # [ 149.096619] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5822worker1 # [ 149.101325] nix-daemon[831]: reaped child process 1872, status = succeeded5823worker1 # [ 149.114001] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5824worker1 # [ 150.554337] nix-daemon[831]: reaped child process 1886, status = succeeded5825worker1 # [ 150.748134] nix-daemon[831]: accepted connection from pid 1901, user nix-grpc-daemon (trusted)5826worker1 # [ 150.768607] nix-daemon[831]: reaped child process 1904, status = succeeded5827lb # [ 150.869051] niks3-server[1003]: 2026/09/20 12:24:49 INFO Received uploads request method=POST path=/api/pending_closures5828worker1 # [ 150.790652] nix-grpc-daemon[1612]: time=2026-09-20T12:24:50.284Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5829worker1 # [ 150.793436] nix-grpc-daemon[1612]: time=2026-09-20T12:24:50.286Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5830lb # [ 150.902591] niks3-server[1003]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5831lb # [ 150.920132] niks3-server[1003]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5832lb # [ 150.928088] niks3-server[1003]: 2026/09/20 12:24:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5833worker1 # [ 150.845645] nix-grpc-daemon[1612]: time=2026-09-20T12:24:50.339Z level=INFO msg="Uploading 1 narinfos"5834lb # [ 150.939604] niks3-server[1003]: 2026/09/20 12:24:49 INFO Signed narinfos id=51 count=15835lb # [ 150.945566] niks3-server[1003]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5836lb # [ 150.953573] niks3-server[1003]: 2026/09/20 12:24:49 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5837lb # [ 150.961348] niks3-server[1003]: 2026/09/20 12:24:49 INFO Completed upload id=515838worker1 # [ 150.871869] nix-grpc-daemon[1612]: time=2026-09-20T12:24:50.365Z level=INFO msg="Upload complete. (347ms)"5839lb # [ 150.964676] niks3-server[1003]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5840worker1 # [ 150.889283] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=15841worker1 # [ 150.905672] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:50Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15842worker1 # [ 150.917489] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785843worker1 # [ 150.923552] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:50Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05844worker1 # [ 150.929349] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785845worker1 # [ 150.934493] nix-daemon[831]: reaped child process 1884, status = succeeded5846worker1 # [ 150.936648] nix-grpc-daemon[1612]: time=2026-09-20T12:24:50.427Z level=INFO msg="All 1 paths already cached"5847worker1 # [ 150.941728] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473785848worker1 # [ 150.952165] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5849worker1 # [ 151.136917] nix-daemon[831]: accepted connection from pid 1910, user nix-grpc-daemon (trusted)5850worker1 # [ 151.157273] nix-daemon[831]: reaped child process 1913, status = succeeded5851worker1 # [ 151.337724] nix-daemon[831]: accepted connection from pid 1915, user nix-grpc-daemon (trusted)5852worker1 # [ 151.355746] nix-daemon[831]: reaped child process 1918, status = succeeded5853lb # [ 151.455504] niks3-server[1003]: 2026/09/20 12:24:49 INFO Received uploads request method=POST path=/api/pending_closures5854worker1 # [ 151.375991] nix-grpc-daemon[1612]: time=2026-09-20T12:24:50.869Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5855worker1 # [ 151.377759] nix-grpc-daemon[1612]: time=2026-09-20T12:24:50.869Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5856lb # [ 151.482900] niks3-server[1003]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5857worker1 # [ 151.405709] nix-grpc-daemon[1612]: time=2026-09-20T12:24:50.899Z level=INFO msg="Uploading 1 narinfos"5858lb # [ 151.497870] niks3-server[1003]: 2026/09/20 12:24:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5859lb # [ 151.509040] niks3-server[1003]: 2026/09/20 12:24:49 INFO Signed narinfos id=52 count=15860lb # [ 151.519561] niks3-server[1003]: 2026/09/20 12:24:50 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5861lb # [ 151.524527] niks3-server[1003]: 2026/09/20 12:24:50 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5862worker1 # [ 151.441461] nix-grpc-daemon[1612]: time=2026-09-20T12:24:50.935Z level=INFO msg="Upload complete. (479ms)"5863lb # [ 151.530122] niks3-server[1003]: 2026/09/20 12:24:50 INFO Completed upload id=525864lb # [ 151.534690] niks3-server[1003]: 2026/09/20 12:24:50 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5865worker1 # [ 151.448286] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=6245866worker1 # [ 151.456673] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785867worker1 # [ 151.466950] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5868worker1 # [ 151.471456] nix-daemon[831]: reaped child process 1908, status = succeeded5869worker1 # [ 151.484462] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5870lb # [ 152.434223] envoy[920]: conn peer=[2001:db8:1::4]:59626 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=13762 tx=957 ms=462665871worker1 # [ 153.131563] nix-daemon[831]: reaped child process 1922, status = succeeded5872worker1 # [ 153.314710] nix-daemon[831]: accepted connection from pid 1937, user nix-grpc-daemon (trusted)5873worker1 # [ 153.332940] nix-daemon[831]: reaped child process 1940, status = succeeded5874lb # [ 153.434690] niks3-server[1003]: 2026/09/20 12:24:51 INFO Received uploads request method=POST path=/api/pending_closures5875worker1 # [ 153.360413] nix-grpc-daemon[1612]: time=2026-09-20T12:24:52.851Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5876worker1 # [ 153.361876] nix-grpc-daemon[1612]: time=2026-09-20T12:24:52.851Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5877lb # [ 153.465741] niks3-server[1003]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5878lb # [ 153.481108] niks3-server[1003]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5879lb # [ 153.494061] niks3-server[1003]: 2026/09/20 12:24:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5880worker1 # [ 153.411048] nix-grpc-daemon[1612]: time=2026-09-20T12:24:52.904Z level=INFO msg="Uploading 1 narinfos"5881lb # [ 153.503566] niks3-server[1003]: 2026/09/20 12:24:52 INFO Signed narinfos id=53 count=15882lb # [ 153.508220] niks3-server[1003]: 2026/09/20 12:24:52 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5883lb # [ 153.512160] niks3-server[1003]: 2026/09/20 12:24:52 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5884lb # [ 153.519176] niks3-server[1003]: 2026/09/20 12:24:52 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5885lb # [ 153.522854] niks3-server[1003]: 2026/09/20 12:24:52 INFO Completed upload id=535886worker1 # [ 153.434880] nix-grpc-daemon[1612]: time=2026-09-20T12:24:52.929Z level=INFO msg="Upload complete. (339ms)"5887worker1 # [ 153.448909] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=15888worker1 # [ 153.464889] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:52Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15889worker1 # [ 153.472233] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785890worker1 # [ 153.475077] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:52Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05891worker1 # [ 153.479417] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785892worker1 # [ 153.483164] nix-daemon[831]: reaped child process 1920, status = succeeded5893worker1 # [ 153.484802] nix-grpc-daemon[1612]: time=2026-09-20T12:24:52.976Z level=INFO msg="All 1 paths already cached"5894worker1 # [ 153.487643] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473785895worker1 # [ 153.500485] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5896worker1 # [ 153.691615] nix-daemon[831]: accepted connection from pid 1946, user nix-grpc-daemon (trusted)5897worker1 # [ 153.709008] nix-daemon[831]: reaped child process 1949, status = succeeded5898worker1 # [ 153.885550] nix-daemon[831]: accepted connection from pid 1951, user nix-grpc-daemon (trusted)5899worker1 # [ 153.902692] nix-daemon[831]: reaped child process 1954, status = succeeded5900lb # [ 154.001991] niks3-server[1003]: 2026/09/20 12:24:52 INFO Received uploads request method=POST path=/api/pending_closures5901worker1 # [ 153.922580] nix-grpc-daemon[1612]: time=2026-09-20T12:24:53.416Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5902worker1 # [ 153.924152] nix-grpc-daemon[1612]: time=2026-09-20T12:24:53.416Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5903lb # [ 154.027898] niks3-server[1003]: 2026/09/20 12:24:52 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5904worker1 # [ 153.951734] nix-grpc-daemon[1612]: time=2026-09-20T12:24:53.445Z level=INFO msg="Uploading 1 narinfos"5905lb # [ 154.043737] niks3-server[1003]: 2026/09/20 12:24:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5906lb # [ 154.054979] niks3-server[1003]: 2026/09/20 12:24:52 INFO Signed narinfos id=54 count=15907lb # [ 154.059098] niks3-server[1003]: 2026/09/20 12:24:52 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5908worker1 # [ 153.979492] nix-grpc-daemon[1612]: time=2026-09-20T12:24:53.473Z level=INFO msg="Upload complete. (468ms)"5909lb # [ 154.067565] niks3-server[1003]: 2026/09/20 12:24:52 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5910lb # [ 154.072330] niks3-server[1003]: 2026/09/20 12:24:52 INFO Completed upload id=545911lb # [ 154.075222] niks3-server[1003]: 2026/09/20 12:24:52 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5912worker1 # [ 153.986599] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=6245913worker1 # [ 153.999890] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785914worker1 # [ 154.005326] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5915worker1 # [ 154.010139] nix-daemon[831]: reaped child process 1944, status = succeeded5916worker1 # [ 154.022606] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5917worker1 # [ 155.247863] nix-daemon[831]: reaped child process 1958, status = succeeded5918worker1 # [ 155.410469] nix-daemon[831]: accepted connection from pid 1973, user nix-grpc-daemon (trusted)5919worker1 # [ 155.429373] nix-daemon[831]: reaped child process 1976, status = succeeded5920worker1 # [ 155.454589] nix-grpc-daemon[1612]: time=2026-09-20T12:24:54.947Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5921worker1 # [ 155.456255] nix-grpc-daemon[1612]: time=2026-09-20T12:24:54.947Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5922lb # [ 155.531909] niks3-server[1003]: 2026/09/20 12:24:54 INFO Received uploads request method=POST path=/api/pending_closures5923lb # [ 155.566007] niks3-server[1003]: 2026/09/20 12:24:54 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5924lb # [ 155.580290] niks3-server[1003]: 2026/09/20 12:24:54 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5925lb # [ 155.588707] niks3-server[1003]: 2026/09/20 12:24:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5926worker1 # [ 155.506378] nix-grpc-daemon[1612]: time=2026-09-20T12:24:55.000Z level=INFO msg="Uploading 1 narinfos"5927lb # [ 155.594258] niks3-server[1003]: 2026/09/20 12:24:54 INFO Signed narinfos id=55 count=15928lb # [ 155.598941] niks3-server[1003]: 2026/09/20 12:24:54 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5929lb # [ 155.609490] niks3-server[1003]: 2026/09/20 12:24:54 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5930lb # [ 155.615273] niks3-server[1003]: 2026/09/20 12:24:54 INFO Completed upload id=555931lb # [ 155.618545] niks3-server[1003]: 2026/09/20 12:24:54 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5932worker1 # [ 155.526392] nix-grpc-daemon[1612]: time=2026-09-20T12:24:55.020Z level=INFO msg="Upload complete. (294ms)"5933worker1 # [ 155.540777] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=15934worker1 # [ 155.552301] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:55Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15935worker1 # [ 155.556929] nix-daemon[831]: reaped child process 1956, status = succeeded5936worker1 # [ 155.581492] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785937worker1 # [ 155.593583] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:55Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05938worker1 # [ 155.603869] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785939worker1 # [ 155.617434] nix-grpc-daemon[1612]: time=2026-09-20T12:24:55.111Z level=INFO msg="All 1 paths already cached"5940worker1 # [ 155.626272] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473785941worker1 # [ 155.640118] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5942worker1 # [ 155.839697] nix-daemon[831]: accepted connection from pid 1982, user nix-grpc-daemon (trusted)5943worker1 # [ 155.860137] nix-daemon[831]: reaped child process 1985, status = succeeded5944worker1 # [ 156.034257] nix-daemon[831]: accepted connection from pid 1987, user nix-grpc-daemon (trusted)5945worker1 # [ 156.050427] nix-daemon[831]: reaped child process 1990, status = succeeded5946lb # [ 156.154200] niks3-server[1003]: 2026/09/20 12:24:54 INFO Received uploads request method=POST path=/api/pending_closures5947worker1 # [ 156.075546] nix-grpc-daemon[1612]: time=2026-09-20T12:24:55.569Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5948worker1 # [ 156.077215] nix-grpc-daemon[1612]: time=2026-09-20T12:24:55.569Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5949lb # [ 156.182248] niks3-server[1003]: 2026/09/20 12:24:54 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5950lb # [ 156.195278] niks3-server[1003]: 2026/09/20 12:24:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5951worker1 # [ 156.118379] nix-grpc-daemon[1612]: time=2026-09-20T12:24:55.612Z level=INFO msg="Uploading 1 narinfos"5952lb # [ 156.208505] niks3-server[1003]: 2026/09/20 12:24:54 INFO Signed narinfos id=56 count=15953lb # [ 156.211486] niks3-server[1003]: 2026/09/20 12:24:54 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5954lb # [ 156.226633] niks3-server[1003]: 2026/09/20 12:24:54 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5955lb # [ 156.232528] niks3-server[1003]: 2026/09/20 12:24:54 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5956lb # [ 156.237515] niks3-server[1003]: 2026/09/20 12:24:54 INFO Completed upload id=565957worker1 # [ 156.149584] nix-grpc-daemon[1612]: time=2026-09-20T12:24:55.643Z level=INFO msg="Upload complete. (493ms)"5958worker1 # [ 156.156281] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=6245959worker1 # [ 156.172274] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785960worker1 # [ 156.178142] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5961worker1 # [ 156.183131] nix-daemon[831]: reaped child process 1980, status = succeeded5962worker1 # [ 156.198173] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5963worker1 # [ 157.242527] nix-daemon[831]: reaped child process 1994, status = succeeded5964worker1 # [ 157.427483] nix-daemon[831]: accepted connection from pid 2009, user nix-grpc-daemon (trusted)5965worker1 # [ 157.444784] nix-daemon[831]: reaped child process 2012, status = succeeded5966lb # [ 157.550159] niks3-server[1003]: 2026/09/20 12:24:56 INFO Received uploads request method=POST path=/api/pending_closures5967worker1 # [ 157.471112] nix-grpc-daemon[1612]: time=2026-09-20T12:24:56.963Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5968worker1 # [ 157.472806] nix-grpc-daemon[1612]: time=2026-09-20T12:24:56.963Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5969lb # [ 157.583857] niks3-server[1003]: 2026/09/20 12:24:56 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5970lb # [ 157.601735] niks3-server[1003]: 2026/09/20 12:24:56 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5971lb # [ 157.613721] niks3-server[1003]: 2026/09/20 12:24:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5972worker1 # [ 157.530796] nix-grpc-daemon[1612]: time=2026-09-20T12:24:57.024Z level=INFO msg="Uploading 1 narinfos"5973lb # [ 157.624871] niks3-server[1003]: 2026/09/20 12:24:56 INFO Signed narinfos id=57 count=15974lb # [ 157.631366] niks3-server[1003]: 2026/09/20 12:24:56 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5975lb # [ 157.638186] niks3-server[1003]: 2026/09/20 12:24:56 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5976lb # [ 157.645610] niks3-server[1003]: 2026/09/20 12:24:56 INFO Completed upload id=575977worker1 # [ 157.557470] nix-grpc-daemon[1612]: time=2026-09-20T12:24:57.051Z level=INFO msg="Upload complete. (344ms)"5978lb # [ 157.648533] niks3-server[1003]: 2026/09/20 12:24:56 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5979worker1 # [ 157.573231] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=15980worker1 # [ 157.588318] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:57Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15981worker1 # [ 157.593379] nix-daemon[831]: reaped child process 1992, status = succeeded5982worker1 # [ 157.616143] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473785983worker1 # [ 157.627385] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:57Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05984worker1 # [ 157.638865] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473785985worker1 # [ 157.653271] nix-grpc-daemon[1612]: time=2026-09-20T12:24:57.147Z level=INFO msg="All 2 paths already cached"5986worker1 # [ 157.662270] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473785987worker1 # [ 157.676171] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5988worker1 # [ 157.873666] nix-daemon[831]: accepted connection from pid 2018, user nix-grpc-daemon (trusted)5989worker1 # [ 157.892791] nix-daemon[831]: reaped child process 2021, status = succeeded5990worker1 # [ 158.069719] nix-daemon[831]: accepted connection from pid 2023, user nix-grpc-daemon (trusted)5991worker1 # [ 158.088560] nix-daemon[831]: reaped child process 2026, status = succeeded5992lb # [ 158.190833] niks3-server[1003]: 2026/09/20 12:24:56 INFO Received uploads request method=POST path=/api/pending_closures5993worker1 # [ 158.111738] nix-grpc-daemon[1612]: time=2026-09-20T12:24:57.605Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5994worker1 # [ 158.113472] nix-grpc-daemon[1612]: time=2026-09-20T12:24:57.605Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5995lb # [ 158.218335] niks3-server[1003]: 2026/09/20 12:24:56 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5996lb # [ 158.230295] niks3-server[1003]: 2026/09/20 12:24:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5997worker1 # [ 158.149599] nix-grpc-daemon[1612]: time=2026-09-20T12:24:57.643Z level=INFO msg="Uploading 1 narinfos"5998lb # [ 158.238030] niks3-server[1003]: 2026/09/20 12:24:56 INFO Signed narinfos id=58 count=15999lb # [ 158.244824] niks3-server[1003]: 2026/09/20 12:24:56 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6000lb # [ 158.259045] niks3-server[1003]: 2026/09/20 12:24:56 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6001worker1 # [ 158.179717] nix-grpc-daemon[1612]: time=2026-09-20T12:24:57.673Z level=INFO msg="Upload complete. (488ms)"6002lb # [ 158.267783] niks3-server[1003]: 2026/09/20 12:24:56 INFO Completed upload id=586003lb # [ 158.271460] niks3-server[1003]: 2026/09/20 12:24:56 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6004worker1 # [ 158.188275] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=7526005worker1 # [ 158.202159] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473786006worker1 # [ 158.208619] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)6007worker1 # [ 158.213662] nix-daemon[831]: reaped child process 2016, status = succeeded6008worker1 # [ 158.228228] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)6009worker1 # [ 159.075537] nix-daemon[831]: reaped child process 2030, status = succeeded6010worker1 # [ 159.250774] nix-daemon[831]: accepted connection from pid 2045, user nix-grpc-daemon (trusted)6011worker1 # [ 159.271250] nix-daemon[831]: reaped child process 2048, status = succeeded6012lb # [ 159.373269] niks3-server[1003]: 2026/09/20 12:24:57 INFO Received uploads request method=POST path=/api/pending_closures6013worker1 # [ 159.298265] nix-grpc-daemon[1612]: time=2026-09-20T12:24:58.790Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6014worker1 # [ 159.300390] nix-grpc-daemon[1612]: time=2026-09-20T12:24:58.791Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6015lb # [ 159.405557] niks3-server[1003]: 2026/09/20 12:24:57 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6016lb # [ 159.420568] niks3-server[1003]: 2026/09/20 12:24:57 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6017worker1 # [ 159.345899] nix-grpc-daemon[1612]: time=2026-09-20T12:24:58.839Z level=INFO msg="Uploading 1 narinfos"6018lb # [ 159.434621] niks3-server[1003]: 2026/09/20 12:24:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6019lb # [ 159.444539] niks3-server[1003]: 2026/09/20 12:24:57 INFO Signed narinfos id=59 count=16020lb # [ 159.450547] niks3-server[1003]: 2026/09/20 12:24:57 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6021lb # [ 159.456098] niks3-server[1003]: 2026/09/20 12:24:57 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6022lb # [ 159.467668] niks3-server[1003]: 2026/09/20 12:24:57 INFO Completed upload id=596023worker1 # [ 159.379735] nix-grpc-daemon[1612]: time=2026-09-20T12:24:58.873Z level=INFO msg="Upload complete. (340ms)"6024lb # [ 159.470812] niks3-server[1003]: 2026/09/20 12:24:57 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6025worker1 # [ 159.393187] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=16026worker1 # [ 159.412132] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:58Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16027worker1 # [ 159.417526] nix-daemon[831]: reaped child process 2028, status = succeeded6028worker1 # [ 159.436558] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473786029worker1 # [ 159.451816] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473786030worker1 # [ 159.467004] nix-grpc-daemon[1612]: time=2026-09-20T12:24:58.961Z level=INFO msg="All 2 paths already cached"6031worker1 # [ 159.476088] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473786032worker1 # [ 159.490077] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)6033worker1 # [ 159.690744] nix-daemon[831]: accepted connection from pid 2052, user nix-grpc-daemon (trusted)6034worker1 # [ 159.712144] nix-daemon[831]: reaped child process 2055, status = succeeded6035worker1 # [ 159.887273] nix-daemon[831]: accepted connection from pid 2057, user nix-grpc-daemon (trusted)6036worker1 # [ 159.907031] nix-daemon[831]: reaped child process 2060, status = succeeded6037lb # [ 160.006323] niks3-server[1003]: 2026/09/20 12:24:58 INFO Received uploads request method=POST path=/api/pending_closures6038worker1 # [ 159.927943] nix-grpc-daemon[1612]: time=2026-09-20T12:24:59.421Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6039worker1 # [ 159.929618] nix-grpc-daemon[1612]: time=2026-09-20T12:24:59.421Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6040lb # [ 160.035578] niks3-server[1003]: 2026/09/20 12:24:58 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6041worker1 # [ 159.960535] nix-grpc-daemon[1612]: time=2026-09-20T12:24:59.454Z level=INFO msg="Uploading 1 narinfos"6042lb # [ 160.051083] niks3-server[1003]: 2026/09/20 12:24:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6043lb # [ 160.062774] niks3-server[1003]: 2026/09/20 12:24:58 INFO Signed narinfos id=60 count=16044lb # [ 160.067011] niks3-server[1003]: 2026/09/20 12:24:58 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6045lb # [ 160.075976] niks3-server[1003]: 2026/09/20 12:24:58 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6046worker1 # [ 159.992264] nix-grpc-daemon[1612]: time=2026-09-20T12:24:59.486Z level=INFO msg="Upload complete. (485ms)"6047lb # [ 160.080700] niks3-server[1003]: 2026/09/20 12:24:58 INFO Completed upload id=606048lb # [ 160.085078] niks3-server[1003]: 2026/09/20 12:24:58 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6049worker1 # [ 160.000129] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=7526050worker1 # [ 160.011719] nix-grpc-daemon[1538]: ts=2026-09-20T12:24:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473786051worker1 # [ 160.017552] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)6052worker1 # [ 160.022635] nix-daemon[831]: reaped child process 2050, status = succeeded6053worker1 # [ 160.035812] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)6054worker1 # [ 161.482442] nix-daemon[831]: reaped child process 2064, status = succeeded6055worker1 # [ 161.661696] nix-daemon[831]: accepted connection from pid 2079, user nix-grpc-daemon (trusted)6056worker1 # [ 161.681470] nix-daemon[831]: reaped child process 2082, status = succeeded6057lb # [ 161.785684] niks3-server[1003]: 2026/09/20 12:25:00 INFO Received uploads request method=POST path=/api/pending_closures6058worker1 # [ 161.708469] nix-grpc-daemon[1612]: time=2026-09-20T12:25:01.200Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6059worker1 # [ 161.710327] nix-grpc-daemon[1612]: time=2026-09-20T12:25:01.200Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6060lb # [ 161.821552] niks3-server[1003]: 2026/09/20 12:25:00 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6061lb # [ 161.835219] niks3-server[1003]: 2026/09/20 12:25:00 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6062lb # [ 161.850381] niks3-server[1003]: 2026/09/20 12:25:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6063worker1 # [ 161.767775] nix-grpc-daemon[1612]: time=2026-09-20T12:25:01.261Z level=INFO msg="Uploading 1 narinfos"6064lb # [ 161.860643] niks3-server[1003]: 2026/09/20 12:25:00 INFO Signed narinfos id=61 count=16065lb # [ 161.866193] niks3-server[1003]: 2026/09/20 12:25:00 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6066lb # [ 161.874211] niks3-server[1003]: 2026/09/20 12:25:00 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6067lb # [ 161.881166] niks3-server[1003]: 2026/09/20 12:25:00 INFO Completed upload id=616068worker1 # [ 161.791850] nix-grpc-daemon[1612]: time=2026-09-20T12:25:01.285Z level=INFO msg="Upload complete. (345ms)"6069lb # [ 161.884406] niks3-server[1003]: 2026/09/20 12:25:00 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6070worker1 # [ 161.808370] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=16071worker1 # [ 161.823564] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:01Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16072worker1 # [ 161.829169] nix-daemon[831]: reaped child process 2062, status = succeeded6073worker1 # [ 161.848575] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473786074worker1 # [ 161.864116] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473786075worker1 # [ 161.879276] nix-grpc-daemon[1612]: time=2026-09-20T12:25:01.373Z level=INFO msg="All 2 paths already cached"6076worker1 # [ 161.888519] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473786077worker1 # [ 161.903241] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)6078worker1 # [ 162.099996] nix-daemon[831]: accepted connection from pid 2086, user nix-grpc-daemon (trusted)6079worker1 # [ 162.121213] nix-daemon[831]: reaped child process 2089, status = succeeded6080worker1 # [ 162.301575] nix-daemon[831]: accepted connection from pid 2091, user nix-grpc-daemon (trusted)6081worker1 # [ 162.318852] nix-daemon[831]: reaped child process 2094, status = succeeded6082lb # [ 162.423100] niks3-server[1003]: 2026/09/20 12:25:00 INFO Received uploads request method=POST path=/api/pending_closures6083worker1 # [ 162.344715] nix-grpc-daemon[1612]: time=2026-09-20T12:25:01.838Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6084worker1 # [ 162.346224] nix-grpc-daemon[1612]: time=2026-09-20T12:25:01.838Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6085lb # [ 162.452938] niks3-server[1003]: 2026/09/20 12:25:00 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6086lb # [ 162.467982] niks3-server[1003]: 2026/09/20 12:25:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6087worker1 # [ 162.386111] nix-grpc-daemon[1612]: time=2026-09-20T12:25:01.879Z level=INFO msg="Uploading 1 narinfos"6088lb # [ 162.478136] niks3-server[1003]: 2026/09/20 12:25:00 INFO Signed narinfos id=62 count=16089lb # [ 162.485115] niks3-server[1003]: 2026/09/20 12:25:00 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6090worker1 # [ 162.408631] nix-grpc-daemon[1612]: time=2026-09-20T12:25:01.902Z level=INFO msg="Upload complete. (488ms)"6091lb # [ 162.497071] niks3-server[1003]: 2026/09/20 12:25:00 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6092lb # [ 162.502763] niks3-server[1003]: 2026/09/20 12:25:00 INFO Completed upload id=626093worker1 # [ 162.416130] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=0 paths=1 nar_bytes_in=7526094lb # [ 162.506413] niks3-server[1003]: 2026/09/20 12:25:01 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6095worker1 # [ 162.424393] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473786096worker1 # [ 162.439110] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)6097worker1 # [ 162.441466] nix-daemon[831]: reaped child process 2084, status = succeeded6098worker1 # [ 162.456253] nix-daemon[831]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)6099worker1 # [ 163.276516] nix-daemon[831]: reaped child process 2098, status = succeeded6100worker1 # [ 163.437497] nix-daemon[831]: accepted connection from pid 2113, user nix-grpc-daemon (trusted)6101worker1 # [ 163.456148] nix-daemon[831]: reaped child process 2116, status = succeeded6102lb # [ 163.561664] niks3-server[1003]: 2026/09/20 12:25:02 INFO Received uploads request method=POST path=/api/pending_closures6103worker1 # [ 163.483894] nix-grpc-daemon[1612]: time=2026-09-20T12:25:02.976Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6104worker1 # [ 163.485546] nix-grpc-daemon[1612]: time=2026-09-20T12:25:02.976Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6105lb # [ 163.594806] niks3-server[1003]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6106lb # [ 163.609460] niks3-server[1003]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6107lb # [ 163.620226] niks3-server[1003]: 2026/09/20 12:25:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6108worker1 # [ 163.537471] nix-grpc-daemon[1612]: time=2026-09-20T12:25:03.031Z level=INFO msg="Uploading 1 narinfos"6109lb # [ 163.628818] niks3-server[1003]: 2026/09/20 12:25:02 INFO Signed narinfos id=63 count=16110lb # [ 163.633716] niks3-server[1003]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6111lb # [ 163.641998] niks3-server[1003]: 2026/09/20 12:25:02 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6112lb # [ 163.648484] niks3-server[1003]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6113lb # [ 163.653907] niks3-server[1003]: 2026/09/20 12:25:02 INFO Completed upload id=636114worker1 # [ 163.565937] nix-grpc-daemon[1612]: time=2026-09-20T12:25:03.060Z level=INFO msg="Upload complete. (300ms)"6115worker1 # [ 163.576994] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47378 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=16116worker1 # [ 163.593708] nix-daemon[831]: reaped child process 2096, status = succeeded6117client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.41 seconds)6118worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6119worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6120client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16121worker1 # [ 163.985759] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473786122worker2 # [ 164.054998] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:334886123worker2 # [ 164.072993] nix-grpc-daemon[1590]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 1/5)6124worker2 # [ 164.178637] nix-grpc-daemon[1590]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 133 ms (attempt 2/5)6125worker2 # [ 164.319575] nix-grpc-daemon[1590]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 273 ms (attempt 3/5)6126worker2 # [ 164.600531] nix-grpc-daemon[1590]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 4/5)6127worker2 # [ 164.676862] nix-grpc-daemon[1590]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6128worker1 # [ 164.645657] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:04Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06129client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.96 seconds)6130(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 20.45 seconds)6131subtest: low disk drains a worker and builds go to the other6132worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6133worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.16 seconds)6134worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6135worker1 # [ 166.153587] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:05Z level=info event=unhealthy reason=min_free6136worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6137client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26138client # don't know how to build these paths:6139client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6140worker2 # [ 167.296525] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:334886141worker1 # [ 167.236697] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473786142worker1 # [ 167.261361] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:06Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06143worker1 # [ 167.268167] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:06Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16144worker2 # [ 167.372133] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:334886145worker2 # [ 167.387493] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:334886146client # copying 1 paths to 'lb:50051'...6147client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6148worker2 # [ 167.404116] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:334886149worker2 # [ 167.419789] nix-daemon[861]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6150worker2 # [ 167.446839] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:06Z level=info event=niks3_push_started pid=16466151worker2 # [ 167.657141] nix-grpc-daemon[1646]: time=2026-09-20T12:25:07.119Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""6152worker2 # [ 167.830433] nix-daemon[861]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6153worker2 # [ 167.847788] nix-daemon[861]: reaped child process 1662, status = succeeded6154worker2 # [ 168.022333] nix-daemon[861]: accepted connection from pid 1664, user nix-grpc-daemon (trusted)6155worker2 # [ 168.039261] nix-daemon[861]: reaped child process 1667, status = succeeded6156lb # [ 168.078387] niks3-server[1003]: 2026/09/20 12:25:06 INFO Received uploads request method=POST path=/api/pending_closures6157worker2 # [ 168.069169] nix-grpc-daemon[1646]: time=2026-09-20T12:25:07.530Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6158worker2 # [ 168.070670] nix-grpc-daemon[1646]: time=2026-09-20T12:25:07.530Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6159lb # [ 168.115822] niks3-server[1003]: 2026/09/20 12:25:06 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6160worker2 # [ 168.106433] nix-grpc-daemon[1646]: time=2026-09-20T12:25:07.568Z level=INFO msg="Uploading 1 narinfos"6161lb # [ 168.129834] niks3-server[1003]: 2026/09/20 12:25:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6162lb # [ 168.140819] niks3-server[1003]: 2026/09/20 12:25:06 INFO Signed narinfos id=64 count=16163lb # [ 168.147486] niks3-server[1003]: 2026/09/20 12:25:06 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6164lb # [ 168.156144] niks3-server[1003]: 2026/09/20 12:25:06 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6165worker2 # [ 168.140063] nix-grpc-daemon[1646]: time=2026-09-20T12:25:07.602Z level=INFO msg="Upload complete. (479ms)"6166lb # [ 168.165277] niks3-server[1003]: 2026/09/20 12:25:06 INFO Completed upload id=646167lb # [ 168.167809] niks3-server[1003]: 2026/09/20 12:25:06 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6168worker2 # [ 168.148129] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33488 duration_s=0 paths=1 nar_bytes_in=5126169worker2 # [ 168.158845] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:334886170worker2 # [ 168.168275] nix-daemon[861]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6171worker2 # [ 168.175830] nix-daemon[861]: reaped child process 1644, status = succeeded6172client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6173worker2 # [ 168.183394] nix-daemon[861]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6174client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6175client # farm-a> LOG-farm-a-drain6176worker2 # [ 169.237574] nix-daemon[861]: reaped child process 1671, status = succeeded6177worker2 # [ 169.417728] nix-daemon[861]: accepted connection from pid 1686, user nix-grpc-daemon (trusted)6178worker2 # [ 169.436571] nix-daemon[861]: reaped child process 1689, status = succeeded6179lb # [ 169.476800] niks3-server[1003]: 2026/09/20 12:25:07 INFO Received uploads request method=POST path=/api/pending_closures6180worker2 # [ 169.468115] nix-grpc-daemon[1646]: time=2026-09-20T12:25:08.927Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6181worker2 # [ 169.469717] nix-grpc-daemon[1646]: time=2026-09-20T12:25:08.927Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6182lb # [ 169.516211] niks3-server[1003]: 2026/09/20 12:25:08 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6183lb # [ 169.526286] niks3-server[1003]: 2026/09/20 12:25:08 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6184lb # [ 169.536760] niks3-server[1003]: 2026/09/20 12:25:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6185worker2 # [ 169.513755] nix-grpc-daemon[1646]: time=2026-09-20T12:25:08.975Z level=INFO msg="Uploading 1 narinfos"6186lb # [ 169.544348] niks3-server[1003]: 2026/09/20 12:25:08 INFO Signed narinfos id=65 count=16187lb # [ 169.549414] niks3-server[1003]: 2026/09/20 12:25:08 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6188lb # [ 169.558432] niks3-server[1003]: 2026/09/20 12:25:08 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6189lb # [ 169.565159] niks3-server[1003]: 2026/09/20 12:25:08 INFO Completed upload id=656190worker2 # [ 169.539147] nix-grpc-daemon[1646]: time=2026-09-20T12:25:09.001Z level=INFO msg="Upload complete. (340ms)"6191lb # [ 169.571171] niks3-server[1003]: 2026/09/20 12:25:08 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6192worker2 # [ 169.548980] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33488 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=16193worker1 # [ 169.491227] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:08Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06194worker1 # [ 169.497396] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:08Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16195worker2 # [ 169.567722] nix-daemon[861]: reaped child process 1669, status = succeeded6196worker2 # [ 169.599944] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:334886197worker2 # [ 169.616907] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:334886198worker2 # [ 169.631177] nix-grpc-daemon[1646]: time=2026-09-20T12:25:09.093Z level=INFO msg="All 1 paths already cached"6199client # copying 1 paths to 'lb:50051'...6200client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6201worker2 # [ 169.642140] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:334886202worker2 # [ 169.656237] nix-daemon[861]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6203worker2 # [ 169.859566] nix-daemon[861]: accepted connection from pid 1693, user nix-grpc-daemon (trusted)6204worker2 # [ 169.876409] nix-daemon[861]: reaped child process 1696, status = succeeded6205worker2 # [ 170.050940] nix-daemon[861]: accepted connection from pid 1698, user nix-grpc-daemon (trusted)6206worker2 # [ 170.067868] nix-daemon[861]: reaped child process 1701, status = succeeded6207lb # [ 170.104480] niks3-server[1003]: 2026/09/20 12:25:08 INFO Received uploads request method=POST path=/api/pending_closures6208worker2 # [ 170.089374] nix-grpc-daemon[1646]: time=2026-09-20T12:25:09.551Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6209worker2 # [ 170.090887] nix-grpc-daemon[1646]: time=2026-09-20T12:25:09.551Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6210lb # [ 170.130283] niks3-server[1003]: 2026/09/20 12:25:08 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6211worker2 # [ 170.120154] nix-grpc-daemon[1646]: time=2026-09-20T12:25:09.582Z level=INFO msg="Uploading 1 narinfos"6212lb # [ 170.147440] niks3-server[1003]: 2026/09/20 12:25:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6213lb # [ 170.158756] niks3-server[1003]: 2026/09/20 12:25:08 INFO Signed narinfos id=66 count=16214worker2 # [ 170.143195] nix-grpc-daemon[1646]: time=2026-09-20T12:25:09.605Z level=INFO msg="Upload complete. (469ms)"6215lb # [ 170.168571] niks3-server[1003]: 2026/09/20 12:25:08 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6216lb # [ 170.173738] niks3-server[1003]: 2026/09/20 12:25:08 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6217worker2 # [ 170.152249] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33488 duration_s=0 paths=1 nar_bytes_in=6326218lb # [ 170.178321] niks3-server[1003]: 2026/09/20 12:25:08 INFO Completed upload id=666219lb # [ 170.180768] niks3-server[1003]: 2026/09/20 12:25:08 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6220worker2 # [ 170.161841] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:334886221worker2 # [ 170.168148] nix-daemon[861]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6222worker2 # [ 170.172615] nix-daemon[861]: reaped child process 1691, status = succeeded6223client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6224worker2 # [ 170.184198] nix-daemon[861]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6225client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6226client # farm-b> LOG-farm-b-drain6227worker2 # [ 170.818345] nix-daemon[861]: reaped child process 1705, status = succeeded6228worker2 # [ 170.990398] nix-daemon[861]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6229worker2 # [ 171.010214] nix-daemon[861]: reaped child process 1723, status = succeeded6230lb # [ 171.050008] niks3-server[1003]: 2026/09/20 12:25:09 INFO Received uploads request method=POST path=/api/pending_closures6231worker2 # [ 171.036666] nix-grpc-daemon[1646]: time=2026-09-20T12:25:10.498Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6232worker2 # [ 171.038741] nix-grpc-daemon[1646]: time=2026-09-20T12:25:10.498Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6233lb # [ 171.083626] niks3-server[1003]: 2026/09/20 12:25:09 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6234lb # [ 171.100489] niks3-server[1003]: 2026/09/20 12:25:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6235worker2 # [ 171.084201] nix-grpc-daemon[1646]: time=2026-09-20T12:25:10.546Z level=INFO msg="Uploading 1 narinfos"6236lb # [ 171.116278] niks3-server[1003]: 2026/09/20 12:25:09 INFO Signed narinfos id=67 count=16237lb # [ 171.118999] niks3-server[1003]: 2026/09/20 12:25:09 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6238lb # [ 171.128890] niks3-server[1003]: 2026/09/20 12:25:09 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6239lb # [ 171.138129] niks3-server[1003]: 2026/09/20 12:25:09 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6240lb # [ 171.145561] niks3-server[1003]: 2026/09/20 12:25:09 INFO Completed upload id=676241worker2 # [ 171.121701] nix-grpc-daemon[1646]: time=2026-09-20T12:25:10.584Z level=INFO msg="Upload complete. (327ms)"6242lb # [ 171.148545] niks3-server[1003]: 2026/09/20 12:25:09 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6243worker2 # [ 171.133124] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33488 duration_s=0 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=16244worker1 # [ 171.078138] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:10Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06245worker1 # [ 171.078742] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:10Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16246worker2 # [ 171.155324] nix-daemon[861]: reaped child process 1703, status = succeeded6247worker2 # [ 171.190453] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:334886248worker2 # [ 171.212834] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:334886249worker2 # [ 171.231800] nix-grpc-daemon[1646]: time=2026-09-20T12:25:10.694Z level=INFO msg="All 2 paths already cached"6250client # copying 1 paths to 'lb:50051'...6251client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6252worker2 # [ 171.246576] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:334886253worker2 # [ 171.264151] nix-daemon[861]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6254worker2 # [ 171.531709] nix-daemon[861]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)6255worker2 # [ 171.552591] nix-daemon[861]: reaped child process 1730, status = succeeded6256worker2 # [ 171.765705] nix-daemon[861]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)6257worker2 # [ 171.786923] nix-daemon[861]: reaped child process 1735, status = succeeded6258lb # [ 171.823561] niks3-server[1003]: 2026/09/20 12:25:10 INFO Received uploads request method=POST path=/api/pending_closures6259worker2 # [ 171.812081] nix-grpc-daemon[1646]: time=2026-09-20T12:25:11.274Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6260worker2 # [ 171.813641] nix-grpc-daemon[1646]: time=2026-09-20T12:25:11.274Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6261lb # [ 171.867887] niks3-server[1003]: 2026/09/20 12:25:10 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6262lb # [ 171.889581] niks3-server[1003]: 2026/09/20 12:25:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6263worker2 # [ 171.871902] nix-grpc-daemon[1646]: time=2026-09-20T12:25:11.333Z level=INFO msg="Uploading 1 narinfos"6264lb # [ 171.903176] niks3-server[1003]: 2026/09/20 12:25:10 INFO Signed narinfos id=68 count=16265lb # [ 171.910530] niks3-server[1003]: 2026/09/20 12:25:10 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6266lb # [ 171.922360] niks3-server[1003]: 2026/09/20 12:25:10 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6267lb # [ 171.930430] niks3-server[1003]: 2026/09/20 12:25:10 INFO Completed upload id=686268worker2 # [ 171.906165] nix-grpc-daemon[1646]: time=2026-09-20T12:25:11.368Z level=INFO msg="Upload complete. (617ms)"6269lb # [ 171.933682] niks3-server[1003]: 2026/09/20 12:25:10 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6270worker2 # [ 171.919810] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33488 duration_s=0 paths=1 nar_bytes_in=7606271worker2 # [ 171.932429] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:334886272worker2 # [ 171.955070] nix-daemon[861]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6273worker2 # [ 171.958574] nix-daemon[861]: reaped child process 1725, status = succeeded6274client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6275client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6276worker2 # [ 171.974720] nix-daemon[861]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6277lb # [ 172.437203] envoy[920]: conn peer=[2001:db8:1::1]:41546 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27105 tx=10680 ms=191076278lb # [ 172.442634] envoy[920]: conn peer=[2001:db8:1::1]:48860 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=523 ms=6826279client # farm-top> LOG-farm-top-drain6280worker2 # [ 173.446483] nix-daemon[861]: reaped child process 1739, status = succeeded6281worker2 # [ 173.673484] nix-daemon[861]: accepted connection from pid 1754, user nix-grpc-daemon (trusted)6282worker2 # [ 173.694821] nix-daemon[861]: reaped child process 1757, status = succeeded6283lb # [ 173.739123] niks3-server[1003]: 2026/09/20 12:25:12 INFO Received uploads request method=POST path=/api/pending_closures6284worker2 # [ 173.728637] nix-grpc-daemon[1646]: time=2026-09-20T12:25:13.190Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6285worker2 # [ 173.730564] nix-grpc-daemon[1646]: time=2026-09-20T12:25:13.190Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6286lb # [ 173.793711] niks3-server[1003]: 2026/09/20 12:25:12 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6287lb # [ 173.811105] niks3-server[1003]: 2026/09/20 12:25:12 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6288lb # [ 173.822297] niks3-server[1003]: 2026/09/20 12:25:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6289worker2 # [ 173.798601] nix-grpc-daemon[1646]: time=2026-09-20T12:25:13.260Z level=INFO msg="Uploading 1 narinfos"6290lb # [ 173.830030] niks3-server[1003]: 2026/09/20 12:25:12 INFO Signed narinfos id=69 count=16291lb # [ 173.835168] niks3-server[1003]: 2026/09/20 12:25:12 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6292lb # [ 173.843324] niks3-server[1003]: 2026/09/20 12:25:12 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6293lb # [ 173.852325] niks3-server[1003]: 2026/09/20 12:25:12 INFO Completed upload id=696294worker2 # [ 173.827951] nix-grpc-daemon[1646]: time=2026-09-20T12:25:13.290Z level=INFO msg="Upload complete. (433ms)"6295lb # [ 173.855143] niks3-server[1003]: 2026/09/20 12:25:12 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6296worker2 # [ 173.841692] nix-grpc-daemon[1590]: ts=2026-09-20T12:25:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33488 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=16297worker2 # [ 173.866482] nix-daemon[861]: reaped child process 1737, status = succeeded6298client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.86 seconds)6299client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6300client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.30 seconds)6301worker1: must succeed: rm /nix/.rw-store/fill6302worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.20 seconds)6303worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6304worker1 # [ 175.169773] nix-grpc-daemon[1538]: ts=2026-09-20T12:25:14Z level=info event=healthy reason=min_free6305worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.16 seconds)6306(finished: subtest: low disk drains a worker and builds go to the other, in 10.96 seconds)6307(finished: run the VM test script, in 176.78 seconds)6308test script finished in 177.17s6309cleanup6310kill QemuMachine (pid 50)6311client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6312kill QemuMachine (pid 49)6313lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6314kill QemuMachine (pid 52)6315worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6316kill QemuMachine (pid 51)6317worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6318(finished: cleanup, in 1.31 seconds)6319additionally exposed symbols:6320 client, lb, worker1, worker2,6321 vlan1,6322 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh