vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #299
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13worker1 # Disk image does not exist, creating the virtualisation disk image...14client # Disk image does not exist, creating the virtualisation disk image...15lb # Formatting '/build/vm-state-lb/tmp.XwQTrlyUcl', fmt=raw size=107374182416worker1 # Formatting '/build/vm-state-worker1/tmp.ucsWFDBUHS', fmt=raw size=107374182417worker2: QEMU running (pid 52)18lb: QEMU running (pid 50)19worker2 # Disk image does not exist, creating the virtualisation disk image...20lb # mke2fs 1.47.4 (6-Mar-2025)21worker1 # mke2fs 1.47.4 (6-Mar-2025)22client # Formatting '/build/vm-state-client/tmp.99GUyMyCMi', fmt=raw size=107374182423worker1: QEMU running (pid 51)24client: QEMU running (pid 49)25client # mke2fs 1.47.4 (6-Mar-2025)26worker1 # Discarding device blocks: 0/262144 done27lb # Discarding device blocks: 0/262144 done28worker2 # Formatting '/build/vm-state-worker2/tmp.4nWT7QshVw', fmt=raw size=107374182429(finished: start all VMs, in 0.47 seconds)30lb # Creating filesystem with 262144 4k blocks and 65536 inodes31worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes32client # Discarding device blocks: 0/262144 done33worker2 # mke2fs 1.47.4 (6-Mar-2025)34client: waiting for unit network-addresses-eth1.service35lb # Filesystem UUID: 1b7320b8-7621-4426-9f3e-79345037d1c936worker2 # Discarding device blocks: 0/262144 done37client: waiting for the VM to finish booting38lb # Superblock backups stored on blocks:39worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes40client # Creating filesystem with 262144 4k blocks and 65536 inodes41worker1 # Filesystem UUID: 30cb300f-6f10-42cd-9129-3e7aa90cf02142lb # 32768, 98304, 163840, 22937643worker2 # Filesystem UUID: 931ea2e4-7f1d-4064-a59c-52d5258ca02144client # Filesystem UUID: 6f3a39a3-5cde-474a-8553-04ad9e368e0d45worker1 # Superblock backups stored on blocks:46lb # 47worker2 # Superblock backups stored on blocks:48client # Superblock backups stored on blocks:49worker1 # 32768, 98304, 163840, 22937650lb # Allocating group tables: 0/8 done51worker2 # 32768, 98304, 163840, 22937652client # 32768, 98304, 163840, 22937653worker1 # 54lb # Writing inode tables: 0/8 done55worker2 # 56client # 57worker1 # Allocating group tables: 0/8 done58lb # Creating journal (8192 blocks): done59worker2 # Allocating group tables: 0/8 done60worker2 # Writing inode tables: 0/8 done61worker1 # Writing inode tables: 0/8 done62lb # Writing superblocks and filesystem accounting information: 0/8 done63worker1 # Creating journal (8192 blocks): done64client # Allocating group tables: 0/8 done65lb # 66worker1 # Writing superblocks and filesystem accounting information: 0/8 done67worker2 # Creating journal (8192 blocks): done68worker1 # 69worker2 # Writing superblocks and filesystem accounting information: 0/8 done70lb # Virtualisation disk image created.71client # Writing inode tables: 0/8 done72worker1 # Virtualisation disk image created.73client # Creating journal (8192 blocks): done74worker2 # 75client # Writing superblocks and filesystem accounting information: 0/8 done76worker2 # Virtualisation disk image created.77client # 78client # Virtualisation disk image created.79client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681client # [ 0.000000] KASLR enabled82client # [ 0.000000] random: crng init done83client # [ 0.000000] Machine model: linux,dummy-virt84client # [ 0.000000] efi: UEFI not found.85client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88client # [ 0.000000] Zone ranges:89client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90client # [ 0.000000] DMA32 empty91client # [ 0.000000] Normal empty92client # [ 0.000000] Device empty93client # [ 0.000000] Movable zone start for each node94client # [ 0.000000] Early memory node ranges95client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098client # [ 0.000000] psci: probing for conduit method from DT.99client # [ 0.000000] psci: PSCIv1.3 detected in firmware.100client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101client # [ 0.000000] psci: Trusted OS migration not required102client # [ 0.000000] psci: SMC Calling Convention v1.1103client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105client # [ 0.000000] Detected PIPT I-cache on CPU0106client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107client # [ 0.000000] CPU features: detected: GICv3 CPU interface108client # [ 0.000000] CPU features: detected: Spectre-v4109client # [ 0.000000] CPU features: detected: Spectre-BHB110client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112client # [ 0.000000] alternatives: applying boot alternatives113client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test/init regInfo=/nix/store/kw37kf8y651cwikgpy10xp7y2ldijiqs-closure-info/registration console=ttyAMA0,115200n8 console=tty0114client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/kw37kf8y651cwikgpy10xp7y2ldijiqs-closure-info/registration", will be passed to user space.115client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119client # [ 0.000000] software IO TLB: area num 1.120client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122client # [ 0.000000] Fallback order for Node 0: 0123client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124client # [ 0.000000] Policy zone: DMA125client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127client # [ 0.000000] allocated 3145728 bytes of page_ext128client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129client # [ 0.000000] ftrace: allocated 294 pages with 4 groups130client # [ 0.000000] rcu: Hierarchical RCU implementation.131client # [ 0.000000] rcu: RCU event tracing is enabled.132client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133client # [ 0.000000] Trampoline variant of Tasks RCU enabled.134client # [ 0.000000] Rude variant of Tasks RCU enabled.135client # [ 0.000000] Tracing variant of Tasks RCU enabled.136client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.139client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0142client # [ 0.000000] GICv3: 256 SPIs implemented143client # [ 0.000000] GICv3: 0 Extended SPIs implemented144client # [ 0.000000] Root IRQ handler: gic_handle_irq145client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI146client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0147client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000148client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]149client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)150client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)151client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000152client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000153client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.154client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns155client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).156client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns157client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns158client # [ 0.000032] arm-pv: using stolen time PV159client # [ 0.000652] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)160client # [ 0.000817] Console: colour dummy device 80x25161client # [ 0.000825] printk: legacy console [tty0] enabled162client # [ 0.001012] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)163client # [ 0.001019] pid_max: default: 32768 minimum: 301164client # [ 0.001090] LSM: initializing lsm=capability,landlock,yama,bpf,ima165client # [ 0.001263] landlock: Up and running.166client # [ 0.001266] Yama: becoming mindful.167client # [ 0.001881] LSM support for eBPF active168client # [ 0.002021] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)169client # [ 0.002053] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)170client # [ 0.003131] cacheinfo: Unable to detect cache hierarchy for CPU 0171client # [ 0.003922] rcu: Hierarchical SRCU implementation.172client # [ 0.003926] rcu: Max phase no-delay instances is 1000.173client # [ 0.005189] fsl-mc MSI: its@8080000 domain created174client # [ 0.005280] EFI services will not be available.175client # [ 0.005359] smp: Bringing up secondary CPUs ...176client # [ 0.005368] smp: Brought up 1 node, 1 CPU177client # [ 0.005371] SMP: Total of 1 processors activated.178client # [ 0.005376] CPU: All CPU(s) started at EL1179client # [ 0.005388] CPU features: detected: Branch Target Identification180client # [ 0.005392] CPU features: detected: ARMv8.4 Translation Table Level181client # [ 0.005396] CPU features: detected: Instruction cache invalidation not required for I/D coherence182client # [ 0.005399] CPU features: detected: Data cache clean to the PoU not required for I/D coherence183client # [ 0.005403] CPU features: detected: Common not Private translations184client # [ 0.005406] CPU features: detected: CRC32 instructions185client # [ 0.005409] CPU features: detected: Data cache clean to Point of Deep Persistence186client # [ 0.005413] CPU features: detected: Data cache clean to Point of Persistence187client # [ 0.005416] CPU features: detected: Data independent timing control (DIT)188client # [ 0.005419] CPU features: detected: E0PD189client # [ 0.005422] CPU features: detected: Enhanced Counter Virtualization190client # [ 0.005425] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)191client # [ 0.005428] CPU features: detected: Enhanced Virtualization Traps192client # [ 0.005431] CPU features: detected: Fine Grained Traps193worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]194client # [ 0.005435] CPU features: detected: Generic authentication (architected QARMA5 algorithm)195client # [ 0.005441] CPU features: detected: RCpc load-acquire (LDAPR)196client # [ 0.005444] CPU features: detected: LSE atomic instructions197worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026198worker1 # [ 0.000000] KASLR enabled199client # [ 0.005447] CPU features: detected: Privileged Access Never200worker1 # [ 0.000000] random: crng init done201client # [ 0.005449] CPU features: detected: PMUv3202worker1 # [ 0.000000] Machine model: linux,dummy-virt203worker1 # [ 0.000000] efi: UEFI not found.204lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]205client # [ 0.005452] CPU features: detected: RAS Extension Support206worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT207client # [ 0.005455] CPU features: detected: RASv1p1 Extension Support208worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]209lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026210worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]211lb # [ 0.000000] KASLR enabled212client # [ 0.005458] CPU features: detected: Random Number Generator213lb # [ 0.000000] random: crng init done214worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]215client # [ 0.005460] CPU features: detected: Speculation barrier (SB)216worker1 # [ 0.000000] Zone ranges:217lb # [ 0.000000] Machine model: linux,dummy-virt218lb # [ 0.000000] efi: UEFI not found.219client # [ 0.005463] CPU features: detected: Stage-2 Force Write-Back220worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]221worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026222worker2 # [ 0.000000] KASLR enabled223worker1 # [ 0.000000] DMA32 empty224worker1 # [ 0.000000] Normal empty225lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT226client # [ 0.005466] CPU features: detected: TLB range maintenance instructions227worker2 # [ 0.000000] random: crng init done228worker1 # [ 0.000000] Device empty229worker2 # [ 0.000000] Machine model: linux,dummy-virt230worker1 # [ 0.000000] Movable zone start for each node231client # [ 0.005471] CPU features: detected: Speculative Store Bypassing Safe (SSBS)232lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]233worker2 # [ 0.000000] efi: UEFI not found.234worker1 # [ 0.000000] Early memory node ranges235client # [ 0.005512] alternatives: applying system-wide alternatives236lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]237lb # [ 0.000000] Zone ranges:238worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT239worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]240client # [ 0.008483] CPU features: detected: BBM Level 2 without TLB conflict abort241lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]242worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]243worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]244lb # [ 0.000000] DMA32 empty245lb # [ 0.000000] Normal empty246worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]247worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000248worker2 # [ 0.000000] Zone ranges:249lb # [ 0.000000] Device empty250client # [ 0.008642] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)251worker1 # [ 0.000000] psci: probing for conduit method from DT.252lb # [ 0.000000] Movable zone start for each node253client # [ 0.009029] devtmpfs: initialized254worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]255worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.256lb # [ 0.000000] Early memory node ranges257worker2 # [ 0.000000] DMA32 empty258worker2 # [ 0.000000] Normal empty259client # [ 0.010850] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)260worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs261lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]262worker2 # [ 0.000000] Device empty263worker1 # [ 0.000000] psci: Trusted OS migration not required264worker2 # [ 0.000000] Movable zone start for each node265client # [ 0.010872] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).266lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]267worker1 # [ 0.000000] psci: SMC Calling Convention v1.1268worker2 # [ 0.000000] Early memory node ranges269lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000270client # [ 0.011056] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL271worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]272worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)273client # [ 0.011061] 0 pages in range for non-PLT usage274lb # [ 0.000000] psci: probing for conduit method from DT.275lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.276client # [ 0.011062] 508288 pages in range for PLT usage277worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]278worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296279lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs280worker1 # [ 0.000000] Detected PIPT I-cache on CPU0281worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000282client # [ 0.011171] pinctrl core: initialized pinctrl subsystem283client # [ 0.011954] DMI not present or invalid.284lb # [ 0.000000] psci: Trusted OS migration not required285worker2 # [ 0.000000] psci: probing for conduit method from DT.286worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)287lb # [ 0.000000] psci: SMC Calling Convention v1.1288client # [ 0.015696] NET: Registered PF_NETLINK/PF_ROUTE protocol family289worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.290worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface291worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs292client # [ 0.017898] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations293lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)294worker1 # [ 0.000000] CPU features: detected: Spectre-v4295worker2 # [ 0.000000] psci: Trusted OS migration not required296worker1 # [ 0.000000] CPU features: detected: Spectre-BHB297client # [ 0.018073] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations298worker2 # [ 0.000000] psci: SMC Calling Convention v1.1299lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296300worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38301lb # [ 0.000000] Detected PIPT I-cache on CPU0302client # [ 0.018271] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations303worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)304worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23305lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)306client # [ 0.018292] audit: initializing netlink subsys (disabled)307worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296308worker1 # [ 0.000000] alternatives: applying boot alternatives309lb # [ 0.000000] CPU features: detected: GICv3 CPU interface310client # [ 0.018894] thermal_sys: Registered thermal governor 'fair_share'311worker2 # [ 0.000000] Detected PIPT I-cache on CPU0312lb # [ 0.000000] CPU features: detected: Spectre-v4313client # [ 0.018896] thermal_sys: Registered thermal governor 'bang_bang'314worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)315lb # [ 0.000000] CPU features: detected: Spectre-BHB316client # [ 0.018900] thermal_sys: Registered thermal governor 'step_wise'317worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface318lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38319client # [ 0.018905] thermal_sys: Registered thermal governor 'user_space'320worker2 # [ 0.000000] CPU features: detected: Spectre-v4321lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23322worker2 # [ 0.000000] CPU features: detected: Spectre-BHB323client # [ 0.018908] thermal_sys: Registered thermal governor 'power_allocator'324lb # [ 0.000000] alternatives: applying boot alternatives325worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gy3k7x527c38djcmpycpycfhnskkzynp-nixos-system-worker1-test/init regInfo=/nix/store/b4g7ngbiscxlrax8kca3f93vbr2k88bd-closure-info/registration console=ttyAMA0,115200n8 console=tty0326worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38327client # [ 0.018933] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1328worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23329client # [ 0.018942] cpuidle: using governor ladder330worker2 # [ 0.000000] alternatives: applying boot alternatives331client # [ 0.018949] cpuidle: using governor menu332worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/b4g7ngbiscxlrax8kca3f93vbr2k88bd-closure-info/registration", will be passed to user space.333client # [ 0.019141] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.334client # [ 0.019159] ASID allocator initialised with 65536 entries335worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes336lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/14bqwb8zl951hxla1qpmchqzwfgwlqnx-nixos-system-lb-test/init regInfo=/nix/store/hxsww7q411z4rrmrw9s7nvsxa10s5ypn-closure-info/registration console=ttyAMA0,115200n8 console=tty0337client # [ 0.020472] Serial: AMBA PL011 UART driver338worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)339client # [ 0.025835] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1340client # [ 0.025968] printk: console [ttyAMA0] enabled341worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)342lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/hxsww7q411z4rrmrw9s7nvsxa10s5ypn-closure-info/registration", will be passed to user space.343worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jzdfkj5rn54mxddyl2kfg84vs1zgm4ba-nixos-system-worker2-test/init regInfo=/nix/store/a861za859qjzvnmb0mjbxjbnm95qmjfq-closure-info/registration console=ttyAMA0,115200n8 console=tty0344worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB345worker1 # [ 0.000000] software IO TLB: area num 1.346lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes347worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/a861za859qjzvnmb0mjbxjbnm95qmjfq-closure-info/registration", will be passed to user space.348worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB349lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)350worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes351worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)352lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)353worker1 # [ 0.000000] Fallback order for Node 0: 0354worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)355lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB356worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216357worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)358worker1 # [ 0.000000] Policy zone: DMA359lb # [ 0.000000] software IO TLB: area num 1.360worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off361lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB362worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB363worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1364lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)365worker2 # [ 0.000000] software IO TLB: area num 1.366worker1 # [ 0.000000] allocated 3145728 bytes of page_ext367lb # [ 0.000000] Fallback order for Node 0: 0368worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB369worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages370lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216371worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups372lb # [ 0.000000] Policy zone: DMA373worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)374worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.375worker2 # [ 0.000000] Fallback order for Node 0: 0376lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off377worker1 # [ 0.000000] rcu: RCU event tracing is enabled.378client # [ 0.148388] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages379worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216380lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1381worker2 # [ 0.000000] Policy zone: DMA382worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.383lb # [ 0.000000] allocated 3145728 bytes of page_ext384client # [ 0.148408] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page385worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.386worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off387lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages388client # [ 0.148413] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages389worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.390worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1391lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups392worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.393client # [ 0.148417] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page394lb # [ 0.000000] rcu: Hierarchical RCU implementation.395worker2 # [ 0.000000] allocated 3145728 bytes of page_ext396worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.397lb # [ 0.000000] rcu: RCU event tracing is enabled.398worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages399client # [ 0.148422] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages400worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups401worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1402client # [ 0.148426] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page403lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.404worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.405lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.406client # [ 0.148430] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages407worker2 # [ 0.000000] rcu: RCU event tracing is enabled.408worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.409lb # [ 0.000000] Rude variant of Tasks RCU enabled.410client # [ 0.148434] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page411lb # [ 0.000000] Tracing variant of Tasks RCU enabled.412worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.413worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.414worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.415lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.416worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.417worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.418lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1419worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.420worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0421client # [ 0.155505] fbcon: Taking over console422worker1 # [ 0.000000] GICv3: 256 SPIs implemented423worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.424lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.425client # [ 0.155521] ACPI: Interpreter disabled.426worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented427worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1428client # [ 0.157506] iommu: Default domain type: Translated429worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq430lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.431worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI432client # [ 0.157515] iommu: DMA domain TLB invalidation policy: strict mode433worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.434worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0435lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.436client # [ 0.159126] SCSI subsystem initialized437lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0438worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.439worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000440lb # [ 0.000000] GICv3: 256 SPIs implemented441worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]442lb # [ 0.000000] GICv3: 0 Extended SPIs implemented443worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.444lb # [ 0.000000] Root IRQ handler: gic_handle_irq445worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)446worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0447lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI448worker2 # [ 0.000000] GICv3: 256 SPIs implemented449lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0450worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented451worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)452worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq453lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000454worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000455worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI456lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]457worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000458worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0459lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)460worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000461worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.462worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]463client # [ 0.164715] usbcore: registered new interface driver usbfs464lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)465worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns466client # [ 0.164753] usbcore: registered new interface driver hub467worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)468lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000469worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).470client # [ 0.164771] usbcore: registered new device driver usb471lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000472client # [ 0.165059] pps_core: LinuxPPS API ver. 1 registered473worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)474worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns475lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.476worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000477client # [ 0.165065] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>478worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns479client # [ 0.165082] PTP clock support registered480worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000481lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns482client # [ 0.165131] EDAC MC: Ver: 3.0.0483worker1 # [ 0.000031] arm-pv: using stolen time PV484worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.485lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).486client # [ 0.169486] scmi_core: SCMI protocol bus registered487worker1 # [ 0.000413] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)488worker1 # [ 0.000585] Console: colour dummy device 80x25489worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns490client # [ 0.170425] FPGA manager framework491lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns492worker1 # [ 0.000593] printk: legacy console [tty0] enabled493client # [ 0.171340] vgaarb: loaded494worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).495lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns496lb # [ 0.000029] arm-pv: using stolen time PV497client # [ 0.171946] clocksource: Switched to clocksource arch_sys_counter498worker1 # [ 0.000782] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)499worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns500worker1 # [ 0.000789] pid_max: default: 32768 minimum: 301501lb # [ 0.000410] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)502worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns503worker1 # [ 0.000856] LSM: initializing lsm=capability,landlock,yama,bpf,ima504lb # [ 0.000605] Console: colour dummy device 80x25505worker2 # [ 0.000029] arm-pv: using stolen time PV506worker1 # [ 0.001035] landlock: Up and running.507worker1 # [ 0.001038] Yama: becoming mindful.508lb # [ 0.000613] printk: legacy console [tty0] enabled509worker1 # [ 0.001502] LSM support for eBPF active510worker2 # [ 0.000407] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)511client # [ 0.175453] VFS: Disk quotas dquot_6.6.0512lb # [ 0.000827] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)513worker1 # [ 0.001665] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)514worker2 # [ 0.000588] Console: colour dummy device 80x25515lb # [ 0.000834] pid_max: default: 32768 minimum: 301516worker2 # [ 0.000596] printk: legacy console [tty0] enabled517client # [ 0.175489] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)518worker1 # [ 0.001702] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)519lb # [ 0.000912] LSM: initializing lsm=capability,landlock,yama,bpf,ima520lb # [ 0.001047] landlock: Up and running.521worker1 # [ 0.002817] cacheinfo: Unable to detect cache hierarchy for CPU 0522worker2 # [ 0.000791] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)523lb # [ 0.001050] Yama: becoming mindful.524worker1 # [ 0.003507] rcu: Hierarchical SRCU implementation.525worker2 # [ 0.000798] pid_max: default: 32768 minimum: 301526lb # [ 0.001500] LSM support for eBPF active527worker1 # [ 0.003511] rcu: Max phase no-delay instances is 1000.528worker2 # [ 0.000876] LSM: initializing lsm=capability,landlock,yama,bpf,ima529worker1 # [ 0.004712] fsl-mc MSI: its@8080000 domain created530lb # [ 0.001653] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)531worker2 # [ 0.001029] landlock: Up and running.532client # [ 0.179029] netfs: FS-Cache loaded533worker2 # [ 0.001031] Yama: becoming mindful.534worker1 # [ 0.004803] EFI services will not be available.535client # [ 0.179154] pnp: PnP ACPI: disabled536lb # [ 0.001691] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)537worker2 # [ 0.001471] LSM support for eBPF active538worker1 # [ 0.004922] smp: Bringing up secondary CPUs ...539worker1 # [ 0.004932] smp: Brought up 1 node, 1 CPU540lb # [ 0.002815] cacheinfo: Unable to detect cache hierarchy for CPU 0541worker2 # [ 0.001632] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)542worker1 # [ 0.004935] SMP: Total of 1 processors activated.543lb # [ 0.003539] rcu: Hierarchical SRCU implementation.544worker1 # [ 0.004940] CPU: All CPU(s) started at EL1545worker2 # [ 0.001668] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)546lb # [ 0.003543] rcu: Max phase no-delay instances is 1000.547worker1 # [ 0.004951] CPU features: detected: Branch Target Identification548lb # [ 0.004736] fsl-mc MSI: its@8080000 domain created549worker2 # [ 0.002704] cacheinfo: Unable to detect cache hierarchy for CPU 0550lb # [ 0.004836] EFI services will not be available.551worker2 # [ 0.003392] rcu: Hierarchical SRCU implementation.552worker1 # [ 0.004955] CPU features: detected: ARMv8.4 Translation Table Level553lb # [ 0.004903] smp: Bringing up secondary CPUs ...554worker2 # [ 0.003396] rcu: Max phase no-delay instances is 1000.555lb # [ 0.004912] smp: Brought up 1 node, 1 CPU556worker1 # [ 0.004959] CPU features: detected: Instruction cache invalidation not required for I/D coherence557worker2 # [ 0.004576] fsl-mc MSI: its@8080000 domain created558client # [ 0.183047] NET: Registered PF_INET protocol family559lb # [ 0.004915] SMP: Total of 1 processors activated.560worker2 # [ 0.004663] EFI services will not be available.561lb # [ 0.004921] CPU: All CPU(s) started at EL1562client # [ 0.183297] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)563worker1 # [ 0.004963] CPU features: detected: Data cache clean to the PoU not required for I/D coherence564worker2 # [ 0.004732] smp: Bringing up secondary CPUs ...565lb # [ 0.004931] CPU features: detected: Branch Target Identification566worker2 # [ 0.004740] smp: Brought up 1 node, 1 CPU567worker1 # [ 0.004966] CPU features: detected: Common not Private translations568worker2 # [ 0.004743] SMP: Total of 1 processors activated.569lb # [ 0.004937] CPU features: detected: ARMv8.4 Translation Table Level570worker1 # [ 0.004969] CPU features: detected: CRC32 instructions571worker2 # [ 0.004748] CPU: All CPU(s) started at EL1572worker1 # [ 0.004972] CPU features: detected: Data cache clean to Point of Deep Persistence573worker2 # [ 0.004759] CPU features: detected: Branch Target Identification574lb # [ 0.004940] CPU features: detected: Instruction cache invalidation not required for I/D coherence575worker1 # [ 0.004976] CPU features: detected: Data cache clean to Point of Persistence576worker2 # [ 0.004763] CPU features: detected: ARMv8.4 Translation Table Level577lb # [ 0.004943] CPU features: detected: Data cache clean to the PoU not required for I/D coherence578worker1 # [ 0.004979] CPU features: detected: Data independent timing control (DIT)579worker2 # [ 0.004766] CPU features: detected: Instruction cache invalidation not required for I/D coherence580lb # [ 0.004947] CPU features: detected: Common not Private translations581worker1 # [ 0.004982] CPU features: detected: E0PD582lb # [ 0.004950] CPU features: detected: CRC32 instructions583worker2 # [ 0.004770] CPU features: detected: Data cache clean to the PoU not required for I/D coherence584worker1 # [ 0.004984] CPU features: detected: Enhanced Counter Virtualization585lb # [ 0.004953] CPU features: detected: Data cache clean to Point of Deep Persistence586worker2 # [ 0.004773] CPU features: detected: Common not Private translations587worker1 # [ 0.004988] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)588worker2 # [ 0.004776] CPU features: detected: CRC32 instructions589lb # [ 0.004956] CPU features: detected: Data cache clean to Point of Persistence590worker1 # [ 0.004991] CPU features: detected: Enhanced Virtualization Traps591worker2 # [ 0.004779] CPU features: detected: Data cache clean to Point of Deep Persistence592lb # [ 0.004960] CPU features: detected: Data independent timing control (DIT)593worker1 # [ 0.004994] CPU features: detected: Fine Grained Traps594lb # [ 0.004963] CPU features: detected: E0PD595worker2 # [ 0.004783] CPU features: detected: Data cache clean to Point of Persistence596worker1 # [ 0.004997] CPU features: detected: Generic authentication (architected QARMA5 algorithm)597lb # [ 0.004965] CPU features: detected: Enhanced Counter Virtualization598worker2 # [ 0.004786] CPU features: detected: Data independent timing control (DIT)599worker1 # [ 0.005002] CPU features: detected: RCpc load-acquire (LDAPR)600lb # [ 0.004968] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)601worker2 # [ 0.004789] CPU features: detected: E0PD602worker1 # [ 0.005005] CPU features: detected: LSE atomic instructions603lb # [ 0.004972] CPU features: detected: Enhanced Virtualization Traps604worker2 # [ 0.004792] CPU features: detected: Enhanced Counter Virtualization605worker1 # [ 0.005008] CPU features: detected: Privileged Access Never606lb # [ 0.004975] CPU features: detected: Fine Grained Traps607worker1 # [ 0.005010] CPU features: detected: PMUv3608worker2 # [ 0.004794] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)609worker1 # [ 0.005013] CPU features: detected: RAS Extension Support610worker2 # [ 0.004798] CPU features: detected: Enhanced Virtualization Traps611lb # [ 0.004979] CPU features: detected: Generic authentication (architected QARMA5 algorithm)612worker1 # [ 0.005016] CPU features: detected: RASv1p1 Extension Support613worker2 # [ 0.004801] CPU features: detected: Fine Grained Traps614lb # [ 0.004984] CPU features: detected: RCpc load-acquire (LDAPR)615worker1 # [ 0.005019] CPU features: detected: Random Number Generator616lb # [ 0.004987] CPU features: detected: LSE atomic instructions617worker2 # [ 0.004804] CPU features: detected: Generic authentication (architected QARMA5 algorithm)618lb # [ 0.004990] CPU features: detected: Privileged Access Never619worker1 # [ 0.005021] CPU features: detected: Speculation barrier (SB)620worker2 # [ 0.004809] CPU features: detected: RCpc load-acquire (LDAPR)621lb # [ 0.004992] CPU features: detected: PMUv3622worker1 # [ 0.005024] CPU features: detected: Stage-2 Force Write-Back623worker2 # [ 0.004812] CPU features: detected: LSE atomic instructions624lb # [ 0.004995] CPU features: detected: RAS Extension Support625worker1 # [ 0.005027] CPU features: detected: TLB range maintenance instructions626worker2 # [ 0.004815] CPU features: detected: Privileged Access Never627lb # [ 0.004998] CPU features: detected: RASv1p1 Extension Support628worker2 # [ 0.004817] CPU features: detected: PMUv3629worker1 # [ 0.005032] CPU features: detected: Speculative Store Bypassing Safe (SSBS)630lb # [ 0.005001] CPU features: detected: Random Number Generator631worker2 # [ 0.004820] CPU features: detected: RAS Extension Support632worker1 # [ 0.005068] alternatives: applying system-wide alternatives633lb # [ 0.005003] CPU features: detected: Speculation barrier (SB)634worker2 # [ 0.004822] CPU features: detected: RASv1p1 Extension Support635worker1 # [ 0.008083] CPU features: detected: BBM Level 2 without TLB conflict abort636lb # [ 0.005006] CPU features: detected: Stage-2 Force Write-Back637worker2 # [ 0.004825] CPU features: detected: Random Number Generator638lb # [ 0.005009] CPU features: detected: TLB range maintenance instructions639worker2 # [ 0.004828] CPU features: detected: Speculation barrier (SB)640worker1 # [ 0.008244] Memory: 1406556K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)641worker2 # [ 0.004830] CPU features: detected: Stage-2 Force Write-Back642lb # [ 0.005014] CPU features: detected: Speculative Store Bypassing Safe (SSBS)643worker1 # [ 0.008657] devtmpfs: initialized644worker2 # [ 0.004833] CPU features: detected: TLB range maintenance instructions645lb # [ 0.005050] alternatives: applying system-wide alternatives646worker1 # [ 0.010391] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)647worker2 # [ 0.004838] CPU features: detected: Speculative Store Bypassing Safe (SSBS)648lb # [ 0.008079] CPU features: detected: BBM Level 2 without TLB conflict abort649worker1 # [ 0.010415] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).650worker2 # [ 0.004875] alternatives: applying system-wide alternatives651worker1 # [ 0.010604] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL652lb # [ 0.008272] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)653worker2 # [ 0.007842] CPU features: detected: BBM Level 2 without TLB conflict abort654lb # [ 0.008671] devtmpfs: initialized655lb # [ 0.010448] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)656worker2 # [ 0.008114] Memory: 1406516K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)657worker2 # [ 0.008527] devtmpfs: initialized658lb # [ 0.010470] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).659worker2 # [ 0.010263] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)660lb # [ 0.010673] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL661lb # [ 0.010678] 0 pages in range for non-PLT usage662worker2 # [ 0.010284] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).663lb # [ 0.010679] 508288 pages in range for PLT usage664worker2 # [ 0.010457] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL665lb # [ 0.010793] pinctrl core: initialized pinctrl subsystem666worker2 # [ 0.010462] 0 pages in range for non-PLT usage667lb # [ 0.011557] DMI not present or invalid.668worker2 # [ 0.010463] 508288 pages in range for PLT usage669lb # [ 0.014743] NET: Registered PF_NETLINK/PF_ROUTE protocol family670worker2 # [ 0.010573] pinctrl core: initialized pinctrl subsystem671worker2 # [ 0.011333] DMI not present or invalid.672lb # [ 0.016942] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations673worker2 # [ 0.014511] NET: Registered PF_NETLINK/PF_ROUTE protocol family674lb # [ 0.017129] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations675worker1 # [ 0.010609] 0 pages in range for non-PLT usage676worker1 # [ 0.010610] 508288 pages in range for PLT usage677lb # [ 0.017325] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations678worker1 # [ 0.010725] pinctrl core: initialized pinctrl subsystem679lb # [ 0.017347] audit: initializing netlink subsys (disabled)680worker1 # [ 0.011444] DMI not present or invalid.681lb # [ 0.017907] thermal_sys: Registered thermal governor 'fair_share'682worker1 # [ 0.014678] NET: Registered PF_NETLINK/PF_ROUTE protocol family683lb # [ 0.017909] thermal_sys: Registered thermal governor 'bang_bang'684worker1 # [ 0.016850] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations685lb # [ 0.017913] thermal_sys: Registered thermal governor 'step_wise'686worker1 # [ 0.017029] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations687lb # [ 0.017919] thermal_sys: Registered thermal governor 'user_space'688worker1 # [ 0.017231] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations689client # [ 0.212151] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)690worker1 # [ 0.017253] audit: initializing netlink subsys (disabled)691worker1 # [ 0.017855] thermal_sys: Registered thermal governor 'fair_share'692client # [ 0.212201] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)693worker1 # [ 0.017857] thermal_sys: Registered thermal governor 'bang_bang'694client # [ 0.212232] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)695worker1 # [ 0.017861] thermal_sys: Registered thermal governor 'step_wise'696worker2 # [ 0.016660] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations697client # [ 0.212310] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)698worker1 # [ 0.017866] thermal_sys: Registered thermal governor 'user_space'699worker2 # [ 0.016848] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations700client # [ 0.212469] TCP: Hash tables configured (established 16384 bind 16384)701worker1 # [ 0.017869] thermal_sys: Registered thermal governor 'power_allocator'702client # [ 0.212549] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)703worker2 # [ 0.017053] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations704worker1 # [ 0.017893] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1705worker2 # [ 0.017073] audit: initializing netlink subsys (disabled)706worker1 # [ 0.017901] cpuidle: using governor ladder707client # [ 0.212581] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)708worker1 # [ 0.017907] cpuidle: using governor menu709worker2 # [ 0.017680] thermal_sys: Registered thermal governor 'fair_share'710client # [ 0.212616] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)711worker1 # [ 0.018090] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.712worker2 # [ 0.017682] thermal_sys: Registered thermal governor 'bang_bang'713client # [ 0.212721] NET: Registered PF_UNIX/PF_LOCAL protocol family714worker1 # [ 0.018105] ASID allocator initialised with 65536 entries715client # [ 0.212751] NET: Registered PF_XDP protocol family716worker2 # [ 0.017686] thermal_sys: Registered thermal governor 'step_wise'717worker1 # [ 0.019369] Serial: AMBA PL011 UART driver718lb # [ 0.017921] thermal_sys: Registered thermal governor 'power_allocator'719client # [ 0.212771] PCI: CLS 0 bytes, default 64720worker2 # [ 0.017691] thermal_sys: Registered thermal governor 'user_space'721client # [ 0.213016] Trying to unpack rootfs image as initramfs...722lb # [ 0.017946] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1723worker1 # [ 0.024495] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1724worker2 # [ 0.017694] thermal_sys: Registered thermal governor 'power_allocator'725lb # [ 0.017954] cpuidle: using governor ladder726worker1 # [ 0.024654] printk: console [ttyAMA0] enabled727lb # [ 0.017960] cpuidle: using governor menu728worker2 # [ 0.017724] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1729worker2 # [ 0.017733] cpuidle: using governor ladder730lb # [ 0.018150] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.731worker1 # [ 0.144237] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages732worker2 # [ 0.017739] cpuidle: using governor menu733lb # [ 0.018165] ASID allocator initialised with 65536 entries734worker1 # [ 0.144259] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page735lb # [ 0.019341] Serial: AMBA PL011 UART driver736worker2 # [ 0.017918] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.737client # [ 0.229252] kvm [1]: HYP mode not available738worker1 # [ 0.144264] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages739worker2 # [ 0.017933] ASID allocator initialised with 65536 entries740lb # [ 0.024647] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1741worker2 # [ 0.019069] Serial: AMBA PL011 UART driver742worker1 # [ 0.144268] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page743lb # [ 0.024793] printk: console [ttyAMA0] enabled744worker2 # [ 0.024206] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1745worker1 # [ 0.144273] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages746worker2 # [ 0.024361] printk: console [ttyAMA0] enabled747lb # [ 0.144742] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages748worker1 # [ 0.144277] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page749lb # [ 0.144762] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page750worker1 # [ 0.144282] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages751worker2 # [ 0.143759] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages752lb # [ 0.144767] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages753worker1 # [ 0.144286] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page754worker2 # [ 0.143780] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page755lb # [ 0.144772] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page756worker2 # [ 0.143785] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages757lb # [ 0.144776] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages758worker2 # [ 0.143790] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page759lb # [ 0.144780] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page760worker1 # [ 0.151575] fbcon: Taking over console761worker2 # [ 0.143794] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages762worker1 # [ 0.151590] ACPI: Interpreter disabled.763lb # [ 0.144785] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages764worker2 # [ 0.143798] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page765worker1 # [ 0.153402] iommu: Default domain type: Translated766lb # [ 0.144789] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page767worker1 # [ 0.153411] iommu: DMA domain TLB invalidation policy: strict mode768worker2 # [ 0.143803] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages769worker2 # [ 0.143807] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page770worker1 # [ 0.155055] SCSI subsystem initialized771lb # [ 0.152072] fbcon: Taking over console772lb # [ 0.152086] ACPI: Interpreter disabled.773lb # [ 0.153938] iommu: Default domain type: Translated774worker2 # [ 0.151219] fbcon: Taking over console775lb # [ 0.153947] iommu: DMA domain TLB invalidation policy: strict mode776worker2 # [ 0.151235] ACPI: Interpreter disabled.777worker2 # [ 0.153082] iommu: Default domain type: Translated778lb # [ 0.155668] SCSI subsystem initialized779worker2 # [ 0.153092] iommu: DMA domain TLB invalidation policy: strict mode780worker2 # [ 0.154848] SCSI subsystem initialized781worker1 # [ 0.162570] usbcore: registered new interface driver usbfs782worker1 # [ 0.162603] usbcore: registered new interface driver hub783worker1 # [ 0.162621] usbcore: registered new device driver usb784worker1 # [ 0.162930] pps_core: LinuxPPS API ver. 1 registered785worker1 # [ 0.162936] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>786worker1 # [ 0.162946] PTP clock support registered787worker1 # [ 0.162986] EDAC MC: Ver: 3.0.0788lb # [ 0.163252] usbcore: registered new interface driver usbfs789lb # [ 0.163285] usbcore: registered new interface driver hub790worker1 # [ 0.167655] scmi_core: SCMI protocol bus registered791lb # [ 0.163303] usbcore: registered new device driver usb792worker2 # [ 0.162384] usbcore: registered new interface driver usbfs793lb # [ 0.163605] pps_core: LinuxPPS API ver. 1 registered794worker1 # [ 0.168601] FPGA manager framework795worker2 # [ 0.162418] usbcore: registered new interface driver hub796worker1 # [ 0.169571] vgaarb: loaded797worker2 # [ 0.162445] usbcore: registered new device driver usb798lb # [ 0.163611] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>799worker2 # [ 0.162742] pps_core: LinuxPPS API ver. 1 registered800lb # [ 0.163628] PTP clock support registered801lb # [ 0.163670] EDAC MC: Ver: 3.0.0802worker1 # [ 0.170213] clocksource: Switched to clocksource arch_sys_counter803worker2 # [ 0.162748] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>804worker1 # [ 0.170865] VFS: Disk quotas dquot_6.6.0805lb # [ 0.168303] scmi_core: SCMI protocol bus registered806worker2 # [ 0.162758] PTP clock support registered807worker2 # [ 0.162799] EDAC MC: Ver: 3.0.0808worker1 # [ 0.170892] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)809lb # [ 0.169267] FPGA manager framework810worker2 # [ 0.167413] scmi_core: SCMI protocol bus registered811worker1 # [ 0.173240] netfs: FS-Cache loaded812lb # [ 0.170281] vgaarb: loaded813worker1 # [ 0.173353] pnp: PnP ACPI: disabled814worker2 # [ 0.168372] FPGA manager framework815worker2 # [ 0.169339] vgaarb: loaded816lb # [ 0.170916] clocksource: Switched to clocksource arch_sys_counter817lb # [ 0.172366] VFS: Disk quotas dquot_6.6.0818worker2 # [ 0.169981] clocksource: Switched to clocksource arch_sys_counter819lb # [ 0.172396] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)820worker2 # [ 0.170591] VFS: Disk quotas dquot_6.6.0821lb # [ 0.173997] netfs: FS-Cache loaded822worker2 # [ 0.170618] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)823lb # [ 0.174095] pnp: PnP ACPI: disabled824worker2 # [ 0.172980] netfs: FS-Cache loaded825worker2 # [ 0.173106] pnp: PnP ACPI: disabled826worker1 # [ 0.179377] NET: Registered PF_INET protocol family827worker1 # [ 0.179665] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)828lb # [ 0.180314] NET: Registered PF_INET protocol family829lb # [ 0.180604] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)830worker2 # [ 0.179148] NET: Registered PF_INET protocol family831worker2 # [ 0.179429] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832worker1 # [ 0.209840] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833worker1 # [ 0.209894] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834worker1 # [ 0.209923] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835worker1 # [ 0.210000] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836worker1 # [ 0.210142] TCP: Hash tables configured (established 16384 bind 16384)837worker2 # [ 0.209914] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)838worker2 # [ 0.209969] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)839worker1 # [ 0.214953] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)840lb # [ 0.211282] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)841worker1 # [ 0.214996] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)842lb # [ 0.211337] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)843worker2 # [ 0.212114] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)844worker1 # [ 0.215035] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)845lb # [ 0.211369] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)846worker2 # [ 0.212235] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)847worker1 # [ 0.215128] NET: Registered PF_UNIX/PF_LOCAL protocol family848lb # [ 0.211448] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849worker2 # [ 0.212377] TCP: Hash tables configured (established 16384 bind 16384)850worker1 # [ 0.215159] NET: Registered PF_XDP protocol family851worker1 # [ 0.215177] PCI: CLS 0 bytes, default 64852lb # [ 0.211590] TCP: Hash tables configured (established 16384 bind 16384)853worker2 # [ 0.212484] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)854worker1 # [ 0.215409] Trying to unpack rootfs image as initramfs...855lb # [ 0.211684] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)856worker2 # [ 0.212524] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)857lb # [ 0.211724] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)858worker2 # [ 0.212562] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)859worker2 # [ 0.212685] NET: Registered PF_UNIX/PF_LOCAL protocol family860lb # [ 0.211763] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)861worker2 # [ 0.212737] NET: Registered PF_XDP protocol family862lb # [ 0.211853] NET: Registered PF_UNIX/PF_LOCAL protocol family863worker2 # [ 0.212757] PCI: CLS 0 bytes, default 64864lb # [ 0.211883] NET: Registered PF_XDP protocol family865worker2 # [ 0.213025] Trying to unpack rootfs image as initramfs...866lb # [ 0.211903] PCI: CLS 0 bytes, default 64867lb # [ 0.212163] Trying to unpack rootfs image as initramfs...868worker1 # [ 0.227185] kvm [1]: HYP mode not available869lb # [ 0.228501] kvm [1]: HYP mode not available870client # [ 0.324623] Initialise system trusted keyrings871client # [ 0.325362] workingset: timestamp_bits=42 max_order=19 bucket_order=0872worker2 # [ 0.230002] kvm [1]: HYP mode not available873client # [ 0.332342] squashfs: version 4.0 (2009/01/31) Phillip Lougher874client # [ 0.333206] 9p: Installing v9fs 9p2000 file system support875client # [ 0.353188] Key type asymmetric registered876client # [ 0.353214] Asymmetric key parser 'x509' registered877client # [ 0.353283] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878client # [ 0.355391] io scheduler mq-deadline registered879client # [ 0.355402] io scheduler kyber registered880client # [ 0.368659] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881client # [ 0.369978] ledtrig-cpu: registered to indicate activity on CPUs882client # [ 0.370357] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:883client # [ 0.370373] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000884client # [ 0.370385] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000885client # [ 0.370394] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000886client # [ 0.370411] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits887client # [ 0.370433] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]888client # [ 0.370506] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00889client # [ 0.370516] pci_bus 0000:00: root bus resource [bus 00-ff]890client # [ 0.370522] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]891client # [ 0.370527] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]892client # [ 0.370532] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]893client # [ 0.370589] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint894client # [ 0.371024] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint895client # [ 0.371209] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]896client # [ 0.371225] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]897client # [ 0.371254] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]898client # [ 0.371272] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]899client # [ 0.371732] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint900client # [ 0.371916] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]901client # [ 0.371932] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]902client # [ 0.389946] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]903client # [ 0.390428] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint904client # [ 0.390611] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]905client # [ 0.390626] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]906client # [ 0.390656] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]907client # [ 0.391108] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint908client # [ 0.391288] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]909client # [ 0.391304] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]910client # [ 0.391336] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]911client # [ 0.391799] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint912client # [ 0.404035] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]913client # [ 0.404063] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]914client # [ 0.404093] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915client # [ 0.404593] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint916worker1 # [ 0.324545] Initialise system trusted keyrings917client # [ 0.404780] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]918worker1 # [ 0.325287] workingset: timestamp_bits=42 max_order=19 bucket_order=0919client # [ 0.404796] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]920client # [ 0.404826] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]921worker1 # [ 0.326604] squashfs: version 4.0 (2009/01/31) Phillip Lougher922client # [ 0.405308] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint923client # [ 0.405491] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]924client # [ 0.405507] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]925lb # [ 0.326255] Initialise system trusted keyrings926client # [ 0.405536] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]927worker1 # [ 0.327363] 9p: Installing v9fs 9p2000 file system support928client # [ 0.405552] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]929lb # [ 0.327055] workingset: timestamp_bits=42 max_order=19 bucket_order=0930client # [ 0.406005] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint931lb # [ 0.328343] squashfs: version 4.0 (2009/01/31) Phillip Lougher932worker2 # [ 0.326557] Initialise system trusted keyrings933client # [ 0.406193] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]934worker2 # [ 0.327309] workingset: timestamp_bits=42 max_order=19 bucket_order=0935client # [ 0.406224] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]936client # [ 0.406685] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint937lb # [ 0.329114] 9p: Installing v9fs 9p2000 file system support938worker2 # [ 0.328596] squashfs: version 4.0 (2009/01/31) Phillip Lougher939client # [ 0.406874] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]940worker2 # [ 0.329351] 9p: Installing v9fs 9p2000 file system support941client # [ 0.406904] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]942client # [ 0.407317] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint943client # [ 0.407498] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]944client # [ 0.407749] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint945client # [ 0.428065] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]946client # [ 0.428090] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]947client # [ 0.428119] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]948client # [ 0.428615] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint949client # [ 0.428804] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]950client # [ 0.428820] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]951client # [ 0.428850] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]952client # [ 0.429456] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned953client # [ 0.429467] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned954client # [ 0.429473] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned955client # [ 0.429518] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned956worker2 # [ 0.349936] Key type asymmetric registered957client # [ 0.429565] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned958worker1 # [ 0.355299] Key type asymmetric registered959worker2 # [ 0.349963] Asymmetric key parser 'x509' registered960worker1 # [ 0.355328] Asymmetric key parser 'x509' registered961client # [ 0.429612] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned962lb # [ 0.353039] Key type asymmetric registered963worker1 # [ 0.355404] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)964lb # [ 0.353068] Asymmetric key parser 'x509' registered965client # [ 0.429658] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned966worker1 # [ 0.357482] io scheduler mq-deadline registered967lb # [ 0.353142] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)968worker1 # [ 0.357493] io scheduler kyber registered969client # [ 0.429704] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned970client # [ 0.429751] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned971client # [ 0.429798] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned972client # [ 0.429844] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned973client # [ 0.429891] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned974client # [ 0.429993] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned975client # [ 0.430039] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned976worker2 # [ 0.358066] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)977client # [ 0.430061] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned978worker2 # [ 0.359137] io scheduler mq-deadline registered979worker2 # [ 0.359147] io scheduler kyber registered980client # [ 0.430083] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned981client # [ 0.430104] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned982lb # [ 0.358971] io scheduler mq-deadline registered983lb # [ 0.358990] io scheduler kyber registered984client # [ 0.430128] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned985client # [ 0.430150] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned986client # [ 0.430171] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned987client # [ 0.430193] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned988client # [ 0.430215] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned989client # [ 0.430237] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned990client # [ 0.430260] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned991client # [ 0.430283] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned992client # [ 0.430304] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned993client # [ 0.430325] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned994client # [ 0.430347] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned995client # [ 0.430368] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned996client # [ 0.430390] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned997worker2 # [ 0.370114] pl061_gpio 9030000.pl061: PL061 GPIO chip registered998client # [ 0.430411] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned999client # [ 0.430432] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1000client # [ 0.430454] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1001worker1 # [ 0.370724] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1002worker1 # [ 0.371374] ledtrig-cpu: registered to indicate activity on CPUs1003client # [ 0.430476] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1004worker2 # [ 0.371489] ledtrig-cpu: registered to indicate activity on CPUs1005client # [ 0.430504] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1006worker1 # [ 0.371727] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1007worker2 # [ 0.371878] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1008client # [ 0.430513] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1009worker1 # [ 0.371753] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001010client # [ 0.430518] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1011worker2 # [ 0.371895] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001012client # [ 0.431695] pci 0000:00:0a.0: enabling device (0000 -> 0002)1013worker1 # [ 0.371772] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001014lb # [ 0.371077] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1015worker2 # [ 0.371907] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001016lb # [ 0.371753] ledtrig-cpu: registered to indicate activity on CPUs1017worker1 # [ 0.371780] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001018worker2 # [ 0.371916] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001019lb # [ 0.372136] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1020worker1 # [ 0.371804] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1021worker2 # [ 0.371937] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1022lb # [ 0.372154] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001023worker1 # [ 0.371826] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1024worker2 # [ 0.371962] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1025lb # [ 0.372166] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001026worker1 # [ 0.371896] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001027worker2 # [ 0.372041] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001028worker1 # [ 0.371906] pci_bus 0000:00: root bus resource [bus 00-ff]1029lb # [ 0.372175] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001030worker2 # [ 0.372051] pci_bus 0000:00: root bus resource [bus 00-ff]1031worker1 # [ 0.371913] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1032worker2 # [ 0.372057] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1033lb # [ 0.372207] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1034worker1 # [ 0.371918] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1035worker2 # [ 0.372062] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1036worker1 # [ 0.371923] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1037lb # [ 0.372233] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1038worker2 # [ 0.372068] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1039lb # [ 0.372310] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001040worker1 # [ 0.372022] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1041worker2 # [ 0.372127] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1042lb # [ 0.372320] pci_bus 0000:00: root bus resource [bus 00-ff]1043worker1 # [ 0.372460] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1044lb # [ 0.372326] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1045worker2 # [ 0.372565] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1046worker1 # [ 0.372646] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1047client # [ 0.476084] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 43354 usecs1048worker2 # [ 0.372756] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1049lb # [ 0.372332] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1050worker1 # [ 0.372663] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1051worker2 # [ 0.372773] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1052lb # [ 0.372337] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1053worker1 # [ 0.372692] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1054worker2 # [ 0.372802] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1055worker1 # [ 0.372709] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1056lb # [ 0.372423] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1057worker2 # [ 0.372819] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1058worker1 # [ 0.373160] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1059lb # [ 0.372864] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1060worker2 # [ 0.373292] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1061worker1 # [ 0.373343] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1062lb # [ 0.373050] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1063worker2 # [ 0.373479] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1064worker1 # [ 0.373359] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1065lb # [ 0.373067] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1066worker2 # [ 0.373494] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1067worker1 # [ 0.373389] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1068lb # [ 0.373096] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1069worker2 # [ 0.373524] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1070lb # [ 0.373113] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1071worker1 # [ 0.373834] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1072worker2 # [ 0.373975] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1073worker1 # [ 0.374017] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1074lb # [ 0.373570] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1075worker1 # [ 0.374033] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1076lb # [ 0.373753] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1077worker2 # [ 0.393346] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1078worker1 # [ 0.374064] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1079lb # [ 0.373769] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1080worker2 # [ 0.393366] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1081lb # [ 0.373799] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1082worker1 # [ 0.374562] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1083worker2 # [ 0.393396] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1084worker1 # [ 0.374743] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1085lb # [ 0.374244] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1086worker2 # [ 0.393862] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1087worker1 # [ 0.374759] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1088lb # [ 0.374426] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1089worker1 # [ 0.374792] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1090lb # [ 0.374442] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1091worker2 # [ 0.397069] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1092lb # [ 0.374471] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1093worker1 # [ 0.375258] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1094worker2 # [ 0.397088] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1095worker1 # [ 0.375440] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1096lb # [ 0.374942] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1097worker2 # [ 0.397121] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1098worker1 # [ 0.375456] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1099lb # [ 0.375123] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1100worker1 # [ 0.375486] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1101worker2 # [ 0.397576] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1102lb # [ 0.375148] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1103worker2 # [ 0.397757] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1104lb # [ 0.375181] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1105worker1 # [ 0.375931] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1106worker2 # [ 0.397773] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1107worker1 # [ 0.376112] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1108lb # [ 0.375638] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1109worker2 # [ 0.397802] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1110worker1 # [ 0.376129] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1111lb # [ 0.375819] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1112worker1 # [ 0.376158] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1113lb # [ 0.375835] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1114lb # [ 0.375865] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1115worker1 # [ 0.376608] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1116worker1 # [ 0.376790] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1117lb # [ 0.376350] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1118worker1 # [ 0.376806] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1119lb # [ 0.376533] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1120worker1 # [ 0.376836] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1121lb # [ 0.376550] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1122worker1 # [ 0.376852] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1123lb # [ 0.376579] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1124worker1 # [ 0.377328] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1125lb # [ 0.377037] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1126client # [ 0.496786] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1127worker1 # [ 0.377514] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1128lb # [ 0.377220] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1129client # [ 0.498906] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1130worker1 # [ 0.377544] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131lb # [ 0.377235] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1132lb # [ 0.377265] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1133worker1 # [ 0.377992] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1134lb # [ 0.377281] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1135worker1 # [ 0.378178] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1136worker1 # [ 0.378208] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1137lb # [ 0.377738] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1138lb # [ 0.377924] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1139lb # [ 0.377953] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1140lb # [ 0.378400] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1141lb # [ 0.378586] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1142lb # [ 0.378616] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1143worker2 # [ 0.410315] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1144worker2 # [ 0.410518] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1145worker2 # [ 0.410535] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1146worker2 # [ 0.410565] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1147worker2 # [ 0.411058] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1148client # [ 0.509965] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1149worker2 # [ 0.411246] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1150client # [ 0.511917] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1151worker2 # [ 0.411262] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1152worker2 # [ 0.411292] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1153worker2 # [ 0.411308] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1154worker1 # [ 0.426710] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1155worker2 # [ 0.411775] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1156worker1 # [ 0.426898] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1157worker2 # [ 0.411965] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1158worker1 # [ 0.427150] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1159worker2 # [ 0.411995] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1160worker1 # [ 0.427449] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1161worker2 # [ 0.412447] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1162worker1 # [ 0.427466] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1163worker2 # [ 0.412637] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1164worker1 # [ 0.427496] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1165worker2 # [ 0.412666] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1166worker1 # [ 0.427952] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1167worker2 # [ 0.413071] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1168worker1 # [ 0.428134] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1169lb # [ 0.427069] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1170worker2 # [ 0.413255] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1171worker1 # [ 0.428151] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1172lb # [ 0.427275] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1173worker2 # [ 0.413505] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1174worker1 # [ 0.428181] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1175client # [ 0.522969] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1176lb # [ 0.427529] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1177worker2 # [ 0.413796] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1178worker1 # [ 0.428753] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1179lb # [ 0.427807] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1180worker2 # [ 0.413813] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1181lb # [ 0.427824] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1182worker1 # [ 0.428764] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1183worker2 # [ 0.413843] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1184lb # [ 0.427854] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1185worker1 # [ 0.428770] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1186worker2 # [ 0.414320] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1187lb # [ 0.428322] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1188worker2 # [ 0.414504] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1189worker1 # [ 0.428815] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1190worker2 # [ 0.414519] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1191lb # [ 0.428506] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1192worker1 # [ 0.428863] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1193lb # [ 0.428521] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1194worker2 # [ 0.414549] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1195worker1 # [ 0.428910] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1196lb # [ 0.428550] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1197worker2 # [ 0.415137] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1198worker1 # [ 0.428958] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1199lb # [ 0.429127] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1200worker2 # [ 0.415148] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1201worker1 # [ 0.429005] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1202lb # [ 0.429140] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1203worker2 # [ 0.415154] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1204worker1 # [ 0.429054] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1205lb # [ 0.429146] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1206worker2 # [ 0.415197] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1207worker1 # [ 0.429102] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1208lb # [ 0.429191] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1209worker2 # [ 0.415244] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1210client # [ 0.529154] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1211worker1 # [ 0.429151] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1212lb # [ 0.429238] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1213worker2 # [ 0.415290] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1214client # [ 0.531331] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1215worker1 # [ 0.429199] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1216lb # [ 0.429285] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1217worker2 # [ 0.415337] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1218worker1 # [ 0.429276] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1219lb # [ 0.429332] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1220worker2 # [ 0.415384] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1221worker1 # [ 0.429323] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1222lb # [ 0.429379] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1223worker2 # [ 0.415429] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1224worker1 # [ 0.429344] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1225lb # [ 0.429428] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1226worker2 # [ 0.415476] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1227worker1 # [ 0.429366] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1228lb # [ 0.429475] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1229worker2 # [ 0.415522] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1230worker1 # [ 0.429388] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1231lb # [ 0.429523] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1232worker1 # [ 0.429413] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1233worker2 # [ 0.415569] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1234worker1 # [ 0.429435] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1235lb # [ 0.429570] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1236worker2 # [ 0.415632] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1237worker1 # [ 0.429458] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1238worker2 # [ 0.415677] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1239lb # [ 0.429630] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1240worker1 # [ 0.429480] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1241worker2 # [ 0.415699] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1242lb # [ 0.429676] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1243worker1 # [ 0.429503] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1244worker2 # [ 0.415720] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1245lb # [ 0.429698] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1246worker1 # [ 0.429525] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1247worker2 # [ 0.415742] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1248lb # [ 0.429719] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1249worker1 # [ 0.429548] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1250client # [ 0.541543] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1251worker2 # [ 0.415766] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1252lb # [ 0.429741] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1253worker1 # [ 0.429571] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1254client # [ 0.543776] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1255worker2 # [ 0.415788] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1256lb # [ 0.429765] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1257worker1 # [ 0.429593] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1258worker2 # [ 0.415810] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1259lb # [ 0.429788] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1260worker1 # [ 0.429614] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1261worker2 # [ 0.415832] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1262lb # [ 0.429809] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1263worker1 # [ 0.429637] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1264worker2 # [ 0.415854] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1265lb # [ 0.429831] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1266worker1 # [ 0.429658] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1267worker2 # [ 0.415877] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1268lb # [ 0.429853] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1269worker1 # [ 0.429680] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1270worker1 # [ 0.429702] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1271worker2 # [ 0.415899] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1272lb # [ 0.429876] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1273worker1 # [ 0.429725] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1274worker2 # [ 0.415922] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1275lb # [ 0.429898] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1276worker1 # [ 0.429747] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1277worker2 # [ 0.415944] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1278lb # [ 0.429921] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1279worker1 # [ 0.429770] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1280worker2 # [ 0.415965] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1281lb # [ 0.429942] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1282worker1 # [ 0.429796] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1283worker2 # [ 0.415986] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1284lb # [ 0.429964] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1285worker1 # [ 0.429806] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1286worker2 # [ 0.416007] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1287lb # [ 0.429986] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1288worker1 # [ 0.429811] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1289worker2 # [ 0.416029] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1290lb # [ 0.430007] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1291worker2 # [ 0.416050] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1292lb # [ 0.430028] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1293worker2 # [ 0.416072] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1294lb # [ 0.430049] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1295worker2 # [ 0.416094] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1296lb # [ 0.430071] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1297client # [ 0.554818] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1298worker1 # [ 0.469027] pci 0000:00:0a.0: enabling device (0000 -> 0002)1299worker2 # [ 0.416116] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1300lb # [ 0.430093] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1301worker2 # [ 0.416143] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1302lb # [ 0.430115] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1303worker2 # [ 0.416153] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1304lb # [ 0.430142] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1305worker2 # [ 0.416158] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1306lb # [ 0.430152] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1307worker2 # [ 0.417342] pci 0000:00:0a.0: enabling device (0000 -> 0002)1308lb # [ 0.430156] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1309client # [ 0.558145] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1310lb # [ 0.431343] pci 0000:00:0a.0: enabling device (0000 -> 0002)1311client # [ 0.571388] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1312client # [ 0.574026] msm_serial: driver initialized1313client # [ 0.574203] SuperH (H)SCI(F) driver initialized1314client # [ 0.574259] STM32 USART driver initialized1315worker1 # [ 0.493135] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1316lb # [ 0.490578] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1317worker2 # [ 0.493311] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1318worker1 # [ 0.499387] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1319worker1 # [ 0.501467] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1320lb # [ 0.500302] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1321worker2 # [ 0.503344] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1322worker1 # [ 0.511730] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1323worker1 # [ 0.513695] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1324worker2 # [ 0.507347] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1325worker2 # [ 0.509270] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1326lb # [ 0.511572] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1327lb # [ 0.513576] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1328lb # [ 0.515580] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1329lb # [ 0.517624] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1330worker1 # [ 0.525068] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1331worker2 # [ 0.520668] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1332client # [ 0.612626] loop: module loaded1333client # [ 0.612857] virtio_blk virtio5: 1/0/0 default/read/poll queues1334client # [ 0.613723] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1335worker1 # [ 0.528299] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1336worker2 # [ 0.523744] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1337worker2 # [ 0.525774] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1338lb # [ 0.528145] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1339lb # [ 0.530247] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1340worker1 # [ 0.538490] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1341worker1 # [ 0.540761] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1342worker2 # [ 0.535455] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1343worker2 # [ 0.537728] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1344client # [ 0.624824] megasas: 07.734.00.00-rc11345lb # [ 0.541830] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1346worker1 # [ 0.544294] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1347client # [ 0.625643] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1348client # [ 0.627592] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001349client # [ 0.627632] Intel/Sharp Extended Query Table at 0x00311350client # [ 0.629354] Using buffer write method1351client # [ 0.629443] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1352lb # [ 0.544509] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1353lb # [ 0.546720] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1354client # [ 0.631267] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001355client # [ 0.631303] Intel/Sharp Extended Query Table at 0x00311356worker1 # [ 0.550450] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1357worker2 # [ 0.548598] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1358client # [ 0.645004] Using buffer write method1359client # [ 0.645044] Concatenating MTD devices:1360worker2 # [ 0.551696] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1361client # [ 0.645049] (0): "0.flash"1362client # [ 0.645053] (1): "0.flash"1363client # [ 0.645057] into device "0.flash"1364lb # [ 0.564242] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1365worker1 # [ 0.567472] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1366lb # [ 0.566834] msm_serial: driver initialized1367worker1 # [ 0.570122] msm_serial: driver initialized1368worker2 # [ 0.564664] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1369lb # [ 0.567567] SuperH (H)SCI(F) driver initialized1370worker1 # [ 0.570848] SuperH (H)SCI(F) driver initialized1371lb # [ 0.567628] STM32 USART driver initialized1372worker1 # [ 0.570906] STM32 USART driver initialized1373worker2 # [ 0.567214] msm_serial: driver initialized1374worker2 # [ 0.567361] SuperH (H)SCI(F) driver initialized1375worker2 # [ 0.567414] STM32 USART driver initialized1376worker1 # [ 0.603199] loop: module loaded1377worker1 # [ 0.603412] virtio_blk virtio5: 1/0/0 default/read/poll queues1378lb # [ 0.601721] loop: module loaded1379worker1 # [ 0.604229] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1380lb # [ 0.601931] virtio_blk virtio5: 1/0/0 default/read/poll queues1381lb # [ 0.602695] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1382worker2 # [ 0.602907] loop: module loaded1383worker2 # [ 0.603104] virtio_blk virtio5: 1/0/0 default/read/poll queues1384worker2 # [ 0.603845] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1385worker1 # [ 0.611232] megasas: 07.734.00.00-rc11386worker1 # [ 0.611956] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1387lb # [ 0.608081] megasas: 07.734.00.00-rc11388worker2 # [ 0.610642] megasas: 07.734.00.00-rc11389lb # [ 0.608845] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1390worker2 # [ 0.611376] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1391worker2 # [ 0.613661] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001392worker2 # [ 0.613687] Intel/Sharp Extended Query Table at 0x00311393worker1 # [ 0.622279] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001394worker1 # [ 0.622366] Intel/Sharp Extended Query Table at 0x00311395worker1 # [ 0.624216] Using buffer write method1396worker1 # [ 0.624304] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1397worker2 # [ 0.622988] Using buffer write method1398worker1 # [ 0.626130] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001399worker2 # [ 0.623058] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1400worker1 # [ 0.626175] Intel/Sharp Extended Query Table at 0x00311401worker1 # [ 0.627808] Using buffer write method1402worker1 # [ 0.627845] Concatenating MTD devices:1403worker1 # [ 0.627849] (0): "0.flash"1404worker1 # [ 0.627853] (1): "0.flash"1405worker1 # [ 0.627856] into device "0.flash"1406lb # [ 0.632215] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001407lb # [ 0.632269] Intel/Sharp Extended Query Table at 0x00311408lb # [ 0.633863] Using buffer write method1409lb # [ 0.633958] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1410worker2 # [ 0.634017] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001411worker2 # [ 0.634047] Intel/Sharp Extended Query Table at 0x00311412worker2 # [ 0.635526] Using buffer write method1413worker2 # [ 0.635554] Concatenating MTD devices:1414worker2 # [ 0.635558] (0): "0.flash"1415worker2 # [ 0.635562] (1): "0.flash"1416worker2 # [ 0.635565] into device "0.flash"1417lb # [ 0.639123] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001418lb # [ 0.639166] Intel/Sharp Extended Query Table at 0x00311419lb # [ 0.640697] Using buffer write method1420lb # [ 0.640733] Concatenating MTD devices:1421lb # [ 0.640738] (0): "0.flash"1422lb # [ 0.640741] (1): "0.flash"1423lb # [ 0.640745] into device "0.flash"1424client # [ 0.892221] Freeing initrd memory: 26160K1425client # [ 0.898379] tun: Universal TUN/TAP device driver, 1.61426client # [ 0.902112] thunder_xcv, ver 1.01427client # [ 0.902163] thunder_bgx, ver 1.01428client # [ 0.902186] nicpf, ver 1.01429client # [ 0.902766] e1000: Intel(R) PRO/1000 Network Driver1430client # [ 0.902773] e1000: Copyright (c) 1999-2006 Intel Corporation.1431client # [ 0.902797] e1000e: Intel(R) PRO/1000 Network Driver1432client # [ 0.902804] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1433client # [ 0.902832] igb: Intel(R) Gigabit Ethernet Network Driver1434client # [ 0.902838] igb: Copyright (c) 2007-2014 Intel Corporation.1435client # [ 0.902860] igbvf: Intel(R) Gigabit Virtual Function Network Driver1436client # [ 0.902866] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1437client # [ 0.903001] sky2: driver version 1.301438client # [ 0.911543] usbcore: registered new interface driver usb-storage1439client # [ 0.911678] usbcore: registered new interface driver usbserial_generic1440client # [ 0.911694] usbserial: USB Serial support registered for generic1441client # [ 0.914903] ehci-pci 0000:00:0a.0: EHCI Host Controller1442client # [ 0.914935] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11443client # [ 0.915163] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001444client # [ 0.917915] hv_vmbus: registering driver hyperv_keyboard1445client # [ 0.919444] rtc-pl031 9010000.pl031: registered as rtc01446client # [ 0.919470] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:51 UTC (1789901451)1447client # [ 0.919768] i2c_dev: i2c /dev entries driver1448client # [ 0.924878] sdhci: Secure Digital Host Controller Interface driver1449client # [ 0.924893] sdhci: Copyright(c) Pierre Ossman1450client # [ 0.925166] Synopsys Designware Multimedia Card Interface Driver1451client # [ 0.925539] sdhci-pltfm: SDHCI platform and OF driver helper1452client # [ 0.927235] hid: raw HID events driver (C) Jiri Kosina1453client # [ 0.927474] usbcore: registered new interface driver usbhid1454client # [ 0.927480] usbhid: USB HID core driver1455client # [ 0.932388] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001456client # [ 0.932760] hub 1-0:1.0: USB hub found1457client # [ 0.932778] hub 1-0:1.0: 6 ports detected1458client # [ 0.935410] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1459client # [ 0.938039] drop_monitor: Initializing network drop monitor service1460client # [ 0.938230] NET: Registered PF_INET6 protocol family1461client # [ 0.940122] Segment Routing with IPv61462client # [ 0.940151] In-situ OAM (IOAM) with IPv61463client # [ 0.940179] NET: Registered PF_PACKET protocol family1464client # [ 0.941816] 9pnet: Installing 9P2000 support1465client # [ 0.944556] Key type dns_resolver registered1466client # [ 0.950751] registered taskstats version 11467client # [ 0.950907] Loading compiled-in X.509 certificates1468client # [ 0.959601] Demotion targets for Node 0: null1469client # [ 0.959713] Key type .fscrypt registered1470client # [ 0.959719] Key type fscrypt-provisioning registered1471client # [ 0.959815] ima: No TPM chip found, activating TPM-bypass!1472client # [ 0.959834] ima: Allocated hash algorithm: sha11473client # [ 0.959856] ima: No architecture policies found1474client # [ 0.964112] input: gpio-keys as /devices/platform/gpio-keys/input/input01475worker2 # [ 0.881438] Freeing initrd memory: 26148K1476worker2 # [ 0.887443] tun: Universal TUN/TAP device driver, 1.61477worker1 # [ 0.895573] Freeing initrd memory: 26148K1478lb # [ 0.894426] Freeing initrd memory: 26140K1479client # [ 0.982193] clk: Disabling unused clocks1480client # [ 0.982229] PM: genpd: Disabling unused power domains1481worker2 # [ 0.891269] thunder_xcv, ver 1.01482worker2 # [ 0.891315] thunder_bgx, ver 1.01483client # [ 0.986484] Freeing unused kernel memory: 4736K1484worker2 # [ 0.891337] nicpf, ver 1.01485client # [ 0.986694] Run /init as init process1486worker2 # [ 0.891890] e1000: Intel(R) PRO/1000 Network Driver1487worker1 # [ 0.901708] tun: Universal TUN/TAP device driver, 1.61488worker2 # [ 0.891897] e1000: Copyright (c) 1999-2006 Intel Corporation.1489worker2 # [ 0.891922] e1000e: Intel(R) PRO/1000 Network Driver1490worker2 # [ 0.891930] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1491lb # [ 0.900636] tun: Universal TUN/TAP device driver, 1.61492worker2 # [ 0.891959] igb: Intel(R) Gigabit Ethernet Network Driver1493worker2 # [ 0.891964] igb: Copyright (c) 2007-2014 Intel Corporation.1494worker2 # [ 0.891987] igbvf: Intel(R) Gigabit Virtual Function Network Driver1495worker1 # [ 0.905602] thunder_xcv, ver 1.01496worker2 # [ 0.891993] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1497worker1 # [ 0.905653] thunder_bgx, ver 1.01498worker1 # [ 0.905677] nicpf, ver 1.01499worker2 # [ 0.892124] sky2: driver version 1.301500worker2 # [ 0.893716] usbcore: registered new interface driver usb-storage1501worker2 # [ 0.893802] usbcore: registered new interface driver usbserial_generic1502worker2 # [ 0.893818] usbserial: USB Serial support registered for generic1503worker2 # [ 0.894732] ehci-pci 0000:00:0a.0: EHCI Host Controller1504worker2 # [ 0.894758] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11505lb # [ 0.904480] thunder_xcv, ver 1.01506worker1 # [ 0.907507] e1000: Intel(R) PRO/1000 Network Driver1507lb # [ 0.904530] thunder_bgx, ver 1.01508worker2 # [ 0.894949] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001509lb # [ 0.904553] nicpf, ver 1.01510worker1 # [ 0.907520] e1000: Copyright (c) 1999-2006 Intel Corporation.1511lb # [ 0.905107] e1000: Intel(R) PRO/1000 Network Driver1512worker1 # [ 0.907551] e1000e: Intel(R) PRO/1000 Network Driver1513worker2 # [ 0.906655] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001514lb # [ 0.905115] e1000: Copyright (c) 1999-2006 Intel Corporation.1515worker1 # [ 0.907561] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1516worker2 # [ 0.906994] hub 1-0:1.0: USB hub found1517lb # [ 0.905139] e1000e: Intel(R) PRO/1000 Network Driver1518worker2 # [ 0.907023] hub 1-0:1.0: 6 ports detected1519worker1 # [ 0.907591] igb: Intel(R) Gigabit Ethernet Network Driver1520lb # [ 0.905147] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1521worker1 # [ 0.907596] igb: Copyright (c) 2007-2014 Intel Corporation.1522lb # [ 0.905177] igb: Intel(R) Gigabit Ethernet Network Driver1523worker1 # [ 0.907621] igbvf: Intel(R) Gigabit Virtual Function Network Driver1524worker2 # [ 0.909487] hv_vmbus: registering driver hyperv_keyboard1525lb # [ 0.905183] igb: Copyright (c) 2007-2014 Intel Corporation.1526worker1 # [ 0.907627] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1527client # [ 1.002255] systemd[1]: Successfully made /usr/ read-only.1528lb # [ 0.905206] igbvf: Intel(R) Gigabit Virtual Function Network Driver1529worker1 # [ 0.907781] sky2: driver version 1.301530lb # [ 0.905212] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1531worker1 # [ 0.909421] usbcore: registered new interface driver usb-storage1532lb # [ 0.905347] sky2: driver version 1.301533worker2 # [ 0.911008] rtc-pl031 9010000.pl031: registered as rtc01534worker1 # [ 0.909540] usbcore: registered new interface driver usbserial_generic1535lb # [ 0.907682] ehci-pci 0000:00:0a.0: EHCI Host Controller1536worker2 # [ 0.911035] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:51 UTC (1789901451)1537worker1 # [ 0.909555] usbserial: USB Serial support registered for generic1538lb # [ 0.907714] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11539worker2 # [ 0.911333] i2c_dev: i2c /dev entries driver1540worker1 # [ 0.910147] hv_vmbus: registering driver hyperv_keyboard1541lb # [ 0.907958] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001542worker1 # [ 0.910934] ehci-pci 0000:00:0a.0: EHCI Host Controller1543worker1 # [ 0.910968] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11544worker1 # [ 0.911155] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001545lb # [ 0.917156] usbcore: registered new interface driver usb-storage1546lb # [ 0.917272] usbcore: registered new interface driver usbserial_generic1547worker1 # [ 0.922960] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001548lb # [ 0.917287] usbserial: USB Serial support registered for generic1549worker2 # [ 0.916269] sdhci: Secure Digital Host Controller Interface driver1550worker1 # [ 0.924047] hub 1-0:1.0: USB hub found1551worker2 # [ 0.916282] sdhci: Copyright(c) Pierre Ossman1552lb # [ 0.917963] hv_vmbus: registering driver hyperv_keyboard1553worker1 # [ 0.924531] hub 1-0:1.0: 6 ports detected1554worker2 # [ 0.916545] Synopsys Designware Multimedia Card Interface Driver1555worker2 # [ 0.916926] sdhci-pltfm: SDHCI platform and OF driver helper1556lb # [ 0.921554] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001557lb # [ 0.921889] hub 1-0:1.0: USB hub found1558worker1 # [ 0.925622] rtc-pl031 9010000.pl031: registered as rtc01559lb # [ 0.921911] hub 1-0:1.0: 6 ports detected1560worker1 # [ 0.925654] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:51 UTC (1789901451)1561worker2 # [ 0.921225] hid: raw HID events driver (C) Jiri Kosina1562worker1 # [ 0.925995] i2c_dev: i2c /dev entries driver1563worker2 # [ 0.921498] usbcore: registered new interface driver usbhid1564lb # [ 0.924183] rtc-pl031 9010000.pl031: registered as rtc01565worker2 # [ 0.921505] usbhid: USB HID core driver1566lb # [ 0.924213] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:51 UTC (1789901451)1567lb # [ 0.924567] i2c_dev: i2c /dev entries driver1568worker2 # [ 0.924380] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1569worker2 # [ 0.925893] drop_monitor: Initializing network drop monitor service1570worker2 # [ 0.927952] NET: Registered PF_INET6 protocol family1571lb # [ 0.929538] sdhci: Secure Digital Host Controller Interface driver1572worker1 # [ 0.931070] sdhci: Secure Digital Host Controller Interface driver1573worker2 # [ 0.929385] Segment Routing with IPv61574lb # [ 0.929549] sdhci: Copyright(c) Pierre Ossman1575worker1 # [ 0.931083] sdhci: Copyright(c) Pierre Ossman1576worker2 # [ 0.929419] In-situ OAM (IOAM) with IPv61577lb # [ 0.929821] Synopsys Designware Multimedia Card Interface Driver1578worker1 # [ 0.931355] Synopsys Designware Multimedia Card Interface Driver1579worker2 # [ 0.929449] NET: Registered PF_PACKET protocol family1580lb # [ 0.930201] sdhci-pltfm: SDHCI platform and OF driver helper1581worker1 # [ 0.931731] sdhci-pltfm: SDHCI platform and OF driver helper1582worker1 # [ 0.933436] hid: raw HID events driver (C) Jiri Kosina1583worker1 # [ 0.933686] usbcore: registered new interface driver usbhid1584worker1 # [ 0.933692] usbhid: USB HID core driver1585lb # [ 0.934651] hid: raw HID events driver (C) Jiri Kosina1586worker2 # [ 0.931260] 9pnet: Installing 9P2000 support1587worker2 # [ 0.933431] Key type dns_resolver registered1588lb # [ 0.935631] usbcore: registered new interface driver usbhid1589lb # [ 0.935641] usbhid: USB HID core driver1590worker1 # [ 0.939310] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1591worker1 # [ 0.940840] drop_monitor: Initializing network drop monitor service1592lb # [ 0.937904] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1593worker1 # [ 0.941033] NET: Registered PF_INET6 protocol family1594worker1 # [ 0.944069] Segment Routing with IPv61595lb # [ 0.940586] drop_monitor: Initializing network drop monitor service1596worker1 # [ 0.944091] In-situ OAM (IOAM) with IPv61597lb # [ 0.940767] NET: Registered PF_INET6 protocol family1598worker1 # [ 0.944134] NET: Registered PF_PACKET protocol family1599lb # [ 0.942724] Segment Routing with IPv61600worker1 # [ 0.945781] 9pnet: Installing 9P2000 support1601lb # [ 0.942743] In-situ OAM (IOAM) with IPv61602lb # [ 0.942777] NET: Registered PF_PACKET protocol family1603worker2 # [ 0.940290] registered taskstats version 11604worker2 # [ 0.940435] Loading compiled-in X.509 certificates1605lb # [ 0.944626] 9pnet: Installing 9P2000 support1606worker1 # [ 0.948716] Key type dns_resolver registered1607lb # [ 0.946782] Key type dns_resolver registered1608worker2 # [ 0.948828] Demotion targets for Node 0: null1609worker2 # [ 0.948992] Key type .fscrypt registered1610worker2 # [ 0.949002] Key type fscrypt-provisioning registered1611worker2 # [ 0.949097] ima: No TPM chip found, activating TPM-bypass!1612worker2 # [ 0.949117] ima: Allocated hash algorithm: sha11613worker2 # [ 0.949144] ima: No architecture policies found1614lb # [ 0.953533] registered taskstats version 11615worker1 # [ 0.955192] registered taskstats version 11616lb # [ 0.953712] Loading compiled-in X.509 certificates1617worker2 # [ 0.953188] input: gpio-keys as /devices/platform/gpio-keys/input/input01618worker1 # [ 0.955354] Loading compiled-in X.509 certificates1619worker1 # [ 0.964108] Demotion targets for Node 0: null1620worker1 # [ 0.964242] Key type .fscrypt registered1621worker1 # [ 0.964250] Key type fscrypt-provisioning registered1622lb # [ 0.962240] Demotion targets for Node 0: null1623worker1 # [ 0.964349] ima: No TPM chip found, activating TPM-bypass!1624lb # [ 0.962349] Key type .fscrypt registered1625worker1 # [ 0.964369] ima: Allocated hash algorithm: sha11626lb # [ 0.962355] Key type fscrypt-provisioning registered1627worker1 # [ 0.964391] ima: No architecture policies found1628lb # [ 0.962453] ima: No TPM chip found, activating TPM-bypass!1629lb # [ 0.962472] ima: Allocated hash algorithm: sha11630lb # [ 0.962501] ima: No architecture policies found1631worker1 # [ 0.968608] input: gpio-keys as /devices/platform/gpio-keys/input/input01632lb # [ 0.966943] input: gpio-keys as /devices/platform/gpio-keys/input/input01633worker2 # [ 0.970917] clk: Disabling unused clocks1634worker2 # [ 0.970946] PM: genpd: Disabling unused power domains1635worker2 # [ 0.975202] Freeing unused kernel memory: 4736K1636worker2 # [ 0.975429] Run /init as init process1637worker1 # [ 0.987136] clk: Disabling unused clocks1638worker1 # [ 0.987175] PM: genpd: Disabling unused power domains1639lb # [ 0.984627] clk: Disabling unused clocks1640lb # [ 0.984663] PM: genpd: Disabling unused power domains1641worker1 # [ 0.991460] Freeing unused kernel memory: 4736K1642worker1 # [ 0.991698] Run /init as init process1643lb # [ 0.988893] Freeing unused kernel memory: 4736K1644lb # [ 0.989124] Run /init as init process1645worker2 # [ 0.992265] systemd[1]: Successfully made /usr/ read-only.1646lb # [ 1.005219] systemd[1]: Successfully made /usr/ read-only.1647worker1 # [ 1.008499] systemd[1]: Successfully made /usr/ read-only.1648client # [ 1.180025] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker2 # [ 1.154059] usb 1-1: new high-speed USB device number 2 using ehci-pci1650lb # [ 1.166995] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker1 # [ 1.170303] usb 1-1: new high-speed USB device number 2 using ehci-pci1652client # [ 1.332187] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653client # [ 1.338067] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1654client # [ 1.350286] systemd[1]: Detected virtualization qemu.1655client # [ 1.350383] systemd[1]: Detected architecture arm64.1656client # [ 1.350408] systemd[1]: Running in initrd.1657client # [ 1.351375] systemd[1]: Initializing machine ID from random generator.1658client # [ 1.351782] systemd[1]: Hostname set to <client>.1659worker2 # [ 1.308331] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660lb # [ 1.319411] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661worker1 # [ 1.322642] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11662client # [ 1.416242] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01663worker2 # [ 1.327084] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1664worker2 # [ 1.339067] systemd[1]: Detected virtualization qemu.1665worker2 # [ 1.341068] systemd[1]: Detected architecture arm64.1666worker2 # [ 1.343088] systemd[1]: Running in initrd.1667worker2 # [ 1.345691] systemd[1]: Initializing machine ID from random generator.1668lb # [ 1.340042] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1669worker1 # [ 1.343319] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1670worker2 # [ 1.348645] systemd[1]: Hostname set to <worker2>.1671lb # [ 1.352121] systemd[1]: Detected virtualization qemu.1672worker1 # [ 1.355406] systemd[1]: Detected virtualization qemu.1673lb # [ 1.354105] systemd[1]: Detected architecture arm64.1674worker1 # [ 1.357391] systemd[1]: Detected architecture arm64.1675lb # [ 1.356084] systemd[1]: Running in initrd.1676worker1 # [ 1.359375] systemd[1]: Running in initrd.1677lb # [ 1.358657] systemd[1]: Initializing machine ID from random generator.1678worker1 # [ 1.361932] systemd[1]: Initializing machine ID from random generator.1679lb # [ 1.361666] systemd[1]: Hostname set to <lb>.1680worker1 # [ 1.364913] systemd[1]: Hostname set to <worker1>.1681worker2 # [ 1.394299] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682lb # [ 1.407270] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker1 # [ 1.410547] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01684client # [ 1.536001] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker2 # [ 1.518071] usb 1-2: new high-speed USB device number 3 using ehci-pci1686lb # [ 1.531007] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker1 # [ 1.534330] usb 1-2: new high-speed USB device number 3 using ehci-pci1688client # [ 1.663791] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689client # [ 1.690295] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690client # [ 1.695423] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691worker2 # [ 1.650470] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692lb # [ 1.669163] systemd[1]: bpf-restrict-fs: LSM BPF program attached1693worker1 # [ 1.676739] systemd[1]: bpf-restrict-fs: LSM BPF program attached1694worker2 # [ 1.676394] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21695worker2 # [ 1.681516] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01696client # [ 1.779498] systemd[1]: Queued start job for default target Initrd Default Target.1697worker1 # [ 1.692618] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21698lb # [ 1.693708] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21699worker1 # [ 1.698275] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01700client # [ 1.790329] systemd[1]: Created slice Slice /system/modprobe.1701lb # [ 1.699071] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01702client # [ 1.791575] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1703client # [ 1.792989] systemd[1]: Expecting device /dev/disk/by-label/nixos...1704client # [ 1.794052] systemd[1]: Reached target Path Units.1705client # [ 1.794868] systemd[1]: Reached target Slice Units.1706client # [ 1.795701] systemd[1]: Reached target Swaps.1707client # [ 1.796561] systemd[1]: Reached target Timer Units.1708client # [ 1.797566] systemd[1]: Listening on D-Bus System Message Bus Socket.1709client # [ 1.798782] systemd[1]: Listening on Journal Socket (/dev/log).1710client # [ 1.799905] systemd[1]: Listening on Journal Sockets.1711client # [ 1.801062] systemd[1]: Listening on udev Control Socket.1712client # [ 1.801192] systemd[1]: Listening on udev Kernel Socket.1713client # [ 1.801217] systemd[1]: Reached target Socket Units.1714client # [ 1.805445] systemd[1]: Starting Create List of Static Device Nodes...1715client # [ 1.815947] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1716client # [ 1.817281] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1717client # [ 1.829583] systemd[1]: Mounting Kernel Configuration File System...1718client # [ 1.852118] systemd[1]: Starting Journal Service...1719client # [ 1.856161] systemd[1]: Starting Load Kernel Modules...1720client # [ 1.857094] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1721worker2 # [ 1.765771] systemd[1]: Queued start job for default target Initrd Default Target.1722client # [ 1.864892] systemd[1]: Starting Coldplug All udev Devices...1723worker2 # [ 1.777519] systemd[1]: Created slice Slice /system/modprobe.1724worker2 # [ 1.778762] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1725worker2 # [ 1.780079] systemd[1]: Expecting device /dev/disk/by-label/nixos...1726worker2 # [ 1.781146] systemd[1]: Reached target Path Units.1727worker2 # [ 1.781964] systemd[1]: Reached target Slice Units.1728worker2 # [ 1.782901] systemd[1]: Reached target Swaps.1729worker2 # [ 1.783653] systemd[1]: Reached target Timer Units.1730worker1 # [ 1.789001] systemd[1]: Queued start job for default target Initrd Default Target.1731lb # [ 1.785839] systemd[1]: Queued start job for default target Initrd Default Target.1732worker2 # [ 1.784660] systemd[1]: Listening on D-Bus System Message Bus Socket.1733worker2 # [ 1.785895] systemd[1]: Listening on Journal Socket (/dev/log).1734worker2 # [ 1.787192] systemd[1]: Listening on Journal Sockets.1735worker2 # [ 1.787340] systemd[1]: Listening on udev Control Socket.1736client # [ 1.880119] systemd[1]: Finished Create List of Static Device Nodes.1737worker2 # [ 1.787468] systemd[1]: Listening on udev Kernel Socket.1738client # [ 1.881180] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1739worker2 # [ 1.787491] systemd[1]: Reached target Socket Units.1740worker2 # [ 1.792490] systemd[1]: Starting Create List of Static Device Nodes...1741worker1 # [ 1.800306] systemd[1]: Created slice Slice /system/modprobe.1742lb # [ 1.797429] systemd[1]: Created slice Slice /system/modprobe.1743worker1 # [ 1.801365] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1744lb # [ 1.798643] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1745worker1 # [ 1.802579] systemd[1]: Expecting device /dev/disk/by-label/nixos...1746worker1 # [ 1.803503] systemd[1]: Reached target Path Units.1747worker1 # [ 1.804216] systemd[1]: Reached target Slice Units.1748worker1 # [ 1.804925] systemd[1]: Reached target Swaps.1749worker2 # [ 1.799341] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1750worker1 # [ 1.805586] systemd[1]: Reached target Timer Units.1751lb # [ 1.800165] systemd[1]: Expecting device /dev/disk/by-label/nixos...1752lb # [ 1.800204] systemd[1]: Reached target Path Units.1753worker1 # [ 1.806513] systemd[1]: Listening on D-Bus System Message Bus Socket.1754client # [ 1.892666] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1755worker2 # [ 1.800590] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1756lb # [ 1.800226] systemd[1]: Reached target Slice Units.1757worker1 # [ 1.807544] systemd[1]: Listening on Journal Socket (/dev/log).1758lb # [ 1.800249] systemd[1]: Reached target Swaps.1759worker1 # [ 1.808518] systemd[1]: Listening on Journal Sockets.1760lb # [ 1.800269] systemd[1]: Reached target Timer Units.1761worker1 # [ 1.809381] systemd[1]: Listening on udev Control Socket.1762lb # [ 1.800470] systemd[1]: Listening on D-Bus System Message Bus Socket.1763worker1 # [ 1.810301] systemd[1]: Listening on udev Kernel Socket.1764lb # [ 1.800628] systemd[1]: Listening on Journal Socket (/dev/log).1765worker1 # [ 1.811102] systemd[1]: Reached target Socket Units.1766lb # [ 1.800771] systemd[1]: Listening on Journal Sockets.1767lb # [ 1.800906] systemd[1]: Listening on udev Control Socket.1768lb # [ 1.801022] systemd[1]: Listening on udev Kernel Socket.1769worker1 # [ 1.813272] systemd[1]: Starting Create List of Static Device Nodes...1770lb # [ 1.801044] systemd[1]: Reached target Socket Units.1771lb # [ 1.812092] systemd[1]: Starting Create List of Static Device Nodes...1772worker2 # [ 1.810141] systemd[1]: Mounting Kernel Configuration File System...1773client # [ 1.902643] systemd-journald[73]: Collecting audit messages is disabled.1774client # [ 1.903868] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1775worker1 # [ 1.822474] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1776worker2 # [ 1.818173] systemd[1]: Starting Journal Service...1777worker1 # [ 1.823492] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1778lb # [ 1.823186] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1779lb # [ 1.824337] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1780lb # [ 1.827816] systemd[1]: Mounting Kernel Configuration File System...1781client # [ 1.922786] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1782client # [ 1.923393] systemd[1]: Mounted Kernel Configuration File System.1783worker1 # [ 1.838685] systemd[1]: Mounting Kernel Configuration File System...1784worker1 # [ 1.854482] systemd[1]: Starting Journal Service...1785lb # [ 1.851520] systemd[1]: Starting Journal Service...1786worker2 # [ 1.854217] systemd[1]: Starting Load Kernel Modules...1787worker2 # [ 1.854341] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1788worker1 # [ 1.862188] systemd[1]: Starting Load Kernel Modules...1789worker1 # [ 1.863263] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1790client # [ 1.948065] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1791client # [ 1.952890] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01792client # [ 1.953126] [drm] features: -virgl +edid -resource_blob -host_visible1793client # [ 1.953135] [drm] features: -context_init1794client # [ 1.953845] [drm] number of scanouts: 11795worker2 # [ 1.864631] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1796client # [ 1.953863] [drm] number of cap sets: 01797worker1 # [ 1.876441] systemd[1]: Starting Coldplug All udev Devices...1798worker2 # [ 1.870225] systemd[1]: Starting Coldplug All udev Devices...1799lb # [ 1.875200] systemd[1]: Starting Load Kernel Modules...1800worker2 # [ 1.872750] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1801client # [ 1.964218] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1802lb # [ 1.876156] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1803lb # [ 1.879031] systemd[1]: Starting Coldplug All udev Devices...1804client # [ 1.968443] systemd[1]: Starting Create Static Device Nodes in /dev...1805lb # [ 1.883874] systemd[1]: Finished Create List of Static Device Nodes.1806worker2 # [ 1.880475] systemd[1]: Finished Create List of Static Device Nodes.1807worker2 # [ 1.881412] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1808lb # [ 1.885682] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1809lb # [ 1.891963] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1810lb # [ 1.893418] systemd[1]: Mounted Kernel Configuration File System.1811worker2 # [ 1.890175] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01812worker2 # [ 1.890481] [drm] features: -virgl +edid -resource_blob -host_visible1813worker2 # [ 1.890525] [drm] features: -context_init1814worker2 # [ 1.891248] [drm] number of scanouts: 11815worker2 # [ 1.891266] [drm] number of cap sets: 01816client # [ 1.980352] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1817client # [ 1.980377] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01818worker1 # [ 1.899706] systemd[1]: Finished Create List of Static Device Nodes.1819worker1 # [ 1.900867] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1820worker1 # [ 1.901155] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1821worker2 # [ 1.898125] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1822worker2 # [ 1.898526] systemd[1]: Mounted Kernel Configuration File System.1823worker2 # [ 1.902410] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1824worker1 # [ 1.912407] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1825lb # [ 1.908991] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1826client # [ 2.000464] Console: switching to colour frame buffer device 160x501827worker1 # [ 1.918703] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1828worker1 # [ 1.919069] systemd[1]: Mounted Kernel Configuration File System.1829worker2 # [ 1.915902] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1830worker2 # [ 1.915932] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01831worker1 # [ 1.933492] systemd-journald[73]: Collecting audit messages is disabled.1832worker2 # [ 1.928796] systemd-journald[73]: Collecting audit messages is disabled.1833worker1 # [ 1.934552] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1834worker1 # [ 1.939330] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01835worker1 # [ 1.939563] [drm] features: -virgl +edid -resource_blob -host_visible1836worker1 # [ 1.939572] [drm] features: -context_init1837worker1 # [ 1.940290] [drm] number of scanouts: 11838worker1 # [ 1.940309] [drm] number of cap sets: 01839client # [ 2.028587] systemd[1]: Finished Create Static Device Nodes in /dev.1840client # [ 2.028770] systemd[1]: Reached target Preparation for Local File Systems.1841client # [ 2.028795] systemd[1]: Reached target Local File Systems.1842lb # [ 1.942651] systemd-journald[73]: Collecting audit messages is disabled.1843client # [ 2.032845] systemd[1]: Starting Rule-based Manager for Device Events and Files...1844client # [ 2.040777] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1845lb # [ 1.950742] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1846worker2 # [ 1.946387] Console: switching to colour frame buffer device 160x501847worker2 # [ 1.952943] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1848lb # [ 1.960233] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1849lb # [ 1.962839] systemd[1]: Starting Create Static Device Nodes in /dev...1850worker1 # [ 1.962674] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1851worker1 # [ 1.962704] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01852worker2 # [ 1.966704] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1853worker2 # [ 1.970403] systemd[1]: Starting Create Static Device Nodes in /dev...1854client # [ 2.064272] systemd[1]: Finished Load Kernel Modules.1855lb # [ 1.971207] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1856lb # [ 1.975846] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01857lb # [ 1.976076] [drm] features: -virgl +edid -resource_blob -host_visible1858worker1 # [ 1.982541] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1859lb # [ 1.976085] [drm] features: -context_init1860lb # [ 1.976792] [drm] number of scanouts: 11861worker1 # [ 1.985158] systemd[1]: Starting Create Static Device Nodes in /dev...1862lb # [ 1.976809] [drm] number of cap sets: 01863client # [ 2.072422] systemd[1]: Starting Apply Kernel Variables...1864lb # [ 1.991386] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1865lb # [ 1.991406] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01866worker2 # [ 1.998291] systemd[1]: Finished Load Kernel Modules.1867worker2 # [ 2.002028] systemd[1]: Starting Apply Kernel Variables...1868worker1 # [ 1.998680] Console: switching to colour frame buffer device 160x501869worker1 # [ 2.005462] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1870client # [ 2.089748] systemd-modules-load[74]: Inserted module 'dm_mod'1871client # [ 2.092258] systemd-modules-load[74]: Module 'virtio_balloon' is built in1872client # [ 2.093413] systemd-modules-load[74]: Module 'virtio_console' is built in1873client # [ 2.094462] systemd-modules-load[74]: Inserted module 'virtio_gpu'1874client # [ 2.095406] systemd-modules-load[74]: Module 'virtio_rng' is built in1875worker2 # [ 2.020494] systemd[1]: Finished Create Static Device Nodes in /dev.1876client # [ 2.112472] systemd[1]: Started Journal Service.1877worker1 # [ 2.026902] systemd[1]: Finished Create Static Device Nodes in /dev.1878worker1 # [ 2.027140] systemd[1]: Reached target Preparation for Local File Systems.1879worker1 # [ 2.027176] systemd[1]: Reached target Local File Systems.1880worker2 # [ 2.026555] systemd[1]: Reached target Preparation for Local File Systems.1881worker2 # [ 2.028638] systemd[1]: Reached target Local File Systems.1882worker1 # [ 2.034760] systemd[1]: Starting Rule-based Manager for Device Events and Files...1883lb # [ 2.034821] systemd[1]: Finished Create Static Device Nodes in /dev.1884lb # [ 2.035038] systemd[1]: Reached target Preparation for Local File Systems.1885lb # [ 2.035061] systemd[1]: Reached target Local File Systems.1886worker2 # [ 2.039593] systemd[1]: Starting Rule-based Manager for Device Events and Files...1887lb # [ 2.043443] systemd[1]: Starting Rule-based Manager for Device Events and Files...1888client # [ 2.124187] systemd-udevd[79]: Using default interface naming scheme 'v261'.1889lb # [ 2.055021] Console: switching to colour frame buffer device 160x501890lb # [ 2.055720] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1891client # [ 2.132188] systemd[1]: Starting Create System Files and Directories...1892client # [ 2.134923] systemd[1]: Finished Apply Kernel Variables.1893worker1 # [ 2.062535] systemd[1]: Finished Load Kernel Modules.1894lb # [ 2.065974] systemd[1]: Finished Load Kernel Modules.1895worker1 # [ 2.066027] systemd[1]: Starting Apply Kernel Variables...1896lb # [ 2.069259] systemd[1]: Starting Apply Kernel Variables...1897worker2 # [ 2.066698] systemd[1]: Finished Apply Kernel Variables.1898client # [ 2.159326] systemd[1]: Finished Create System Files and Directories.1899client # [ 2.174942] systemd[1]: Started Rule-based Manager for Device Events and Files.1900worker1 # [ 2.107032] systemd[1]: Finished Apply Kernel Variables.1901worker2 # [ 2.106274] systemd[1]: Started Journal Service.1902lb # [ 2.119164] systemd[1]: Finished Apply Kernel Variables.1903worker2 # [ 2.100373] systemd-modules-load[74]: Inserted module 'dm_mod'1904worker2 # [ 2.101483] systemd-modules-load[74]: Module 'virtio_balloon' is built in1905worker2 # [ 2.102589] systemd-modules-load[74]: Module 'virtio_console' is built in1906worker2 # [ 2.103649] systemd-modules-load[74]: Inserted module 'virtio_gpu'1907worker1 # [ 2.130514] systemd[1]: Started Journal Service.1908worker2 # [ 2.109374] systemd-modules-load[74]: Module 'virtio_rng' is built in1909worker1 # [ 2.119638] systemd-modules-load[74]: Inserted module 'dm_mod'1910worker1 # [ 2.120959] systemd-modules-load[74]: Module 'virtio_balloon' is built in1911worker2 # [ 2.115379] systemd[1]: Starting Create System Files and Directories...1912worker1 # [ 2.128325] systemd-modules-load[74]: Module 'virtio_console' is built in1913worker2 # [ 2.123450] systemd-udevd[80]: Using default interface naming scheme 'v261'.1914lb # [ 2.144524] systemd[1]: Started Journal Service.1915worker1 # [ 2.136342] systemd-modules-load[74]: Inserted module 'virtio_gpu'1916worker1 # [ 2.137439] systemd-modules-load[74]: Module 'virtio_rng' is built in1917lb # [ 2.133459] systemd-modules-load[74]: Inserted module 'dm_mod'1918lb # [ 2.134882] systemd-modules-load[74]: Module 'virtio_balloon' is built in1919worker1 # [ 2.139477] systemd[1]: Starting Create System Files and Directories...1920worker1 # [ 2.143902] systemd-udevd[80]: Using default interface naming scheme 'v261'.1921lb # [ 2.144562] systemd-modules-load[74]: Module 'virtio_console' is built in1922lb # [ 2.148444] systemd-modules-load[74]: Inserted module 'virtio_gpu'1923client # [ 2.238474] systemd[1]: Starting Virtual Console Setup...1924lb # [ 2.150886] systemd-modules-load[74]: Module 'virtio_rng' is built in1925worker2 # [ 2.149780] systemd[1]: Finished Create System Files and Directories.1926lb # [ 2.161953] systemd[1]: Starting Create System Files and Directories...1927lb # [ 2.164559] systemd-udevd[79]: Using default interface naming scheme 'v261'.1928worker2 # [ 2.166744] systemd[1]: Started Rule-based Manager for Device Events and Files.1929worker1 # [ 2.185275] systemd[1]: Finished Create System Files and Directories.1930worker1 # [ 2.189512] systemd[1]: Started Rule-based Manager for Device Events and Files.1931lb # [ 2.211055] systemd[1]: Finished Create System Files and Directories.1932client # [ 2.301366] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1933client # [ 2.304118] systemd[1]: Finished Virtual Console Setup.1934lb # [ 2.217600] systemd[1]: Started Rule-based Manager for Device Events and Files.1935worker2 # [ 2.232248] systemd[1]: Starting Virtual Console Setup...1936worker1 # [ 2.250040] systemd[1]: Starting Virtual Console Setup...1937worker2 # [ 2.276491] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1938worker2 # [ 2.280143] systemd[1]: Finished Virtual Console Setup.1939lb # [ 2.292891] systemd[1]: Starting Virtual Console Setup...1940worker1 # [ 2.300528] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1941worker1 # [ 2.304103] systemd[1]: Finished Virtual Console Setup.1942lb # [ 2.344771] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1943lb # [ 2.348889] systemd[1]: Finished Virtual Console Setup.1944client # [ 2.901559] systemd[1]: Finished Coldplug All udev Devices.1945client # [ 2.902495] systemd[1]: Reached target System Initialization.1946client # [ 2.903291] systemd[1]: Reached target Basic System.1947worker2 # [ 2.873356] systemd[1]: Finished Coldplug All udev Devices.1948worker2 # [ 2.874674] systemd[1]: Reached target System Initialization.1949worker2 # [ 2.880479] systemd[1]: Reached target Basic System.1950worker1 # [ 2.893275] systemd[1]: Finished Coldplug All udev Devices.1951worker1 # [ 2.894217] systemd[1]: Reached target System Initialization.1952worker1 # [ 2.895021] systemd[1]: Reached target Basic System.1953client # [ 3.028340] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1954lb # [ 2.957209] systemd[1]: Finished Coldplug All udev Devices.1955lb # [ 2.958926] systemd[1]: Reached target System Initialization.1956lb # [ 2.959797] systemd[1]: Reached target Basic System.1957client # [ 3.057505] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1958client # [ 3.073813] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1959worker2 # [ 3.003971] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1960worker1 # [ 3.019925] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1961client # [ 3.133753] systemd[1]: Found device /dev/disk/by-label/nixos.1962client # [ 3.135949] systemd[1]: Reached target Initrd Root Device.1963client # [ 3.139872] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1964worker2 # [ 3.049425] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1965worker1 # [ 3.060639] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1966worker2 # [ 3.053397] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line.1967worker1 # [ 3.080893] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1968client # [ 3.192276] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1969client # [ 3.199989] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1970worker2 # [ 3.114455] systemd[1]: Found device /dev/disk/by-label/nixos.1971client # [ 3.208356] systemd[1]: Mounting /sysroot...1972worker2 # [ 3.116285] systemd[1]: Reached target Initrd Root Device.1973worker2 # [ 3.119884] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1974lb # [ 3.126396] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1975lb # [ 3.145415] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1976worker1 # [ 3.156236] systemd[1]: Found device /dev/disk/by-label/nixos.1977lb # [ 3.152324] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1978worker1 # [ 3.158984] systemd[1]: Reached target Initrd Root Device.1979client # [ 3.258943] EXT4-fs (vda): mounted filesystem 6f3a39a3-5cde-474a-8553-04ad9e368e0d r/w with ordered data mode. Quota mode: none.1980worker1 # [ 3.161253] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1981client # [ 3.249176] systemd[1]: Mounted /sysroot.1982client # [ 3.251006] systemd[1]: Reached target Initrd Root File System.1983client # [ 3.260135] systemd[1]: Starting Mountpoints Configured in the Real Root...1984worker2 # [ 3.178428] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1985worker2 # [ 3.187215] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1986worker2 # [ 3.189907] systemd[1]: Mounting /sysroot...1987client # [ 3.283646] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload.1988client # [ 3.292109] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)...1989client # [ 3.296115] systemd[1]: Reloading...1990worker1 # [ 3.215322] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1991lb # [ 3.212609] systemd[1]: Found device /dev/disk/by-label/nixos.1992worker1 # [ 3.221505] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1993lb # [ 3.219324] systemd[1]: Reached target Initrd Root Device.1994worker1 # [ 3.227268] systemd[1]: Mounting /sysroot...1995lb # [ 3.223564] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1996worker2 # [ 3.240937] EXT4-fs (vda): mounted filesystem 931ea2e4-7f1d-4064-a59c-52d5258ca021 r/w with ordered data mode. Quota mode: none.1997worker2 # [ 3.229038] systemd[1]: Mounted /sysroot.1998worker2 # [ 3.231237] systemd[1]: Reached target Initrd Root File System.1999worker2 # [ 3.235754] systemd[1]: Starting Mountpoints Configured in the Real Root...2000worker1 # [ 3.286507] EXT4-fs (vda): mounted filesystem 30cb300f-6f10-42cd-9129-3e7aa90cf021 r/w with ordered data mode. Quota mode: none.
loading 1,262 hidden lines…
3263client: (finished: waiting for unit network-addresses-eth1.service, in 13.47 seconds)3264client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3265worker2 # [ 13.057876] systemd[1]: Finished Address configuration of eth1.3266worker1 # [ 13.066847] network-addresses-eth1-start[657]: adding address 2001:db8:1::3/64... done3267worker1 # [ 13.086099] dhcpcd[642]: DUID 00:01:00:01:32:42:77:17:52:54:00:12:34:563268worker1 # [ 13.088707] dhcpcd[642]: eth0: IAID 00:12:34:563269worker1 # [ 13.090591] dhcpcd[642]: eth0: adding address fe80::5054:ff:fe12:34563270worker1 # [ 13.098524] systemd[1]: Finished Address configuration of eth1.3271client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3272lb: waiting for unit network-addresses-eth1.service3273lb: waiting for the VM to finish booting3274worker2 # [ 13.143617] mousedev: PS/2 mouse device common for all mice3275worker1 # [ 13.194367] mousedev: PS/2 mouse device common for all mice3276worker2 # [ 13.250981] systemd-logind[502]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3277worker1 # [ 13.314940] systemd-logind[511]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3278lb # [ 13.333129] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.3279lb # [ 13.366658] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.3280lb # [ 13.375806] systemd[1]: Started backdoor.service.3281lb # [ 13.469232] 8021q: 802.1Q VLAN Support v1.83282lb # connecting to host...3283lb: Guest shell says: b'Spawning backdoor root shell...\n'3284lb: connected to guest root shell3285lb: (connecting took 0.44 seconds)3286lb: (finished: waiting for the VM to finish booting, in 0.44 seconds)3287lb # [ 13.566698] (udev-worker)[688]: Network interface NamePolicy= disabled on kernel command line.3288lb # [ 13.634233] cfg80211: Loading compiled-in X.509 certificates for regulatory database3289lb # [ 13.682747] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3290lb # [ 13.685832] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3291client # [ 13.777976] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33292lb # [ 13.690094] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23293lb # [ 13.690406] cfg80211: failed to load regulatory.db3294lb # [ 13.704513] systemd-vconsole-setup[707]: Configuration of first virtual console was skipped, ignoring remaining ones.3295lb # [ 13.718155] (udev-worker)[693]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3296lb # [ 13.724462] (udev-worker)[693]: Network interface NamePolicy= disabled on kernel command line.3297lb # [ 13.736807] systemd[1]: Finished Virtual Console Setup.3298worker2 # [ 13.746593] dhcpcd[635]: eth0: soliciting a DHCP lease3299worker2 # [ 13.752670] dhcpcd[635]: eth0: offered 10.0.2.15 from 10.0.2.23300worker2 # [ 13.760448] dhcpcd[635]: eth0: probing address 10.0.2.15/243301worker1 # [ 13.784738] dhcpcd[642]: eth0: soliciting a DHCP lease3302worker1 # [ 13.793104] dhcpcd[642]: eth0: offered 10.0.2.15 from 10.0.2.23303worker1 # [ 13.800238] dhcpcd[642]: eth0: probing address 10.0.2.15/243304worker1 # [ 13.957791] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33305lb # [ 13.988843] 8021q: adding VLAN 0 to HW filter on device eth03306lb # [ 13.977433] systemd[1]: Condition check resulted in Virtio network device being skipped.3307lb # [ 13.983564] dhcpcd[663]: eth0: waiting for carrier3308lb # [ 13.989453] dhcpcd[663]: eth0: carrier acquired3309lb # [ 13.993810] systemd[1]: Starting Address configuration of eth1...3310client # [ 14.095718] systemd[1]: Starting Virtual Console Setup...3311lb # [ 14.009996] dhcpcd[663]: DUID 00:01:00:01:32:42:77:18:52:54:00:12:34:563312lb # [ 14.012443] dhcpcd[663]: eth0: IAID 00:12:34:563313lb # [ 14.014329] dhcpcd[663]: eth0: adding address fe80::5054:ff:fe12:34563314client # [ 14.134134] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3315client # [ 14.135287] systemd[1]: Stopped Virtual Console Setup.3316client # [ 14.139141] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3317client # [ 14.142806] systemd[1]: Starting Virtual Console Setup...3318lb # [ 14.117275] 8021q: adding VLAN 0 to HW filter on device eth13319lb # [ 14.107064] systemd-logind[526]: Watching system buttons on /dev/input/event0 (gpio-keys)3320client # [ 14.195316] systemd-logind[430]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3321lb # [ 14.129064] network-addresses-eth1-start[741]: adding address 192.168.1.2/24... done3322lb # [ 14.146307] network-addresses-eth1-start[741]: adding address 2001:db8:1::2/64... done3323lb # [ 14.170468] systemd[1]: Finished Address configuration of eth1.3324lb # [ 14.245033] mousedev: PS/2 mouse device common for all mice3325worker1 # [ 14.254976] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3326worker2 # [ 14.251937] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3327worker2 # [ 14.260429] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3328worker2 # [ 14.261473] systemd[1]: Stopped Virtual Console Setup.3329worker2 # [ 14.262177] systemd[1]: Stopping Virtual Console Setup...3330worker2 # [ 14.266029] systemd[1]: Starting Virtual Console Setup...3331worker1 # [ 14.280631] systemd[1]: Starting Virtual Console Setup...3332worker2 # [ 14.285112] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3333worker2 # [ 14.290960] systemd[1]: Stopped Virtual Console Setup.3334worker2 # [ 14.291733] dhcpcd[635]: eth0: soliciting an IPv6 router3335worker1 # [ 14.303554] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3336worker1 # [ 14.304942] systemd[1]: Stopped Virtual Console Setup.3337worker2 # [ 14.294138] dhcpcd[635]: eth0: Router Advertisement from fe80::23338worker1 # [ 14.308002] systemd[1]: Starting Virtual Console Setup...3339worker2 # [ 14.298877] dhcpcd[635]: eth0: adding address fec0::5054:ff:fe12:3456/643340worker2 # [ 14.304826] systemd[1]: Starting Virtual Console Setup...3341worker2 # [ 14.305582] dhcpcd[635]: eth0: adding route to fec0::/643342worker2 # [ 14.306298] dhcpcd[635]: eth0: adding default route via fe80::23343worker1 # [ 14.354899] systemd-logind[511]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3344lb # [ 14.413918] systemd-logind[526]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3345lb # [ 14.430537] dhcpcd[663]: eth0: soliciting a DHCP lease3346lb # [ 14.436535] dhcpcd[663]: eth0: offered 10.0.2.15 from 10.0.2.23347lb # [ 14.444243] dhcpcd[663]: eth0: probing address 10.0.2.15/243348client # [ 14.587150] systemd-vconsole-setup[649]: Configuration of first virtual console was skipped, ignoring remaining ones.3349client # [ 14.591252] systemd[1]: Finished Virtual Console Setup.3350worker2 # [ 14.626451] systemd-vconsole-setup[703]: Configuration of first virtual console was skipped, ignoring remaining ones.3351worker2 # [ 14.630401] systemd[1]: Finished Virtual Console Setup.3352worker1 # [ 14.749540] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones.3353worker1 # [ 14.754698] systemd[1]: Finished Virtual Console Setup.3354client # [ 14.838946] dhcpcd[543]: eth0: soliciting an IPv6 router3355client # [ 14.843853] dhcpcd[543]: eth0: Router Advertisement from fe80::23356client # [ 14.846710] dhcpcd[543]: eth0: adding address fec0::5054:ff:fe12:3456/643357client # [ 14.849619] dhcpcd[543]: eth0: adding route to fec0::/643358client # [ 14.851905] dhcpcd[543]: eth0: adding default route via fe80::23359client # [ 14.887113] dhcpcd[543]: eth0: soliciting a DHCP lease3360client # [ 14.893246] dhcpcd[543]: eth0: offered 10.0.2.15 from 10.0.2.23361client # [ 14.896506] dhcpcd[543]: eth0: probing address 10.0.2.15/243362lb: (finished: waiting for unit network-addresses-eth1.service, in 1.77 seconds)3363lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3364lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.06 seconds)3365worker1: waiting for unit network-addresses-eth1.service3366worker1: waiting for the VM to finish booting3367worker1: Guest shell says: b'Spawning backdoor root shell...\n'3368worker1: connected to guest root shell3369worker1: (connecting took 0.00 seconds)3370worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3371worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.12 seconds)3372worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3373worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3374worker2: waiting for unit network-addresses-eth1.service3375worker2: waiting for the VM to finish booting3376worker2: Guest shell says: b'Spawning backdoor root shell...\n'3377worker2: connected to guest root shell3378worker2: (connecting took 0.00 seconds)3379worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3380worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds)3381worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3382worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3383lb: waiting for unit niks3.service3384worker1 # [ 15.689331] dhcpcd[642]: eth0: soliciting an IPv6 router3385worker1 # [ 15.693051] dhcpcd[642]: eth0: Router Advertisement from fe80::23386worker1 # [ 15.695754] dhcpcd[642]: eth0: adding address fec0::5054:ff:fe12:3456/643387worker1 # [ 15.698925] dhcpcd[642]: eth0: adding route to fec0::/643388worker1 # [ 15.701304] dhcpcd[642]: eth0: adding default route via fe80::23389lb # [ 16.071297] dhcpcd[663]: eth0: soliciting an IPv6 router3390lb # [ 16.072845] dhcpcd[663]: eth0: Router Advertisement from fe80::23391lb # [ 16.074760] dhcpcd[663]: eth0: adding address fec0::5054:ff:fe12:3456/643392lb # [ 16.077323] dhcpcd[663]: eth0: adding route to fec0::/643393lb # [ 16.079531] dhcpcd[663]: eth0: adding default route via fe80::23394lb # [ 16.096581] postgresql-pre-start[682]: selecting default time zone ... UTC3395lb # [ 16.102251] postgresql-pre-start[682]: creating configuration files ... ok3396lb # [ 16.228780] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3397lb # [ 16.230000] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3398lb # [ 16.231039] systemd[1]: Stopped Virtual Console Setup.3399lb # [ 16.231749] systemd[1]: Stopping Virtual Console Setup...3400lb # [ 16.243159] systemd[1]: Starting Virtual Console Setup...3401lb # [ 16.284134] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3402lb # [ 16.288123] systemd[1]: Stopped Virtual Console Setup.3403lb # [ 16.302235] systemd[1]: Starting Virtual Console Setup...3404lb # [ 16.356346] systemd-logind[526]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3405lb # [ 16.662048] postgresql-pre-start[682]: running bootstrap script ... ok3406lb # [ 16.781419] systemd-vconsole-setup[790]: Configuration of first virtual console was skipped, ignoring remaining ones.3407lb # [ 16.790365] systemd[1]: Finished Virtual Console Setup.3408lb # [ 17.385983] postgresql-pre-start[682]: performing post-bootstrap initialization ... ok3409lb # [ 17.507725] postgresql-pre-start[682]: syncing data to disk ... ok3410lb # [ 17.508977] postgresql-pre-start[682]: initdb: warning: enabling "trust" authentication for local connections3411lb # [ 17.511666] postgresql-pre-start[682]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3412lb # [ 17.514134] postgresql-pre-start[682]: Success. You can now start the database server using:3413lb # [ 17.515355] postgresql-pre-start[682]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3414lb # [ 17.678814] postgres[808]: [808] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3415lb # [ 17.682919] postgres[808]: [808] LOG: listening on IPv6 address "::1", port 54323416lb # [ 17.686888] postgres[808]: [808] LOG: listening on IPv4 address "127.0.0.1", port 54323417lb # [ 17.689071] postgres[808]: [808] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3418lb # [ 17.705052] postgres[826]: [826] LOG: database system was shut down at 2026-09-20 10:51:07 GMT3419lb # [ 17.712757] postgres[808]: [808] LOG: database system is ready to accept connections3420lb # [ 17.717544] systemd[1]: Started PostgreSQL Server.3421lb # [ 17.724133] systemd[1]: Starting PostgreSQL Setup Scripts...3422lb # [ 17.976727] postgresql-setup-start[837]: CREATE DATABASE3423lb # [ 18.030200] postgresql-setup-start[842]: CREATE ROLE3424lb # [ 18.058229] postgresql-setup-start[844]: ALTER DATABASE3425lb # [ 18.066159] systemd[1]: Finished PostgreSQL Setup Scripts.3426lb # [ 18.068532] systemd[1]: Reached target PostgreSQL.3427lb # [ 19.014645] dhcpcd[663]: eth0: leased 10.0.2.15 for 86400 seconds3428worker2 # [ 19.074466] dhcpcd[635]: eth0: leased 10.0.2.15 for 86400 seconds3429worker2 # [ 19.079629] dhcpcd[635]: eth0: adding route to 10.0.2.0/243430worker2 # [ 19.083009] dhcpcd[635]: eth0: adding default route via 10.0.2.23431lb # [ 19.018042] dhcpcd[663]: eth0: adding route to 10.0.2.0/243432lb # [ 19.018231] dhcpcd[663]: eth0: adding default route via 10.0.2.23433lb # [ 19.181135] systemd[1]: Started DHCP Client.3434lb # [ 19.187206] systemd[1]: Reached target Network is Online.3435lb # [ 19.190014] systemd[1]: Started Envoy reverse proxy.3436lb # [ 19.197922] systemd[1]: Started mock-oidc.service.3437worker2 # [ 19.253437] systemd[1]: Started DHCP Client.3438worker2 # [ 19.255639] systemd[1]: Reached target Multi-User System.3439worker2 # [ 19.256874] systemd[1]: Startup finished in 961ms (kernel) + 4.619s (initrd) + 13.674s (userspace) = 19.255s.3440lb # [ 19.303639] mock-oidc-server[917]: Mock OIDC Server running3441lb # [ 19.305136] mock-oidc-server[917]: OIDC Address: 192.168.1.2:80803442lb # [ 19.306458] mock-oidc-server[917]: Issue Address: 0.0.0.0:80813443lb # [ 19.307890] mock-oidc-server[917]: Issuer: http://192.168.1.2:8080/oidc3444lb # [ 19.309673] mock-oidc-server[917]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3445lb # [ 19.311114] mock-oidc-server[917]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3446lb # [ 19.313209] mock-oidc-server[917]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3447worker1 # [ 19.553694] dhcpcd[642]: eth0: leased 10.0.2.15 for 86400 seconds3448worker1 # [ 19.555792] dhcpcd[642]: eth0: adding route to 10.0.2.0/243449worker1 # [ 19.558352] dhcpcd[642]: eth0: adding default route via 10.0.2.23450worker1 # [ 19.693418] systemd[1]: Started DHCP Client.3451worker1 # [ 19.695054] systemd[1]: Reached target Multi-User System.3452worker1 # [ 19.696679] systemd[1]: Startup finished in 982ms (kernel) + 5.462s (initrd) + 13.250s (userspace) = 19.695s.3453client # [ 19.865443] dhcpcd[543]: eth0: leased 10.0.2.15 for 86400 seconds3454lb # [ 19.864131] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3455lb # [ 19.866022] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:469] statically linked extensions:3456lb # [ 19.868188] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3457lb # [ 19.873802] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3458lb # [ 19.875974] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3459lb # [ 19.878095] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3460lb # [ 19.881139] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3461lb # [ 19.883057] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3462lb # [ 19.886305] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3463lb # [ 19.889531] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23464lb # [ 19.891429] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3465lb # [ 19.894667] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3466lb # [ 19.914716] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3467lb # [ 19.921716] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3468lb # [ 19.925420] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3469lb # [ 19.930737] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3470lb # [ 19.943494] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3471client # [ 19.869473] dhcpcd[543]: eth0: adding route to 10.0.2.0/243472client # [ 19.869839] dhcpcd[543]: eth0: adding default route via 10.0.2.23473client # [ 20.035407] systemd[1]: Started DHCP Client.3474lb # [ 19.946409] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3475client # [ 20.039384] systemd[1]: Reached target Multi-User System.3476lb # [ 19.950894] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3477client # [ 20.040527] systemd[1]: Startup finished in 975ms (kernel) + 5.444s (initrd) + 13.619s (userspace) = 20.038s.3478lb # [ 19.953653] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3479lb # [ 19.964333] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3480lb # [ 19.969606] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3481lb # [ 19.974015] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3482lb # [ 19.976863] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3483lb # [ 19.984825] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3484lb # [ 19.986895] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3485lb # [ 19.990813] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23486lb # [ 19.996568] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3487lb # [ 19.998558] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3488lb # [ 20.002103] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3489lb # [ 20.004150] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3490lb # [ 20.007673] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3491lb # [ 20.011429] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3492lb # [ 20.014580] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3493lb # [ 20.018279] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3494lb # [ 20.026837] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3495lb # [ 20.030403] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3496lb # [ 20.032676] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3497lb # [ 20.036089] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3498lb # [ 20.039355] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3499lb # [ 20.043059] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3500lb # [ 20.045754] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3501lb # [ 20.048256] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3502lb # [ 20.050333] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3503lb # [ 20.053492] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3504lb # [ 20.056802] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3505lb # [ 20.069930] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3506lb # [ 20.102329] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3507lb # [ 20.105592] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3508lb # [ 20.107534] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3509lb # [ 20.111132] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3510lb # [ 20.114356] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3511lb # [ 20.117439] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3512lb # [ 20.119495] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3513lb # [ 20.122431] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3514lb # [ 20.124473] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3515lb # [ 20.126453] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3516lb # [ 20.129733] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3517lb # [ 20.138510] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3518lb # [ 20.141889] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3519lb # [ 20.148946] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3520lb # [ 20.152385] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3521lb # [ 20.155499] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3522lb # [ 20.159567] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3523lb # [ 20.162655] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3524lb # [ 20.165701] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3525lb # [ 20.172444] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3526lb # [ 20.175757] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3527lb # [ 20.178187] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3528lb # [ 20.184350] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3529lb # [ 20.188202] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3530lb # [ 20.191219] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3531lb # [ 20.204975] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3532lb # [ 20.210650] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3533lb # [ 20.215877] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3534lb # [ 20.223485] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3535lb # [ 20.227618] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3536lb # [ 20.231219] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3537lb # [ 20.234106] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3538lb # [ 20.238311] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3539lb # [ 20.245077] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3540lb # [ 20.251918] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3541lb # [ 20.254453] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3542lb # [ 20.256522] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3543lb # [ 20.261483] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3544lb # [ 20.271554] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3545lb # [ 20.275810] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3546lb # [ 20.278480] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3547lb # [ 20.288177] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3548worker1 # [ 20.301701] systemd[1]: Starting Nix worker-protocol over gRPC...3549worker2 # [ 20.298108] systemd[1]: Starting Nix worker-protocol over gRPC...3550lb # [ 20.302804] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3551lb # [ 20.306591] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3552lb # [ 20.309237] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3553lb # [ 20.315217] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83554lb # [ 20.318192] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3555lb # [ 20.320750] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3556lb # [ 20.330633] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23557lb # [ 20.340206] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3558lb # [ 20.343829] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3559lb # [ 20.354248] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3560lb # [ 20.358219] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3561lb # [ 20.361370] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13562lb # [ 20.363579] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3563lb # [ 20.366862] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3564lb # [ 20.369847] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3565lb # [ 20.376925] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3566lb # [ 20.380152] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3567lb # [ 20.383372] envoy[916]: [2026-09-20 10:51:10.500][916][info][main] [source/server/server.cc:531] HTTP header map info:3568lb # [ 20.385465] envoy[916]: [2026-09-20 10:51:10.503][916][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3569lb # [ 20.401957] envoy[916]: [2026-09-20 10:51:10.503][916][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3570lb # [ 20.403803] envoy[916]: [2026-09-20 10:51:10.503][916][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3571lb # [ 20.413529] envoy[916]: [2026-09-20 10:51:10.503][916][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3572lb # [ 20.415627] envoy[916]: [2026-09-20 10:51:10.632][916][info][main] [source/server/server.cc:968] runtime: {}3573lb # [ 20.417375] envoy[916]: [2026-09-20 10:51:10.644][916][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3574lb # [ 20.419312] envoy[916]: [2026-09-20 10:51:10.644][916][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013575lb # [ 20.421355] envoy[916]: [2026-09-20 10:51:10.644][916][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013576lb # [ 20.423104] envoy[916]: [2026-09-20 10:51:10.660][916][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3577lb # [ 20.425106] envoy[916]: [2026-09-20 10:51:10.660][916][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3578lb # [ 20.426900] envoy[916]: [2026-09-20 10:51:10.660][916][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3579lb # [ 20.428781] envoy[916]: [2026-09-20 10:51:10.877][916][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3580lb # [ 20.430542] envoy[916]: [2026-09-20 10:51:10.928][916][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3581lb # [ 20.432552] envoy[916]: [2026-09-20 10:51:10.929][916][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3582lb # [ 20.436324] envoy[916]: [2026-09-20 10:51:10.929][916][info][main] [source/server/server.cc:1077] starting main dispatch loop3583worker2 # [ 20.561846] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3584worker2 # [ 20.574422] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13585worker1 # [ 20.585866] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3586worker1 # [ 20.598226] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13587worker2 # [ 20.623236] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3588worker2 # [ 20.628242] systemd[1]: Started Nix worker-protocol over gRPC.3589worker1 # [ 20.645083] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3590worker1 # [ 20.650076] systemd[1]: Started Nix worker-protocol over gRPC.3591lb # [ 20.672220] envoy[916]: [2026-09-20 10:51:11.262][916][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3592lb # [ 20.680173] envoy[916]: [2026-09-20 10:51:11.262][916][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3593lb # [ 20.691268] envoy[916]: [2026-09-20 10:51:11.262][916][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3594worker2 # [ 20.695804] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:500513595lb # [ 20.704239] envoy[916]: [2026-09-20 10:51:11.262][916][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3596worker2 # [ 20.710038] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3597worker1 # [ 20.720395] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:500513598worker1 # [ 20.722281] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3599worker2 # [ 20.911399] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:500513600worker1 # [ 20.923554] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:500513601worker2 # [ 20.916923] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3602worker1 # [ 20.928955] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3603worker2 # [ 21.117794] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:500513604worker1 # [ 21.129717] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:500513605worker2 # [ 21.123126] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3606worker1 # [ 21.134944] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3607worker2 # [ 21.324142] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:500513608worker1 # [ 21.335840] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:500513609worker2 # [ 21.329583] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3610worker1 # [ 21.341126] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3611worker2 # [ 21.530564] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:500513612worker1 # [ 21.541805] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:500513613worker2 # [ 21.536340] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3614worker1 # [ 21.546964] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3615worker2 # [ 21.739106] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:500513616worker1 # [ 21.749177] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:500513617worker2 # [ 21.743367] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3618worker1 # [ 21.753877] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3619worker2 # [ 21.939718] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:500513620worker1 # [ 21.954728] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:500513621worker2 # [ 21.945480] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3622worker1 # [ 21.960185] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3623worker2 # [ 22.146362] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 22.160999] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:500513625worker2 # [ 22.151831] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3626worker1 # [ 22.166273] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker2 # [ 22.352728] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:500513628worker1 # [ 22.367088] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:500513629worker2 # [ 22.358041] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3630worker1 # [ 22.372425] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3631worker2 # [ 22.559155] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:500513632worker1 # [ 22.573355] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:500513633worker2 # [ 22.564787] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3634worker1 # [ 22.578362] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker2 # [ 22.768473] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:500513636worker1 # [ 22.781470] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:500513637worker2 # [ 22.775834] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3638worker1 # [ 22.791617] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker2 # [ 22.968466] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:500513640worker1 # [ 22.981625] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:500513641worker2 # [ 22.973864] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3642worker1 # [ 22.986890] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker2 # [ 23.174488] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:500513644worker1 # [ 23.187759] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:500513645worker2 # [ 23.179767] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3646worker1 # [ 23.192955] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker2 # [ 23.380904] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:500513648worker1 # [ 23.393796] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:500513649worker2 # [ 23.386286] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3650worker1 # [ 23.399047] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker2 # [ 23.587246] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:500513652worker1 # [ 23.599912] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:500513653worker2 # [ 23.593158] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3654worker1 # [ 23.604736] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker1 # [ 23.803629] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 23.796165] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:500513657worker1 # [ 23.807872] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3658worker2 # [ 23.800328] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker1 # [ 24.004774] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:500513660worker2 # [ 23.996499] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:500513661worker1 # [ 24.010098] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3662worker2 # [ 24.001887] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker1 # [ 24.211174] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:500513664worker2 # [ 24.202812] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:500513665worker1 # [ 24.216652] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3666worker2 # [ 24.208286] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker1 # [ 24.417665] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:500513668worker2 # [ 24.409226] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:500513669worker1 # [ 24.423131] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3670worker2 # [ 24.414754] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker1 # [ 24.624091] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:500513672worker2 # [ 24.615607] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:500513673worker1 # [ 24.629427] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3674worker2 # [ 24.621114] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker1 # [ 24.831478] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:500513676worker2 # [ 24.824155] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 24.828465] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3678worker1 # [ 24.837342] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker2 # [ 25.024805] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 25.038247] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 25.030506] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3682worker1 # [ 25.043785] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3683worker2 # [ 25.231461] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:500513684worker1 # [ 25.244910] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:500513685worker2 # [ 25.237262] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3686worker1 # [ 25.251153] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3687worker2 # [ 25.438344] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:500513688worker1 # [ 25.451973] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 25.443871] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3690worker1 # [ 25.457099] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3691worker2 # [ 25.644853] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:500513692worker1 # [ 25.657820] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:500513693worker2 # [ 25.650250] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3694worker1 # [ 25.663055] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3695worker2 # [ 25.853661] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:500513696worker1 # [ 25.866173] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:500513697worker2 # [ 25.858206] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3698worker1 # [ 25.870562] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3699worker2 # [ 26.054357] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:500513700worker1 # [ 26.066477] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:500513701worker2 # [ 26.059883] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3702worker1 # [ 26.071775] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3703lb # [ 26.101565] rustfs-bucket-start[989]: mb s3://farm3704lb # [ 26.111118] systemd[1]: Finished rustfs-bucket.service.3705lb # [ 26.122795] systemd[1]: Starting niks3 server...3706worker2 # [ 26.261047] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:500513707worker1 # [ 26.272838] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:500513708worker2 # [ 26.266829] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3709worker1 # [ 26.277767] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3710lb # [ 26.339931] postgres[1005]: [1005] ERROR: relation "goose_db_version" does not exist at character 363711lb # [ 26.341855] postgres[1005]: [1005] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3712lb # [ 26.376561] niks3-server[998]: 2026/09/20 10:51:16 OK 20241026095416_initial_model.sql (22.45ms)3713lb # [ 26.379903] niks3-server[998]: 2026/09/20 10:51:16 OK 20251210153512_drop_unused_gin_index.sql (1.85ms)3714lb # [ 26.385805] niks3-server[998]: 2026/09/20 10:51:16 OK 20251218171726_add_pins.sql (4.3ms)3715lb # [ 26.390489] niks3-server[998]: 2026/09/20 10:51:16 OK 20260628120000_add_object_size_and_stats.sql (4.64ms)3716lb # [ 26.395389] niks3-server[998]: 2026/09/20 10:51:16 OK 20260905000000_add_claims.sql (4.83ms)3717lb # [ 26.399976] niks3-server[998]: 2026/09/20 10:51:16 OK 20260920000000_drop_claims.sql (4.5ms)3718lb # [ 26.401216] niks3-server[998]: 2026/09/20 10:51:16 goose: successfully migrated database to version: 202609200000003719lb # [ 26.406197] niks3-server[998]: 2026/09/20 10:51:16 OK 1_commit_pending_closure.sql (6.19ms)3720lb # [ 26.409320] niks3-server[998]: 2026/09/20 10:51:16 OK 2_object_stats_trigger.sql (3ms)3721lb # [ 26.410646] niks3-server[998]: 2026/09/20 10:51:16 goose: up to current file version: 23722lb # [ 26.414760] niks3-server[998]: 2026/09/20 10:51:17 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3723lb # [ 26.459426] niks3-server[998]: 2026/09/20 10:51:17 INFO Read proxy enabled — serving cache objects from S33724lb # [ 26.461454] niks3-server[998]: 2026/09/20 10:51:17 INFO Using socket-activated listener address=0.0.0.0:57513725lb # [ 26.465685] niks3-server[998]: 2026/09/20 10:51:17 INFO systemd watchdog enabled interval=15s3726lb # [ 26.470705] systemd[1]: Started niks3 server.3727lb # [ 26.471429] niks3-server[998]: 2026/09/20 10:51:17 INFO Starting HTTP server address=0.0.0.0:57513728lb # [ 26.473973] systemd[1]: Reached target Multi-User System.3729worker1 # [ 26.474668] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:500513730lb # [ 26.475170] systemd[1]: Startup finished in 978ms (kernel) + 4.610s (initrd) + 20.879s (userspace) = 26.468s.3731worker2 # [ 26.467738] nix-grpc-daemon[777]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:500513732worker1 # [ 26.480147] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3733lb # [ 26.482059] niks3-server[998]: 2026/09/20 10:51:17 INFO lead: acquired remote=192.168.1.3:396863734worker2 # [ 26.473324] nix-grpc-daemon[777]: ts=2026-09-20T10:51:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3735worker1 # [ 26.488679] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_take_over3736worker1 # [ 26.681081] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:500513737worker2 # [ 26.674377] nix-grpc-daemon[777]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:500513738worker1 # [ 26.686501] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3739worker2 # [ 26.679792] nix-grpc-daemon[777]: ts=2026-09-20T10:51:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3740worker1 # [ 26.888896] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:500513741worker2 # [ 26.882027] nix-grpc-daemon[777]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:500513742worker1 # [ 26.900442] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03743worker1 # [ 26.906442] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03744lb: (finished: waiting for unit niks3.service, in 11.70 seconds)3745lb: waiting for TCP port 5751 on localhost3746lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3747lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)3748lb: waiting for unit envoy.service3749lb: (finished: waiting for unit envoy.service, in 0.06 seconds)3750lb: waiting for TCP port 50051 on localhost3751lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3752lb # [ 27.143007] envoy[916]: conn peer=[::1]:59826 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33753lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3754lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3755??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3756 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283757lb: must succeed: curl -sf localhost:9901/clusters3758lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3759lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)3760subtest: one node schedules and both builders hold a WorkerSession on it3761lb: must succeed: curl -sf localhost:9901/clusters3762lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3763worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics3764worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)3765(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.14 seconds)3766subtest: balancer auth: client cert, bearer token, nothing, unknown CN3767worker2 # [ 27.912799] nix-grpc-daemon[777]: ts=2026-09-20T10:51:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:534123768worker2 # [ 27.925906] systemd[1]: Started Nix Daemon.3769worker2 # [ 28.250373] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3770worker2 # [ 28.294902] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5)3771worker2 # [ 28.334553] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 2/5)3772worker2 # [ 28.368897] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 3/5)3773worker2 # [ 28.428535] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 418 ms (attempt 4/5)3774worker2 # [ 28.849235] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3775worker1 # [ 28.899575] nix-grpc-daemon[774]: ts=2026-09-20T10:51:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:386563776worker1 # [ 28.915371] systemd[1]: Started Nix Daemon.3777worker1 # [ 29.203138] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3778worker1 # [ 29.231514] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 1/5)3779worker1 # [ 29.277788] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 2/5)3780worker1 # [ 29.378629] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 3/5)3781worker1 # [ 29.473846] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 246 ms (attempt 4/5)3782worker1 # [ 29.730033] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3783worker1 # [ 29.747095] nix-grpc-daemon[774]: ts=2026-09-20T10:51:20Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it"3784worker2 # [ 29.751918] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:534123785worker2 # [ 29.767710] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it"3786client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3787client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds)3788client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3789client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3790worker1 # [ 30.251332] nix-grpc-daemon[774]: ts=2026-09-20T10:51:20Z level=info event=oidc_jwks provider=mock keys=13791worker1 # [ 30.260500] nix-grpc-daemon[774]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:386563792worker2 # [ 30.276158] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=info event=oidc_jwks provider=mock keys=13793lb # [ 30.286710] envoy[916]: conn peer=[2001:db8:1::1]:57722 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=383 ms=19133794worker2 # [ 30.282965] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:534123795worker2 # [ 30.291482] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it"3796worker2 # [ 30.308243] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:534123797worker2 # [ 30.317818] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it"3798client: must succeed: rm -r /var/lib/nix-grpc-store3799client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3800worker1 # [ 32.645264] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=info event=denied method=QueryMissing cn=- role=none3801worker2 # [ 32.926223] nix-grpc-daemon[777]: ts=2026-09-20T10:51:23Z level=info event=denied method=QueryMissing cn=stranger role=none3802(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.40 seconds)3803subtest: DAG build is scheduled across workers and lands in the cache3804client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23805worker1 # [ 33.182599] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:386563806client # don't know how to build these paths:3807client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3808worker2 # [ 33.188541] nix-grpc-daemon[777]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534123809worker1 # [ 33.239632] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03810worker1 # [ 33.245926] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13811worker1 # [ 33.293327] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386563812worker1 # [ 33.318885] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386563813client # copying 1 paths to 'lb:50051'...3814worker1 # [ 33.336125] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386563815client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3816worker1 # [ 33.362426] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3817worker1 # [ 33.399508] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=info event=niks3_push_started pid=8463818worker1 # [ 33.881905] nix-daemon[833]: accepted connection from pid 859, user nix-grpc-daemon (trusted)3819worker1 # [ 33.902471] nix-daemon[833]: reaped child process 862, status = succeeded3820worker1 # [ 34.078828] nix-daemon[833]: accepted connection from pid 864, user nix-grpc-daemon (trusted)3821worker1 # [ 34.099167] nix-daemon[833]: reaped child process 867, status = succeeded3822lb # [ 34.108179] niks3-server[998]: 2026/09/20 10:51:24 INFO Received uploads request method=POST path=/api/pending_closures3823worker1 # [ 34.137902] nix-grpc-daemon[846]: time=2026-09-20T10:51:24.725Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3824worker1 # [ 34.141994] nix-grpc-daemon[846]: time=2026-09-20T10:51:24.728Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3825lb # [ 34.185939] niks3-server[998]: 2026/09/20 10:51:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3826lb # [ 34.198160] niks3-server[998]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3827lb # [ 34.228163] niks3-server[998]: 2026/09/20 10:51:24 INFO Signed narinfos id=1 count=13828worker1 # [ 34.235650] nix-grpc-daemon[846]: time=2026-09-20T10:51:24.823Z level=INFO msg="Uploading 1 narinfos"3829lb # [ 34.247059] niks3-server[998]: 2026/09/20 10:51:24 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3830lb # [ 34.260499] niks3-server[998]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3831lb # [ 34.266054] niks3-server[998]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3832lb # [ 34.274755] niks3-server[998]: 2026/09/20 10:51:24 INFO Completed upload id=13833worker1 # [ 34.279262] nix-grpc-daemon[846]: time=2026-09-20T10:51:24.867Z level=INFO msg="Upload complete. (585ms)"3834worker1 # [ 34.291583] nix-grpc-daemon[774]: ts=2026-09-20T10:51:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=5043835worker1 # [ 34.311379] nix-grpc-daemon[774]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386563836worker1 # [ 34.320411] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3837worker1 # [ 34.325685] nix-daemon[833]: reaped child process 844, status = succeeded3838client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3839worker1 # [ 34.342260] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3840client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3841client # farm-a> LOG-farm-a-t13842worker1 # [ 35.586963] nix-daemon[833]: reaped child process 871, status = succeeded3843worker1 # [ 35.776258] nix-daemon[833]: accepted connection from pid 886, user nix-grpc-daemon (trusted)3844worker1 # [ 35.797067] nix-daemon[833]: reaped child process 889, status = succeeded3845lb # [ 35.805356] niks3-server[998]: 2026/09/20 10:51:26 INFO Received uploads request method=POST path=/api/pending_closures3846worker1 # [ 35.823120] nix-grpc-daemon[846]: time=2026-09-20T10:51:26.411Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3847worker1 # [ 35.825780] nix-grpc-daemon[846]: time=2026-09-20T10:51:26.413Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3848lb # [ 35.861613] niks3-server[998]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3849lb # [ 35.870912] niks3-server[998]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3850worker1 # [ 35.885233] nix-grpc-daemon[846]: time=2026-09-20T10:51:26.472Z level=INFO msg="Uploading 1 narinfos"3851lb # [ 35.880935] niks3-server[998]: 2026/09/20 10:51:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3852lb # [ 35.888578] niks3-server[998]: 2026/09/20 10:51:26 INFO Signed narinfos id=2 count=13853lb # [ 35.890886] niks3-server[998]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3854lb # [ 35.901264] niks3-server[998]: 2026/09/20 10:51:26 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3855lb # [ 35.908858] niks3-server[998]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3856lb # [ 35.913050] niks3-server[998]: 2026/09/20 10:51:26 INFO Completed upload id=23857worker1 # [ 35.917305] nix-grpc-daemon[846]: time=2026-09-20T10:51:26.505Z level=INFO msg="Upload complete. (361ms)"3858worker1 # [ 35.941033] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13859worker1 # [ 35.954967] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03860worker1 # [ 35.958594] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13861worker1 # [ 35.962349] nix-daemon[833]: reaped child process 869, status = succeeded3862worker1 # [ 35.984842] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386563863worker1 # [ 36.000989] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386563864client # copying 1 paths to 'lb:50051'...3865worker1 # [ 36.017140] nix-grpc-daemon[846]: time=2026-09-20T10:51:26.604Z level=INFO msg="All 1 paths already cached"3866worker1 # [ 36.023581] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386563867client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3868worker1 # [ 36.050867] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3869worker1 # [ 36.290402] nix-daemon[833]: accepted connection from pid 895, user nix-grpc-daemon (trusted)3870worker1 # [ 36.309824] nix-daemon[833]: reaped child process 899, status = succeeded3871worker1 # [ 36.481371] nix-daemon[833]: accepted connection from pid 901, user nix-grpc-daemon (trusted)3872worker1 # [ 36.501706] nix-daemon[833]: reaped child process 904, status = succeeded3873lb # [ 36.508513] niks3-server[998]: 2026/09/20 10:51:27 INFO Received uploads request method=POST path=/api/pending_closures3874worker1 # [ 36.522975] nix-grpc-daemon[846]: time=2026-09-20T10:51:27.110Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3875worker1 # [ 36.524606] nix-grpc-daemon[846]: time=2026-09-20T10:51:27.111Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3876lb # [ 36.544854] niks3-server[998]: 2026/09/20 10:51:27 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3877worker1 # [ 36.565572] nix-grpc-daemon[846]: time=2026-09-20T10:51:27.153Z level=INFO msg="Uploading 1 narinfos"3878lb # [ 36.559961] niks3-server[998]: 2026/09/20 10:51:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3879lb # [ 36.572253] niks3-server[998]: 2026/09/20 10:51:27 INFO Signed narinfos id=3 count=13880lb # [ 36.578426] niks3-server[998]: 2026/09/20 10:51:27 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3881lb # [ 36.587366] niks3-server[998]: 2026/09/20 10:51:27 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3882lb # [ 36.595510] niks3-server[998]: 2026/09/20 10:51:27 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3883lb # [ 36.600000] niks3-server[998]: 2026/09/20 10:51:27 INFO Completed upload id=33884worker1 # [ 36.603783] nix-grpc-daemon[846]: time=2026-09-20T10:51:27.192Z level=INFO msg="Upload complete. (522ms)"3885worker1 # [ 36.612305] nix-grpc-daemon[774]: ts=2026-09-20T10:51:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=6243886worker1 # [ 36.627599] nix-grpc-daemon[774]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386563887worker1 # [ 36.635252] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3888worker1 # [ 36.641042] nix-daemon[833]: reaped child process 893, status = succeeded3889client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3890client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3891worker1 # [ 36.656238] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3892worker1 # [ 37.680582] nix-daemon[833]: reaped child process 908, status = succeeded3893client # farm-b> LOG-farm-b-t13894worker1 # [ 37.838709] nix-daemon[833]: accepted connection from pid 923, user nix-grpc-daemon (trusted)3895worker1 # [ 37.858368] nix-daemon[833]: reaped child process 926, status = succeeded3896lb # [ 37.866798] niks3-server[998]: 2026/09/20 10:51:28 INFO Received uploads request method=POST path=/api/pending_closures3897worker1 # [ 37.882065] nix-grpc-daemon[846]: time=2026-09-20T10:51:28.469Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3898worker1 # [ 37.883808] nix-grpc-daemon[846]: time=2026-09-20T10:51:28.469Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3899lb # [ 37.906256] niks3-server[998]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3900lb # [ 37.918705] niks3-server[998]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3901lb # [ 37.929836] niks3-server[998]: 2026/09/20 10:51:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3902lb # [ 37.934857] niks3-server[998]: 2026/09/20 10:51:28 INFO Signed narinfos id=4 count=13903worker1 # [ 37.939012] nix-grpc-daemon[846]: time=2026-09-20T10:51:28.526Z level=INFO msg="Uploading 1 narinfos"3904lb # [ 37.939639] niks3-server[998]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3905lb # [ 37.956439] niks3-server[998]: 2026/09/20 10:51:28 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3906lb # [ 37.965812] niks3-server[998]: 2026/09/20 10:51:28 INFO Completed upload id=43907worker1 # [ 37.969986] nix-grpc-daemon[846]: time=2026-09-20T10:51:28.558Z level=INFO msg="Upload complete. (303ms)"3908lb # [ 37.969030] niks3-server[998]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3909worker1 # [ 37.988672] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13910worker1 # [ 38.004284] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03911worker1 # [ 38.008640] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13912worker1 # [ 38.012548] nix-daemon[833]: reaped child process 906, status = succeeded3913worker1 # [ 38.032174] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386563914worker1 # [ 38.047354] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386563915worker1 # [ 38.062263] nix-grpc-daemon[846]: time=2026-09-20T10:51:28.650Z level=INFO msg="All 2 paths already cached"3916client # copying 1 paths to 'lb:50051'...3917client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3918worker1 # [ 38.073018] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386563919worker1 # [ 38.087544] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3920worker1 # [ 38.285406] nix-daemon[833]: accepted connection from pid 932, user nix-grpc-daemon (trusted)3921worker1 # [ 38.304455] nix-daemon[833]: reaped child process 935, status = succeeded3922worker1 # [ 38.480097] nix-daemon[833]: accepted connection from pid 937, user nix-grpc-daemon (trusted)3923worker1 # [ 38.498625] nix-daemon[833]: reaped child process 940, status = succeeded3924lb # [ 38.507431] niks3-server[998]: 2026/09/20 10:51:29 INFO Received uploads request method=POST path=/api/pending_closures3925worker1 # [ 38.521554] nix-grpc-daemon[846]: time=2026-09-20T10:51:29.110Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3926worker1 # [ 38.523639] nix-grpc-daemon[846]: time=2026-09-20T10:51:29.111Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3927lb # [ 38.539791] niks3-server[998]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3928lb # [ 38.552638] niks3-server[998]: 2026/09/20 10:51:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3929worker1 # [ 38.564206] nix-grpc-daemon[846]: time=2026-09-20T10:51:29.152Z level=INFO msg="Uploading 1 narinfos"3930lb # [ 38.560208] niks3-server[998]: 2026/09/20 10:51:29 INFO Signed narinfos id=5 count=13931lb # [ 38.568271] niks3-server[998]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3932lb # [ 38.579513] niks3-server[998]: 2026/09/20 10:51:29 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3933worker1 # [ 38.590792] nix-grpc-daemon[846]: time=2026-09-20T10:51:29.179Z level=INFO msg="Upload complete. (486ms)"3934lb # [ 38.587145] niks3-server[998]: 2026/09/20 10:51:29 INFO Completed upload id=53935lb # [ 38.589892] niks3-server[998]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3936worker1 # [ 38.600471] nix-grpc-daemon[774]: ts=2026-09-20T10:51:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=7523937worker1 # [ 38.612344] nix-grpc-daemon[774]: ts=2026-09-20T10:51:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386563938worker1 # [ 38.619326] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3939worker1 # [ 38.624255] nix-daemon[833]: reaped child process 930, status = succeeded3940client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3941client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3942worker1 # [ 38.638417] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3943client # farm-top> LOG-farm-top-t13944worker1 # [ 39.881036] nix-daemon[833]: reaped child process 944, status = succeeded3945worker1 # [ 40.064867] nix-daemon[833]: accepted connection from pid 960, user nix-grpc-daemon (trusted)3946worker1 # [ 40.086224] nix-daemon[833]: reaped child process 963, status = succeeded3947lb # [ 40.094467] niks3-server[998]: 2026/09/20 10:51:30 INFO Received uploads request method=POST path=/api/pending_closures3948worker1 # [ 40.112318] nix-grpc-daemon[846]: time=2026-09-20T10:51:30.700Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3949worker1 # [ 40.116119] nix-grpc-daemon[846]: time=2026-09-20T10:51:30.702Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3950lb # [ 40.143089] niks3-server[998]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3951worker1 # [ 40.168688] nix-grpc-daemon[846]: time=2026-09-20T10:51:30.756Z level=INFO msg="Uploading 1 narinfos"3952lb # [ 40.155766] niks3-server[998]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3953lb # [ 40.169357] niks3-server[998]: 2026/09/20 10:51:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3954lb # [ 40.179079] niks3-server[998]: 2026/09/20 10:51:30 INFO Signed narinfos id=6 count=13955worker1 # [ 40.192741] nix-grpc-daemon[846]: time=2026-09-20T10:51:30.781Z level=INFO msg="Upload complete. (343ms)"3956lb # [ 40.189163] niks3-server[998]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3957lb # [ 40.200849] niks3-server[998]: 2026/09/20 10:51:30 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3958lb # [ 40.206831] niks3-server[998]: 2026/09/20 10:51:30 INFO Completed upload id=63959worker1 # [ 40.205189] nix-grpc-daemon[774]: ts=2026-09-20T10:51:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13960lb # [ 40.210996] niks3-server[998]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3961worker1 # [ 40.225996] nix-daemon[833]: reaped child process 942, status = succeeded3962client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.30 seconds)3963client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3964lb # [ 40.285098] envoy[916]: conn peer=[2001:db8:1::1]:57728 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1183965lb # [ 40.287485] envoy[916]: conn peer=[2001:db8:1::1]:43688 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=203966lb # [ 40.289922] envoy[916]: conn peer=[2001:db8:1::1]:43696 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=133967lb # [ 40.291906] envoy[916]: conn peer=[2001:db8:1::1]:43704 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9523 tx=3812 ms=70513968client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds)3969client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3970client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)3971client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3972client # copying 3 paths...3973client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3974client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3975client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3976client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)3977(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.99 seconds)3978subtest: repeat is answered Cached by the scheduler without building3979worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3980worker1 # finding garbage collector roots...3981worker1 # deleting specified paths...3982worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3983worker1 # deleting unused links...3984worker1 # note: hard linking is currently saving 0.0 KiB3985worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)3986worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3987worker2 # finding garbage collector roots...3988worker2 # deleting specified paths...3989worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3990worker2 # deleting unused links...3991worker2 # note: hard linking is currently saving 0.0 KiB3992worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.32 seconds)3993client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23994worker1 # [ 41.799980] nix-grpc-daemon[774]: ts=2026-09-20T10:51:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:386563995client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):3996client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3997worker1 # [ 41.819227] nix-grpc-daemon[774]: ts=2026-09-20T10:51:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386563998worker1 # [ 41.831378] nix-grpc-daemon[846]: time=2026-09-20T10:51:32.418Z level=INFO msg="All 2 paths already cached"3999worker1 # [ 41.850316] nix-grpc-daemon[774]: ts=2026-09-20T10:51:32Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14000client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.34 seconds)4001client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4002client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.22 seconds)4003lb: must succeed: curl -sf localhost:9901/clusters4004lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4005lb: must succeed: curl -sf localhost:9901/clusters4006lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4007worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4008worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4009(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.49 seconds)4010subtest: inputs already in the cache are not sent to the scheduler4011lb: must succeed: curl -sf localhost:9901/clusters4012lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4013lb: must succeed: curl -sf localhost:9901/clusters4014lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4015worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4016worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4017client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24018worker2 # [ 42.929737] nix-grpc-daemon[777]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:534124019client # don't know how to build these paths:4020client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4021worker2 # [ 42.941351] nix-grpc-daemon[777]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534124022worker1 # [ 42.981339] nix-grpc-daemon[774]: ts=2026-09-20T10:51:33Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04023worker1 # [ 42.986788] nix-grpc-daemon[774]: ts=2026-09-20T10:51:33Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14024worker1 # [ 43.025942] nix-grpc-daemon[774]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386564025worker1 # [ 43.041484] nix-grpc-daemon[774]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386564026worker1 # [ 43.057795] nix-grpc-daemon[846]: time=2026-09-20T10:51:33.645Z level=INFO msg="All 2 paths already cached"4027client # copying 1 paths to 'lb:50051'...4028client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4029worker1 # [ 43.068133] nix-grpc-daemon[774]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386564030worker1 # [ 43.083690] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4031worker1 # [ 43.298120] nix-daemon[833]: accepted connection from pid 993, user nix-grpc-daemon (trusted)4032worker1 # [ 43.319178] nix-daemon[833]: reaped child process 996, status = succeeded4033worker1 # [ 43.499546] nix-daemon[833]: accepted connection from pid 998, user nix-grpc-daemon (trusted)4034worker1 # [ 43.518228] nix-daemon[833]: reaped child process 1001, status = succeeded4035lb # [ 43.529821] niks3-server[998]: 2026/09/20 10:51:34 INFO Received uploads request method=POST path=/api/pending_closures4036worker1 # [ 43.545949] nix-grpc-daemon[846]: time=2026-09-20T10:51:34.134Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4037worker1 # [ 43.547478] nix-grpc-daemon[846]: time=2026-09-20T10:51:34.134Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4038lb # [ 43.567015] niks3-server[998]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4039lb # [ 43.582105] niks3-server[998]: 2026/09/20 10:51:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4040worker1 # [ 43.590034] nix-grpc-daemon[846]: time=2026-09-20T10:51:34.178Z level=INFO msg="Uploading 1 narinfos"4041lb # [ 43.590930] niks3-server[998]: 2026/09/20 10:51:34 INFO Signed narinfos id=7 count=14042lb # [ 43.597971] niks3-server[998]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4043lb # [ 43.608099] niks3-server[998]: 2026/09/20 10:51:34 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4044lb # [ 43.614194] niks3-server[998]: 2026/09/20 10:51:34 INFO Completed upload id=74045lb # [ 43.616604] niks3-server[998]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4046worker1 # [ 43.617245] nix-grpc-daemon[846]: time=2026-09-20T10:51:34.205Z level=INFO msg="Upload complete. (516ms)"4047worker1 # [ 43.626628] nix-grpc-daemon[774]: ts=2026-09-20T10:51:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=7524048worker1 # [ 43.642554] nix-grpc-daemon[774]: ts=2026-09-20T10:51:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386564049worker1 # [ 43.648774] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4050worker1 # [ 43.654133] nix-daemon[833]: reaped child process 991, status = succeeded4051client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4052worker1 # [ 43.667099] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4053client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4054client # farm-top> LOG-farm-top-t1b4055worker1 # [ 44.917552] nix-daemon[833]: reaped child process 1005, status = succeeded4056worker1 # [ 45.100555] nix-daemon[833]: accepted connection from pid 1020, user nix-grpc-daemon (trusted)4057worker1 # [ 45.121517] nix-daemon[833]: reaped child process 1023, status = succeeded4058lb # [ 45.131707] niks3-server[998]: 2026/09/20 10:51:35 INFO Received uploads request method=POST path=/api/pending_closures4059worker1 # [ 45.144400] nix-grpc-daemon[846]: time=2026-09-20T10:51:35.731Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4060worker1 # [ 45.145861] nix-grpc-daemon[846]: time=2026-09-20T10:51:35.731Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4061lb # [ 45.166695] niks3-server[998]: 2026/09/20 10:51:35 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4062lb # [ 45.179604] niks3-server[998]: 2026/09/20 10:51:35 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4063lb # [ 45.191221] niks3-server[998]: 2026/09/20 10:51:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4064worker1 # [ 45.200229] nix-grpc-daemon[846]: time=2026-09-20T10:51:35.788Z level=INFO msg="Uploading 1 narinfos"4065lb # [ 45.200975] niks3-server[998]: 2026/09/20 10:51:35 INFO Signed narinfos id=8 count=14066lb # [ 45.205019] niks3-server[998]: 2026/09/20 10:51:35 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4067lb # [ 45.212335] niks3-server[998]: 2026/09/20 10:51:35 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4068lb # [ 45.218271] niks3-server[998]: 2026/09/20 10:51:35 INFO Completed upload id=84069worker1 # [ 45.221416] nix-grpc-daemon[846]: time=2026-09-20T10:51:35.809Z level=INFO msg="Upload complete. (340ms)"4070lb # [ 45.220757] niks3-server[998]: 2026/09/20 10:51:35 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4071worker1 # [ 45.237166] nix-grpc-daemon[774]: ts=2026-09-20T10:51:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14072worker1 # [ 45.252203] nix-daemon[833]: reaped child process 1003, status = succeeded4073client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.64 seconds)4074client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4075client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds)4076lb: must succeed: curl -sf localhost:9901/clusters4077lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4078lb: must succeed: curl -sf localhost:9901/clusters4079lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4080worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4081worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4082(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.29 seconds)4083subtest: two clients wanting the same drv build it once4084client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4085client # [ 45.894896] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4086client # Running as unit: dedup1.service; invocation ID: a9c0466643004567944265bb4d7279044087client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4088client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4089worker1 # [ 46.100983] nix-grpc-daemon[774]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:386564090client # [ 46.194233] nix[883]: don't know how to build these paths:4091client # [ 46.195238] nix[883]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4092worker1 # [ 46.121046] nix-grpc-daemon[774]: ts=2026-09-20T10:51:36Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04093worker2 # [ 46.117470] nix-grpc-daemon[777]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534124094worker1 # [ 46.130826] nix-grpc-daemon[774]: ts=2026-09-20T10:51:36Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14095worker2 # [ 46.139119] nix-grpc-daemon[777]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534124096client # [ 46.241251] nix[883]: copying 1 paths to 'lb:50051'...4097client # [ 46.245033] nix[883]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4098worker2 # [ 46.151540] nix-grpc-daemon[777]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534124099worker2 # [ 46.164505] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4100worker2 # [ 46.188851] nix-grpc-daemon[777]: ts=2026-09-20T10:51:36Z level=info event=niks3_push_started pid=8614101worker2 # [ 46.638620] nix-daemon[833]: accepted connection from pid 875, user nix-grpc-daemon (trusted)4102worker2 # [ 46.658086] nix-daemon[833]: reaped child process 878, status = succeeded4103worker2 # [ 46.833673] nix-daemon[833]: accepted connection from pid 880, user nix-grpc-daemon (trusted)4104worker2 # [ 46.853034] nix-daemon[833]: reaped child process 883, status = succeeded4105lb # [ 46.874475] niks3-server[998]: 2026/09/20 10:51:37 INFO Received uploads request method=POST path=/api/pending_closures4106worker2 # [ 46.882600] nix-grpc-daemon[861]: time=2026-09-20T10:51:37.487Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4107worker2 # [ 46.884502] nix-grpc-daemon[861]: time=2026-09-20T10:51:37.487Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4108lb # [ 46.929419] niks3-server[998]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4109worker2 # [ 46.931887] nix-grpc-daemon[861]: time=2026-09-20T10:51:37.538Z level=INFO msg="Uploading 1 narinfos"4110lb # [ 46.937706] niks3-server[998]: 2026/09/20 10:51:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4111client # [ 47.017597] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4112lb # [ 46.944893] niks3-server[998]: 2026/09/20 10:51:37 INFO Signed narinfos id=9 count=14113client # Running as unit: dedup2.service; invocation ID: 1304e0449550433488e6cf46c3ee85134114lb # [ 46.949914] niks3-server[998]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4115lb # [ 46.958710] niks3-server[998]: 2026/09/20 10:51:37 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4116lb # [ 46.963336] niks3-server[998]: 2026/09/20 10:51:37 INFO Completed upload id=94117worker2 # [ 46.958477] nix-grpc-daemon[861]: time=2026-09-20T10:51:37.565Z level=INFO msg="Upload complete. (507ms)"4118client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds)4119lb # [ 46.965624] niks3-server[998]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4120worker2 # [ 46.968367] nix-grpc-daemon[777]: ts=2026-09-20T10:51:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=1 nar_bytes_in=4324121worker2 # [ 46.980550] nix-grpc-daemon[777]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534124122worker2 # [ 46.988401] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4123worker2 # [ 46.993889] nix-daemon[833]: reaped child process 859, status = succeeded4124client # [ 47.096396] nix[883]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4125worker2 # [ 47.005924] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4126worker1 # [ 47.274203] nix-grpc-daemon[774]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:386564127client # [ 47.366185] nix[899]: don't know how to build these paths:4128client # [ 47.367497] nix[899]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4129worker1 # [ 47.296106] nix-grpc-daemon[774]: ts=2026-09-20T10:51:37Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04130worker2 # [ 47.295220] nix-grpc-daemon[777]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534124131client # [ 47.396073] nix[899]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4132client: must succeed: sleep 24133lb # [ 50.286972] envoy[916]: conn peer=[2001:db8:1::1]:37578 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=724134lb # [ 50.291992] envoy[916]: conn peer=[2001:db8:1::1]:37582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1705 ms=23084135client: (finished: must succeed: sleep 2, in 2.07 seconds)4136??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4137 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394138client: waiting for success: ! systemctl is-active dedup1 dedup24139??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4140 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394141worker2 # [ 50.652507] nix-daemon[833]: reaped child process 887, status = succeeded4142worker2 # [ 50.837686] nix-daemon[833]: accepted connection from pid 916, user nix-grpc-daemon (trusted)4143worker2 # [ 50.855952] nix-daemon[833]: reaped child process 919, status = succeeded4144lb # [ 50.873458] niks3-server[998]: 2026/09/20 10:51:41 INFO Received uploads request method=POST path=/api/pending_closures4145worker2 # [ 50.885462] nix-grpc-daemon[861]: time=2026-09-20T10:51:41.489Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4146worker2 # [ 50.887638] nix-grpc-daemon[861]: time=2026-09-20T10:51:41.490Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4147lb # [ 50.916915] niks3-server[998]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4148lb # [ 50.937263] niks3-server[998]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4149worker2 # [ 50.948106] nix-grpc-daemon[861]: time=2026-09-20T10:51:41.554Z level=INFO msg="Uploading 1 narinfos"4150lb # [ 50.952416] niks3-server[998]: 2026/09/20 10:51:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4151lb # [ 50.961733] niks3-server[998]: 2026/09/20 10:51:41 INFO Signed narinfos id=10 count=14152lb # [ 50.967981] niks3-server[998]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4153lb # [ 50.976777] niks3-server[998]: 2026/09/20 10:51:41 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4154lb # [ 50.984927] niks3-server[998]: 2026/09/20 10:51:41 INFO Completed upload id=104155worker2 # [ 50.979979] nix-grpc-daemon[861]: time=2026-09-20T10:51:41.586Z level=INFO msg="Upload complete. (361ms)"4156lb # [ 50.988585] niks3-server[998]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4157worker2 # [ 50.993218] nix-grpc-daemon[777]: ts=2026-09-20T10:51:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14158worker2 # [ 51.012272] nix-grpc-daemon[777]: ts=2026-09-20T10:51:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14159worker2 # [ 51.018857] nix-daemon[833]: reaped child process 885, status = succeeded4160client # [ 51.150150] systemd[1]: dedup2.service: Deactivated successfully.4161client # [ 51.154561] systemd[1]: dedup2.service: Consumed 191ms CPU time over 4.137s wall clock time, 31M memory peak, 7.4K incoming IP traffic, 6.4K outgoing IP traffic.4162client # [ 51.163061] systemd[1]: dedup1.service: Deactivated successfully.4163client # [ 51.167001] systemd[1]: dedup1.service: Consumed 170ms CPU time over 5.267s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.4164client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4165client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4166client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4167worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4168worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4169worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4170worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4171worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4172worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)4173worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4174worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4175(finished: subtest: two clients wanting the same drv build it once, in 6.30 seconds)4176subtest: build hook: nix-daemon with builders = grpc://lb4177client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4178client # [ 52.356820] systemd[1]: Started Nix Daemon.4179client # [ 52.547896] nix-daemon[940]: accepted connection from pid 937, user root (trusted)4180worker2 # [ 52.661047] nix-grpc-daemon[777]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:534124181worker1 # [ 52.676886] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386564182worker1 # [ 52.691187] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04183worker1 # [ 52.698510] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14184worker1 # [ 52.736066] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386564185worker1 # [ 52.752607] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386564186worker1 # [ 52.768117] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386564187worker1 # [ 52.785323] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4188worker1 # [ 52.996962] nix-daemon[833]: accepted connection from pid 1060, user nix-grpc-daemon (trusted)4189worker1 # [ 53.017106] nix-daemon[833]: reaped child process 1063, status = succeeded4190worker1 # [ 53.193698] nix-daemon[833]: accepted connection from pid 1065, user nix-grpc-daemon (trusted)4191worker1 # [ 53.214385] nix-daemon[833]: reaped child process 1068, status = succeeded4192lb # [ 53.225605] niks3-server[998]: 2026/09/20 10:51:43 INFO Received uploads request method=POST path=/api/pending_closures4193worker1 # [ 53.241967] nix-grpc-daemon[846]: time=2026-09-20T10:51:43.829Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4194worker1 # [ 53.243513] nix-grpc-daemon[846]: time=2026-09-20T10:51:43.829Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4195lb # [ 53.261533] niks3-server[998]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4196lb # [ 53.278126] niks3-server[998]: 2026/09/20 10:51:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4197worker1 # [ 53.288546] nix-grpc-daemon[846]: time=2026-09-20T10:51:43.876Z level=INFO msg="Uploading 1 narinfos"4198lb # [ 53.287930] niks3-server[998]: 2026/09/20 10:51:43 INFO Signed narinfos id=11 count=14199lb # [ 53.294868] niks3-server[998]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4200lb # [ 53.303673] niks3-server[998]: 2026/09/20 10:51:43 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4201lb # [ 53.313575] niks3-server[998]: 2026/09/20 10:51:43 INFO Completed upload id=114202worker1 # [ 53.317790] nix-grpc-daemon[846]: time=2026-09-20T10:51:43.906Z level=INFO msg="Upload complete. (514ms)"4203lb # [ 53.316768] niks3-server[998]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4204worker1 # [ 53.328434] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=5124205worker1 # [ 53.344331] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386564206worker1 # [ 53.352350] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4207worker1 # [ 53.358016] nix-daemon[833]: reaped child process 1058, status = succeeded4208worker1 # [ 53.371257] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4209worker1 # [ 54.801919] nix-daemon[833]: reaped child process 1072, status = succeeded4210worker1 # [ 54.982060] nix-daemon[833]: accepted connection from pid 1087, user nix-grpc-daemon (trusted)4211worker1 # [ 55.003573] nix-daemon[833]: reaped child process 1090, status = succeeded4212lb # [ 55.018161] niks3-server[998]: 2026/09/20 10:51:45 INFO Received uploads request method=POST path=/api/pending_closures4213worker1 # [ 55.033987] nix-grpc-daemon[846]: time=2026-09-20T10:51:45.621Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4214worker1 # [ 55.035525] nix-grpc-daemon[846]: time=2026-09-20T10:51:45.621Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4215worker1 # [ 55.093171] nix-grpc-daemon[846]: time=2026-09-20T10:51:45.681Z level=INFO msg="Uploading 1 narinfos"4216lb # [ 55.074967] niks3-server[998]: 2026/09/20 10:51:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4217lb # [ 55.094586] niks3-server[998]: 2026/09/20 10:51:45 INFO Signed narinfos id=12 count=14218lb # [ 55.107730] niks3-server[998]: 2026/09/20 10:51:45 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4219lb # [ 55.119389] niks3-server[998]: 2026/09/20 10:51:45 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4220lb # [ 55.124441] niks3-server[998]: 2026/09/20 10:51:45 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4221lb # [ 55.134076] niks3-server[998]: 2026/09/20 10:51:45 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4222lb # [ 55.139339] niks3-server[998]: 2026/09/20 10:51:45 INFO Completed upload id=124223worker1 # [ 55.143726] nix-grpc-daemon[846]: time=2026-09-20T10:51:45.732Z level=INFO msg="Upload complete. (355ms)"4224lb # [ 55.142397] niks3-server[998]: 2026/09/20 10:51:45 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4225worker1 # [ 55.161501] nix-grpc-daemon[774]: ts=2026-09-20T10:51:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14226worker2 # [ 55.157079] nix-grpc-daemon[777]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:534124227worker1 # [ 55.181946] nix-daemon[833]: reaped child process 1070, status = succeeded4228worker2 # [ 55.171167] nix-grpc-daemon[777]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4229worker2 # [ 55.234624] nix-grpc-daemon[777]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:534124230worker2 # [ 55.241974] nix-grpc-daemon[777]: ts=2026-09-20T10:51:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=1 nar_bytes_out=1284231worker2 # [ 55.599499] nix-grpc-daemon[777]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:534124232worker2 # [ 55.610248] nix-grpc-daemon[777]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534124233worker2 # [ 55.627323] nix-grpc-daemon[861]: time=2026-09-20T10:51:46.231Z level=INFO msg="All 1 paths already cached"4234worker1 # [ 55.652952] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04235worker1 # [ 55.660833] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14236worker1 # [ 55.671864] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386564237worker1 # [ 55.686171] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386564238worker1 # [ 55.704117] nix-grpc-daemon[846]: time=2026-09-20T10:51:46.292Z level=INFO msg="All 1 paths already cached"4239worker1 # [ 55.716733] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386564240worker1 # [ 55.732744] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4241worker1 # [ 55.959103] nix-daemon[833]: accepted connection from pid 1096, user nix-grpc-daemon (trusted)4242worker1 # [ 55.978599] nix-daemon[833]: reaped child process 1099, status = succeeded4243worker1 # [ 56.167059] nix-daemon[833]: accepted connection from pid 1101, user nix-grpc-daemon (trusted)4244worker1 # [ 56.185713] nix-daemon[833]: reaped child process 1104, status = succeeded4245lb # [ 56.196950] niks3-server[998]: 2026/09/20 10:51:46 INFO Received uploads request method=POST path=/api/pending_closures4246worker1 # [ 56.213428] nix-grpc-daemon[846]: time=2026-09-20T10:51:46.801Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4247worker1 # [ 56.214960] nix-grpc-daemon[846]: time=2026-09-20T10:51:46.801Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4248lb # [ 56.231168] niks3-server[998]: 2026/09/20 10:51:46 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4249worker1 # [ 56.258107] nix-grpc-daemon[846]: time=2026-09-20T10:51:46.846Z level=INFO msg="Uploading 1 narinfos"4250lb # [ 56.247908] niks3-server[998]: 2026/09/20 10:51:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4251lb # [ 56.263692] niks3-server[998]: 2026/09/20 10:51:46 INFO Signed narinfos id=13 count=14252lb # [ 56.269585] niks3-server[998]: 2026/09/20 10:51:46 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4253lb # [ 56.276556] niks3-server[998]: 2026/09/20 10:51:46 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4254lb # [ 56.292758] niks3-server[998]: 2026/09/20 10:51:46 INFO Completed upload id=134255worker1 # [ 56.297108] nix-grpc-daemon[846]: time=2026-09-20T10:51:46.885Z level=INFO msg="Upload complete. (544ms)"4256lb # [ 56.296089] niks3-server[998]: 2026/09/20 10:51:46 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4257worker1 # [ 56.310231] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=6244258worker1 # [ 56.324759] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386564259worker1 # [ 56.331726] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4260worker1 # [ 56.337692] nix-daemon[833]: reaped child process 1094, status = succeeded4261worker1 # [ 56.353565] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4262worker1 # [ 57.787481] nix-daemon[833]: reaped child process 1108, status = succeeded4263worker1 # [ 57.993827] nix-daemon[833]: accepted connection from pid 1123, user nix-grpc-daemon (trusted)4264worker1 # [ 58.013982] nix-daemon[833]: reaped child process 1126, status = succeeded4265lb # [ 58.023078] niks3-server[998]: 2026/09/20 10:51:48 INFO Received uploads request method=POST path=/api/pending_closures4266worker1 # [ 58.040231] nix-grpc-daemon[846]: time=2026-09-20T10:51:48.626Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4267worker1 # [ 58.041765] nix-grpc-daemon[846]: time=2026-09-20T10:51:48.626Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4268lb # [ 58.067757] niks3-server[998]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4269lb # [ 58.082000] niks3-server[998]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4270worker1 # [ 58.094347] nix-grpc-daemon[846]: time=2026-09-20T10:51:48.682Z level=INFO msg="Uploading 1 narinfos"4271lb # [ 58.093015] niks3-server[998]: 2026/09/20 10:51:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4272lb # [ 58.099783] niks3-server[998]: 2026/09/20 10:51:48 INFO Signed narinfos id=14 count=14273lb # [ 58.103616] niks3-server[998]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4274lb # [ 58.110670] niks3-server[998]: 2026/09/20 10:51:48 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4275lb # [ 58.116107] niks3-server[998]: 2026/09/20 10:51:48 INFO Completed upload id=144276worker1 # [ 58.120361] nix-grpc-daemon[846]: time=2026-09-20T10:51:48.708Z level=INFO msg="Upload complete. (351ms)"4277lb # [ 58.118308] niks3-server[998]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4278worker1 # [ 58.137148] nix-grpc-daemon[774]: ts=2026-09-20T10:51:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14279worker1 # [ 58.152396] nix-grpc-daemon[774]: ts=2026-09-20T10:51:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:386564280worker1 # [ 58.157567] nix-daemon[833]: reaped child process 1106, status = succeeded4281worker2 # [ 58.169271] nix-grpc-daemon[777]: ts=2026-09-20T10:51:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:534124282worker2 # [ 58.188086] nix-grpc-daemon[777]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4283worker2 # [ 58.213262] nix-grpc-daemon[777]: ts=2026-09-20T10:51:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=1 nar_bytes_out=1764284worker1 # [ 58.574240] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:386564285worker2 # [ 58.577405] nix-grpc-daemon[777]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534124286worker2 # [ 58.593942] nix-grpc-daemon[861]: time=2026-09-20T10:51:49.199Z level=INFO msg="All 2 paths already cached"4287worker1 # [ 58.626602] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04288worker1 # [ 58.634467] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14289worker1 # [ 58.644591] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386564290worker1 # [ 58.660215] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386564291worker1 # [ 58.679362] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.267Z level=INFO msg="All 2 paths already cached"4292worker1 # [ 58.693436] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386564293worker1 # [ 58.709413] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4294worker1 # [ 58.955313] nix-daemon[833]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)4295worker1 # [ 58.975965] nix-daemon[833]: reaped child process 1135, status = succeeded4296worker1 # [ 59.169842] nix-daemon[833]: accepted connection from pid 1137, user nix-grpc-daemon (trusted)4297worker1 # [ 59.190008] nix-daemon[833]: reaped child process 1140, status = succeeded4298lb # [ 59.199837] niks3-server[998]: 2026/09/20 10:51:49 INFO Received uploads request method=POST path=/api/pending_closures4299worker1 # [ 59.218894] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.806Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4300worker1 # [ 59.220697] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.806Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4301lb # [ 59.251268] niks3-server[998]: 2026/09/20 10:51:49 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4302lb # [ 59.264964] niks3-server[998]: 2026/09/20 10:51:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4303worker1 # [ 59.276223] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.864Z level=INFO msg="Uploading 1 narinfos"4304lb # [ 59.274521] niks3-server[998]: 2026/09/20 10:51:49 INFO Signed narinfos id=15 count=14305lb # [ 59.288551] niks3-server[998]: 2026/09/20 10:51:49 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4306lb # [ 59.295171] niks3-server[998]: 2026/09/20 10:51:49 INFO Completed upload id=154307worker1 # [ 59.298019] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.886Z level=INFO msg="Upload complete. (567ms)"4308lb # [ 59.297050] niks3-server[998]: 2026/09/20 10:51:49 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4309worker1 # [ 59.313314] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.891Z level=WARN msg="Failed to register uploaded object" key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo error="server returned 404: object is not pending upload\n"4310worker1 # [ 59.329542] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=7524311worker1 # [ 59.341867] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386564312worker1 # [ 59.348899] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4313worker1 # [ 59.351108] nix-daemon[833]: reaped child process 1130, status = succeeded4314worker1 # [ 59.366946] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4315lb # [ 60.287059] envoy[916]: conn peer=[2001:db8:1::1]:37604 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1082 ms=37554316lb # [ 60.292317] envoy[916]: conn peer=[2001:db8:1::1]:37592 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1370 ms=49274317lb # [ 60.292451] envoy[916]: conn peer=[2001:db8:1::1]:59586 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3415 tx=1771 ms=26434318lb # [ 60.292619] envoy[916]: conn peer=[2001:db8:1::1]:59592 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=814319lb # [ 60.292730] envoy[916]: conn peer=[2001:db8:1::1]:59608 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3875 tx=1873 ms=26814320lb # [ 60.292857] envoy[916]: conn peer=[2001:db8:1::1]:59612 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=1184321worker1 # [ 61.025128] nix-daemon[833]: reaped child process 1144, status = succeeded4322worker1 # [ 61.216066] nix-daemon[833]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)4323worker1 # [ 61.238227] nix-daemon[833]: reaped child process 1162, status = succeeded4324lb # [ 61.248957] niks3-server[998]: 2026/09/20 10:51:51 INFO Received uploads request method=POST path=/api/pending_closures4325worker1 # [ 61.264462] nix-grpc-daemon[846]: time=2026-09-20T10:51:51.851Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4326worker1 # [ 61.265973] nix-grpc-daemon[846]: time=2026-09-20T10:51:51.851Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4327lb # [ 61.305222] niks3-server[998]: 2026/09/20 10:51:51 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4328lb # [ 61.316356] niks3-server[998]: 2026/09/20 10:51:51 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4329lb # [ 61.326162] niks3-server[998]: 2026/09/20 10:51:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4330worker1 # [ 61.335208] nix-grpc-daemon[846]: time=2026-09-20T10:51:51.922Z level=INFO msg="Uploading 1 narinfos"4331lb # [ 61.334250] niks3-server[998]: 2026/09/20 10:51:51 INFO Signed narinfos id=16 count=14332lb # [ 61.339391] niks3-server[998]: 2026/09/20 10:51:51 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4333lb # [ 61.352684] niks3-server[998]: 2026/09/20 10:51:51 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4334lb # [ 61.360314] niks3-server[998]: 2026/09/20 10:51:51 INFO Completed upload id=164335worker1 # [ 61.364669] nix-grpc-daemon[846]: time=2026-09-20T10:51:51.953Z level=INFO msg="Upload complete. (382ms)"4336lb # [ 61.362968] niks3-server[998]: 2026/09/20 10:51:51 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4337worker2 # [ 61.374092] nix-grpc-daemon[777]: ts=2026-09-20T10:51:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:534124338worker1 # [ 61.381340] nix-grpc-daemon[774]: ts=2026-09-20T10:51:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=2 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14339worker1 # [ 61.399141] nix-daemon[833]: reaped child process 1142, status = succeeded4340worker2 # [ 61.389048] nix-grpc-daemon[777]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4341worker1 # [ 61.444143] nix-grpc-daemon[774]: ts=2026-09-20T10:51:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:386564342worker1 # [ 61.452156] nix-grpc-daemon[774]: ts=2026-09-20T10:51:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_out=2324343client # [ 61.637735] nix-daemon[940]: reaped child process 942, status = succeeded4344client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 9.54 seconds)4345client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4346client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4347client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4348client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4349client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4350client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4351(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 9.67 seconds)4352subtest: an input only one worker has still reaches the builder4353client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4354client # this derivation will be built:4355client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4356client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4357client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.46 seconds)4358client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4359client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds)4360worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4361worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds)4362worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4363worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4364client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24365client # [ 63.001099] nix-daemon[940]: accepted connection from pid 1020, user root (trusted)4366client # this derivation will be built:4367client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4368client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4369worker1 # [ 63.120132] nix-grpc-daemon[774]: ts=2026-09-20T10:51:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:386564370worker1 # [ 63.127182] nix-grpc-daemon[774]: ts=2026-09-20T10:51:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386564371worker1 # [ 63.350035] nix-daemon[833]: accepted connection from pid 1169, user nix-grpc-daemon (trusted)4372worker1 # [ 63.369370] nix-daemon[833]: reaped child process 1172, status = succeeded4373lb # [ 63.378072] niks3-server[998]: 2026/09/20 10:51:53 INFO Received uploads request method=POST path=/api/pending_closures4374worker1 # [ 63.393965] nix-grpc-daemon[846]: time=2026-09-20T10:51:53.981Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4375worker1 # [ 63.395656] nix-grpc-daemon[846]: time=2026-09-20T10:51:53.981Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4376lb # [ 63.415829] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4377lb # [ 63.428457] niks3-server[998]: 2026/09/20 10:51:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4378worker1 # [ 63.439395] nix-grpc-daemon[846]: time=2026-09-20T10:51:54.027Z level=INFO msg="Uploading 1 narinfos"4379lb # [ 63.438770] niks3-server[998]: 2026/09/20 10:51:54 INFO Signed narinfos id=17 count=14380lb # [ 63.445145] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4381lb # [ 63.454709] niks3-server[998]: 2026/09/20 10:51:54 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4382lb # [ 63.462863] niks3-server[998]: 2026/09/20 10:51:54 INFO Completed upload id=174383worker1 # [ 63.465518] nix-grpc-daemon[846]: time=2026-09-20T10:51:54.053Z level=INFO msg="Upload complete. (332ms)"4384lb # [ 63.466131] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4385worker1 # [ 63.492402] nix-grpc-daemon[774]: ts=2026-09-20T10:51:54Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04386worker1 # [ 63.498627] nix-grpc-daemon[774]: ts=2026-09-20T10:51:54Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14387worker2 # [ 63.535155] nix-grpc-daemon[777]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534124388worker2 # [ 63.555752] nix-grpc-daemon[777]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534124389client # copying 2 paths to 'lb:50051'...4390client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4391worker2 # [ 63.577625] nix-grpc-daemon[777]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534124392client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4393worker2 # [ 63.594584] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4394worker2 # [ 63.843447] nix-daemon[833]: accepted connection from pid 938, user nix-grpc-daemon (trusted)4395worker2 # [ 63.863922] nix-daemon[833]: reaped child process 941, status = succeeded4396worker2 # [ 64.051717] nix-daemon[833]: accepted connection from pid 943, user nix-grpc-daemon (trusted)4397worker2 # [ 64.070706] nix-daemon[833]: reaped child process 946, status = succeeded4398lb # [ 64.089625] niks3-server[998]: 2026/09/20 10:51:54 INFO Received uploads request method=POST path=/api/pending_closures4399lb # [ 64.103420] niks3-server[998]: 2026/09/20 10:51:54 INFO Received uploads request method=POST path=/api/pending_closures4400worker2 # [ 64.112629] nix-grpc-daemon[861]: time=2026-09-20T10:51:54.718Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4401worker2 # [ 64.114614] nix-grpc-daemon[861]: time=2026-09-20T10:51:54.718Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4402worker2 # [ 64.118658] nix-grpc-daemon[861]: time=2026-09-20T10:51:54.723Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4403lb # [ 64.167175] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4404lb # [ 64.178918] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4405lb # [ 64.195732] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4406lb # [ 64.202268] niks3-server[998]: 2026/09/20 10:51:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4407lb # [ 64.212532] niks3-server[998]: 2026/09/20 10:51:54 INFO Signed narinfos id=18 count=14408worker2 # [ 64.206421] nix-grpc-daemon[861]: time=2026-09-20T10:51:54.811Z level=INFO msg="Uploading 3 narinfos"4409lb # [ 64.214574] niks3-server[998]: 2026/09/20 10:51:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4410lb # [ 64.223836] niks3-server[998]: 2026/09/20 10:51:54 INFO Signed narinfos id=19 count=24411lb # [ 64.228292] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4412lb # [ 64.241619] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4413lb # [ 64.250818] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4414lb # [ 64.259067] niks3-server[998]: 2026/09/20 10:51:54 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4415lb # [ 64.263821] niks3-server[998]: 2026/09/20 10:51:54 INFO Completed upload id=184416lb # [ 64.266759] niks3-server[998]: 2026/09/20 10:51:54 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4417lb # [ 64.269760] niks3-server[998]: 2026/09/20 10:51:54 INFO Completed upload id=194418worker2 # [ 64.264915] nix-grpc-daemon[861]: time=2026-09-20T10:51:54.871Z level=INFO msg="Upload complete. (639ms)"4419lb # [ 64.272367] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4420worker2 # [ 64.277654] nix-grpc-daemon[777]: ts=2026-09-20T10:51:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=2 nar_bytes_in=9844421worker2 # [ 64.297133] nix-grpc-daemon[777]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534124422worker2 # [ 64.307808] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4423worker2 # [ 64.320440] nix-daemon[833]: reaped child process 936, status = succeeded4424worker2 # [ 64.340601] nix-grpc-daemon[777]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4425client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4426worker2 # [ 64.364969] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4427client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4428worker2 # [ 65.419725] nix-daemon[833]: reaped child process 951, status = succeeded4429worker2 # [ 65.590906] nix-daemon[833]: accepted connection from pid 966, user nix-grpc-daemon (trusted)4430worker2 # [ 65.609878] nix-daemon[833]: reaped child process 969, status = succeeded4431lb # [ 65.628687] niks3-server[998]: 2026/09/20 10:51:56 INFO Received uploads request method=POST path=/api/pending_closures4432worker2 # [ 65.634839] nix-grpc-daemon[861]: time=2026-09-20T10:51:56.240Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4433lb # [ 65.658381] niks3-server[998]: 2026/09/20 10:51:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4434worker2 # [ 65.663581] nix-grpc-daemon[861]: time=2026-09-20T10:51:56.270Z level=INFO msg="Uploading 1 narinfos"4435lb # [ 65.674104] niks3-server[998]: 2026/09/20 10:51:56 INFO Signed narinfos id=20 count=14436lb # [ 65.682657] niks3-server[998]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4437lb # [ 65.695923] niks3-server[998]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4438lb # [ 65.706040] niks3-server[998]: 2026/09/20 10:51:56 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4439worker2 # [ 65.708388] nix-grpc-daemon[861]: time=2026-09-20T10:51:56.315Z level=INFO msg="Upload complete. (324ms)"4440lb # [ 65.716364] niks3-server[998]: 2026/09/20 10:51:56 INFO Completed upload id=204441lb # [ 65.721634] niks3-server[998]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4442worker2 # [ 65.721177] nix-grpc-daemon[777]: ts=2026-09-20T10:51:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14443worker2 # [ 65.738450] nix-daemon[833]: reaped child process 948, status = succeeded4444client # copying 1 paths...4445worker2 # [ 65.763329] nix-grpc-daemon[777]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:534124446client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4447worker1 # [ 65.803626] nix-grpc-daemon[774]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:386564448worker1 # [ 65.821625] nix-grpc-daemon[774]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4449worker1 # [ 65.844756] nix-grpc-daemon[774]: ts=2026-09-20T10:51:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_out=1204450client # [ 66.062807] nix-daemon[940]: reaped child process 1023, status = succeeded4451client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.31 seconds)4452client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24453client # [ 66.282333] nix-daemon[940]: accepted connection from pid 1041, user root (trusted)4454client # this derivation will be built:4455client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4456worker2 # [ 66.387169] nix-grpc-daemon[777]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:534124457client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4458worker1 # [ 66.401508] nix-grpc-daemon[774]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386564459worker1 # [ 66.413064] nix-grpc-daemon[846]: time=2026-09-20T10:51:57.000Z level=INFO msg="All 1 paths already cached"4460worker1 # [ 66.431210] nix-grpc-daemon[774]: ts=2026-09-20T10:51:57Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04461worker1 # [ 66.439085] nix-grpc-daemon[774]: ts=2026-09-20T10:51:57Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14462worker1 # [ 66.448417] nix-grpc-daemon[774]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386564463worker1 # [ 66.460504] nix-grpc-daemon[774]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:386564464client # copying 1 paths to 'lb:50051'...4465client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4466worker1 # [ 66.484993] nix-grpc-daemon[774]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:386564467worker1 # [ 66.500283] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4468worker1 # [ 66.523763] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5)4469worker1 # [ 66.591318] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 2/5)4470worker1 # [ 66.755074] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 3/5)4471worker1 # [ 66.929929] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 691 ms (attempt 4/5)4472worker1 # [ 67.629189] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4473worker1 # [ 67.636994] nix-grpc-daemon[774]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4474worker1 # [ 67.881313] nix-daemon[833]: accepted connection from pid 1185, user nix-grpc-daemon (trusted)4475worker1 # [ 67.900715] nix-daemon[833]: reaped child process 1188, status = succeeded4476worker1 # [ 68.073495] nix-daemon[833]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)4477worker1 # [ 68.090600] nix-daemon[833]: reaped child process 1193, status = succeeded4478worker1 # [ 68.115019] nix-grpc-daemon[846]: time=2026-09-20T10:51:58.702Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4479worker1 # [ 68.116601] nix-grpc-daemon[846]: time=2026-09-20T10:51:58.702Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4480lb # [ 68.099896] niks3-server[998]: 2026/09/20 10:51:58 INFO Received uploads request method=POST path=/api/pending_closures4481lb # [ 68.130639] niks3-server[998]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4482worker1 # [ 68.147055] nix-grpc-daemon[846]: time=2026-09-20T10:51:58.735Z level=INFO msg="Uploading 1 narinfos"4483lb # [ 68.146304] niks3-server[998]: 2026/09/20 10:51:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4484lb # [ 68.157307] niks3-server[998]: 2026/09/20 10:51:58 INFO Signed narinfos id=21 count=14485lb # [ 68.163320] niks3-server[998]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4486worker1 # [ 68.176913] nix-grpc-daemon[846]: time=2026-09-20T10:51:58.765Z level=INFO msg="Upload complete. (499ms)"4487lb # [ 68.173087] niks3-server[998]: 2026/09/20 10:51:58 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4488lb # [ 68.178830] niks3-server[998]: 2026/09/20 10:51:58 INFO Completed upload id=214489worker1 # [ 68.183211] nix-grpc-daemon[774]: ts=2026-09-20T10:51:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 paths=1 nar_bytes_in=5684490lb # [ 68.183124] niks3-server[998]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4491worker1 # [ 68.197195] nix-grpc-daemon[774]: ts=2026-09-20T10:51:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:386564492worker1 # [ 68.204615] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4493worker1 # [ 68.209276] nix-daemon[833]: reaped child process 1179, status = succeeded4494client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4495worker1 # [ 68.223359] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4496client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4497worker1 # [ 69.070248] nix-daemon[833]: reaped child process 1197, status = succeeded4498worker1 # [ 69.250827] nix-daemon[833]: accepted connection from pid 1212, user nix-grpc-daemon (trusted)4499worker1 # [ 69.268909] nix-daemon[833]: reaped child process 1215, status = succeeded4500lb # [ 69.277605] niks3-server[998]: 2026/09/20 10:51:59 INFO Received uploads request method=POST path=/api/pending_closures4501worker1 # [ 69.296266] nix-grpc-daemon[846]: time=2026-09-20T10:51:59.881Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4502lb # [ 69.313170] niks3-server[998]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4503worker1 # [ 69.325932] nix-grpc-daemon[846]: time=2026-09-20T10:51:59.914Z level=INFO msg="Uploading 1 narinfos"4504lb # [ 69.325655] niks3-server[998]: 2026/09/20 10:51:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4505lb # [ 69.336850] niks3-server[998]: 2026/09/20 10:51:59 INFO Signed narinfos id=22 count=14506lb # [ 69.341747] niks3-server[998]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4507worker1 # [ 69.353914] nix-grpc-daemon[846]: time=2026-09-20T10:51:59.942Z level=INFO msg="Upload complete. (320ms)"4508lb # [ 69.351260] niks3-server[998]: 2026/09/20 10:51:59 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4509lb # [ 69.357362] niks3-server[998]: 2026/09/20 10:51:59 INFO Completed upload id=224510lb # [ 69.360497] niks3-server[998]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4511client # copying 1 paths...4512worker1 # [ 69.365720] nix-grpc-daemon[774]: ts=2026-09-20T10:51:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14513worker1 # [ 69.381497] nix-grpc-daemon[774]: ts=2026-09-20T10:51:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:386564514client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4515worker1 # [ 69.386199] nix-daemon[833]: reaped child process 1195, status = succeeded4516worker2 # [ 69.402123] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:534124517worker2 # [ 69.415860] nix-grpc-daemon[777]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4518worker2 # [ 69.433603] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=1 nar_bytes_out=1204519client # [ 69.657939] nix-daemon[940]: reaped child process 1044, status = succeeded4520client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.59 seconds)4521client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24522client # [ 69.876432] nix-daemon[940]: accepted connection from pid 1062, user root (trusted)4523client # this derivation will be built:4524client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4525worker1 # [ 69.991551] nix-grpc-daemon[774]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:386564526client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4527worker2 # [ 69.987367] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534124528worker2 # [ 69.998148] nix-grpc-daemon[861]: time=2026-09-20T10:52:00.604Z level=INFO msg="All 1 paths already cached"4529worker1 # [ 70.025934] nix-grpc-daemon[774]: ts=2026-09-20T10:52:00Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04530worker1 # [ 70.032846] nix-grpc-daemon[774]: ts=2026-09-20T10:52:00Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14531worker2 # [ 70.026783] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534124532worker2 # [ 70.042351] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534124533worker2 # [ 70.057997] nix-grpc-daemon[861]: time=2026-09-20T10:52:00.664Z level=INFO msg="All 1 paths already cached"4534client # copying 1 paths to 'lb:50051'...4535client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4536worker2 # [ 70.068956] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534124537worker2 # [ 70.084966] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4538lb # [ 70.287876] envoy[916]: conn peer=[2001:db8:1::1]:59628 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4313 tx=2223 ms=28994539worker2 # [ 70.290114] nix-daemon[833]: accepted connection from pid 974, user nix-grpc-daemon (trusted)4540worker2 # [ 70.310054] nix-daemon[833]: reaped child process 977, status = succeeded4541worker2 # [ 70.482901] nix-daemon[833]: accepted connection from pid 979, user nix-grpc-daemon (trusted)4542worker2 # [ 70.502662] nix-daemon[833]: reaped child process 982, status = succeeded4543lb # [ 70.292882] envoy[916]: conn peer=[2001:db8:1::1]:41234 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=407 ms=334544lb # [ 70.293020] envoy[916]: conn peer=[2001:db8:1::1]:41238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3849 tx=1766 ms=27874545lb # [ 70.293207] envoy[916]: conn peer=[2001:db8:1::1]:41254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1084546lb # [ 70.293315] envoy[916]: conn peer=[2001:db8:1::1]:41260 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1827 ms=31044547lb # [ 70.293418] envoy[916]: conn peer=[2001:db8:1::1]:41264 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=954548lb # [ 70.519976] niks3-server[998]: 2026/09/20 10:52:01 INFO Received uploads request method=POST path=/api/pending_closures4549worker2 # [ 70.548698] nix-grpc-daemon[861]: time=2026-09-20T10:52:01.155Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4550worker2 # [ 70.550778] nix-grpc-daemon[861]: time=2026-09-20T10:52:01.157Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4551lb # [ 70.574850] niks3-server[998]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4552lb # [ 70.590751] niks3-server[998]: 2026/09/20 10:52:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4553worker2 # [ 70.591439] nix-grpc-daemon[861]: time=2026-09-20T10:52:01.197Z level=INFO msg="Uploading 1 narinfos"4554lb # [ 70.602507] niks3-server[998]: 2026/09/20 10:52:01 INFO Signed narinfos id=23 count=14555lb # [ 70.609281] niks3-server[998]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4556lb # [ 70.616684] niks3-server[998]: 2026/09/20 10:52:01 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4557lb # [ 70.622867] niks3-server[998]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4558lb # [ 70.628819] niks3-server[998]: 2026/09/20 10:52:01 INFO Completed upload id=234559worker2 # [ 70.623882] nix-grpc-daemon[861]: time=2026-09-20T10:52:01.230Z level=INFO msg="Upload complete. (521ms)"4560worker2 # [ 70.635756] nix-grpc-daemon[777]: ts=2026-09-20T10:52:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=1 nar_bytes_in=5684561worker2 # [ 70.653336] nix-grpc-daemon[777]: ts=2026-09-20T10:52:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534124562worker2 # [ 70.664330] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4563worker2 # [ 70.667430] nix-daemon[833]: reaped child process 972, status = succeeded4564client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4565worker2 # [ 70.681115] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4566client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4567worker2 # [ 71.705183] nix-daemon[833]: reaped child process 986, status = succeeded4568worker2 # [ 71.871078] nix-daemon[833]: accepted connection from pid 1001, user nix-grpc-daemon (trusted)4569worker2 # [ 71.890433] nix-daemon[833]: reaped child process 1004, status = succeeded4570lb # [ 71.908904] niks3-server[998]: 2026/09/20 10:52:02 INFO Received uploads request method=POST path=/api/pending_closures4571worker2 # [ 71.915178] nix-grpc-daemon[861]: time=2026-09-20T10:52:02.520Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4572lb # [ 71.942605] niks3-server[998]: 2026/09/20 10:52:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4573worker2 # [ 71.944459] nix-grpc-daemon[861]: time=2026-09-20T10:52:02.551Z level=INFO msg="Uploading 1 narinfos"4574lb # [ 71.956951] niks3-server[998]: 2026/09/20 10:52:02 INFO Signed narinfos id=24 count=14575lb # [ 71.959834] niks3-server[998]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4576lb # [ 71.971073] niks3-server[998]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4577worker2 # [ 71.970976] nix-grpc-daemon[861]: time=2026-09-20T10:52:02.577Z level=INFO msg="Upload complete. (279ms)"4578lb # [ 71.977942] niks3-server[998]: 2026/09/20 10:52:02 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4579lb # [ 71.982457] niks3-server[998]: 2026/09/20 10:52:02 INFO Completed upload id=244580lb # [ 71.984077] niks3-server[998]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4581worker2 # [ 71.980849] nix-grpc-daemon[777]: ts=2026-09-20T10:52:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14582worker2 # [ 71.991704] nix-daemon[833]: reaped child process 984, status = succeeded4583client # copying 1 paths...4584worker1 # [ 72.038451] nix-grpc-daemon[774]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:386564585worker1 # [ 72.054138] nix-grpc-daemon[774]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4586client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4587worker1 # [ 72.102984] nix-grpc-daemon[774]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:386564588worker1 # [ 72.108370] nix-grpc-daemon[774]: ts=2026-09-20T10:52:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_out=1204589client # [ 72.316670] nix-daemon[940]: reaped child process 1065, status = succeeded4590client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.66 seconds)4591(finished: subtest: an input only one worker has still reaches the builder, in 10.54 seconds)4592subtest: upload whose reference the worker lacks is completed from the cache4593client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4594client # this derivation will be built:4595client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4596client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4597client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.46 seconds)4598client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4599client # this derivation will be built:4600client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4601client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4602client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds)4603client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4604client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4605worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4606worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4607worker2 # [ 73.649364] systemd[1]: Stopping Nix worker-protocol over gRPC...4608worker2 # [ 73.655697] nix-grpc-daemon[777]: ts=2026-09-20T10:52:04Z level=info event=signal_exit4609worker2 # [ 74.915600] nix-grpc-daemon[777]: ts=2026-09-20T10:52:05Z level=info event=scheduler_restarting4610worker1 # [ 74.926488] nix-grpc-daemon[774]: ts=2026-09-20T10:52:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:386524611worker1 # [ 74.926863] nix-grpc-daemon[774]: ts=2026-09-20T10:52:05Z level=info event=worker_gone addr=192.168.1.4:500514612worker2 # [ 74.946776] nix-grpc-daemon[777]: ts=2026-09-20T10:52:05Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4613worker2 # [ 74.974850] nix-daemon[833]: reaped child process 835, status = succeeded4614worker2 # [ 75.807765] nix-grpc-daemon[777]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4615worker2 # [ 75.808288] nix-grpc-daemon[777]: E0000 00:00:1789901526.414282 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4616worker2 # [ 75.819733] nix-grpc-daemon[777]: E0000 00:00:1789901526.426350 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4617worker2 # [ 76.096627] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4618worker2 # [ 76.099751] systemd[1]: Stopped Nix worker-protocol over gRPC.4619worker2 # [ 76.109872] systemd[1]: nix-grpc-daemon.service: Consumed 1.785s CPU time over 55.792s wall clock time, 51.5M memory peak, 44.4K incoming IP traffic, 76.3K outgoing IP traffic.4620worker2 # [ 76.119705] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4621worker2 # [ 76.125813] systemd[1]: Closed Nix worker-protocol over gRPC.4622worker2 # [ 76.128903] systemd[1]: nix-grpc-daemon.socket: Consumed 625us CPU time over 1min 5.004s wall clock time, 256K memory peak, 58.5K incoming IP traffic, 51.6K outgoing IP traffic.4623lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4624lb: must succeed: curl -sf localhost:9901/clusters4625lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4626lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4627client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24628worker1 # [ 76.475390] nix-grpc-daemon[774]: ts=2026-09-20T10:52:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:386564629client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4630worker1 # [ 76.483099] nix-grpc-daemon[774]: ts=2026-09-20T10:52:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:386564631client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.28 seconds)4632worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4633worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4634worker2 # [ 76.610619] systemd[1]: Listening on Nix worker-protocol over gRPC.4635worker1 # [ 76.703808] systemd[1]: Stopping Nix worker-protocol over gRPC...4636worker2 # [ 77.082228] systemd[1]: Starting Nix worker-protocol over gRPC...4637worker2 # [ 77.300809] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:07Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4638worker2 # [ 77.303458] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:07Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14639worker2 # [ 77.311834] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:07Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4640worker2 # [ 77.332345] systemd[1]: Started Nix worker-protocol over gRPC.4641worker2 # [ 77.357096] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:07Z level=info event=scheduler_connected addr=lb:500514642worker1 # [ 77.368792] nix-grpc-daemon[774]: ts=2026-09-20T10:52:07Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04643worker1 # [ 77.696707] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=signal_exit4644worker1 # [ 77.927094] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_yield4645worker2 # [ 77.929400] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:08Z level=info event=scheduler_restarting addr=lb:500514646lb # [ 77.935289] niks3-server[998]: 2026/09/20 10:52:08 INFO lead: released remote=192.168.1.3:396864647worker1 # [ 77.939440] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:386524648worker1 # [ 77.947225] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=worker_gone addr=192.168.1.4:500514649worker1 # [ 77.951537] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_restarting addr=lb:500514650worker1 # [ 77.955644] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:386524651worker1 # [ 77.960185] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=worker_gone addr=192.168.1.3:500514652worker2 # [ 78.130294] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:08Z level=info event=scheduler_connected addr=lb:500514653worker2 # [ 78.135746] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4654worker1 # [ 78.148384] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_connected addr=lb:500514655worker1 # [ 78.153736] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4656worker2 # [ 78.338154] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:08Z level=info event=scheduler_connected addr=lb:500514657worker2 # [ 78.342518] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4658worker1 # [ 78.354551] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_connected addr=lb:500514659worker1 # [ 78.359923] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4660worker2 # [ 78.538559] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:500514661worker2 # [ 78.543870] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4662worker1 # [ 78.560803] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:500514663worker1 # [ 78.566209] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4664worker2 # [ 78.744767] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:500514665worker2 # [ 78.749939] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4666worker1 # [ 78.768904] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:500514667worker1 # [ 78.773016] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4668worker1 # [ 78.932149] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=scheduler_restarting4669worker2 # [ 78.950884] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:500514670worker2 # [ 78.956192] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4671worker1 # [ 78.974691] nix-daemon[833]: reaped child process 835, status = succeeded4672worker1 # [ 78.999135] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4673worker2 # [ 79.157227] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:500514674worker2 # [ 79.162667] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4675worker2 # [ 79.365270] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:500514676worker2 # [ 79.369517] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4677worker2 # [ 79.565823] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_connected addr=lb:500514678worker2 # [ 79.571211] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4679worker2 # [ 79.772128] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_connected addr=lb:500514680worker2 # [ 79.777282] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4681worker1 # [ 79.797970] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4682worker1 # [ 79.802672] nix-grpc-daemon[774]: E0000 00:00:1789901530.385019 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4683worker1 # [ 79.826032] nix-grpc-daemon[774]: E0000 00:00:1789901530.414311 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4684worker2 # [ 79.978168] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_connected addr=lb:500514685worker2 # [ 79.983565] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4686worker1 # [ 80.012985] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4687worker1 # [ 80.022024] systemd[1]: Stopped Nix worker-protocol over gRPC.4688worker1 # [ 80.027911] systemd[1]: nix-grpc-daemon.service: Consumed 3.937s CPU time over 59.708s wall clock time, 65.7M memory peak, 90.5K incoming IP traffic, 172.8K outgoing IP traffic.4689worker1 # [ 80.043331] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4690worker1 # [ 80.047326] systemd[1]: Closed Nix worker-protocol over gRPC.4691worker1 # [ 80.050150] systemd[1]: nix-grpc-daemon.socket: Consumed 611us CPU time over 1min 8.251s wall clock time, 256K memory peak, 92K incoming IP traffic, 73.6K outgoing IP traffic.4692lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4693lb: must succeed: curl -sf localhost:9901/clusters4694lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4695lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4696client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24697worker2 # [ 80.184523] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_connected addr=lb:500514698worker2 # [ 80.189836] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4699lb # [ 80.292226] envoy[916]: conn peer=[2001:db8:1::1]:41276 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3725 tx=1918 ms=21694700lb # [ 80.292597] envoy[916]: conn peer=[2001:db8:1::1]:34870 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=634701lb # [ 80.292736] envoy[916]: conn peer=[2001:db8:1::4]:33160 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4968 tx=1454 ms=542404702lb # [ 80.292853] envoy[916]: conn peer=[2001:db8:1::1]:34872 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=244703lb # [ 80.292980] envoy[916]: conn peer=[2001:db8:1::3]:40046 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6642 tx=2047 ms=582674704worker2 # [ 80.383062] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:369624705worker2 # [ 80.401253] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_connected addr=lb:500514706worker2 # [ 80.412173] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4707worker2 # [ 80.424985] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4708worker2 # [ 80.436519] nix-grpc-daemon[1025]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5)4709worker2 # [ 80.459388] nix-grpc-daemon[1025]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 2/5)4710worker2 # [ 80.481937] nix-grpc-daemon[1025]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 246 ms (attempt 3/5)4711worker2 # [ 80.593507] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_connected addr=lb:500514712worker2 # [ 80.598777] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4713worker2 # [ 80.735495] nix-grpc-daemon[1025]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 427 ms (attempt 4/5)4714worker2 # [ 80.799668] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_connected addr=lb:500514715worker2 # [ 80.805134] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4716worker2 # [ 81.005954] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_connected addr=lb:500514717worker2 # [ 81.011225] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4718worker2 # [ 81.170738] nix-grpc-daemon[1025]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4719client # copying 2 paths...4720client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4721worker2 # [ 81.196730] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:369624722client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4723worker2 # [ 81.211904] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_connected addr=lb:500514724worker2 # [ 81.222411] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4725worker2 # [ 81.236279] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4726worker2 # [ 81.253839] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=niks3_push_started pid=10814727worker2 # [ 81.414419] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:500514728worker2 # [ 81.435542] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4729worker2 # [ 81.621000] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:500514730worker2 # [ 81.640276] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4731worker2 # [ 81.655005] nix-daemon[833]: accepted connection from pid 1094, user nix-grpc-daemon (trusted)4732worker2 # [ 81.673656] nix-daemon[833]: reaped child process 1097, status = succeeded4733lb # [ 81.691584] niks3-server[998]: 2026/09/20 10:52:12 INFO Received uploads request method=POST path=/api/pending_closures4734lb # [ 81.701461] niks3-server[998]: 2026/09/20 10:52:12 INFO Received uploads request method=POST path=/api/pending_closures4735worker2 # [ 81.707825] nix-grpc-daemon[1081]: time=2026-09-20T10:52:12.312Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4736worker2 # [ 81.710418] nix-grpc-daemon[1081]: time=2026-09-20T10:52:12.312Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4737worker2 # [ 81.712450] nix-grpc-daemon[1081]: time=2026-09-20T10:52:12.312Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4738lb # [ 81.754937] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4739lb # [ 81.766965] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4740lb # [ 81.778181] niks3-server[998]: 2026/09/20 10:52:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4741worker2 # [ 81.780116] nix-grpc-daemon[1081]: time=2026-09-20T10:52:12.386Z level=INFO msg="Uploading 3 narinfos"4742lb # [ 81.788251] niks3-server[998]: 2026/09/20 10:52:12 INFO Signed narinfos id=25 count=14743lb # [ 81.790399] niks3-server[998]: 2026/09/20 10:52:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4744lb # [ 81.800282] niks3-server[998]: 2026/09/20 10:52:12 INFO Signed narinfos id=26 count=24745lb # [ 81.802229] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4746lb # [ 81.809520] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4747lb # [ 81.824072] niks3-server[998]: 2026/09/20 10:52:12 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4748worker2 # [ 81.824273] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:500514749lb # [ 81.833842] niks3-server[998]: 2026/09/20 10:52:12 INFO Completed upload id=264750lb # [ 81.836738] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4751worker2 # [ 81.829874] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4752lb # [ 81.840706] niks3-server[998]: 2026/09/20 10:52:12 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4753lb # [ 81.843497] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4754worker2 # [ 81.838661] nix-grpc-daemon[1081]: time=2026-09-20T10:52:12.445Z level=INFO msg="Upload complete. (359ms)"4755lb # [ 81.845961] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4756lb # [ 81.848748] niks3-server[998]: 2026/09/20 10:52:12 INFO Completed upload id=254757worker2 # [ 81.848384] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=0 paths=2 nar_bytes_in=3124758worker2 # [ 81.866673] nix-daemon[833]: reaped child process 1079, status = succeeded4759client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.76 seconds)4760worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4761worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4762worker1 # [ 82.024863] systemd[1]: Listening on Nix worker-protocol over gRPC.4763worker1 # [ 82.030173] systemd[1]: Starting Nix worker-protocol over gRPC...4764worker2 # [ 82.030857] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:500514765worker2 # [ 82.036294] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4766worker1 # [ 82.229749] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4767worker1 # [ 82.232335] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14768worker1 # [ 82.240787] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4769worker1 # [ 82.242521] systemd[1]: Started Nix worker-protocol over gRPC.4770worker2 # [ 82.237062] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:500514771lb # [ 82.246413] niks3-server[998]: 2026/09/20 10:52:12 INFO lead: acquired remote=192.168.1.3:343704772worker2 # [ 82.242547] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4773worker1 # [ 82.256503] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=scheduler_take_over4774lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4775lb: must succeed: curl -sf localhost:9901/clusters4776worker1 # [ 82.288840] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:500514777worker1 # [ 82.290723] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4778lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4779worker2 # [ 82.445410] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500514780worker2 # [ 82.449610] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4781worker1 # [ 82.491979] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500514782worker1 # [ 82.497144] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4783worker2 # [ 82.646379] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500514784worker2 # [ 82.651879] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4785worker1 # [ 82.697805] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500514786worker1 # [ 82.703147] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4787worker2 # [ 82.852850] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500514788worker2 # [ 82.858514] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4789worker1 # [ 82.904205] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500514790worker1 # [ 82.909536] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4791worker2 # [ 83.059470] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500514792worker1 # [ 83.074082] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04793worker1 # [ 83.110259] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:500514794worker1 # [ 83.115848] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04795lb: must succeed: curl -sf localhost:9901/clusters4796lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4797lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds)4798(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.19 seconds)4799subtest: scheduler down: the other node takes the lock and keeps it4800lb: must succeed: curl -sf localhost:9901/clusters4801lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4802lb: must succeed: curl -sf localhost:9901/clusters4803lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4804lb: must succeed: curl -sf localhost:9901/clusters4805lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4806lb: must succeed: curl -sf localhost:9901/clusters4807lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4808worker1 # [ 83.705487] systemd[1]: Stopping Nix worker-protocol over gRPC...4809worker1 # [ 84.243175] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=signal_exit4810worker1 # [ 84.254278] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=scheduler_yield4811lb # [ 84.254415] niks3-server[998]: 2026/09/20 10:52:14 INFO lead: released remote=192.168.1.3:343704812worker1 # [ 84.260140] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=scheduler_restarting addr=lb:500514813worker1 # [ 84.265538] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:389864814worker1 # [ 84.270169] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=worker_gone addr=192.168.1.3:500514815worker2 # [ 84.264160] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:14Z level=info event=scheduler_restarting addr=lb:500514816worker1 # [ 84.275231] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:389864817worker1 # [ 84.279810] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=worker_gone addr=192.168.1.4:500514818worker1 # [ 84.460824] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500514819worker1 # [ 84.468137] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4820worker2 # [ 84.464107] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500514821worker2 # [ 84.469530] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4822worker1 # [ 84.675887] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500514823worker2 # [ 84.670810] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500514824worker1 # [ 84.683665] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4825worker2 # [ 84.676405] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4826worker1 # [ 84.884880] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500514827worker2 # [ 84.877423] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500514828worker2 # [ 84.882845] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4829worker1 # [ 84.892549] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4830worker2 # [ 85.083878] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500514831worker1 # [ 85.093505] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500514832worker1 # [ 85.098946] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4833worker2 # [ 85.093444] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4834worker1 # [ 85.263851] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_restarting4835worker2 # [ 85.296416] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:500514836worker2 # [ 85.300659] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4837worker2 # [ 85.497296] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:500514838worker2 # [ 85.503241] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4839worker2 # [ 85.704083] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:500514840worker2 # [ 85.709430] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4841worker2 # [ 85.910592] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:500514842worker2 # [ 85.916222] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4843worker1 # [ 86.013528] nix-grpc-daemon[1241]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4844worker1 # [ 86.013900] nix-grpc-daemon[1241]: E0000 00:00:1789901536.601763 1284 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4845worker1 # [ 86.025678] nix-grpc-daemon[1241]: E0000 00:00:1789901536.614004 1284 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4846worker2 # [ 86.117219] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:500514847worker2 # [ 86.122585] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4848worker1 # [ 86.276712] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4849worker1 # [ 86.279648] systemd[1]: Stopped Nix worker-protocol over gRPC.4850worker1 # [ 86.289674] systemd[1]: nix-grpc-daemon.service: Consumed 216ms CPU time over 4.241s wall clock time, 12.8M memory peak, 8.1K incoming IP traffic, 8.7K outgoing IP traffic.4851worker1 # [ 86.303196] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4852worker1 # [ 86.307308] systemd[1]: Closed Nix worker-protocol over gRPC.4853worker1 # [ 86.310392] systemd[1]: nix-grpc-daemon.socket: Consumed 916us CPU time over 4.288s wall clock time, 256K memory peak, 15.4K incoming IP traffic, 12.2K outgoing IP traffic.4854worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4855worker2 # [ 86.325864] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:500514856worker2 # [ 86.331536] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4857worker2 # [ 86.526334] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_connected addr=lb:500514858worker2 # [ 86.531680] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4859worker2 # [ 86.732512] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_connected addr=lb:500514860worker2 # [ 86.738069] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4861worker2 # [ 86.938915] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_connected addr=lb:500514862worker2 # [ 86.944441] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4863worker2 # [ 87.145369] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_connected addr=lb:500514864worker2 # [ 87.150779] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4865lb # [ 87.334210] niks3-server[998]: 2026/09/20 10:52:17 INFO lead: acquired remote=192.168.1.4:368524866worker2 # [ 87.329446] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_take_over4867worker2 # [ 87.352853] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_connected addr=lb:500514868worker2 # [ 87.374509] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04869worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.17 seconds)4870worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4871worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)4872client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24873worker2 # [ 87.776138] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:369624874client # don't know how to build these paths:4875client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4876worker2 # [ 87.786963] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:369624877worker2 # [ 87.815076] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04878worker2 # [ 87.822930] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=14879worker2 # [ 87.863860] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369624880worker2 # [ 87.880706] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:369624881client # copying 1 paths to 'lb:50051'...4882client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4883worker2 # [ 87.898603] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:369624884worker2 # [ 87.914527] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4885worker2 # [ 88.120635] nix-daemon[833]: accepted connection from pid 1121, user nix-grpc-daemon (trusted)4886worker2 # [ 88.143376] nix-daemon[833]: reaped child process 1124, status = succeeded4887worker2 # [ 88.324326] nix-daemon[833]: accepted connection from pid 1126, user nix-grpc-daemon (trusted)4888worker2 # [ 88.343090] nix-daemon[833]: reaped child process 1129, status = succeeded4889lb # [ 88.361328] niks3-server[998]: 2026/09/20 10:52:18 INFO Received uploads request method=POST path=/api/pending_closures4890worker2 # [ 88.367212] nix-grpc-daemon[1081]: time=2026-09-20T10:52:18.973Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4891worker2 # [ 88.368905] nix-grpc-daemon[1081]: time=2026-09-20T10:52:18.973Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4892lb # [ 88.396904] niks3-server[998]: 2026/09/20 10:52:18 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4893lb # [ 88.414213] niks3-server[998]: 2026/09/20 10:52:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4894lb # [ 88.420616] niks3-server[998]: 2026/09/20 10:52:19 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4895lb # [ 88.440302] niks3-server[998]: 2026/09/20 10:52:19 INFO Signed narinfos id=27 count=14896worker2 # [ 88.436064] nix-grpc-daemon[1081]: time=2026-09-20T10:52:19.042Z level=INFO msg="Uploading 1 narinfos"4897lb # [ 88.455587] niks3-server[998]: 2026/09/20 10:52:19 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4898worker2 # [ 88.457574] nix-grpc-daemon[1081]: time=2026-09-20T10:52:19.064Z level=INFO msg="Upload complete. (523ms)"4899lb # [ 88.464809] niks3-server[998]: 2026/09/20 10:52:19 INFO Completed upload id=274900lb # [ 88.469448] niks3-server[998]: 2026/09/20 10:52:19 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4901worker2 # [ 88.470727] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=0 paths=1 nar_bytes_in=5204902worker2 # [ 88.487273] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369624903worker2 # [ 88.496728] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4904worker2 # [ 88.500943] nix-daemon[833]: reaped child process 1119, status = succeeded4905client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4906client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4907worker2 # [ 88.515671] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4908client # farm-a> LOG-farm-a-on-standby4909worker2 # [ 89.761338] nix-daemon[833]: reaped child process 1133, status = succeeded4910worker2 # [ 89.934726] nix-daemon[833]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4911worker2 # [ 89.953644] nix-daemon[833]: reaped child process 1151, status = succeeded4912lb # [ 89.972970] niks3-server[998]: 2026/09/20 10:52:20 INFO Received uploads request method=POST path=/api/pending_closures4913worker2 # [ 89.977911] nix-grpc-daemon[1081]: time=2026-09-20T10:52:20.584Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4914worker2 # [ 89.981525] nix-grpc-daemon[1081]: time=2026-09-20T10:52:20.586Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4915lb # [ 90.005060] niks3-server[998]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4916lb # [ 90.029334] niks3-server[998]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4917worker2 # [ 90.031984] nix-grpc-daemon[1081]: time=2026-09-20T10:52:20.637Z level=INFO msg="Uploading 1 narinfos"4918lb # [ 90.042027] niks3-server[998]: 2026/09/20 10:52:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4919lb # [ 90.051895] niks3-server[998]: 2026/09/20 10:52:20 INFO Signed narinfos id=28 count=14920lb # [ 90.058804] niks3-server[998]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4921lb # [ 90.062360] niks3-server[998]: 2026/09/20 10:52:20 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4922lb # [ 90.072431] niks3-server[998]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4923lb # [ 90.080079] niks3-server[998]: 2026/09/20 10:52:20 INFO Completed upload id=284924worker2 # [ 90.075236] nix-grpc-daemon[1081]: time=2026-09-20T10:52:20.682Z level=INFO msg="Upload complete. (347ms)"4925worker2 # [ 90.097421] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14926worker2 # [ 90.112261] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04927worker2 # [ 90.118246] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=14928worker2 # [ 90.122054] nix-daemon[833]: reaped child process 1131, status = succeeded4929worker2 # [ 90.144750] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369624930worker2 # [ 90.160600] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:369624931worker2 # [ 90.175610] nix-grpc-daemon[1081]: time=2026-09-20T10:52:20.782Z level=INFO msg="All 1 paths already cached"4932client # copying 1 paths to 'lb:50051'...4933client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4934worker2 # [ 90.185899] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:369624935worker2 # [ 90.199708] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4936lb # [ 90.294212] envoy[916]: conn peer=[2001:db8:1::1]:34886 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=305 ms=14834937lb # [ 90.299321] envoy[916]: conn peer=[2001:db8:1::3]:33992 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1568 tx=536 ms=30264938worker2 # [ 90.409430] nix-daemon[833]: accepted connection from pid 1157, user nix-grpc-daemon (trusted)4939worker2 # [ 90.428707] nix-daemon[833]: reaped child process 1160, status = succeeded4940worker2 # [ 90.613806] nix-daemon[833]: accepted connection from pid 1162, user nix-grpc-daemon (trusted)4941worker2 # [ 90.639516] nix-daemon[833]: reaped child process 1165, status = succeeded4942lb # [ 90.654255] niks3-server[998]: 2026/09/20 10:52:21 INFO Received uploads request method=POST path=/api/pending_closures4943worker2 # [ 90.660990] nix-grpc-daemon[1081]: time=2026-09-20T10:52:21.267Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4944worker2 # [ 90.662554] nix-grpc-daemon[1081]: time=2026-09-20T10:52:21.267Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4945lb # [ 90.688453] niks3-server[998]: 2026/09/20 10:52:21 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4946lb # [ 90.700433] niks3-server[998]: 2026/09/20 10:52:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4947worker2 # [ 90.701524] nix-grpc-daemon[1081]: time=2026-09-20T10:52:21.308Z level=INFO msg="Uploading 1 narinfos"4948lb # [ 90.709305] niks3-server[998]: 2026/09/20 10:52:21 INFO Signed narinfos id=29 count=14949lb # [ 90.719419] niks3-server[998]: 2026/09/20 10:52:21 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4950lb # [ 90.731054] niks3-server[998]: 2026/09/20 10:52:21 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4951lb # [ 90.740637] niks3-server[998]: 2026/09/20 10:52:21 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4952lb # [ 90.745435] niks3-server[998]: 2026/09/20 10:52:21 INFO Completed upload id=294953worker2 # [ 90.740209] nix-grpc-daemon[1081]: time=2026-09-20T10:52:21.347Z level=INFO msg="Upload complete. (523ms)"4954worker2 # [ 90.748796] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=0 paths=1 nar_bytes_in=6404955worker2 # [ 90.760738] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369624956worker2 # [ 90.772805] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4957worker2 # [ 90.778054] nix-daemon[833]: reaped child process 1155, status = succeeded4958client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4959worker2 # [ 90.789970] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4960client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4961client # farm-b> LOG-farm-b-on-standby4962worker2 # [ 91.632513] nix-daemon[833]: reaped child process 1169, status = succeeded4963worker2 # [ 91.801191] nix-daemon[833]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4964worker2 # [ 91.820936] nix-daemon[833]: reaped child process 1187, status = succeeded4965lb # [ 91.840657] niks3-server[998]: 2026/09/20 10:52:22 INFO Received uploads request method=POST path=/api/pending_closures4966worker2 # [ 91.846988] nix-grpc-daemon[1081]: time=2026-09-20T10:52:22.452Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4967worker2 # [ 91.849017] nix-grpc-daemon[1081]: time=2026-09-20T10:52:22.452Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4968lb # [ 91.874082] niks3-server[998]: 2026/09/20 10:52:22 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4969lb # [ 91.891756] niks3-server[998]: 2026/09/20 10:52:22 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4970lb # [ 91.900301] niks3-server[998]: 2026/09/20 10:52:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4971worker2 # [ 91.901058] nix-grpc-daemon[1081]: time=2026-09-20T10:52:22.507Z level=INFO msg="Uploading 1 narinfos"4972lb # [ 91.906350] niks3-server[998]: 2026/09/20 10:52:22 INFO Signed narinfos id=30 count=14973lb # [ 91.911272] niks3-server[998]: 2026/09/20 10:52:22 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4974lb # [ 91.922017] niks3-server[998]: 2026/09/20 10:52:22 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4975lb # [ 91.931202] niks3-server[998]: 2026/09/20 10:52:22 INFO Completed upload id=304976worker2 # [ 91.926294] nix-grpc-daemon[1081]: time=2026-09-20T10:52:22.533Z level=INFO msg="Upload complete. (323ms)"4977lb # [ 91.934332] niks3-server[998]: 2026/09/20 10:52:22 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4978worker2 # [ 91.943698] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14979worker2 # [ 91.960354] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04980worker2 # [ 91.966552] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=14981worker2 # [ 91.970733] nix-daemon[833]: reaped child process 1167, status = succeeded4982worker2 # [ 91.987013] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369624983worker2 # [ 92.002539] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:369624984worker2 # [ 92.016838] nix-grpc-daemon[1081]: time=2026-09-20T10:52:22.623Z level=INFO msg="All 2 paths already cached"4985client # copying 1 paths to 'lb:50051'...4986client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4987worker2 # [ 92.027027] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:369624988worker2 # [ 92.044140] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4989worker2 # [ 92.244107] nix-daemon[833]: accepted connection from pid 1193, user nix-grpc-daemon (trusted)4990worker2 # [ 92.262353] nix-daemon[833]: reaped child process 1196, status = succeeded4991worker2 # [ 92.431880] nix-daemon[833]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)4992worker2 # [ 92.450820] nix-daemon[833]: reaped child process 1201, status = succeeded4993lb # [ 92.467297] niks3-server[998]: 2026/09/20 10:52:23 INFO Received uploads request method=POST path=/api/pending_closures4994worker2 # [ 92.471855] nix-grpc-daemon[1081]: time=2026-09-20T10:52:23.078Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4995worker2 # [ 92.473488] nix-grpc-daemon[1081]: time=2026-09-20T10:52:23.078Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4996lb # [ 92.496562] niks3-server[998]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst4997worker2 # [ 92.502186] nix-grpc-daemon[1081]: time=2026-09-20T10:52:23.108Z level=INFO msg="Uploading 1 narinfos"4998lb # [ 92.510264] niks3-server[998]: 2026/09/20 10:52:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4999lb # [ 92.522708] niks3-server[998]: 2026/09/20 10:52:23 INFO Signed narinfos id=31 count=15000lb # [ 92.526544] niks3-server[998]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5001lb # [ 92.534496] niks3-server[998]: 2026/09/20 10:52:23 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5002worker2 # [ 92.533722] nix-grpc-daemon[1081]: time=2026-09-20T10:52:23.140Z level=INFO msg="Upload complete. (474ms)"5003lb # [ 92.539663] niks3-server[998]: 2026/09/20 10:52:23 INFO Completed upload id=315004lb # [ 92.542775] niks3-server[998]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5005worker2 # [ 92.540137] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=0 paths=1 nar_bytes_in=7685006worker2 # [ 92.551873] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369625007worker2 # [ 92.555350] nix-daemon[833]: reaped child process 1191, status = succeeded5008worker2 # [ 92.562565] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)5009client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5010client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5011worker2 # [ 92.575701] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)5012client # farm-top> LOG-farm-top-on-standby5013worker2 # [ 94.021577] nix-daemon[833]: reaped child process 1205, status = succeeded5014worker2 # [ 94.206158] nix-daemon[833]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5015worker2 # [ 94.224333] nix-daemon[833]: reaped child process 1223, status = succeeded5016lb # [ 94.241541] niks3-server[998]: 2026/09/20 10:52:24 INFO Received uploads request method=POST path=/api/pending_closures5017worker2 # [ 94.250308] nix-grpc-daemon[1081]: time=2026-09-20T10:52:24.855Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5018worker2 # [ 94.251820] nix-grpc-daemon[1081]: time=2026-09-20T10:52:24.855Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5019lb # [ 94.277196] niks3-server[998]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5020lb # [ 94.294907] niks3-server[998]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5021worker2 # [ 94.303730] nix-grpc-daemon[1081]: time=2026-09-20T10:52:24.910Z level=INFO msg="Uploading 1 narinfos"5022lb # [ 94.303063] niks3-server[998]: 2026/09/20 10:52:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5023lb # [ 94.312699] niks3-server[998]: 2026/09/20 10:52:24 INFO Signed narinfos id=32 count=15024lb # [ 94.314991] niks3-server[998]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5025lb # [ 94.325193] niks3-server[998]: 2026/09/20 10:52:24 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5026lb # [ 94.331820] niks3-server[998]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5027lb # [ 94.336720] niks3-server[998]: 2026/09/20 10:52:24 INFO Completed upload id=325028worker2 # [ 94.331552] nix-grpc-daemon[1081]: time=2026-09-20T10:52:24.938Z level=INFO msg="Upload complete. (342ms)"5029worker2 # [ 94.345163] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15030worker2 # [ 94.361521] nix-daemon[833]: reaped child process 1203, status = succeeded5031client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.86 seconds)5032client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5033client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds)5034worker1 # [ 94.718551] systemd[1]: Listening on Nix worker-protocol over gRPC.5035worker1 # [ 94.728493] systemd[1]: Starting Nix worker-protocol over gRPC...5036worker1 # [ 94.931600] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5037worker1 # [ 94.934086] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15038worker1 # [ 94.941092] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5039worker1 # [ 94.949443] systemd[1]: Started Nix worker-protocol over gRPC.5040lb: must succeed: curl -sf localhost:9901/clusters5041worker1 # [ 94.984956] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:25Z level=info event=scheduler_connected addr=lb:500515042worker2 # [ 94.977969] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05043lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5044worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5045worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5046lb: must succeed: curl -sf localhost:9901/clusters5047lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5048lb: must succeed: curl -sf localhost:9901/clusters5049lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5050worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5051worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)5052(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 11.92 seconds)5053subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5054client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5055client # [ 95.510525] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5056client # Running as unit: rs.service; invocation ID: a29f27c9c86c4648ae0b83f1ac16cefa5057client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5058worker1 # [ 95.670891] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:448625059worker1 # [ 95.685752] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5060client # [ 95.787892] nix[1164]: don't know how to build these paths:5061client # [ 95.789198] nix[1164]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5062worker2 # [ 95.709470] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05063worker2 # [ 95.714851] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=15064worker2 # [ 95.755704] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369625065worker2 # [ 95.771078] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:369625066client # [ 95.876862] nix[1164]: copying 1 paths to 'lb:50051'...5067client # [ 95.881431] nix[1164]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5068worker2 # [ 95.788669] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:369625069worker2 # [ 95.804219] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)5070worker2 # [ 96.007550] nix-daemon[833]: accepted connection from pid 1236, user nix-grpc-daemon (trusted)5071worker2 # [ 96.026846] nix-daemon[833]: reaped child process 1239, status = succeeded5072worker2 # [ 96.200063] nix-daemon[833]: accepted connection from pid 1241, user nix-grpc-daemon (trusted)5073worker2 # [ 96.216886] nix-daemon[833]: reaped child process 1244, status = succeeded5074lb # [ 96.234566] niks3-server[998]: 2026/09/20 10:52:26 INFO Received uploads request method=POST path=/api/pending_closures5075worker2 # [ 96.239578] nix-grpc-daemon[1081]: time=2026-09-20T10:52:26.845Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5076worker2 # [ 96.241172] nix-grpc-daemon[1081]: time=2026-09-20T10:52:26.845Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5077lb # [ 96.262981] niks3-server[998]: 2026/09/20 10:52:26 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5078lb # [ 96.277395] niks3-server[998]: 2026/09/20 10:52:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5079worker2 # [ 96.277865] nix-grpc-daemon[1081]: time=2026-09-20T10:52:26.884Z level=INFO msg="Uploading 1 narinfos"5080lb # [ 96.289342] niks3-server[998]: 2026/09/20 10:52:26 INFO Signed narinfos id=33 count=15081lb # [ 96.295030] niks3-server[998]: 2026/09/20 10:52:26 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5082lb # [ 96.305471] niks3-server[998]: 2026/09/20 10:52:26 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5083lb # [ 96.309769] niks3-server[998]: 2026/09/20 10:52:26 INFO Completed upload id=335084worker2 # [ 96.304705] nix-grpc-daemon[1081]: time=2026-09-20T10:52:26.911Z level=INFO msg="Upload complete. (483ms)"5085lb # [ 96.312230] niks3-server[998]: 2026/09/20 10:52:26 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5086worker2 # [ 96.312272] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=0 paths=1 nar_bytes_in=4165087worker2 # [ 96.324446] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:369625088worker2 # [ 96.333578] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)5089worker2 # [ 96.337057] nix-daemon[833]: reaped child process 1234, status = succeeded5090client # [ 96.438902] nix[1164]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5091worker2 # [ 96.348260] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)5092lb: must succeed: curl -sf localhost:9901/clusters5093lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5094lb: must succeed: curl -sf localhost:9901/clusters5095lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5096lb: must succeed: curl -sf localhost:9901/clusters5097lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5098lb: must succeed: curl -sf localhost:9901/clusters5099lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5100worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5101worker1 # [ 98.399495] systemd-journald[275]: Received client request to rotate journal, rotating.5102worker1 # [ 98.426630] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/23e09f1877c049239a23bc64cf61eab9.5103worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5104worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5105worker2 # [ 98.474611] systemd[1]: Stopping Nix worker-protocol over gRPC...5106worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5107??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5108 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735109client: must succeed: sleep 5.05110worker2 # [ 99.332912] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:29Z level=info event=draining5111lb # [ 100.297118] envoy[916]: conn peer=[2001:db8:1::1]:60752 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=3889 ms=65785112client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5113worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5114worker2 # [ 103.987506] nix-daemon[833]: reaped child process 1248, status = succeeded5115worker2 # [ 104.167341] nix-daemon[833]: accepted connection from pid 1288, user nix-grpc-daemon (trusted)5116worker2 # [ 104.185321] nix-daemon[833]: reaped child process 1291, status = succeeded5117lb # [ 104.207466] niks3-server[998]: 2026/09/20 10:52:34 INFO Received uploads request method=POST path=/api/pending_closures5118worker2 # [ 104.236544] nix-grpc-daemon[1081]: time=2026-09-20T10:52:34.841Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5119worker2 # [ 104.238325] nix-grpc-daemon[1081]: time=2026-09-20T10:52:34.841Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5120lb # [ 104.306204] niks3-server[998]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5121lb # [ 104.316475] niks3-server[998]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5122lb # [ 104.329359] niks3-server[998]: 2026/09/20 10:52:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5123worker2 # [ 104.325897] nix-grpc-daemon[1081]: time=2026-09-20T10:52:34.931Z level=INFO msg="Uploading 1 narinfos"5124lb # [ 104.339448] niks3-server[998]: 2026/09/20 10:52:34 INFO Signed narinfos id=34 count=15125lb # [ 104.346274] niks3-server[998]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5126lb # [ 104.356862] niks3-server[998]: 2026/09/20 10:52:34 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5127lb # [ 104.371840] niks3-server[998]: 2026/09/20 10:52:34 INFO Completed upload id=345128worker2 # [ 104.369252] nix-grpc-daemon[1081]: time=2026-09-20T10:52:34.976Z level=INFO msg="Upload complete. (406ms)"5129lb # [ 104.376480] niks3-server[998]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5130worker2 # [ 104.390409] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15131worker2 # [ 104.414690] nix-daemon[833]: reaped child process 1246, status = succeeded5132client # [ 104.531953] systemd[1]: rs.service: Deactivated successfully.5133client # [ 104.536666] systemd[1]: rs.service: Consumed 161ms CPU time over 9.025s wall clock time, 38.9M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5134worker2 # [ 105.334886] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:35Z level=info event=signal_exit5135worker2 # [ 105.558721] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_yield5136lb # [ 105.567266] niks3-server[998]: 2026/09/20 10:52:36 INFO lead: released remote=192.168.1.4:368525137worker1 # [ 105.575130] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_restarting addr=lb:500515138worker2 # [ 105.566362] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:359845139worker2 # [ 105.573913] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=worker_gone addr=192.168.1.3:500515140worker2 # [ 105.578329] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_restarting addr=lb:500515141worker2 # [ 105.582803] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:359845142worker2 # [ 105.588412] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=worker_gone addr=192.168.1.4:500515143worker1 # [ 105.774588] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:500515144worker2 # [ 105.768184] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:500515145worker1 # [ 105.781851] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5146worker2 # [ 105.773639] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5147worker2 # [ 105.974747] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:500515148worker1 # [ 105.983582] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:500515149worker2 # [ 105.980535] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5150worker1 # [ 105.991113] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5151worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.26 seconds)5152client: waiting for success: ! systemctl is-active rs5153worker2 # [ 106.182299] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:500515154worker1 # [ 106.191898] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:500515155worker2 # [ 106.188181] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5156worker1 # [ 106.197635] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5157client: (finished: waiting for success: ! systemctl is-active rs, in 0.09 seconds)5158client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5159client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5160client: must fail: journalctl -u rs | grep -q 'reconnecting'5161client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5162lb: must succeed: curl -sf localhost:9901/clusters5163worker1 # [ 106.398392] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:500515164worker2 # [ 106.389714] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:500515165worker1 # [ 106.404283] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5166worker2 # [ 106.398455] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5167lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)5168worker2 # [ 106.566813] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:37Z level=info event=scheduler_restarting5169worker1 # [ 106.607650] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_connected addr=lb:500515170worker1 # [ 106.612429] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5171worker2 # [ 106.630778] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:37Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5172worker2 # [ 106.654306] nix-daemon[833]: reaped child process 1074, status = succeeded5173worker1 # [ 106.808534] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_connected addr=lb:500515174worker1 # [ 106.814079] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5175worker1 # [ 107.014880] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_connected addr=lb:500515176worker1 # [ 107.020391] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5177worker2 # [ 107.180426] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5178worker2 # [ 107.183475] systemd[1]: Stopped Nix worker-protocol over gRPC.5179worker2 # [ 107.193854] systemd[1]: nix-grpc-daemon.service: Consumed 2.074s CPU time over 30.096s wall clock time, 36.6M memory peak, 60.3K incoming IP traffic, 114K outgoing IP traffic.5180worker2 # [ 107.207617] systemd[1]: Starting Nix worker-protocol over gRPC...5181worker1 # [ 107.221628] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_connected addr=lb:500515182worker1 # [ 107.226861] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5183worker2 # [ 107.409917] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5184worker2 # [ 107.413482] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15185worker1 # [ 107.427494] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:500515186worker2 # [ 107.423357] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5187worker1 # [ 107.432720] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5188worker2 # [ 107.434082] systemd[1]: Started Nix worker-protocol over gRPC.5189lb: must succeed: curl -sf localhost:9901/clusters5190worker2 # [ 107.440143] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=scheduler_take_over5191lb # [ 107.446536] niks3-server[998]: 2026/09/20 10:52:38 INFO lead: acquired remote=192.168.1.4:432805192worker2 # [ 107.474158] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:500515193worker2 # [ 107.481066] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05194lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5195worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5196worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5197worker1 # [ 107.634812] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:500515198worker2 # [ 107.626674] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05199lb: must succeed: curl -sf localhost:9901/clusters5200lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5201worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5202worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5203(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.41 seconds)5204subtest: scheduler restart mid-build: build finishes, no double build5205client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5206client # [ 108.921737] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5207client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5208worker2 # [ 109.091294] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:398425209worker2 # [ 109.103108] nix-daemon[833]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5210client # Running as unit: mid.service; invocation ID: b95d14811de743e7a91b76ad07a48b0a5211client # [ 109.215902] nix[1199]: don't know how to build these paths:5212client # [ 109.218387] nix[1199]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5213worker2 # [ 109.139341] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:39Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05214worker2 # [ 109.146405] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:39Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15215worker2 # [ 109.191265] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398425216worker2 # [ 109.212763] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 1/5)5217worker2 # [ 109.266378] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 2/5)5218worker2 # [ 109.296942] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 3/5)5219worker2 # [ 109.388505] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 4/5)5220worker2 # [ 109.398366] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5221worker2 # [ 109.422139] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398425222client # [ 109.528247] nix[1199]: copying 1 paths to 'lb:50051'...5223worker2 # [ 109.439890] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398425224client # [ 109.535767] nix[1199]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5225worker2 # [ 109.455831] nix-daemon[833]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5226worker2 # [ 109.491589] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:40Z level=info event=niks3_push_started pid=13665227worker2 # [ 109.877031] nix-daemon[833]: accepted connection from pid 1379, user nix-grpc-daemon (trusted)5228worker2 # [ 109.896534] nix-daemon[833]: reaped child process 1382, status = succeeded5229worker2 # [ 110.068212] nix-daemon[833]: accepted connection from pid 1384, user nix-grpc-daemon (trusted)5230worker2 # [ 110.087601] nix-daemon[833]: reaped child process 1387, status = succeeded5231lb # [ 110.104872] niks3-server[998]: 2026/09/20 10:52:40 INFO Received uploads request method=POST path=/api/pending_closures5232worker2 # [ 110.111221] nix-grpc-daemon[1366]: time=2026-09-20T10:52:40.717Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5233worker2 # [ 110.115183] nix-grpc-daemon[1366]: time=2026-09-20T10:52:40.719Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5234lb # [ 110.144543] niks3-server[998]: 2026/09/20 10:52:40 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5235worker2 # [ 110.157174] nix-grpc-daemon[1366]: time=2026-09-20T10:52:40.763Z level=INFO msg="Uploading 1 narinfos"5236lb # [ 110.161722] niks3-server[998]: 2026/09/20 10:52:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5237lb # [ 110.175923] niks3-server[998]: 2026/09/20 10:52:40 INFO Signed narinfos id=35 count=15238lb # [ 110.179210] niks3-server[998]: 2026/09/20 10:52:40 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5239lb # [ 110.191364] niks3-server[998]: 2026/09/20 10:52:40 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5240worker2 # [ 110.192538] nix-grpc-daemon[1366]: time=2026-09-20T10:52:40.799Z level=INFO msg="Upload complete. (485ms)"5241lb # [ 110.198809] niks3-server[998]: 2026/09/20 10:52:40 INFO Completed upload id=355242worker2 # [ 110.203311] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39842 duration_s=0 paths=1 nar_bytes_in=4245243worker2 # [ 110.206742] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398425244worker2 # [ 110.209443] nix-grpc-daemon[1366]: time=2026-09-20T10:52:40.816Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n"5245worker2 # [ 110.213152] nix-daemon[833]: reaped child process 1364, status = succeeded5246worker2 # [ 110.216882] nix-daemon[833]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5247worker2 # [ 110.228584] nix-daemon[833]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5248client # [ 110.321009] nix[1199]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5249lb # [ 110.294859] envoy[916]: conn peer=[2001:db8:1::1]:57456 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1328 ms=87465250lb # [ 110.300139] envoy[916]: conn peer=[2001:db8:1::4]:46368 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7096 tx=2101 ms=292545251lb: must succeed: curl -sf localhost:9901/clusters5252lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5253lb: must succeed: curl -sf localhost:9901/clusters5254lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5255worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5256worker2 # [ 112.800689] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1298 (nix-grpc-daemon) on client request.5257worker2 # [ 112.802302] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5258lb # [ 112.829132] niks3-server[998]: 2026/09/20 10:52:43 INFO lead: released remote=192.168.1.4:432805259worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5260client # [ 112.926481] nix[1199]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5261client: must succeed: sleep 5.05262worker1 # [ 112.841979] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5263client # [ 112.932878] nix[1199]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5264worker2 # [ 112.851057] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5265worker2 # [ 112.860354] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5266worker2 # [ 112.861720] systemd[1]: nix-grpc-daemon.service: Consumed 518ms CPU time over 5.641s wall clock time, 33.8M memory peak, 12.2K incoming IP traffic, 16.2K outgoing IP traffic.5267worker2 # [ 112.869532] nix-daemon[833]: reaped child process 1393, status = succeeded5268worker2 # [ 112.871300] nix-daemon[833]: reaped child process 1357, status = succeeded5269worker2 # [ 112.880613] nix-daemon[1395]: unexpected Nix daemon error: error: interrupted by the user5270worker2 # [ 112.886088] nix-daemon[833]: reaped child process 1395, status = failed with exit code 15271worker1 # [ 113.041924] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500515272worker2 # [ 113.036589] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5273worker2 # [ 113.045609] systemd[1]: Starting Nix worker-protocol over gRPC...5274worker2 # [ 113.251296] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5275worker2 # [ 113.253801] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15276worker2 # [ 113.261144] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5277worker2 # [ 113.262897] systemd[1]: Started Nix worker-protocol over gRPC.5278worker2 # [ 113.275540] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=scheduler_take_over5279lb # [ 113.280733] niks3-server[998]: 2026/09/20 10:52:43 INFO lead: acquired remote=192.168.1.4:525305280worker2 # [ 113.290975] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05281worker2 # [ 113.305009] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500515282worker2 # [ 113.306923] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05283worker2 # [ 113.342119] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05284worker2 # [ 113.344953] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15285worker1 # [ 113.397639] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448625286worker1 # [ 113.420669] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 1/5)5287worker1 # [ 113.484375] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 2/5)5288worker1 # [ 113.508571] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 258 ms (attempt 3/5)5289worker1 # [ 113.774085] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 650 ms (attempt 4/5)5290worker1 # [ 114.433956] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5291worker1 # [ 114.455915] nix-grpc-daemon[1305]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5292worker1 # [ 114.494100] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5293worker1 # [ 114.516173] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5294client # [ 114.599678] nix[1199]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5295client: (finished: must succeed: sleep 5.0, in 5.07 seconds)5296client: waiting for success: ! systemctl is-active mid5297worker1 # [ 118.341979] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:48Z level=info event=niks3_push_started pid=14565298worker1 # [ 118.399344] nix-daemon[833]: reaped child process 1432, status = succeeded5299worker1 # [ 118.755489] nix-daemon[833]: accepted connection from pid 1469, user nix-grpc-daemon (trusted)5300worker1 # [ 118.773881] nix-daemon[833]: reaped child process 1472, status = succeeded5301lb # [ 118.785817] niks3-server[998]: 2026/09/20 10:52:49 INFO Received uploads request method=POST path=/api/pending_closures5302worker1 # [ 118.800465] nix-grpc-daemon[1456]: time=2026-09-20T10:52:49.387Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5303worker1 # [ 118.801984] nix-grpc-daemon[1456]: time=2026-09-20T10:52:49.387Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5304lb # [ 118.844704] niks3-server[998]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5305lb # [ 118.859607] niks3-server[998]: 2026/09/20 10:52:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5306worker1 # [ 118.865254] nix-grpc-daemon[1456]: time=2026-09-20T10:52:49.452Z level=INFO msg="Uploading 1 narinfos"5307lb # [ 118.870297] niks3-server[998]: 2026/09/20 10:52:49 INFO Signed narinfos id=36 count=15308lb # [ 118.877837] niks3-server[998]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5309lb # [ 118.889973] niks3-server[998]: 2026/09/20 10:52:49 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5310lb # [ 118.902451] niks3-server[998]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5311lb # [ 118.911485] niks3-server[998]: 2026/09/20 10:52:49 INFO Completed upload id=365312worker1 # [ 118.914914] nix-grpc-daemon[1456]: time=2026-09-20T10:52:49.503Z level=INFO msg="Upload complete. (329ms)"5313worker1 # [ 118.928333] nix-grpc-daemon[1456]: time=2026-09-20T10:52:49.508Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5314worker1 # [ 118.944584] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44862 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15315worker1 # [ 118.952270] nix-daemon[833]: reaped child process 1430, status = succeeded5316client # [ 119.055782] systemd[1]: mid.service: Deactivated successfully.5317client # [ 119.060264] systemd[1]: mid.service: Consumed 193ms CPU time over 10.138s wall clock time, 38.9M memory peak, 9.6K incoming IP traffic, 10.8K outgoing IP traffic.5318client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5319client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5320client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5321(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.66 seconds)5322subtest: interrupting the client stops the build on the worker5323client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5324client # [ 119.550717] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5325client # Running as unit: intr.service; invocation ID: 455aae791f6b499a8a612d8be0cd2f4e5326client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5327worker1 # [ 119.688746] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:448625328client # [ 119.780708] nix[1234]: don't know how to build these paths:5329client # [ 119.782331] nix[1234]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5330worker2 # [ 119.703708] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:50Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05331worker2 # [ 119.709095] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:50Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15332worker2 # [ 119.754095] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346185333worker2 # [ 119.769047] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5334worker2 # [ 119.791975] nix-grpc-daemon[1431]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 1/5)5335worker2 # [ 119.852440] nix-grpc-daemon[1431]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 2/5)5336worker2 # [ 119.916909] nix-grpc-daemon[1431]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 383 ms (attempt 3/5)5337lb # [ 120.297986] envoy[916]: conn peer=[2001:db8:1::4]:42154 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=470 tx=226 ms=53705338lb # [ 120.303032] envoy[916]: conn peer=[2001:db8:1::1]:57220 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3884 tx=1677 ms=98515339worker2 # [ 120.307480] nix-grpc-daemon[1431]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 4/5)5340worker2 # [ 120.325591] nix-grpc-daemon[1431]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5341worker2 # [ 120.347991] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346185342client # [ 120.455589] nix[1234]: copying 1 paths to 'lb:50051'...5343client # [ 120.462161] nix[1234]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5344worker2 # [ 120.368102] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346185345worker2 # [ 120.382726] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5346worker2 # [ 120.411063] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:51Z level=info event=niks3_push_started pid=15035347worker2 # [ 120.832280] nix-daemon[833]: accepted connection from pid 1516, user nix-grpc-daemon (trusted)5348worker2 # [ 120.853125] nix-daemon[833]: reaped child process 1523, status = succeeded5349worker2 # [ 121.033561] nix-daemon[833]: accepted connection from pid 1525, user nix-grpc-daemon (trusted)5350worker2 # [ 121.052000] nix-daemon[833]: reaped child process 1528, status = succeeded5351lb # [ 121.069217] niks3-server[998]: 2026/09/20 10:52:51 INFO Received uploads request method=POST path=/api/pending_closures5352worker2 # [ 121.079831] nix-grpc-daemon[1503]: time=2026-09-20T10:52:51.684Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5353worker2 # [ 121.081660] nix-grpc-daemon[1503]: time=2026-09-20T10:52:51.685Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5354lb # [ 121.122386] niks3-server[998]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5355worker2 # [ 121.127415] nix-grpc-daemon[1503]: time=2026-09-20T10:52:51.733Z level=INFO msg="Uploading 1 narinfos"5356lb # [ 121.134968] niks3-server[998]: 2026/09/20 10:52:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5357lb # [ 121.146735] niks3-server[998]: 2026/09/20 10:52:51 INFO Signed narinfos id=37 count=15358lb # [ 121.152295] niks3-server[998]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5359lb # [ 121.162892] niks3-server[998]: 2026/09/20 10:52:51 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5360lb # [ 121.167715] niks3-server[998]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5361lb # [ 121.174703] niks3-server[998]: 2026/09/20 10:52:51 INFO Completed upload id=375362worker2 # [ 121.169971] nix-grpc-daemon[1503]: time=2026-09-20T10:52:51.776Z level=INFO msg="Upload complete. (529ms)"5363worker2 # [ 121.183046] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=4245364worker2 # [ 121.200102] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346185365worker2 # [ 121.207637] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5366worker2 # [ 121.214322] nix-daemon[833]: reaped child process 1501, status = succeeded5367client # [ 121.319962] nix[1234]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5368worker2 # [ 121.230337] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5369client: must succeed: systemctl kill -s INT intr5370client # [ 123.246282] systemd[1]: intr.service: Sent signal SIGINT to main process 1234 (nix) on client request.5371client # [ 123.254740] nix[1234]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5372client # [ 123.264092] nix[1234]: error: interrupted by the user5373client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5374client # [ 123.296262] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5375client # [ 123.300946] systemd[1]: intr.service: Failed with result 'exit-code'.5376client # [ 123.303024] systemd[1]: intr.service: Consumed 143ms CPU time over 3.748s wall clock time, 39.2M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5377worker2 # [ 123.260734] nix-daemon[1532]: unexpected Nix daemon error: error: interrupted by the user5378worker2 # [ 123.272995] nix-daemon[833]: reaped child process 1530, status = succeeded5379worker2 # [ 123.277657] nix-daemon[833]: reaped child process 1532, status = failed with exit code 15380(finished: subtest: interrupting the client stops the build on the worker, in 3.90 seconds)5381subtest: a deploy mid-build drains: the build finishes, the new generation takes over5382client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5383client # [ 123.474841] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5384client # Running as unit: sw.service; invocation ID: c1d09e632463494eb6629ff747b071785385client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5386worker1 # [ 123.630814] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:448625387client # [ 123.722971] nix[1253]: don't know how to build these paths:5388client # [ 123.723959] nix[1253]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5389worker2 # [ 123.640626] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:54Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05390worker2 # [ 123.646994] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:54Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15391worker1 # [ 123.658716] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448625392worker1 # [ 123.674829] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:448625393client # [ 123.772165] nix[1253]: copying 1 paths to 'lb:50051'...5394client # [ 123.774659] nix[1253]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5395worker1 # [ 123.689552] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:448625396worker1 # [ 123.704923] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5397worker1 # [ 123.914465] nix-daemon[833]: accepted connection from pid 1500, user nix-grpc-daemon (trusted)5398worker1 # [ 123.934366] nix-daemon[833]: reaped child process 1503, status = succeeded5399worker1 # [ 124.112981] nix-daemon[833]: accepted connection from pid 1505, user nix-grpc-daemon (trusted)5400worker1 # [ 124.131716] nix-daemon[833]: reaped child process 1508, status = succeeded5401lb # [ 124.139710] niks3-server[998]: 2026/09/20 10:52:54 INFO Received uploads request method=POST path=/api/pending_closures5402worker1 # [ 124.155645] nix-grpc-daemon[1456]: time=2026-09-20T10:52:54.743Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5403worker1 # [ 124.157297] nix-grpc-daemon[1456]: time=2026-09-20T10:52:54.743Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5404lb # [ 124.178079] niks3-server[998]: 2026/09/20 10:52:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5405worker1 # [ 124.189785] nix-grpc-daemon[1456]: time=2026-09-20T10:52:54.777Z level=INFO msg="Uploading 1 narinfos"5406lb # [ 124.190876] niks3-server[998]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5407worker1 # [ 124.212037] nix-grpc-daemon[1456]: time=2026-09-20T10:52:54.800Z level=INFO msg="Upload complete. (490ms)"5408lb # [ 124.208298] niks3-server[998]: 2026/09/20 10:52:54 INFO Signed narinfos id=38 count=15409lb # [ 124.210907] niks3-server[998]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5410lb # [ 124.215885] niks3-server[998]: 2026/09/20 10:52:54 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5411worker1 # [ 124.219833] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44862 duration_s=0 paths=1 nar_bytes_in=4165412lb # [ 124.220926] niks3-server[998]: 2026/09/20 10:52:54 INFO Completed upload id=385413lb # [ 124.224429] niks3-server[998]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5414worker1 # [ 124.232114] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:448625415worker1 # [ 124.238470] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5416worker1 # [ 124.242801] nix-daemon[833]: reaped child process 1498, status = succeeded5417worker1 # [ 124.253274] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5418client # [ 124.336553] nix[1253]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5419worker1: must succeed: systemctl reload nix-grpc-daemon.service5420worker1 # [ 126.105733] systemd[1]: Reloading Nix worker-protocol over gRPC...5421worker1 # [ 126.160197] systemd[1]: Reloaded Nix worker-protocol over gRPC.5422worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5423worker1: must succeed: pgrep -f 'read -t [9]0 x'5424worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5425client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25426client # don't know how to build these paths:5427client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5428worker2 # [ 126.467336] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346185429worker2 # [ 126.474868] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346185430worker2 # [ 126.501440] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05431worker2 # [ 126.508385] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15432worker2 # [ 126.552939] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346185433worker2 # [ 126.568580] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346185434client # copying 1 paths to 'lb:50051'...5435worker2 # [ 126.584385] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346185436client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5437worker2 # [ 126.609207] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5438worker2 # [ 126.811832] nix-daemon[833]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)5439worker2 # [ 126.831357] nix-daemon[833]: reaped child process 1585, status = succeeded5440worker1 # [ 126.959759] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:57Z level=info event=draining5441worker2 # [ 127.005361] nix-daemon[833]: accepted connection from pid 1587, user nix-grpc-daemon (trusted)5442worker2 # [ 127.025064] nix-daemon[833]: reaped child process 1590, status = succeeded5443lb # [ 127.042018] niks3-server[998]: 2026/09/20 10:52:57 INFO Received uploads request method=POST path=/api/pending_closures5444worker2 # [ 127.047063] nix-grpc-daemon[1503]: time=2026-09-20T10:52:57.653Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5445worker2 # [ 127.048653] nix-grpc-daemon[1503]: time=2026-09-20T10:52:57.653Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5446lb # [ 127.075444] niks3-server[998]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5447worker2 # [ 127.088298] nix-grpc-daemon[1503]: time=2026-09-20T10:52:57.694Z level=INFO msg="Uploading 1 narinfos"5448lb # [ 127.093075] niks3-server[998]: 2026/09/20 10:52:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5449lb # [ 127.104198] niks3-server[998]: 2026/09/20 10:52:57 INFO Signed narinfos id=39 count=15450lb # [ 127.110336] niks3-server[998]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5451lb # [ 127.119139] niks3-server[998]: 2026/09/20 10:52:57 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5452worker2 # [ 127.119987] nix-grpc-daemon[1503]: time=2026-09-20T10:52:57.726Z level=INFO msg="Upload complete. (493ms)"5453lb # [ 127.126982] niks3-server[998]: 2026/09/20 10:52:57 INFO Completed upload id=395454lb # [ 127.130944] niks3-server[998]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5455worker2 # [ 127.128327] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=5285456worker2 # [ 127.144315] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346185457worker2 # [ 127.150724] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5458worker2 # [ 127.155821] nix-daemon[833]: reaped child process 1580, status = succeeded5459client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5460worker2 # [ 127.168246] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5461client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5462worker2 # [ 127.789025] nix-daemon[833]: reaped child process 1594, status = succeeded5463client # farm-a> LOG-farm-a-during-drain5464worker2 # [ 127.955344] nix-daemon[833]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5465worker2 # [ 127.975895] nix-daemon[833]: reaped child process 1612, status = succeeded5466lb # [ 127.992676] niks3-server[998]: 2026/09/20 10:52:58 INFO Received uploads request method=POST path=/api/pending_closures5467worker2 # [ 128.002991] nix-grpc-daemon[1503]: time=2026-09-20T10:52:58.606Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5468worker2 # [ 128.005367] nix-grpc-daemon[1503]: time=2026-09-20T10:52:58.607Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5469lb # [ 128.033864] niks3-server[998]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5470lb # [ 128.041546] niks3-server[998]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5471lb # [ 128.050479] niks3-server[998]: 2026/09/20 10:52:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5472lb # [ 128.055239] niks3-server[998]: 2026/09/20 10:52:58 INFO Signed narinfos id=40 count=15473worker2 # [ 128.051192] nix-grpc-daemon[1503]: time=2026-09-20T10:52:58.656Z level=INFO msg="Uploading 1 narinfos"5474lb # [ 128.058669] niks3-server[998]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5475lb # [ 128.068054] niks3-server[998]: 2026/09/20 10:52:58 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5476lb # [ 128.072769] niks3-server[998]: 2026/09/20 10:52:58 INFO Completed upload id=405477worker2 # [ 128.067760] nix-grpc-daemon[1503]: time=2026-09-20T10:52:58.674Z level=INFO msg="Upload complete. (287ms)"5478lb # [ 128.074755] niks3-server[998]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5479worker2 # [ 128.080484] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15480worker2 # [ 128.092343] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05481worker2 # [ 128.095035] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15482worker2 # [ 128.098315] nix-daemon[833]: reaped child process 1592, status = succeeded5483worker2 # [ 128.133184] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346185484worker2 # [ 128.148132] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346185485worker2 # [ 128.162747] nix-grpc-daemon[1503]: time=2026-09-20T10:52:58.769Z level=INFO msg="All 1 paths already cached"5486client # copying 1 paths to 'lb:50051'...5487worker2 # [ 128.173110] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346185488client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5489worker2 # [ 128.196181] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5490worker2 # [ 128.401720] nix-daemon[833]: accepted connection from pid 1618, user nix-grpc-daemon (trusted)5491worker2 # [ 128.419583] nix-daemon[833]: reaped child process 1621, status = succeeded5492worker2 # [ 128.596155] nix-daemon[833]: accepted connection from pid 1623, user nix-grpc-daemon (trusted)5493worker2 # [ 128.619404] nix-daemon[833]: reaped child process 1626, status = succeeded5494lb # [ 128.633846] niks3-server[998]: 2026/09/20 10:52:59 INFO Received uploads request method=POST path=/api/pending_closures5495worker2 # [ 128.642102] nix-grpc-daemon[1503]: time=2026-09-20T10:52:59.248Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5496worker2 # [ 128.643622] nix-grpc-daemon[1503]: time=2026-09-20T10:52:59.248Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5497lb # [ 128.666836] niks3-server[998]: 2026/09/20 10:52:59 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5498worker2 # [ 128.675231] nix-grpc-daemon[1503]: time=2026-09-20T10:52:59.281Z level=INFO msg="Uploading 1 narinfos"5499lb # [ 128.682619] niks3-server[998]: 2026/09/20 10:52:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5500lb # [ 128.693754] niks3-server[998]: 2026/09/20 10:52:59 INFO Signed narinfos id=41 count=15501lb # [ 128.702953] niks3-server[998]: 2026/09/20 10:52:59 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5502worker2 # [ 128.702939] nix-grpc-daemon[1503]: time=2026-09-20T10:52:59.309Z level=INFO msg="Upload complete. (488ms)"5503lb # [ 128.708612] niks3-server[998]: 2026/09/20 10:52:59 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5504lb # [ 128.713510] niks3-server[998]: 2026/09/20 10:52:59 INFO Completed upload id=415505lb # [ 128.716668] niks3-server[998]: 2026/09/20 10:52:59 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5506worker2 # [ 128.712270] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=6405507worker2 # [ 128.722981] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346185508worker2 # [ 128.729604] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5509worker2 # [ 128.734880] nix-daemon[833]: reaped child process 1616, status = succeeded5510client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5511client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5512worker2 # [ 128.749337] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5513worker2 # [ 129.772149] nix-daemon[833]: reaped child process 1630, status = succeeded5514client # farm-b> LOG-farm-b-during-drain5515worker2 # [ 129.929828] nix-daemon[833]: accepted connection from pid 1645, user nix-grpc-daemon (trusted)5516worker2 # [ 129.949144] nix-daemon[833]: reaped child process 1648, status = succeeded5517lb # [ 129.970657] niks3-server[998]: 2026/09/20 10:53:00 INFO Received uploads request method=POST path=/api/pending_closures5518worker2 # [ 129.976694] nix-grpc-daemon[1503]: time=2026-09-20T10:53:00.582Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5519worker2 # [ 129.978215] nix-grpc-daemon[1503]: time=2026-09-20T10:53:00.582Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5520lb # [ 130.005937] niks3-server[998]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5521lb # [ 130.025817] niks3-server[998]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5522lb # [ 130.034166] niks3-server[998]: 2026/09/20 10:53:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5523worker2 # [ 130.033257] nix-grpc-daemon[1503]: time=2026-09-20T10:53:00.639Z level=INFO msg="Uploading 1 narinfos"5524lb # [ 130.042559] niks3-server[998]: 2026/09/20 10:53:00 INFO Signed narinfos id=42 count=15525lb # [ 130.046886] niks3-server[998]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5526lb # [ 130.054689] niks3-server[998]: 2026/09/20 10:53:00 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5527lb # [ 130.061643] niks3-server[998]: 2026/09/20 10:53:00 INFO Completed upload id=425528worker2 # [ 130.056152] nix-grpc-daemon[1503]: time=2026-09-20T10:53:00.662Z level=INFO msg="Upload complete. (297ms)"5529lb # [ 130.064301] niks3-server[998]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5530worker2 # [ 130.073457] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15531worker2 # [ 130.087348] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05532worker2 # [ 130.091050] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15533worker2 # [ 130.094740] nix-daemon[833]: reaped child process 1628, status = succeeded5534worker2 # [ 130.119398] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346185535worker2 # [ 130.141084] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346185536worker2 # [ 130.155110] nix-grpc-daemon[1503]: time=2026-09-20T10:53:00.761Z level=INFO msg="All 2 paths already cached"5537client # copying 1 paths to 'lb:50051'...5538worker2 # [ 130.165508] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346185539client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5540worker2 # [ 130.188614] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5541lb # [ 130.299299] envoy[916]: conn peer=[2001:db8:1::1]:54240 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=732 ms=35055542worker2 # [ 130.390319] nix-daemon[833]: accepted connection from pid 1654, user nix-grpc-daemon (trusted)5543worker2 # [ 130.411519] nix-daemon[833]: reaped child process 1657, status = succeeded5544worker2 # [ 130.584535] nix-daemon[833]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)5545worker2 # [ 130.604726] nix-daemon[833]: reaped child process 1662, status = succeeded5546lb # [ 130.620954] niks3-server[998]: 2026/09/20 10:53:01 INFO Received uploads request method=POST path=/api/pending_closures5547worker2 # [ 130.624062] nix-grpc-daemon[1503]: time=2026-09-20T10:53:01.230Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5548worker2 # [ 130.625569] nix-grpc-daemon[1503]: time=2026-09-20T10:53:01.230Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5549lb # [ 130.650049] niks3-server[998]: 2026/09/20 10:53:01 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5550lb # [ 130.663908] niks3-server[998]: 2026/09/20 10:53:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5551worker2 # [ 130.665820] nix-grpc-daemon[1503]: time=2026-09-20T10:53:01.272Z level=INFO msg="Uploading 1 narinfos"5552lb # [ 130.676685] niks3-server[998]: 2026/09/20 10:53:01 INFO Signed narinfos id=43 count=15553lb # [ 130.679603] niks3-server[998]: 2026/09/20 10:53:01 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5554lb # [ 130.688197] niks3-server[998]: 2026/09/20 10:53:01 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5555lb # [ 130.696738] niks3-server[998]: 2026/09/20 10:53:01 INFO Completed upload id=435556worker2 # [ 130.691733] nix-grpc-daemon[1503]: time=2026-09-20T10:53:01.298Z level=INFO msg="Upload complete. (485ms)"5557lb # [ 130.699797] niks3-server[998]: 2026/09/20 10:53:01 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5558worker2 # [ 130.700358] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=7685559worker2 # [ 130.708774] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346185560worker2 # [ 130.719121] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5561worker2 # [ 130.726262] nix-daemon[833]: reaped child process 1652, status = succeeded5562client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5563worker2 # [ 130.736162] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5564client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5565client # farm-top> LOG-farm-top-during-drain5566worker2 # [ 132.181531] nix-daemon[833]: reaped child process 1666, status = succeeded5567worker2 # [ 132.359785] nix-daemon[833]: accepted connection from pid 1681, user nix-grpc-daemon (trusted)5568worker2 # [ 132.377806] nix-daemon[833]: reaped child process 1684, status = succeeded5569lb # [ 132.396662] niks3-server[998]: 2026/09/20 10:53:02 INFO Received uploads request method=POST path=/api/pending_closures5570worker2 # [ 132.403070] nix-grpc-daemon[1503]: time=2026-09-20T10:53:03.008Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5571worker2 # [ 132.404661] nix-grpc-daemon[1503]: time=2026-09-20T10:53:03.008Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5572worker2 # [ 132.444489] nix-grpc-daemon[1503]: time=2026-09-20T10:53:03.051Z level=INFO msg="Uploading 1 narinfos"5573lb # [ 132.438224] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5574lb # [ 132.452443] niks3-server[998]: 2026/09/20 10:53:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5575lb # [ 132.462027] niks3-server[998]: 2026/09/20 10:53:03 INFO Signed narinfos id=44 count=15576lb # [ 132.466537] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5577lb # [ 132.470571] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5578worker2 # [ 132.472771] nix-grpc-daemon[1503]: time=2026-09-20T10:53:03.079Z level=INFO msg="Upload complete. (324ms)"5579lb # [ 132.478246] niks3-server[998]: 2026/09/20 10:53:03 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5580lb # [ 132.481960] niks3-server[998]: 2026/09/20 10:53:03 INFO Completed upload id=445581lb # [ 132.484856] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5582worker2 # [ 132.484534] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15583worker2 # [ 132.501358] nix-daemon[833]: reaped child process 1664, status = succeeded5584client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.33 seconds)5585client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5586client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds)5587worker1: must succeed: pkill -f 'read -t [9]0 x'5588worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5589client: waiting for success: ! systemctl is-active sw5590worker1 # [ 132.882629] nix-daemon[833]: reaped child process 1512, status = succeeded5591worker1 # [ 133.040989] nix-daemon[833]: accepted connection from pid 1552, user nix-grpc-daemon (trusted)5592worker1 # [ 133.060262] nix-daemon[833]: reaped child process 1555, status = succeeded5593lb # [ 133.067448] niks3-server[998]: 2026/09/20 10:53:03 INFO Received uploads request method=POST path=/api/pending_closures5594worker1 # [ 133.081830] nix-grpc-daemon[1456]: time=2026-09-20T10:53:03.669Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5595worker1 # [ 133.083319] nix-grpc-daemon[1456]: time=2026-09-20T10:53:03.669Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5596lb # [ 133.106125] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5597worker1 # [ 133.123147] nix-grpc-daemon[1456]: time=2026-09-20T10:53:03.710Z level=INFO msg="Uploading 1 narinfos"5598lb # [ 133.119645] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5599lb # [ 133.130046] niks3-server[998]: 2026/09/20 10:53:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5600lb # [ 133.135412] niks3-server[998]: 2026/09/20 10:53:03 INFO Signed narinfos id=45 count=15601worker1 # [ 133.144523] nix-grpc-daemon[1456]: time=2026-09-20T10:53:03.732Z level=INFO msg="Upload complete. (274ms)"5602lb # [ 133.140810] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5603lb # [ 133.143574] niks3-server[998]: 2026/09/20 10:53:03 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5604lb # [ 133.149568] niks3-server[998]: 2026/09/20 10:53:03 INFO Completed upload id=455605worker1 # [ 133.153701] nix-grpc-daemon[1305]: ts=2026-09-20T10:53:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44862 duration_s=8 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15606lb # [ 133.152794] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5607worker1 # [ 133.166203] nix-daemon[833]: reaped child process 1510, status = succeeded5608client # [ 133.288650] systemd[1]: sw.service: Deactivated successfully.5609client # [ 133.293119] systemd[1]: sw.service: Consumed 158ms CPU time over 9.817s wall clock time, 37.1M memory peak, 8.4K incoming IP traffic, 8.8K outgoing IP traffic.5610worker1 # [ 133.962235] nix-grpc-daemon[1305]: ts=2026-09-20T10:53:04Z level=info event=signal_exit5611client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5612client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5613client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5614worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5615worker2 # [ 135.195176] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:346005616worker1 # [ 135.208800] nix-grpc-daemon[1305]: ts=2026-09-20T10:53:05Z level=info event=scheduler_restarting5617worker2 # [ 135.195581] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:05Z level=info event=worker_gone addr=192.168.1.3:500515618worker1 # [ 135.232443] nix-grpc-daemon[1305]: ts=2026-09-20T10:53:05Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5619worker1 # [ 135.259090] nix-daemon[833]: reaped child process 1361, status = succeeded5620worker1 # [ 135.439065] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5621worker1 # [ 135.447003] systemd[1]: nix-grpc-daemon.service: Consumed 955ms CPU time over 40.710s wall clock time, 32.7M memory peak, 23.5K incoming IP traffic, 33.2K outgoing IP traffic.5622worker1 # [ 135.465856] systemd[1]: Starting Nix worker-protocol over gRPC...5623worker1 # [ 135.660637] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5624worker1 # [ 135.664058] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15625worker1 # [ 135.672407] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5626worker1 # [ 135.674117] systemd[1]: Started Nix worker-protocol over gRPC.5627worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.68 seconds)5628lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5629lb: must succeed: curl -sf localhost:9901/clusters5630worker1 # [ 135.726136] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:06Z level=info event=scheduler_connected addr=lb:500515631worker2 # [ 135.719091] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05632lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5633lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)5634lb: must succeed: curl -sf localhost:9901/clusters5635lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5636worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5637worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5638(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 12.61 seconds)5639subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5640client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15641worker2 # [ 136.175432] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346185642worker1 # [ 136.200617] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533505643worker1 # [ 136.214143] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5644worker1 # [ 136.239189] nix-grpc-daemon[1569]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 1/5)5645worker1 # [ 136.250030] nix-grpc-daemon[1569]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 146 ms (attempt 2/5)5646worker1 # [ 136.403607] nix-grpc-daemon[1569]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 224 ms (attempt 3/5)5647worker1 # [ 136.635256] nix-grpc-daemon[1569]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 354 ms (attempt 4/5)5648worker1 # [ 136.998671] nix-grpc-daemon[1569]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5649worker2 # [ 137.042221] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:07Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05650worker2 # [ 137.048364] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:07Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15651worker2 # [ 137.054306] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:07Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05652worker2 # [ 137.059558] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:07Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05653worker1 # [ 137.097701] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505654worker1 # [ 137.114935] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533505655worker1 # [ 137.130693] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533505656worker1 # [ 137.146241] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5657worker1 # [ 137.175903] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:07Z level=info event=niks3_push_started pid=16255658worker1 # [ 137.563320] nix-daemon[833]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5659worker1 # [ 137.583762] nix-daemon[833]: reaped child process 1641, status = succeeded5660worker1 # [ 137.759793] nix-daemon[833]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)5661worker1 # [ 137.776577] nix-daemon[833]: reaped child process 1646, status = succeeded5662lb # [ 137.790157] niks3-server[998]: 2026/09/20 10:53:08 INFO Received uploads request method=POST path=/api/pending_closures5663worker1 # [ 137.803284] nix-grpc-daemon[1625]: time=2026-09-20T10:53:08.390Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5664worker1 # [ 137.805045] nix-grpc-daemon[1625]: time=2026-09-20T10:53:08.390Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5665lb # [ 137.842281] niks3-server[998]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5666lb # [ 137.851828] niks3-server[998]: 2026/09/20 10:53:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5667worker1 # [ 137.861293] nix-grpc-daemon[1625]: time=2026-09-20T10:53:08.449Z level=INFO msg="Uploading 1 narinfos"5668lb # [ 137.861526] niks3-server[998]: 2026/09/20 10:53:08 INFO Signed narinfos id=46 count=15669lb # [ 137.863880] niks3-server[998]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5670lb # [ 137.874360] niks3-server[998]: 2026/09/20 10:53:08 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5671lb # [ 137.881913] niks3-server[998]: 2026/09/20 10:53:08 INFO Completed upload id=465672worker1 # [ 137.886337] nix-grpc-daemon[1625]: time=2026-09-20T10:53:08.474Z level=INFO msg="Upload complete. (492ms)"5673lb # [ 137.884738] niks3-server[998]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5674worker1 # [ 137.896314] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=5125675worker1 # [ 137.912328] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505676worker1 # [ 137.919340] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5677worker1 # [ 137.925040] nix-daemon[833]: reaped child process 1623, status = succeeded5678worker1 # [ 137.937168] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5679worker1 # [ 139.173625] nix-daemon[833]: reaped child process 1650, status = succeeded5680worker1 # [ 139.339246] nix-daemon[833]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)5681worker1 # [ 139.356549] nix-daemon[833]: reaped child process 1668, status = succeeded5682lb # [ 139.367915] niks3-server[998]: 2026/09/20 10:53:09 INFO Received uploads request method=POST path=/api/pending_closures5683worker1 # [ 139.384443] nix-grpc-daemon[1625]: time=2026-09-20T10:53:09.970Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5684worker1 # [ 139.385981] nix-grpc-daemon[1625]: time=2026-09-20T10:53:09.970Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5685lb # [ 139.404466] niks3-server[998]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5686lb # [ 139.421571] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5687lb # [ 139.433057] niks3-server[998]: 2026/09/20 10:53:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5688worker1 # [ 139.443656] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.030Z level=INFO msg="Uploading 1 narinfos"5689lb # [ 139.439351] niks3-server[998]: 2026/09/20 10:53:10 INFO Signed narinfos id=47 count=15690lb # [ 139.443513] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5691lb # [ 139.453768] niks3-server[998]: 2026/09/20 10:53:10 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5692lb # [ 139.460455] niks3-server[998]: 2026/09/20 10:53:10 INFO Completed upload id=475693worker1 # [ 139.464584] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.053Z level=INFO msg="Upload complete. (313ms)"5694lb # [ 139.462956] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5695worker1 # [ 139.474366] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15696worker2 # [ 139.467502] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:10Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15697worker2 # [ 139.477600] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:10Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05698worker1 # [ 139.492299] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505699worker1 # [ 139.499029] nix-daemon[833]: reaped child process 1648, status = succeeded5700worker1 # [ 139.503087] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533505701worker1 # [ 139.511804] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533505702worker1 # [ 139.523314] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5703worker1 # [ 139.712924] nix-daemon[833]: accepted connection from pid 1672, user nix-grpc-daemon (trusted)5704worker1 # [ 139.731505] nix-daemon[833]: reaped child process 1675, status = succeeded5705worker1 # [ 139.911427] nix-daemon[833]: accepted connection from pid 1677, user nix-grpc-daemon (trusted)5706worker1 # [ 139.930511] nix-daemon[833]: reaped child process 1680, status = succeeded5707lb # [ 139.938607] niks3-server[998]: 2026/09/20 10:53:10 INFO Received uploads request method=POST path=/api/pending_closures5708worker1 # [ 139.952125] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.540Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5709worker1 # [ 139.953632] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.540Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5710lb # [ 139.970751] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5711worker1 # [ 139.998320] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.586Z level=INFO msg="Uploading 1 narinfos"5712lb # [ 139.987945] niks3-server[998]: 2026/09/20 10:53:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5713lb # [ 140.002403] niks3-server[998]: 2026/09/20 10:53:10 INFO Signed narinfos id=48 count=15714lb # [ 140.009400] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5715lb # [ 140.019657] niks3-server[998]: 2026/09/20 10:53:10 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5716lb # [ 140.024612] niks3-server[998]: 2026/09/20 10:53:10 INFO Completed upload id=485717worker1 # [ 140.028126] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.616Z level=INFO msg="Upload complete. (493ms)"5718lb # [ 140.027287] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5719worker1 # [ 140.036180] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=5125720worker1 # [ 140.048859] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505721worker1 # [ 140.058948] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5722worker1 # [ 140.065206] nix-daemon[833]: reaped child process 1670, status = succeeded5723worker1 # [ 140.080392] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5724lb # [ 140.300882] envoy[916]: conn peer=[2001:db8:1::1]:47864 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9638 tx=3894 ms=60405725lb # [ 140.305877] envoy[916]: conn peer=[2001:db8:1::1]:47862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2922 tx=1309 ms=95455726lb # [ 140.310727] envoy[916]: conn peer=[2001:db8:1::3]:40708 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2392 tx=788 ms=402455727worker1 # [ 141.511367] nix-daemon[833]: reaped child process 1684, status = succeeded5728worker1 # [ 141.691171] nix-daemon[833]: accepted connection from pid 1699, user nix-grpc-daemon (trusted)5729worker1 # [ 141.710779] nix-daemon[833]: reaped child process 1702, status = succeeded5730lb # [ 141.719525] niks3-server[998]: 2026/09/20 10:53:12 INFO Received uploads request method=POST path=/api/pending_closures5731worker1 # [ 141.734250] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.321Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5732worker1 # [ 141.735809] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.321Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5733lb # [ 141.756644] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5734worker1 # [ 141.773345] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.361Z level=INFO msg="Uploading 1 narinfos"5735lb # [ 141.769672] niks3-server[998]: 2026/09/20 10:53:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5736lb # [ 141.785085] niks3-server[998]: 2026/09/20 10:53:12 INFO Signed narinfos id=49 count=15737lb # [ 141.787857] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5738lb # [ 141.796864] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5739lb # [ 141.805421] niks3-server[998]: 2026/09/20 10:53:12 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5740lb # [ 141.810750] niks3-server[998]: 2026/09/20 10:53:12 INFO Completed upload id=495741worker1 # [ 141.814002] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.402Z level=INFO msg="Upload complete. (322ms)"5742lb # [ 141.815032] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5743worker2 # [ 141.811816] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:12Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15744worker1 # [ 141.825008] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15745worker2 # [ 141.825048] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:12Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05746worker1 # [ 141.841057] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505747worker1 # [ 141.847134] nix-daemon[833]: reaped child process 1682, status = succeeded5748worker1 # [ 141.859698] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533505749worker1 # [ 141.873341] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533505750worker1 # [ 141.884991] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5751worker1 # [ 142.074969] nix-daemon[833]: accepted connection from pid 1706, user nix-grpc-daemon (trusted)5752worker1 # [ 142.093552] nix-daemon[833]: reaped child process 1709, status = succeeded5753worker1 # [ 142.267553] nix-daemon[833]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)5754worker1 # [ 142.285542] nix-daemon[833]: reaped child process 1714, status = succeeded5755lb # [ 142.294676] niks3-server[998]: 2026/09/20 10:53:12 INFO Received uploads request method=POST path=/api/pending_closures5756worker1 # [ 142.307695] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.895Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5757worker1 # [ 142.309375] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.895Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5758lb # [ 142.323006] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5759lb # [ 142.336327] niks3-server[998]: 2026/09/20 10:53:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5760worker1 # [ 142.346886] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.935Z level=INFO msg="Uploading 1 narinfos"5761lb # [ 142.347242] niks3-server[998]: 2026/09/20 10:53:12 INFO Signed narinfos id=50 count=15762lb # [ 142.353089] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5763lb # [ 142.361247] niks3-server[998]: 2026/09/20 10:53:12 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5764lb # [ 142.367570] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5765lb # [ 142.372395] niks3-server[998]: 2026/09/20 10:53:12 INFO Completed upload id=505766worker1 # [ 142.376642] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.965Z level=INFO msg="Upload complete. (478ms)"5767worker1 # [ 142.384882] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=5125768worker1 # [ 142.399509] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505769worker1 # [ 142.405770] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5770worker1 # [ 142.410668] nix-daemon[833]: reaped child process 1704, status = succeeded5771worker1 # [ 142.424205] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5772worker1 # [ 143.665577] nix-daemon[833]: reaped child process 1718, status = succeeded5773worker1 # [ 143.849989] nix-daemon[833]: accepted connection from pid 1733, user nix-grpc-daemon (trusted)5774worker1 # [ 143.867443] nix-daemon[833]: reaped child process 1736, status = succeeded5775lb # [ 143.875947] niks3-server[998]: 2026/09/20 10:53:14 INFO Received uploads request method=POST path=/api/pending_closures5776worker1 # [ 143.890587] nix-grpc-daemon[1625]: time=2026-09-20T10:53:14.477Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5777worker1 # [ 143.892196] nix-grpc-daemon[1625]: time=2026-09-20T10:53:14.477Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5778lb # [ 143.912377] niks3-server[998]: 2026/09/20 10:53:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5779worker1 # [ 143.927723] nix-grpc-daemon[1625]: time=2026-09-20T10:53:14.515Z level=INFO msg="Uploading 1 narinfos"5780lb # [ 143.933379] niks3-server[998]: 2026/09/20 10:53:14 INFO Signed narinfos id=51 count=15781lb # [ 143.941051] niks3-server[998]: 2026/09/20 10:53:14 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5782worker1 # [ 143.957426] nix-grpc-daemon[1625]: time=2026-09-20T10:53:14.545Z level=INFO msg="Upload complete. (322ms)"5783lb # [ 143.954957] niks3-server[998]: 2026/09/20 10:53:14 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5784lb # [ 143.959239] niks3-server[998]: 2026/09/20 10:53:14 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5785lb # [ 143.963419] niks3-server[998]: 2026/09/20 10:53:14 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5786worker2 # [ 143.956130] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:14Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15787lb # [ 143.966618] niks3-server[998]: 2026/09/20 10:53:14 INFO Completed upload id=515788worker1 # [ 143.968919] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15789lb # [ 143.968828] niks3-server[998]: 2026/09/20 10:53:14 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5790worker2 # [ 143.970211] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:14Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05791worker1 # [ 143.983190] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505792worker1 # [ 143.987891] nix-daemon[833]: reaped child process 1716, status = succeeded5793worker1 # [ 143.995046] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533505794worker1 # [ 144.006614] nix-grpc-daemon[1625]: time=2026-09-20T10:53:14.595Z level=INFO msg="All 1 paths already cached"5795worker1 # [ 144.014121] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533505796worker1 # [ 144.024913] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5797worker1 # [ 144.213016] nix-daemon[833]: accepted connection from pid 1740, user nix-grpc-daemon (trusted)5798worker1 # [ 144.231676] nix-daemon[833]: reaped child process 1743, status = succeeded5799worker1 # [ 144.403830] nix-daemon[833]: accepted connection from pid 1745, user nix-grpc-daemon (trusted)5800worker1 # [ 144.421482] nix-daemon[833]: reaped child process 1748, status = succeeded5801lb # [ 144.430634] niks3-server[998]: 2026/09/20 10:53:15 INFO Received uploads request method=POST path=/api/pending_closures5802worker1 # [ 144.445080] nix-grpc-daemon[1625]: time=2026-09-20T10:53:15.033Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5803worker1 # [ 144.446566] nix-grpc-daemon[1625]: time=2026-09-20T10:53:15.033Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5804lb # [ 144.458915] niks3-server[998]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5805worker1 # [ 144.476490] nix-grpc-daemon[1625]: time=2026-09-20T10:53:15.064Z level=INFO msg="Uploading 1 narinfos"5806lb # [ 144.473847] niks3-server[998]: 2026/09/20 10:53:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5807lb # [ 144.484366] niks3-server[998]: 2026/09/20 10:53:15 INFO Signed narinfos id=52 count=15808lb # [ 144.487084] niks3-server[998]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5809lb # [ 144.496541] niks3-server[998]: 2026/09/20 10:53:15 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5810lb # [ 144.502863] niks3-server[998]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5811lb # [ 144.507919] niks3-server[998]: 2026/09/20 10:53:15 INFO Completed upload id=525812worker1 # [ 144.512167] nix-grpc-daemon[1625]: time=2026-09-20T10:53:15.100Z level=INFO msg="Upload complete. (474ms)"5813worker1 # [ 144.520753] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=6245814worker1 # [ 144.534352] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505815worker1 # [ 144.540408] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5816worker1 # [ 144.545402] nix-daemon[833]: reaped child process 1738, status = succeeded5817worker1 # [ 144.559021] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5818worker1 # [ 145.605763] nix-daemon[833]: reaped child process 1752, status = succeeded5819worker1 # [ 145.792062] nix-daemon[833]: accepted connection from pid 1767, user nix-grpc-daemon (trusted)5820worker1 # [ 145.811944] nix-daemon[833]: reaped child process 1770, status = succeeded5821lb # [ 145.821905] niks3-server[998]: 2026/09/20 10:53:16 INFO Received uploads request method=POST path=/api/pending_closures5822worker1 # [ 145.834059] nix-grpc-daemon[1625]: time=2026-09-20T10:53:16.422Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5823worker1 # [ 145.838278] nix-grpc-daemon[1625]: time=2026-09-20T10:53:16.424Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5824lb # [ 145.859732] niks3-server[998]: 2026/09/20 10:53:16 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5825lb # [ 145.872894] niks3-server[998]: 2026/09/20 10:53:16 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5826lb # [ 145.883136] niks3-server[998]: 2026/09/20 10:53:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5827worker1 # [ 145.892661] nix-grpc-daemon[1625]: time=2026-09-20T10:53:16.480Z level=INFO msg="Uploading 1 narinfos"5828lb # [ 145.890498] niks3-server[998]: 2026/09/20 10:53:16 INFO Signed narinfos id=53 count=15829lb # [ 145.896628] niks3-server[998]: 2026/09/20 10:53:16 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5830lb # [ 145.907586] niks3-server[998]: 2026/09/20 10:53:16 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5831lb # [ 145.913034] niks3-server[998]: 2026/09/20 10:53:16 INFO Completed upload id=535832worker1 # [ 145.917215] nix-grpc-daemon[1625]: time=2026-09-20T10:53:16.505Z level=INFO msg="Upload complete. (347ms)"5833lb # [ 145.915721] niks3-server[998]: 2026/09/20 10:53:16 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5834worker2 # [ 145.917189] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:16Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15835worker1 # [ 145.930625] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15836worker2 # [ 145.929969] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:16Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05837worker1 # [ 145.948301] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505838worker1 # [ 145.958734] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533505839worker1 # [ 145.964450] nix-daemon[833]: reaped child process 1750, status = succeeded5840worker1 # [ 145.971559] nix-grpc-daemon[1625]: time=2026-09-20T10:53:16.559Z level=INFO msg="All 1 paths already cached"5841worker1 # [ 145.980696] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533505842worker1 # [ 145.994000] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5843worker1 # [ 146.189199] nix-daemon[833]: accepted connection from pid 1774, user nix-grpc-daemon (trusted)5844worker1 # [ 146.208992] nix-daemon[833]: reaped child process 1777, status = succeeded5845worker1 # [ 146.383762] nix-daemon[833]: accepted connection from pid 1779, user nix-grpc-daemon (trusted)5846worker1 # [ 146.400267] nix-daemon[833]: reaped child process 1782, status = succeeded5847lb # [ 146.410256] niks3-server[998]: 2026/09/20 10:53:17 INFO Received uploads request method=POST path=/api/pending_closures5848worker1 # [ 146.435100] nix-grpc-daemon[1625]: time=2026-09-20T10:53:17.023Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5849worker1 # [ 146.436708] nix-grpc-daemon[1625]: time=2026-09-20T10:53:17.023Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5850lb # [ 146.452402] niks3-server[998]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5851worker1 # [ 146.469547] nix-grpc-daemon[1625]: time=2026-09-20T10:53:17.057Z level=INFO msg="Uploading 1 narinfos"5852lb # [ 146.466707] niks3-server[998]: 2026/09/20 10:53:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5853lb # [ 146.481410] niks3-server[998]: 2026/09/20 10:53:17 INFO Signed narinfos id=54 count=15854lb # [ 146.488307] niks3-server[998]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5855lb # [ 146.497899] niks3-server[998]: 2026/09/20 10:53:17 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5856lb # [ 146.502891] niks3-server[998]: 2026/09/20 10:53:17 INFO Completed upload id=545857lb # [ 146.505930] niks3-server[998]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5858worker1 # [ 146.506622] nix-grpc-daemon[1625]: time=2026-09-20T10:53:17.095Z level=INFO msg="Upload complete. (498ms)"5859worker1 # [ 146.516471] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=6245860worker1 # [ 146.532487] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505861worker1 # [ 146.540765] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5862worker1 # [ 146.547729] nix-daemon[833]: reaped child process 1772, status = succeeded5863worker1 # [ 146.559845] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5864worker1 # [ 147.608939] nix-daemon[833]: reaped child process 1786, status = succeeded5865worker1 # [ 147.777376] nix-daemon[833]: accepted connection from pid 1801, user nix-grpc-daemon (trusted)5866worker1 # [ 147.796817] nix-daemon[833]: reaped child process 1804, status = succeeded5867lb # [ 147.805068] niks3-server[998]: 2026/09/20 10:53:18 INFO Received uploads request method=POST path=/api/pending_closures5868worker1 # [ 147.820434] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.406Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5869worker1 # [ 147.822141] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.406Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5870lb # [ 147.850515] niks3-server[998]: 2026/09/20 10:53:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5871worker1 # [ 147.862126] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.450Z level=INFO msg="Uploading 1 narinfos"5872lb # [ 147.862951] niks3-server[998]: 2026/09/20 10:53:18 INFO Signed narinfos id=55 count=15873lb # [ 147.870815] niks3-server[998]: 2026/09/20 10:53:18 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5874lb # [ 147.882341] niks3-server[998]: 2026/09/20 10:53:18 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5875lb # [ 147.887187] niks3-server[998]: 2026/09/20 10:53:18 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5876lb # [ 147.890687] niks3-server[998]: 2026/09/20 10:53:18 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5877lb # [ 147.896075] niks3-server[998]: 2026/09/20 10:53:18 INFO Completed upload id=555878worker1 # [ 147.900051] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.488Z level=INFO msg="Upload complete. (326ms)"5879lb # [ 147.898586] niks3-server[998]: 2026/09/20 10:53:18 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5880worker2 # [ 147.899231] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:18Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15881worker2 # [ 147.907950] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:18Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05882worker1 # [ 147.913299] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15883worker1 # [ 147.932290] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505884worker1 # [ 147.942213] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533505885worker1 # [ 147.947534] nix-daemon[833]: reaped child process 1784, status = succeeded5886worker1 # [ 147.955343] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.543Z level=INFO msg="All 1 paths already cached"5887worker1 # [ 147.963008] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533505888worker1 # [ 147.975202] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5889worker1 # [ 148.171004] nix-daemon[833]: accepted connection from pid 1808, user nix-grpc-daemon (trusted)5890worker1 # [ 148.191734] nix-daemon[833]: reaped child process 1811, status = succeeded5891worker1 # [ 148.368115] nix-daemon[833]: accepted connection from pid 1813, user nix-grpc-daemon (trusted)5892worker1 # [ 148.385276] nix-daemon[833]: reaped child process 1816, status = succeeded5893lb # [ 148.394330] niks3-server[998]: 2026/09/20 10:53:18 INFO Received uploads request method=POST path=/api/pending_closures5894worker1 # [ 148.407390] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.995Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5895worker1 # [ 148.409015] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.995Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5896lb # [ 148.422024] niks3-server[998]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5897worker1 # [ 148.440242] nix-grpc-daemon[1625]: time=2026-09-20T10:53:19.028Z level=INFO msg="Uploading 1 narinfos"5898lb # [ 148.440176] niks3-server[998]: 2026/09/20 10:53:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5899lb # [ 148.449679] niks3-server[998]: 2026/09/20 10:53:19 INFO Signed narinfos id=56 count=15900lb # [ 148.455241] niks3-server[998]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5901worker1 # [ 148.465793] nix-grpc-daemon[1625]: time=2026-09-20T10:53:19.054Z level=INFO msg="Upload complete. (476ms)"5902lb # [ 148.464149] niks3-server[998]: 2026/09/20 10:53:19 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5903worker1 # [ 148.472109] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=6245904lb # [ 148.469601] niks3-server[998]: 2026/09/20 10:53:19 INFO Completed upload id=565905lb # [ 148.473076] niks3-server[998]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5906worker1 # [ 148.480770] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505907worker1 # [ 148.490315] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5908worker1 # [ 148.494679] nix-daemon[833]: reaped child process 1806, status = succeeded5909worker1 # [ 148.507276] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5910worker1 # [ 149.927975] nix-daemon[833]: reaped child process 1820, status = succeeded5911worker1 # [ 150.084112] nix-daemon[833]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)5912worker1 # [ 150.103912] nix-daemon[833]: reaped child process 1838, status = succeeded5913lb # [ 150.113402] niks3-server[998]: 2026/09/20 10:53:20 INFO Received uploads request method=POST path=/api/pending_closures5914worker1 # [ 150.128401] nix-grpc-daemon[1625]: time=2026-09-20T10:53:20.715Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5915worker1 # [ 150.129888] nix-grpc-daemon[1625]: time=2026-09-20T10:53:20.715Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5916lb # [ 150.155499] niks3-server[998]: 2026/09/20 10:53:20 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5917lb # [ 150.166857] niks3-server[998]: 2026/09/20 10:53:20 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5918lb # [ 150.178849] niks3-server[998]: 2026/09/20 10:53:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5919worker1 # [ 150.188351] nix-grpc-daemon[1625]: time=2026-09-20T10:53:20.776Z level=INFO msg="Uploading 1 narinfos"5920lb # [ 150.185677] niks3-server[998]: 2026/09/20 10:53:20 INFO Signed narinfos id=57 count=15921lb # [ 150.191541] niks3-server[998]: 2026/09/20 10:53:20 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5922lb # [ 150.200199] niks3-server[998]: 2026/09/20 10:53:20 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5923lb # [ 150.208328] niks3-server[998]: 2026/09/20 10:53:20 INFO Completed upload id=575924worker1 # [ 150.211023] nix-grpc-daemon[1625]: time=2026-09-20T10:53:20.799Z level=INFO msg="Upload complete. (294ms)"5925lb # [ 150.211145] niks3-server[998]: 2026/09/20 10:53:20 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5926worker2 # [ 150.213277] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:20Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15927worker1 # [ 150.221068] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=15928worker2 # [ 150.226927] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:20Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05929worker1 # [ 150.240303] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505930worker1 # [ 150.249760] nix-daemon[833]: reaped child process 1818, status = succeeded5931worker1 # [ 150.253609] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533505932worker1 # [ 150.265794] nix-grpc-daemon[1625]: time=2026-09-20T10:53:20.854Z level=INFO msg="All 2 paths already cached"5933worker1 # [ 150.274307] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533505934worker1 # [ 150.286116] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5935worker1 # [ 150.474133] nix-daemon[833]: accepted connection from pid 1842, user nix-grpc-daemon (trusted)5936worker1 # [ 150.493458] nix-daemon[833]: reaped child process 1845, status = succeeded5937worker1 # [ 150.668106] nix-daemon[833]: accepted connection from pid 1847, user nix-grpc-daemon (trusted)5938worker1 # [ 150.685091] nix-daemon[833]: reaped child process 1850, status = succeeded5939lb # [ 150.694820] niks3-server[998]: 2026/09/20 10:53:21 INFO Received uploads request method=POST path=/api/pending_closures5940worker1 # [ 150.708503] nix-grpc-daemon[1625]: time=2026-09-20T10:53:21.296Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5941worker1 # [ 150.710003] nix-grpc-daemon[1625]: time=2026-09-20T10:53:21.296Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5942lb # [ 150.722844] niks3-server[998]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5943worker1 # [ 150.740608] nix-grpc-daemon[1625]: time=2026-09-20T10:53:21.328Z level=INFO msg="Uploading 1 narinfos"5944lb # [ 150.740594] niks3-server[998]: 2026/09/20 10:53:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5945lb # [ 150.751008] niks3-server[998]: 2026/09/20 10:53:21 INFO Signed narinfos id=58 count=15946lb # [ 150.755849] niks3-server[998]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5947worker1 # [ 150.768644] nix-grpc-daemon[1625]: time=2026-09-20T10:53:21.357Z level=INFO msg="Upload complete. (469ms)"5948lb # [ 150.764464] niks3-server[998]: 2026/09/20 10:53:21 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5949lb # [ 150.770453] niks3-server[998]: 2026/09/20 10:53:21 INFO Completed upload id=585950worker1 # [ 150.774603] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=7525951lb # [ 150.773782] niks3-server[998]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5952worker1 # [ 150.787777] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505953worker1 # [ 150.794579] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5954worker1 # [ 150.799285] nix-daemon[833]: reaped child process 1840, status = succeeded5955worker1 # [ 150.813103] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5956worker1 # [ 151.833840] nix-daemon[833]: reaped child process 1854, status = succeeded5957worker1 # [ 151.987564] nix-daemon[833]: accepted connection from pid 1869, user nix-grpc-daemon (trusted)5958worker1 # [ 152.007688] nix-daemon[833]: reaped child process 1872, status = succeeded5959lb # [ 152.017650] niks3-server[998]: 2026/09/20 10:53:22 INFO Received uploads request method=POST path=/api/pending_closures5960worker1 # [ 152.026809] nix-grpc-daemon[1625]: time=2026-09-20T10:53:22.614Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5961worker1 # [ 152.032682] nix-grpc-daemon[1625]: time=2026-09-20T10:53:22.616Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5962lb # [ 152.051222] niks3-server[998]: 2026/09/20 10:53:22 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5963lb # [ 152.066883] niks3-server[998]: 2026/09/20 10:53:22 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5964lb # [ 152.079347] niks3-server[998]: 2026/09/20 10:53:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5965worker1 # [ 152.089065] nix-grpc-daemon[1625]: time=2026-09-20T10:53:22.677Z level=INFO msg="Uploading 1 narinfos"5966lb # [ 152.087907] niks3-server[998]: 2026/09/20 10:53:22 INFO Signed narinfos id=59 count=15967lb # [ 152.092949] niks3-server[998]: 2026/09/20 10:53:22 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5968lb # [ 152.101866] niks3-server[998]: 2026/09/20 10:53:22 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5969lb # [ 152.107946] niks3-server[998]: 2026/09/20 10:53:22 INFO Completed upload id=595970lb # [ 152.110595] niks3-server[998]: 2026/09/20 10:53:22 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo5971worker1 # [ 152.110973] nix-grpc-daemon[1625]: time=2026-09-20T10:53:22.699Z level=INFO msg="Upload complete. (289ms)"5972worker2 # [ 152.112384] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:22Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=15973worker1 # [ 152.122399] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=15974worker1 # [ 152.140393] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505975worker1 # [ 152.146929] nix-daemon[833]: reaped child process 1852, status = succeeded5976worker1 # [ 152.151196] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533505977worker1 # [ 152.160206] nix-grpc-daemon[1625]: time=2026-09-20T10:53:22.748Z level=INFO msg="All 2 paths already cached"5978worker1 # [ 152.167940] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533505979worker1 # [ 152.179119] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5980worker1 # [ 152.365751] nix-daemon[833]: accepted connection from pid 1876, user nix-grpc-daemon (trusted)5981worker1 # [ 152.385362] nix-daemon[833]: reaped child process 1879, status = succeeded5982worker1 # [ 152.558822] nix-daemon[833]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)5983worker1 # [ 152.578025] nix-daemon[833]: reaped child process 1884, status = succeeded5984lb # [ 152.586325] niks3-server[998]: 2026/09/20 10:53:23 INFO Received uploads request method=POST path=/api/pending_closures5985worker1 # [ 152.600860] nix-grpc-daemon[1625]: time=2026-09-20T10:53:23.189Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5986worker1 # [ 152.602385] nix-grpc-daemon[1625]: time=2026-09-20T10:53:23.189Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"5987lb # [ 152.615750] niks3-server[998]: 2026/09/20 10:53:23 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst5988worker1 # [ 152.633358] nix-grpc-daemon[1625]: time=2026-09-20T10:53:23.221Z level=INFO msg="Uploading 1 narinfos"5989lb # [ 152.631854] niks3-server[998]: 2026/09/20 10:53:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign5990lb # [ 152.642191] niks3-server[998]: 2026/09/20 10:53:23 INFO Signed narinfos id=60 count=15991lb # [ 152.651486] niks3-server[998]: 2026/09/20 10:53:23 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls5992worker1 # [ 152.660641] nix-grpc-daemon[1625]: time=2026-09-20T10:53:23.249Z level=INFO msg="Upload complete. (468ms)"5993lb # [ 152.657095] niks3-server[998]: 2026/09/20 10:53:23 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete5994lb # [ 152.661610] niks3-server[998]: 2026/09/20 10:53:23 INFO Completed upload id=605995lb # [ 152.664189] niks3-server[998]: 2026/09/20 10:53:23 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo5996worker1 # [ 152.668719] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=7525997worker1 # [ 152.679799] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533505998worker1 # [ 152.685892] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5999worker1 # [ 152.690895] nix-daemon[833]: reaped child process 1874, status = succeeded6000worker1 # [ 152.702794] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)6001worker1 # [ 153.723963] nix-daemon[833]: reaped child process 1888, status = succeeded6002worker1 # [ 153.880485] nix-daemon[833]: accepted connection from pid 1903, user nix-grpc-daemon (trusted)6003worker1 # [ 153.900106] nix-daemon[833]: reaped child process 1906, status = succeeded6004lb # [ 153.908800] niks3-server[998]: 2026/09/20 10:53:24 INFO Received uploads request method=POST path=/api/pending_closures6005worker1 # [ 153.923271] nix-grpc-daemon[1625]: time=2026-09-20T10:53:24.510Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6006worker1 # [ 153.924880] nix-grpc-daemon[1625]: time=2026-09-20T10:53:24.510Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6007lb # [ 153.945091] niks3-server[998]: 2026/09/20 10:53:24 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6008lb # [ 153.957667] niks3-server[998]: 2026/09/20 10:53:24 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6009worker1 # [ 153.970640] nix-grpc-daemon[1625]: time=2026-09-20T10:53:24.558Z level=INFO msg="Uploading 1 narinfos"6010lb # [ 153.969777] niks3-server[998]: 2026/09/20 10:53:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6011lb # [ 153.976942] niks3-server[998]: 2026/09/20 10:53:24 INFO Signed narinfos id=61 count=16012lb # [ 153.979091] niks3-server[998]: 2026/09/20 10:53:24 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6013lb # [ 153.985857] niks3-server[998]: 2026/09/20 10:53:24 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6014lb # [ 153.990458] niks3-server[998]: 2026/09/20 10:53:24 INFO Completed upload id=616015worker1 # [ 153.994685] nix-grpc-daemon[1625]: time=2026-09-20T10:53:24.583Z level=INFO msg="Upload complete. (283ms)"6016lb # [ 153.992870] niks3-server[998]: 2026/09/20 10:53:24 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6017worker2 # [ 153.994088] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:24Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16018worker1 # [ 154.008601] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16019worker1 # [ 154.019750] nix-daemon[833]: reaped child process 1886, status = succeeded6020worker1 # [ 154.048694] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533506021worker1 # [ 154.064511] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533506022worker1 # [ 154.078885] nix-grpc-daemon[1625]: time=2026-09-20T10:53:24.667Z level=INFO msg="All 2 paths already cached"6023worker1 # [ 154.088106] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533506024worker1 # [ 154.101868] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)6025worker1 # [ 154.297708] nix-daemon[833]: accepted connection from pid 1910, user nix-grpc-daemon (trusted)6026worker1 # [ 154.316682] nix-daemon[833]: reaped child process 1913, status = succeeded6027worker1 # [ 154.491300] nix-daemon[833]: accepted connection from pid 1915, user nix-grpc-daemon (trusted)6028worker1 # [ 154.511059] nix-daemon[833]: reaped child process 1918, status = succeeded6029lb # [ 154.518204] niks3-server[998]: 2026/09/20 10:53:25 INFO Received uploads request method=POST path=/api/pending_closures6030worker1 # [ 154.531146] nix-grpc-daemon[1625]: time=2026-09-20T10:53:25.119Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6031worker1 # [ 154.532740] nix-grpc-daemon[1625]: time=2026-09-20T10:53:25.119Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6032lb # [ 154.548865] niks3-server[998]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6033worker1 # [ 154.567067] nix-grpc-daemon[1625]: time=2026-09-20T10:53:25.155Z level=INFO msg="Uploading 1 narinfos"6034lb # [ 154.566522] niks3-server[998]: 2026/09/20 10:53:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6035lb # [ 154.576304] niks3-server[998]: 2026/09/20 10:53:25 INFO Signed narinfos id=62 count=16036lb # [ 154.581815] niks3-server[998]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6037worker1 # [ 154.593269] nix-grpc-daemon[1625]: time=2026-09-20T10:53:25.181Z level=INFO msg="Upload complete. (475ms)"6038lb # [ 154.591093] niks3-server[998]: 2026/09/20 10:53:25 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6039lb # [ 154.597400] niks3-server[998]: 2026/09/20 10:53:25 INFO Completed upload id=626040lb # [ 154.600874] niks3-server[998]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6041worker1 # [ 154.600302] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=7526042worker1 # [ 154.613799] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533506043worker1 # [ 154.622922] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)6044worker1 # [ 154.625170] nix-daemon[833]: reaped child process 1908, status = succeeded6045worker1 # [ 154.638327] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)6046worker1 # [ 155.659297] nix-daemon[833]: reaped child process 1922, status = succeeded6047worker1 # [ 155.813363] nix-daemon[833]: accepted connection from pid 1937, user nix-grpc-daemon (trusted)6048worker1 # [ 155.832646] nix-daemon[833]: reaped child process 1940, status = succeeded6049lb # [ 155.846182] niks3-server[998]: 2026/09/20 10:53:26 INFO Received uploads request method=POST path=/api/pending_closures6050worker1 # [ 155.860404] nix-grpc-daemon[1625]: time=2026-09-20T10:53:26.447Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6051worker1 # [ 155.861857] nix-grpc-daemon[1625]: time=2026-09-20T10:53:26.447Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6052lb # [ 155.882966] niks3-server[998]: 2026/09/20 10:53:26 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6053lb # [ 155.899015] niks3-server[998]: 2026/09/20 10:53:26 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6054lb # [ 155.910940] niks3-server[998]: 2026/09/20 10:53:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6055worker1 # [ 155.919340] nix-grpc-daemon[1625]: time=2026-09-20T10:53:26.507Z level=INFO msg="Uploading 1 narinfos"6056lb # [ 155.918351] niks3-server[998]: 2026/09/20 10:53:26 INFO Signed narinfos id=63 count=16057lb # [ 155.922774] niks3-server[998]: 2026/09/20 10:53:26 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6058lb # [ 155.928589] niks3-server[998]: 2026/09/20 10:53:26 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6059lb # [ 155.934615] niks3-server[998]: 2026/09/20 10:53:26 INFO Completed upload id=636060worker1 # [ 155.938109] nix-grpc-daemon[1625]: time=2026-09-20T10:53:26.526Z level=INFO msg="Upload complete. (291ms)"6061lb # [ 155.936960] niks3-server[998]: 2026/09/20 10:53:26 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6062worker1 # [ 155.949077] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16063worker1 # [ 155.965686] nix-daemon[833]: reaped child process 1920, status = succeeded6064client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.09 seconds)6065worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6066worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6067client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16068worker2 # [ 156.337400] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346186069worker1 # [ 156.357266] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533506070worker2 # [ 156.374148] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:26Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06071client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.32 seconds)6072(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 20.49 seconds)6073subtest: low disk drains a worker and builds go to the other6074worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6075worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.10 seconds)6076worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6077worker1 # [ 157.697881] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:28Z level=info event=unhealthy reason=min_free6078worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6079client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26080client # don't know how to build these paths:6081client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6082worker1 # [ 158.888516] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:533506083worker2 # [ 158.883226] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346186084worker2 # [ 158.913106] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06085worker2 # [ 158.920447] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16086worker2 # [ 158.959408] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346186087worker2 # [ 158.976074] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346186088client # copying 1 paths to 'lb:50051'...6089client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6090worker2 # [ 158.993106] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346186091worker2 # [ 159.008186] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)6092worker2 # [ 159.215827] nix-daemon[833]: accepted connection from pid 1709, user nix-grpc-daemon (trusted)6093worker2 # [ 159.232821] nix-daemon[833]: reaped child process 1712, status = succeeded6094worker2 # [ 159.413766] nix-daemon[833]: accepted connection from pid 1714, user nix-grpc-daemon (trusted)6095worker2 # [ 159.433819] nix-daemon[833]: reaped child process 1717, status = succeeded6096lb # [ 159.451242] niks3-server[998]: 2026/09/20 10:53:30 INFO Received uploads request method=POST path=/api/pending_closures6097worker2 # [ 159.459575] nix-grpc-daemon[1503]: time=2026-09-20T10:53:30.065Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6098worker2 # [ 159.461293] nix-grpc-daemon[1503]: time=2026-09-20T10:53:30.065Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6099lb # [ 159.486649] niks3-server[998]: 2026/09/20 10:53:30 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6100lb # [ 159.499257] niks3-server[998]: 2026/09/20 10:53:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6101worker2 # [ 159.501262] nix-grpc-daemon[1503]: time=2026-09-20T10:53:30.107Z level=INFO msg="Uploading 1 narinfos"6102lb # [ 159.510783] niks3-server[998]: 2026/09/20 10:53:30 INFO Signed narinfos id=64 count=16103lb # [ 159.516460] niks3-server[998]: 2026/09/20 10:53:30 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6104lb # [ 159.527953] niks3-server[998]: 2026/09/20 10:53:30 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6105lb # [ 159.533431] niks3-server[998]: 2026/09/20 10:53:30 INFO Completed upload id=646106worker2 # [ 159.528423] nix-grpc-daemon[1503]: time=2026-09-20T10:53:30.135Z level=INFO msg="Upload complete. (503ms)"6107lb # [ 159.536281] niks3-server[998]: 2026/09/20 10:53:30 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6108worker2 # [ 159.535722] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=5126109worker2 # [ 159.551401] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346186110worker2 # [ 159.560443] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)6111worker2 # [ 159.565776] nix-daemon[833]: reaped child process 1707, status = succeeded6112client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6113client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6114worker2 # [ 159.580260] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)6115lb # [ 160.301252] envoy[916]: conn peer=[2001:db8:1::1]:45092 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27131 tx=10789 ms=197806116client # farm-a> LOG-farm-a-drain6117worker2 # [ 160.609820] nix-daemon[833]: reaped child process 1721, status = succeeded6118worker2 # [ 160.774079] nix-daemon[833]: accepted connection from pid 1736, user nix-grpc-daemon (trusted)6119worker2 # [ 160.796236] nix-daemon[833]: reaped child process 1739, status = succeeded6120lb # [ 160.307566] envoy[916]: conn peer=[2001:db8:1::1]:54620 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=880 tx=483 ms=636121lb # [ 160.814082] niks3-server[998]: 2026/09/20 10:53:31 INFO Received uploads request method=POST path=/api/pending_closures6122worker2 # [ 160.824432] nix-grpc-daemon[1503]: time=2026-09-20T10:53:31.429Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6123worker2 # [ 160.826009] nix-grpc-daemon[1503]: time=2026-09-20T10:53:31.429Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6124lb # [ 160.861290] niks3-server[998]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6125lb # [ 160.874288] niks3-server[998]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6126lb # [ 160.883819] niks3-server[998]: 2026/09/20 10:53:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6127worker2 # [ 160.885230] nix-grpc-daemon[1503]: time=2026-09-20T10:53:31.491Z level=INFO msg="Uploading 1 narinfos"6128lb # [ 160.892871] niks3-server[998]: 2026/09/20 10:53:31 INFO Signed narinfos id=65 count=16129lb # [ 160.899374] niks3-server[998]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6130lb # [ 160.909619] niks3-server[998]: 2026/09/20 10:53:31 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6131lb # [ 160.915507] niks3-server[998]: 2026/09/20 10:53:31 INFO Completed upload id=656132worker2 # [ 160.909926] nix-grpc-daemon[1503]: time=2026-09-20T10:53:31.516Z level=INFO msg="Upload complete. (318ms)"6133lb # [ 160.918405] niks3-server[998]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6134worker2 # [ 160.927959] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16135worker2 # [ 160.944145] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06136worker2 # [ 160.948005] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16137worker2 # [ 160.951866] nix-daemon[833]: reaped child process 1719, status = succeeded6138worker2 # [ 160.971302] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346186139worker2 # [ 160.986819] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346186140worker2 # [ 161.001256] nix-grpc-daemon[1503]: time=2026-09-20T10:53:31.608Z level=INFO msg="All 1 paths already cached"6141client # copying 1 paths to 'lb:50051'...6142client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6143worker2 # [ 161.011791] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346186144worker2 # [ 161.025707] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)6145worker2 # [ 161.235786] nix-daemon[833]: accepted connection from pid 1745, user nix-grpc-daemon (trusted)6146worker2 # [ 161.253104] nix-daemon[833]: reaped child process 1748, status = succeeded6147worker2 # [ 161.430254] nix-daemon[833]: accepted connection from pid 1750, user nix-grpc-daemon (trusted)6148worker2 # [ 161.447875] nix-daemon[833]: reaped child process 1753, status = succeeded6149lb # [ 161.465173] niks3-server[998]: 2026/09/20 10:53:32 INFO Received uploads request method=POST path=/api/pending_closures6150worker2 # [ 161.469742] nix-grpc-daemon[1503]: time=2026-09-20T10:53:32.076Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6151worker2 # [ 161.471275] nix-grpc-daemon[1503]: time=2026-09-20T10:53:32.076Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6152lb # [ 161.492656] niks3-server[998]: 2026/09/20 10:53:32 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6153lb # [ 161.506938] niks3-server[998]: 2026/09/20 10:53:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6154worker2 # [ 161.507847] nix-grpc-daemon[1503]: time=2026-09-20T10:53:32.114Z level=INFO msg="Uploading 1 narinfos"6155lb # [ 161.519878] niks3-server[998]: 2026/09/20 10:53:32 INFO Signed narinfos id=66 count=16156lb # [ 161.524993] niks3-server[998]: 2026/09/20 10:53:32 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6157lb # [ 161.531921] niks3-server[998]: 2026/09/20 10:53:32 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6158worker2 # [ 161.531359] nix-grpc-daemon[1503]: time=2026-09-20T10:53:32.138Z level=INFO msg="Upload complete. (489ms)"6159lb # [ 161.537190] niks3-server[998]: 2026/09/20 10:53:32 INFO Completed upload id=666160lb # [ 161.540788] niks3-server[998]: 2026/09/20 10:53:32 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6161worker2 # [ 161.544357] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=6326162worker2 # [ 161.554911] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346186163worker2 # [ 161.561740] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)6164worker2 # [ 161.566329] nix-daemon[833]: reaped child process 1743, status = succeeded6165client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6166client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6167worker2 # [ 161.578504] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)6168worker2 # [ 162.598040] nix-daemon[833]: reaped child process 1757, status = succeeded6169client # farm-b> LOG-farm-b-drain6170worker2 # [ 162.761125] nix-daemon[833]: accepted connection from pid 1772, user nix-grpc-daemon (trusted)6171worker2 # [ 162.778200] nix-daemon[833]: reaped child process 1775, status = succeeded6172lb # [ 162.799179] niks3-server[998]: 2026/09/20 10:53:33 INFO Received uploads request method=POST path=/api/pending_closures6173worker2 # [ 162.804409] nix-grpc-daemon[1503]: time=2026-09-20T10:53:33.407Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6174worker2 # [ 162.805949] nix-grpc-daemon[1503]: time=2026-09-20T10:53:33.407Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6175lb # [ 162.830749] niks3-server[998]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6176lb # [ 162.844585] niks3-server[998]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6177lb # [ 162.854025] niks3-server[998]: 2026/09/20 10:53:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6178worker2 # [ 162.854271] nix-grpc-daemon[1503]: time=2026-09-20T10:53:33.460Z level=INFO msg="Uploading 1 narinfos"6179lb # [ 162.862932] niks3-server[998]: 2026/09/20 10:53:33 INFO Signed narinfos id=67 count=16180lb # [ 162.868236] niks3-server[998]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6181lb # [ 162.875667] niks3-server[998]: 2026/09/20 10:53:33 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6182lb # [ 162.882168] niks3-server[998]: 2026/09/20 10:53:33 INFO Completed upload id=676183worker2 # [ 162.877911] nix-grpc-daemon[1503]: time=2026-09-20T10:53:33.483Z level=INFO msg="Upload complete. (289ms)"6184lb # [ 162.884401] niks3-server[998]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6185worker2 # [ 162.892223] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16186worker2 # [ 162.904674] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06187worker2 # [ 162.908171] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16188worker2 # [ 162.911506] nix-daemon[833]: reaped child process 1755, status = succeeded6189worker2 # [ 162.934715] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346186190worker2 # [ 162.949837] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346186191worker2 # [ 162.963161] nix-grpc-daemon[1503]: time=2026-09-20T10:53:33.569Z level=INFO msg="All 2 paths already cached"6192client # copying 1 paths to 'lb:50051'...6193client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6194worker2 # [ 162.973755] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346186195worker2 # [ 162.987406] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)6196worker2 # [ 163.186618] nix-daemon[833]: accepted connection from pid 1781, user nix-grpc-daemon (trusted)6197worker2 # [ 163.206426] nix-daemon[833]: reaped child process 1784, status = succeeded6198worker2 # [ 163.384401] nix-daemon[833]: accepted connection from pid 1786, user nix-grpc-daemon (trusted)6199worker2 # [ 163.402940] nix-daemon[833]: reaped child process 1789, status = succeeded6200lb # [ 163.419496] niks3-server[998]: 2026/09/20 10:53:34 INFO Received uploads request method=POST path=/api/pending_closures6201worker2 # [ 163.424105] nix-grpc-daemon[1503]: time=2026-09-20T10:53:34.030Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6202worker2 # [ 163.425587] nix-grpc-daemon[1503]: time=2026-09-20T10:53:34.030Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6203lb # [ 163.452156] niks3-server[998]: 2026/09/20 10:53:34 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6204worker2 # [ 163.468300] nix-grpc-daemon[1503]: time=2026-09-20T10:53:34.074Z level=INFO msg="Uploading 1 narinfos"6205lb # [ 163.467961] niks3-server[998]: 2026/09/20 10:53:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6206lb # [ 163.480467] niks3-server[998]: 2026/09/20 10:53:34 INFO Signed narinfos id=68 count=16207lb # [ 163.485741] niks3-server[998]: 2026/09/20 10:53:34 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6208lb # [ 163.493418] niks3-server[998]: 2026/09/20 10:53:34 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6209lb # [ 163.498337] niks3-server[998]: 2026/09/20 10:53:34 INFO Completed upload id=686210worker2 # [ 163.493124] nix-grpc-daemon[1503]: time=2026-09-20T10:53:34.099Z level=INFO msg="Upload complete. (490ms)"6211lb # [ 163.501160] niks3-server[998]: 2026/09/20 10:53:34 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6212worker2 # [ 163.500163] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=7606213worker2 # [ 163.514445] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346186214worker2 # [ 163.521281] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)6215worker2 # [ 163.526993] nix-daemon[833]: reaped child process 1779, status = succeeded6216client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6217worker2 # [ 163.540209] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)6218client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6219client # farm-top> LOG-farm-top-drain6220worker2 # [ 164.982266] nix-daemon[833]: reaped child process 1793, status = succeeded6221worker2 # [ 165.160629] nix-daemon[833]: accepted connection from pid 1808, user nix-grpc-daemon (trusted)6222worker2 # [ 165.176884] nix-daemon[833]: reaped child process 1811, status = succeeded6223lb # [ 165.197109] niks3-server[998]: 2026/09/20 10:53:35 INFO Received uploads request method=POST path=/api/pending_closures6224worker2 # [ 165.204298] nix-grpc-daemon[1503]: time=2026-09-20T10:53:35.809Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6225worker2 # [ 165.205931] nix-grpc-daemon[1503]: time=2026-09-20T10:53:35.809Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6226lb # [ 165.228800] niks3-server[998]: 2026/09/20 10:53:35 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6227lb # [ 165.246213] niks3-server[998]: 2026/09/20 10:53:35 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6228lb # [ 165.259111] niks3-server[998]: 2026/09/20 10:53:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6229worker2 # [ 165.260149] nix-grpc-daemon[1503]: time=2026-09-20T10:53:35.866Z level=INFO msg="Uploading 1 narinfos"6230lb # [ 165.269762] niks3-server[998]: 2026/09/20 10:53:35 INFO Signed narinfos id=69 count=16231lb # [ 165.275867] niks3-server[998]: 2026/09/20 10:53:35 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6232worker2 # [ 165.278254] nix-grpc-daemon[1503]: time=2026-09-20T10:53:35.885Z level=INFO msg="Upload complete. (325ms)"6233lb # [ 165.284321] niks3-server[998]: 2026/09/20 10:53:35 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6234lb # [ 165.290622] niks3-server[998]: 2026/09/20 10:53:35 INFO Completed upload id=696235lb # [ 165.294677] niks3-server[998]: 2026/09/20 10:53:35 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6236worker2 # [ 165.293343] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16237worker2 # [ 165.310284] nix-daemon[833]: reaped child process 1791, status = succeeded6238client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.71 seconds)6239client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6240client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds)6241worker1: must succeed: rm /nix/.rw-store/fill6242worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6243worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6244worker1 # [ 166.709416] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:37Z level=info event=healthy reason=min_free6245worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds)6246(finished: subtest: low disk drains a worker and builds go to the other, in 10.52 seconds)6247(finished: run the VM test script, in 167.83 seconds)6248test script finished in 168.12s6249cleanup6250kill QemuMachine (pid 49)6251client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6252kill QemuMachine (pid 50)6253lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6254kill QemuMachine (pid 51)6255worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6256kill QemuMachine (pid 52)6257worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6258(finished: cleanup, in 1.04 seconds)6259additionally exposed symbols:6260 client, lb, worker1, worker2,6261 vlan1,6262 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh