vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #219
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2: QEMU running (pid 52)13worker2 # Disk image does not exist, creating the virtualisation disk image...14worker2 # Formatting '/build/vm-state-worker2/tmp.5SHSfUGaYB', fmt=raw size=107374182415worker2 # mke2fs 1.47.4 (6-Mar-2025)16worker2 # Discarding device blocks: 0/262144 done17worker1 # Disk image does not exist, creating the virtualisation disk image...18worker1: QEMU running (pid 51)19worker1 # Formatting '/build/vm-state-worker1/tmp.lF1EoxYDEu', fmt=raw size=107374182420worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes21client # Disk image does not exist, creating the virtualisation disk image...22client: QEMU running (pid 50)23worker1 # mke2fs 1.47.4 (6-Mar-2025)24worker2 # Filesystem UUID: 765cbe72-e471-42d7-823e-0cb465f20eb125worker1 # Discarding device blocks: 0/262144 done26worker2 # Superblock backups stored on blocks:27worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes28worker2 # 32768, 98304, 163840, 22937629worker1 # Filesystem UUID: 496e9f48-b36f-4463-ac22-bc775a755ada30worker2 # 31worker1 # Superblock backups stored on blocks:32worker2 # Allocating group tables: 0/8 done33worker1 # 32768, 98304, 163840, 22937634worker1 # 35worker1 # Allocating group tables: 0/8 done36client # Formatting '/build/vm-state-client/tmp.7tynefua3h', fmt=raw size=107374182437worker1 # Writing inode tables: 0/8 done38client # mke2fs 1.47.4 (6-Mar-2025)39worker1 # Creating journal (8192 blocks): done40client # Discarding device blocks: 0/262144 done41worker1 # Writing superblocks and filesystem accounting information: 0/8 done42client # Creating filesystem with 262144 4k blocks and 65536 inodes43worker1 # 44worker2 # Writing inode tables: 0/8 done45client # Filesystem UUID: 643ff5cf-0743-43ac-ab6e-26dc850462ed46worker1 # Virtualisation disk image created.47client # Superblock backups stored on blocks:48worker2 # Creating journal (8192 blocks): done49client # 32768, 98304, 163840, 22937650worker2 # Writing superblocks and filesystem accounting information: 0/8 done51client # 52worker2 # 53client # Allocating group tables: 0/8 done54worker2 # Virtualisation disk image created.55client # Writing inode tables: 0/8 done56client # Creating journal (8192 blocks): done57client # Writing superblocks and filesystem accounting information: 0/8 done58client # 59client # Virtualisation disk image created.60worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]61worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202662worker2 # [ 0.000000] KASLR enabled63worker2 # [ 0.000000] random: crng init done64worker2 # [ 0.000000] Machine model: linux,dummy-virt65worker2 # [ 0.000000] efi: UEFI not found.66worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT67worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]68worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]69worker2 # [ 0.000000] Zone ranges:70worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]71worker2 # [ 0.000000] DMA32 empty72worker2 # [ 0.000000] Normal empty73worker2 # [ 0.000000] Device empty74worker2 # [ 0.000000] Movable zone start for each node75worker2 # [ 0.000000] Early memory node ranges76worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]77worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]78worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000079worker2 # [ 0.000000] psci: probing for conduit method from DT.80worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.81worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs82worker2 # [ 0.000000] psci: Trusted OS migration not required83worker2 # [ 0.000000] psci: SMC Calling Convention v1.184worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)85worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u31129686worker2 # [ 0.000000] Detected PIPT I-cache on CPU087worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)88worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface89worker2 # [ 0.000000] CPU features: detected: Spectre-v490worker2 # [ 0.000000] CPU features: detected: Spectre-BHB91worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3892worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2393worker2 # [ 0.000000] alternatives: applying boot alternatives94worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/s6syxg8bzwd7qi9vjyhl2iymakwgwchl-nixos-system-worker2-test/init regInfo=/nix/store/fvllgs2lpjy4afj8ywraac45nnzswcyk-closure-info/registration console=ttyAMA0,115200n8 console=tty095worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/fvllgs2lpjy4afj8ywraac45nnzswcyk-closure-info/registration", will be passed to user space.96worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes97worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)98worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)99worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB100worker2 # [ 0.000000] software IO TLB: area num 1.101worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB102worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)103worker2 # [ 0.000000] Fallback order for Node 0: 0104worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216105worker2 # [ 0.000000] Policy zone: DMA106worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off107worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1108worker2 # [ 0.000000] allocated 3145728 bytes of page_ext109worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages110worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups111worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.112worker2 # [ 0.000000] rcu: RCU event tracing is enabled.113worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.114worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.115worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.116worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.117worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.118worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1119worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.120worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.121worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.122worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0123worker2 # [ 0.000000] GICv3: 256 SPIs implemented124worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented125worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq126worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI127worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0128worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000129worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]130worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)131worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)132worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000133worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000134worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.135worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns136worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).137worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns138worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns139worker2 # [ 0.000042] arm-pv: using stolen time PV140worker2 # [ 0.000547] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)141worker2 # [ 0.000728] Console: colour dummy device 80x25142worker2 # [ 0.000739] printk: legacy console [tty0] enabled143worker2 # [ 0.000963] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)144worker2 # [ 0.000971] pid_max: default: 32768 minimum: 301145worker2 # [ 0.001060] LSM: initializing lsm=capability,landlock,yama,bpf,ima146worker2 # [ 0.001286] landlock: Up and running.147worker2 # [ 0.001289] Yama: becoming mindful.148worker2 # [ 0.001909] LSM support for eBPF active149worker2 # [ 0.002054] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)150worker2 # [ 0.002087] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)151worker2 # [ 0.003294] cacheinfo: Unable to detect cache hierarchy for CPU 0152worker2 # [ 0.004396] rcu: Hierarchical SRCU implementation.153worker2 # [ 0.004401] rcu: Max phase no-delay instances is 1000.154worker2 # [ 0.005732] fsl-mc MSI: its@8080000 domain created155worker2 # [ 0.005824] EFI services will not be available.156worker2 # [ 0.005919] smp: Bringing up secondary CPUs ...157worker2 # [ 0.005930] smp: Brought up 1 node, 1 CPU158worker2 # [ 0.005933] SMP: Total of 1 processors activated.159worker2 # [ 0.005939] CPU: All CPU(s) started at EL1160worker2 # [ 0.005953] CPU features: detected: Branch Target Identification161worker2 # [ 0.005958] CPU features: detected: ARMv8.4 Translation Table Level162worker2 # [ 0.005966] CPU features: detected: Instruction cache invalidation not required for I/D coherence163worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]164worker2 # [ 0.005970] CPU features: detected: Data cache clean to the PoU not required for I/D coherence165worker2 # [ 0.005974] CPU features: detected: Common not Private translations166worker2 # [ 0.005977] CPU features: detected: CRC32 instructions167worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026168worker1 # [ 0.000000] KASLR enabled169worker2 # [ 0.005980] CPU features: detected: Data cache clean to Point of Deep Persistence170worker1 # [ 0.000000] random: crng init done171worker1 # [ 0.000000] Machine model: linux,dummy-virt172worker2 # [ 0.005984] CPU features: detected: Data cache clean to Point of Persistence173worker1 # [ 0.000000] efi: UEFI not found.174worker2 # [ 0.005987] CPU features: detected: Data independent timing control (DIT)175worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT176worker2 # [ 0.005990] CPU features: detected: E0PD177worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]178worker2 # [ 0.005992] CPU features: detected: Enhanced Counter Virtualization179worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]180worker1 # [ 0.000000] Zone ranges:181worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]182worker1 # [ 0.000000] DMA32 empty183worker2 # [ 0.005995] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)184worker1 # [ 0.000000] Normal empty185worker2 # [ 0.005999] CPU features: detected: Enhanced Virtualization Traps186worker1 # [ 0.000000] Device empty187client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]188worker1 # [ 0.000000] Movable zone start for each node189client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026190worker2 # [ 0.006002] CPU features: detected: Fine Grained Traps191client # [ 0.000000] KASLR enabled192worker2 # [ 0.006006] CPU features: detected: Generic authentication (architected QARMA5 algorithm)193client # [ 0.000000] random: crng init done194worker1 # [ 0.000000] Early memory node ranges195client # [ 0.000000] Machine model: linux,dummy-virt196worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]197client # [ 0.000000] efi: UEFI not found.198worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]199client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT200worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000201worker2 # [ 0.006010] CPU features: detected: RCpc load-acquire (LDAPR)202worker1 # [ 0.000000] psci: probing for conduit method from DT.203client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]204worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.205client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]206worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs207client # [ 0.000000] Zone ranges:208worker1 # [ 0.000000] psci: Trusted OS migration not required209client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]210worker1 # [ 0.000000] psci: SMC Calling Convention v1.1211client # [ 0.000000] DMA32 empty212worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)213client # [ 0.000000] Normal empty214worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296215client # [ 0.000000] Device empty216worker1 # [ 0.000000] Detected PIPT I-cache on CPU0217client # [ 0.000000] Movable zone start for each node218worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)219client # [ 0.000000] Early memory node ranges220worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface221client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]222worker1 # [ 0.000000] CPU features: detected: Spectre-v4223client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]224worker1 # [ 0.000000] CPU features: detected: Spectre-BHB225client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000226worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38227client # [ 0.000000] psci: probing for conduit method from DT.228worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23229client # [ 0.000000] psci: PSCIv1.3 detected in firmware.230worker1 # [ 0.000000] alternatives: applying boot alternatives231client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs232worker2 # [ 0.006013] CPU features: detected: LSE atomic instructions233client # [ 0.000000] psci: Trusted OS migration not required234worker2 # [ 0.006016] CPU features: detected: Privileged Access Never235client # [ 0.000000] psci: SMC Calling Convention v1.1236worker2 # [ 0.006019] CPU features: detected: PMUv3237client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)238worker2 # [ 0.006022] CPU features: detected: RAS Extension Support239client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296240client # [ 0.000000] Detected PIPT I-cache on CPU0241worker2 # [ 0.006025] CPU features: detected: RASv1p1 Extension Support242worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/d4fyzhbj17d2kjsvh8wc3bi4h1xp78az-nixos-system-worker1-test/init regInfo=/nix/store/1swg5l71zbz3z93iymnlqzyakxrz6g6q-closure-info/registration console=ttyAMA0,115200n8 console=tty0243client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)244worker2 # [ 0.006027] CPU features: detected: Random Number Generator245client # [ 0.000000] CPU features: detected: GICv3 CPU interface246worker2 # [ 0.006030] CPU features: detected: Speculation barrier (SB)247worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/1swg5l71zbz3z93iymnlqzyakxrz6g6q-closure-info/registration", will be passed to user space.248worker2 # [ 0.006033] CPU features: detected: Stage-2 Force Write-Back249worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes250worker2 # [ 0.006036] CPU features: detected: TLB range maintenance instructions251worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)252worker2 # [ 0.006041] CPU features: detected: Speculative Store Bypassing Safe (SSBS)253client # [ 0.000000] CPU features: detected: Spectre-v4254worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)255client # [ 0.000000] CPU features: detected: Spectre-BHB256worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB257worker1 # [ 0.000000] software IO TLB: area num 1.258worker2 # [ 0.006089] alternatives: applying system-wide alternatives259worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB260worker2 # [ 0.009318] CPU features: detected: BBM Level 2 without TLB conflict abort261worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)262worker2 # [ 0.009558] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)263worker1 # [ 0.000000] Fallback order for Node 0: 0264worker2 # [ 0.013655] devtmpfs: initialized265worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216266worker2 # [ 0.015832] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)267worker1 # [ 0.000000] Policy zone: DMA268worker2 # [ 0.015858] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).269worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off270worker2 # [ 0.016069] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL271client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38272worker2 # [ 0.016074] 0 pages in range for non-PLT usage273client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23274worker2 # [ 0.016075] 508288 pages in range for PLT usage275worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1276worker2 # [ 0.016205] pinctrl core: initialized pinctrl subsystem277worker1 # [ 0.000000] allocated 3145728 bytes of page_ext278worker2 # [ 0.017117] DMI not present or invalid.279worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages280worker2 # [ 0.020955] NET: Registered PF_NETLINK/PF_ROUTE protocol family281worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups282worker2 # [ 0.023366] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations283worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.284worker2 # [ 0.023570] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations285worker1 # [ 0.000000] rcu: RCU event tracing is enabled.286worker2 # [ 0.023773] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations287worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.288worker2 # [ 0.023802] audit: initializing netlink subsys (disabled)289worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.290worker2 # [ 0.024421] thermal_sys: Registered thermal governor 'fair_share'291worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.292worker2 # [ 0.024423] thermal_sys: Registered thermal governor 'bang_bang'293worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.294worker2 # [ 0.024427] thermal_sys: Registered thermal governor 'step_wise'295client # [ 0.000000] alternatives: applying boot alternatives296worker2 # [ 0.024432] thermal_sys: Registered thermal governor 'user_space'297client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gpf58crna23m3bj51fx82f4mmyq9cz2y-nixos-system-client-test/init regInfo=/nix/store/3mlqfzg214kshc0hlqx0k0v4hz50pak5-closure-info/registration console=ttyAMA0,115200n8 console=tty0298worker2 # [ 0.024435] thermal_sys: Registered thermal governor 'power_allocator'299client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/3mlqfzg214kshc0hlqx0k0v4hz50pak5-closure-info/registration", will be passed to user space.300worker2 # [ 0.024460] audit: type=2000 audit(0.020:1): state=initialized audit_enabled=0 res=1301client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes302worker2 # [ 0.024470] cpuidle: using governor ladder303client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)304worker2 # [ 0.024476] cpuidle: using governor menu305client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)306worker2 # [ 0.024670] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.307client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB308worker2 # [ 0.024687] ASID allocator initialised with 65536 entries309client # [ 0.000000] software IO TLB: area num 1.310worker2 # [ 0.026019] Serial: AMBA PL011 UART driver311client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB312worker2 # [ 0.031457] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1313worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.314worker2 # [ 0.031625] printk: console [ttyAMA0] enabled315worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1316client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)317worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.318client # [ 0.000000] Fallback order for Node 0: 0319worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.320client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216321worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.322client # [ 0.000000] Policy zone: DMA323worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0324client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off325worker1 # [ 0.000000] GICv3: 256 SPIs implemented326client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1327worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented328client # [ 0.000000] allocated 3145728 bytes of page_ext329worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq330client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages331worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI332client # [ 0.000000] ftrace: allocated 294 pages with 4 groups333worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0334client # [ 0.000000] rcu: Hierarchical RCU implementation.335worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000336client # [ 0.000000] rcu: RCU event tracing is enabled.337worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]338client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.339worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)340client # [ 0.000000] Trampoline variant of Tasks RCU enabled.341worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)342client # [ 0.000000] Rude variant of Tasks RCU enabled.343worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000344client # [ 0.000000] Tracing variant of Tasks RCU enabled.345worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000346client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.347worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.348client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1349worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns350client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.351worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).352client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.353worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns354client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.355worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns356client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0357worker1 # [ 0.000040] arm-pv: using stolen time PV358client # [ 0.000000] GICv3: 256 SPIs implemented359worker1 # [ 0.000626] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)360client # [ 0.000000] GICv3: 0 Extended SPIs implemented361worker1 # [ 0.000832] Console: colour dummy device 80x25362client # [ 0.000000] Root IRQ handler: gic_handle_irq363worker1 # [ 0.000841] printk: legacy console [tty0] enabled364client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI365worker1 # [ 0.001039] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)366client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0367worker2 # [ 0.156562] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages368worker1 # [ 0.001047] pid_max: default: 32768 minimum: 301369client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000370worker2 # [ 0.156588] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page371client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]372worker2 # [ 0.156594] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages373client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)374worker2 # [ 0.156599] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page375client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)376worker2 # [ 0.156603] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages377client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000378worker2 # [ 0.156607] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page379client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000380worker2 # [ 0.156612] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages381client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.382worker2 # [ 0.156616] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page383client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns384worker2 # [ 0.170176] fbcon: Taking over console385client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).386worker2 # [ 0.170197] ACPI: Interpreter disabled.387client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns388worker2 # [ 0.176315] iommu: Default domain type: Translated389client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns390worker2 # [ 0.176329] iommu: DMA domain TLB invalidation policy: strict mode391client # [ 0.000052] arm-pv: using stolen time PV392worker2 # [ 0.176757] SCSI subsystem initialized393client # [ 0.001158] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)394worker2 # [ 0.178836] usbcore: registered new interface driver usbfs395client # [ 0.001383] Console: colour dummy device 80x25396worker2 # [ 0.178872] usbcore: registered new interface driver hub397client # [ 0.001392] printk: legacy console [tty0] enabled398worker2 # [ 0.178893] usbcore: registered new device driver usb399client # [ 0.001607] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)400worker2 # [ 0.179223] pps_core: LinuxPPS API ver. 1 registered401client # [ 0.001615] pid_max: default: 32768 minimum: 301402worker2 # [ 0.179233] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>403client # [ 0.001702] LSM: initializing lsm=capability,landlock,yama,bpf,ima404worker2 # [ 0.179244] PTP clock support registered405client # [ 0.001907] landlock: Up and running.406worker2 # [ 0.179308] EDAC MC: Ver: 3.0.0407client # [ 0.001913] Yama: becoming mindful.408worker2 # [ 0.183844] scmi_core: SCMI protocol bus registered409client # [ 0.002645] LSM support for eBPF active410worker2 # [ 0.184879] FPGA manager framework411client # [ 0.002838] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)412worker2 # [ 0.190809] vgaarb: loaded413client # [ 0.002871] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)414worker2 # [ 0.191545] clocksource: Switched to clocksource arch_sys_counter415client # [ 0.004166] cacheinfo: Unable to detect cache hierarchy for CPU 0416worker2 # [ 0.192243] VFS: Disk quotas dquot_6.6.0417client # [ 0.004893] rcu: Hierarchical SRCU implementation.418worker2 # [ 0.192279] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)419client # [ 0.004898] rcu: Max phase no-delay instances is 1000.420worker2 # [ 0.195250] netfs: FS-Cache loaded421client # [ 0.006147] fsl-mc MSI: its@8080000 domain created422worker2 # [ 0.202620] pnp: PnP ACPI: disabled423client # [ 0.006241] EFI services will not be available.424worker2 # [ 0.206488] NET: Registered PF_INET protocol family425client # [ 0.006328] smp: Bringing up secondary CPUs ...426worker2 # [ 0.206828] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)427client # [ 0.006337] smp: Brought up 1 node, 1 CPU428worker1 # [ 0.001123] LSM: initializing lsm=capability,landlock,yama,bpf,ima429client # [ 0.006340] SMP: Total of 1 processors activated.430worker1 # [ 0.001339] landlock: Up and running.431client # [ 0.006346] CPU: All CPU(s) started at EL1432worker1 # [ 0.001342] Yama: becoming mindful.433client # [ 0.006360] CPU features: detected: Branch Target Identification434worker1 # [ 0.002854] LSM support for eBPF active435client # [ 0.006364] CPU features: detected: ARMv8.4 Translation Table Level436worker1 # [ 0.003139] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)437client # [ 0.006367] CPU features: detected: Instruction cache invalidation not required for I/D coherence438worker1 # [ 0.003174] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)439client # [ 0.006371] CPU features: detected: Data cache clean to the PoU not required for I/D coherence440worker1 # [ 0.004479] cacheinfo: Unable to detect cache hierarchy for CPU 0441client # [ 0.006374] CPU features: detected: Common not Private translations442worker1 # [ 0.041360] rcu: Hierarchical SRCU implementation.443client # [ 0.006377] CPU features: detected: CRC32 instructions444worker1 # [ 0.041369] rcu: Max phase no-delay instances is 1000.445client # [ 0.006380] CPU features: detected: Data cache clean to Point of Deep Persistence446worker2 # [ 0.252313] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)447worker1 # [ 0.042662] fsl-mc MSI: its@8080000 domain created448client # [ 0.006384] CPU features: detected: Data cache clean to Point of Persistence449worker2 # [ 0.252387] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)450client # [ 0.006388] CPU features: detected: Data independent timing control (DIT)451worker2 # [ 0.252425] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)452client # [ 0.006391] CPU features: detected: E0PD453worker2 # [ 0.252524] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)454client # [ 0.006393] CPU features: detected: Enhanced Counter Virtualization455worker2 # [ 0.252673] TCP: Hash tables configured (established 16384 bind 16384)456client # [ 0.006396] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)457worker2 # [ 0.252782] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)458client # [ 0.006399] CPU features: detected: Enhanced Virtualization Traps459worker2 # [ 0.252833] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)460client # [ 0.006402] CPU features: detected: Fine Grained Traps461worker2 # [ 0.252917] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)462client # [ 0.006406] CPU features: detected: Generic authentication (architected QARMA5 algorithm)463worker2 # [ 0.253032] NET: Registered PF_UNIX/PF_LOCAL protocol family464client # [ 0.006411] CPU features: detected: RCpc load-acquire (LDAPR)465worker2 # [ 0.253059] NET: Registered PF_XDP protocol family466client # [ 0.006414] CPU features: detected: LSE atomic instructions467worker1 # [ 0.042759] EFI services will not be available.468client # [ 0.006417] CPU features: detected: Privileged Access Never469worker1 # [ 0.042889] smp: Bringing up secondary CPUs ...470client # [ 0.006420] CPU features: detected: PMUv3471worker1 # [ 0.042900] smp: Brought up 1 node, 1 CPU472client # [ 0.006422] CPU features: detected: RAS Extension Support473worker1 # [ 0.042904] SMP: Total of 1 processors activated.474client # [ 0.006425] CPU features: detected: RASv1p1 Extension Support475worker1 # [ 0.042910] CPU: All CPU(s) started at EL1476client # [ 0.006428] CPU features: detected: Random Number Generator477worker1 # [ 0.042924] CPU features: detected: Branch Target Identification478client # [ 0.006430] CPU features: detected: Speculation barrier (SB)479worker1 # [ 0.042929] CPU features: detected: ARMv8.4 Translation Table Level480client # [ 0.006433] CPU features: detected: Stage-2 Force Write-Back481worker1 # [ 0.042933] CPU features: detected: Instruction cache invalidation not required for I/D coherence482client # [ 0.006436] CPU features: detected: TLB range maintenance instructions483worker1 # [ 0.042936] CPU features: detected: Data cache clean to the PoU not required for I/D coherence484client # [ 0.006441] CPU features: detected: Speculative Store Bypassing Safe (SSBS)485worker1 # [ 0.042940] CPU features: detected: Common not Private translations486client # [ 0.006481] alternatives: applying system-wide alternatives487worker1 # [ 0.042943] CPU features: detected: CRC32 instructions488client # [ 0.009910] CPU features: detected: BBM Level 2 without TLB conflict abort489worker1 # [ 0.042946] CPU features: detected: Data cache clean to Point of Deep Persistence490client # [ 0.010116] Memory: 1406496K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)491worker1 # [ 0.042950] CPU features: detected: Data cache clean to Point of Persistence492client # [ 0.012088] devtmpfs: initialized493worker1 # [ 0.042953] CPU features: detected: Data independent timing control (DIT)494client # [ 0.015378] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)495worker1 # [ 0.042956] CPU features: detected: E0PD496client # [ 0.015405] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).497worker1 # [ 0.042959] CPU features: detected: Enhanced Counter Virtualization498client # [ 0.015608] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL499worker1 # [ 0.042961] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)500client # [ 0.015613] 0 pages in range for non-PLT usage501worker1 # [ 0.042965] CPU features: detected: Enhanced Virtualization Traps502client # [ 0.015614] 508288 pages in range for PLT usage503worker1 # [ 0.042968] CPU features: detected: Fine Grained Traps504client # [ 0.015745] pinctrl core: initialized pinctrl subsystem505worker1 # [ 0.042971] CPU features: detected: Generic authentication (architected QARMA5 algorithm)506client # [ 0.016580] DMI not present or invalid.507worker1 # [ 0.042977] CPU features: detected: RCpc load-acquire (LDAPR)508client # [ 0.022794] NET: Registered PF_NETLINK/PF_ROUTE protocol family509worker1 # [ 0.042980] CPU features: detected: LSE atomic instructions510client # [ 0.025847] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations511worker1 # [ 0.042983] CPU features: detected: Privileged Access Never512client # [ 0.026068] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations513worker1 # [ 0.042985] CPU features: detected: PMUv3514client # [ 0.026293] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations515worker1 # [ 0.042988] CPU features: detected: RAS Extension Support516client # [ 0.026327] audit: initializing netlink subsys (disabled)517worker1 # [ 0.042990] CPU features: detected: RASv1p1 Extension Support518client # [ 0.026994] thermal_sys: Registered thermal governor 'fair_share'519worker1 # [ 0.042993] CPU features: detected: Random Number Generator520client # [ 0.026997] thermal_sys: Registered thermal governor 'bang_bang'521worker1 # [ 0.042995] CPU features: detected: Speculation barrier (SB)522client # [ 0.027001] thermal_sys: Registered thermal governor 'step_wise'523worker1 # [ 0.042998] CPU features: detected: Stage-2 Force Write-Back524client # [ 0.027007] thermal_sys: Registered thermal governor 'user_space'525worker1 # [ 0.043001] CPU features: detected: TLB range maintenance instructions526client # [ 0.027010] thermal_sys: Registered thermal governor 'power_allocator'527worker1 # [ 0.043006] CPU features: detected: Speculative Store Bypassing Safe (SSBS)528client # [ 0.027041] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1529worker1 # [ 0.043043] alternatives: applying system-wide alternatives530client # [ 0.027052] cpuidle: using governor ladder531worker1 # [ 0.048172] CPU features: detected: BBM Level 2 without TLB conflict abort532client # [ 0.027057] cpuidle: using governor menu533worker1 # [ 0.048401] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)534client # [ 0.027264] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.535worker1 # [ 0.049241] devtmpfs: initialized536client # [ 0.027283] ASID allocator initialised with 65536 entries537worker1 # [ 0.051489] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)538client # [ 0.029891] Serial: AMBA PL011 UART driver539worker1 # [ 0.051516] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).540client # [ 0.035973] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1541worker1 # [ 0.051763] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL542client # [ 0.036173] printk: console [ttyAMA0] enabled543worker1 # [ 0.051769] 0 pages in range for non-PLT usage544client # [ 0.163157] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages545worker1 # [ 0.051770] 508288 pages in range for PLT usage546client # [ 0.163188] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page547worker1 # [ 0.051888] pinctrl core: initialized pinctrl subsystem548client # [ 0.163194] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages549worker1 # [ 0.053601] DMI not present or invalid.550client # [ 0.163198] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page551worker1 # [ 0.058791] NET: Registered PF_NETLINK/PF_ROUTE protocol family552client # [ 0.163202] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages553worker1 # [ 0.061968] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations554client # [ 0.163207] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page555worker1 # [ 0.062188] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations556client # [ 0.163211] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages557worker1 # [ 0.062405] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations558client # [ 0.163215] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page559worker1 # [ 0.062437] audit: initializing netlink subsys (disabled)560client # [ 0.176181] fbcon: Taking over console561worker1 # [ 0.063088] thermal_sys: Registered thermal governor 'fair_share'562client # [ 0.176208] ACPI: Interpreter disabled.563worker1 # [ 0.063090] thermal_sys: Registered thermal governor 'bang_bang'564client # [ 0.179662] iommu: Default domain type: Translated565worker1 # [ 0.063095] thermal_sys: Registered thermal governor 'step_wise'566client # [ 0.179672] iommu: DMA domain TLB invalidation policy: strict mode567worker1 # [ 0.063100] thermal_sys: Registered thermal governor 'user_space'568client # [ 0.182191] SCSI subsystem initialized569worker1 # [ 0.063103] thermal_sys: Registered thermal governor 'power_allocator'570client # [ 0.192831] usbcore: registered new interface driver usbfs571worker1 # [ 0.063155] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1572client # [ 0.192871] usbcore: registered new interface driver hub573worker1 # [ 0.063166] cpuidle: using governor ladder574client # [ 0.198316] usbcore: registered new device driver usb575worker1 # [ 0.063171] cpuidle: using governor menu576client # [ 0.198701] pps_core: LinuxPPS API ver. 1 registered577worker1 # [ 0.063365] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.578client # [ 0.198711] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>579worker1 # [ 0.063383] ASID allocator initialised with 65536 entries580client # [ 0.198723] PTP clock support registered581worker1 # [ 0.064690] Serial: AMBA PL011 UART driver582client # [ 0.198780] EDAC MC: Ver: 3.0.0583worker1 # [ 0.070454] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1584client # [ 0.202036] scmi_core: SCMI protocol bus registered585worker1 # [ 0.070648] printk: console [ttyAMA0] enabled586client # [ 0.208332] FPGA manager framework587worker1 # [ 0.208809] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages588client # [ 0.210953] vgaarb: loaded589worker1 # [ 0.208840] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page590client # [ 0.224766] clocksource: Switched to clocksource arch_sys_counter591worker1 # [ 0.208851] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages592client # [ 0.225614] VFS: Disk quotas dquot_6.6.0593worker1 # [ 0.208859] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page594client # [ 0.225657] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)595worker1 # [ 0.208868] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages596client # [ 0.230614] netfs: FS-Cache loaded597worker1 # [ 0.208872] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page598client # [ 0.230770] pnp: PnP ACPI: disabled599worker1 # [ 0.208877] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages600worker2 # [ 0.253080] PCI: CLS 0 bytes, default 64601worker1 # [ 0.208881] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page602worker1 # [ 0.216156] fbcon: Taking over console603worker2 # [ 0.253380] Trying to unpack rootfs image as initramfs...604worker1 # [ 0.216178] ACPI: Interpreter disabled.605worker2 # [ 0.282009] kvm [1]: HYP mode not available606worker1 # [ 0.219542] iommu: Default domain type: Translated607worker1 # [ 0.219555] iommu: DMA domain TLB invalidation policy: strict mode608worker1 # [ 0.221295] SCSI subsystem initialized609client # [ 0.235411] NET: Registered PF_INET protocol family610worker1 # [ 0.222058] usbcore: registered new interface driver usbfs611worker1 # [ 0.222093] usbcore: registered new interface driver hub612worker1 # [ 0.222114] usbcore: registered new device driver usb613worker1 # [ 0.222470] pps_core: LinuxPPS API ver. 1 registered614worker1 # [ 0.222480] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>615worker1 # [ 0.222491] PTP clock support registered616client # [ 0.235721] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)617worker1 # [ 0.222546] EDAC MC: Ver: 3.0.0618worker1 # [ 0.227201] scmi_core: SCMI protocol bus registered619worker1 # [ 0.228228] FPGA manager framework620worker1 # [ 0.229472] vgaarb: loaded621worker1 # [ 0.231124] clocksource: Switched to clocksource arch_sys_counter622worker1 # [ 0.231988] VFS: Disk quotas dquot_6.6.0623worker1 # [ 0.232030] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)624worker1 # [ 0.237310] netfs: FS-Cache loaded625worker1 # [ 0.237591] pnp: PnP ACPI: disabled626worker1 # [ 0.242903] NET: Registered PF_INET protocol family627worker1 # [ 0.243281] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)628worker1 # [ 0.297292] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)629worker1 # [ 0.297942] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)630worker1 # [ 0.297986] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)631worker1 # [ 0.298155] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)632worker1 # [ 0.298308] TCP: Hash tables configured (established 16384 bind 16384)633worker1 # [ 0.302953] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)634worker1 # [ 0.303002] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)635worker1 # [ 0.303045] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)636worker1 # [ 0.303163] NET: Registered PF_UNIX/PF_LOCAL protocol family637worker1 # [ 0.303283] NET: Registered PF_XDP protocol family638worker1 # [ 0.303309] PCI: CLS 0 bytes, default 64639worker1 # [ 0.303603] Trying to unpack rootfs image as initramfs...640client # [ 0.283503] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)641client # [ 0.283574] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)642client # [ 0.283618] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)643client # [ 0.284095] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)644client # [ 0.284253] TCP: Hash tables configured (established 16384 bind 16384)645worker1 # [ 0.322433] kvm [1]: HYP mode not available646client # [ 0.284363] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)647client # [ 0.284497] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)648client # [ 0.284549] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)649client # [ 0.284661] NET: Registered PF_UNIX/PF_LOCAL protocol family650client # [ 0.284709] NET: Registered PF_XDP protocol family651client # [ 0.284731] PCI: CLS 0 bytes, default 64652client # [ 0.285071] Trying to unpack rootfs image as initramfs...653client # [ 0.302392] kvm [1]: HYP mode not available654worker2 # [ 0.677517] Initialise system trusted keyrings655worker2 # [ 0.679921] workingset: timestamp_bits=42 max_order=19 bucket_order=0656worker2 # [ 0.706105] squashfs: version 4.0 (2009/01/31) Phillip Lougher657worker2 # [ 0.722203] 9p: Installing v9fs 9p2000 file system support658worker2 # [ 0.775881] Key type asymmetric registered659worker2 # [ 0.775948] Asymmetric key parser 'x509' registered660worker2 # [ 0.776148] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)661worker2 # [ 0.782025] io scheduler mq-deadline registered662worker2 # [ 0.782051] io scheduler kyber registered663worker2 # [ 0.831942] pl061_gpio 9030000.pl061: PL061 GPIO chip registered664worker2 # [ 0.835181] ledtrig-cpu: registered to indicate activity on CPUs665worker2 # [ 0.837784] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:666worker2 # [ 0.837828] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000667worker2 # [ 0.837855] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000668worker2 # [ 0.837875] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000669worker2 # [ 0.837920] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits670worker2 # [ 0.837996] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]671worker2 # [ 0.838170] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00672worker2 # [ 0.838192] pci_bus 0000:00: root bus resource [bus 00-ff]673worker2 # [ 0.838206] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]674worker2 # [ 0.838217] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]675worker2 # [ 0.838229] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]676worker2 # [ 0.838428] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint677worker2 # [ 0.839374] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint678worker1 # [ 0.831293] Initialise system trusted keyrings679worker1 # [ 0.832531] workingset: timestamp_bits=42 max_order=19 bucket_order=0680worker1 # [ 0.834919] squashfs: version 4.0 (2009/01/31) Phillip Lougher681worker1 # [ 0.836107] 9p: Installing v9fs 9p2000 file system support682worker2 # [ 0.867784] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]683worker2 # [ 0.867832] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]684worker2 # [ 0.867881] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]685worker2 # [ 0.867906] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]686worker2 # [ 0.868668] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint687worker2 # [ 0.868974] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]688worker2 # [ 0.868999] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]689worker2 # [ 0.869043] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]690worker2 # [ 0.869703] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint691worker2 # [ 0.869962] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]692worker2 # [ 0.869985] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]693worker2 # [ 0.870026] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]694worker2 # [ 0.870663] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint695worker2 # [ 0.870924] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]696worker2 # [ 0.870949] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]697worker2 # [ 0.870995] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]698worker2 # [ 0.871663] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint699worker2 # [ 0.871922] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]700worker2 # [ 0.871946] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]701worker2 # [ 0.871989] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]702worker2 # [ 0.872649] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint703worker2 # [ 0.872927] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]704worker2 # [ 0.872950] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]705worker2 # [ 0.872993] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]706worker2 # [ 0.873616] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint707worker2 # [ 0.873864] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]708worker2 # [ 0.873886] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]709worker2 # [ 0.873926] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]710worker2 # [ 0.873948] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]711client # [ 0.827970] Initialise system trusted keyrings712worker2 # [ 0.874611] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint713worker2 # [ 0.874864] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]714worker2 # [ 0.874904] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]715client # [ 0.830024] workingset: timestamp_bits=42 max_order=19 bucket_order=0716worker1 # [ 0.869922] Key type asymmetric registered717worker2 # [ 0.875522] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint718worker1 # [ 0.869969] Asymmetric key parser 'x509' registered719client # [ 0.833148] squashfs: version 4.0 (2009/01/31) Phillip Lougher720worker1 # [ 0.870085] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)721client # [ 0.834892] 9p: Installing v9fs 9p2000 file system support722worker2 # [ 0.907767] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]723worker1 # [ 0.878457] io scheduler mq-deadline registered724worker2 # [ 0.907813] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]725worker1 # [ 0.878485] io scheduler kyber registered726worker2 # [ 0.908274] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint727worker2 # [ 0.908463] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]728worker2 # [ 0.908720] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint729worker2 # [ 0.908992] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]730worker2 # [ 0.909010] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]731worker2 # [ 0.909041] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]732worker2 # [ 0.909515] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint733worker2 # [ 0.909700] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]734worker2 # [ 0.909716] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]735worker2 # [ 0.909746] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]736worker2 # [ 0.910371] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned737worker2 # [ 0.910384] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned738worker2 # [ 0.910390] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned739worker2 # [ 0.910436] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned740worker2 # [ 0.910485] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned741worker2 # [ 0.910534] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned742worker1 # [ 0.890543] pl061_gpio 9030000.pl061: PL061 GPIO chip registered743worker2 # [ 0.910582] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned744worker2 # [ 0.910631] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned745worker2 # [ 0.910679] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned746worker1 # [ 0.892284] ledtrig-cpu: registered to indicate activity on CPUs747worker2 # [ 0.910729] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned748worker1 # [ 0.892823] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:749worker1 # [ 0.892848] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000750worker2 # [ 0.910778] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned751worker1 # [ 0.892864] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000752worker2 # [ 0.910827] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned753worker2 # [ 0.910886] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned754worker2 # [ 0.910932] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned755worker2 # [ 0.910955] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned756worker1 # [ 0.892873] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000757worker2 # [ 0.910977] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned758worker1 # [ 0.892906] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits759worker2 # [ 0.911000] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned760worker1 # [ 0.892935] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]761worker2 # [ 0.911025] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned762worker2 # [ 0.911047] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned763worker1 # [ 0.893029] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00764worker1 # [ 0.893041] pci_bus 0000:00: root bus resource [bus 00-ff]765worker2 # [ 0.911070] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned766lb: QEMU running (pid 49)767worker1 # [ 0.893049] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]768worker2 # [ 0.911092] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned769worker1 # [ 0.893055] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]770worker2 # [ 0.911114] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned771client # [ 0.879234] Key type asymmetric registered772(finished: start all VMs, in 2.31 seconds)773worker2 # [ 0.911137] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned774client # [ 0.879271] Asymmetric key parser 'x509' registered775client: waiting for unit network-addresses-eth1.service776worker2 # [ 0.911160] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned777client # [ 0.879366] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)778client: waiting for the VM to finish booting779worker2 # [ 0.911183] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned780lb # Disk image does not exist, creating the virtualisation disk image...781worker2 # [ 0.911206] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned782client # [ 0.881922] io scheduler mq-deadline registered783worker1 # [ 0.893061] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]784lb # Formatting '/build/vm-state-lb/tmp.89LJNaKCSG', fmt=raw size=1073741824785worker1 # [ 0.893142] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint786lb # mke2fs 1.47.4 (6-Mar-2025)787worker1 # [ 0.893695] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint788lb # Discarding device blocks: 0/262144 done789client # [ 0.881937] io scheduler kyber registered790worker2 # [ 0.911228] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned791worker1 # [ 0.893926] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]792worker2 # [ 0.911250] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned793worker1 # [ 0.893946] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]794worker2 # [ 0.911272] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned795worker1 # [ 0.893982] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]796worker1 # [ 0.894002] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]797lb # Creating filesystem with 262144 4k blocks and 65536 inodes798worker1 # [ 0.914600] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint799lb # Filesystem UUID: fb2c5cc7-ad4e-40a1-b4b3-7ae5911254fb800worker1 # [ 0.914808] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]801lb # Superblock backups stored on blocks:802worker1 # [ 0.914826] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]803lb # 32768, 98304, 163840, 229376804worker1 # [ 0.914858] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]805lb # 806worker2 # [ 0.911294] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned807lb # Allocating group tables: 0/8 done808worker2 # [ 0.911316] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned809lb # Writing inode tables: 0/8 done810worker2 # [ 0.911338] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned811lb # Creating journal (8192 blocks): done812worker2 # [ 0.911360] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned813lb # Writing superblocks and filesystem accounting information: 0/8 done814worker2 # [ 0.911383] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned815lb # 816worker2 # [ 0.911409] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]817lb # Virtualisation disk image created.818worker2 # [ 0.911420] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]819worker1 # [ 0.915374] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint820worker2 # [ 0.911425] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]821worker1 # [ 0.915589] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]822worker1 # [ 0.915607] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]823worker1 # [ 0.915639] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]824worker2 # [ 0.956713] pci 0000:00:0a.0: enabling device (0000 -> 0002)825worker1 # [ 0.916123] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint826worker1 # [ 0.916313] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]827worker1 # [ 0.916330] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]828worker1 # [ 0.916363] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]829worker1 # [ 0.916851] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint830worker1 # [ 0.917043] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]831worker1 # [ 0.917061] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]832worker1 # [ 0.917091] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]833worker1 # [ 0.917566] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint834worker1 # [ 0.917758] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]835worker1 # [ 0.917775] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]836worker1 # [ 0.917806] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]837client # [ 0.896462] pl061_gpio 9030000.pl061: PL061 GPIO chip registered838worker1 # [ 0.918284] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint839client # [ 0.897998] ledtrig-cpu: registered to indicate activity on CPUs840client # [ 0.899412] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:841client # [ 0.899434] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000842client # [ 0.899448] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000843client # [ 0.899470] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000844client # [ 0.899496] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits845worker2 # [ 0.978288] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)846client # [ 0.899526] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]847client # [ 0.899634] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00848worker1 # [ 0.942549] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]849worker1 # [ 0.942586] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]850client # [ 0.899645] pci_bus 0000:00: root bus resource [bus 00-ff]851worker1 # [ 0.942618] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]852client # [ 0.899652] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]853worker1 # [ 0.942635] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]854client # [ 0.899657] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]855worker1 # [ 0.943203] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint856client # [ 0.899662] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]857worker1 # [ 0.943409] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]858client # [ 0.899777] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint859worker1 # [ 0.943466] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]860worker1 # [ 0.943964] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint861client # [ 0.900253] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint862worker1 # [ 0.944164] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]863client # [ 0.900447] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]864worker1 # [ 0.944199] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]865client # [ 0.900464] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]866worker2 # [ 0.989120] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)867worker1 # [ 0.945752] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint868client # [ 0.900495] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]869worker2 # [ 0.991391] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)870worker1 # [ 0.945950] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]871client # [ 0.900512] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]872worker1 # [ 0.946228] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint873client # [ 0.900997] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint874worker1 # [ 0.946542] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]875client # [ 0.901190] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]876worker1 # [ 0.946561] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]877client # [ 0.901207] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]878worker1 # [ 0.946595] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]879client # [ 0.901238] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]880worker1 # [ 0.947083] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint881worker1 # [ 0.947274] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]882client # [ 0.901744] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint883worker1 # [ 0.947292] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]884client # [ 0.901940] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]885worker1 # [ 0.947324] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]886client # [ 0.901958] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]887worker1 # [ 0.947990] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned888client # [ 0.901990] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]889worker1 # [ 0.948003] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned890worker1 # [ 0.948009] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned891worker1 # [ 0.948057] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned892worker1 # [ 0.948106] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned893worker1 # [ 0.948158] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned894worker2 # [ 1.003817] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)895worker2 # [ 1.005990] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)896worker1 # [ 0.978475] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned897worker1 # [ 0.978551] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned898worker1 # [ 0.978604] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned899client # [ 0.938624] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint900worker1 # [ 0.978659] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned901client # [ 0.938872] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]902client # [ 0.938893] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]903worker1 # [ 0.978713] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned904client # [ 0.938931] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]905worker1 # [ 0.978766] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned906worker1 # [ 0.978951] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned907client # [ 0.939550] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint908client # [ 0.939761] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]909worker1 # [ 0.979007] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned910client # [ 0.939780] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]911worker1 # [ 0.979031] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned912worker2 # [ 1.016232] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)913worker1 # [ 0.979056] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned914client # [ 0.939814] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915worker1 # [ 0.979080] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned916client # [ 0.940350] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint917worker1 # [ 0.979107] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned918client # [ 0.940563] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]919worker1 # [ 0.979131] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned920client # [ 0.940581] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]921worker1 # [ 0.979155] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned922client # [ 0.940616] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]923worker1 # [ 0.979180] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned924client # [ 0.941141] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint925worker1 # [ 0.979205] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned926client # [ 0.941375] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]927worker1 # [ 0.979230] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned928client # [ 0.941393] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]929worker1 # [ 0.979257] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned930client # [ 0.941427] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]931worker1 # [ 0.979283] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned932client # [ 0.941446] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]933worker1 # [ 0.979306] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned934worker1 # [ 0.979328] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned935client # [ 0.942027] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint936worker1 # [ 0.979351] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned937client # [ 0.942245] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]938worker1 # [ 0.979374] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned939client # [ 0.942280] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]940worker1 # [ 0.979397] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned941worker1 # [ 0.979420] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned942client # [ 0.942839] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint943worker2 # [ 1.033023] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)944worker1 # [ 0.979451] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned945client # [ 0.943060] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]946worker1 # [ 0.979476] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned947client # [ 0.943094] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]948worker1 # [ 0.979501] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned949client # [ 0.943584] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint950worker1 # [ 0.979538] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]951client # [ 0.943804] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]952worker1 # [ 0.979547] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]953worker1 # [ 0.979552] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]954client # [ 0.944095] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint955worker1 # [ 0.980852] pci 0000:00:0a.0: enabling device (0000 -> 0002)956client # [ 0.944427] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]957client # [ 0.944447] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]958client # [ 0.944481] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]959client # [ 0.945020] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint960client # [ 0.945230] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]961client # [ 0.945248] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]962client # [ 0.945283] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]963client # [ 0.945966] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned964client # [ 0.945979] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned965client # [ 0.945985] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned966worker2 # [ 1.044221] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)967client # [ 0.946038] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned968client # [ 0.946092] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned969client # [ 0.946146] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned970client # [ 0.946198] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned971client # [ 0.946250] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned972client # [ 0.946303] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned973client # [ 0.946356] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned974worker2 # [ 1.055846] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)975worker1 # [ 1.037959] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)976client # [ 0.990497] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned977client # [ 0.990572] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned978client # [ 0.990706] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned979client # [ 0.990758] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned980worker2 # [ 1.074270] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)981worker2 # [ 1.076958] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)982client # [ 0.990783] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned983client # [ 0.990810] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned984client # [ 0.990842] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned985client # [ 0.990869] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned986client # [ 0.990893] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned987client # [ 0.990918] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned988worker1 # [ 1.048121] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)989client # [ 0.990941] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned990client # [ 0.990964] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned991worker2 # [ 1.085897] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled992client # [ 0.990986] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned993client # [ 0.991013] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned994client # [ 0.991036] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned995client # [ 0.991058] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned996client # [ 0.991081] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned997client # [ 0.991103] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned998client # [ 0.991125] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned999client # [ 0.991148] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1000client # [ 0.991172] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1001client # [ 0.991195] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1002client # [ 0.991218] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1003worker2 # [ 1.093108] msm_serial: driver initialized1004client # [ 0.991241] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1005worker2 # [ 1.093288] SuperH (H)SCI(F) driver initialized1006client # [ 0.991278] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1007worker1 # [ 1.059089] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1008worker2 # [ 1.093346] STM32 USART driver initialized1009client # [ 0.991292] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1010worker1 # [ 1.061405] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1011client # [ 0.991298] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1012client # [ 0.992518] pci 0000:00:0a.0: enabling device (0000 -> 0002)1013worker1 # [ 1.088571] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1014worker1 # [ 1.091870] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1015worker1 # [ 1.104040] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1016worker1 # [ 1.111222] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1017worker1 # [ 1.113963] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1018worker2 # [ 1.162145] loop: module loaded1019worker2 # [ 1.162389] virtio_blk virtio5: 1/0/0 default/read/poll queues1020worker2 # [ 1.164003] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1021worker2 # [ 1.169762] megasas: 07.734.00.00-rc11022client # [ 1.107504] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1023worker1 # [ 1.144850] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1024worker1 # [ 1.152031] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1025client # [ 1.121076] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1026worker2 # [ 1.177216] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1027worker1 # [ 1.176198] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1028worker1 # [ 1.184246] msm_serial: driver initialized1029worker1 # [ 1.184439] SuperH (H)SCI(F) driver initialized1030worker1 # [ 1.184500] STM32 USART driver initialized1031client # [ 1.142607] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1032client # [ 1.145593] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1033worker2 # [ 1.221389] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001034client # [ 1.148819] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1035worker2 # [ 1.221449] Intel/Sharp Extended Query Table at 0x00311036client # [ 1.161609] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1037worker2 # [ 1.232999] Using buffer write method1038worker2 # [ 1.233146] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1039client # [ 1.172205] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1040worker2 # [ 1.250446] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001041worker2 # [ 1.250517] Intel/Sharp Extended Query Table at 0x00311042worker2 # [ 1.253301] Using buffer write method1043worker2 # [ 1.253410] Concatenating MTD devices:1044worker2 # [ 1.253426] (0): "0.flash"1045worker2 # [ 1.253433] (1): "0.flash"1046client # [ 1.185649] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1047worker2 # [ 1.253438] into device "0.flash"1048client # [ 1.190201] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1049client # [ 1.201760] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1050worker1 # [ 1.236444] loop: module loaded1051worker1 # [ 1.236670] virtio_blk virtio5: 1/0/0 default/read/poll queues1052worker1 # [ 1.237572] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1053client # [ 1.220154] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1054worker1 # [ 1.255280] megasas: 07.734.00.00-rc11055worker1 # [ 1.256259] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1056worker1 # [ 1.261897] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001057worker1 # [ 1.261945] Intel/Sharp Extended Query Table at 0x00311058worker1 # [ 1.273719] Using buffer write method1059client # [ 1.241620] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1060worker1 # [ 1.278442] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1061worker1 # [ 1.280396] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001062worker1 # [ 1.280450] Intel/Sharp Extended Query Table at 0x00311063worker1 # [ 1.291049] Using buffer write method1064worker1 # [ 1.291112] Concatenating MTD devices:1065client # [ 1.244556] msm_serial: driver initialized1066client # [ 1.244774] SuperH (H)SCI(F) driver initialized1067client # [ 1.244834] STM32 USART driver initialized1068worker1 # [ 1.291116] (0): "0.flash"1069worker1 # [ 1.291122] (1): "0.flash"1070worker1 # [ 1.291125] into device "0.flash"1071client # [ 1.293300] loop: module loaded1072client # [ 1.293615] virtio_blk virtio5: 1/0/0 default/read/poll queues1073client # [ 1.294546] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1074client # [ 1.303305] megasas: 07.734.00.00-rc11075client # [ 1.304150] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1076client # [ 1.315163] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001077client # [ 1.315221] Intel/Sharp Extended Query Table at 0x00311078client # [ 1.316908] Using buffer write method1079client # [ 1.317006] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1080client # [ 1.323734] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001081client # [ 1.323823] Intel/Sharp Extended Query Table at 0x00311082client # [ 1.325414] Using buffer write method1083client # [ 1.325459] Concatenating MTD devices:1084client # [ 1.325463] (0): "0.flash"1085client # [ 1.325468] (1): "0.flash"1086client # [ 1.325471] into device "0.flash"1087lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]1088lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 20261089lb # [ 0.000000] KASLR enabled1090lb # [ 0.000000] random: crng init done1091lb # [ 0.000000] Machine model: linux,dummy-virt1092lb # [ 0.000000] efi: UEFI not found.1093lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT1094lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]1095lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]1096lb # [ 0.000000] Zone ranges:1097lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]1098lb # [ 0.000000] DMA32 empty1099lb # [ 0.000000] Normal empty1100lb # [ 0.000000] Device empty1101lb # [ 0.000000] Movable zone start for each node1102lb # [ 0.000000] Early memory node ranges1103lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]1104lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]1105lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c4000001106lb # [ 0.000000] psci: probing for conduit method from DT.1107lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.1108lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs1109lb # [ 0.000000] psci: Trusted OS migration not required1110lb # [ 0.000000] psci: SMC Calling Convention v1.11111lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)1112lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u3112961113lb # [ 0.000000] Detected PIPT I-cache on CPU01114lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)1115lb # [ 0.000000] CPU features: detected: GICv3 CPU interface1116lb # [ 0.000000] CPU features: detected: Spectre-v41117lb # [ 0.000000] CPU features: detected: Spectre-BHB1118lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_381119lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_231120lb # [ 0.000000] alternatives: applying boot alternatives1121lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty01122lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.1123lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes1124lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)1125lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)1126lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB1127lb # [ 0.000000] software IO TLB: area num 1.1128lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB1129lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)1130lb # [ 0.000000] Fallback order for Node 0: 01131lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 3932161132lb # [ 0.000000] Policy zone: DMA1133lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off1134lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=11135lb # [ 0.000000] allocated 3145728 bytes of page_ext1136lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages1137lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups1138lb # [ 0.000000] rcu: Hierarchical RCU implementation.1139lb # [ 0.000000] rcu: RCU event tracing is enabled.1140lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.1141lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.1142lb # [ 0.000000] Rude variant of Tasks RCU enabled.1143lb # [ 0.000000] Tracing variant of Tasks RCU enabled.1144lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.1145lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=11146lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.1147lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.1148lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.1149lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 01150lb # [ 0.000000] GICv3: 256 SPIs implemented1151lb # [ 0.000000] GICv3: 0 Extended SPIs implemented1152lb # [ 0.000000] Root IRQ handler: gic_handle_irq1153lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI1154lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=01155lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a00001156lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]1157lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)1158lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)1159lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a100001160lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a200001161lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.1162lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns1163lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).1164lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns1165lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns1166lb # [ 0.000039] arm-pv: using stolen time PV1167lb # [ 0.000520] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)1168lb # [ 0.000720] Console: colour dummy device 80x251169lb # [ 0.000728] printk: legacy console [tty0] enabled1170lb # [ 0.000961] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)1171lb # [ 0.000968] pid_max: default: 32768 minimum: 3011172lb # [ 0.001048] LSM: initializing lsm=capability,landlock,yama,bpf,ima1173lb # [ 0.001228] landlock: Up and running.1174lb # [ 0.001231] Yama: becoming mindful.1175lb # [ 0.001718] LSM support for eBPF active1176lb # [ 0.001868] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)1177lb # [ 0.001907] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)1178lb # [ 0.003219] cacheinfo: Unable to detect cache hierarchy for CPU 01179lb # [ 0.004452] rcu: Hierarchical SRCU implementation.1180lb # [ 0.004458] rcu: Max phase no-delay instances is 1000.1181lb # [ 0.005761] fsl-mc MSI: its@8080000 domain created1182lb # [ 0.005870] EFI services will not be available.1183lb # [ 0.005947] smp: Bringing up secondary CPUs ...1184lb # [ 0.005957] smp: Brought up 1 node, 1 CPU1185lb # [ 0.005961] SMP: Total of 1 processors activated.1186lb # [ 0.005966] CPU: All CPU(s) started at EL11187lb # [ 0.005988] CPU features: detected: Branch Target Identification1188lb # [ 0.005995] CPU features: detected: ARMv8.4 Translation Table Level1189lb # [ 0.005998] CPU features: detected: Instruction cache invalidation not required for I/D coherence1190lb # [ 0.006001] CPU features: detected: Data cache clean to the PoU not required for I/D coherence1191lb # [ 0.006005] CPU features: detected: Common not Private translations1192lb # [ 0.006008] CPU features: detected: CRC32 instructions1193lb # [ 0.006011] CPU features: detected: Data cache clean to Point of Deep Persistence1194lb # [ 0.006015] CPU features: detected: Data cache clean to Point of Persistence1195lb # [ 0.006018] CPU features: detected: Data independent timing control (DIT)1196lb # [ 0.006021] CPU features: detected: E0PD1197lb # [ 0.006023] CPU features: detected: Enhanced Counter Virtualization1198lb # [ 0.006026] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)1199lb # [ 0.006030] CPU features: detected: Enhanced Virtualization Traps1200lb # [ 0.006033] CPU features: detected: Fine Grained Traps1201lb # [ 0.006041] CPU features: detected: Generic authentication (architected QARMA5 algorithm)1202lb # [ 0.006048] CPU features: detected: RCpc load-acquire (LDAPR)1203lb # [ 0.006051] CPU features: detected: LSE atomic instructions1204lb # [ 0.006054] CPU features: detected: Privileged Access Never1205lb # [ 0.006056] CPU features: detected: PMUv31206lb # [ 0.006059] CPU features: detected: RAS Extension Support1207lb # [ 0.006061] CPU features: detected: RASv1p1 Extension Support1208lb # [ 0.006064] CPU features: detected: Random Number Generator1209lb # [ 0.006066] CPU features: detected: Speculation barrier (SB)1210lb # [ 0.006070] CPU features: detected: Stage-2 Force Write-Back1211lb # [ 0.006077] CPU features: detected: TLB range maintenance instructions1212lb # [ 0.006092] CPU features: detected: Speculative Store Bypassing Safe (SSBS)1213lb # [ 0.006147] alternatives: applying system-wide alternatives1214lb # [ 0.009480] CPU features: detected: BBM Level 2 without TLB conflict abort1215lb # [ 0.009691] Memory: 1406532K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)1216lb # [ 0.010383] devtmpfs: initialized1217lb # [ 0.014086] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)1218lb # [ 0.014122] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).1219lb # [ 0.014361] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL1220lb # [ 0.014366] 0 pages in range for non-PLT usage1221lb # [ 0.014367] 508288 pages in range for PLT usage1222lb # [ 0.020149] pinctrl core: initialized pinctrl subsystem1223lb # [ 0.020991] DMI not present or invalid.1224lb # [ 0.027188] NET: Registered PF_NETLINK/PF_ROUTE protocol family1225lb # [ 0.029567] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations1226lb # [ 0.029768] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations1227lb # [ 0.029991] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations1228lb # [ 0.030022] audit: initializing netlink subsys (disabled)1229lb # [ 0.030755] thermal_sys: Registered thermal governor 'fair_share'1230lb # [ 0.030758] thermal_sys: Registered thermal governor 'bang_bang'1231lb # [ 0.030762] thermal_sys: Registered thermal governor 'step_wise'1232lb # [ 0.030768] thermal_sys: Registered thermal governor 'user_space'1233lb # [ 0.030771] thermal_sys: Registered thermal governor 'power_allocator'1234lb # [ 0.030803] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=11235lb # [ 0.030814] cpuidle: using governor ladder1236lb # [ 0.030820] cpuidle: using governor menu1237lb # [ 0.031028] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.1238lb # [ 0.031046] ASID allocator initialised with 65536 entries1239lb # [ 0.032418] Serial: AMBA PL011 UART driver1240lb # [ 0.038005] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev11241lb # [ 0.038207] printk: console [ttyAMA0] enabled1242lb # [ 0.164772] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1243lb # [ 0.164862] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page1244lb # [ 0.164867] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages1245lb # [ 0.164871] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page1246lb # [ 0.164876] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1247lb # [ 0.164880] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page1248lb # [ 0.164885] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages1249lb # [ 0.164889] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page1250lb # [ 0.186997] fbcon: Taking over console1251lb # [ 0.187068] ACPI: Interpreter disabled.1252lb # [ 0.191150] iommu: Default domain type: Translated1253lb # [ 0.191158] iommu: DMA domain TLB invalidation policy: strict mode1254lb # [ 0.193993] SCSI subsystem initialized1255lb # [ 0.199206] usbcore: registered new interface driver usbfs1256lb # [ 0.199234] usbcore: registered new interface driver hub1257lb # [ 0.199328] usbcore: registered new device driver usb1258lb # [ 0.199779] pps_core: LinuxPPS API ver. 1 registered1259lb # [ 0.199786] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>1260lb # [ 0.199795] PTP clock support registered1261lb # [ 0.200053] EDAC MC: Ver: 3.0.01262lb # [ 0.231330] scmi_core: SCMI protocol bus registered1263lb # [ 0.242650] FPGA manager framework1264lb # [ 0.243693] vgaarb: loaded1265worker2 # [ 1.704290] Freeing initrd memory: 26148K1266lb # [ 0.244371] clocksource: Switched to clocksource arch_sys_counter1267lb # [ 0.245007] VFS: Disk quotas dquot_6.6.01268lb # [ 0.245041] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1269lb # [ 0.249581] netfs: FS-Cache loaded1270lb # [ 0.249745] pnp: PnP ACPI: disabled1271worker2 # [ 1.711993] tun: Universal TUN/TAP device driver, 1.61272lb # [ 0.253813] NET: Registered PF_INET protocol family1273lb # [ 0.254112] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1274worker2 # [ 1.716244] thunder_xcv, ver 1.01275worker2 # [ 1.716295] thunder_bgx, ver 1.01276worker2 # [ 1.716318] nicpf, ver 1.01277worker2 # [ 1.716927] e1000: Intel(R) PRO/1000 Network Driver1278worker2 # [ 1.716936] e1000: Copyright (c) 1999-2006 Intel Corporation.1279worker2 # [ 1.716961] e1000e: Intel(R) PRO/1000 Network Driver1280worker2 # [ 1.716969] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1281worker2 # [ 1.717000] igb: Intel(R) Gigabit Ethernet Network Driver1282worker2 # [ 1.717006] igb: Copyright (c) 2007-2014 Intel Corporation.1283worker2 # [ 1.717030] igbvf: Intel(R) Gigabit Virtual Function Network Driver1284worker2 # [ 1.717037] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1285worker1 # [ 1.693542] Freeing initrd memory: 26148K1286worker2 # [ 1.717177] sky2: driver version 1.301287worker2 # [ 1.718829] usbcore: registered new interface driver usb-storage1288worker2 # [ 1.718893] usbcore: registered new interface driver usbserial_generic1289worker2 # [ 1.718908] usbserial: USB Serial support registered for generic1290worker2 # [ 1.719522] hv_vmbus: registering driver hyperv_keyboard1291worker2 # [ 1.720293] ehci-pci 0000:00:0a.0: EHCI Host Controller1292worker2 # [ 1.720321] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11293worker2 # [ 1.720550] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001294worker2 # [ 1.733047] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001295worker1 # [ 1.700864] tun: Universal TUN/TAP device driver, 1.61296worker2 # [ 1.733480] hub 1-0:1.0: USB hub found1297worker2 # [ 1.733513] hub 1-0:1.0: 6 ports detected1298worker2 # [ 1.736678] rtc-pl031 9010000.pl031: registered as rtc01299worker2 # [ 1.736716] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:03:39 UTC (1789891419)1300worker2 # [ 1.737114] i2c_dev: i2c /dev entries driver1301worker1 # [ 1.705147] thunder_xcv, ver 1.01302worker1 # [ 1.705206] thunder_bgx, ver 1.01303worker1 # [ 1.705228] nicpf, ver 1.01304worker1 # [ 1.705875] e1000: Intel(R) PRO/1000 Network Driver1305worker1 # [ 1.705887] e1000: Copyright (c) 1999-2006 Intel Corporation.1306worker1 # [ 1.705915] e1000e: Intel(R) PRO/1000 Network Driver1307worker1 # [ 1.705923] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1308worker1 # [ 1.705957] igb: Intel(R) Gigabit Ethernet Network Driver1309worker2 # [ 1.742204] sdhci: Secure Digital Host Controller Interface driver1310worker2 # [ 1.742221] sdhci: Copyright(c) Pierre Ossman1311worker1 # [ 1.705962] igb: Copyright (c) 2007-2014 Intel Corporation.1312worker2 # [ 1.742498] Synopsys Designware Multimedia Card Interface Driver1313worker1 # [ 1.705987] igbvf: Intel(R) Gigabit Virtual Function Network Driver1314worker2 # [ 1.742880] sdhci-pltfm: SDHCI platform and OF driver helper1315worker1 # [ 1.705995] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1316worker1 # [ 1.706143] sky2: driver version 1.301317worker2 # [ 1.747600] hid: raw HID events driver (C) Jiri Kosina1318worker2 # [ 1.747890] usbcore: registered new interface driver usbhid1319worker2 # [ 1.747897] usbhid: USB HID core driver1320worker1 # [ 1.715224] usbcore: registered new interface driver usb-storage1321worker2 # [ 1.750900] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1322worker1 # [ 1.715296] usbcore: registered new interface driver usbserial_generic1323worker1 # [ 1.715315] usbserial: USB Serial support registered for generic1324worker1 # [ 1.716020] hv_vmbus: registering driver hyperv_keyboard1325worker1 # [ 1.717433] ehci-pci 0000:00:0a.0: EHCI Host Controller1326worker2 # [ 1.753635] drop_monitor: Initializing network drop monitor service1327lb # [ 0.285459] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1328worker2 # [ 1.753833] NET: Registered PF_INET6 protocol family1329worker1 # [ 1.717471] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11330lb # [ 0.285523] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1331worker1 # [ 1.717692] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001332lb # [ 0.285559] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1333worker2 # [ 1.756074] Segment Routing with IPv61334lb # [ 0.285652] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1335worker2 # [ 1.756095] In-situ OAM (IOAM) with IPv61336lb # [ 0.285797] TCP: Hash tables configured (established 16384 bind 16384)1337worker2 # [ 1.756136] NET: Registered PF_PACKET protocol family1338worker1 # [ 1.723348] rtc-pl031 9010000.pl031: registered as rtc01339lb # [ 0.285914] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1340worker1 # [ 1.723387] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:03:39 UTC (1789891419)1341lb # [ 0.285956] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1342worker2 # [ 1.758661] 9pnet: Installing 9P2000 support1343worker1 # [ 1.723890] i2c_dev: i2c /dev entries driver1344lb # [ 0.285995] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1345lb # [ 0.286089] NET: Registered PF_UNIX/PF_LOCAL protocol family1346lb # [ 0.286141] NET: Registered PF_XDP protocol family1347lb # [ 0.286162] PCI: CLS 0 bytes, default 641348worker1 # [ 1.726943] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001349lb # [ 0.286442] Trying to unpack rootfs image as initramfs...1350worker1 # [ 1.727393] hub 1-0:1.0: USB hub found1351worker1 # [ 1.727426] hub 1-0:1.0: 6 ports detected1352worker2 # [ 1.761647] Key type dns_resolver registered1353lb # [ 0.302151] kvm [1]: HYP mode not available1354worker1 # [ 1.732842] sdhci: Secure Digital Host Controller Interface driver1355worker1 # [ 1.732860] sdhci: Copyright(c) Pierre Ossman1356worker1 # [ 1.733142] Synopsys Designware Multimedia Card Interface Driver1357worker1 # [ 1.733534] sdhci-pltfm: SDHCI platform and OF driver helper1358worker2 # [ 1.768346] registered taskstats version 11359worker1 # [ 1.738121] hid: raw HID events driver (C) Jiri Kosina1360worker2 # [ 1.768525] Loading compiled-in X.509 certificates1361worker1 # [ 1.739088] usbcore: registered new interface driver usbhid1362worker1 # [ 1.739099] usbhid: USB HID core driver1363worker1 # [ 1.741439] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1364worker1 # [ 1.744185] drop_monitor: Initializing network drop monitor service1365worker1 # [ 1.744421] NET: Registered PF_INET6 protocol family1366worker2 # [ 1.778540] Demotion targets for Node 0: null1367worker2 # [ 1.778693] Key type .fscrypt registered1368worker2 # [ 1.778704] Key type fscrypt-provisioning registered1369worker1 # [ 1.747229] Segment Routing with IPv61370worker2 # [ 1.778820] ima: No TPM chip found, activating TPM-bypass!1371worker1 # [ 1.747261] In-situ OAM (IOAM) with IPv61372worker2 # [ 1.778841] ima: Allocated hash algorithm: sha11373worker1 # [ 1.747299] NET: Registered PF_PACKET protocol family1374worker2 # [ 1.778870] ima: No architecture policies found1375worker2 # [ 1.783164] input: gpio-keys as /devices/platform/gpio-keys/input/input01376worker1 # [ 1.749011] 9pnet: Installing 9P2000 support1377worker1 # [ 1.752158] Key type dns_resolver registered1378worker1 # [ 1.758899] registered taskstats version 11379worker1 # [ 1.759062] Loading compiled-in X.509 certificates1380worker2 # [ 1.803158] clk: Disabling unused clocks1381worker2 # [ 1.803201] PM: genpd: Disabling unused power domains1382worker1 # [ 1.768562] Demotion targets for Node 0: null1383worker1 # [ 1.768710] Key type .fscrypt registered1384worker2 # [ 1.808631] Freeing unused kernel memory: 4736K1385worker1 # [ 1.768716] Key type fscrypt-provisioning registered1386worker2 # [ 1.808877] Run /init as init process1387worker1 # [ 1.768824] ima: No TPM chip found, activating TPM-bypass!1388worker1 # [ 1.768844] ima: Allocated hash algorithm: sha11389worker1 # [ 1.768868] ima: No architecture policies found1390worker1 # [ 1.779031] input: gpio-keys as /devices/platform/gpio-keys/input/input01391client # [ 1.742858] Freeing initrd memory: 26160K1392client # [ 1.749479] tun: Universal TUN/TAP device driver, 1.61393client # [ 1.753893] thunder_xcv, ver 1.01394client # [ 1.753951] thunder_bgx, ver 1.01395client # [ 1.753986] nicpf, ver 1.01396worker2 # [ 1.829582] systemd[1]: Successfully made /usr/ read-only.1397client # [ 1.756080] e1000: Intel(R) PRO/1000 Network Driver1398client # [ 1.756119] e1000: Copyright (c) 1999-2006 Intel Corporation.1399client # [ 1.756289] e1000e: Intel(R) PRO/1000 Network Driver1400client # [ 1.756321] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1401client # [ 1.756414] igb: Intel(R) Gigabit Ethernet Network Driver1402client # [ 1.756426] igb: Copyright (c) 2007-2014 Intel Corporation.1403client # [ 1.756454] igbvf: Intel(R) Gigabit Virtual Function Network Driver1404worker1 # [ 1.800138] clk: Disabling unused clocks1405client # [ 1.756464] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1406client # [ 1.756618] sky2: driver version 1.301407worker1 # [ 1.800187] PM: genpd: Disabling unused power domains1408client # [ 1.759212] ehci-pci 0000:00:0a.0: EHCI Host Controller1409client # [ 1.759250] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11410client # [ 1.759428] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001411worker1 # [ 1.805183] Freeing unused kernel memory: 4736K1412worker1 # [ 1.805421] Run /init as init process1413client # [ 1.768342] usbcore: registered new interface driver usb-storage1414client # [ 1.768784] usbcore: registered new interface driver usbserial_generic1415client # [ 1.768806] usbserial: USB Serial support registered for generic1416client # [ 1.769474] hv_vmbus: registering driver hyperv_keyboard1417client # [ 1.773197] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001418client # [ 1.773635] hub 1-0:1.0: USB hub found1419client # [ 1.773656] hub 1-0:1.0: 6 ports detected1420client # [ 1.775976] rtc-pl031 9010000.pl031: registered as rtc01421client # [ 1.776005] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:03:39 UTC (1789891419)1422client # [ 1.776396] i2c_dev: i2c /dev entries driver1423client # [ 1.781447] sdhci: Secure Digital Host Controller Interface driver1424client # [ 1.781461] sdhci: Copyright(c) Pierre Ossman1425client # [ 1.781770] Synopsys Designware Multimedia Card Interface Driver1426client # [ 1.782186] sdhci-pltfm: SDHCI platform and OF driver helper1427worker1 # [ 1.824280] systemd[1]: Successfully made /usr/ read-only.1428client # [ 1.786720] hid: raw HID events driver (C) Jiri Kosina1429client # [ 1.787026] usbcore: registered new interface driver usbhid1430client # [ 1.787033] usbhid: USB HID core driver1431client # [ 1.790061] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1432client # [ 1.792986] drop_monitor: Initializing network drop monitor service1433client # [ 1.793211] NET: Registered PF_INET6 protocol family1434client # [ 1.795428] Segment Routing with IPv61435client # [ 1.795450] In-situ OAM (IOAM) with IPv61436client # [ 1.795505] NET: Registered PF_PACKET protocol family1437client # [ 1.797174] 9pnet: Installing 9P2000 support1438client # [ 1.800354] Key type dns_resolver registered1439client # [ 1.807249] registered taskstats version 11440client # [ 1.807447] Loading compiled-in X.509 certificates1441client # [ 1.817985] Demotion targets for Node 0: null1442client # [ 1.818132] Key type .fscrypt registered1443client # [ 1.818140] Key type fscrypt-provisioning registered1444client # [ 1.818262] ima: No TPM chip found, activating TPM-bypass!1445client # [ 1.818290] ima: Allocated hash algorithm: sha11446client # [ 1.821395] ima: No architecture policies found1447client # [ 1.822794] input: gpio-keys as /devices/platform/gpio-keys/input/input01448client # [ 1.847759] clk: Disabling unused clocks1449client # [ 1.847798] PM: genpd: Disabling unused power domains1450client # [ 1.855257] Freeing unused kernel memory: 4736K1451client # [ 1.855648] Run /init as init process1452worker2 # [ 1.979864] usb 1-1: new high-speed USB device number 2 using ehci-pci1453client # [ 1.912208] systemd[1]: Successfully made /usr/ read-only.1454worker1 # [ 1.974523] usb 1-1: new high-speed USB device number 2 using ehci-pci1455lb # [ 0.618642] Initialise system trusted keyrings1456lb # [ 0.619678] workingset: timestamp_bits=42 max_order=19 bucket_order=01457client # [ 2.022522] usb 1-1: new high-speed USB device number 2 using ehci-pci1458lb # [ 0.643505] squashfs: version 4.0 (2009/01/31) Phillip Lougher1459lb # [ 0.648446] 9p: Installing v9fs 9p2000 file system support1460worker2 # [ 2.137284] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11461lb # [ 0.705776] Key type asymmetric registered1462lb # [ 0.705829] Asymmetric key parser 'x509' registered1463lb # [ 0.705987] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1464lb # [ 0.709151] io scheduler mq-deadline registered1465lb # [ 0.709173] io scheduler kyber registered1466worker1 # [ 2.138083] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11467worker2 # [ 2.175115] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1468worker2 # [ 2.188059] systemd[1]: Detected virtualization qemu.1469worker2 # [ 2.190214] systemd[1]: Detected architecture arm64.1470worker2 # [ 2.193065] systemd[1]: Running in initrd.1471worker2 # [ 2.200387] systemd[1]: Initializing machine ID from random generator.1472worker1 # [ 2.159893] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1473worker1 # [ 2.175320] systemd[1]: Detected virtualization qemu.1474worker1 # [ 2.177675] systemd[1]: Detected architecture arm64.1475worker2 # [ 2.211869] systemd[1]: Hostname set to <worker2>.1476worker1 # [ 2.180267] systemd[1]: Running in initrd.1477worker1 # [ 2.184581] systemd[1]: Initializing machine ID from random generator.1478worker1 # [ 2.188204] systemd[1]: Hostname set to <worker1>.1479lb # [ 0.768069] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1480lb # [ 0.772687] ledtrig-cpu: registered to indicate activity on CPUs1481worker2 # [ 2.233427] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01482lb # [ 0.774216] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1483lb # [ 0.774252] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001484lb # [ 0.774270] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001485lb # [ 0.774300] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001486lb # [ 0.774341] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1487lb # [ 0.774376] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1488lb # [ 0.774550] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001489lb # [ 0.774569] pci_bus 0000:00: root bus resource [bus 00-ff]1490lb # [ 0.774581] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1491lb # [ 0.774589] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1492lb # [ 0.774597] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1493lb # [ 0.774682] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1494lb # [ 0.775398] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1495lb # [ 0.775693] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1496lb # [ 0.775726] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1497client # [ 2.182151] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11498lb # [ 0.775776] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1499lb # [ 0.775810] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1500worker1 # [ 2.239740] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01501lb # [ 0.822125] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1502lb # [ 0.822422] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1503lb # [ 0.822448] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1504lb # [ 0.822495] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1505lb # [ 0.823368] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1506lb # [ 0.823635] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1507lb # [ 0.823658] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1508lb # [ 0.823705] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1509lb # [ 0.844598] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1510lb # [ 0.844922] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1511lb # [ 0.844953] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1512lb # [ 0.845528] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1513lb # [ 0.846411] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1514lb # [ 0.846705] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1515lb # [ 0.846732] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1516lb # [ 0.846782] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1517lb # [ 0.847550] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1518lb # [ 0.847855] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1519lb # [ 0.847890] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1520lb # [ 0.847940] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1521lb # [ 0.875298] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1522lb # [ 0.875629] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1523lb # [ 0.875663] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1524lb # [ 0.875717] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1525lb # [ 0.875746] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1526client # [ 2.260619] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1527lb # [ 0.882425] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1528lb # [ 0.882705] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1529lb # [ 0.882750] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1530lb # [ 0.883432] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1531lb # [ 0.883721] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1532lb # [ 0.883770] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1533client # [ 2.273484] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01534client # [ 2.284390] systemd[1]: Detected virtualization qemu.1535client # [ 2.286726] systemd[1]: Detected architecture arm64.1536client # [ 2.288802] systemd[1]: Running in initrd.1537lb # [ 0.896581] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1538worker2 # [ 2.363640] usb 1-2: new high-speed USB device number 3 using ehci-pci1539client # [ 2.297419] systemd[1]: Initializing machine ID from random generator.1540client # [ 2.306760] systemd[1]: Hostname set to <client>.1541lb # [ 0.910217] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1542lb # [ 0.939690] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1543worker1 # [ 2.374496] usb 1-2: new high-speed USB device number 3 using ehci-pci1544lb # [ 0.942310] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1545lb # [ 0.942360] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1546lb # [ 0.942424] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1547lb # [ 0.943237] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1548lb # [ 0.943567] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1549lb # [ 0.943596] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1550lb # [ 0.943647] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1551lb # [ 0.965409] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1552lb # [ 0.965442] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1553lb # [ 0.965454] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1554lb # [ 0.965555] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1555lb # [ 0.965667] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1556lb # [ 0.965772] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1557lb # [ 0.965870] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1558lb # [ 0.965967] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1559lb # [ 0.966069] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1560lb # [ 0.966164] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1561lb # [ 0.966267] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1562lb # [ 0.966373] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1563lb # [ 0.966525] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1564lb # [ 0.966613] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1565lb # [ 0.966664] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1566lb # [ 0.966715] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1567lb # [ 0.966762] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1568lb # [ 0.967151] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1569lb # [ 0.967201] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1570lb # [ 0.967251] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1571lb # [ 0.967300] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1572lb # [ 0.967345] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1573lb # [ 0.967398] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1574lb # [ 0.967458] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1575lb # [ 0.967530] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1576lb # [ 0.967580] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1577lb # [ 0.967629] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1578lb # [ 0.967683] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1579lb # [ 0.967739] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1580lb # [ 0.967795] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1581lb # [ 0.967850] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1582lb # [ 0.967901] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1583lb # [ 0.967958] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1584lb # [ 0.968014] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1585lb # [ 0.968072] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1586lb # [ 0.968103] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1587lb # [ 0.968124] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1588lb # [ 1.033912] pci 0000:00:0a.0: enabling device (0000 -> 0002)1589client # [ 2.430455] usb 1-2: new high-speed USB device number 3 using ehci-pci1590lb # [ 1.063352] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1591lb # [ 1.074346] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1592worker2 # [ 2.544138] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21593worker2 # [ 2.546545] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01594lb # [ 1.087346] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1595lb # [ 1.094230] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1596lb # [ 1.108314] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1597worker1 # [ 2.555398] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21598worker1 # [ 2.557346] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01599lb # [ 1.130180] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1600lb # [ 1.134479] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1601lb # [ 1.152151] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1602lb # [ 1.162695] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1603lb # [ 1.173887] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1604lb # [ 1.176369] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1605lb # [ 1.189780] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1606lb # [ 1.192909] msm_serial: driver initialized1607lb # [ 1.193064] SuperH (H)SCI(F) driver initialized1608lb # [ 1.193127] STM32 USART driver initialized1609client # [ 2.591679] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21610client # [ 2.597760] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01611lb # [ 1.232737] loop: module loaded1612lb # [ 1.232999] virtio_blk virtio5: 1/0/0 default/read/poll queues1613lb # [ 1.235290] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1614lb # [ 1.241214] megasas: 07.734.00.00-rc11615lb # [ 1.242052] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1616lb # [ 1.257593] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001617lb # [ 1.257649] Intel/Sharp Extended Query Table at 0x00311618lb # [ 1.260057] Using buffer write method1619lb # [ 1.260168] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1620worker2 # [ 2.730743] systemd[1]: bpf-restrict-fs: LSM BPF program attached1621lb # [ 1.294595] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001622lb # [ 1.294661] Intel/Sharp Extended Query Table at 0x00311623client # [ 2.689489] systemd[1]: bpf-restrict-fs: LSM BPF program attached1624lb # [ 1.299929] Using buffer write method1625lb # [ 1.299978] Concatenating MTD devices:1626lb # [ 1.299983] (0): "0.flash"1627lb # [ 1.299988] (1): "0.flash"1628lb # [ 1.299992] into device "0.flash"1629worker1 # [ 2.733252] systemd[1]: bpf-restrict-fs: LSM BPF program attached1630worker2 # [ 2.797143] systemd[1]: Queued start job for default target Initrd Default Target.1631worker2 # [ 2.805809] systemd[1]: Created slice Slice /system/modprobe.1632worker2 # [ 2.806945] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1633worker2 # [ 2.808079] systemd[1]: Expecting device /dev/disk/by-label/nixos...1634worker2 # [ 2.808120] systemd[1]: Reached target Path Units.1635worker2 # [ 2.808138] systemd[1]: Reached target Slice Units.1636worker2 # [ 2.808155] systemd[1]: Reached target Swaps.1637worker2 # [ 2.808175] systemd[1]: Reached target Timer Units.1638worker2 # [ 2.808940] systemd[1]: Listening on D-Bus System Message Bus Socket.1639worker2 # [ 2.809142] systemd[1]: Listening on Journal Socket (/dev/log).1640worker2 # [ 2.809337] systemd[1]: Listening on Journal Sockets.1641worker2 # [ 2.809620] systemd[1]: Listening on udev Control Socket.1642worker2 # [ 2.809954] systemd[1]: Listening on udev Kernel Socket.1643worker2 # [ 2.809985] systemd[1]: Reached target Socket Units.1644worker2 # [ 2.820799] systemd[1]: Starting Create List of Static Device Nodes...1645worker2 # [ 2.829263] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1646worker2 # [ 2.830278] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1647worker2 # [ 2.843855] systemd[1]: Mounting Kernel Configuration File System...1648client # [ 2.782525] systemd[1]: Queued start job for default target Initrd Default Target.1649worker2 # [ 2.860007] systemd[1]: Starting Journal Service...1650client # [ 2.794349] systemd[1]: Created slice Slice /system/modprobe.1651client # [ 2.795604] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1652client # [ 2.796643] systemd[1]: Expecting device /dev/disk/by-label/nixos...1653client # [ 2.797507] systemd[1]: Reached target Path Units.1654client # [ 2.798151] systemd[1]: Reached target Slice Units.1655client # [ 2.798871] systemd[1]: Reached target Swaps.1656client # [ 2.799448] systemd[1]: Reached target Timer Units.1657client # [ 2.800292] systemd[1]: Listening on D-Bus System Message Bus Socket.1658client # [ 2.801327] systemd[1]: Listening on Journal Socket (/dev/log).1659client # [ 2.802279] systemd[1]: Listening on Journal Sockets.1660client # [ 2.803217] systemd[1]: Listening on udev Control Socket.1661client # [ 2.804047] systemd[1]: Listening on udev Kernel Socket.1662client # [ 2.804778] systemd[1]: Reached target Socket Units.1663client # [ 2.813089] systemd[1]: Starting Create List of Static Device Nodes...1664client # [ 2.820377] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1665client # [ 2.821450] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1666client # [ 2.830688] systemd[1]: Mounting Kernel Configuration File System...1667client # [ 2.846753] systemd[1]: Starting Journal Service...1668worker2 # [ 2.923892] systemd[1]: Starting Load Kernel Modules...1669client # [ 2.854677] systemd[1]: Starting Load Kernel Modules...1670worker2 # [ 2.924063] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1671client # [ 2.855586] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1672worker2 # [ 2.927707] systemd[1]: Starting Coldplug All udev Devices...1673worker2 # [ 2.940257] systemd-journald[73]: Collecting audit messages is disabled.1674worker1 # [ 2.909454] systemd[1]: Queued start job for default target Initrd Default Target.1675worker1 # [ 2.921196] systemd[1]: Created slice Slice /system/modprobe.1676worker1 # [ 2.922525] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1677worker1 # [ 2.922575] systemd[1]: Expecting device /dev/disk/by-label/nixos...1678worker1 # [ 2.922609] systemd[1]: Reached target Path Units.1679worker1 # [ 2.922627] systemd[1]: Reached target Slice Units.1680worker1 # [ 2.922644] systemd[1]: Reached target Swaps.1681worker1 # [ 2.922661] systemd[1]: Reached target Timer Units.1682worker1 # [ 2.922861] systemd[1]: Listening on D-Bus System Message Bus Socket.1683worker1 # [ 2.923005] systemd[1]: Listening on Journal Socket (/dev/log).1684worker1 # [ 2.923127] systemd[1]: Listening on Journal Sockets.1685worker1 # [ 2.923242] systemd[1]: Listening on udev Control Socket.1686worker1 # [ 2.923354] systemd[1]: Listening on udev Kernel Socket.1687worker1 # [ 2.923372] systemd[1]: Reached target Socket Units.1688worker1 # [ 2.933786] systemd[1]: Starting Create List of Static Device Nodes...1689worker1 # [ 2.942652] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1690worker1 # [ 2.942788] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1691worker2 # [ 2.981766] systemd[1]: Finished Create List of Static Device Nodes.1692worker2 # [ 2.991132] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1693worker1 # [ 2.958757] systemd[1]: Mounting Kernel Configuration File System...1694client # [ 2.922672] systemd[1]: Starting Coldplug All udev Devices...1695client # [ 2.954027] systemd[1]: Finished Create List of Static Device Nodes.1696worker1 # [ 3.002518] systemd[1]: Starting Journal Service...1697worker2 # [ 3.033216] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1698worker2 # [ 3.033777] systemd[1]: Mounted Kernel Configuration File System.1699worker2 # [ 3.044153] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1700client # [ 2.988898] systemd-journald[73]: Collecting audit messages is disabled.1701worker1 # [ 3.034728] systemd[1]: Starting Load Kernel Modules...1702client # [ 3.002628] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1703client # [ 3.003399] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1704client # [ 3.010756] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1705worker1 # [ 3.116432] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1706worker2 # [ 3.165698] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1707worker2 # [ 3.176855] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1708client # [ 3.143838] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1709client # [ 3.146687] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1710client # [ 3.157723] systemd[1]: Mounted Kernel Configuration File System.1711worker2 # [ 3.266193] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01712worker2 # [ 3.266690] [drm] features: -virgl +edid -resource_blob -host_visible1713worker2 # [ 3.266702] [drm] features: -context_init1714worker2 # [ 3.294597] [drm] number of scanouts: 11715worker1 # [ 3.254610] systemd[1]: Starting Coldplug All udev Devices...1716worker2 # [ 3.294656] [drm] number of cap sets: 01717worker2 # [ 3.304808] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1718worker2 # [ 3.304980] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01719worker1 # [ 3.273878] systemd[1]: Finished Create List of Static Device Nodes.1720client # [ 3.238981] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01721client # [ 3.239298] [drm] features: -virgl +edid -resource_blob -host_visible1722client # [ 3.239311] [drm] features: -context_init1723client # [ 3.240274] [drm] number of scanouts: 11724client # [ 3.240299] [drm] number of cap sets: 01725client # [ 3.266230] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1726client # [ 3.266268] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01727worker1 # [ 3.316820] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1728worker2 # [ 3.352920] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1729worker1 # [ 3.327347] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1730worker1 # [ 3.327992] systemd[1]: Mounted Kernel Configuration File System.1731worker1 # [ 3.347221] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1732client # [ 3.306773] Console: switching to colour frame buffer device 160x501733worker2 # [ 3.391767] Console: switching to colour frame buffer device 160x501734worker2 # [ 3.392658] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1735client # [ 3.352181] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1736worker2 # [ 3.393567] systemd[1]: Starting Create Static Device Nodes in /dev...1737client # [ 3.357803] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1738client # [ 3.367790] systemd[1]: Starting Create Static Device Nodes in /dev...1739worker2 # [ 3.467884] systemd[1]: Finished Load Kernel Modules.1740worker2 # [ 3.470815] systemd[1]: Starting Apply Kernel Variables...1741client # [ 3.402624] systemd[1]: Finished Load Kernel Modules.1742client # [ 3.406694] systemd[1]: Starting Apply Kernel Variables...1743worker1 # [ 3.442766] systemd-journald[73]: Collecting audit messages is disabled.1744worker2 # [ 3.460284] systemd-modules-load[75]: Inserted module 'dm_mod'1745worker2 # [ 3.461550] systemd-modules-load[75]: Module 'virtio_balloon' is built in1746worker2 # [ 3.464876] systemd-modules-load[75]: Module 'virtio_console' is built in1747worker2 # [ 3.489674] systemd[1]: Started Journal Service.1748worker1 # [ 3.460701] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1749worker2 # [ 3.474403] systemd-modules-load[75]: Inserted module 'virtio_gpu'1750worker2 # [ 3.475517] systemd-modules-load[75]: Module 'virtio_rng' is built in1751worker1 # [ 3.482535] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1752client # [ 3.451358] systemd[1]: Finished Create Static Device Nodes in /dev.1753client # [ 3.451837] systemd[1]: Reached target Preparation for Local File Systems.1754client # [ 3.451892] systemd[1]: Reached target Local File Systems.1755worker1 # [ 3.494539] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01756worker1 # [ 3.494931] [drm] features: -virgl +edid -resource_blob -host_visible1757worker1 # [ 3.494945] [drm] features: -context_init1758worker1 # [ 3.495802] [drm] number of scanouts: 11759worker1 # [ 3.495824] [drm] number of cap sets: 01760worker2 # [ 3.513054] systemd[1]: Finished Create Static Device Nodes in /dev.1761worker1 # [ 3.502594] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1762worker2 # [ 3.516376] systemd[1]: Reached target Preparation for Local File Systems.1763client # [ 3.467074] systemd[1]: Starting Rule-based Manager for Device Events and Files...1764worker1 # [ 3.506922] systemd[1]: Starting Create Static Device Nodes in /dev...1765worker2 # [ 3.524623] systemd[1]: Reached target Local File Systems.1766worker2 # [ 3.528374] systemd[1]: Starting Create System Files and Directories...1767worker1 # [ 3.518842] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1768worker1 # [ 3.518873] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01769worker2 # [ 3.534763] systemd[1]: Starting Rule-based Manager for Device Events and Files...1770client # [ 3.494923] systemd[1]: Finished Apply Kernel Variables.1771worker2 # [ 3.550016] systemd[1]: Finished Apply Kernel Variables.1772client # [ 3.509724] systemd[1]: Started Journal Service.1773client # [ 3.486599] systemd-modules-load[74]: Inserted module 'dm_mod'1774client # [ 3.488543] systemd-modules-load[74]: Module 'virtio_balloon' is built in1775worker1 # [ 3.554859] Console: switching to colour frame buffer device 160x501776client # [ 3.500520] systemd-modules-load[74]: Module 'virtio_console' is built in1777client # [ 3.508446] systemd-modules-load[74]: Inserted module 'virtio_gpu'1778worker2 # [ 3.584357] systemd[1]: Finished Create System Files and Directories.1779client # [ 3.512451] systemd-modules-load[74]: Module 'virtio_rng' is built in1780client # [ 3.520656] systemd[1]: Starting Create System Files and Directories...1781worker1 # [ 3.587202] systemd[1]: Finished Create Static Device Nodes in /dev.1782worker1 # [ 3.588365] systemd[1]: Reached target Preparation for Local File Systems.1783worker1 # [ 3.588400] systemd[1]: Reached target Local File Systems.1784worker1 # [ 3.592242] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1785worker1 # [ 3.600026] systemd[1]: Starting Rule-based Manager for Device Events and Files...1786worker2 # [ 3.617251] systemd-udevd[88]: Using default interface naming scheme 'v261'.1787worker1 # [ 3.614575] systemd[1]: Finished Load Kernel Modules.1788client # [ 3.561434] systemd-udevd[80]: Using default interface naming scheme 'v261'.1789worker1 # [ 3.622888] systemd[1]: Starting Apply Kernel Variables...1790worker2 # [ 3.647333] systemd[1]: Started Rule-based Manager for Device Events and Files.1791worker1 # [ 3.638772] systemd[1]: Started Journal Service.1792client # [ 3.578961] systemd[1]: Finished Create System Files and Directories.1793worker1 # [ 3.594332] systemd-modules-load[74]: Inserted module 'dm_mod'1794worker1 # [ 3.604637] systemd-modules-load[74]: Module 'virtio_balloon' is built in1795worker1 # [ 3.605881] systemd-modules-load[74]: Module 'virtio_console' is built in1796worker1 # [ 3.606995] systemd-modules-load[74]: Inserted module 'virtio_gpu'1797worker1 # [ 3.614641] systemd-modules-load[74]: Module 'virtio_rng' is built in1798client # [ 3.604267] systemd[1]: Started Rule-based Manager for Device Events and Files.1799worker1 # [ 3.632130] systemd[1]: Starting Create System Files and Directories...1800worker1 # [ 3.682649] systemd[1]: Finished Apply Kernel Variables.1801lb # [ 2.245972] Freeing initrd memory: 26140K1802worker2 # [ 3.752144] systemd[1]: Starting Virtual Console Setup...1803worker1 # [ 3.710053] systemd-udevd[79]: Using default interface naming scheme 'v261'.1804client # [ 3.702116] systemd[1]: Starting Virtual Console Setup...1805worker1 # [ 3.716554] systemd[1]: Finished Create System Files and Directories.1806lb # [ 2.311398] tun: Universal TUN/TAP device driver, 1.61807lb # [ 2.318839] thunder_xcv, ver 1.01808lb # [ 2.318899] thunder_bgx, ver 1.01809lb # [ 2.318922] nicpf, ver 1.01810lb # [ 2.319576] e1000: Intel(R) PRO/1000 Network Driver1811lb # [ 2.319591] e1000: Copyright (c) 1999-2006 Intel Corporation.1812lb # [ 2.319640] e1000e: Intel(R) PRO/1000 Network Driver1813lb # [ 2.319660] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1814lb # [ 2.319736] igb: Intel(R) Gigabit Ethernet Network Driver1815lb # [ 2.319747] igb: Copyright (c) 2007-2014 Intel Corporation.1816lb # [ 2.319775] igbvf: Intel(R) Gigabit Virtual Function Network Driver1817lb # [ 2.319784] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1818lb # [ 2.319932] sky2: driver version 1.301819lb # [ 2.324369] usbcore: registered new interface driver usb-storage1820lb # [ 2.324727] usbcore: registered new interface driver usbserial_generic1821lb # [ 2.324748] usbserial: USB Serial support registered for generic1822lb # [ 2.326449] hv_vmbus: registering driver hyperv_keyboard1823lb # [ 2.327873] ehci-pci 0000:00:0a.0: EHCI Host Controller1824lb # [ 2.327921] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11825lb # [ 2.328149] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001826lb # [ 2.328688] rtc-pl031 9010000.pl031: registered as rtc01827lb # [ 2.328723] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:03:41 UTC (1789891421)1828lb # [ 2.329132] i2c_dev: i2c /dev entries driver1829lb # [ 2.332276] sdhci: Secure Digital Host Controller Interface driver1830lb # [ 2.332292] sdhci: Copyright(c) Pierre Ossman1831lb # [ 2.332614] Synopsys Designware Multimedia Card Interface Driver1832lb # [ 2.333017] sdhci-pltfm: SDHCI platform and OF driver helper1833lb # [ 2.334917] hid: raw HID events driver (C) Jiri Kosina1834lb # [ 2.335175] usbcore: registered new interface driver usbhid1835lb # [ 2.335181] usbhid: USB HID core driver1836lb # [ 2.336499] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1837lb # [ 2.338216] drop_monitor: Initializing network drop monitor service1838lb # [ 2.338415] NET: Registered PF_INET6 protocol family1839lb # [ 2.338673] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001840lb # [ 2.339013] hub 1-0:1.0: USB hub found1841lb # [ 2.339036] hub 1-0:1.0: 6 ports detected1842worker1 # [ 3.752634] systemd[1]: Started Rule-based Manager for Device Events and Files.1843lb # [ 2.375664] Segment Routing with IPv61844lb # [ 2.375824] In-situ OAM (IOAM) with IPv61845lb # [ 2.376072] NET: Registered PF_PACKET protocol family1846lb # [ 2.378188] 9pnet: Installing 9P2000 support1847worker2 # [ 3.842035] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1848worker2 # [ 3.846748] systemd[1]: Finished Virtual Console Setup.1849client # [ 3.776686] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1850client # [ 3.784716] systemd[1]: Finished Virtual Console Setup.1851lb # [ 2.458180] Key type dns_resolver registered1852lb # [ 2.470819] registered taskstats version 11853lb # [ 2.471325] Loading compiled-in X.509 certificates1854worker1 # [ 3.857681] systemd[1]: Starting Virtual Console Setup...1855lb # [ 2.484121] Demotion targets for Node 0: null1856lb # [ 2.485383] Key type .fscrypt registered1857lb # [ 2.485399] Key type fscrypt-provisioning registered1858lb # [ 2.485523] ima: No TPM chip found, activating TPM-bypass!1859lb # [ 2.485546] ima: Allocated hash algorithm: sha11860lb # [ 2.485787] ima: No architecture policies found1861lb # [ 2.494059] input: gpio-keys as /devices/platform/gpio-keys/input/input01862lb # [ 2.531138] clk: Disabling unused clocks1863lb # [ 2.531175] PM: genpd: Disabling unused power domains1864lb # [ 2.537320] Freeing unused kernel memory: 4736K1865lb # [ 2.537667] Run /init as init process1866worker1 # [ 3.928589] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1867lb # [ 2.552564] systemd[1]: Successfully made /usr/ read-only.1868worker1 # [ 3.936233] systemd[1]: Finished Virtual Console Setup.1869lb # [ 2.588424] usb 1-1: new high-speed USB device number 2 using ehci-pci1870lb # [ 2.749799] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11871lb # [ 2.821289] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01872lb # [ 2.890045] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1873lb # [ 2.902615] systemd[1]: Detected virtualization qemu.1874lb # [ 2.905117] systemd[1]: Detected architecture arm64.1875lb # [ 2.907181] systemd[1]: Running in initrd.1876lb # [ 2.911729] systemd[1]: Initializing machine ID from random generator.1877lb # [ 2.915185] systemd[1]: Hostname set to <lb>.1878lb # [ 2.948537] usb 1-2: new high-speed USB device number 3 using ehci-pci1879worker2 # [ 4.490116] systemd[1]: Finished Coldplug All udev Devices.1880worker2 # [ 4.491764] systemd[1]: Reached target System Initialization.1881worker2 # [ 4.496639] systemd[1]: Reached target Basic System.1882client # [ 4.483681] systemd[1]: Finished Coldplug All udev Devices.1883client # [ 4.484837] systemd[1]: Reached target System Initialization.1884client # [ 4.485685] systemd[1]: Reached target Basic System.1885lb # [ 3.175540] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21886lb # [ 3.179546] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01887worker1 # [ 4.650190] systemd[1]: Finished Coldplug All udev Devices.1888worker1 # [ 4.651295] systemd[1]: Reached target System Initialization.1889worker1 # [ 4.653293] systemd[1]: Reached target Basic System.1890worker2 # [ 4.737565] (udev-worker)[105]: Network interface NamePolicy= disabled on kernel command line.1891worker2 # [ 4.765513] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1892worker2 # [ 4.769927] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1893worker2 # [ 4.839476] systemd[1]: Found device /dev/disk/by-label/nixos.1894worker2 # [ 4.844229] systemd[1]: Reached target Initrd Root Device.1895client # [ 4.773704] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1896worker2 # [ 4.848486] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1897client # [ 4.783477] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1898client # [ 4.787840] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1899lb # [ 3.430891] systemd[1]: bpf-restrict-fs: LSM BPF program attached1900worker2 # [ 4.904271] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1901worker2 # [ 4.912726] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1902worker2 # [ 4.919664] systemd[1]: Mounting /sysroot...1903client # [ 4.886870] systemd[1]: Found device /dev/disk/by-label/nixos.1904client # [ 4.890070] systemd[1]: Reached target Initrd Root Device.1905client # [ 4.892843] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1906worker2 # [ 4.992795] EXT4-fs (vda): mounted filesystem 765cbe72-e471-42d7-823e-0cb465f20eb1 r/w with ordered data mode. Quota mode: none.1907worker2 # [ 4.984387] systemd[1]: Mounted /sysroot.1908worker2 # [ 4.986903] systemd[1]: Reached target Initrd Root File System.1909worker1 # [ 4.947982] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1910worker1 # [ 4.961935] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1911worker1 # [ 4.967015] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1912worker2 # [ 5.055180] systemd[1]: Starting Mountpoints Configured in the Real Root...1913worker2 # [ 5.073416] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1914worker2 # [ 5.079411] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1915worker2 # [ 5.081208] systemd[1]: Reloading...1916client # [ 5.076498] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1917worker1 # [ 5.104148] systemd[1]: Found device /dev/disk/by-label/nixos.1918worker1 # [ 5.107412] systemd[1]: Reached target Initrd Root Device.1919worker1 # [ 5.110073] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1920client # [ 5.118965] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1921lb # [ 3.773136] systemd[1]: Queued start job for default target Initrd Default Target.1922lb # [ 3.785013] systemd[1]: Created slice Slice /system/modprobe.1923lb # [ 3.787049] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1924lb # [ 3.789391] systemd[1]: Expecting device /dev/disk/by-label/nixos...1925lb # [ 3.791370] systemd[1]: Reached target Path Units.1926lb # [ 3.792854] systemd[1]: Reached target Slice Units.1927lb # [ 3.794231] systemd[1]: Reached target Swaps.1928lb # [ 3.795495] systemd[1]: Reached target Timer Units.1929lb # [ 3.797338] systemd[1]: Listening on D-Bus System Message Bus Socket.1930lb # [ 3.799509] systemd[1]: Listening on Journal Socket (/dev/log).1931lb # [ 3.801520] systemd[1]: Listening on Journal Sockets.1932lb # [ 3.803184] systemd[1]: Listening on udev Control Socket.1933lb # [ 3.805014] systemd[1]: Listening on udev Kernel Socket.1934lb # [ 3.805063] systemd[1]: Reached target Socket Units.1935lb # [ 3.810647] systemd[1]: Starting Create List of Static Device Nodes...1936lb # [ 3.818603] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1937lb # [ 3.820230] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1938client # [ 5.196626] systemd[1]: Mounting /sysroot...1939lb # [ 3.836657] systemd[1]: Mounting Kernel Configuration File System...1940lb # [ 3.847727] systemd[1]: Starting Journal Service...1941worker1 # [ 5.244862] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1942client # [ 5.262481] EXT4-fs (vda): mounted filesystem 643ff5cf-0743-43ac-ab6e-26dc850462ed r/w with ordered data mode. Quota mode: none.1943lb # [ 3.874539] systemd[1]: Starting Load Kernel Modules...1944lb # [ 3.874694] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1945client # [ 5.245966] systemd[1]: Mounted /sysroot.1946client # [ 5.250587] systemd[1]: Reached target Initrd Root File System.1947worker1 # [ 5.262669] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1948client # [ 5.256303] systemd[1]: Starting Mountpoints Configured in the Real Root...1949worker1 # [ 5.272590] systemd[1]: Mounting /sysroot...1950lb # [ 3.904892] systemd-journald[74]: Collecting audit messages is disabled.1951lb # [ 3.905955] systemd[1]: Starting Coldplug All udev Devices...1952lb # [ 3.913743] systemd[1]: Finished Create List of Static Device Nodes.1953lb # [ 3.915115] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1954lb # [ 3.915503] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1955lb # [ 3.915761] systemd[1]: Mounted Kernel Configuration File System.1956client # [ 5.283284] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1957client # [ 5.292376] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1958client # [ 5.295933] systemd[1]: Reloading...1959lb # [ 3.933692] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1960worker1 # [ 5.366881] EXT4-fs (vda): mounted filesystem 496e9f48-b36f-4463-ac22-bc775a755ada r/w with ordered data mode. Quota mode: none.1961worker1 # [ 5.324090] systemd[1]: Mounted /sysroot.1962worker1 # [ 5.326698] systemd[1]: Reached target Initrd Root File System.1963worker1 # [ 5.332614] systemd[1]: Starting Mountpoints Configured in the Real Root...1964worker1 # [ 5.370456] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1965lb # [ 3.991220] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1966worker1 # [ 5.376184] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1967worker1 # [ 5.380834] systemd[1]: Reloading...1968lb # [ 4.013402] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1969lb # [ 4.026169] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01970lb # [ 4.026447] [drm] features: -virgl +edid -resource_blob -host_visible1971lb # [ 4.026461] [drm] features: -context_init1972lb # [ 4.027265] [drm] number of scanouts: 11973lb # [ 4.027286] [drm] number of cap sets: 01974lb # [ 4.030922] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1975lb # [ 4.037421] systemd[1]: Starting Create Static Device Nodes in /dev...1976lb # [ 4.052332] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1977lb # [ 4.052399] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01978lb # [ 4.092776] Console: switching to colour frame buffer device 160x501979lb # [ 4.113206] systemd[1]: Finished Create Static Device Nodes in /dev.1980lb # [ 4.113460] systemd[1]: Reached target Preparation for Local File Systems.1981lb # [ 4.113490] systemd[1]: Reached target Local File Systems.1982lb # [ 4.087350] systemd-modules-load[76]: Inserted module 'dm_mod'1983lb # [ 4.088591] systemd-modules-load[76]: Module 'virtio_balloon' is built in1984lb # [ 4.089743] systemd-modules-load[76]: Module 'virtio_console' is built in1985lb # [ 4.124667] systemd[1]: Starting Rule-based Manager for Device Events and Files...1986lb # [ 4.129081] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1987worker2 # [ 5.575500] systemd[1]: Reloading finished in 496 ms.1988lb # [ 4.105190] systemd-modules-load[76]: Inserted module 'virtio_gpu'1989lb # [ 4.108640] systemd-modules-load[76]: Module 'virtio_rng' is built in1990worker2 # [ 5.608965] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace...1991worker2 # [ 5.614374] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace...1992worker2 # [ 5.619133] systemd[1]: initrd-parse-etc.service: Deactivated successfully.1993worker2 # [ 5.621682] systemd[1]: Finished Mountpoints Configured in the Real Root.1994worker2 # [ 5.622889] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.1995client # [ 5.549485] systemd[1]: Reloading finished in 257 ms.1996worker2 # [ 5.636607] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1997client # [ 5.578208] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace...1998lb # [ 4.144624] systemd[1]: Started Journal Service.1999lb # [ 4.186629] systemd[1]: Finished Load Kernel Modules.2000client # [ 5.583231] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace...
loading 1,178 hidden lines…
3179worker1 # [ 21.438732] dbus-broker-launch[527]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3180worker2 # [ 21.501027] network-addresses-eth1-start[681]: adding address 2001:db8:1::4/64... done3181worker1 # [ 21.471040] systemd-logind[549]: New seat seat0.3182worker1 # [ 21.471977] systemd-logind[549]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3183worker1 # [ 21.481397] systemd[1]: Started User Login Management.3184worker1 # [ 21.488540] systemd[1]: Starting linger-users.service...3185worker2 # [ 21.549611] systemd[1]: Finished Address configuration of eth1.3186worker1 # [ 21.497544] systemd[1]: Started D-Bus System Message Bus.3187client # [ 21.510055] cfg80211: Loading compiled-in X.509 certificates for regulatory database3188worker2 # [ 21.571255] dhcpcd[689]: dhcpcd-10.3.2 starting3189worker1 # [ 21.530503] systemd[1]: Stopped target Host and Network Name Lookups.3190worker2 # [ 21.598095] dhcpcd[729]: dev: loaded udev3191worker1 # [ 21.540708] systemd[1]: Stopping Host and Network Name Lookups...3192worker1 # [ 21.546658] systemd[1]: Stopped target User and Group Name Lookups.3193worker1 # [ 21.547685] systemd[1]: Stopping User and Group Name Lookups...3194lb # [ 20.176351] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33195client # [ 21.577837] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3196client # [ 21.580880] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3197worker1 # [ 21.567263] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3198worker1 # [ 21.573633] systemd[1]: nscd.service: Deactivated successfully.3199worker1 # [ 21.574501] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3200worker1 # [ 21.575364] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3201client # [ 21.586811] 8021q: adding VLAN 0 to HW filter on device eth13202client # [ 21.590869] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23203client # [ 21.591298] cfg80211: failed to load regulatory.db3204worker2 # [ 21.667965] 8021q: 802.1Q VLAN Support v1.83205lb # [ 20.176101] postgresql-pre-start[688]: selecting default "shared_buffers" ... 128MB3206worker2 # [ 21.668406] 8021q: adding VLAN 0 to HW filter on device eth13207worker1 # [ 21.590134] dbus-broker-launch[527]: Ready3208client # [ 21.610947] network-addresses-eth1-start[628]: adding address 192.168.1.1/24... done3209worker1 # [ 21.640402] systemd[1]: Condition check resulted in Virtio network device being skipped.3210worker2 # [ 21.715915] systemd[1]: Finished Extra networking commands..3211worker2 # [ 21.723541] systemd[1]: Reached target Network.3212worker1 # [ 21.667798] systemd[1]: linger-users.service: Deactivated successfully.3213worker1 # [ 21.672333] systemd[1]: Finished linger-users.service.3214client # [ 21.659819] network-addresses-eth1-start[628]: adding address 2001:db8:1::1/64... done3215worker2 # [ 21.731686] systemd[1]: Starting Permit User Sessions...3216worker1 # [ 21.709540] systemd[1]: Started Name Service Cache Daemon (nsncd).3217worker1 # [ 21.710614] systemd[1]: Reached target Host and Network Name Lookups.3218worker1 # [ 21.711509] systemd[1]: Reached target User and Group Name Lookups.3219worker1 # [ 21.718669] systemd-logind[549]: Watching system buttons on /dev/input/event0 (gpio-keys)3220worker2 # [ 21.803333] cfg80211: Loading compiled-in X.509 certificates for regulatory database3221worker1 # [ 21.723067] nsncd[597]: Sep 20 08:03:59.541 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3222client # [ 21.739982] dhcpcd[653]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (631) - Operation not permitted3223client # [ 21.753945] dhcpcd[653]: .resolvconf-wrapped: clearing stale lock pid 6313224worker2 # [ 21.852909] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3225worker2 # [ 21.853500] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3226worker2 # [ 21.859758] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23227worker2 # [ 21.860185] cfg80211: failed to load regulatory.db3228client # [ 21.765247] systemd[1]: Finished Address configuration of eth1.3229worker1 # [ 21.788577] systemd[1]: Finished resolvconf update.3230worker1 # [ 21.789577] systemd[1]: Reached target Preparation for Network.3231worker2 # [ 21.860291] systemd[1]: Finished Permit User Sessions.3232worker1 # [ 21.799270] systemd[1]: Starting DHCP Client...3233worker1 # [ 21.804792] systemd[1]: Starting Address configuration of eth1...3234worker2 # [ 21.867577] systemd[1]: Started Getty on tty1.3235worker2 # [ 21.870405] systemd[1]: Reached target Login Prompts.3236worker1 # [ 21.817100] systemd[1]: Starting Extra networking commands....3237client # [ 21.899809] 8021q: adding VLAN 0 to HW filter on device eth03238client # [ 21.877498] dhcpcd[620]: eth0: waiting for carrier3239client # [ 21.881129] dhcpcd[620]: libudev: received NULL device3240client # [ 21.882159] dhcpcd[620]: libudev: received NULL device3241client # [ 21.886729] dhcpcd[620]: eth0: carrier acquired3242client # [ 21.908673] dhcpcd[620]: DUID 00:01:00:01:32:42:4f:ef:52:54:00:12:34:563243client # [ 21.909804] dhcpcd[620]: eth0: IAID 00:12:34:563244client # [ 21.910519] dhcpcd[620]: eth0: adding address fe80::5054:ff:fe12:34563245client # [ 21.942128] systemd[1]: Finished Extra networking commands..3246client # [ 21.946437] systemd[1]: Reached target Network.3247worker2 # [ 22.047796] 8021q: adding VLAN 0 to HW filter on device eth03248worker2 # [ 22.028762] dhcpcd[729]: eth0: waiting for carrier3249worker2 # [ 22.032205] dhcpcd[729]: libudev: received NULL device3250worker2 # [ 22.033128] dhcpcd[729]: libudev: received NULL device3251worker2 # [ 22.034076] dhcpcd[729]: eth0: carrier acquired3252client # [ 21.962436] systemd[1]: Starting Permit User Sessions...3253worker2 # [ 22.057684] dhcpcd[729]: DUID 00:01:00:01:32:42:4f:ef:52:54:00:12:34:563254worker2 # [ 22.058862] dhcpcd[729]: eth0: IAID 00:12:34:563255worker2 # [ 22.059568] dhcpcd[729]: eth0: adding address fe80::5054:ff:fe12:34563256client # [ 22.030485] systemd[1]: Finished Permit User Sessions.3257client # [ 22.046526] systemd[1]: Started Getty on tty1.3258client # [ 22.051008] systemd[1]: Reached target Login Prompts.3259worker1 # [ 22.069304] network-addresses-eth1-start[625]: adding address 192.168.1.3/24... done3260worker1 # [ 22.117788] network-addresses-eth1-start[625]: adding address 2001:db8:1::3/64... done3261lb # [ 20.785278] systemd[1]: Starting Virtual Console Setup...3262worker1 # [ 22.201029] systemd[1]: Finished Address configuration of eth1.3263lb # [ 20.818811] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3264lb # [ 20.822319] systemd[1]: Stopped Virtual Console Setup.3265client # [ 22.247345] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33266lb # [ 20.836140] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs3267worker1 # [ 22.249088] dhcpcd[633]: dhcpcd-10.3.2 starting3268worker1 # [ 22.303245] mousedev: PS/2 mouse device common for all mice3269lb # [ 20.850884] systemd[1]: Starting Virtual Console Setup...3270worker1 # [ 22.298180] dhcpcd[682]: dev: loaded udev3271worker2 # [ 22.433026] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33272worker1 # [ 22.435131] 8021q: 802.1Q VLAN Support v1.83273lb # [ 20.978236] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.3274worker1 # [ 22.435629] 8021q: adding VLAN 0 to HW filter on device eth13275worker1 # [ 22.416363] systemd[1]: Finished Extra networking commands..3276worker1 # [ 22.417648] systemd[1]: Reached target Network.3277worker1 # [ 22.428234] systemd[1]: Starting Permit User Sessions...3278worker1 # [ 22.464887] systemd-logind[549]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3279lb # [ 21.064614] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.3280lb # [ 21.074721] systemd[1]: Started backdoor.service.3281worker1 # [ 22.599083] cfg80211: Loading compiled-in X.509 certificates for regulatory database3282worker1 # [ 22.597096] systemd[1]: Finished Permit User Sessions.3283worker1 # [ 22.606938] systemd[1]: Started Getty on tty1.3284worker1 # [ 22.617374] systemd[1]: Reached target Login Prompts.3285worker1 # [ 22.671317] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3286worker1 # [ 22.671892] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3287worker1 # [ 22.677337] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23288worker1 # [ 22.677738] cfg80211: failed to load regulatory.db3289lb # [ 21.254128] 8021q: 802.1Q VLAN Support v1.83290lb # connecting to host...3291lb # [ 21.283077] (udev-worker)[609]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3292lb # [ 21.301919] (udev-worker)[606]: Network interface NamePolicy= disabled on kernel command line.3293lb # [ 21.315605] (udev-worker)[609]: Network interface NamePolicy= disabled on kernel command line.3294worker1 # [ 22.869881] 8021q: adding VLAN 0 to HW filter on device eth03295worker1 # [ 22.823406] dhcpcd[682]: eth0: waiting for carrier3296worker1 # [ 22.828146] dhcpcd[682]: libudev: received NULL device3297worker1 # [ 22.829098] dhcpcd[682]: libudev: received NULL device3298worker1 # [ 22.830019] dhcpcd[682]: eth0: carrier acquired3299lb # [ 21.479867] cfg80211: Loading compiled-in X.509 certificates for regulatory database3300worker1 # [ 22.879555] dhcpcd[682]: DUID 00:01:00:01:32:42:4f:f0:52:54:00:12:34:563301worker1 # [ 22.881695] dhcpcd[682]: eth0: IAID 00:12:34:563302worker1 # [ 22.882365] dhcpcd[682]: eth0: adding address fe80::5054:ff:fe12:34563303client: (finished: waiting for unit network-addresses-eth1.service, in 22.04 seconds)3304client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3305lb # [ 21.556296] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3306lb # [ 21.560056] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3307worker2 # [ 23.001949] systemd[1]: Starting Virtual Console Setup...3308worker2 # [ 23.003724] dhcpcd[729]: eth0: soliciting a DHCP lease3309lb # [ 21.568284] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23310lb # [ 21.568839] cfg80211: failed to load regulatory.db3311worker2 # [ 23.019358] dhcpcd[729]: eth0: offered 10.0.2.15 from 10.0.2.23312worker2 # [ 23.033215] dhcpcd[729]: eth0: probing address 10.0.2.15/243313worker2 # [ 23.054249] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3314worker2 # [ 23.055498] systemd[1]: Stopped Virtual Console Setup.3315lb # [ 21.588463] systemd[1]: Condition check resulted in Virtio network device being skipped.3316client # [ 22.985263] systemd[1]: Starting Virtual Console Setup...3317worker2 # [ 23.063422] systemd[1]: Starting Virtual Console Setup...3318lb # [ 21.616185] systemd[1]: Starting Address configuration of eth1...3319worker2 # [ 23.090536] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3320client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.14 seconds)3321lb: waiting for unit network-addresses-eth1.service3322lb: waiting for the VM to finish booting3323lb: Guest shell says: b'Spawning backdoor root shell...\n'3324lb: connected to guest root shell3325lb: (connecting took 0.00 seconds)3326lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3327client # [ 23.039705] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3328client # [ 23.047129] systemd[1]: Stopped Virtual Console Setup.3329client # [ 23.056559] systemd[1]: Starting Virtual Console Setup...3330worker2 # [ 23.167628] systemd-logind[598]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3331client # [ 23.098139] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3332client # [ 23.151924] systemd-logind[515]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3333lb # [ 21.876884] 8021q: adding VLAN 0 to HW filter on device eth03334lb # [ 21.857385] dhcpcd[658]: eth0: waiting for carrier3335lb # [ 21.864865] dhcpcd[658]: eth0: carrier acquired3336lb # [ 21.911639] 8021q: adding VLAN 0 to HW filter on device eth13337lb # [ 21.896860] dhcpcd[658]: DUID 00:01:00:01:32:42:4f:f1:52:54:00:12:34:563338lb # [ 21.899632] dhcpcd[658]: eth0: IAID 00:12:34:563339lb # [ 21.903745] dhcpcd[658]: eth0: adding address fe80::5054:ff:fe12:34563340lb # [ 21.917687] network-addresses-eth1-start[724]: adding address 192.168.1.2/24... done3341lb # [ 21.939284] systemd-vconsole-setup[706]: Configuration of first virtual console was skipped, ignoring remaining ones.3342lb # [ 21.947339] network-addresses-eth1-start[724]: adding address 2001:db8:1::2/64... done3343lb # [ 21.954874] systemd[1]: Finished Virtual Console Setup.3344lb # [ 21.968533] dhcpcd[658]: eth0: soliciting a DHCP lease3345lb # [ 21.977757] dhcpcd[658]: eth0: offered 10.0.2.15 from 10.0.2.23346lb # [ 21.984458] dhcpcd[658]: eth0: probing address 10.0.2.15/243347lb # [ 21.987983] systemd[1]: Finished Address configuration of eth1.3348client # [ 23.448543] dhcpcd[620]: eth0: soliciting a DHCP lease3349client # [ 23.453306] dhcpcd[620]: eth0: offered 10.0.2.15 from 10.0.2.23350client # [ 23.464606] dhcpcd[620]: eth0: probing address 10.0.2.15/243351lb # [ 22.233772] systemd-logind[521]: Watching system buttons on /dev/input/event0 (gpio-keys)3352worker2 # [ 23.829304] dhcpcd[729]: eth0: soliciting an IPv6 router3353worker2 # [ 23.830804] dhcpcd[729]: eth0: Router Advertisement from fe80::23354worker2 # [ 23.831657] dhcpcd[729]: eth0: adding address fec0::5054:ff:fe12:3456/643355worker2 # [ 23.833068] dhcpcd[729]: eth0: adding route to fec0::/643356worker2 # [ 23.834681] dhcpcd[729]: eth0: adding default route via fe80::23357lb # [ 22.434204] mousedev: PS/2 mouse device common for all mice3358lb # [ 22.496659] systemd-logind[521]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3359worker2 # [ 24.095105] systemd-vconsole-setup[781]: Configuration of first virtual console was skipped, ignoring remaining ones.3360worker2 # [ 24.100756] systemd[1]: Finished Virtual Console Setup.3361client # [ 24.080485] dhcpcd[620]: eth0: soliciting an IPv6 router3362client # [ 24.085774] dhcpcd[620]: eth0: Router Advertisement from fe80::23363client # [ 24.087346] dhcpcd[620]: eth0: adding address fec0::5054:ff:fe12:3456/643364client # [ 24.089050] dhcpcd[620]: eth0: adding route to fec0::/643365client # [ 24.091561] dhcpcd[620]: eth0: adding default route via fe80::23366worker1 # [ 24.129016] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3367worker1 # [ 24.139585] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3368worker1 # [ 24.142955] systemd[1]: Stopped Virtual Console Setup.3369worker1 # [ 24.143785] systemd[1]: Stopping Virtual Console Setup...3370worker1 # [ 24.149894] systemd[1]: Starting Virtual Console Setup...3371worker1 # [ 24.176975] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3372worker1 # [ 24.178177] systemd[1]: Stopped Virtual Console Setup.3373worker1 # [ 24.182348] dhcpcd[682]: eth0: soliciting a DHCP lease3374worker1 # [ 24.186956] systemd[1]: Starting Virtual Console Setup...3375worker1 # [ 24.191003] dhcpcd[682]: eth0: offered 10.0.2.15 from 10.0.2.23376worker1 # [ 24.196555] dhcpcd[682]: eth0: probing address 10.0.2.15/243377client # [ 24.201814] systemd-vconsole-setup[733]: Configuration of first virtual console was skipped, ignoring remaining ones.3378client # [ 24.207803] systemd[1]: Finished Virtual Console Setup.3379lb: (finished: waiting for unit network-addresses-eth1.service, in 1.38 seconds)3380lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3381lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.09 seconds)3382worker1: waiting for unit network-addresses-eth1.service3383worker1: waiting for the VM to finish booting3384worker1: Guest shell says: b'Spawning backdoor root shell...\n'3385worker1: connected to guest root shell3386worker1: (connecting took 0.00 seconds)3387worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3388worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.20 seconds)3389worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3390worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.09 seconds)3391worker2: waiting for unit network-addresses-eth1.service3392worker2: waiting for the VM to finish booting3393worker2: Guest shell says: b'Spawning backdoor root shell...\n'3394worker2: connected to guest root shell3395worker2: (connecting took 0.00 seconds)3396worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3397lb # [ 23.606323] dhcpcd[658]: eth0: soliciting an IPv6 router3398lb # [ 23.609455] dhcpcd[658]: eth0: Router Advertisement from fe80::23399lb # [ 23.610276] dhcpcd[658]: eth0: adding address fec0::5054:ff:fe12:3456/643400lb # [ 23.611132] dhcpcd[658]: eth0: adding route to fec0::/643401lb # [ 23.613058] dhcpcd[658]: eth0: adding default route via fe80::23402worker1 # [ 25.078373] dhcpcd[682]: eth0: soliciting an IPv6 router3403worker1 # [ 25.080399] dhcpcd[682]: eth0: Router Advertisement from fe80::23404worker1 # [ 25.082221] dhcpcd[682]: eth0: adding address fec0::5054:ff:fe12:3456/643405worker1 # [ 25.083657] dhcpcd[682]: eth0: adding route to fec0::/643406worker1 # [ 25.084622] dhcpcd[682]: eth0: adding default route via fe80::23407worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.43 seconds)3408worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3409worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.06 seconds)3410lb: waiting for unit niks3.service3411worker1 # [ 25.369073] systemd-vconsole-setup[724]: Configuration of first virtual console was skipped, ignoring remaining ones.3412worker1 # [ 25.375262] systemd[1]: Finished Virtual Console Setup.3413lb # [ 24.315073] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3414lb # [ 24.317844] systemd[1]: Stopped Virtual Console Setup.3415lb # [ 24.323339] systemd[1]: Stopping Virtual Console Setup...3416lb # [ 24.352921] systemd[1]: Starting Virtual Console Setup...3417lb # [ 24.477056] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3418lb # [ 24.490760] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3419lb # [ 24.495329] systemd[1]: Stopped Virtual Console Setup.3420lb # [ 24.525620] systemd[1]: Starting Virtual Console Setup...3421lb # [ 24.532800] systemd-logind[521]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3422lb # [ 25.040002] postgresql-pre-start[688]: selecting default time zone ... UTC3423lb # [ 25.047942] postgresql-pre-start[688]: creating configuration files ... ok3424lb # [ 25.317422] systemd-vconsole-setup[784]: Configuration of first virtual console was skipped, ignoring remaining ones.3425lb # [ 25.325158] systemd[1]: Finished Virtual Console Setup.3426lb # [ 25.588788] postgresql-pre-start[688]: running bootstrap script ... ok3427client # [ 27.720872] dhcpcd[620]: eth0: leased 10.0.2.15 for 86400 seconds3428client # [ 27.723356] dhcpcd[620]: eth0: adding route to 10.0.2.0/243429client # [ 27.726320] dhcpcd[620]: eth0: adding default route via 10.0.2.23430client # [ 28.081919] systemd[1]: Started DHCP Client.3431client # [ 28.085394] systemd[1]: Reached target Multi-User System.3432client # [ 28.087443] systemd[1]: Startup finished in 1.849s (kernel) + 8.618s (initrd) + 17.619s (userspace) = 28.087s.3433worker2 # [ 28.242991] dhcpcd[729]: eth0: leased 10.0.2.15 for 86400 seconds3434worker2 # [ 28.243188] dhcpcd[729]: eth0: adding route to 10.0.2.0/243435worker2 # [ 28.243236] dhcpcd[729]: eth0: adding default route via 10.0.2.23436lb # [ 27.007565] postgresql-pre-start[688]: performing post-bootstrap initialization ... ok3437lb # [ 27.083539] dhcpcd[658]: eth0: leased 10.0.2.15 for 86400 seconds3438worker2 # [ 28.562226] systemd[1]: Started DHCP Client.3439worker2 # [ 28.565401] systemd[1]: Reached target Multi-User System.3440worker2 # [ 28.566928] systemd[1]: Startup finished in 1.790s (kernel) + 8.085s (initrd) + 18.689s (userspace) = 28.565s.3441lb # [ 27.088754] dhcpcd[658]: eth0: adding route to 10.0.2.0/243442lb # [ 27.099065] dhcpcd[658]: eth0: adding default route via 10.0.2.23443lb # [ 27.414139] systemd[1]: Started DHCP Client.3444lb # [ 27.417350] systemd[1]: Reached target Network is Online.3445lb # [ 27.438184] systemd[1]: Started Envoy reverse proxy.3446lb # [ 27.449631] systemd[1]: Started mock-oidc.service.3447lb # [ 27.495974] postgresql-pre-start[688]: syncing data to disk ... ok3448lb # [ 27.499381] postgresql-pre-start[688]: initdb: warning: enabling "trust" authentication for local connections3449lb # [ 27.511192] postgresql-pre-start[688]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3450lb # [ 27.515631] postgresql-pre-start[688]: Success. You can now start the database server using:3451lb # [ 27.518325] postgresql-pre-start[688]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3452lb # [ 27.730820] mock-oidc-server[873]: Mock OIDC Server running3453lb # [ 27.738866] mock-oidc-server[873]: OIDC Address: 192.168.1.2:80803454lb # [ 27.740692] mock-oidc-server[873]: Issue Address: 0.0.0.0:80813455lb # [ 27.755809] mock-oidc-server[873]: Issuer: http://192.168.1.2:8080/oidc3456lb # [ 27.763057] mock-oidc-server[873]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3457lb # [ 27.780927] mock-oidc-server[873]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3458lb # [ 27.784308] mock-oidc-server[873]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3459lb # [ 27.987356] postgres[880]: [880] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3460lb # [ 27.994421] postgres[880]: [880] LOG: listening on IPv6 address "::1", port 54323461lb # [ 27.996977] postgres[880]: [880] LOG: listening on IPv4 address "127.0.0.1", port 54323462lb # [ 28.027922] postgres[880]: [880] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3463lb # [ 28.050653] postgres[904]: [904] LOG: database system was shut down at 2026-09-20 08:04:06 GMT3464worker1 # [ 29.462451] dhcpcd[682]: eth0: leased 10.0.2.15 for 86400 seconds3465worker1 # [ 29.462697] dhcpcd[682]: eth0: adding route to 10.0.2.0/243466worker1 # [ 29.462747] dhcpcd[682]: eth0: adding default route via 10.0.2.23467lb # [ 28.070408] postgres[880]: [880] LOG: database system is ready to accept connections3468lb # [ 28.081249] systemd[1]: Started PostgreSQL Server.3469lb # [ 28.098317] systemd[1]: Starting PostgreSQL Setup Scripts...3470worker1 # [ 29.795552] systemd[1]: Started DHCP Client.3471worker1 # [ 29.799170] systemd[1]: Reached target Multi-User System.3472worker1 # [ 29.801036] systemd[1]: Startup finished in 1.760s (kernel) + 9.069s (initrd) + 18.969s (userspace) = 29.798s.3473lb # [ 28.695453] postgresql-setup-start[916]: CREATE DATABASE3474lb # [ 28.806203] postgresql-setup-start[921]: CREATE ROLE3475lb # [ 28.857049] postgresql-setup-start[923]: ALTER DATABASE3476lb # [ 28.880973] systemd[1]: Finished PostgreSQL Setup Scripts.3477lb # [ 28.883969] systemd[1]: Reached target PostgreSQL.3478lb # [ 29.795552] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3479lb # [ 29.795997] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:469] statically linked extensions:3480lb # [ 29.796140] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3481lb # [ 29.796176] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3482lb # [ 29.796208] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3483lb # [ 29.796240] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3484lb # [ 29.796275] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3485lb # [ 29.796363] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3486lb # [ 29.854051] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3487lb # [ 29.857184] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3488lb # [ 29.867839] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3489lb # [ 29.872652] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3490lb # [ 29.876473] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3491lb # [ 29.883502] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3492lb # [ 29.888328] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3493lb # [ 29.895943] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3494lb # [ 29.899261] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3495lb # [ 29.915359] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3496lb # [ 29.919633] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3497lb # [ 29.923221] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3498lb # [ 29.927409] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3499lb # [ 29.936069] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3500lb # [ 29.948430] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3501lb # [ 29.968117] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3502lb # [ 29.971217] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3503lb # [ 29.975378] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3504lb # [ 29.992817] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3505lb # [ 29.995012] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3506lb # [ 29.997612] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3507lb # [ 30.001511] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3508lb # [ 30.003398] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3509lb # [ 30.006280] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3510lb # [ 30.010066] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3511lb # [ 30.011918] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3512lb # [ 30.019107] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3513lb # [ 30.021189] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3514lb # [ 30.023586] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3515lb # [ 30.025345] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3516lb # [ 30.028005] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3517lb # [ 30.030288] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3518lb # [ 30.033161] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3519lb # [ 30.035280] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3520lb # [ 30.037617] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3521lb # [ 30.041582] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3522lb # [ 30.044684] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3523lb # [ 30.053340] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13524lb # [ 30.055654] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3525lb # [ 30.058993] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3526lb # [ 30.061041] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3527lb # [ 30.063792] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3528lb # [ 30.067166] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3529lb # [ 30.070324] envoy[872]: [2026-09-20 08:04:08.997][872][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3530lb # [ 30.077475] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3531lb # [ 30.080923] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3532lb # [ 30.085991] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3533lb # [ 30.089503] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3534lb # [ 30.093809] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3535lb # [ 30.096524] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3536lb # [ 30.099416] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3537lb # [ 30.102613] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3538lb # [ 30.106247] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3539lb # [ 30.110600] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3540lb # [ 30.113822] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3541lb # [ 30.118553] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3542lb # [ 30.122441] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3543lb # [ 30.124969] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3544lb # [ 30.132662] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3545lb # [ 30.138998] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3546lb # [ 30.149179] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3547lb # [ 30.153095] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3548lb # [ 30.157951] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3549lb # [ 30.163693] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3550lb # [ 30.195551] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3551lb # [ 30.197458] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23552lb # [ 30.200283] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83553lb # [ 30.206430] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3554lb # [ 30.214534] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3555lb # [ 30.221094] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3556lb # [ 30.225442] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3557lb # [ 30.229677] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3558lb # [ 30.234172] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3559lb # [ 30.236870] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3560lb # [ 30.245709] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3561lb # [ 30.255551] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3562lb # [ 30.260817] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3563lb # [ 30.265844] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3564lb # [ 30.269271] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3565lb # [ 30.271790] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3566lb # [ 30.276472] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23567lb # [ 30.279376] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3568lb # [ 30.283277] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3569lb # [ 30.285680] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3570lb # [ 30.287486] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3571lb # [ 30.290061] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3572lb # [ 30.293161] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3573lb # [ 30.302737] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3574lb # [ 30.305586] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3575lb # [ 30.313068] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3576lb # [ 30.315344] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3577lb # [ 30.318097] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3578lb # [ 30.320374] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3579lb # [ 30.322659] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3580lb # [ 30.326371] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3581lb # [ 30.333399] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23582lb # [ 30.335492] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3583lb # [ 30.339179] envoy[872]: [2026-09-20 08:04:08.998][872][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3584lb # [ 30.347304] envoy[872]: [2026-09-20 08:04:09.053][872][info][main] [source/server/server.cc:531] HTTP header map info:3585lb # [ 30.348963] envoy[872]: [2026-09-20 08:04:09.056][872][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3586lb # [ 30.370421] envoy[872]: [2026-09-20 08:04:09.056][872][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3587lb # [ 30.372090] envoy[872]: [2026-09-20 08:04:09.056][872][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3588lb # [ 30.389947] envoy[872]: [2026-09-20 08:04:09.056][872][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3589lb # [ 30.397063] envoy[872]: [2026-09-20 08:04:09.338][872][info][main] [source/server/server.cc:968] runtime: {}3590lb # [ 30.404288] envoy[872]: [2026-09-20 08:04:09.351][872][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3591lb # [ 30.407862] envoy[872]: [2026-09-20 08:04:09.352][872][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013592lb # [ 30.413491] envoy[872]: [2026-09-20 08:04:09.352][872][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013593lb # [ 30.415589] envoy[872]: [2026-09-20 08:04:09.354][872][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3594lb # [ 30.417704] envoy[872]: [2026-09-20 08:04:09.354][872][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3595lb # [ 30.419713] envoy[872]: [2026-09-20 08:04:09.354][872][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3596lb # [ 30.454286] envoy[872]: [2026-09-20 08:04:09.657][872][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3597worker1 # [ 31.872774] systemd[1]: Starting Nix worker-protocol over gRPC...3598worker2 # [ 31.937509] systemd[1]: Starting Nix worker-protocol over gRPC...3599lb # [ 30.479652] envoy[872]: [2026-09-20 08:04:09.682][872][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3600lb # [ 30.486761] envoy[872]: [2026-09-20 08:04:09.686][872][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3601lb # [ 30.490418] envoy[872]: [2026-09-20 08:04:09.686][872][info][main] [source/server/server.cc:1077] starting main dispatch loop3602worker2 # [ 32.199688] nix-grpc-daemon[855]: ts=2026-09-20T08:04:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3603worker2 # [ 32.222202] nix-grpc-daemon[855]: ts=2026-09-20T08:04:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13604worker2 # [ 32.289490] nix-grpc-daemon[855]: ts=2026-09-20T08:04:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3605worker2 # [ 32.298331] systemd[1]: Started Nix worker-protocol over gRPC.3606worker2 # [ 32.363220] nix-grpc-daemon[855]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3607lb # [ 30.893670] envoy[872]: [2026-09-20 08:04:10.096][872][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3608lb # [ 30.895442] envoy[872]: [2026-09-20 08:04:10.096][872][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3609lb # [ 30.898256] envoy[872]: [2026-09-20 08:04:10.096][872][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3610lb # [ 30.905046] envoy[872]: [2026-09-20 08:04:10.096][872][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3611worker1 # [ 32.447157] nix-grpc-daemon[797]: ts=2026-09-20T08:04:10Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3612worker1 # [ 32.482427] nix-grpc-daemon[797]: ts=2026-09-20T08:04:10Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13613worker2 # [ 32.564166] nix-grpc-daemon[855]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3614worker1 # [ 32.584966] nix-grpc-daemon[797]: ts=2026-09-20T08:04:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3615worker1 # [ 32.587130] systemd[1]: Started Nix worker-protocol over gRPC.3616worker1 # [ 32.733505] nix-grpc-daemon[797]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500513617worker1 # [ 32.754347] nix-grpc-daemon[797]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3618worker2 # [ 32.964696] nix-grpc-daemon[855]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3619worker1 # [ 32.955346] nix-grpc-daemon[797]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500513620worker1 # [ 32.979084] nix-grpc-daemon[797]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3621worker1 # [ 33.180263] nix-grpc-daemon[797]: ts=2026-09-20T08:04:11Z level=info event=scheduler_connected addr=lb:500513622worker1 # [ 33.186387] nix-grpc-daemon[797]: ts=2026-09-20T08:04:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3623worker1 # [ 33.387352] nix-grpc-daemon[797]: ts=2026-09-20T08:04:11Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 33.393507] nix-grpc-daemon[797]: ts=2026-09-20T08:04:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3625worker1 # [ 33.595411] nix-grpc-daemon[797]: ts=2026-09-20T08:04:11Z level=info event=scheduler_connected addr=lb:500513626worker1 # [ 33.605699] nix-grpc-daemon[797]: ts=2026-09-20T08:04:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3627worker2 # [ 33.767173] nix-grpc-daemon[855]: ts=2026-09-20T08:04:11Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 33.774450] nix-grpc-daemon[855]: ts=2026-09-20T08:04:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3629worker1 # [ 33.809949] nix-grpc-daemon[797]: ts=2026-09-20T08:04:11Z level=info event=scheduler_connected addr=lb:500513630worker1 # [ 33.815133] nix-grpc-daemon[797]: ts=2026-09-20T08:04:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3631worker2 # [ 33.975665] nix-grpc-daemon[855]: ts=2026-09-20T08:04:11Z level=info event=scheduler_connected addr=lb:500513632worker2 # [ 33.979984] nix-grpc-daemon[855]: ts=2026-09-20T08:04:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3633worker1 # [ 34.016133] nix-grpc-daemon[797]: ts=2026-09-20T08:04:11Z level=info event=scheduler_connected addr=lb:500513634worker1 # [ 34.019687] nix-grpc-daemon[797]: ts=2026-09-20T08:04:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3635worker2 # [ 34.180943] nix-grpc-daemon[855]: ts=2026-09-20T08:04:11Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 34.187098] nix-grpc-daemon[855]: ts=2026-09-20T08:04:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3637worker1 # [ 34.220689] nix-grpc-daemon[797]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500513638worker1 # [ 34.224653] nix-grpc-daemon[797]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3639worker2 # [ 34.388466] nix-grpc-daemon[855]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 34.395649] nix-grpc-daemon[855]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3641worker1 # [ 34.425650] nix-grpc-daemon[797]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500513642worker1 # [ 34.435697] nix-grpc-daemon[797]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3643worker2 # [ 34.597962] nix-grpc-daemon[855]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 34.606526] nix-grpc-daemon[855]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3645worker1 # [ 34.637429] nix-grpc-daemon[797]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500513646worker1 # [ 34.647492] nix-grpc-daemon[797]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3647worker2 # [ 34.807739] nix-grpc-daemon[855]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 34.817146] nix-grpc-daemon[855]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3649lb # [ 33.402483] rustfs-bucket-start[969]: mb s3://farm3650lb # [ 33.433102] systemd[1]: Finished rustfs-bucket.service.3651worker1 # [ 34.849523] nix-grpc-daemon[797]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500513652lb # [ 33.448647] systemd[1]: Starting niks3 server...3653worker1 # [ 34.855590] nix-grpc-daemon[797]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3654worker2 # [ 35.018199] nix-grpc-daemon[855]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500513655worker2 # [ 35.026392] nix-grpc-daemon[855]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3656worker1 # [ 35.056631] nix-grpc-daemon[797]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500513657worker1 # [ 35.061104] nix-grpc-daemon[797]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3658worker2 # [ 35.227387] nix-grpc-daemon[855]: ts=2026-09-20T08:04:13Z level=info event=scheduler_connected addr=lb:500513659worker2 # [ 35.231583] nix-grpc-daemon[855]: ts=2026-09-20T08:04:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3660worker1 # [ 35.262189] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=scheduler_connected addr=lb:500513661worker1 # [ 35.274835] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3662worker2 # [ 35.432758] nix-grpc-daemon[855]: ts=2026-09-20T08:04:13Z level=info event=scheduler_connected addr=lb:500513663worker2 # [ 35.437819] nix-grpc-daemon[855]: ts=2026-09-20T08:04:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3664lb # [ 34.053053] postgres[989]: [989] ERROR: relation "goose_db_version" does not exist at character 363665lb # [ 34.062941] postgres[989]: [989] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3666worker1 # [ 35.476792] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=scheduler_connected addr=lb:500513667worker1 # [ 35.484160] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3668worker2 # [ 35.638809] nix-grpc-daemon[855]: ts=2026-09-20T08:04:13Z level=info event=scheduler_connected addr=lb:500513669worker2 # [ 35.667307] nix-grpc-daemon[855]: ts=2026-09-20T08:04:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3670lb # [ 34.233645] niks3-server[979]: 2026/09/20 08:04:13 OK 20241026095416_initial_model.sql (76.42ms)3671lb # [ 34.244792] niks3-server[979]: 2026/09/20 08:04:13 OK 20251210153512_drop_unused_gin_index.sql (8.86ms)3672lb # [ 34.257697] niks3-server[979]: 2026/09/20 08:04:13 OK 20251218171726_add_pins.sql (12.8ms)3673worker1 # [ 35.690953] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=scheduler_connected addr=lb:500513674worker1 # [ 35.692649] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3675lb # [ 34.283597] niks3-server[979]: 2026/09/20 08:04:13 OK 20260628120000_add_object_size_and_stats.sql (25.83ms)3676lb # [ 34.302694] niks3-server[979]: 2026/09/20 08:04:13 OK 20260905000000_add_claims.sql (18.89ms)3677lb # [ 34.321554] niks3-server[979]: 2026/09/20 08:04:13 OK 20260920000000_drop_claims.sql (18.75ms)3678lb # [ 34.323223] niks3-server[979]: 2026/09/20 08:04:13 goose: successfully migrated database to version: 202609200000003679lb # [ 34.337988] niks3-server[979]: 2026/09/20 08:04:13 OK 1_commit_pending_closure.sql (16.39ms)3680lb # [ 34.353461] niks3-server[979]: 2026/09/20 08:04:13 OK 2_object_stats_trigger.sql (7.34ms)3681lb # [ 34.355537] niks3-server[979]: 2026/09/20 08:04:13 goose: up to current file version: 23682lb # [ 34.367768] niks3-server[979]: 2026/09/20 08:04:13 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3683worker2 # [ 35.868923] nix-grpc-daemon[855]: ts=2026-09-20T08:04:13Z level=info event=scheduler_connected addr=lb:500513684worker2 # [ 35.875117] nix-grpc-daemon[855]: ts=2026-09-20T08:04:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3685worker1 # [ 35.895575] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=scheduler_connected addr=lb:500513686worker1 # [ 35.903320] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3687lb # [ 34.549486] niks3-server[979]: 2026/09/20 08:04:13 INFO Read proxy enabled — serving cache objects from S33688lb # [ 34.555025] niks3-server[979]: 2026/09/20 08:04:13 INFO Using socket-activated listener address=0.0.0.0:57513689lb # [ 34.562443] systemd[1]: Started niks3 server.3690lb # [ 34.563824] niks3-server[979]: 2026/09/20 08:04:13 INFO systemd watchdog enabled interval=15s3691lb # [ 34.570912] systemd[1]: Reached target Multi-User System.3692lb # [ 34.571846] systemd[1]: Startup finished in 2.511s (kernel) + 6.268s (initrd) + 25.789s (userspace) = 34.570s.3693lb # [ 34.575991] niks3-server[979]: 2026/09/20 08:04:13 INFO Starting HTTP server address=0.0.0.0:57513694lb # [ 34.580116] niks3-server[979]: 2026/09/20 08:04:13 INFO lead: acquired remote=192.168.1.3:391063695worker1 # [ 35.998526] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=scheduler_take_over3696worker2 # [ 36.076166] nix-grpc-daemon[855]: ts=2026-09-20T08:04:13Z level=info event=scheduler_connected addr=lb:500513697worker1 # [ 36.035776] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03698worker1 # [ 36.102624] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=scheduler_connected addr=lb:500513699worker1 # [ 36.107199] nix-grpc-daemon[797]: ts=2026-09-20T08:04:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3700worker1 # [ 36.308249] nix-grpc-daemon[797]: ts=2026-09-20T08:04:14Z level=info event=scheduler_connected addr=lb:500513701worker1 # [ 36.312555] nix-grpc-daemon[797]: ts=2026-09-20T08:04:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03702lb: (finished: waiting for unit niks3.service, in 11.19 seconds)3703lb: waiting for TCP port 5751 on localhost3704lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3705lb: (finished: waiting for TCP port 5751 on localhost, in 0.15 seconds)3706lb: waiting for unit envoy.service3707lb: (finished: waiting for unit envoy.service, in 0.13 seconds)3708lb: waiting for TCP port 50051 on localhost3709lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3710lb # [ 35.422912] envoy[872]: conn peer=[::1]:42926 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=53711lb: (finished: waiting for TCP port 50051 on localhost, in 0.08 seconds)3712lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3713lb: must succeed: curl -sf localhost:9901/clusters3714lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.15 seconds)3715lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.15 seconds)3716subtest: one node schedules and both builders hold a WorkerSession on it3717lb: must succeed: curl -sf localhost:9901/clusters3718lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.14 seconds)3719worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3720worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.12 seconds)3721lb: must succeed: curl -sf localhost:9901/clusters3722lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3723lb: must succeed: curl -sf localhost:9901/clusters3724lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3725worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true3726worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.11 seconds)3727lb: must succeed: curl -sf localhost:9901/clusters3728lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.14 seconds)3729lb: must succeed: curl -sf localhost:9901/clusters3730lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3731worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true3732worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.08 seconds)3733worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true3734worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true, in 0.09 seconds)3735worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true3736worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true, in 0.09 seconds)3737worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true3738worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true, in 0.14 seconds)3739(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 1.15 seconds)3740subtest: balancer auth: client cert, bearer token, nothing, unknown CN3741worker1 # [ 38.710820] nix-grpc-daemon[797]: ts=2026-09-20T08:04:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492663742worker1 # [ 38.723122] systemd[1]: Started Nix Daemon.3743worker1 # [ 39.144920] nix-daemon[881]: accepted connection from pid 797, user nix-grpc-daemon (trusted)3744worker1 # [ 39.208293] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 1/5)3745worker1 # [ 39.281595] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 2/5)3746worker1 # [ 39.293807] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 220 ms (attempt 3/5)3747worker1 # [ 39.518666] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 4/5)3748worker1 # [ 39.582035] nix-grpc-daemon[797]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3749worker1 # [ 39.615839] nix-grpc-daemon[797]: ts=2026-09-20T08:04:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492663750worker1 # [ 39.633882] nix-grpc-daemon[797]: ts=2026-09-20T08:04:17Z level=debug event=path_info_miss path=gpf58crna23m3bj51fx82f4mmyq9cz2y-nixos-system-client-test error="error: path '/nix/store/gpf58crna23m3bj51fx82f4mmyq9cz2y-nixos-system-client-test' is required, but there is no substituter that can build it"3751worker1 # [ 39.646027] nix-grpc-daemon[797]: ts=2026-09-20T08:04:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492663752worker1 # [ 39.655436] nix-grpc-daemon[797]: ts=2026-09-20T08:04:17Z level=debug event=path_info_miss path=gpf58crna23m3bj51fx82f4mmyq9cz2y-nixos-system-client-test error="error: path '/nix/store/gpf58crna23m3bj51fx82f4mmyq9cz2y-nixos-system-client-test' is required, but there is no substituter that can build it"3753client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3754client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds)3755client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3756client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.08 seconds)3757worker1 # [ 40.202527] nix-grpc-daemon[797]: ts=2026-09-20T08:04:18Z level=info event=oidc_jwks provider=mock keys=13758worker1 # [ 40.209113] nix-grpc-daemon[797]: ts=2026-09-20T08:04:18Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:492663759worker1 # [ 40.245221] nix-grpc-daemon[797]: ts=2026-09-20T08:04:18Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:492663760worker1 # [ 40.256536] nix-grpc-daemon[797]: ts=2026-09-20T08:04:18Z level=debug event=path_info_miss path=gpf58crna23m3bj51fx82f4mmyq9cz2y-nixos-system-client-test error="error: path '/nix/store/gpf58crna23m3bj51fx82f4mmyq9cz2y-nixos-system-client-test' is required, but there is no substituter that can build it"3761worker2 # [ 40.352713] nix-grpc-daemon[855]: ts=2026-09-20T08:04:18Z level=info event=oidc_jwks provider=mock keys=13762worker2 # [ 40.355746] nix-grpc-daemon[855]: ts=2026-09-20T08:04:18Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:344223763worker2 # [ 40.369401] systemd[1]: Started Nix Daemon.3764worker2 # [ 40.692148] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)3765worker2 # [ 40.725094] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5)3766worker2 # [ 40.814172] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 2/5)3767worker2 # [ 40.849783] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 3/5)3768worker2 # [ 40.862474] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 780 ms (attempt 4/5)3769worker2 # [ 41.651627] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3770worker2 # [ 41.667717] nix-grpc-daemon[855]: ts=2026-09-20T08:04:19Z level=debug event=path_info_miss path=gpf58crna23m3bj51fx82f4mmyq9cz2y-nixos-system-client-test error="error: path '/nix/store/gpf58crna23m3bj51fx82f4mmyq9cz2y-nixos-system-client-test' is required, but there is no substituter that can build it"3771lb # [ 40.460353] envoy[872]: conn peer=[2001:db8:1::1]:54634 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=10093772lb # [ 40.461999] envoy[872]: conn peer=[2001:db8:1::1]:54644 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=2630 tx=422 ms=14543773client: must succeed: rm -r /var/lib/nix-grpc-store3774client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds)3775worker1 # [ 43.952143] nix-grpc-daemon[797]: ts=2026-09-20T08:04:21Z level=info event=denied method=QueryMissing cn=- role=none3776worker1 # [ 44.258173] nix-grpc-daemon[797]: ts=2026-09-20T08:04:22Z level=info event=denied method=QueryMissing cn=stranger role=none3777(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.95 seconds)3778subtest: DAG build is scheduled across workers and lands in the cache3779client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&23780worker2 # [ 44.593880] nix-grpc-daemon[855]: ts=2026-09-20T08:04:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:344223781client # don't know how to build these paths:3782client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3783worker1 # [ 44.577599] nix-grpc-daemon[797]: ts=2026-09-20T08:04:22Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03784worker1 # [ 44.581914] nix-grpc-daemon[797]: ts=2026-09-20T08:04:22Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=13785worker2 # [ 44.691489] nix-grpc-daemon[855]: ts=2026-09-20T08:04:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344223786worker2 # [ 44.712123] nix-grpc-daemon[855]: ts=2026-09-20T08:04:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344223787client # copying 1 paths to 'lb:50051'...3788worker2 # [ 44.731060] nix-grpc-daemon[855]: ts=2026-09-20T08:04:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344223789client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3790worker2 # [ 44.759207] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)3791worker2 # [ 44.785057] nix-grpc-daemon[855]: ts=2026-09-20T08:04:22Z level=info event=niks3_push_started pid=9263792worker2 # [ 45.443765] nix-daemon[916]: accepted connection from pid 938, user nix-grpc-daemon (trusted)3793worker2 # [ 45.474346] nix-daemon[916]: reaped child process 942, status = succeeded3794worker2 # [ 45.673253] nix-daemon[916]: accepted connection from pid 945, user nix-grpc-daemon (trusted)3795worker2 # [ 45.697879] nix-daemon[916]: reaped child process 948, status = succeeded3796lb # [ 44.244325] niks3-server[979]: 2026/09/20 08:04:23 INFO Received uploads request method=POST path=/api/pending_closures3797worker2 # [ 45.733830] nix-grpc-daemon[926]: time=2026-09-20T08:04:23.519Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3798worker2 # [ 45.739354] nix-grpc-daemon[926]: time=2026-09-20T08:04:23.523Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3799lb # [ 44.318770] niks3-server[979]: 2026/09/20 08:04:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3800lb # [ 44.332778] niks3-server[979]: 2026/09/20 08:04:23 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3801lb # [ 44.358195] niks3-server[979]: 2026/09/20 08:04:23 INFO Signed narinfos id=1 count=13802worker2 # [ 45.834360] nix-grpc-daemon[926]: time=2026-09-20T08:04:23.620Z level=INFO msg="Uploading 1 narinfos"3803lb # [ 44.399049] niks3-server[979]: 2026/09/20 08:04:23 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3804lb # [ 44.421603] niks3-server[979]: 2026/09/20 08:04:23 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3805lb # [ 44.429272] niks3-server[979]: 2026/09/20 08:04:23 INFO Completed upload id=13806worker2 # [ 45.900362] nix-grpc-daemon[926]: time=2026-09-20T08:04:23.686Z level=INFO msg="Upload complete. (727ms)"3807worker2 # [ 45.908853] nix-grpc-daemon[855]: ts=2026-09-20T08:04:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=1 paths=1 nar_bytes_in=5043808lb # [ 44.439751] niks3-server[979]: 2026/09/20 08:04:23 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3809worker2 # [ 45.914010] nix-grpc-daemon[855]: ts=2026-09-20T08:04:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344223810worker2 # [ 45.927724] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)3811worker2 # [ 45.932475] nix-daemon[916]: reaped child process 924, status = succeeded3812client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3813worker2 # [ 45.945926] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)3814client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3815client # farm-a> LOG-farm-a-t13816worker2 # [ 47.799479] nix-daemon[916]: reaped child process 952, status = succeeded3817worker2 # [ 47.993649] nix-daemon[916]: accepted connection from pid 967, user nix-grpc-daemon (trusted)3818worker2 # [ 48.026325] nix-daemon[916]: reaped child process 970, status = succeeded3819lb # [ 46.579505] niks3-server[979]: 2026/09/20 08:04:25 INFO Received uploads request method=POST path=/api/pending_closures3820worker2 # [ 48.070701] nix-grpc-daemon[926]: time=2026-09-20T08:04:25.855Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3821worker2 # [ 48.073763] nix-grpc-daemon[926]: time=2026-09-20T08:04:25.855Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3822lb # [ 46.636358] niks3-server[979]: 2026/09/20 08:04:25 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3823lb # [ 46.668576] niks3-server[979]: 2026/09/20 08:04:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3824lb # [ 46.671632] niks3-server[979]: 2026/09/20 08:04:25 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3825lb # [ 46.678585] niks3-server[979]: 2026/09/20 08:04:25 INFO Signed narinfos id=2 count=13826worker2 # [ 48.149637] nix-grpc-daemon[926]: time=2026-09-20T08:04:25.935Z level=INFO msg="Uploading 1 narinfos"3827lb # [ 46.681172] niks3-server[979]: 2026/09/20 08:04:25 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3828lb # [ 46.707726] niks3-server[979]: 2026/09/20 08:04:25 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3829lb # [ 46.737075] niks3-server[979]: 2026/09/20 08:04:25 INFO Completed upload id=23830worker2 # [ 48.210840] nix-grpc-daemon[926]: time=2026-09-20T08:04:25.997Z level=INFO msg="Upload complete. (444ms)"3831lb # [ 46.743986] niks3-server[979]: 2026/09/20 08:04:25 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3832worker2 # [ 48.221185] nix-grpc-daemon[855]: ts=2026-09-20T08:04:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13833worker2 # [ 48.235407] nix-daemon[916]: reaped child process 950, status = succeeded3834worker1 # [ 48.185225] nix-grpc-daemon[797]: ts=2026-09-20T08:04:26Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03835worker1 # [ 48.195289] nix-grpc-daemon[797]: ts=2026-09-20T08:04:26Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=13836worker2 # [ 48.302050] nix-grpc-daemon[855]: ts=2026-09-20T08:04:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344223837worker2 # [ 48.326068] nix-grpc-daemon[855]: ts=2026-09-20T08:04:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344223838worker2 # [ 48.351272] nix-grpc-daemon[926]: time=2026-09-20T08:04:26.137Z level=INFO msg="All 1 paths already cached"3839client # copying 1 paths to 'lb:50051'...3840client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3841worker2 # [ 48.361487] nix-grpc-daemon[855]: ts=2026-09-20T08:04:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344223842worker2 # [ 48.372653] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)3843worker2 # [ 48.610722] nix-daemon[916]: accepted connection from pid 974, user nix-grpc-daemon (trusted)3844worker2 # [ 48.639247] nix-daemon[916]: reaped child process 978, status = succeeded3845worker2 # [ 48.871565] nix-daemon[916]: accepted connection from pid 980, user nix-grpc-daemon (trusted)3846worker2 # [ 48.899308] nix-daemon[916]: reaped child process 983, status = succeeded3847lb # [ 47.441513] niks3-server[979]: 2026/09/20 08:04:26 INFO Received uploads request method=POST path=/api/pending_closures3848worker2 # [ 48.922719] nix-grpc-daemon[926]: time=2026-09-20T08:04:26.709Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3849worker2 # [ 48.926512] nix-grpc-daemon[926]: time=2026-09-20T08:04:26.712Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3850lb # [ 47.481388] niks3-server[979]: 2026/09/20 08:04:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3851worker2 # [ 48.959721] nix-grpc-daemon[926]: time=2026-09-20T08:04:26.745Z level=INFO msg="Uploading 1 narinfos"3852lb # [ 47.488804] niks3-server[979]: 2026/09/20 08:04:26 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3853lb # [ 47.495861] niks3-server[979]: 2026/09/20 08:04:26 INFO Signed narinfos id=3 count=13854lb # [ 47.499499] niks3-server[979]: 2026/09/20 08:04:26 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3855lb # [ 47.506623] niks3-server[979]: 2026/09/20 08:04:26 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3856lb # [ 47.515567] niks3-server[979]: 2026/09/20 08:04:26 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3857lb # [ 47.521637] niks3-server[979]: 2026/09/20 08:04:26 INFO Completed upload id=33858worker2 # [ 48.994669] nix-grpc-daemon[926]: time=2026-09-20T08:04:26.781Z level=INFO msg="Upload complete. (601ms)"3859worker2 # [ 49.004597] nix-grpc-daemon[855]: ts=2026-09-20T08:04:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=0 paths=1 nar_bytes_in=6243860worker2 # [ 49.019156] nix-grpc-daemon[855]: ts=2026-09-20T08:04:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344223861worker2 # [ 49.025847] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)3862worker2 # [ 49.032704] nix-daemon[916]: reaped child process 972, status = succeeded3863client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3864client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3865worker2 # [ 49.048800] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)3866client # farm-b> LOG-farm-b-t13867worker2 # [ 50.079580] nix-daemon[916]: reaped child process 987, status = succeeded3868worker2 # [ 50.277590] nix-daemon[916]: accepted connection from pid 1002, user nix-grpc-daemon (trusted)3869worker2 # [ 50.307076] nix-daemon[916]: reaped child process 1005, status = succeeded3870lb # [ 48.852288] niks3-server[979]: 2026/09/20 08:04:28 INFO Received uploads request method=POST path=/api/pending_closures3871worker2 # [ 50.338689] nix-grpc-daemon[926]: time=2026-09-20T08:04:28.123Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3872worker2 # [ 50.340689] nix-grpc-daemon[926]: time=2026-09-20T08:04:28.123Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3873lb # [ 48.890125] niks3-server[979]: 2026/09/20 08:04:28 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3874lb # [ 48.899580] niks3-server[979]: 2026/09/20 08:04:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3875lb # [ 48.908407] niks3-server[979]: 2026/09/20 08:04:28 INFO Signed narinfos id=4 count=13876worker2 # [ 50.378699] nix-grpc-daemon[926]: time=2026-09-20T08:04:28.164Z level=INFO msg="Uploading 1 narinfos"3877lb # [ 48.913574] niks3-server[979]: 2026/09/20 08:04:28 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3878lb # [ 48.919442] niks3-server[979]: 2026/09/20 08:04:28 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3879lb # [ 48.929442] niks3-server[979]: 2026/09/20 08:04:28 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3880lb # [ 48.938568] niks3-server[979]: 2026/09/20 08:04:28 INFO Completed upload id=43881worker2 # [ 50.409302] nix-grpc-daemon[926]: time=2026-09-20T08:04:28.195Z level=INFO msg="Upload complete. (348ms)"3882lb # [ 48.944439] niks3-server[979]: 2026/09/20 08:04:28 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3883worker2 # [ 50.415597] nix-grpc-daemon[855]: ts=2026-09-20T08:04:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13884worker2 # [ 50.429344] nix-daemon[916]: reaped child process 985, status = succeeded3885worker1 # [ 50.365472] nix-grpc-daemon[797]: ts=2026-09-20T08:04:28Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03886worker1 # [ 50.366022] nix-grpc-daemon[797]: ts=2026-09-20T08:04:28Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=13887worker2 # [ 50.472814] nix-grpc-daemon[855]: ts=2026-09-20T08:04:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344223888worker2 # [ 50.488854] nix-grpc-daemon[855]: ts=2026-09-20T08:04:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344223889worker2 # [ 50.512751] nix-grpc-daemon[926]: time=2026-09-20T08:04:28.299Z level=INFO msg="All 2 paths already cached"3890client # copying 1 paths to 'lb:50051'...3891client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3892worker2 # [ 50.523112] nix-grpc-daemon[855]: ts=2026-09-20T08:04:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344223893worker2 # [ 50.537242] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)3894worker2 # [ 50.811665] nix-daemon[916]: accepted connection from pid 1009, user nix-grpc-daemon (trusted)3895worker2 # [ 50.842636] nix-daemon[916]: reaped child process 1012, status = succeeded3896worker2 # [ 51.058026] nix-daemon[916]: accepted connection from pid 1014, user nix-grpc-daemon (trusted)3897worker2 # [ 51.086255] nix-daemon[916]: reaped child process 1017, status = succeeded3898lb # [ 49.629413] niks3-server[979]: 2026/09/20 08:04:28 INFO Received uploads request method=POST path=/api/pending_closures3899worker2 # [ 51.114995] nix-grpc-daemon[926]: time=2026-09-20T08:04:28.901Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3900worker2 # [ 51.117987] nix-grpc-daemon[926]: time=2026-09-20T08:04:28.901Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3901lb # [ 49.684515] niks3-server[979]: 2026/09/20 08:04:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3902worker2 # [ 51.160517] nix-grpc-daemon[926]: time=2026-09-20T08:04:28.946Z level=INFO msg="Uploading 1 narinfos"3903lb # [ 49.691858] niks3-server[979]: 2026/09/20 08:04:28 INFO Signed narinfos id=5 count=13904lb # [ 49.705042] niks3-server[979]: 2026/09/20 08:04:28 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3905lb # [ 49.713320] niks3-server[979]: 2026/09/20 08:04:28 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3906lb # [ 49.721943] niks3-server[979]: 2026/09/20 08:04:28 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3907lb # [ 49.727366] niks3-server[979]: 2026/09/20 08:04:28 INFO Completed upload id=53908worker2 # [ 51.198910] nix-grpc-daemon[926]: time=2026-09-20T08:04:28.985Z level=INFO msg="Upload complete. (649ms)"3909worker2 # [ 51.204620] nix-grpc-daemon[855]: ts=2026-09-20T08:04:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=0 paths=1 nar_bytes_in=7523910lb # [ 49.736860] niks3-server[979]: 2026/09/20 08:04:28 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3911worker2 # [ 51.216771] nix-grpc-daemon[855]: ts=2026-09-20T08:04:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344223912worker2 # [ 51.222733] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)3913worker2 # [ 51.227560] nix-daemon[916]: reaped child process 1007, status = succeeded3914client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3915client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3916worker2 # [ 51.244091] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)3917lb # [ 50.460602] envoy[872]: conn peer=[2001:db8:1::1]:35790 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=133918lb # [ 50.463110] envoy[872]: conn peer=[2001:db8:1::1]:35796 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=183919client # farm-top> LOG-farm-top-t13920worker2 # [ 52.671112] nix-daemon[916]: reaped child process 1021, status = succeeded3921worker2 # [ 52.915424] nix-daemon[916]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)3922worker2 # [ 52.945917] nix-daemon[916]: reaped child process 1040, status = succeeded3923lb # [ 51.483072] niks3-server[979]: 2026/09/20 08:04:30 INFO Received uploads request method=POST path=/api/pending_closures3924worker2 # [ 52.967299] nix-grpc-daemon[926]: time=2026-09-20T08:04:30.751Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3925worker2 # [ 52.969348] nix-grpc-daemon[926]: time=2026-09-20T08:04:30.751Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3926lb # [ 51.542551] niks3-server[979]: 2026/09/20 08:04:30 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3927lb # [ 51.555693] niks3-server[979]: 2026/09/20 08:04:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3928worker2 # [ 53.030943] nix-grpc-daemon[926]: time=2026-09-20T08:04:30.817Z level=INFO msg="Uploading 1 narinfos"3929lb # [ 51.564866] niks3-server[979]: 2026/09/20 08:04:30 INFO Signed narinfos id=6 count=13930lb # [ 51.570695] niks3-server[979]: 2026/09/20 08:04:30 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3931lb # [ 51.579305] niks3-server[979]: 2026/09/20 08:04:30 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3932lb # [ 51.585600] niks3-server[979]: 2026/09/20 08:04:30 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3933worker2 # [ 53.060487] nix-grpc-daemon[926]: time=2026-09-20T08:04:30.847Z level=INFO msg="Upload complete. (405ms)"3934lb # [ 51.591280] niks3-server[979]: 2026/09/20 08:04:30 INFO Completed upload id=63935lb # [ 51.593701] niks3-server[979]: 2026/09/20 08:04:30 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3936worker2 # [ 53.068698] nix-grpc-daemon[855]: ts=2026-09-20T08:04:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13937worker2 # [ 53.080594] nix-daemon[916]: reaped child process 1019, status = succeeded3938client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 8.77 seconds)3939client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath3940client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.27 seconds)3941client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3942client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds)3943client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3944client # copying 3 paths...3945client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3946client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3947client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3948client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.39 seconds)3949(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 9.54 seconds)3950subtest: repeat is answered Cached by the scheduler without building3951worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3952worker1 # finding garbage collector roots...3953worker1 # deleting specified paths...3954worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3955worker1 # deleting unused links...3956worker1 # note: hard linking is currently saving 0.0 KiB3957worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.37 seconds)3958worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3959worker2 # finding garbage collector roots...3960worker2 # deleting specified paths...3961worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3962worker2 # deleting unused links...3963worker2 # note: hard linking is currently saving 0.0 KiB3964worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)3965client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&23966worker2 # [ 54.794525] nix-grpc-daemon[855]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:344223967client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):3968client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3969worker1 # [ 54.778866] nix-grpc-daemon[797]: ts=2026-09-20T08:04:32Z level=debug event=want client=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=13970worker1 # [ 54.818479] nix-grpc-daemon[797]: ts=2026-09-20T08:04:32Z level=debug event=want client=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=13971worker1 # [ 54.834236] nix-grpc-daemon[797]: ts=2026-09-20T08:04:32Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=13972client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 0.42 seconds)3973client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath3974client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.29 seconds)3975lb: must succeed: curl -sf localhost:9901/clusters3976lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3977lb: must succeed: curl -sf localhost:9901/clusters3978lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)3979worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true3980worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.12 seconds)3981(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.72 seconds)3982subtest: two clients wanting the same drv build it once3983client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup3984client # [ 55.598540] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.3985client # Running as unit: dedup1.service; invocation ID: b2a9c147821249ca81b038b529d4b8f13986client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.08 seconds)3987client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup3988client # [ 55.865443] nix[949]: don't know how to build these paths:3989client # [ 55.867069] nix[949]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv3990worker2 # [ 55.938084] nix-grpc-daemon[855]: ts=2026-09-20T08:04:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:344223991worker1 # [ 55.889980] nix-grpc-daemon[797]: ts=2026-09-20T08:04:33Z level=debug event=want client=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=03992worker1 # [ 55.894118] nix-grpc-daemon[797]: ts=2026-09-20T08:04:33Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=13993worker1 # [ 55.907491] nix-grpc-daemon[797]: ts=2026-09-20T08:04:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492663994worker1 # [ 55.923302] nix-grpc-daemon[797]: ts=2026-09-20T08:04:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492663995client # [ 55.920456] nix[949]: copying 1 paths to 'lb:50051'...3996worker1 # [ 55.936311] nix-grpc-daemon[797]: ts=2026-09-20T08:04:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492663997client # [ 55.923865] nix[949]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...3998worker1 # [ 55.946213] nix-daemon[881]: accepted connection from pid 797, user nix-grpc-daemon (trusted)3999worker1 # [ 55.969600] nix-grpc-daemon[797]: ts=2026-09-20T08:04:33Z level=info event=niks3_push_started pid=9284000worker1 # [ 56.547734] nix-daemon[881]: accepted connection from pid 940, user nix-grpc-daemon (trusted)4001worker1 # [ 56.575814] nix-daemon[881]: reaped child process 943, status = succeeded4002client # [ 56.730182] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4003client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4004worker1 # [ 56.883319] nix-daemon[881]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4005worker1 # [ 56.930800] nix-daemon[881]: reaped child process 952, status = succeeded4006lb # [ 55.526318] niks3-server[979]: 2026/09/20 08:04:34 INFO Received uploads request method=POST path=/api/pending_closures4007worker1 # [ 56.946644] nix-grpc-daemon[928]: time=2026-09-20T08:04:34.772Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4008worker1 # [ 56.956554] nix-grpc-daemon[928]: time=2026-09-20T08:04:34.782Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4009lb # [ 55.574451] niks3-server[979]: 2026/09/20 08:04:34 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4010lb # [ 55.583445] niks3-server[979]: 2026/09/20 08:04:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4011lb # [ 55.586220] niks3-server[979]: 2026/09/20 08:04:34 INFO Signed narinfos id=7 count=14012worker1 # [ 56.996253] nix-grpc-daemon[928]: time=2026-09-20T08:04:34.823Z level=INFO msg="Uploading 1 narinfos"4013lb # [ 55.606493] niks3-server[979]: 2026/09/20 08:04:34 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4014lb # [ 55.620129] niks3-server[979]: 2026/09/20 08:04:34 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4015lb # [ 55.630202] niks3-server[979]: 2026/09/20 08:04:34 INFO Completed upload id=74016worker1 # [ 57.041055] nix-grpc-daemon[928]: time=2026-09-20T08:04:34.867Z level=INFO msg="Upload complete. (723ms)"4017lb # [ 55.632583] niks3-server[979]: 2026/09/20 08:04:34 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4018worker1 # [ 57.048977] nix-grpc-daemon[797]: ts=2026-09-20T08:04:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49266 duration_s=1 paths=1 nar_bytes_in=4324019worker1 # [ 57.056422] nix-grpc-daemon[797]: ts=2026-09-20T08:04:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492664020worker1 # [ 57.070422] nix-daemon[881]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4021worker1 # [ 57.078529] nix-daemon[881]: reaped child process 926, status = succeeded4022client # Running as unit: dedup2.service; invocation ID: a3882577874a4f4696522ba8ad4fcdaf4023worker1 # [ 57.092731] nix-daemon[881]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4024client # [ 57.075817] nix[949]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4025worker1 # [ 57.150223] nix-grpc-daemon[797]: ts=2026-09-20T08:04:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492664026client # [ 57.149923] nix[965]: this derivation will be built:4027worker2 # [ 57.231014] nix-grpc-daemon[855]: ts=2026-09-20T08:04:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:344224028worker2 # [ 57.238334] nix-grpc-daemon[855]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' from 'http://lb:5751'...4029client # [ 57.190508] nix[965]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4030worker1 # [ 57.217660] nix-grpc-daemon[797]: ts=2026-09-20T08:04:35Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04031worker1 # [ 57.223854] nix-grpc-daemon[797]: ts=2026-09-20T08:04:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492664032client # [ 57.215658] nix[965]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4033client: must succeed: sleep 24034client: (finished: must succeed: sleep 2, in 2.07 seconds)4035client: waiting for success: ! systemctl is-active dedup1 dedup24036worker1 # [ 60.521067] nix-daemon[881]: reaped child process 956, status = succeeded4037worker1 # [ 60.739752] nix-daemon[881]: accepted connection from pid 983, user nix-grpc-daemon (trusted)4038worker1 # [ 60.769075] nix-daemon[881]: reaped child process 986, status = succeeded4039lb # [ 59.367413] niks3-server[979]: 2026/09/20 08:04:38 INFO Received uploads request method=POST path=/api/pending_closures4040worker1 # [ 60.792207] nix-grpc-daemon[928]: time=2026-09-20T08:04:38.616Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4041worker1 # [ 60.794878] nix-grpc-daemon[928]: time=2026-09-20T08:04:38.616Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4042lb # [ 59.424511] niks3-server[979]: 2026/09/20 08:04:38 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4043lb # [ 59.432681] niks3-server[979]: 2026/09/20 08:04:38 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4044lb # [ 59.441684] niks3-server[979]: 2026/09/20 08:04:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4045lb # [ 59.447314] niks3-server[979]: 2026/09/20 08:04:38 INFO Signed narinfos id=8 count=14046worker1 # [ 60.857632] nix-grpc-daemon[928]: time=2026-09-20T08:04:38.683Z level=INFO msg="Uploading 1 narinfos"4047lb # [ 59.450483] niks3-server[979]: 2026/09/20 08:04:38 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4048lb # [ 59.463080] niks3-server[979]: 2026/09/20 08:04:38 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4049lb # [ 59.468506] niks3-server[979]: 2026/09/20 08:04:38 INFO Completed upload id=84050worker1 # [ 60.878552] nix-grpc-daemon[928]: time=2026-09-20T08:04:38.705Z level=INFO msg="Upload complete. (369ms)"4051lb # [ 59.471059] niks3-server[979]: 2026/09/20 08:04:38 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4052worker1 # [ 60.893267] nix-grpc-daemon[797]: ts=2026-09-20T08:04:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49266 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14053worker1 # [ 60.908544] nix-grpc-daemon[797]: ts=2026-09-20T08:04:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49266 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14054worker1 # [ 60.915663] nix-daemon[881]: reaped child process 954, status = succeeded4055client # [ 60.945363] systemd[1]: dedup2.service: Deactivated successfully.4056client # [ 60.949637] systemd[1]: dedup2.service: Consumed 225ms CPU time over 4.218s wall clock time, 31M memory peak, 7.7K incoming IP traffic, 6.5K outgoing IP traffic.4057client # [ 60.974534] systemd[1]: dedup1.service: Deactivated successfully.4058client # [ 60.979672] systemd[1]: dedup1.service: Consumed 186ms CPU time over 5.378s wall clock time, 37.2M memory peak, 8.4K incoming IP traffic, 9.1K outgoing IP traffic.4059client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.12 seconds)4060client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4061client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.06 seconds)4062worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4063worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.09 seconds)4064worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4065worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4066worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4067lb # [ 60.456979] envoy[872]: conn peer=[2001:db8:1::1]:35810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9371 tx=3828 ms=85174068lb # [ 60.462815] envoy[872]: conn peer=[2001:db8:1::1]:40354 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1162 tx=481 ms=1284069lb # [ 60.468254] envoy[872]: conn peer=[2001:db8:1::1]:40370 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1592 tx=1487 ms=37584070lb # [ 60.474007] envoy[872]: conn peer=[2001:db8:1::1]:40358 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1371 ms=50824071worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.11 seconds)4072worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4073worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.07 seconds)4074(finished: subtest: two clients wanting the same drv build it once, in 6.45 seconds)4075subtest: build hook: nix-daemon with builders = grpc://lb4076client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log4077client # [ 62.258801] systemd[1]: Started Nix Daemon.4078client # [ 62.491136] nix-daemon[1006]: accepted connection from pid 1003, user root (trusted)4079worker1 # [ 62.751645] nix-grpc-daemon[797]: ts=2026-09-20T08:04:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:492664080worker1 # [ 62.758463] nix-grpc-daemon[797]: ts=2026-09-20T08:04:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492664081worker1 # [ 62.776974] nix-grpc-daemon[797]: ts=2026-09-20T08:04:40Z level=debug event=want client=5 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04082worker1 # [ 62.781053] nix-grpc-daemon[797]: ts=2026-09-20T08:04:40Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14083worker2 # [ 62.887997] nix-grpc-daemon[855]: ts=2026-09-20T08:04:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344224084worker2 # [ 62.908113] nix-grpc-daemon[855]: ts=2026-09-20T08:04:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344224085worker2 # [ 62.923195] nix-grpc-daemon[855]: ts=2026-09-20T08:04:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344224086worker2 # [ 62.946084] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4087worker2 # [ 63.165624] nix-daemon[916]: accepted connection from pid 1082, user nix-grpc-daemon (trusted)4088worker2 # [ 63.189596] nix-daemon[916]: reaped child process 1085, status = succeeded4089worker2 # [ 63.384760] nix-daemon[916]: accepted connection from pid 1087, user nix-grpc-daemon (trusted)4090worker2 # [ 63.408689] nix-daemon[916]: reaped child process 1090, status = succeeded4091lb # [ 61.950812] niks3-server[979]: 2026/09/20 08:04:41 INFO Received uploads request method=POST path=/api/pending_closures4092worker2 # [ 63.430671] nix-grpc-daemon[926]: time=2026-09-20T08:04:41.216Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4093worker2 # [ 63.432568] nix-grpc-daemon[926]: time=2026-09-20T08:04:41.216Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4094lb # [ 61.982000] niks3-server[979]: 2026/09/20 08:04:41 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4095lb # [ 62.001440] niks3-server[979]: 2026/09/20 08:04:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4096worker2 # [ 63.479225] nix-grpc-daemon[926]: time=2026-09-20T08:04:41.265Z level=INFO msg="Uploading 1 narinfos"4097lb # [ 62.013646] niks3-server[979]: 2026/09/20 08:04:41 INFO Signed narinfos id=9 count=14098lb # [ 62.015044] niks3-server[979]: 2026/09/20 08:04:41 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4099lb # [ 62.023316] niks3-server[979]: 2026/09/20 08:04:41 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4100lb # [ 62.030548] niks3-server[979]: 2026/09/20 08:04:41 INFO Completed upload id=94101worker2 # [ 63.500934] nix-grpc-daemon[926]: time=2026-09-20T08:04:41.287Z level=INFO msg="Upload complete. (536ms)"4102lb # [ 62.033012] niks3-server[979]: 2026/09/20 08:04:41 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4103worker2 # [ 63.508208] nix-grpc-daemon[855]: ts=2026-09-20T08:04:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=0 paths=1 nar_bytes_in=5124104worker2 # [ 63.523988] nix-grpc-daemon[855]: ts=2026-09-20T08:04:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344224105worker2 # [ 63.531569] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4106worker2 # [ 63.537414] nix-daemon[916]: reaped child process 1080, status = succeeded4107worker2 # [ 63.550251] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4108worker2 # [ 64.402018] nix-daemon[916]: reaped child process 1094, status = succeeded4109worker2 # [ 64.609965] nix-daemon[916]: accepted connection from pid 1109, user nix-grpc-daemon (trusted)4110worker2 # [ 64.635151] nix-daemon[916]: reaped child process 1112, status = succeeded4111lb # [ 63.172742] niks3-server[979]: 2026/09/20 08:04:42 INFO Received uploads request method=POST path=/api/pending_closures4112worker2 # [ 64.652305] nix-grpc-daemon[926]: time=2026-09-20T08:04:42.438Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4113worker2 # [ 64.657938] nix-grpc-daemon[926]: time=2026-09-20T08:04:42.441Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4114lb # [ 63.201419] niks3-server[979]: 2026/09/20 08:04:42 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4115lb # [ 63.212098] niks3-server[979]: 2026/09/20 08:04:42 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4116lb # [ 63.220283] niks3-server[979]: 2026/09/20 08:04:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4117worker2 # [ 64.695090] nix-grpc-daemon[926]: time=2026-09-20T08:04:42.481Z level=INFO msg="Uploading 1 narinfos"4118lb # [ 63.227527] niks3-server[979]: 2026/09/20 08:04:42 INFO Signed narinfos id=10 count=14119lb # [ 63.231313] niks3-server[979]: 2026/09/20 08:04:42 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4120lb # [ 63.238789] niks3-server[979]: 2026/09/20 08:04:42 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4121worker2 # [ 64.713431] nix-grpc-daemon[926]: time=2026-09-20T08:04:42.500Z level=INFO msg="Upload complete. (348ms)"4122lb # [ 63.244696] niks3-server[979]: 2026/09/20 08:04:42 INFO Completed upload id=104123lb # [ 63.247955] niks3-server[979]: 2026/09/20 08:04:42 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4124worker2 # [ 64.720846] nix-grpc-daemon[855]: ts=2026-09-20T08:04:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=5 outputs=14125worker1 # [ 64.670094] nix-grpc-daemon[797]: ts=2026-09-20T08:04:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492664126worker2 # [ 64.734344] nix-daemon[916]: reaped child process 1092, status = succeeded4127worker1 # [ 64.689304] nix-grpc-daemon[797]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4128worker2 # [ 64.793386] nix-grpc-daemon[855]: ts=2026-09-20T08:04:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:344224129worker2 # [ 64.799347] nix-grpc-daemon[855]: ts=2026-09-20T08:04:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=0 paths=1 nar_bytes_out=1284130worker1 # [ 64.996863] nix-grpc-daemon[797]: ts=2026-09-20T08:04:42Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:492664131worker2 # [ 65.070475] nix-grpc-daemon[855]: ts=2026-09-20T08:04:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344224132worker2 # [ 65.089764] nix-grpc-daemon[926]: time=2026-09-20T08:04:42.876Z level=INFO msg="All 1 paths already cached"4133worker1 # [ 65.057126] nix-grpc-daemon[797]: ts=2026-09-20T08:04:42Z level=debug event=want client=6 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04134worker1 # [ 65.062323] nix-grpc-daemon[797]: ts=2026-09-20T08:04:42Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14135worker2 # [ 65.126594] nix-grpc-daemon[855]: ts=2026-09-20T08:04:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344224136worker2 # [ 65.148066] nix-grpc-daemon[855]: ts=2026-09-20T08:04:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344224137worker2 # [ 65.167744] nix-grpc-daemon[926]: time=2026-09-20T08:04:42.954Z level=INFO msg="All 1 paths already cached"4138worker2 # [ 65.175141] nix-grpc-daemon[855]: ts=2026-09-20T08:04:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344224139worker2 # [ 65.187538] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4140worker2 # [ 65.371228] nix-daemon[916]: accepted connection from pid 1116, user nix-grpc-daemon (trusted)4141worker2 # [ 65.395373] nix-daemon[916]: reaped child process 1119, status = succeeded4142worker2 # [ 65.589966] nix-daemon[916]: accepted connection from pid 1121, user nix-grpc-daemon (trusted)4143worker2 # [ 65.615015] nix-daemon[916]: reaped child process 1124, status = succeeded4144lb # [ 64.151889] niks3-server[979]: 2026/09/20 08:04:43 INFO Received uploads request method=POST path=/api/pending_closures4145worker2 # [ 65.635946] nix-grpc-daemon[926]: time=2026-09-20T08:04:43.422Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4146worker2 # [ 65.638410] nix-grpc-daemon[926]: time=2026-09-20T08:04:43.424Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4147lb # [ 64.193696] niks3-server[979]: 2026/09/20 08:04:43 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4148lb # [ 64.212615] niks3-server[979]: 2026/09/20 08:04:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4149worker2 # [ 65.690282] nix-grpc-daemon[926]: time=2026-09-20T08:04:43.476Z level=INFO msg="Uploading 1 narinfos"4150lb # [ 64.223533] niks3-server[979]: 2026/09/20 08:04:43 INFO Signed narinfos id=11 count=14151lb # [ 64.232466] niks3-server[979]: 2026/09/20 08:04:43 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4152lb # [ 64.247888] niks3-server[979]: 2026/09/20 08:04:43 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4153worker2 # [ 65.725233] nix-grpc-daemon[926]: time=2026-09-20T08:04:43.511Z level=INFO msg="Upload complete. (527ms)"4154lb # [ 64.255014] niks3-server[979]: 2026/09/20 08:04:43 INFO Completed upload id=114155lb # [ 64.259185] niks3-server[979]: 2026/09/20 08:04:43 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4156worker2 # [ 65.732694] nix-grpc-daemon[855]: ts=2026-09-20T08:04:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=0 paths=1 nar_bytes_in=6244157worker2 # [ 65.743124] nix-grpc-daemon[855]: ts=2026-09-20T08:04:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344224158worker2 # [ 65.749437] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4159worker2 # [ 65.753751] nix-daemon[916]: reaped child process 1114, status = succeeded4160worker2 # [ 65.767189] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4161worker2 # [ 67.221600] nix-daemon[916]: reaped child process 1128, status = succeeded4162worker2 # [ 67.424272] nix-daemon[916]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)4163worker2 # [ 67.449797] nix-daemon[916]: reaped child process 1146, status = succeeded4164lb # [ 65.994171] niks3-server[979]: 2026/09/20 08:04:45 INFO Received uploads request method=POST path=/api/pending_closures4165worker2 # [ 67.480654] nix-grpc-daemon[926]: time=2026-09-20T08:04:45.263Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4166worker2 # [ 67.482459] nix-grpc-daemon[926]: time=2026-09-20T08:04:45.263Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4167lb # [ 66.044741] niks3-server[979]: 2026/09/20 08:04:45 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4168lb # [ 66.062824] niks3-server[979]: 2026/09/20 08:04:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4169lb # [ 66.072791] niks3-server[979]: 2026/09/20 08:04:45 INFO Signed narinfos id=12 count=14170worker2 # [ 67.540671] nix-grpc-daemon[926]: time=2026-09-20T08:04:45.326Z level=INFO msg="Uploading 1 narinfos"4171lb # [ 66.079559] niks3-server[979]: 2026/09/20 08:04:45 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4172lb # [ 66.085073] niks3-server[979]: 2026/09/20 08:04:45 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4173lb # [ 66.092084] niks3-server[979]: 2026/09/20 08:04:45 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4174worker2 # [ 67.567184] nix-grpc-daemon[926]: time=2026-09-20T08:04:45.353Z level=INFO msg="Upload complete. (388ms)"4175lb # [ 66.098457] niks3-server[979]: 2026/09/20 08:04:45 INFO Completed upload id=124176lb # [ 66.108143] niks3-server[979]: 2026/09/20 08:04:45 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4177worker2 # [ 67.574282] nix-grpc-daemon[855]: ts=2026-09-20T08:04:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=6 outputs=14178worker2 # [ 67.587214] nix-grpc-daemon[855]: ts=2026-09-20T08:04:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:344224179worker2 # [ 67.590153] nix-daemon[916]: reaped child process 1126, status = succeeded4180worker2 # [ 67.605908] nix-grpc-daemon[855]: ts=2026-09-20T08:04:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:344224181worker2 # [ 67.609021] nix-grpc-daemon[855]: ts=2026-09-20T08:04:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=0 paths=1 nar_bytes_out=1764182worker2 # [ 67.946497] nix-grpc-daemon[855]: ts=2026-09-20T08:04:45Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:344224183worker2 # [ 67.955264] nix-grpc-daemon[855]: ts=2026-09-20T08:04:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344224184worker2 # [ 67.963085] nix-grpc-daemon[926]: time=2026-09-20T08:04:45.748Z level=INFO msg="All 2 paths already cached"4185worker1 # [ 67.923417] nix-grpc-daemon[797]: ts=2026-09-20T08:04:45Z level=debug event=want client=7 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04186worker1 # [ 67.930685] nix-grpc-daemon[797]: ts=2026-09-20T08:04:45Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14187worker2 # [ 68.027976] nix-grpc-daemon[855]: ts=2026-09-20T08:04:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344224188worker2 # [ 68.038624] nix-grpc-daemon[855]: ts=2026-09-20T08:04:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344224189worker2 # [ 68.048499] nix-grpc-daemon[926]: time=2026-09-20T08:04:45.835Z level=INFO msg="All 2 paths already cached"4190worker2 # [ 68.058782] nix-grpc-daemon[855]: ts=2026-09-20T08:04:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344224191worker2 # [ 68.068149] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4192worker2 # [ 68.256895] nix-daemon[916]: accepted connection from pid 1150, user nix-grpc-daemon (trusted)4193worker2 # [ 68.281892] nix-daemon[916]: reaped child process 1153, status = succeeded4194worker2 # [ 68.479305] nix-daemon[916]: accepted connection from pid 1155, user nix-grpc-daemon (trusted)4195worker2 # [ 68.503700] nix-daemon[916]: reaped child process 1158, status = succeeded4196lb # [ 67.043972] niks3-server[979]: 2026/09/20 08:04:46 INFO Received uploads request method=POST path=/api/pending_closures4197worker2 # [ 68.520843] nix-grpc-daemon[926]: time=2026-09-20T08:04:46.307Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4198worker2 # [ 68.523946] nix-grpc-daemon[926]: time=2026-09-20T08:04:46.310Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4199lb # [ 67.084089] niks3-server[979]: 2026/09/20 08:04:46 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4200worker2 # [ 68.564362] nix-grpc-daemon[926]: time=2026-09-20T08:04:46.350Z level=INFO msg="Uploading 1 narinfos"4201lb # [ 67.099366] niks3-server[979]: 2026/09/20 08:04:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4202lb # [ 67.108367] niks3-server[979]: 2026/09/20 08:04:46 INFO Signed narinfos id=13 count=14203lb # [ 67.110926] niks3-server[979]: 2026/09/20 08:04:46 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4204lb # [ 67.123216] niks3-server[979]: 2026/09/20 08:04:46 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4205worker2 # [ 68.597846] nix-grpc-daemon[926]: time=2026-09-20T08:04:46.384Z level=INFO msg="Upload complete. (516ms)"4206lb # [ 67.129417] niks3-server[979]: 2026/09/20 08:04:46 INFO Completed upload id=134207lb # [ 67.131615] niks3-server[979]: 2026/09/20 08:04:46 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4208worker2 # [ 68.604983] nix-grpc-daemon[855]: ts=2026-09-20T08:04:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=0 paths=1 nar_bytes_in=7524209worker2 # [ 68.615169] nix-grpc-daemon[855]: ts=2026-09-20T08:04:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344224210worker2 # [ 68.619417] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4211worker2 # [ 68.623282] nix-daemon[916]: reaped child process 1148, status = succeeded4212worker2 # [ 68.635422] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4213worker2 # [ 69.667025] nix-daemon[916]: reaped child process 1162, status = succeeded4214worker2 # [ 69.868502] nix-daemon[916]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)4215worker2 # [ 69.894252] nix-daemon[916]: reaped child process 1180, status = succeeded4216lb # [ 68.443110] niks3-server[979]: 2026/09/20 08:04:47 INFO Received uploads request method=POST path=/api/pending_closures4217worker2 # [ 69.920834] nix-grpc-daemon[926]: time=2026-09-20T08:04:47.706Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4218worker2 # [ 69.922498] nix-grpc-daemon[926]: time=2026-09-20T08:04:47.706Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4219lb # [ 68.471705] niks3-server[979]: 2026/09/20 08:04:47 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4220lb # [ 68.478093] niks3-server[979]: 2026/09/20 08:04:47 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4221lb # [ 68.487348] niks3-server[979]: 2026/09/20 08:04:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4222worker2 # [ 69.958999] nix-grpc-daemon[926]: time=2026-09-20T08:04:47.745Z level=INFO msg="Uploading 1 narinfos"4223lb # [ 68.492894] niks3-server[979]: 2026/09/20 08:04:47 INFO Signed narinfos id=14 count=14224lb # [ 68.497498] niks3-server[979]: 2026/09/20 08:04:47 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4225lb # [ 68.505518] niks3-server[979]: 2026/09/20 08:04:47 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4226lb # [ 68.510212] niks3-server[979]: 2026/09/20 08:04:47 INFO Completed upload id=144227worker2 # [ 69.980764] nix-grpc-daemon[926]: time=2026-09-20T08:04:47.767Z level=INFO msg="Upload complete. (336ms)"4228lb # [ 68.516310] niks3-server[979]: 2026/09/20 08:04:47 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4229worker2 # [ 69.987510] nix-grpc-daemon[855]: ts=2026-09-20T08:04:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=7 outputs=14230worker1 # [ 69.936928] nix-grpc-daemon[797]: ts=2026-09-20T08:04:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492664231worker2 # [ 70.000661] nix-daemon[916]: reaped child process 1160, status = succeeded4232worker1 # [ 69.952845] nix-grpc-daemon[797]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4233worker1 # [ 69.966536] nix-grpc-daemon[797]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4234worker1 # [ 70.009892] nix-grpc-daemon[797]: ts=2026-09-20T08:04:47Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:492664235worker1 # [ 70.013684] nix-grpc-daemon[797]: ts=2026-09-20T08:04:47Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49266 duration_s=0 paths=1 nar_bytes_out=2324236client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.18 seconds)4237client # [ 70.156640] nix-daemon[1006]: reaped child process 1008, status = succeeded4238client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4239client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4240client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4241client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.08 seconds)4242client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4243client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.05 seconds)4244(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.36 seconds)4245subtest: an input only one worker has still reaches the builder4246client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4247client # this derivation will be built:4248client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4249client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4250client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.57 seconds)4251client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4252client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.27 seconds)4253worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4254worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.28 seconds)4255worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4256worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds)4257client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24258client # [ 71.771859] nix-daemon[1006]: accepted connection from pid 1089, user root (trusted)4259client # this derivation will be built:4260client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4261lb # [ 70.460877] envoy[872]: conn peer=[2001:db8:1::1]:58866 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=333 ms=224262lb # [ 70.461072] envoy[872]: conn peer=[2001:db8:1::1]:58860 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3388 tx=1777 ms=20074263lb # [ 70.461110] envoy[872]: conn peer=[2001:db8:1::1]:58878 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3892 tx=1895 ms=26104264lb # [ 70.461143] envoy[872]: conn peer=[2001:db8:1::1]:58882 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=594265lb # [ 70.461182] envoy[872]: conn peer=[2001:db8:1::1]:58892 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=704266lb # [ 70.461214] envoy[872]: conn peer=[2001:db8:1::1]:58888 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2221 ms=21894267worker2 # [ 72.094958] nix-grpc-daemon[855]: ts=2026-09-20T08:04:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:344224268client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4269worker2 # [ 72.105105] nix-grpc-daemon[855]: ts=2026-09-20T08:04:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344224270client # copying 1 paths...4271client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4272worker2 # [ 72.118742] nix-grpc-daemon[855]: ts=2026-09-20T08:04:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344224273worker2 # [ 72.137535] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4274worker2 # [ 72.352400] nix-daemon[916]: accepted connection from pid 1187, user nix-grpc-daemon (trusted)4275worker2 # [ 72.378771] nix-daemon[916]: reaped child process 1190, status = succeeded4276lb # [ 70.930733] niks3-server[979]: 2026/09/20 08:04:50 INFO Received uploads request method=POST path=/api/pending_closures4277worker2 # [ 72.412444] nix-grpc-daemon[926]: time=2026-09-20T08:04:50.198Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4278worker2 # [ 72.414225] nix-grpc-daemon[926]: time=2026-09-20T08:04:50.198Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4279lb # [ 70.958024] niks3-server[979]: 2026/09/20 08:04:50 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4280lb # [ 70.972942] niks3-server[979]: 2026/09/20 08:04:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4281worker2 # [ 72.447980] nix-grpc-daemon[926]: time=2026-09-20T08:04:50.234Z level=INFO msg="Uploading 1 narinfos"4282lb # [ 70.982916] niks3-server[979]: 2026/09/20 08:04:50 INFO Signed narinfos id=15 count=14283lb # [ 70.988618] niks3-server[979]: 2026/09/20 08:04:50 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4284lb # [ 71.000329] niks3-server[979]: 2026/09/20 08:04:50 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4285worker2 # [ 72.480785] nix-grpc-daemon[926]: time=2026-09-20T08:04:50.267Z level=INFO msg="Upload complete. (326ms)"4286lb # [ 71.010199] niks3-server[979]: 2026/09/20 08:04:50 INFO Completed upload id=154287lb # [ 71.013246] niks3-server[979]: 2026/09/20 08:04:50 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4288worker2 # [ 72.488216] nix-grpc-daemon[855]: ts=2026-09-20T08:04:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=0 paths=1 nar_bytes_in=1204289worker2 # [ 72.499996] nix-daemon[916]: reaped child process 1185, status = succeeded4290worker1 # [ 72.448578] nix-grpc-daemon[797]: ts=2026-09-20T08:04:50Z level=debug event=want client=8 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04291worker1 # [ 72.448813] nix-grpc-daemon[797]: ts=2026-09-20T08:04:50Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14292worker1 # [ 72.497188] nix-grpc-daemon[797]: ts=2026-09-20T08:04:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492664293worker1 # [ 72.518270] nix-grpc-daemon[797]: ts=2026-09-20T08:04:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492664294client # copying 2 paths to 'lb:50051'...4295client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4296client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4297worker1 # [ 72.551118] nix-grpc-daemon[797]: ts=2026-09-20T08:04:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492664298worker1 # [ 72.571745] nix-daemon[881]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4299worker1 # [ 72.834965] nix-daemon[881]: accepted connection from pid 1018, user nix-grpc-daemon (trusted)4300worker1 # [ 72.866613] nix-daemon[881]: reaped child process 1021, status = succeeded4301worker1 # [ 73.084222] nix-daemon[881]: accepted connection from pid 1023, user nix-grpc-daemon (trusted)4302worker1 # [ 73.111336] nix-daemon[881]: reaped child process 1026, status = succeeded4303lb # [ 71.715178] niks3-server[979]: 2026/09/20 08:04:50 INFO Received uploads request method=POST path=/api/pending_closures4304lb # [ 71.724289] niks3-server[979]: 2026/09/20 08:04:50 INFO Received uploads request method=POST path=/api/pending_closures4305worker1 # [ 73.147846] nix-grpc-daemon[928]: time=2026-09-20T08:04:50.973Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4306worker1 # [ 73.150212] nix-grpc-daemon[928]: time=2026-09-20T08:04:50.973Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4307worker1 # [ 73.152735] nix-grpc-daemon[928]: time=2026-09-20T08:04:50.973Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4308lb # [ 71.764124] niks3-server[979]: 2026/09/20 08:04:50 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4309lb # [ 71.790256] niks3-server[979]: 2026/09/20 08:04:50 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4310lb # [ 71.800132] niks3-server[979]: 2026/09/20 08:04:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4311worker1 # [ 73.217847] nix-grpc-daemon[928]: time=2026-09-20T08:04:51.043Z level=INFO msg="Uploading 3 narinfos"4312lb # [ 71.807580] niks3-server[979]: 2026/09/20 08:04:51 INFO Signed narinfos id=16 count=14313lb # [ 71.814255] niks3-server[979]: 2026/09/20 08:04:51 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4314lb # [ 71.819293] niks3-server[979]: 2026/09/20 08:04:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4315lb # [ 71.825269] niks3-server[979]: 2026/09/20 08:04:51 INFO Signed narinfos id=17 count=24316lb # [ 71.827227] niks3-server[979]: 2026/09/20 08:04:51 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4317lb # [ 71.849325] niks3-server[979]: 2026/09/20 08:04:51 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4318lb # [ 71.860660] niks3-server[979]: 2026/09/20 08:04:51 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4319lb # [ 71.862454] niks3-server[979]: 2026/09/20 08:04:51 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4320lb # [ 71.866586] niks3-server[979]: 2026/09/20 08:04:51 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4321lb # [ 71.870116] niks3-server[979]: 2026/09/20 08:04:51 INFO Completed upload id=174322lb # [ 71.873670] niks3-server[979]: 2026/09/20 08:04:51 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4323lb # [ 71.877378] niks3-server[979]: 2026/09/20 08:04:51 INFO Completed upload id=164324worker1 # [ 73.288234] nix-grpc-daemon[928]: time=2026-09-20T08:04:51.115Z level=INFO msg="Upload complete. (695ms)"4325worker1 # [ 73.296306] nix-grpc-daemon[797]: ts=2026-09-20T08:04:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49266 duration_s=0 paths=2 nar_bytes_in=9844326worker1 # [ 73.308990] nix-grpc-daemon[797]: ts=2026-09-20T08:04:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492664327worker1 # [ 73.317395] nix-daemon[881]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4328worker1 # [ 73.322270] nix-daemon[881]: reaped child process 1015, status = succeeded4329client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4330client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4331worker1 # [ 73.336292] nix-daemon[881]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4332worker1 # [ 74.373874] nix-daemon[881]: reaped child process 1030, status = succeeded4333worker1 # [ 74.539656] nix-daemon[881]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)4334worker1 # [ 74.563635] nix-daemon[881]: reaped child process 1048, status = succeeded4335lb # [ 73.169065] niks3-server[979]: 2026/09/20 08:04:52 INFO Received uploads request method=POST path=/api/pending_closures4336worker1 # [ 74.592688] nix-grpc-daemon[928]: time=2026-09-20T08:04:52.418Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4337lb # [ 73.195687] niks3-server[979]: 2026/09/20 08:04:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4338lb # [ 73.201555] niks3-server[979]: 2026/09/20 08:04:52 INFO Signed narinfos id=18 count=14339worker1 # [ 74.614157] nix-grpc-daemon[928]: time=2026-09-20T08:04:52.440Z level=INFO msg="Uploading 1 narinfos"4340lb # [ 73.206219] niks3-server[979]: 2026/09/20 08:04:52 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4341lb # [ 73.210878] niks3-server[979]: 2026/09/20 08:04:52 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4342lb # [ 73.216858] niks3-server[979]: 2026/09/20 08:04:52 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4343lb # [ 73.224441] niks3-server[979]: 2026/09/20 08:04:52 INFO Completed upload id=184344worker1 # [ 74.633966] nix-grpc-daemon[928]: time=2026-09-20T08:04:52.460Z level=INFO msg="Upload complete. (285ms)"4345lb # [ 73.227975] niks3-server[979]: 2026/09/20 08:04:52 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4346worker1 # [ 74.645093] nix-grpc-daemon[797]: ts=2026-09-20T08:04:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49266 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=8 outputs=14347worker1 # [ 74.658495] nix-daemon[881]: reaped child process 1028, status = succeeded4348client # copying 1 paths...4349worker1 # [ 74.692607] nix-grpc-daemon[797]: ts=2026-09-20T08:04:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492664350client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4351worker2 # [ 74.789948] nix-grpc-daemon[855]: ts=2026-09-20T08:04:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:344224352worker2 # [ 74.807678] nix-grpc-daemon[855]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4353worker2 # [ 74.825480] nix-grpc-daemon[855]: ts=2026-09-20T08:04:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=0 paths=1 nar_bytes_out=1204354client # [ 74.871040] nix-daemon[1006]: reaped child process 1092, status = succeeded4355client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.39 seconds)4356client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24357client # [ 75.096669] nix-daemon[1006]: accepted connection from pid 1111, user root (trusted)4358client # this derivation will be built:4359client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4360worker1 # [ 75.315953] nix-grpc-daemon[797]: ts=2026-09-20T08:04:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:492664361client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4362worker2 # [ 75.386733] nix-grpc-daemon[855]: ts=2026-09-20T08:04:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344224363worker2 # [ 75.395566] nix-grpc-daemon[926]: time=2026-09-20T08:04:53.181Z level=INFO msg="All 1 paths already cached"4364worker1 # [ 75.359010] nix-grpc-daemon[797]: ts=2026-09-20T08:04:53Z level=debug event=want client=9 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04365worker1 # [ 75.363413] nix-grpc-daemon[797]: ts=2026-09-20T08:04:53Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14366worker2 # [ 75.472004] nix-grpc-daemon[855]: ts=2026-09-20T08:04:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344224367worker2 # [ 75.492185] nix-grpc-daemon[855]: ts=2026-09-20T08:04:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344224368client # copying 1 paths to 'lb:50051'...4369client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4370worker2 # [ 75.518311] nix-grpc-daemon[855]: ts=2026-09-20T08:04:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344224371worker2 # [ 75.534869] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4372worker2 # [ 75.551840] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 1/5)4373worker2 # [ 75.568991] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 2/5)4374worker2 # [ 75.620979] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 317 ms (attempt 3/5)4375worker2 # [ 75.942864] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 510 ms (attempt 4/5)4376worker2 # [ 76.458630] nix-grpc-daemon[855]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4377worker2 # [ 76.469986] nix-grpc-daemon[855]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4378worker2 # [ 76.724938] nix-daemon[916]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)4379worker2 # [ 76.754376] nix-daemon[916]: reaped child process 1202, status = succeeded4380worker2 # [ 76.965853] nix-daemon[916]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)4381worker2 # [ 76.993430] nix-daemon[916]: reaped child process 1207, status = succeeded4382lb # [ 75.536852] niks3-server[979]: 2026/09/20 08:04:54 INFO Received uploads request method=POST path=/api/pending_closures4383worker2 # [ 77.014787] nix-grpc-daemon[926]: time=2026-09-20T08:04:54.800Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4384worker2 # [ 77.016678] nix-grpc-daemon[926]: time=2026-09-20T08:04:54.800Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4385lb # [ 75.556188] niks3-server[979]: 2026/09/20 08:04:54 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4386lb # [ 75.565315] niks3-server[979]: 2026/09/20 08:04:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4387worker2 # [ 77.038871] nix-grpc-daemon[926]: time=2026-09-20T08:04:54.825Z level=INFO msg="Uploading 1 narinfos"4388lb # [ 75.571178] niks3-server[979]: 2026/09/20 08:04:54 INFO Signed narinfos id=19 count=14389lb # [ 75.573924] niks3-server[979]: 2026/09/20 08:04:54 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4390lb # [ 75.581034] niks3-server[979]: 2026/09/20 08:04:54 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4391lb # [ 75.586605] niks3-server[979]: 2026/09/20 08:04:54 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4392lb # [ 75.592429] niks3-server[979]: 2026/09/20 08:04:54 INFO Completed upload id=194393worker2 # [ 77.063170] nix-grpc-daemon[926]: time=2026-09-20T08:04:54.849Z level=INFO msg="Upload complete. (565ms)"4394worker2 # [ 77.069007] nix-grpc-daemon[855]: ts=2026-09-20T08:04:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=1 paths=1 nar_bytes_in=5684395worker2 # [ 77.077885] nix-grpc-daemon[855]: ts=2026-09-20T08:04:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344224396worker2 # [ 77.089535] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4397worker2 # [ 77.093647] nix-daemon[916]: reaped child process 1193, status = succeeded4398worker2 # [ 77.105138] nix-daemon[916]: accepted connection from pid 855, user nix-grpc-daemon (trusted)4399client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4400client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4401worker2 # [ 78.767947] nix-daemon[916]: reaped child process 1211, status = succeeded4402worker2 # [ 79.004758] nix-daemon[916]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)4403worker2 # [ 79.030858] nix-daemon[916]: reaped child process 1229, status = succeeded4404lb # [ 77.573732] niks3-server[979]: 2026/09/20 08:04:56 INFO Received uploads request method=POST path=/api/pending_closures4405worker2 # [ 79.060561] nix-grpc-daemon[926]: time=2026-09-20T08:04:56.843Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4406lb # [ 77.613213] niks3-server[979]: 2026/09/20 08:04:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4407worker2 # [ 79.097041] nix-grpc-daemon[926]: time=2026-09-20T08:04:56.883Z level=INFO msg="Uploading 1 narinfos"4408lb # [ 77.631745] niks3-server[979]: 2026/09/20 08:04:56 INFO Signed narinfos id=20 count=14409lb # [ 77.637677] niks3-server[979]: 2026/09/20 08:04:56 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4410lb # [ 77.645339] niks3-server[979]: 2026/09/20 08:04:56 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4411worker2 # [ 79.123582] nix-grpc-daemon[926]: time=2026-09-20T08:04:56.910Z level=INFO msg="Upload complete. (401ms)"4412lb # [ 77.655086] niks3-server[979]: 2026/09/20 08:04:56 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4413lb # [ 77.660077] niks3-server[979]: 2026/09/20 08:04:56 INFO Completed upload id=204414lb # [ 77.662557] niks3-server[979]: 2026/09/20 08:04:56 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4415worker2 # [ 79.137341] nix-grpc-daemon[855]: ts=2026-09-20T08:04:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=2 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=9 outputs=14416worker2 # [ 79.151488] nix-daemon[916]: reaped child process 1209, status = succeeded4417client # copying 1 paths...4418worker1 # [ 79.122145] nix-grpc-daemon[797]: ts=2026-09-20T08:04:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492664419worker1 # [ 79.132147] nix-grpc-daemon[797]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4420client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4421worker1 # [ 79.172066] nix-grpc-daemon[797]: ts=2026-09-20T08:04:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:492664422worker1 # [ 79.174965] nix-grpc-daemon[797]: ts=2026-09-20T08:04:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49266 duration_s=0 paths=1 nar_bytes_out=1204423client # [ 79.279306] nix-daemon[1006]: reaped child process 1114, status = succeeded4424client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 4.41 seconds)4425client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24426client # [ 79.519499] nix-daemon[1006]: accepted connection from pid 1133, user root (trusted)4427client # this derivation will be built:4428client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4429worker1 # [ 79.754152] nix-grpc-daemon[797]: ts=2026-09-20T08:04:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:492664430client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4431worker1 # [ 79.763113] nix-grpc-daemon[797]: ts=2026-09-20T08:04:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492664432worker1 # [ 79.771975] nix-grpc-daemon[928]: time=2026-09-20T08:04:57.596Z level=INFO msg="All 1 paths already cached"4433worker1 # [ 79.788130] nix-grpc-daemon[797]: ts=2026-09-20T08:04:57Z level=debug event=want client=10 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04434worker1 # [ 79.791441] nix-grpc-daemon[797]: ts=2026-09-20T08:04:57Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14435worker1 # [ 79.798138] nix-grpc-daemon[797]: ts=2026-09-20T08:04:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492664436worker1 # [ 79.813387] nix-grpc-daemon[797]: ts=2026-09-20T08:04:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492664437worker1 # [ 79.828116] nix-grpc-daemon[928]: time=2026-09-20T08:04:57.654Z level=INFO msg="All 1 paths already cached"4438client # copying 1 paths to 'lb:50051'...4439client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4440worker1 # [ 79.839026] nix-grpc-daemon[797]: ts=2026-09-20T08:04:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492664441worker1 # [ 79.852587] nix-daemon[881]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4442worker1 # [ 80.064808] nix-daemon[881]: accepted connection from pid 1057, user nix-grpc-daemon (trusted)4443worker1 # [ 80.092522] nix-daemon[881]: reaped child process 1060, status = succeeded4444worker1 # [ 80.289990] nix-daemon[881]: accepted connection from pid 1062, user nix-grpc-daemon (trusted)4445worker1 # [ 80.315669] nix-daemon[881]: reaped child process 1065, status = succeeded4446lb # [ 78.919654] niks3-server[979]: 2026/09/20 08:04:58 INFO Received uploads request method=POST path=/api/pending_closures4447worker1 # [ 80.355118] nix-grpc-daemon[928]: time=2026-09-20T08:04:58.181Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4448worker1 # [ 80.359921] nix-grpc-daemon[928]: time=2026-09-20T08:04:58.181Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4449lb # [ 78.960568] niks3-server[979]: 2026/09/20 08:04:58 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4450lb # [ 78.967609] niks3-server[979]: 2026/09/20 08:04:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4451worker1 # [ 80.380857] nix-grpc-daemon[928]: time=2026-09-20T08:04:58.207Z level=INFO msg="Uploading 1 narinfos"4452lb # [ 78.972348] niks3-server[979]: 2026/09/20 08:04:58 INFO Signed narinfos id=21 count=14453lb # [ 78.980270] niks3-server[979]: 2026/09/20 08:04:58 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4454lb # [ 78.986781] niks3-server[979]: 2026/09/20 08:04:58 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4455lb # [ 78.989433] niks3-server[979]: 2026/09/20 08:04:58 INFO Completed upload id=214456worker1 # [ 80.399635] nix-grpc-daemon[928]: time=2026-09-20T08:04:58.226Z level=INFO msg="Upload complete. (533ms)"4457lb # [ 78.992453] niks3-server[979]: 2026/09/20 08:04:58 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4458worker1 # [ 80.408916] nix-grpc-daemon[797]: ts=2026-09-20T08:04:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49266 duration_s=0 paths=1 nar_bytes_in=5684459worker1 # [ 80.419146] nix-grpc-daemon[797]: ts=2026-09-20T08:04:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492664460worker1 # [ 80.426480] nix-daemon[881]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4461worker1 # [ 80.431757] nix-daemon[881]: reaped child process 1055, status = succeeded4462client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4463worker1 # [ 80.445080] nix-daemon[881]: accepted connection from pid 797, user nix-grpc-daemon (trusted)4464client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4465lb # [ 80.464207] envoy[872]: conn peer=[2001:db8:1::1]:36624 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4219 tx=1771 ms=27964466lb # [ 80.464467] envoy[872]: conn peer=[2001:db8:1::1]:36636 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1014467lb # [ 80.464550] envoy[872]: conn peer=[2001:db8:1::1]:36648 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3740 tx=1936 ms=39144468lb # [ 80.464611] envoy[872]: conn peer=[2001:db8:1::1]:36656 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=634469worker1 # [ 81.899640] nix-daemon[881]: reaped child process 1069, status = succeeded4470worker1 # [ 82.097033] nix-daemon[881]: accepted connection from pid 1084, user nix-grpc-daemon (trusted)4471worker1 # [ 82.122842] nix-daemon[881]: reaped child process 1087, status = succeeded4472lb # [ 80.731808] niks3-server[979]: 2026/09/20 08:04:59 INFO Received uploads request method=POST path=/api/pending_closures4473worker1 # [ 82.156740] nix-grpc-daemon[928]: time=2026-09-20T08:04:59.981Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4474worker1 # [ 82.192737] nix-grpc-daemon[928]: time=2026-09-20T08:05:00.019Z level=INFO msg="Uploading 1 narinfos"4475lb # [ 80.771092] niks3-server[979]: 2026/09/20 08:04:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4476lb # [ 80.789473] niks3-server[979]: 2026/09/20 08:04:59 INFO Signed narinfos id=22 count=14477lb # [ 80.796462] niks3-server[979]: 2026/09/20 08:04:59 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4478lb # [ 80.803783] niks3-server[979]: 2026/09/20 08:04:59 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4479lb # [ 80.813211] niks3-server[979]: 2026/09/20 08:05:00 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4480lb # [ 80.818060] niks3-server[979]: 2026/09/20 08:05:00 INFO Completed upload id=224481worker1 # [ 82.227465] nix-grpc-daemon[928]: time=2026-09-20T08:05:00.054Z level=INFO msg="Upload complete. (370ms)"4482lb # [ 80.820728] niks3-server[979]: 2026/09/20 08:05:00 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4483worker1 # [ 82.236455] nix-grpc-daemon[797]: ts=2026-09-20T08:05:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49266 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=10 outputs=14484worker1 # [ 82.251002] nix-daemon[881]: reaped child process 1067, status = succeeded4485client # copying 1 paths...4486worker1 # [ 82.286406] nix-grpc-daemon[797]: ts=2026-09-20T08:05:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492664487client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4488worker2 # [ 82.383894] nix-grpc-daemon[855]: ts=2026-09-20T08:05:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:344224489worker2 # [ 82.401763] nix-grpc-daemon[855]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4490worker2 # [ 82.423379] nix-grpc-daemon[855]: ts=2026-09-20T08:05:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34422 duration_s=0 paths=1 nar_bytes_out=1204491client # [ 82.475559] nix-daemon[1006]: reaped child process 1136, status = succeeded4492client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.19 seconds)4493(finished: subtest: an input only one worker has still reaches the builder, in 12.14 seconds)4494subtest: upload whose reference the worker lacks is completed from the cache4495client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4496client # this derivation will be built:4497client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4498client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4499client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.54 seconds)4500client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4501client # this derivation will be built:4502client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4503client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4504client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.52 seconds)4505client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4506client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.23 seconds)4507worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4508worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.26 seconds)4509worker2 # [ 84.173625] systemd[1]: Stopping Nix worker-protocol over gRPC...4510worker2 # [ 84.344751] nix-grpc-daemon[855]: ts=2026-09-20T08:05:02Z level=info event=signal_exit4511worker2 # [ 85.599875] nix-grpc-daemon[855]: ts=2026-09-20T08:05:03Z level=info event=scheduler_restarting4512worker1 # [ 85.541485] nix-grpc-daemon[797]: ts=2026-09-20T08:05:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:492584513worker1 # [ 85.541884] nix-grpc-daemon[797]: ts=2026-09-20T08:05:03Z level=info event=worker_gone addr=192.168.1.4:500514514worker2 # [ 85.633790] nix-grpc-daemon[855]: ts=2026-09-20T08:05:03Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4515worker2 # [ 85.653404] nix-daemon[916]: reaped child process 918, status = succeeded4516worker2 # [ 86.133685] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4517worker2 # [ 86.144830] systemd[1]: Stopped Nix worker-protocol over gRPC.4518worker2 # [ 86.147027] systemd[1]: nix-grpc-daemon.service: Consumed 3.765s CPU time over 54.194s wall clock time, 56.1M memory peak, 72.6K incoming IP traffic, 129.2K outgoing IP traffic.4519worker2 # [ 86.161455] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4520worker2 # [ 86.163396] systemd[1]: Closed Nix worker-protocol over gRPC.4521worker2 # [ 86.166331] systemd[1]: nix-grpc-daemon.socket: Consumed 939us CPU time over 1min 5.871s wall clock time, 256K memory peak, 77K incoming IP traffic, 66.3K outgoing IP traffic.4522lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4523lb: must succeed: curl -sf localhost:9901/clusters4524lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4525lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4526client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24527worker1 # [ 86.451729] nix-grpc-daemon[797]: ts=2026-09-20T08:05:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492664528worker1 # [ 86.465540] nix-grpc-daemon[797]: ts=2026-09-20T08:05:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492664529client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4530client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.30 seconds)4531worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4532worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4533worker2 # [ 86.691723] systemd[1]: Listening on Nix worker-protocol over gRPC.4534worker1 # [ 86.731149] systemd[1]: Stopping Nix worker-protocol over gRPC...4535worker2 # [ 87.597089] systemd[1]: Starting Nix worker-protocol over gRPC...4536worker1 # [ 87.632202] nix-grpc-daemon[797]: ts=2026-09-20T08:05:05Z level=info event=signal_exit4537worker2 # [ 87.808973] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:05Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4538worker2 # [ 87.811925] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:05Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14539worker2 # [ 87.822165] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:05Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4540worker2 # [ 87.833159] systemd[1]: Started Nix worker-protocol over gRPC.4541worker2 # [ 87.856873] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:05Z level=info event=scheduler_connected addr=lb:500514542worker1 # [ 87.799378] nix-grpc-daemon[797]: ts=2026-09-20T08:05:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04543worker1 # [ 87.899277] nix-grpc-daemon[797]: ts=2026-09-20T08:05:05Z level=info event=scheduler_yield4544worker2 # [ 87.962423] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:05Z level=info event=scheduler_restarting addr=lb:500514545lb # [ 86.493391] niks3-server[979]: 2026/09/20 08:05:05 INFO lead: released remote=192.168.1.3:391064546worker1 # [ 87.905965] nix-grpc-daemon[797]: ts=2026-09-20T08:05:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:492584547worker1 # [ 87.910001] nix-grpc-daemon[797]: ts=2026-09-20T08:05:05Z level=info event=worker_gone addr=192.168.1.4:500514548worker1 # [ 87.914635] nix-grpc-daemon[797]: ts=2026-09-20T08:05:05Z level=info event=scheduler_restarting addr=lb:500514549worker1 # [ 87.919450] nix-grpc-daemon[797]: ts=2026-09-20T08:05:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:492584550worker1 # [ 87.923132] nix-grpc-daemon[797]: ts=2026-09-20T08:05:05Z level=info event=worker_gone addr=192.168.1.3:500514551worker2 # [ 88.163808] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:05Z level=info event=scheduler_connected addr=lb:500514552worker1 # [ 88.115471] nix-grpc-daemon[797]: ts=2026-09-20T08:05:05Z level=info event=scheduler_connected addr=lb:500514553worker2 # [ 88.178099] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4554worker1 # [ 88.135125] nix-grpc-daemon[797]: ts=2026-09-20T08:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4555worker2 # [ 88.378970] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:06Z level=info event=scheduler_connected addr=lb:500514556worker2 # [ 88.382624] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4557worker1 # [ 88.336093] nix-grpc-daemon[797]: ts=2026-09-20T08:05:06Z level=info event=scheduler_connected addr=lb:500514558worker1 # [ 88.342718] nix-grpc-daemon[797]: ts=2026-09-20T08:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4559worker2 # [ 88.583942] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:06Z level=info event=scheduler_connected addr=lb:500514560worker2 # [ 88.592816] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4561worker1 # [ 88.544131] nix-grpc-daemon[797]: ts=2026-09-20T08:05:06Z level=info event=scheduler_connected addr=lb:500514562worker1 # [ 88.552576] nix-grpc-daemon[797]: ts=2026-09-20T08:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4563worker2 # [ 88.793966] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:06Z level=info event=scheduler_connected addr=lb:500514564worker2 # [ 88.803513] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4565worker1 # [ 88.754409] nix-grpc-daemon[797]: ts=2026-09-20T08:05:06Z level=info event=scheduler_connected addr=lb:500514566worker1 # [ 88.759679] nix-grpc-daemon[797]: ts=2026-09-20T08:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4567worker1 # [ 88.906366] nix-grpc-daemon[797]: ts=2026-09-20T08:05:06Z level=info event=scheduler_restarting4568worker1 # [ 88.935634] nix-daemon[881]: reaped child process 883, status = succeeded4569worker2 # [ 89.005187] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:06Z level=info event=scheduler_connected addr=lb:500514570worker2 # [ 89.008690] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4571worker1 # [ 88.979784] nix-grpc-daemon[797]: ts=2026-09-20T08:05:06Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4572worker2 # [ 89.210238] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:06Z level=info event=scheduler_connected addr=lb:500514573worker1 # [ 89.153649] nix-grpc-daemon[797]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4574worker1 # [ 89.158871] nix-grpc-daemon[797]: E0000 00:00:1789891506.979972 840 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true4575worker1 # [ 89.800562] nix-grpc-daemon[797]: E0000 00:00:1789891507.626672 840 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4576worker1 # [ 89.850660] nix-grpc-daemon[797]: E0000 00:00:1789891507.677394 840 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4577worker2 # [ 90.028156] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4578worker1 # [ 89.989600] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4579worker1 # [ 89.998857] systemd[1]: Stopped Nix worker-protocol over gRPC.4580worker1 # [ 90.004499] systemd[1]: nix-grpc-daemon.service: Consumed 2.218s CPU time over 58.115s wall clock time, 52.1M memory peak, 50.8K incoming IP traffic, 105.5K outgoing IP traffic.4581worker1 # [ 90.017917] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4582worker1 # [ 90.021259] systemd[1]: Closed Nix worker-protocol over gRPC.4583worker1 # [ 90.024943] systemd[1]: nix-grpc-daemon.socket: Consumed 901us CPU time over 1min 9.196s wall clock time, 256K memory peak, 86.5K incoming IP traffic, 75K outgoing IP traffic.4584lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4585lb: must succeed: curl -sf localhost:9901/clusters4586lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4587lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.06 seconds)4588client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24589worker2 # [ 90.228436] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:08Z level=info event=scheduler_connected addr=lb:500514590worker2 # [ 90.232912] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4591worker2 # [ 90.433799] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:08Z level=info event=scheduler_connected addr=lb:500514592worker2 # [ 90.442196] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4593worker2 # [ 90.642851] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:08Z level=info event=scheduler_connected addr=lb:500514594worker2 # [ 90.648342] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:414144595worker2 # [ 90.655576] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4596worker2 # [ 90.666120] nix-daemon[916]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)4597worker2 # [ 90.680531] nix-grpc-daemon[1251]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 1/5)4598worker2 # [ 90.741719] nix-grpc-daemon[1251]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 2/5)4599worker2 # [ 90.849408] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:08Z level=info event=scheduler_connected addr=lb:500514600worker2 # [ 90.854946] nix-grpc-daemon[1251]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 3/5)4601worker2 # [ 90.861302] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4602worker2 # [ 91.052791] nix-grpc-daemon[1251]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 360 ms (attempt 4/5)4603worker2 # [ 91.062419] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:08Z level=info event=scheduler_connected addr=lb:500514604worker2 # [ 91.068149] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4605worker2 # [ 91.272880] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=info event=scheduler_connected addr=lb:500514606worker2 # [ 91.276045] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4607worker2 # [ 91.418555] nix-grpc-daemon[1251]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4608client # copying 2 paths...4609client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4610client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4611worker2 # [ 91.455378] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:414144612worker2 # [ 91.467861] nix-daemon[916]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)4613worker2 # [ 91.476941] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=info event=scheduler_connected addr=lb:500514614worker2 # [ 91.481997] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4615worker2 # [ 91.498421] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=info event=niks3_push_started pid=13074616worker2 # [ 91.683291] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=info event=scheduler_connected addr=lb:500514617worker2 # [ 91.688798] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4618worker2 # [ 91.889743] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=info event=scheduler_connected addr=lb:500514619worker2 # [ 91.900696] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4620lb # [ 90.464865] envoy[872]: conn peer=[2001:db8:1::1]:36668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1779 ms=26734621lb # [ 90.468875] envoy[872]: conn peer=[2001:db8:1::1]:57026 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1124622lb # [ 90.470746] envoy[872]: conn peer=[2001:db8:1::4]:56608 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3239 tx=1159 ms=523214623lb # [ 90.472495] envoy[872]: conn peer=[2001:db8:1::1]:57038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=523 ms=394624lb # [ 90.474508] envoy[872]: conn peer=[2001:db8:1::3]:37462 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3951 tx=1227 ms=562484625worker2 # [ 92.025619] nix-daemon[916]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)4626worker2 # [ 92.060103] nix-daemon[916]: reaped child process 1323, status = succeeded4627lb # [ 90.614679] niks3-server[979]: 2026/09/20 08:05:09 INFO Received uploads request method=POST path=/api/pending_closures4628worker2 # [ 92.107711] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=info event=scheduler_connected addr=lb:500514629worker2 # [ 92.125488] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4630lb # [ 90.645147] niks3-server[979]: 2026/09/20 08:05:09 INFO Received uploads request method=POST path=/api/pending_closures4631worker2 # [ 92.147509] nix-grpc-daemon[1307]: time=2026-09-20T08:05:09.929Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4632worker2 # [ 92.157278] nix-grpc-daemon[1307]: time=2026-09-20T08:05:09.929Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4633worker2 # [ 92.164471] nix-grpc-daemon[1307]: time=2026-09-20T08:05:09.930Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4634lb # [ 90.788306] niks3-server[979]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4635lb # [ 90.822710] niks3-server[979]: 2026/09/20 08:05:10 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4636lb # [ 90.853748] niks3-server[979]: 2026/09/20 08:05:10 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4637worker2 # [ 92.327319] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:10Z level=info event=scheduler_connected addr=lb:500514638lb # [ 90.863225] niks3-server[979]: 2026/09/20 08:05:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4639lb # [ 90.880734] niks3-server[979]: 2026/09/20 08:05:10 INFO Signed narinfos id=23 count=14640worker2 # [ 92.349049] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4641worker2 # [ 92.359801] nix-grpc-daemon[1307]: time=2026-09-20T08:05:10.141Z level=INFO msg="Uploading 3 narinfos"4642lb # [ 90.894218] niks3-server[979]: 2026/09/20 08:05:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4643lb # [ 90.899462] niks3-server[979]: 2026/09/20 08:05:10 INFO Signed narinfos id=24 count=24644lb # [ 90.922749] niks3-server[979]: 2026/09/20 08:05:10 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4645lb # [ 90.958690] niks3-server[979]: 2026/09/20 08:05:10 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4646lb # [ 90.968236] niks3-server[979]: 2026/09/20 08:05:10 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4647lb # [ 90.979322] niks3-server[979]: 2026/09/20 08:05:10 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4648lb # [ 90.985249] niks3-server[979]: 2026/09/20 08:05:10 INFO Completed upload id=244649lb # [ 90.999695] niks3-server[979]: 2026/09/20 08:05:10 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4650worker2 # [ 92.470352] nix-grpc-daemon[1307]: time=2026-09-20T08:05:10.256Z level=WARN msg="Failed to register uploaded object" key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo error="server returned 404: object is not pending upload\n"4651lb # [ 91.020983] niks3-server[979]: 2026/09/20 08:05:10 INFO Completed upload id=234652worker2 # [ 92.491229] nix-grpc-daemon[1307]: time=2026-09-20T08:05:10.277Z level=INFO msg="Upload complete. (701ms)"4653worker2 # [ 92.504733] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41414 duration_s=1 paths=2 nar_bytes_in=3124654worker2 # [ 92.535597] nix-daemon[916]: reaped child process 1305, status = succeeded4655worker2 # [ 92.551314] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:10Z level=info event=scheduler_connected addr=lb:500514656client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 2.43 seconds)4657worker2 # [ 92.576699] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4658worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4659worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.06 seconds)4660worker1 # [ 92.712276] systemd[1]: Listening on Nix worker-protocol over gRPC.4661worker2 # [ 92.778656] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:10Z level=info event=scheduler_connected addr=lb:500514662worker1 # [ 92.724965] systemd[1]: Starting Nix worker-protocol over gRPC...4663worker2 # [ 92.797464] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4664worker2 # [ 92.861539] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:10Z level=info event=scheduler_take_over4665lb # [ 91.387930] niks3-server[979]: 2026/09/20 08:05:10 INFO lead: acquired remote=192.168.1.4:339704666worker2 # [ 93.005390] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:10Z level=info event=scheduler_connected addr=lb:500514667worker2 # [ 93.024287] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:10Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04668worker1 # [ 93.028925] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:10Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4669worker1 # [ 93.035479] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:10Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14670worker1 # [ 93.067568] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4671worker1 # [ 93.096653] systemd[1]: Started Nix worker-protocol over gRPC.4672lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4673lb: must succeed: curl -sf localhost:9901/clusters4674worker1 # [ 93.135131] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:10Z level=info event=scheduler_connected addr=lb:500514675worker2 # [ 93.206145] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:10Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04676lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)4677lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.12 seconds)4678(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.73 seconds)4679subtest: scheduler down: the other node takes the lock and keeps it4680lb: must succeed: curl -sf localhost:9901/clusters4681lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4682lb: must succeed: curl -sf localhost:9901/clusters4683lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4684lb: must succeed: curl -sf localhost:9901/clusters4685lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4686lb: must succeed: curl -sf localhost:9901/clusters4687lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4688worker2 # [ 93.675015] systemd[1]: Stopping Nix worker-protocol over gRPC...4689worker2 # [ 93.827238] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:11Z level=info event=signal_exit4690worker2 # [ 93.853810] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:11Z level=info event=scheduler_yield4691lb # [ 92.390107] niks3-server[979]: 2026/09/20 08:05:11 INFO lead: released remote=192.168.1.4:339704692worker1 # [ 93.801040] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:11Z level=info event=scheduler_restarting addr=lb:500514693worker2 # [ 93.868348] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:414084694worker2 # [ 93.878311] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:11Z level=info event=worker_gone addr=192.168.1.3:500514695worker2 # [ 93.891046] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:11Z level=info event=scheduler_restarting addr=lb:500514696worker2 # [ 93.896672] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:414084697worker2 # [ 93.902140] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:11Z level=info event=worker_gone addr=192.168.1.4:500514698worker1 # [ 94.002227] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:11Z level=info event=scheduler_connected addr=lb:500514699worker1 # [ 94.011452] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4700worker2 # [ 94.077979] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:11Z level=info event=scheduler_connected addr=lb:500514701worker2 # [ 94.102177] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4702worker1 # [ 94.219623] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:12Z level=info event=scheduler_connected addr=lb:500514703worker1 # [ 94.228785] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4704worker2 # [ 94.303703] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:12Z level=info event=scheduler_connected addr=lb:500514705worker2 # [ 94.312261] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4706worker1 # [ 94.429639] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:12Z level=info event=scheduler_connected addr=lb:500514707worker1 # [ 94.439785] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4708worker2 # [ 94.513297] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:12Z level=info event=scheduler_connected addr=lb:500514709worker2 # [ 94.518021] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4710worker1 # [ 94.641354] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:12Z level=info event=scheduler_connected addr=lb:500514711worker1 # [ 94.650747] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4712worker2 # [ 94.719875] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:12Z level=info event=scheduler_connected addr=lb:500514713worker2 # [ 94.727441] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4714worker2 # [ 94.861542] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:12Z level=info event=scheduler_restarting4715worker2 # [ 94.891547] nix-grpc-daemon[1251]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4716worker2 # [ 94.901716] nix-grpc-daemon[1251]: E0000 00:00:1789891512.676947 1294 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4717worker1 # [ 94.852851] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:12Z level=info event=scheduler_connected addr=lb:500514718worker1 # [ 94.861475] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4719worker2 # [ 94.916401] nix-grpc-daemon[1251]: E0000 00:00:1789891512.677739 1294 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4720worker2 # [ 94.949064] nix-grpc-daemon[1251]: ts=2026-09-20T08:05:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4721worker2 # [ 94.953432] nix-daemon[916]: reaped child process 1300, status = succeeded4722worker1 # [ 95.062671] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:12Z level=info event=scheduler_connected addr=lb:500514723worker2 # [ 95.125536] nix-grpc-daemon[1251]: E0000 00:00:1789891512.911912 1294 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true4724worker1 # [ 95.775226] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:13Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4725worker2 # [ 95.863754] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4726worker2 # [ 95.870980] systemd[1]: Stopped Nix worker-protocol over gRPC.4727worker2 # [ 95.882316] systemd[1]: nix-grpc-daemon.service: Consumed 677ms CPU time over 8.269s wall clock time, 30.8M memory peak, 22K incoming IP traffic, 29.9K outgoing IP traffic.4728worker2 # [ 95.898566] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4729worker2 # [ 95.902466] systemd[1]: Closed Nix worker-protocol over gRPC.4730worker2 # [ 95.907405] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 9.220s wall clock time, 256K memory peak, 29.8K incoming IP traffic, 23.6K outgoing IP traffic.4731worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4732worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.05 seconds)4733worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4734worker1 # [ 95.977396] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:13Z level=info event=scheduler_connected addr=lb:500514735worker1 # [ 95.983835] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4736worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4737worker1 # [ 96.184890] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:14Z level=info event=scheduler_connected addr=lb:500514738worker1 # [ 96.200411] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:14Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4739worker1 # [ 96.402697] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:14Z level=info event=scheduler_connected addr=lb:500514740worker1 # [ 96.407777] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4741worker1 # [ 96.609667] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:14Z level=info event=scheduler_connected addr=lb:500514742worker1 # [ 96.617590] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:14Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4743worker1 # [ 96.818820] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:14Z level=info event=scheduler_connected addr=lb:500514744worker1 # [ 96.825032] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4745worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4746worker1 # [ 97.026721] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:14Z level=info event=scheduler_connected addr=lb:500514747worker1 # [ 97.039684] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:14Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4748worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.13 seconds)4749worker1 # [ 97.238195] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:15Z level=info event=scheduler_connected addr=lb:500514750worker1 # [ 97.247232] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4751worker1 # [ 97.448909] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:15Z level=info event=scheduler_connected addr=lb:500514752worker1 # [ 97.459494] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4753worker1 # [ 97.660168] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:15Z level=info event=scheduler_connected addr=lb:500514754worker1 # [ 97.664556] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4755worker1 # [ 97.868325] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:15Z level=info event=scheduler_connected addr=lb:500514756worker1 # [ 97.874456] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4757worker1 # [ 98.075494] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:15Z level=info event=scheduler_connected addr=lb:500514758worker1 # [ 98.083485] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4759lb # [ 96.691394] niks3-server[979]: 2026/09/20 08:05:15 INFO lead: acquired remote=192.168.1.3:507584760worker1 # [ 98.104120] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:15Z level=info event=scheduler_take_over4761worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4762worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)4763worker1 # [ 98.283846] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:16Z level=info event=scheduler_connected addr=lb:500514764worker1 # [ 98.287342] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04765worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4766worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)4767client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&24768worker1 # [ 99.597482] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:437984769worker1 # [ 99.607403] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4770client # don't know how to build these paths:4771client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4772worker1 # [ 99.630125] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:17Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04773worker1 # [ 99.633544] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:17Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14774worker1 # [ 99.680150] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437984775worker1 # [ 99.698257] nix-grpc-daemon[1110]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 1/5)4776worker1 # [ 99.767565] nix-grpc-daemon[1110]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 155 ms (attempt 2/5)4777worker1 # [ 99.933432] nix-grpc-daemon[1110]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 77 ms (attempt 3/5)4778worker1 # [ 100.018963] nix-grpc-daemon[1110]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 116 ms (attempt 4/5)4779worker1 # [ 100.145102] nix-grpc-daemon[1110]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4780worker1 # [ 100.173081] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437984781client # copying 1 paths to 'lb:50051'...4782worker1 # [ 100.194568] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437984783client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4784worker1 # [ 100.208122] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4785worker1 # [ 100.226126] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:18Z level=info event=niks3_push_started pid=11944786worker1 # [ 100.644587] nix-daemon[881]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)4787worker1 # [ 100.668822] nix-daemon[881]: reaped child process 1210, status = succeeded4788worker1 # [ 100.847682] nix-daemon[881]: accepted connection from pid 1212, user nix-grpc-daemon (trusted)4789worker1 # [ 100.872938] nix-daemon[881]: reaped child process 1215, status = succeeded4790lb # [ 99.473175] niks3-server[979]: 2026/09/20 08:05:18 INFO Received uploads request method=POST path=/api/pending_closures4791worker1 # [ 100.896413] nix-grpc-daemon[1194]: time=2026-09-20T08:05:18.721Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4792worker1 # [ 100.899235] nix-grpc-daemon[1194]: time=2026-09-20T08:05:18.721Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4793lb # [ 99.517846] niks3-server[979]: 2026/09/20 08:05:18 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4794lb # [ 99.533453] niks3-server[979]: 2026/09/20 08:05:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4795worker1 # [ 100.950093] nix-grpc-daemon[1194]: time=2026-09-20T08:05:18.776Z level=INFO msg="Uploading 1 narinfos"4796lb # [ 99.546986] niks3-server[979]: 2026/09/20 08:05:18 INFO Signed narinfos id=25 count=14797lb # [ 99.560562] niks3-server[979]: 2026/09/20 08:05:18 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4798lb # [ 99.576555] niks3-server[979]: 2026/09/20 08:05:18 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4799lb # [ 99.588074] niks3-server[979]: 2026/09/20 08:05:18 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4800lb # [ 99.613654] niks3-server[979]: 2026/09/20 08:05:18 INFO Completed upload id=254801worker1 # [ 101.026932] nix-grpc-daemon[1194]: time=2026-09-20T08:05:18.853Z level=INFO msg="Upload complete. (577ms)"4802worker1 # [ 101.037379] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43798 duration_s=0 paths=1 nar_bytes_in=5204803worker1 # [ 101.051957] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437984804worker1 # [ 101.058865] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4805worker1 # [ 101.064090] nix-daemon[881]: reaped child process 1192, status = succeeded4806client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4807client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4808worker1 # [ 101.077107] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4809lb # [ 100.462805] envoy[872]: conn peer=[2001:db8:1::1]:57054 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=305 ms=18954810lb # [ 100.469251] envoy[872]: conn peer=[2001:db8:1::4]:35202 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3659 tx=1151 ms=70844811client # farm-a> LOG-farm-a-on-standby4812worker1 # [ 102.312361] nix-daemon[881]: reaped child process 1219, status = succeeded4813worker1 # [ 102.507909] nix-daemon[881]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)4814worker1 # [ 102.534186] nix-daemon[881]: reaped child process 1237, status = succeeded4815lb # [ 101.142400] niks3-server[979]: 2026/09/20 08:05:20 INFO Received uploads request method=POST path=/api/pending_closures4816worker1 # [ 102.568695] nix-grpc-daemon[1194]: time=2026-09-20T08:05:20.393Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4817worker1 # [ 102.570465] nix-grpc-daemon[1194]: time=2026-09-20T08:05:20.393Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4818lb # [ 101.196132] niks3-server[979]: 2026/09/20 08:05:20 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4819lb # [ 101.212223] niks3-server[979]: 2026/09/20 08:05:20 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4820lb # [ 101.227480] niks3-server[979]: 2026/09/20 08:05:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4821worker1 # [ 102.647255] nix-grpc-daemon[1194]: time=2026-09-20T08:05:20.472Z level=INFO msg="Uploading 1 narinfos"4822lb # [ 101.237004] niks3-server[979]: 2026/09/20 08:05:20 INFO Signed narinfos id=26 count=14823lb # [ 101.242584] niks3-server[979]: 2026/09/20 08:05:20 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4824lb # [ 101.256592] niks3-server[979]: 2026/09/20 08:05:20 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4825lb # [ 101.267078] niks3-server[979]: 2026/09/20 08:05:20 INFO Completed upload id=264826worker1 # [ 102.676586] nix-grpc-daemon[1194]: time=2026-09-20T08:05:20.503Z level=INFO msg="Upload complete. (383ms)"4827lb # [ 101.270305] niks3-server[979]: 2026/09/20 08:05:20 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4828worker1 # [ 102.700912] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43798 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14829worker1 # [ 102.716544] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:20Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04830worker1 # [ 102.719896] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:20Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14831worker1 # [ 102.726115] nix-daemon[881]: reaped child process 1217, status = succeeded4832worker1 # [ 102.744178] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437984833worker1 # [ 102.755569] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437984834worker1 # [ 102.769389] nix-grpc-daemon[1194]: time=2026-09-20T08:05:20.596Z level=INFO msg="All 1 paths already cached"4835client # copying 1 paths to 'lb:50051'...4836client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4837worker1 # [ 102.780154] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437984838worker1 # [ 102.796307] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4839worker1 # [ 103.016451] nix-daemon[881]: accepted connection from pid 1243, user nix-grpc-daemon (trusted)4840worker1 # [ 103.044617] nix-daemon[881]: reaped child process 1246, status = succeeded4841worker1 # [ 103.274439] nix-daemon[881]: accepted connection from pid 1248, user nix-grpc-daemon (trusted)4842worker1 # [ 103.301060] nix-daemon[881]: reaped child process 1251, status = succeeded4843lb # [ 101.901828] niks3-server[979]: 2026/09/20 08:05:21 INFO Received uploads request method=POST path=/api/pending_closures4844worker1 # [ 103.323614] nix-grpc-daemon[1194]: time=2026-09-20T08:05:21.149Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4845worker1 # [ 103.325740] nix-grpc-daemon[1194]: time=2026-09-20T08:05:21.149Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4846lb # [ 101.930074] niks3-server[979]: 2026/09/20 08:05:21 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4847worker1 # [ 103.345009] nix-grpc-daemon[1194]: time=2026-09-20T08:05:21.171Z level=INFO msg="Uploading 1 narinfos"4848lb # [ 101.935963] niks3-server[979]: 2026/09/20 08:05:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4849lb # [ 101.943124] niks3-server[979]: 2026/09/20 08:05:21 INFO Signed narinfos id=27 count=14850lb # [ 101.946276] niks3-server[979]: 2026/09/20 08:05:21 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4851lb # [ 101.954870] niks3-server[979]: 2026/09/20 08:05:21 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4852lb # [ 101.959294] niks3-server[979]: 2026/09/20 08:05:21 INFO Completed upload id=274853worker1 # [ 103.370005] nix-grpc-daemon[1194]: time=2026-09-20T08:05:21.196Z level=INFO msg="Upload complete. (557ms)"4854lb # [ 101.961692] niks3-server[979]: 2026/09/20 08:05:21 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4855worker1 # [ 103.376386] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43798 duration_s=0 paths=1 nar_bytes_in=6404856worker1 # [ 103.388523] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437984857worker1 # [ 103.394101] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4858worker1 # [ 103.398898] nix-daemon[881]: reaped child process 1241, status = succeeded4859client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4860worker1 # [ 103.412957] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4861client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4862client # farm-b> LOG-farm-b-on-standby4863worker1 # [ 104.641613] nix-daemon[881]: reaped child process 1255, status = succeeded4864worker1 # [ 104.828126] nix-daemon[881]: accepted connection from pid 1270, user nix-grpc-daemon (trusted)4865worker1 # [ 104.854327] nix-daemon[881]: reaped child process 1273, status = succeeded4866lb # [ 103.461302] niks3-server[979]: 2026/09/20 08:05:22 INFO Received uploads request method=POST path=/api/pending_closures4867worker1 # [ 104.884170] nix-grpc-daemon[1194]: time=2026-09-20T08:05:22.709Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4868worker1 # [ 104.885956] nix-grpc-daemon[1194]: time=2026-09-20T08:05:22.709Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4869lb # [ 103.512378] niks3-server[979]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4870worker1 # [ 104.934154] nix-grpc-daemon[1194]: time=2026-09-20T08:05:22.760Z level=INFO msg="Uploading 1 narinfos"4871lb # [ 103.523068] niks3-server[979]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4872lb # [ 103.535280] niks3-server[979]: 2026/09/20 08:05:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4873lb # [ 103.545019] niks3-server[979]: 2026/09/20 08:05:22 INFO Signed narinfos id=28 count=14874lb # [ 103.547635] niks3-server[979]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4875lb # [ 103.558287] niks3-server[979]: 2026/09/20 08:05:22 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4876lb # [ 103.567040] niks3-server[979]: 2026/09/20 08:05:22 INFO Completed upload id=284877worker1 # [ 104.976434] nix-grpc-daemon[1194]: time=2026-09-20T08:05:22.803Z level=INFO msg="Upload complete. (353ms)"4878lb # [ 103.572361] niks3-server[979]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4879worker1 # [ 104.984932] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43798 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14880worker1 # [ 105.001450] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:22Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04881worker1 # [ 105.004958] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:22Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=14882worker1 # [ 105.009202] nix-daemon[881]: reaped child process 1253, status = succeeded4883worker1 # [ 105.048513] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437984884worker1 # [ 105.060166] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437984885worker1 # [ 105.077778] nix-grpc-daemon[1194]: time=2026-09-20T08:05:22.904Z level=INFO msg="All 2 paths already cached"4886client # copying 1 paths to 'lb:50051'...4887client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4888worker1 # [ 105.088608] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437984889worker1 # [ 105.099395] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4890worker1 # [ 105.324882] nix-daemon[881]: accepted connection from pid 1279, user nix-grpc-daemon (trusted)4891worker1 # [ 105.360546] nix-daemon[881]: reaped child process 1282, status = succeeded4892worker1 # [ 105.549679] nix-daemon[881]: accepted connection from pid 1284, user nix-grpc-daemon (trusted)4893worker1 # [ 105.580421] nix-daemon[881]: reaped child process 1287, status = succeeded4894lb # [ 104.179894] niks3-server[979]: 2026/09/20 08:05:23 INFO Received uploads request method=POST path=/api/pending_closures4895worker1 # [ 105.599176] nix-grpc-daemon[1194]: time=2026-09-20T08:05:23.425Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4896worker1 # [ 105.601672] nix-grpc-daemon[1194]: time=2026-09-20T08:05:23.425Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4897lb # [ 104.213560] niks3-server[979]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst4898lb # [ 104.225977] niks3-server[979]: 2026/09/20 08:05:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4899worker1 # [ 105.643828] nix-grpc-daemon[1194]: time=2026-09-20T08:05:23.470Z level=INFO msg="Uploading 1 narinfos"4900lb # [ 104.237961] niks3-server[979]: 2026/09/20 08:05:23 INFO Signed narinfos id=29 count=14901lb # [ 104.244590] niks3-server[979]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls4902lb # [ 104.257350] niks3-server[979]: 2026/09/20 08:05:23 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4903lb # [ 104.267282] niks3-server[979]: 2026/09/20 08:05:23 INFO Completed upload id=294904worker1 # [ 105.677935] nix-grpc-daemon[1194]: time=2026-09-20T08:05:23.504Z level=INFO msg="Upload complete. (565ms)"4905lb # [ 104.271080] niks3-server[979]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo4906worker1 # [ 105.684549] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43798 duration_s=0 paths=1 nar_bytes_in=7684907worker1 # [ 105.692552] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437984908worker1 # [ 105.705105] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4909worker1 # [ 105.710113] nix-daemon[881]: reaped child process 1277, status = succeeded4910client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...4911client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4912worker1 # [ 105.725712] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4913client # farm-top> LOG-farm-top-on-standby4914worker1 # [ 106.554302] nix-daemon[881]: reaped child process 1291, status = succeeded4915worker1 # [ 106.750384] nix-daemon[881]: accepted connection from pid 1306, user nix-grpc-daemon (trusted)4916worker1 # [ 106.773953] nix-daemon[881]: reaped child process 1309, status = succeeded4917lb # [ 105.386523] niks3-server[979]: 2026/09/20 08:05:24 INFO Received uploads request method=POST path=/api/pending_closures4918worker1 # [ 106.812791] nix-grpc-daemon[1194]: time=2026-09-20T08:05:24.637Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4919worker1 # [ 106.814693] nix-grpc-daemon[1194]: time=2026-09-20T08:05:24.637Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"4920lb # [ 105.417877] niks3-server[979]: 2026/09/20 08:05:24 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4921lb # [ 105.427883] niks3-server[979]: 2026/09/20 08:05:24 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst4922lb # [ 105.436604] niks3-server[979]: 2026/09/20 08:05:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4923lb # [ 105.438509] niks3-server[979]: 2026/09/20 08:05:24 INFO Signed narinfos id=30 count=14924worker1 # [ 106.851420] nix-grpc-daemon[1194]: time=2026-09-20T08:05:24.677Z level=INFO msg="Uploading 1 narinfos"4925lb # [ 105.444503] niks3-server[979]: 2026/09/20 08:05:24 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls4926lb # [ 105.455092] niks3-server[979]: 2026/09/20 08:05:24 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4927lb # [ 105.459782] niks3-server[979]: 2026/09/20 08:05:24 INFO Completed upload id=304928worker1 # [ 106.870783] nix-grpc-daemon[1194]: time=2026-09-20T08:05:24.697Z level=INFO msg="Upload complete. (333ms)"4929lb # [ 105.461775] niks3-server[979]: 2026/09/20 08:05:24 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo4930worker1 # [ 106.878551] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43798 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=14931worker1 # [ 106.891068] nix-daemon[881]: reaped child process 1289, status = succeeded4932client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&2, in 7.64 seconds)4933client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath4934client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath, in 0.28 seconds)4935worker2 # [ 107.389300] systemd[1]: Listening on Nix worker-protocol over gRPC.4936worker2 # [ 107.401911] systemd[1]: Starting Nix worker-protocol over gRPC...4937worker2 # [ 107.616978] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4938worker2 # [ 107.621023] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14939worker2 # [ 107.631880] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4940worker2 # [ 107.643613] systemd[1]: Started Nix worker-protocol over gRPC.4941lb: must succeed: curl -sf localhost:9901/clusters4942worker2 # [ 107.665014] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:25Z level=info event=scheduler_connected addr=lb:500514943worker1 # [ 107.607342] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:25Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04944lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4945worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4946worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)4947lb: must succeed: curl -sf localhost:9901/clusters4948lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4949lb: must succeed: curl -sf localhost:9901/clusters4950lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4951worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4952worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.11 seconds)4953(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.80 seconds)4954subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise4955client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs4956client # [ 108.089870] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.4957client # Running as unit: rs.service; invocation ID: cda6972181c44de1adb4e59dcb81599b4958client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)4959client # [ 108.394267] nix[1236]: don't know how to build these paths:4960worker1 # [ 108.405757] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:437984961client # [ 108.396825] nix[1236]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv4962worker1 # [ 108.422416] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:26Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=04963worker1 # [ 108.426365] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:26Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=14964worker1 # [ 108.471906] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437984965worker1 # [ 108.493462] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437984966client # [ 108.496743] nix[1236]: copying 1 paths to 'lb:50051'...4967client # [ 108.497710] nix[1236]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...4968worker1 # [ 108.509891] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437984969worker1 # [ 108.530237] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4970worker1 # [ 108.724223] nix-daemon[881]: accepted connection from pid 1324, user nix-grpc-daemon (trusted)4971worker1 # [ 108.751573] nix-daemon[881]: reaped child process 1327, status = succeeded4972worker1 # [ 108.960244] nix-daemon[881]: accepted connection from pid 1329, user nix-grpc-daemon (trusted)4973worker1 # [ 108.986353] nix-daemon[881]: reaped child process 1332, status = succeeded4974lb # [ 107.590574] niks3-server[979]: 2026/09/20 08:05:26 INFO Received uploads request method=POST path=/api/pending_closures4975worker1 # [ 109.015252] nix-grpc-daemon[1194]: time=2026-09-20T08:05:26.841Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4976worker1 # [ 109.018061] nix-grpc-daemon[1194]: time=2026-09-20T08:05:26.841Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"4977lb # [ 107.622154] niks3-server[979]: 2026/09/20 08:05:26 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst4978lb # [ 107.632977] niks3-server[979]: 2026/09/20 08:05:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4979worker1 # [ 109.048656] nix-grpc-daemon[1194]: time=2026-09-20T08:05:26.875Z level=INFO msg="Uploading 1 narinfos"4980lb # [ 107.640365] niks3-server[979]: 2026/09/20 08:05:26 INFO Signed narinfos id=31 count=14981lb # [ 107.643828] niks3-server[979]: 2026/09/20 08:05:26 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls4982lb # [ 107.650356] niks3-server[979]: 2026/09/20 08:05:26 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete4983lb # [ 107.658070] niks3-server[979]: 2026/09/20 08:05:26 INFO Completed upload id=314984worker1 # [ 109.068439] nix-grpc-daemon[1194]: time=2026-09-20T08:05:26.895Z level=INFO msg="Upload complete. (521ms)"4985lb # [ 107.662890] niks3-server[979]: 2026/09/20 08:05:26 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo4986worker1 # [ 109.074957] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43798 duration_s=0 paths=1 nar_bytes_in=4164987worker1 # [ 109.080474] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437984988worker1 # [ 109.091641] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4989worker1 # [ 109.096995] nix-daemon[881]: reaped child process 1322, status = succeeded4990worker1 # [ 109.109088] nix-daemon[881]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4991client # [ 109.093836] nix[1236]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...4992lb: must succeed: curl -sf localhost:9901/clusters4993lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4994lb: must succeed: curl -sf localhost:9901/clusters4995lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4996lb: must succeed: curl -sf localhost:9901/clusters4997lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4998lb: must succeed: curl -sf localhost:9901/clusters4999lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5000worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5001worker2 # [ 111.154508] systemd-journald[285]: Received client request to rotate journal, rotating.5002worker2 # [ 111.179419] systemd-journald[285]: Vacuuming done, freed 0B of archived journals from /var/log/journal/ddaa6140d97a4b4598da1c0dbea50562.5003worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5004worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5005worker1 # [ 111.176551] systemd[1]: Stopping Nix worker-protocol over gRPC...5006worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.07 seconds)5007client: must succeed: sleep 5.05008lb # [ 110.465072] envoy[872]: conn peer=[2001:db8:1::1]:44350 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9484 tx=3813 ms=73075009worker1 # [ 112.098964] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:29Z level=info event=draining5010client: (finished: must succeed: sleep 5.0, in 5.07 seconds)5011worker1 # [ 116.547893] nix-daemon[881]: reaped child process 1336, status = succeeded5012worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5013worker1 # [ 116.745216] nix-daemon[881]: accepted connection from pid 1376, user nix-grpc-daemon (trusted)5014worker1 # [ 116.775045] nix-daemon[881]: reaped child process 1379, status = succeeded5015lb # [ 115.381032] niks3-server[979]: 2026/09/20 08:05:34 INFO Received uploads request method=POST path=/api/pending_closures5016worker1 # [ 116.801744] nix-grpc-daemon[1194]: time=2026-09-20T08:05:34.627Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5017worker1 # [ 116.808565] nix-grpc-daemon[1194]: time=2026-09-20T08:05:34.630Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5018lb # [ 115.417441] niks3-server[979]: 2026/09/20 08:05:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5019worker1 # [ 116.832702] nix-grpc-daemon[1194]: time=2026-09-20T08:05:34.659Z level=INFO msg="Uploading 1 narinfos"5020lb # [ 115.425597] niks3-server[979]: 2026/09/20 08:05:34 INFO Signed narinfos id=32 count=15021lb # [ 115.429265] niks3-server[979]: 2026/09/20 08:05:34 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5022lb # [ 115.436146] niks3-server[979]: 2026/09/20 08:05:34 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5023lb # [ 115.444539] niks3-server[979]: 2026/09/20 08:05:34 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5024worker1 # [ 116.861442] nix-grpc-daemon[1194]: time=2026-09-20T08:05:34.688Z level=INFO msg="Upload complete. (332ms)"5025lb # [ 115.452819] niks3-server[979]: 2026/09/20 08:05:34 INFO Completed upload id=325026lb # [ 115.458318] niks3-server[979]: 2026/09/20 08:05:34 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5027worker1 # [ 116.873039] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43798 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15028worker1 # [ 116.885728] nix-daemon[881]: reaped child process 1334, status = succeeded5029lb # [ 115.475164] niks3-server[979]: 2026/09/20 08:05:34 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5030client # [ 116.915663] systemd[1]: rs.service: Deactivated successfully.5031client # [ 116.920868] systemd[1]: rs.service: Consumed 193ms CPU time over 8.830s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5032worker1 # [ 117.100713] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:34Z level=info event=signal_exit5033worker1 # [ 117.325133] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:35Z level=info event=scheduler_yield5034lb # [ 115.915608] niks3-server[979]: 2026/09/20 08:05:35 INFO lead: released remote=192.168.1.3:507585035worker2 # [ 117.391383] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:35Z level=info event=scheduler_restarting addr=lb:500515036worker1 # [ 117.336243] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:437865037worker1 # [ 117.343375] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:35Z level=info event=worker_gone addr=192.168.1.4:500515038worker1 # [ 117.352544] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:35Z level=info event=scheduler_restarting addr=lb:500515039worker1 # [ 117.357116] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:437865040worker1 # [ 117.361873] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:35Z level=info event=worker_gone addr=192.168.1.3:500515041worker2 # [ 117.591508] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:35Z level=info event=scheduler_connected addr=lb:500515042worker1 # [ 117.544346] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:35Z level=info event=scheduler_connected addr=lb:500515043worker2 # [ 117.604280] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5044worker1 # [ 117.559673] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5045lb # [ 116.174171] niks3-server[979]: 2026/09/20 08:05:35 INFO lead: acquired remote=192.168.1.4:568925046worker2 # [ 117.648799] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:35Z level=info event=scheduler_take_over5047worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.14 seconds)5048client: waiting for success: ! systemctl is-active rs5049worker2 # [ 117.805378] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:35Z level=info event=scheduler_connected addr=lb:500515050worker2 # [ 117.808886] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05051worker1 # [ 117.761113] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:35Z level=info event=scheduler_connected addr=lb:500515052worker1 # [ 117.769431] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5053client: (finished: waiting for success: ! systemctl is-active rs, in 0.08 seconds)5054client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5055client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.07 seconds)5056client: must fail: journalctl -u rs | grep -q 'reconnecting'5057client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5058lb: must succeed: curl -sf localhost:9901/clusters5059lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5060worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5061worker2 # [ 118.033498] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=0 running=05062worker1 # [ 117.972667] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:35Z level=info event=scheduler_connected addr=lb:500515063worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5064(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 10.00 seconds)5065subtest: scheduler restart mid-build: build finishes, no double build5066client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5067client # [ 118.081966] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5068client # Running as unit: mid.service; invocation ID: 9105fc73434d42a7b940130e4c69625e5069client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.08 seconds)5070worker1 # [ 118.332246] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:36Z level=info event=scheduler_restarting5071worker2 # [ 118.412524] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:534265072worker2 # [ 118.415386] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:36Z level=info event=worker_gone addr=192.168.1.3:500515073worker2 # [ 118.435468] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:534345074worker1 # [ 118.373701] nix-grpc-daemon[1110]: ts=2026-09-20T08:05:36Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5075worker2 # [ 118.444989] nix-daemon[916]: accepted connection from pid 1344, user nix-grpc-daemon (trusted)5076client # [ 118.383841] nix[1272]: don't know how to build these paths:5077client # [ 118.385627] nix[1272]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5078worker1 # [ 118.401131] nix-grpc-daemon[1110]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5079worker1 # [ 118.405472] nix-grpc-daemon[1110]: E0000 00:00:1789891536.227574 1153 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5080worker1 # [ 118.412583] nix-daemon[881]: reaped child process 1185, status = succeeded5081worker1 # [ 119.160240] nix-grpc-daemon[1110]: E0000 00:00:1789891536.986075 1153 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5082worker1 # [ 119.206001] nix-grpc-daemon[1110]: E0000 00:00:1789891537.032564 1153 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5083client # [ 119.783494] nix[1272]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5084worker1 # [ 119.823915] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5085worker1 # [ 119.831345] systemd[1]: Stopped Nix worker-protocol over gRPC.5086worker1 # [ 119.836636] systemd[1]: nix-grpc-daemon.service: Consumed 2.212s CPU time over 27.097s wall clock time, 33.8M memory peak, 48K incoming IP traffic, 94.7K outgoing IP traffic.5087worker1 # [ 119.856875] systemd[1]: Starting Nix worker-protocol over gRPC...5088worker1 # [ 120.066826] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5089worker1 # [ 120.070723] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15090worker1 # [ 120.080907] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5091worker1 # [ 120.083138] systemd[1]: Started Nix worker-protocol over gRPC.5092worker1 # [ 120.104551] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:37Z level=info event=scheduler_connected addr=lb:500515093worker2 # [ 120.169205] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:37Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05094worker2 # [ 120.369352] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:38Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05095worker2 # [ 120.373812] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:38Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15096worker2 # [ 120.417163] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534345097worker2 # [ 120.428900] nix-grpc-daemon[1344]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)5098worker2 # [ 120.474095] nix-grpc-daemon[1344]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 132 ms (attempt 2/5)5099worker2 # [ 120.611458] nix-grpc-daemon[1344]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 305 ms (attempt 3/5)5100worker2 # [ 120.922073] nix-grpc-daemon[1344]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 505 ms (attempt 4/5)5101worker2 # [ 121.429023] nix-grpc-daemon[1344]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5102worker2 # [ 121.448165] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534345103client # [ 121.385466] nix[1272]: copying 1 paths to 'lb:50051'...5104worker2 # [ 121.466792] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534345105client # [ 121.392430] nix[1272]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5106worker2 # [ 121.481374] nix-daemon[916]: accepted connection from pid 1344, user nix-grpc-daemon (trusted)5107worker2 # [ 121.502396] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:39Z level=info event=niks3_push_started pid=14655108lb # [ 120.465859] envoy[872]: conn peer=[2001:db8:1::1]:45016 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2927 tx=1349 ms=84915109worker2 # [ 121.942387] nix-daemon[916]: accepted connection from pid 1478, user nix-grpc-daemon (trusted)5110worker2 # [ 121.966945] nix-daemon[916]: reaped child process 1485, status = succeeded5111worker2 # [ 122.191534] nix-daemon[916]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5112worker2 # [ 122.217277] nix-daemon[916]: reaped child process 1490, status = succeeded5113lb # [ 120.473573] envoy[872]: conn peer=[2001:db8:1::3]:47554 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4162 tx=1370 ms=252465114lb # [ 120.760251] niks3-server[979]: 2026/09/20 08:05:39 INFO Received uploads request method=POST path=/api/pending_closures5115worker2 # [ 122.248685] nix-grpc-daemon[1465]: time=2026-09-20T08:05:40.033Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5116worker2 # [ 122.251074] nix-grpc-daemon[1465]: time=2026-09-20T08:05:40.034Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5117lb # [ 120.820377] niks3-server[979]: 2026/09/20 08:05:40 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5118worker2 # [ 122.301907] nix-grpc-daemon[1465]: time=2026-09-20T08:05:40.087Z level=INFO msg="Uploading 1 narinfos"5119lb # [ 120.840309] niks3-server[979]: 2026/09/20 08:05:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5120lb # [ 120.843939] niks3-server[979]: 2026/09/20 08:05:40 INFO Signed narinfos id=33 count=15121lb # [ 120.853755] niks3-server[979]: 2026/09/20 08:05:40 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5122lb # [ 120.860303] niks3-server[979]: 2026/09/20 08:05:40 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5123lb # [ 120.874560] niks3-server[979]: 2026/09/20 08:05:40 INFO Completed upload id=335124worker2 # [ 122.346885] nix-grpc-daemon[1465]: time=2026-09-20T08:05:40.133Z level=INFO msg="Upload complete. (640ms)"5125lb # [ 120.882918] niks3-server[979]: 2026/09/20 08:05:40 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5126worker2 # [ 122.353458] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53434 duration_s=0 paths=1 nar_bytes_in=4245127worker2 # [ 122.365296] nix-grpc-daemon[1344]: ts=2026-09-20T08:05:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534345128worker2 # [ 122.377181] nix-daemon[916]: accepted connection from pid 1344, user nix-grpc-daemon (trusted)5129worker2 # [ 122.381679] nix-daemon[916]: reaped child process 1463, status = succeeded5130worker2 # [ 122.391828] nix-daemon[916]: accepted connection from pid 1344, user nix-grpc-daemon (trusted)5131client # [ 122.316968] nix[1272]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5132lb: must succeed: curl -sf localhost:9901/clusters5133lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5134lb: must succeed: curl -sf localhost:9901/clusters5135lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5136worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5137worker2 # [ 124.646489] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1344 (nix-grpc-daemon) on client request.5138worker2 # [ 124.648726] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5139lb # [ 123.192777] niks3-server[979]: 2026/09/20 08:05:42 INFO lead: released remote=192.168.1.4:568925140client # [ 124.589339] nix[1272]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5141worker1 # [ 124.605080] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5142client # [ 124.599349] nix[1272]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5143worker2 # [ 124.694352] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5144worker2 # [ 124.702972] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5145worker2 # [ 124.705507] systemd[1]: nix-grpc-daemon.service: Consumed 654ms CPU time over 17.293s wall clock time, 31.5M memory peak, 12.8K incoming IP traffic, 19.5K outgoing IP traffic.5146worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.12 seconds)5147client: must succeed: sleep 5.05148worker2 # [ 124.730588] nix-daemon[916]: reaped child process 1492, status = succeeded5149worker2 # [ 124.731918] nix-daemon[916]: reaped child process 1448, status = succeeded5150worker2 # [ 124.744685] nix-daemon[1494]: unexpected Nix daemon error: error: interrupted by the user5151worker2 # [ 124.753593] nix-daemon[916]: reaped child process 1494, status = failed with exit code 15152worker2 # [ 124.820885] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5153worker2 # [ 124.829114] systemd[1]: Starting Nix worker-protocol over gRPC...5154worker1 # [ 124.803306] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:42Z level=info event=scheduler_connected addr=lb:500515155worker2 # [ 125.055529] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5156worker2 # [ 125.058066] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15157worker2 # [ 125.068121] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5158worker2 # [ 125.086952] systemd[1]: Started Nix worker-protocol over gRPC.5159worker2 # [ 125.088521] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:42Z level=info event=scheduler_take_over5160lb # [ 123.618517] niks3-server[979]: 2026/09/20 08:05:42 INFO lead: acquired remote=192.168.1.4:451385161worker2 # [ 125.101931] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:42Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05162worker2 # [ 125.109635] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:42Z level=info event=scheduler_connected addr=lb:500515163worker2 # [ 125.112587] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:42Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05164worker2 # [ 125.177717] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:42Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05165worker2 # [ 125.180292] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:42Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15166worker1 # [ 125.176728] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331445167worker1 # [ 125.189313] nix-daemon[881]: accepted connection from pid 1394, user nix-grpc-daemon (trusted)5168worker1 # [ 125.211585] nix-grpc-daemon[1394]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 1/5)5169worker1 # [ 125.277688] nix-grpc-daemon[1394]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 176 ms (attempt 2/5)5170worker1 # [ 125.459581] nix-grpc-daemon[1394]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 248 ms (attempt 3/5)5171worker1 # [ 125.708451] nix-grpc-daemon[1394]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 208 ms (attempt 4/5)5172worker1 # [ 125.920221] nix-grpc-daemon[1394]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5173worker1 # [ 125.939551] nix-grpc-daemon[1394]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5174worker1 # [ 125.960132] nix-daemon[881]: accepted connection from pid 1394, user nix-grpc-daemon (trusted)5175client # [ 125.959307] nix[1272]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5176worker1 # [ 125.972291] nix-daemon[881]: accepted connection from pid 1394, user nix-grpc-daemon (trusted)5177client: (finished: must succeed: sleep 5.0, in 5.08 seconds)5178client: waiting for success: ! systemctl is-active mid5179worker1 # [ 130.205175] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:48Z level=info event=niks3_push_started pid=14955180worker1 # [ 130.270374] nix-daemon[881]: reaped child process 1471, status = succeeded5181worker1 # [ 130.695295] nix-daemon[881]: accepted connection from pid 1508, user nix-grpc-daemon (trusted)5182worker1 # [ 130.722244] nix-daemon[881]: reaped child process 1511, status = succeeded5183lb # [ 129.330774] niks3-server[979]: 2026/09/20 08:05:48 INFO Received uploads request method=POST path=/api/pending_closures5184worker1 # [ 130.748719] nix-grpc-daemon[1495]: time=2026-09-20T08:05:48.573Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5185worker1 # [ 130.750728] nix-grpc-daemon[1495]: time=2026-09-20T08:05:48.573Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5186lb # [ 129.384806] niks3-server[979]: 2026/09/20 08:05:48 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5187worker1 # [ 130.808386] nix-grpc-daemon[1495]: time=2026-09-20T08:05:48.633Z level=INFO msg="Uploading 1 narinfos"5188lb # [ 129.399137] niks3-server[979]: 2026/09/20 08:05:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5189lb # [ 129.406854] niks3-server[979]: 2026/09/20 08:05:48 INFO Signed narinfos id=34 count=15190lb # [ 129.413168] niks3-server[979]: 2026/09/20 08:05:48 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5191lb # [ 129.430668] niks3-server[979]: 2026/09/20 08:05:48 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5192worker1 # [ 130.850849] nix-grpc-daemon[1495]: time=2026-09-20T08:05:48.677Z level=INFO msg="Upload complete. (356ms)"5193lb # [ 129.442022] niks3-server[979]: 2026/09/20 08:05:48 INFO Completed upload id=345194worker1 # [ 130.857957] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33144 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15195worker1 # [ 130.866188] nix-grpc-daemon[1495]: time=2026-09-20T08:05:48.682Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls error="server returned 404: object is not pending upload\n"5196worker1 # [ 130.874565] nix-grpc-daemon[1495]: time=2026-09-20T08:05:48.689Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5197worker1 # [ 130.878088] nix-daemon[881]: reaped child process 1469, status = succeeded5198client # [ 130.907985] systemd[1]: mid.service: Deactivated successfully.5199client # [ 130.912481] systemd[1]: mid.service: Consumed 205ms CPU time over 12.830s wall clock time, 39.2M memory peak, 10.1K incoming IP traffic, 11.2K outgoing IP traffic.5200client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5201client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5202client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)5203(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 13.26 seconds)5204subtest: interrupting the client stops the build on the worker5205client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5206client # [ 131.332210] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5207client # Running as unit: intr.service; invocation ID: 0a4cd164619148afb268b5302e6ab56e5208client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5209worker2 # [ 131.703672] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:585125210worker2 # [ 131.719553] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5211client # [ 131.667500] nix[1308]: don't know how to build these paths:5212client # [ 131.670255] nix[1308]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5213worker2 # [ 131.762712] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:49Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05214worker2 # [ 131.765759] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:49Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15215worker2 # [ 131.812945] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585125216worker2 # [ 131.824257] nix-grpc-daemon[1530]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 1/5)5217worker2 # [ 131.881665] nix-grpc-daemon[1530]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 2/5)5218lb # [ 130.467309] envoy[872]: conn peer=[2001:db8:1::4]:58880 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=786 tx=389 ms=170095219lb # [ 130.470682] envoy[872]: conn peer=[2001:db8:1::1]:53932 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4058 tx=1827 ms=125145220worker2 # [ 131.967696] nix-grpc-daemon[1530]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 356 ms (attempt 3/5)5221worker2 # [ 132.324146] nix-grpc-daemon[1530]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 477 ms (attempt 4/5)5222worker2 # [ 132.810588] nix-grpc-daemon[1530]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5223worker2 # [ 132.835890] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585125224client # [ 132.781345] nix[1308]: copying 1 paths to 'lb:50051'...5225worker2 # [ 132.856161] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585125226client # [ 132.784726] nix[1308]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5227worker2 # [ 132.879185] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5228worker2 # [ 132.951913] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:50Z level=info event=niks3_push_started pid=16065229worker2 # [ 133.412197] nix-daemon[916]: accepted connection from pid 1619, user nix-grpc-daemon (trusted)5230worker2 # [ 133.434943] nix-daemon[916]: reaped child process 1622, status = succeeded5231worker2 # [ 133.641280] nix-daemon[916]: accepted connection from pid 1624, user nix-grpc-daemon (trusted)5232worker2 # [ 133.667302] nix-daemon[916]: reaped child process 1627, status = succeeded5233lb # [ 132.215158] niks3-server[979]: 2026/09/20 08:05:51 INFO Received uploads request method=POST path=/api/pending_closures5234worker2 # [ 133.703264] nix-grpc-daemon[1606]: time=2026-09-20T08:05:51.487Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5235worker2 # [ 133.705589] nix-grpc-daemon[1606]: time=2026-09-20T08:05:51.487Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5236lb # [ 132.265217] niks3-server[979]: 2026/09/20 08:05:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5237worker2 # [ 133.739845] nix-grpc-daemon[1606]: time=2026-09-20T08:05:51.526Z level=INFO msg="Uploading 1 narinfos"5238lb # [ 132.271488] niks3-server[979]: 2026/09/20 08:05:51 INFO Signed narinfos id=35 count=15239lb # [ 132.278552] niks3-server[979]: 2026/09/20 08:05:51 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5240lb # [ 132.290236] niks3-server[979]: 2026/09/20 08:05:51 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5241lb # [ 132.299541] niks3-server[979]: 2026/09/20 08:05:51 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5242lb # [ 132.303780] niks3-server[979]: 2026/09/20 08:05:51 INFO Completed upload id=355243worker2 # [ 133.774621] nix-grpc-daemon[1606]: time=2026-09-20T08:05:51.561Z level=INFO msg="Upload complete. (551ms)"5244lb # [ 132.307350] niks3-server[979]: 2026/09/20 08:05:51 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5245worker2 # [ 133.785428] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=0 paths=1 nar_bytes_in=4245246worker2 # [ 133.793412] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585125247worker2 # [ 133.806547] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5248worker2 # [ 133.815541] nix-daemon[916]: reaped child process 1604, status = succeeded5249client # [ 133.757821] nix[1308]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5250worker2 # [ 133.837140] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5251client: must succeed: systemctl kill -s INT intr5252worker2 # [ 136.261666] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:54Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5253client # [ 136.184956] systemd[1]: intr.service: Sent signal SIGINT to main process 1308 (nix) on client request.5254client # [ 136.198204] nix[1308]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5255client: (finished: must succeed: systemctl kill -s INT intr, in 0.09 seconds)5256client # [ 136.211507] nix[1308]: error: interrupted by the user5257client # [ 136.253200] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5258client # [ 136.257878] systemd[1]: intr.service: Failed with result 'exit-code'.5259client # [ 136.260333] systemd[1]: intr.service: Consumed 188ms CPU time over 4.924s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.5260worker2 # [ 136.475960] nix-daemon[1634]: unexpected Nix daemon error: error: interrupted by the user5261worker2 # [ 136.481806] nix-daemon[916]: reaped child process 1632, status = succeeded5262worker2 # [ 136.489513] nix-daemon[916]: reaped child process 1634, status = failed with exit code 15263(finished: subtest: interrupting the client stops the build on the worker, in 6.26 seconds)5264subtest: a deploy mid-build drains: the build finishes, the new generation takes over5265client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5266client # [ 137.638956] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5267client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.12 seconds)5268worker1 # [ 137.932961] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:331445269client # Running as unit: sw.service; invocation ID: e52c717d81ec4a8f9fbbfdf1140107325270client # [ 137.931318] nix[1328]: don't know how to build these paths:5271client # [ 137.934297] nix[1328]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5272worker2 # [ 138.025012] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:55Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05273worker2 # [ 138.029300] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:55Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15274worker1 # [ 138.014966] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331445275worker1 # [ 138.038687] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331445276client # [ 138.039162] nix[1328]: copying 1 paths to 'lb:50051'...5277client # [ 138.043769] nix[1328]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5278worker1 # [ 138.058346] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:331445279worker1 # [ 138.069992] nix-daemon[881]: accepted connection from pid 1394, user nix-grpc-daemon (trusted)5280worker1 # [ 138.305345] nix-daemon[881]: accepted connection from pid 1547, user nix-grpc-daemon (trusted)5281worker1 # [ 138.331158] nix-daemon[881]: reaped child process 1550, status = succeeded5282worker1 # [ 138.547485] nix-daemon[881]: accepted connection from pid 1552, user nix-grpc-daemon (trusted)5283worker1 # [ 138.574948] nix-daemon[881]: reaped child process 1555, status = succeeded5284lb # [ 137.173241] niks3-server[979]: 2026/09/20 08:05:56 INFO Received uploads request method=POST path=/api/pending_closures5285worker1 # [ 138.589918] nix-grpc-daemon[1495]: time=2026-09-20T08:05:56.416Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5286worker1 # [ 138.593248] nix-grpc-daemon[1495]: time=2026-09-20T08:05:56.419Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5287lb # [ 137.215641] niks3-server[979]: 2026/09/20 08:05:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5288lb # [ 137.224263] niks3-server[979]: 2026/09/20 08:05:56 INFO Signed narinfos id=36 count=15289worker1 # [ 138.635408] nix-grpc-daemon[1495]: time=2026-09-20T08:05:56.461Z level=INFO msg="Uploading 1 narinfos"5290lb # [ 137.229617] niks3-server[979]: 2026/09/20 08:05:56 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5291lb # [ 137.235973] niks3-server[979]: 2026/09/20 08:05:56 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5292lb # [ 137.242439] niks3-server[979]: 2026/09/20 08:05:56 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5293lb # [ 137.257097] niks3-server[979]: 2026/09/20 08:05:56 INFO Completed upload id=365294worker1 # [ 138.667975] nix-grpc-daemon[1495]: time=2026-09-20T08:05:56.494Z level=INFO msg="Upload complete. (584ms)"5295lb # [ 137.259614] niks3-server[979]: 2026/09/20 08:05:56 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5296worker1 # [ 138.676181] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33144 duration_s=0 paths=1 nar_bytes_in=4165297worker1 # [ 138.686527] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331445298worker1 # [ 138.692926] nix-daemon[881]: accepted connection from pid 1394, user nix-grpc-daemon (trusted)5299worker1 # [ 138.697680] nix-daemon[881]: reaped child process 1545, status = succeeded5300worker1 # [ 138.708218] nix-daemon[881]: accepted connection from pid 1394, user nix-grpc-daemon (trusted)5301client # [ 138.692989] nix[1328]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5302worker1: must succeed: systemctl reload nix-grpc-daemon.service5303worker1 # [ 140.377730] systemd[1]: Reloading Nix worker-protocol over gRPC...5304worker1 # [ 140.432007] systemd[1]: Reloaded Nix worker-protocol over gRPC.5305worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.13 seconds)5306worker1: must succeed: pgrep -f 'read -t [9]0 x'5307worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.07 seconds)5308client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&25309worker2 # [ 140.886741] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:585125310client # don't know how to build these paths:5311client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5312worker2 # [ 140.914556] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:58Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05313worker2 # [ 140.919740] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:58Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15314worker2 # [ 140.972296] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585125315worker2 # [ 140.991207] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585125316client # copying 1 paths to 'lb:50051'...5317client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5318worker2 # [ 141.009293] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585125319worker2 # [ 141.024155] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5320worker1 # [ 141.100573] nix-grpc-daemon[1394]: ts=2026-09-20T08:05:58Z level=info event=draining5321worker2 # [ 141.251655] nix-daemon[916]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)5322worker2 # [ 141.276613] nix-daemon[916]: reaped child process 1692, status = succeeded5323worker2 # [ 141.473410] nix-daemon[916]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5324worker2 # [ 141.496797] nix-daemon[916]: reaped child process 1697, status = succeeded5325lb # [ 140.039821] niks3-server[979]: 2026/09/20 08:05:59 INFO Received uploads request method=POST path=/api/pending_closures5326worker2 # [ 141.517633] nix-grpc-daemon[1606]: time=2026-09-20T08:05:59.303Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5327worker2 # [ 141.519447] nix-grpc-daemon[1606]: time=2026-09-20T08:05:59.303Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5328lb # [ 140.059720] niks3-server[979]: 2026/09/20 08:05:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5329worker2 # [ 141.534254] nix-grpc-daemon[1606]: time=2026-09-20T08:05:59.320Z level=INFO msg="Uploading 1 narinfos"5330lb # [ 140.065308] niks3-server[979]: 2026/09/20 08:05:59 INFO Signed narinfos id=37 count=15331lb # [ 140.068317] niks3-server[979]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5332lb # [ 140.074557] niks3-server[979]: 2026/09/20 08:05:59 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5333lb # [ 140.079896] niks3-server[979]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5334lb # [ 140.082931] niks3-server[979]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5335lb # [ 140.086042] niks3-server[979]: 2026/09/20 08:05:59 INFO Completed upload id=375336worker2 # [ 141.556613] nix-grpc-daemon[1606]: time=2026-09-20T08:05:59.343Z level=INFO msg="Upload complete. (520ms)"5337worker2 # [ 141.561960] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=0 paths=1 nar_bytes_in=5285338worker2 # [ 141.568744] nix-grpc-daemon[1530]: ts=2026-09-20T08:05:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585125339worker2 # [ 141.578543] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5340worker2 # [ 141.582873] nix-daemon[916]: reaped child process 1687, status = succeeded5341client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5342client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5343worker2 # [ 141.595703] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5344lb # [ 140.467895] envoy[872]: conn peer=[2001:db8:1::1]:34330 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2931 tx=757 ms=46125345client # farm-a> LOG-farm-a-during-drain5346worker2 # [ 143.059587] nix-daemon[916]: reaped child process 1701, status = succeeded5347worker2 # [ 143.235063] nix-daemon[916]: accepted connection from pid 1716, user nix-grpc-daemon (trusted)5348worker2 # [ 143.259309] nix-daemon[916]: reaped child process 1719, status = succeeded5349lb # [ 141.802719] niks3-server[979]: 2026/09/20 08:06:01 INFO Received uploads request method=POST path=/api/pending_closures5350worker2 # [ 143.284646] nix-grpc-daemon[1606]: time=2026-09-20T08:06:01.067Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5351worker2 # [ 143.286371] nix-grpc-daemon[1606]: time=2026-09-20T08:06:01.067Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5352lb # [ 141.830196] niks3-server[979]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5353lb # [ 141.841062] niks3-server[979]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5354lb # [ 141.852310] niks3-server[979]: 2026/09/20 08:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5355lb # [ 141.854887] niks3-server[979]: 2026/09/20 08:06:01 INFO Signed narinfos id=38 count=15356worker2 # [ 143.328777] nix-grpc-daemon[1606]: time=2026-09-20T08:06:01.114Z level=INFO msg="Uploading 1 narinfos"5357lb # [ 141.862536] niks3-server[979]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5358lb # [ 141.871969] niks3-server[979]: 2026/09/20 08:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5359lb # [ 141.878266] niks3-server[979]: 2026/09/20 08:06:01 INFO Completed upload id=385360worker2 # [ 143.349065] nix-grpc-daemon[1606]: time=2026-09-20T08:06:01.135Z level=INFO msg="Upload complete. (338ms)"5361lb # [ 141.880951] niks3-server[979]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5362worker2 # [ 143.364491] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15363worker2 # [ 143.375831] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:01Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05364worker2 # [ 143.378508] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:01Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15365worker2 # [ 143.381667] nix-daemon[916]: reaped child process 1699, status = succeeded5366worker2 # [ 143.411138] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585125367worker2 # [ 143.424998] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585125368worker2 # [ 143.438821] nix-grpc-daemon[1606]: time=2026-09-20T08:06:01.225Z level=INFO msg="All 1 paths already cached"5369client # copying 1 paths to 'lb:50051'...5370worker2 # [ 143.449311] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585125371client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5372worker2 # [ 143.472514] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5373worker2 # [ 143.715735] nix-daemon[916]: accepted connection from pid 1725, user nix-grpc-daemon (trusted)5374worker2 # [ 143.742399] nix-daemon[916]: reaped child process 1728, status = succeeded5375worker2 # [ 143.949111] nix-daemon[916]: accepted connection from pid 1730, user nix-grpc-daemon (trusted)5376worker2 # [ 143.972113] nix-daemon[916]: reaped child process 1733, status = succeeded5377lb # [ 142.511345] niks3-server[979]: 2026/09/20 08:06:01 INFO Received uploads request method=POST path=/api/pending_closures5378worker2 # [ 143.989276] nix-grpc-daemon[1606]: time=2026-09-20T08:06:01.775Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5379worker2 # [ 143.991033] nix-grpc-daemon[1606]: time=2026-09-20T08:06:01.775Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5380lb # [ 142.538876] niks3-server[979]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5381lb # [ 142.546152] niks3-server[979]: 2026/09/20 08:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5382lb # [ 142.550179] niks3-server[979]: 2026/09/20 08:06:01 INFO Signed narinfos id=39 count=15383worker2 # [ 144.020008] nix-grpc-daemon[1606]: time=2026-09-20T08:06:01.806Z level=INFO msg="Uploading 1 narinfos"5384lb # [ 142.555827] niks3-server[979]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5385lb # [ 142.568278] niks3-server[979]: 2026/09/20 08:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5386lb # [ 142.575773] niks3-server[979]: 2026/09/20 08:06:01 INFO Completed upload id=395387worker2 # [ 144.046421] nix-grpc-daemon[1606]: time=2026-09-20T08:06:01.833Z level=INFO msg="Upload complete. (558ms)"5388lb # [ 142.578278] niks3-server[979]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5389worker2 # [ 144.052449] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=0 paths=1 nar_bytes_in=6405390worker2 # [ 144.061348] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585125391worker2 # [ 144.073234] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5392worker2 # [ 144.078787] nix-daemon[916]: reaped child process 1723, status = succeeded5393client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5394client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5395worker2 # [ 144.093892] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5396client # farm-b> LOG-farm-b-during-drain5397worker2 # [ 144.720460] nix-daemon[916]: reaped child process 1737, status = succeeded5398worker2 # [ 144.891960] nix-daemon[916]: accepted connection from pid 1752, user nix-grpc-daemon (trusted)5399worker2 # [ 144.917409] nix-daemon[916]: reaped child process 1755, status = succeeded5400lb # [ 143.467217] niks3-server[979]: 2026/09/20 08:06:02 INFO Received uploads request method=POST path=/api/pending_closures5401worker2 # [ 144.947979] nix-grpc-daemon[1606]: time=2026-09-20T08:06:02.733Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5402worker2 # [ 144.949705] nix-grpc-daemon[1606]: time=2026-09-20T08:06:02.733Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5403lb # [ 143.516151] niks3-server[979]: 2026/09/20 08:06:02 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5404lb # [ 143.524176] niks3-server[979]: 2026/09/20 08:06:02 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5405worker2 # [ 145.001052] nix-grpc-daemon[1606]: time=2026-09-20T08:06:02.787Z level=INFO msg="Uploading 1 narinfos"5406lb # [ 143.531795] niks3-server[979]: 2026/09/20 08:06:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5407lb # [ 143.542277] niks3-server[979]: 2026/09/20 08:06:02 INFO Signed narinfos id=40 count=15408lb # [ 143.549635] niks3-server[979]: 2026/09/20 08:06:02 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5409lb # [ 143.559441] niks3-server[979]: 2026/09/20 08:06:02 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5410lb # [ 143.568236] niks3-server[979]: 2026/09/20 08:06:02 INFO Completed upload id=405411worker2 # [ 145.039056] nix-grpc-daemon[1606]: time=2026-09-20T08:06:02.825Z level=INFO msg="Upload complete. (335ms)"5412lb # [ 143.571146] niks3-server[979]: 2026/09/20 08:06:02 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5413worker2 # [ 145.048798] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=0 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15414worker2 # [ 145.059373] nix-daemon[916]: reaped child process 1735, status = succeeded5415worker2 # [ 145.062370] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:02Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05416worker2 # [ 145.065566] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:02Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15417worker2 # [ 145.108393] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585125418worker2 # [ 145.125253] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585125419worker2 # [ 145.139701] nix-grpc-daemon[1606]: time=2026-09-20T08:06:02.926Z level=INFO msg="All 2 paths already cached"5420client # copying 1 paths to 'lb:50051'...5421worker2 # [ 145.150575] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585125422client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5423worker2 # [ 145.176312] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5424worker2 # [ 145.402503] nix-daemon[916]: accepted connection from pid 1761, user nix-grpc-daemon (trusted)5425worker2 # [ 145.425796] nix-daemon[916]: reaped child process 1764, status = succeeded5426worker2 # [ 145.626530] nix-daemon[916]: accepted connection from pid 1766, user nix-grpc-daemon (trusted)5427worker2 # [ 145.649350] nix-daemon[916]: reaped child process 1769, status = succeeded5428lb # [ 144.193099] niks3-server[979]: 2026/09/20 08:06:03 INFO Received uploads request method=POST path=/api/pending_closures5429worker2 # [ 145.674166] nix-grpc-daemon[1606]: time=2026-09-20T08:06:03.460Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5430worker2 # [ 145.676888] nix-grpc-daemon[1606]: time=2026-09-20T08:06:03.463Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5431lb # [ 144.232308] niks3-server[979]: 2026/09/20 08:06:03 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5432worker2 # [ 145.719111] nix-grpc-daemon[1606]: time=2026-09-20T08:06:03.505Z level=INFO msg="Uploading 1 narinfos"5433lb # [ 144.251754] niks3-server[979]: 2026/09/20 08:06:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5434lb # [ 144.263453] niks3-server[979]: 2026/09/20 08:06:03 INFO Signed narinfos id=41 count=15435lb # [ 144.270433] niks3-server[979]: 2026/09/20 08:06:03 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5436lb # [ 144.281600] niks3-server[979]: 2026/09/20 08:06:03 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5437lb # [ 144.290505] niks3-server[979]: 2026/09/20 08:06:03 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5438lb # [ 144.297366] niks3-server[979]: 2026/09/20 08:06:03 INFO Completed upload id=415439worker2 # [ 145.768169] nix-grpc-daemon[1606]: time=2026-09-20T08:06:03.554Z level=INFO msg="Upload complete. (574ms)"5440worker2 # [ 145.776824] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=0 paths=1 nar_bytes_in=7685441worker2 # [ 145.789494] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585125442worker2 # [ 145.801818] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5443worker2 # [ 145.807317] nix-daemon[916]: reaped child process 1759, status = succeeded5444client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5445client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5446worker2 # [ 145.823570] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5447client # farm-top> LOG-farm-top-during-drain5448worker2 # [ 147.452631] nix-daemon[916]: reaped child process 1773, status = succeeded5449worker2 # [ 147.653259] nix-daemon[916]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)5450worker2 # [ 147.676951] nix-daemon[916]: reaped child process 1791, status = succeeded5451lb # [ 146.219498] niks3-server[979]: 2026/09/20 08:06:05 INFO Received uploads request method=POST path=/api/pending_closures5452worker2 # [ 147.700574] nix-grpc-daemon[1606]: time=2026-09-20T08:06:05.486Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5453worker2 # [ 147.702159] nix-grpc-daemon[1606]: time=2026-09-20T08:06:05.486Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5454lb # [ 146.252612] niks3-server[979]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5455lb # [ 146.268255] niks3-server[979]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5456lb # [ 146.279726] niks3-server[979]: 2026/09/20 08:06:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5457worker2 # [ 147.755046] nix-grpc-daemon[1606]: time=2026-09-20T08:06:05.541Z level=INFO msg="Uploading 1 narinfos"5458lb # [ 146.289029] niks3-server[979]: 2026/09/20 08:06:05 INFO Signed narinfos id=42 count=15459lb # [ 146.291198] niks3-server[979]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5460lb # [ 146.300969] niks3-server[979]: 2026/09/20 08:06:05 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5461lb # [ 146.308943] niks3-server[979]: 2026/09/20 08:06:05 INFO Completed upload id=425462worker2 # [ 147.779820] nix-grpc-daemon[1606]: time=2026-09-20T08:06:05.566Z level=INFO msg="Upload complete. (343ms)"5463lb # [ 146.312173] niks3-server[979]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5464worker2 # [ 147.792535] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=2 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15465worker2 # [ 147.805029] nix-daemon[916]: reaped child process 1771, status = succeeded5466client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&2, in 7.28 seconds)5467client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath5468client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath, in 0.29 seconds)5469worker1: must succeed: pkill -f 'read -t [9]0 x'5470worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.07 seconds)5471client: waiting for success: ! systemctl is-active sw5472worker1 # [ 148.374891] nix-daemon[881]: reaped child process 1559, status = succeeded5473worker1 # [ 148.581183] nix-daemon[881]: accepted connection from pid 1599, user nix-grpc-daemon (trusted)5474worker1 # [ 148.607803] nix-daemon[881]: reaped child process 1602, status = succeeded5475lb # [ 147.212092] niks3-server[979]: 2026/09/20 08:06:06 INFO Received uploads request method=POST path=/api/pending_closures5476worker1 # [ 148.678015] nix-grpc-daemon[1495]: time=2026-09-20T08:06:06.503Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5477worker1 # [ 148.680490] nix-grpc-daemon[1495]: time=2026-09-20T08:06:06.503Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5478lb # [ 147.284711] niks3-server[979]: 2026/09/20 08:06:06 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5479lb # [ 147.292184] niks3-server[979]: 2026/09/20 08:06:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5480worker1 # [ 148.703130] nix-grpc-daemon[1495]: time=2026-09-20T08:06:06.529Z level=INFO msg="Uploading 1 narinfos"5481lb # [ 147.296676] niks3-server[979]: 2026/09/20 08:06:06 INFO Signed narinfos id=43 count=15482lb # [ 147.297966] niks3-server[979]: 2026/09/20 08:06:06 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5483lb # [ 147.304923] niks3-server[979]: 2026/09/20 08:06:06 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5484lb # [ 147.311232] niks3-server[979]: 2026/09/20 08:06:06 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5485lb # [ 147.314165] niks3-server[979]: 2026/09/20 08:06:06 INFO Completed upload id=435486worker1 # [ 148.724624] nix-grpc-daemon[1495]: time=2026-09-20T08:06:06.551Z level=INFO msg="Upload complete. (392ms)"5487lb # [ 147.315661] niks3-server[979]: 2026/09/20 08:06:06 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5488worker1 # [ 148.732840] nix-grpc-daemon[1394]: ts=2026-09-20T08:06:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33144 duration_s=10 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15489worker1 # [ 148.743061] nix-daemon[881]: reaped child process 1557, status = succeeded5490client # [ 148.767432] systemd[1]: sw.service: Deactivated successfully.5491client # [ 148.773660] systemd[1]: sw.service: Consumed 194ms CPU time over 11.132s wall clock time, 37.2M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.5492worker1 # [ 149.103230] nix-grpc-daemon[1394]: ts=2026-09-20T08:06:06Z level=info event=signal_exit5493client: (finished: waiting for success: ! systemctl is-active sw, in 1.15 seconds)5494client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5495client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5496worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5497worker1 # [ 150.333842] nix-grpc-daemon[1394]: ts=2026-09-20T08:06:08Z level=info event=scheduler_restarting5498worker2 # [ 150.392679] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:584905499worker2 # [ 150.393003] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:08Z level=info event=worker_gone addr=192.168.1.3:500515500worker1 # [ 150.358232] nix-grpc-daemon[1394]: ts=2026-09-20T08:06:08Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5501worker1 # [ 150.387518] nix-daemon[881]: reaped child process 1463, status = succeeded5502worker1 # [ 150.901389] nix-grpc-daemon[1394]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5503worker1 # [ 150.906800] nix-grpc-daemon[1394]: E0000 00:00:1789891568.727844 1437 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5504worker1 # [ 150.914031] nix-grpc-daemon[1394]: E0000 00:00:1789891568.728150 1437 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5505lb # [ 150.466941] envoy[872]: conn peer=[2001:db8:1::1]:34352 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9473 tx=3831 ms=69285506lb # [ 150.472588] envoy[872]: conn peer=[2001:db8:1::1]:34346 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2939 tx=1351 ms=108185507lb # [ 150.477796] envoy[872]: conn peer=[2001:db8:1::3]:45966 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=448 ms=302365508worker1 # [ 152.150927] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5509worker1 # [ 152.154316] systemd[1]: nix-grpc-daemon.service: Consumed 1.035s CPU time over 32.292s wall clock time, 30.7M memory peak, 21K incoming IP traffic, 27.3K outgoing IP traffic.5510worker1 # [ 152.176783] systemd[1]: Starting Nix worker-protocol over gRPC...5511worker1 # [ 152.385871] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:10Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5512worker1 # [ 152.387982] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:10Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15513worker1 # [ 152.396099] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5514worker1 # [ 152.398011] systemd[1]: Started Nix worker-protocol over gRPC.5515worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.06 seconds)5516lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5517lb: must succeed: curl -sf localhost:9901/clusters5518worker1 # [ 152.422750] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:10Z level=info event=scheduler_connected addr=lb:500515519worker2 # [ 152.488137] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:10Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05520lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5521lb: must succeed: curl -sf localhost:9901/clusters5522lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5523lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)5524lb: must succeed: curl -sf localhost:9901/clusters5525lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5526worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5527worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5528(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.17 seconds)5529subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5530client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15531worker2 # [ 154.078004] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:585125532worker2 # [ 154.099146] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:11Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05533worker2 # [ 154.105733] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:11Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15534worker2 # [ 154.113221] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:11Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05535worker2 # [ 154.118823] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:11Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05536worker1 # [ 154.095729] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085537worker1 # [ 154.112592] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5538worker1 # [ 154.134979] nix-grpc-daemon[1616]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5)5539worker1 # [ 154.209328] nix-grpc-daemon[1616]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 111 ms (attempt 2/5)5540worker1 # [ 154.328780] nix-grpc-daemon[1616]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 124 ms (attempt 3/5)5541worker1 # [ 154.453469] nix-grpc-daemon[1616]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 4/5)5542worker1 # [ 154.589177] nix-grpc-daemon[1616]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5543worker1 # [ 154.614769] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437085544worker1 # [ 154.632152] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437085545worker1 # [ 154.649475] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5546worker1 # [ 154.683370] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:12Z level=info event=niks3_push_started pid=16725547worker1 # [ 155.128267] nix-daemon[881]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)5548worker1 # [ 155.150223] nix-daemon[881]: reaped child process 1688, status = succeeded5549worker1 # [ 155.346430] nix-daemon[881]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)5550worker1 # [ 155.368998] nix-daemon[881]: reaped child process 1693, status = succeeded5551lb # [ 153.976892] niks3-server[979]: 2026/09/20 08:06:13 INFO Received uploads request method=POST path=/api/pending_closures5552worker1 # [ 155.399594] nix-grpc-daemon[1672]: time=2026-09-20T08:06:13.224Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5553worker1 # [ 155.402893] nix-grpc-daemon[1672]: time=2026-09-20T08:06:13.224Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5554lb # [ 154.019515] niks3-server[979]: 2026/09/20 08:06:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5555lb # [ 154.025094] niks3-server[979]: 2026/09/20 08:06:13 INFO Signed narinfos id=44 count=15556worker1 # [ 155.436141] nix-grpc-daemon[1672]: time=2026-09-20T08:06:13.262Z level=INFO msg="Uploading 1 narinfos"5557lb # [ 154.036117] niks3-server[979]: 2026/09/20 08:06:13 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5558lb # [ 154.217867] niks3-server[979]: 2026/09/20 08:06:13 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5559lb # [ 154.229290] niks3-server[979]: 2026/09/20 08:06:13 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5560lb # [ 154.239016] niks3-server[979]: 2026/09/20 08:06:13 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5561lb # [ 154.245736] niks3-server[979]: 2026/09/20 08:06:13 INFO Completed upload id=445562worker1 # [ 155.656596] nix-grpc-daemon[1672]: time=2026-09-20T08:06:13.483Z level=INFO msg="Upload complete. (722ms)"5563worker1 # [ 155.676594] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=1 paths=1 nar_bytes_in=5125564worker1 # [ 155.692991] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085565worker1 # [ 155.706804] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5566worker1 # [ 155.717915] nix-daemon[881]: reaped child process 1670, status = succeeded5567worker1 # [ 155.737532] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5568worker1 # [ 156.577301] nix-daemon[881]: reaped child process 1697, status = succeeded5569worker1 # [ 156.765444] nix-daemon[881]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)5570worker1 # [ 156.790505] nix-daemon[881]: reaped child process 1715, status = succeeded5571lb # [ 155.397473] niks3-server[979]: 2026/09/20 08:06:14 INFO Received uploads request method=POST path=/api/pending_closures5572worker1 # [ 156.824497] nix-grpc-daemon[1672]: time=2026-09-20T08:06:14.648Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5573worker1 # [ 156.826120] nix-grpc-daemon[1672]: time=2026-09-20T08:06:14.648Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5574lb # [ 155.464365] niks3-server[979]: 2026/09/20 08:06:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5575worker1 # [ 156.882254] nix-grpc-daemon[1672]: time=2026-09-20T08:06:14.708Z level=INFO msg="Uploading 1 narinfos"5576lb # [ 155.477006] niks3-server[979]: 2026/09/20 08:06:14 INFO Signed narinfos id=45 count=15577lb # [ 155.487827] niks3-server[979]: 2026/09/20 08:06:14 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5578lb # [ 155.510771] niks3-server[979]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5579lb # [ 155.524569] niks3-server[979]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5580lb # [ 155.531791] niks3-server[979]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5581lb # [ 155.539763] niks3-server[979]: 2026/09/20 08:06:14 INFO Completed upload id=455582worker1 # [ 156.950305] nix-grpc-daemon[1672]: time=2026-09-20T08:06:14.777Z level=INFO msg="Upload complete. (392ms)"5583lb # [ 155.543520] niks3-server[979]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5584worker2 # [ 157.022504] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:14Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15585worker1 # [ 156.965564] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15586worker2 # [ 157.037449] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:14Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05587worker1 # [ 156.990232] nix-daemon[881]: reaped child process 1695, status = succeeded5588worker1 # [ 157.017246] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085589worker1 # [ 157.037886] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437085590worker1 # [ 157.056440] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437085591worker1 # [ 157.064937] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5592worker1 # [ 157.285997] nix-daemon[881]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)5593worker1 # [ 157.309492] nix-daemon[881]: reaped child process 1722, status = succeeded5594worker1 # [ 157.506971] nix-daemon[881]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5595worker1 # [ 157.529429] nix-daemon[881]: reaped child process 1727, status = succeeded5596lb # [ 156.130931] niks3-server[979]: 2026/09/20 08:06:15 INFO Received uploads request method=POST path=/api/pending_closures5597worker1 # [ 157.551367] nix-grpc-daemon[1672]: time=2026-09-20T08:06:15.377Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5598worker1 # [ 157.553200] nix-grpc-daemon[1672]: time=2026-09-20T08:06:15.377Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5599lb # [ 156.163759] niks3-server[979]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5600lb # [ 156.180272] niks3-server[979]: 2026/09/20 08:06:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5601worker1 # [ 157.596082] nix-grpc-daemon[1672]: time=2026-09-20T08:06:15.422Z level=INFO msg="Uploading 1 narinfos"5602lb # [ 156.192442] niks3-server[979]: 2026/09/20 08:06:15 INFO Signed narinfos id=46 count=15603lb # [ 156.198154] niks3-server[979]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5604lb # [ 156.206158] niks3-server[979]: 2026/09/20 08:06:15 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5605lb # [ 156.212714] niks3-server[979]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5606lb # [ 156.218682] niks3-server[979]: 2026/09/20 08:06:15 INFO Completed upload id=465607worker1 # [ 157.629005] nix-grpc-daemon[1672]: time=2026-09-20T08:06:15.455Z level=INFO msg="Upload complete. (554ms)"5608worker1 # [ 157.639066] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=0 paths=1 nar_bytes_in=5125609worker1 # [ 157.654751] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085610worker1 # [ 157.663062] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5611worker1 # [ 157.669293] nix-daemon[881]: reaped child process 1717, status = succeeded5612worker1 # [ 157.682611] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5613worker1 # [ 158.717902] nix-daemon[881]: reaped child process 1731, status = succeeded5614worker1 # [ 158.898495] nix-daemon[881]: accepted connection from pid 1746, user nix-grpc-daemon (trusted)5615worker1 # [ 158.927394] nix-daemon[881]: reaped child process 1749, status = succeeded5616lb # [ 157.530639] niks3-server[979]: 2026/09/20 08:06:16 INFO Received uploads request method=POST path=/api/pending_closures5617worker1 # [ 158.953475] nix-grpc-daemon[1672]: time=2026-09-20T08:06:16.778Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5618worker1 # [ 158.955382] nix-grpc-daemon[1672]: time=2026-09-20T08:06:16.778Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5619lb # [ 157.584079] niks3-server[979]: 2026/09/20 08:06:16 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5620lb # [ 157.595618] niks3-server[979]: 2026/09/20 08:06:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5621worker1 # [ 159.012865] nix-grpc-daemon[1672]: time=2026-09-20T08:06:16.838Z level=INFO msg="Uploading 1 narinfos"5622lb # [ 157.602082] niks3-server[979]: 2026/09/20 08:06:16 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5623lb # [ 157.608280] niks3-server[979]: 2026/09/20 08:06:16 INFO Signed narinfos id=47 count=15624lb # [ 157.610451] niks3-server[979]: 2026/09/20 08:06:16 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5625lb # [ 157.623152] niks3-server[979]: 2026/09/20 08:06:16 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5626lb # [ 157.631690] niks3-server[979]: 2026/09/20 08:06:16 INFO Completed upload id=475627worker1 # [ 159.041780] nix-grpc-daemon[1672]: time=2026-09-20T08:06:16.868Z level=INFO msg="Upload complete. (344ms)"5628lb # [ 157.633971] niks3-server[979]: 2026/09/20 08:06:16 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5629worker2 # [ 159.111462] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:16Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15630worker1 # [ 159.053416] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15631worker2 # [ 159.126546] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:16Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05632worker1 # [ 159.073782] nix-daemon[881]: reaped child process 1729, status = succeeded5633worker1 # [ 159.107834] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085634worker1 # [ 159.122400] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437085635worker1 # [ 159.138603] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437085636worker1 # [ 159.150195] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5637worker1 # [ 159.369613] nix-daemon[881]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)5638worker1 # [ 159.393132] nix-daemon[881]: reaped child process 1756, status = succeeded5639worker1 # [ 159.588740] nix-daemon[881]: accepted connection from pid 1758, user nix-grpc-daemon (trusted)5640worker1 # [ 159.610323] nix-daemon[881]: reaped child process 1761, status = succeeded5641lb # [ 158.215479] niks3-server[979]: 2026/09/20 08:06:17 INFO Received uploads request method=POST path=/api/pending_closures5642worker1 # [ 159.635853] nix-grpc-daemon[1672]: time=2026-09-20T08:06:17.462Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5643worker1 # [ 159.637644] nix-grpc-daemon[1672]: time=2026-09-20T08:06:17.462Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5644lb # [ 158.246662] niks3-server[979]: 2026/09/20 08:06:17 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5645worker1 # [ 159.672279] nix-grpc-daemon[1672]: time=2026-09-20T08:06:17.498Z level=INFO msg="Uploading 1 narinfos"5646lb # [ 158.263433] niks3-server[979]: 2026/09/20 08:06:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5647lb # [ 158.277322] niks3-server[979]: 2026/09/20 08:06:17 INFO Signed narinfos id=48 count=15648lb # [ 158.283382] niks3-server[979]: 2026/09/20 08:06:17 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5649lb # [ 158.291330] niks3-server[979]: 2026/09/20 08:06:17 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5650lb # [ 158.298623] niks3-server[979]: 2026/09/20 08:06:17 INFO Completed upload id=485651worker1 # [ 159.706400] nix-grpc-daemon[1672]: time=2026-09-20T08:06:17.533Z level=INFO msg="Upload complete. (543ms)"5652lb # [ 158.302270] niks3-server[979]: 2026/09/20 08:06:17 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5653worker1 # [ 159.712818] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=0 paths=1 nar_bytes_in=5125654worker1 # [ 159.727410] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085655worker1 # [ 159.734554] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5656worker1 # [ 159.739402] nix-daemon[881]: reaped child process 1751, status = succeeded5657worker1 # [ 159.752577] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5658worker1 # [ 160.579454] nix-daemon[881]: reaped child process 1765, status = succeeded5659worker1 # [ 160.759932] nix-daemon[881]: accepted connection from pid 1780, user nix-grpc-daemon (trusted)5660worker1 # [ 160.784638] nix-daemon[881]: reaped child process 1783, status = succeeded5661lb # [ 159.387949] niks3-server[979]: 2026/09/20 08:06:18 INFO Received uploads request method=POST path=/api/pending_closures5662worker1 # [ 160.805065] nix-grpc-daemon[1672]: time=2026-09-20T08:06:18.631Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5663worker1 # [ 160.808653] nix-grpc-daemon[1672]: time=2026-09-20T08:06:18.633Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5664lb # [ 159.415396] niks3-server[979]: 2026/09/20 08:06:18 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5665lb # [ 159.428522] niks3-server[979]: 2026/09/20 08:06:18 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5666lb # [ 159.436445] niks3-server[979]: 2026/09/20 08:06:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5667worker1 # [ 160.850545] nix-grpc-daemon[1672]: time=2026-09-20T08:06:18.677Z level=INFO msg="Uploading 1 narinfos"5668lb # [ 159.440614] niks3-server[979]: 2026/09/20 08:06:18 INFO Signed narinfos id=49 count=15669lb # [ 159.446322] niks3-server[979]: 2026/09/20 08:06:18 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5670lb # [ 159.452182] niks3-server[979]: 2026/09/20 08:06:18 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5671lb # [ 159.459134] niks3-server[979]: 2026/09/20 08:06:18 INFO Completed upload id=495672worker1 # [ 160.869247] nix-grpc-daemon[1672]: time=2026-09-20T08:06:18.696Z level=INFO msg="Upload complete. (303ms)"5673lb # [ 159.461557] niks3-server[979]: 2026/09/20 08:06:18 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5674worker1 # [ 160.877407] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15675worker2 # [ 160.937960] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:18Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15676worker1 # [ 160.889287] nix-daemon[881]: reaped child process 1763, status = succeeded5677worker2 # [ 160.953215] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:18Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05678worker1 # [ 160.936476] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085679worker1 # [ 160.956148] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437085680worker1 # [ 160.973665] nix-grpc-daemon[1672]: time=2026-09-20T08:06:18.800Z level=INFO msg="All 1 paths already cached"5681worker1 # [ 160.985573] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437085682worker1 # [ 161.000245] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5683worker1 # [ 161.235029] nix-daemon[881]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)5684worker1 # [ 161.262538] nix-daemon[881]: reaped child process 1790, status = succeeded5685worker1 # [ 161.463044] nix-daemon[881]: accepted connection from pid 1792, user nix-grpc-daemon (trusted)5686worker1 # [ 161.489944] nix-daemon[881]: reaped child process 1795, status = succeeded5687lb # [ 160.091582] niks3-server[979]: 2026/09/20 08:06:19 INFO Received uploads request method=POST path=/api/pending_closures5688worker1 # [ 161.800443] nix-grpc-daemon[1672]: time=2026-09-20T08:06:19.626Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5689worker1 # [ 161.806608] nix-grpc-daemon[1672]: time=2026-09-20T08:06:19.626Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5690lb # [ 160.423427] niks3-server[979]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5691worker1 # [ 161.842609] nix-grpc-daemon[1672]: time=2026-09-20T08:06:19.668Z level=INFO msg="Uploading 1 narinfos"5692lb # [ 160.437108] niks3-server[979]: 2026/09/20 08:06:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5693lb # [ 160.448799] niks3-server[979]: 2026/09/20 08:06:19 INFO Signed narinfos id=50 count=15694lb # [ 160.451770] niks3-server[979]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5695lb # [ 160.458511] niks3-server[979]: 2026/09/20 08:06:19 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5696lb # [ 160.474702] niks3-server[979]: 2026/09/20 08:06:19 INFO Completed upload id=505697worker1 # [ 161.885233] nix-grpc-daemon[1672]: time=2026-09-20T08:06:19.711Z level=INFO msg="Upload complete. (862ms)"5698lb # [ 160.483474] niks3-server[979]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5699worker1 # [ 161.897311] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=0 paths=1 nar_bytes_in=6245700worker1 # [ 161.916831] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085701worker1 # [ 161.931611] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5702worker1 # [ 161.939852] nix-daemon[881]: reaped child process 1785, status = succeeded5703worker1 # [ 161.961264] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5704worker1 # [ 163.395055] nix-daemon[881]: reaped child process 1799, status = succeeded5705worker1 # [ 163.576683] nix-daemon[881]: accepted connection from pid 1814, user nix-grpc-daemon (trusted)5706worker1 # [ 163.600945] nix-daemon[881]: reaped child process 1817, status = succeeded5707lb # [ 162.205103] niks3-server[979]: 2026/09/20 08:06:21 INFO Received uploads request method=POST path=/api/pending_closures5708worker1 # [ 163.628522] nix-grpc-daemon[1672]: time=2026-09-20T08:06:21.453Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5709worker1 # [ 163.630095] nix-grpc-daemon[1672]: time=2026-09-20T08:06:21.453Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5710lb # [ 162.246596] niks3-server[979]: 2026/09/20 08:06:21 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5711lb # [ 162.263530] niks3-server[979]: 2026/09/20 08:06:21 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5712lb # [ 162.278106] niks3-server[979]: 2026/09/20 08:06:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5713worker1 # [ 163.696306] nix-grpc-daemon[1672]: time=2026-09-20T08:06:21.522Z level=INFO msg="Uploading 1 narinfos"5714lb # [ 162.288527] niks3-server[979]: 2026/09/20 08:06:21 INFO Signed narinfos id=51 count=15715lb # [ 162.293929] niks3-server[979]: 2026/09/20 08:06:21 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5716lb # [ 162.301533] niks3-server[979]: 2026/09/20 08:06:21 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5717lb # [ 162.311041] niks3-server[979]: 2026/09/20 08:06:21 INFO Completed upload id=515718worker1 # [ 163.720715] nix-grpc-daemon[1672]: time=2026-09-20T08:06:21.547Z level=INFO msg="Upload complete. (343ms)"5719lb # [ 162.314324] niks3-server[979]: 2026/09/20 08:06:21 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5720worker1 # [ 163.733450] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15721worker2 # [ 163.797747] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:21Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15722worker1 # [ 163.757223] nix-daemon[881]: reaped child process 1797, status = succeeded5723worker1 # [ 163.783834] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085724worker1 # [ 163.803783] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437085725worker1 # [ 163.821402] nix-grpc-daemon[1672]: time=2026-09-20T08:06:21.648Z level=INFO msg="All 1 paths already cached"5726worker1 # [ 163.833600] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437085727worker1 # [ 163.849440] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5728worker1 # [ 164.065488] nix-daemon[881]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)5729worker1 # [ 164.093171] nix-daemon[881]: reaped child process 1824, status = succeeded5730worker1 # [ 164.295081] nix-daemon[881]: accepted connection from pid 1826, user nix-grpc-daemon (trusted)5731worker1 # [ 164.320980] nix-daemon[881]: reaped child process 1829, status = succeeded5732lb # [ 162.923831] niks3-server[979]: 2026/09/20 08:06:22 INFO Received uploads request method=POST path=/api/pending_closures5733worker1 # [ 164.344978] nix-grpc-daemon[1672]: time=2026-09-20T08:06:22.171Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5734worker1 # [ 164.346758] nix-grpc-daemon[1672]: time=2026-09-20T08:06:22.171Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5735worker2 # [ 163.806321] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:21Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05736lb # [ 162.955615] niks3-server[979]: 2026/09/20 08:06:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5737worker1 # [ 164.370455] nix-grpc-daemon[1672]: time=2026-09-20T08:06:22.197Z level=INFO msg="Uploading 1 narinfos"5738lb # [ 162.963281] niks3-server[979]: 2026/09/20 08:06:22 INFO Signed narinfos id=52 count=15739lb # [ 162.968256] niks3-server[979]: 2026/09/20 08:06:22 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5740lb # [ 162.975801] niks3-server[979]: 2026/09/20 08:06:22 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5741lb # [ 162.983565] niks3-server[979]: 2026/09/20 08:06:22 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5742lb # [ 162.990174] niks3-server[979]: 2026/09/20 08:06:22 INFO Completed upload id=525743worker1 # [ 164.400640] nix-grpc-daemon[1672]: time=2026-09-20T08:06:22.227Z level=INFO msg="Upload complete. (533ms)"5744lb # [ 162.993859] niks3-server[979]: 2026/09/20 08:06:22 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5745worker1 # [ 164.408188] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=0 paths=1 nar_bytes_in=6245746worker1 # [ 164.419144] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085747worker1 # [ 164.424887] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5748worker1 # [ 164.429544] nix-daemon[881]: reaped child process 1819, status = succeeded5749worker1 # [ 164.442944] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5750worker1 # [ 165.694051] nix-daemon[881]: reaped child process 1833, status = succeeded5751worker1 # [ 165.882311] nix-daemon[881]: accepted connection from pid 1848, user nix-grpc-daemon (trusted)5752worker1 # [ 165.906877] nix-daemon[881]: reaped child process 1851, status = succeeded5753lb # [ 164.509127] niks3-server[979]: 2026/09/20 08:06:23 INFO Received uploads request method=POST path=/api/pending_closures5754worker1 # [ 165.930249] nix-grpc-daemon[1672]: time=2026-09-20T08:06:23.756Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5755worker1 # [ 165.935851] nix-grpc-daemon[1672]: time=2026-09-20T08:06:23.758Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5756lb # [ 164.557924] niks3-server[979]: 2026/09/20 08:06:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5757worker1 # [ 165.982525] nix-grpc-daemon[1672]: time=2026-09-20T08:06:23.809Z level=INFO msg="Uploading 1 narinfos"5758lb # [ 164.573542] niks3-server[979]: 2026/09/20 08:06:23 INFO Signed narinfos id=53 count=15759lb # [ 164.582882] niks3-server[979]: 2026/09/20 08:06:23 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5760lb # [ 164.591140] niks3-server[979]: 2026/09/20 08:06:23 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5761lb # [ 164.595123] niks3-server[979]: 2026/09/20 08:06:23 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5762lb # [ 164.602439] niks3-server[979]: 2026/09/20 08:06:23 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5763lb # [ 164.606481] niks3-server[979]: 2026/09/20 08:06:23 INFO Completed upload id=535764lb # [ 164.608967] niks3-server[979]: 2026/09/20 08:06:23 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5765worker1 # [ 166.018801] nix-grpc-daemon[1672]: time=2026-09-20T08:06:23.845Z level=INFO msg="Upload complete. (365ms)"5766worker2 # [ 166.087588] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:23Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15767worker1 # [ 166.029348] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15768worker2 # [ 166.103816] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:23Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05769worker1 # [ 166.051539] nix-daemon[881]: reaped child process 1831, status = succeeded5770worker1 # [ 166.083404] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085771worker1 # [ 166.102382] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437085772worker1 # [ 166.119806] nix-grpc-daemon[1672]: time=2026-09-20T08:06:23.946Z level=INFO msg="All 1 paths already cached"5773worker1 # [ 166.130398] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437085774worker1 # [ 166.146878] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5775worker1 # [ 166.379527] nix-daemon[881]: accepted connection from pid 1855, user nix-grpc-daemon (trusted)5776worker1 # [ 166.406740] nix-daemon[881]: reaped child process 1858, status = succeeded5777worker1 # [ 166.604190] nix-daemon[881]: accepted connection from pid 1860, user nix-grpc-daemon (trusted)5778worker1 # [ 166.625262] nix-daemon[881]: reaped child process 1863, status = succeeded5779lb # [ 165.231344] niks3-server[979]: 2026/09/20 08:06:24 INFO Received uploads request method=POST path=/api/pending_closures5780worker1 # [ 166.654597] nix-grpc-daemon[1672]: time=2026-09-20T08:06:24.480Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5781worker1 # [ 166.656578] nix-grpc-daemon[1672]: time=2026-09-20T08:06:24.481Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5782lb # [ 165.267142] niks3-server[979]: 2026/09/20 08:06:24 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5783lb # [ 165.285814] niks3-server[979]: 2026/09/20 08:06:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5784worker1 # [ 166.701894] nix-grpc-daemon[1672]: time=2026-09-20T08:06:24.528Z level=INFO msg="Uploading 1 narinfos"5785lb # [ 165.298534] niks3-server[979]: 2026/09/20 08:06:24 INFO Signed narinfos id=54 count=15786lb # [ 165.305535] niks3-server[979]: 2026/09/20 08:06:24 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5787lb # [ 165.314927] niks3-server[979]: 2026/09/20 08:06:24 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5788lb # [ 165.322444] niks3-server[979]: 2026/09/20 08:06:24 INFO Completed upload id=545789worker1 # [ 166.732867] nix-grpc-daemon[1672]: time=2026-09-20T08:06:24.559Z level=INFO msg="Upload complete. (563ms)"5790lb # [ 165.325149] niks3-server[979]: 2026/09/20 08:06:24 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5791worker1 # [ 166.743223] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=0 paths=1 nar_bytes_in=6245792worker1 # [ 166.760717] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085793worker1 # [ 166.769799] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5794worker1 # [ 166.776325] nix-daemon[881]: reaped child process 1853, status = succeeded5795worker1 # [ 166.796303] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5796worker1 # [ 167.433247] nix-daemon[881]: reaped child process 1867, status = succeeded5797worker1 # [ 167.617885] nix-daemon[881]: accepted connection from pid 1882, user nix-grpc-daemon (trusted)5798worker1 # [ 167.643408] nix-daemon[881]: reaped child process 1885, status = succeeded5799lb # [ 166.246044] niks3-server[979]: 2026/09/20 08:06:25 INFO Received uploads request method=POST path=/api/pending_closures5800worker1 # [ 167.668671] nix-grpc-daemon[1672]: time=2026-09-20T08:06:25.495Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5801worker1 # [ 167.674496] nix-grpc-daemon[1672]: time=2026-09-20T08:06:25.497Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5802lb # [ 166.314878] niks3-server[979]: 2026/09/20 08:06:25 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5803lb # [ 166.326388] niks3-server[979]: 2026/09/20 08:06:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5804worker1 # [ 167.741672] nix-grpc-daemon[1672]: time=2026-09-20T08:06:25.567Z level=INFO msg="Uploading 1 narinfos"5805lb # [ 166.334875] niks3-server[979]: 2026/09/20 08:06:25 INFO Signed narinfos id=55 count=15806lb # [ 166.341029] niks3-server[979]: 2026/09/20 08:06:25 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5807lb # [ 166.347375] niks3-server[979]: 2026/09/20 08:06:25 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5808lb # [ 166.354058] niks3-server[979]: 2026/09/20 08:06:25 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5809lb # [ 166.361102] niks3-server[979]: 2026/09/20 08:06:25 INFO Completed upload id=555810worker1 # [ 167.769846] nix-grpc-daemon[1672]: time=2026-09-20T08:06:25.596Z level=INFO msg="Upload complete. (360ms)"5811lb # [ 166.363610] niks3-server[979]: 2026/09/20 08:06:25 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5812worker2 # [ 167.840846] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:25Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15813worker1 # [ 167.785832] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=15814worker1 # [ 167.806127] nix-daemon[881]: reaped child process 1865, status = succeeded5815worker1 # [ 167.826836] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085816worker2 # [ 167.889543] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:25Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05817worker1 # [ 167.844804] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437085818worker1 # [ 167.862887] nix-grpc-daemon[1672]: time=2026-09-20T08:06:25.689Z level=INFO msg="All 2 paths already cached"5819worker1 # [ 167.874246] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437085820worker1 # [ 167.890462] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5821worker1 # [ 168.113388] nix-daemon[881]: accepted connection from pid 1889, user nix-grpc-daemon (trusted)5822worker1 # [ 168.140365] nix-daemon[881]: reaped child process 1892, status = succeeded5823worker1 # [ 168.342188] nix-daemon[881]: accepted connection from pid 1894, user nix-grpc-daemon (trusted)5824worker1 # [ 168.364417] nix-daemon[881]: reaped child process 1897, status = succeeded5825lb # [ 166.966400] niks3-server[979]: 2026/09/20 08:06:26 INFO Received uploads request method=POST path=/api/pending_closures5826worker1 # [ 168.386753] nix-grpc-daemon[1672]: time=2026-09-20T08:06:26.213Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5827worker1 # [ 168.388574] nix-grpc-daemon[1672]: time=2026-09-20T08:06:26.213Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5828lb # [ 167.008388] niks3-server[979]: 2026/09/20 08:06:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5829worker1 # [ 168.428327] nix-grpc-daemon[1672]: time=2026-09-20T08:06:26.254Z level=INFO msg="Uploading 1 narinfos"5830lb # [ 167.022985] niks3-server[979]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5831lb # [ 167.034611] niks3-server[979]: 2026/09/20 08:06:26 INFO Signed narinfos id=56 count=15832lb # [ 167.039073] niks3-server[979]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5833lb # [ 167.046587] niks3-server[979]: 2026/09/20 08:06:26 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5834worker1 # [ 168.464244] nix-grpc-daemon[1672]: time=2026-09-20T08:06:26.291Z level=INFO msg="Upload complete. (554ms)"5835lb # [ 167.054997] niks3-server[979]: 2026/09/20 08:06:26 INFO Completed upload id=565836lb # [ 167.058568] niks3-server[979]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5837worker1 # [ 168.473805] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=0 paths=1 nar_bytes_in=7525838worker1 # [ 168.491230] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085839worker1 # [ 168.498718] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5840worker1 # [ 168.505204] nix-daemon[881]: reaped child process 1887, status = succeeded5841worker1 # [ 168.522333] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5842worker1 # [ 169.968938] nix-daemon[881]: reaped child process 1901, status = succeeded5843worker1 # [ 170.153399] nix-daemon[881]: accepted connection from pid 1916, user nix-grpc-daemon (trusted)5844worker1 # [ 170.177107] nix-daemon[881]: reaped child process 1919, status = succeeded5845lb # [ 168.781077] niks3-server[979]: 2026/09/20 08:06:27 INFO Received uploads request method=POST path=/api/pending_closures5846worker1 # [ 170.210128] nix-grpc-daemon[1672]: time=2026-09-20T08:06:28.031Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5847worker1 # [ 170.211839] nix-grpc-daemon[1672]: time=2026-09-20T08:06:28.031Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5848lb # [ 168.846133] niks3-server[979]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5849lb # [ 168.853893] niks3-server[979]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5850lb # [ 168.863506] niks3-server[979]: 2026/09/20 08:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5851lb # [ 168.869016] niks3-server[979]: 2026/09/20 08:06:28 INFO Signed narinfos id=57 count=15852worker1 # [ 170.280153] nix-grpc-daemon[1672]: time=2026-09-20T08:06:28.106Z level=INFO msg="Uploading 1 narinfos"5853lb # [ 168.872706] niks3-server[979]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5854lb # [ 168.884130] niks3-server[979]: 2026/09/20 08:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5855lb # [ 168.889964] niks3-server[979]: 2026/09/20 08:06:28 INFO Completed upload id=575856lb # [ 168.892588] niks3-server[979]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo5857worker2 # [ 170.364966] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:28Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=15858worker1 # [ 170.303840] nix-grpc-daemon[1672]: time=2026-09-20T08:06:28.127Z level=INFO msg="Upload complete. (364ms)"5859worker1 # [ 170.317607] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=15860worker1 # [ 170.334169] nix-daemon[881]: reaped child process 1899, status = succeeded5861worker1 # [ 170.350814] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085862worker1 # [ 170.367459] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437085863worker1 # [ 170.383946] nix-grpc-daemon[1672]: time=2026-09-20T08:06:28.210Z level=INFO msg="All 2 paths already cached"5864worker1 # [ 170.393780] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437085865worker1 # [ 170.407776] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5866worker1 # [ 170.624401] nix-daemon[881]: accepted connection from pid 1923, user nix-grpc-daemon (trusted)5867worker1 # [ 170.647823] nix-daemon[881]: reaped child process 1926, status = succeeded5868worker1 # [ 170.841685] nix-daemon[881]: accepted connection from pid 1928, user nix-grpc-daemon (trusted)5869worker1 # [ 170.866050] nix-daemon[881]: reaped child process 1931, status = succeeded5870lb # [ 169.466645] niks3-server[979]: 2026/09/20 08:06:28 INFO Received uploads request method=POST path=/api/pending_closures5871worker1 # [ 170.883591] nix-grpc-daemon[1672]: time=2026-09-20T08:06:28.710Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5872worker1 # [ 170.885471] nix-grpc-daemon[1672]: time=2026-09-20T08:06:28.710Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"5873lb # [ 169.488490] niks3-server[979]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst5874lb # [ 169.495747] niks3-server[979]: 2026/09/20 08:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5875worker1 # [ 170.908775] nix-grpc-daemon[1672]: time=2026-09-20T08:06:28.735Z level=INFO msg="Uploading 1 narinfos"5876lb # [ 169.502126] niks3-server[979]: 2026/09/20 08:06:28 INFO Signed narinfos id=58 count=15877lb # [ 169.505635] niks3-server[979]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls5878lb # [ 169.514408] niks3-server[979]: 2026/09/20 08:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5879lb # [ 169.518164] niks3-server[979]: 2026/09/20 08:06:28 INFO Completed upload id=585880worker1 # [ 170.928402] nix-grpc-daemon[1672]: time=2026-09-20T08:06:28.755Z level=INFO msg="Upload complete. (503ms)"5881lb # [ 169.520232] niks3-server[979]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo5882worker1 # [ 170.936077] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=0 paths=1 nar_bytes_in=7525883worker1 # [ 170.939032] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085884worker1 # [ 170.951445] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5885worker1 # [ 170.955604] nix-daemon[881]: reaped child process 1921, status = succeeded5886worker1 # [ 170.966117] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5887worker1 # [ 172.195545] nix-daemon[881]: reaped child process 1935, status = succeeded5888worker1 # [ 172.386810] nix-daemon[881]: accepted connection from pid 1950, user nix-grpc-daemon (trusted)5889worker1 # [ 172.412352] nix-daemon[881]: reaped child process 1953, status = succeeded5890lb # [ 171.015362] niks3-server[979]: 2026/09/20 08:06:30 INFO Received uploads request method=POST path=/api/pending_closures5891worker1 # [ 172.439777] nix-grpc-daemon[1672]: time=2026-09-20T08:06:30.265Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5892worker1 # [ 172.441715] nix-grpc-daemon[1672]: time=2026-09-20T08:06:30.265Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"5893lb # [ 171.051671] niks3-server[979]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv5894lb # [ 171.074453] niks3-server[979]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst5895lb # [ 171.085881] niks3-server[979]: 2026/09/20 08:06:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5896worker1 # [ 172.502331] nix-grpc-daemon[1672]: time=2026-09-20T08:06:30.328Z level=INFO msg="Uploading 1 narinfos"5897lb # [ 171.099244] niks3-server[979]: 2026/09/20 08:06:30 INFO Signed narinfos id=59 count=15898lb # [ 171.104276] niks3-server[979]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls5899lb # [ 171.116000] niks3-server[979]: 2026/09/20 08:06:30 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5900lb # [ 171.121516] niks3-server[979]: 2026/09/20 08:06:30 INFO Completed upload id=595901worker1 # [ 172.531914] nix-grpc-daemon[1672]: time=2026-09-20T08:06:30.358Z level=INFO msg="Upload complete. (353ms)"5902lb # [ 171.124199] niks3-server[979]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo5903worker2 # [ 172.601390] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:30Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=15904worker1 # [ 172.545144] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=15905worker1 # [ 172.566052] nix-daemon[881]: reaped child process 1933, status = succeeded5906worker1 # [ 172.595718] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085907worker1 # [ 172.616543] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437085908worker1 # [ 172.635911] nix-grpc-daemon[1672]: time=2026-09-20T08:06:30.462Z level=INFO msg="All 2 paths already cached"5909worker1 # [ 172.647761] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437085910worker1 # [ 172.664330] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5911worker1 # [ 172.897245] nix-daemon[881]: accepted connection from pid 1957, user nix-grpc-daemon (trusted)5912worker1 # [ 172.920251] nix-daemon[881]: reaped child process 1960, status = succeeded5913worker1 # [ 173.110017] nix-daemon[881]: accepted connection from pid 1962, user nix-grpc-daemon (trusted)5914worker1 # [ 173.132403] nix-daemon[881]: reaped child process 1965, status = succeeded5915lb # [ 171.738209] niks3-server[979]: 2026/09/20 08:06:30 INFO Received uploads request method=POST path=/api/pending_closures5916worker1 # [ 173.159527] nix-grpc-daemon[1672]: time=2026-09-20T08:06:30.985Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5917worker1 # [ 173.161301] nix-grpc-daemon[1672]: time=2026-09-20T08:06:30.985Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"5918lb # [ 171.779693] niks3-server[979]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst5919worker1 # [ 173.198839] nix-grpc-daemon[1672]: time=2026-09-20T08:06:31.025Z level=INFO msg="Uploading 1 narinfos"5920lb # [ 171.793934] niks3-server[979]: 2026/09/20 08:06:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign5921lb # [ 171.804309] niks3-server[979]: 2026/09/20 08:06:30 INFO Signed narinfos id=60 count=15922lb # [ 171.809578] niks3-server[979]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls5923lb # [ 171.818483] niks3-server[979]: 2026/09/20 08:06:31 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete5924lb # [ 171.823272] niks3-server[979]: 2026/09/20 08:06:31 INFO Completed upload id=605925worker1 # [ 173.227063] nix-grpc-daemon[1672]: time=2026-09-20T08:06:31.053Z level=INFO msg="Upload complete. (541ms)"5926lb # [ 171.826484] niks3-server[979]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo5927worker1 # [ 173.237583] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=0 paths=1 nar_bytes_in=7525928worker1 # [ 173.251733] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437085929worker1 # [ 173.258710] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5930worker1 # [ 173.264393] nix-daemon[881]: reaped child process 1955, status = succeeded5931worker1 # [ 173.280794] nix-daemon[881]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5932worker1 # [ 174.334338] nix-daemon[881]: reaped child process 1969, status = succeeded5933worker1 # [ 174.528817] nix-daemon[881]: accepted connection from pid 1984, user nix-grpc-daemon (trusted)5934worker1 # [ 174.551441] nix-daemon[881]: reaped child process 1987, status = succeeded5935lb # [ 173.154808] niks3-server[979]: 2026/09/20 08:06:32 INFO Received uploads request method=POST path=/api/pending_closures5936worker1 # [ 174.580504] nix-grpc-daemon[1672]: time=2026-09-20T08:06:32.404Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5937worker1 # [ 174.582201] nix-grpc-daemon[1672]: time=2026-09-20T08:06:32.405Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"5938lb # [ 173.207167] niks3-server[979]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv5939lb # [ 173.220464] niks3-server[979]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst5940worker1 # [ 174.644296] nix-grpc-daemon[1672]: time=2026-09-20T08:06:32.470Z level=INFO msg="Uploading 1 narinfos"5941lb # [ 173.233729] niks3-server[979]: 2026/09/20 08:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign5942lb # [ 173.241958] niks3-server[979]: 2026/09/20 08:06:32 INFO Signed narinfos id=61 count=15943lb # [ 173.247793] niks3-server[979]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls5944lb # [ 173.256344] niks3-server[979]: 2026/09/20 08:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete5945lb # [ 173.265017] niks3-server[979]: 2026/09/20 08:06:32 INFO Completed upload id=615946worker1 # [ 174.675435] nix-grpc-daemon[1672]: time=2026-09-20T08:06:32.502Z level=INFO msg="Upload complete. (382ms)"5947lb # [ 173.267762] niks3-server[979]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo5948worker1 # [ 174.689322] nix-grpc-daemon[1616]: ts=2026-09-20T08:06:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43708 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=15949worker1 # [ 174.710041] nix-daemon[881]: reaped child process 1967, status = succeeded5950client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.03 seconds)5951worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'5952worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.10 seconds)5953client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]'5954client # [ 174.933049] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features "[\"gpu\"]".5955client # Running as unit: gpu.service; invocation ID: 6a88582b5eff41928492fcb600e34b535956client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.10 seconds)5957lb: must succeed: curl -sf localhost:9901/clusters5958lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5959lb: must succeed: curl -sf localhost:9901/clusters5960lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5961worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true5962client # [ 175.200816] nix[1408]: don't know how to build these paths:5963worker2 # [ 175.273933] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:585125964client # [ 175.202736] nix[1408]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv5965worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true, in 0.08 seconds)5966worker2 # [ 175.288189] nix-grpc-daemon[1530]: ts=2026-09-20T08:06:33Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=05967client # [ 175.218753] nix[1408]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 120s for a worker5968lb: must succeed: curl -sf localhost:9901/clusters5969lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5970lb: must succeed: curl -sf localhost:9901/clusters5971lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5972worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true5973worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true, in 0.06 seconds)5974client: waiting for success: systemctl show -p Result gpu | grep -q exit-code5975lb # [ 180.471970] envoy[872]: conn peer=[2001:db8:1::1]:53438 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26888 tx=10808 ms=206935976client # [ 295.225354] nix[1408]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}5977client # [ 295.250076] nix[1408]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed5978client # [ 295.316772] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE5979client # [ 295.319602] systemd[1]: gpu.service: Failed with result 'exit-code'.5980client # [ 295.325286] systemd[1]: gpu.service: Consumed 235ms CPU time over 2min 389ms wall clock time, 33.2M memory peak, 4K written to disk, 6.5K incoming IP traffic, 5.5K outgoing IP traffic.5981client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 119.96 seconds)5982client: must succeed: journalctl -u gpu -o cat5983client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds)5984lb: must succeed: curl -sf localhost:9901/clusters5985lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5986lb: must succeed: curl -sf localhost:9901/clusters5987lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5988worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true5989worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true, in 0.10 seconds)5990(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 142.97 seconds)5991subtest: low disk drains a worker and builds go to the other5992worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill5993worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.14 seconds)5994worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'5995worker1 # [ 298.490301] nix-grpc-daemon[1616]: ts=2026-09-20T08:08:36Z level=info event=unhealthy reason=min_free5996worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds)5997client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&25998worker2 # [ 299.299714] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:585125999client # don't know how to build these paths:6000client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6001worker2 # [ 299.322173] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:37Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06002worker2 # [ 299.329421] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:37Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16003worker2 # [ 299.368109] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585126004worker2 # [ 299.398558] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585126005client # copying 1 paths to 'lb:50051'...6006client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6007worker2 # [ 299.415436] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585126008worker2 # [ 299.435377] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)6009worker2 # [ 299.656355] nix-daemon[916]: accepted connection from pid 1840, user nix-grpc-daemon (trusted)6010worker2 # [ 299.679184] nix-daemon[916]: reaped child process 1843, status = succeeded6011worker2 # [ 299.856136] nix-daemon[916]: accepted connection from pid 1845, user nix-grpc-daemon (trusted)6012worker2 # [ 299.875342] nix-daemon[916]: reaped child process 1848, status = succeeded6013lb # [ 298.419358] niks3-server[979]: 2026/09/20 08:08:37 INFO Received uploads request method=POST path=/api/pending_closures6014worker2 # [ 299.904460] nix-grpc-daemon[1606]: time=2026-09-20T08:08:37.690Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6015worker2 # [ 299.906020] nix-grpc-daemon[1606]: time=2026-09-20T08:08:37.690Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6016lb # [ 298.479398] niks3-server[979]: 2026/09/20 08:08:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6017worker2 # [ 299.957628] nix-grpc-daemon[1606]: time=2026-09-20T08:08:37.743Z level=INFO msg="Uploading 1 narinfos"6018lb # [ 298.490926] niks3-server[979]: 2026/09/20 08:08:37 INFO Signed narinfos id=62 count=16019lb # [ 298.504845] niks3-server[979]: 2026/09/20 08:08:37 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6020lb # [ 298.521245] niks3-server[979]: 2026/09/20 08:08:37 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6021lb # [ 298.534810] niks3-server[979]: 2026/09/20 08:08:37 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6022lb # [ 298.540596] niks3-server[979]: 2026/09/20 08:08:37 INFO Completed upload id=626023lb # [ 298.544439] niks3-server[979]: 2026/09/20 08:08:37 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6024worker2 # [ 300.011108] nix-grpc-daemon[1606]: time=2026-09-20T08:08:37.797Z level=INFO msg="Upload complete. (554ms)"6025worker2 # [ 300.023951] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=0 paths=1 nar_bytes_in=5126026worker2 # [ 300.040433] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585126027worker2 # [ 300.048987] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)6028worker2 # [ 300.055107] nix-daemon[916]: reaped child process 1838, status = succeeded6029client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6030client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6031worker2 # [ 300.072623] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)6032client # farm-a> LOG-farm-a-drain6033worker2 # [ 301.517875] nix-daemon[916]: reaped child process 1852, status = succeeded6034worker2 # [ 301.689827] nix-daemon[916]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)6035worker2 # [ 301.709771] nix-daemon[916]: reaped child process 1870, status = succeeded6036lb # [ 300.253786] niks3-server[979]: 2026/09/20 08:08:39 INFO Received uploads request method=POST path=/api/pending_closures6037worker2 # [ 301.736564] nix-grpc-daemon[1606]: time=2026-09-20T08:08:39.522Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6038worker2 # [ 301.738262] nix-grpc-daemon[1606]: time=2026-09-20T08:08:39.522Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6039lb # [ 300.303570] niks3-server[979]: 2026/09/20 08:08:39 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6040worker2 # [ 301.786501] nix-grpc-daemon[1606]: time=2026-09-20T08:08:39.572Z level=INFO msg="Uploading 1 narinfos"6041lb # [ 300.319004] niks3-server[979]: 2026/09/20 08:08:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6042lb # [ 300.326803] niks3-server[979]: 2026/09/20 08:08:39 INFO Signed narinfos id=63 count=16043lb # [ 300.329838] niks3-server[979]: 2026/09/20 08:08:39 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6044lb # [ 300.337370] niks3-server[979]: 2026/09/20 08:08:39 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6045lb # [ 300.340964] niks3-server[979]: 2026/09/20 08:08:39 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6046worker2 # [ 301.811369] nix-grpc-daemon[1606]: time=2026-09-20T08:08:39.598Z level=INFO msg="Upload complete. (325ms)"6047lb # [ 300.344451] niks3-server[979]: 2026/09/20 08:08:39 INFO Completed upload id=636048lb # [ 300.347209] niks3-server[979]: 2026/09/20 08:08:39 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6049worker2 # [ 301.824714] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16050worker2 # [ 301.843138] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:39Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06051worker2 # [ 301.847148] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:39Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16052worker2 # [ 301.851162] nix-daemon[916]: reaped child process 1850, status = succeeded6053worker2 # [ 301.884236] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585126054worker2 # [ 301.900157] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585126055client # copying 1 paths to 'lb:50051'...6056worker2 # [ 301.914756] nix-grpc-daemon[1606]: time=2026-09-20T08:08:39.701Z level=INFO msg="All 1 paths already cached"6057worker2 # [ 301.921238] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585126058client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6059worker2 # [ 301.937097] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)6060lb # [ 300.481581] envoy[872]: conn peer=[2001:db8:1::1]:47290 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=727 tx=456 ms=1200586061worker2 # [ 302.141422] nix-daemon[916]: accepted connection from pid 1876, user nix-grpc-daemon (trusted)6062worker2 # [ 302.160281] nix-daemon[916]: reaped child process 1879, status = succeeded6063worker2 # [ 302.337992] nix-daemon[916]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6064worker2 # [ 302.356581] nix-daemon[916]: reaped child process 1884, status = succeeded6065lb # [ 300.897011] niks3-server[979]: 2026/09/20 08:08:40 INFO Received uploads request method=POST path=/api/pending_closures6066worker2 # [ 302.376083] nix-grpc-daemon[1606]: time=2026-09-20T08:08:40.162Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6067worker2 # [ 302.378162] nix-grpc-daemon[1606]: time=2026-09-20T08:08:40.164Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6068lb # [ 300.930453] niks3-server[979]: 2026/09/20 08:08:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6069worker2 # [ 302.408603] nix-grpc-daemon[1606]: time=2026-09-20T08:08:40.195Z level=INFO msg="Uploading 1 narinfos"6070lb # [ 300.945769] niks3-server[979]: 2026/09/20 08:08:40 INFO Signed narinfos id=64 count=16071lb # [ 300.955322] niks3-server[979]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6072lb # [ 300.962484] niks3-server[979]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6073lb # [ 300.972069] niks3-server[979]: 2026/09/20 08:08:40 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6074worker2 # [ 302.447514] nix-grpc-daemon[1606]: time=2026-09-20T08:08:40.234Z level=INFO msg="Upload complete. (493ms)"6075lb # [ 300.977742] niks3-server[979]: 2026/09/20 08:08:40 INFO Completed upload id=646076lb # [ 300.981409] niks3-server[979]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6077worker2 # [ 302.456290] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=0 paths=1 nar_bytes_in=6326078worker2 # [ 302.469108] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585126079worker2 # [ 302.475461] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)6080worker2 # [ 302.481477] nix-daemon[916]: reaped child process 1874, status = succeeded6081client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6082client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6083worker2 # [ 302.495563] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)6084worker2 # [ 303.318038] nix-daemon[916]: reaped child process 1888, status = succeeded6085client # farm-b> LOG-farm-b-drain6086worker2 # [ 303.476589] nix-daemon[916]: accepted connection from pid 1903, user nix-grpc-daemon (trusted)6087worker2 # [ 303.498637] nix-daemon[916]: reaped child process 1906, status = succeeded6088lb # [ 302.039708] niks3-server[979]: 2026/09/20 08:08:41 INFO Received uploads request method=POST path=/api/pending_closures6089worker2 # [ 303.520446] nix-grpc-daemon[1606]: time=2026-09-20T08:08:41.306Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6090worker2 # [ 303.521996] nix-grpc-daemon[1606]: time=2026-09-20T08:08:41.306Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6091lb # [ 302.083816] niks3-server[979]: 2026/09/20 08:08:41 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6092worker2 # [ 303.567095] nix-grpc-daemon[1606]: time=2026-09-20T08:08:41.353Z level=INFO msg="Uploading 1 narinfos"6093lb # [ 302.093431] niks3-server[979]: 2026/09/20 08:08:41 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6094lb # [ 302.110236] niks3-server[979]: 2026/09/20 08:08:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6095lb # [ 302.120290] niks3-server[979]: 2026/09/20 08:08:41 INFO Signed narinfos id=65 count=16096lb # [ 302.122719] niks3-server[979]: 2026/09/20 08:08:41 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6097worker2 # [ 303.597370] nix-grpc-daemon[1606]: time=2026-09-20T08:08:41.383Z level=INFO msg="Upload complete. (292ms)"6098lb # [ 302.127363] niks3-server[979]: 2026/09/20 08:08:41 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6099lb # [ 302.133122] niks3-server[979]: 2026/09/20 08:08:41 INFO Completed upload id=656100lb # [ 302.135980] niks3-server[979]: 2026/09/20 08:08:41 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6101worker2 # [ 303.609469] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16102worker2 # [ 303.628608] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:41Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06103worker2 # [ 303.632413] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:41Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16104worker2 # [ 303.636267] nix-daemon[916]: reaped child process 1886, status = succeeded6105worker2 # [ 303.668800] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585126106worker2 # [ 303.684123] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:585126107client # copying 1 paths to 'lb:50051'...6108worker2 # [ 303.700070] nix-grpc-daemon[1606]: time=2026-09-20T08:08:41.485Z level=INFO msg="All 2 paths already cached"6109client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6110worker2 # [ 303.705938] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:585126111worker2 # [ 303.721160] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)6112worker2 # [ 303.920143] nix-daemon[916]: accepted connection from pid 1912, user nix-grpc-daemon (trusted)6113worker2 # [ 303.939890] nix-daemon[916]: reaped child process 1915, status = succeeded6114worker2 # [ 304.111810] nix-daemon[916]: accepted connection from pid 1917, user nix-grpc-daemon (trusted)6115worker2 # [ 304.132755] nix-daemon[916]: reaped child process 1920, status = succeeded6116lb # [ 302.674587] niks3-server[979]: 2026/09/20 08:08:41 INFO Received uploads request method=POST path=/api/pending_closures6117worker2 # [ 304.159190] nix-grpc-daemon[1606]: time=2026-09-20T08:08:41.945Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6118worker2 # [ 304.160855] nix-grpc-daemon[1606]: time=2026-09-20T08:08:41.945Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6119lb # [ 302.712956] niks3-server[979]: 2026/09/20 08:08:41 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6120worker2 # [ 304.192352] nix-grpc-daemon[1606]: time=2026-09-20T08:08:41.978Z level=INFO msg="Uploading 1 narinfos"6121lb # [ 302.726221] niks3-server[979]: 2026/09/20 08:08:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6122lb # [ 302.737335] niks3-server[979]: 2026/09/20 08:08:41 INFO Signed narinfos id=66 count=16123worker2 # [ 304.218359] nix-grpc-daemon[1606]: time=2026-09-20T08:08:42.005Z level=INFO msg="Upload complete. (480ms)"6124lb # [ 302.748991] niks3-server[979]: 2026/09/20 08:08:41 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6125worker2 # [ 304.224346] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=0 paths=1 nar_bytes_in=7606126lb # [ 302.754561] niks3-server[979]: 2026/09/20 08:08:41 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6127lb # [ 302.761134] niks3-server[979]: 2026/09/20 08:08:41 INFO Completed upload id=666128lb # [ 302.763852] niks3-server[979]: 2026/09/20 08:08:41 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6129worker2 # [ 304.237112] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:585126130worker2 # [ 304.243087] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)6131worker2 # [ 304.248179] nix-daemon[916]: reaped child process 1910, status = succeeded6132client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6133worker2 # [ 304.261335] nix-daemon[916]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)6134client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6135client # farm-top> LOG-farm-top-drain6136worker2 # [ 305.287720] nix-daemon[916]: reaped child process 1924, status = succeeded6137worker2 # [ 305.447594] nix-daemon[916]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)6138worker2 # [ 305.464849] nix-daemon[916]: reaped child process 1942, status = succeeded6139lb # [ 304.009543] niks3-server[979]: 2026/09/20 08:08:43 INFO Received uploads request method=POST path=/api/pending_closures6140worker2 # [ 305.492425] nix-grpc-daemon[1606]: time=2026-09-20T08:08:43.277Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6141worker2 # [ 305.493919] nix-grpc-daemon[1606]: time=2026-09-20T08:08:43.277Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6142lb # [ 304.049674] niks3-server[979]: 2026/09/20 08:08:43 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6143lb # [ 304.065079] niks3-server[979]: 2026/09/20 08:08:43 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6144lb # [ 304.074066] niks3-server[979]: 2026/09/20 08:08:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6145worker2 # [ 305.549712] nix-grpc-daemon[1606]: time=2026-09-20T08:08:43.336Z level=INFO msg="Uploading 1 narinfos"6146lb # [ 304.083184] niks3-server[979]: 2026/09/20 08:08:43 INFO Signed narinfos id=67 count=16147lb # [ 304.088658] niks3-server[979]: 2026/09/20 08:08:43 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6148lb # [ 304.096170] niks3-server[979]: 2026/09/20 08:08:43 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6149lb # [ 304.103199] niks3-server[979]: 2026/09/20 08:08:43 INFO Completed upload id=676150worker2 # [ 305.573754] nix-grpc-daemon[1606]: time=2026-09-20T08:08:43.360Z level=INFO msg="Upload complete. (303ms)"6151lb # [ 304.106310] niks3-server[979]: 2026/09/20 08:08:43 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6152worker2 # [ 305.585011] nix-grpc-daemon[1530]: ts=2026-09-20T08:08:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58512 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16153worker2 # [ 305.601415] nix-daemon[916]: reaped child process 1922, status = succeeded6154client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&2, in 6.60 seconds)6155client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath6156client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath, in 0.23 seconds)6157worker1: must succeed: rm /nix/.rw-store/fill6158worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6159worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6160worker1 # [ 306.501564] nix-grpc-daemon[1616]: ts=2026-09-20T08:08:44Z level=info event=healthy reason=min_free6161worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6162(finished: subtest: low disk drains a worker and builds go to the other, in 10.48 seconds)6163(finished: run the VM test script, in 308.64 seconds)6164test script finished in 308.93s6165cleanup6166kill QemuMachine (pid 50)6167client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6168kill QemuMachine (pid 49)6169lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6170kill QemuMachine (pid 51)6171worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6172kill QemuMachine (pid 52)6173worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6174(finished: cleanup, in 1.17 seconds)6175additionally exposed symbols:6176 client, lb, worker1, worker2,6177 vlan1,6178 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh