vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #255
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2: QEMU running (pid 52)14lb # Disk image does not exist, creating the virtualisation disk image...15client # Disk image does not exist, creating the virtualisation disk image...16lb # Formatting '/build/vm-state-lb/tmp.hVKB7FUI1m', fmt=raw size=107374182417worker2 # Formatting '/build/vm-state-worker2/tmp.CbJsz63kLB', fmt=raw size=107374182418client # Formatting '/build/vm-state-client/tmp.m23GqWqytE', fmt=raw size=107374182419worker1: QEMU running (pid 51)20lb # mke2fs 1.47.4 (6-Mar-2025)21worker2 # mke2fs 1.47.4 (6-Mar-2025)22client # mke2fs 1.47.4 (6-Mar-2025)23client: QEMU running (pid 49)24worker1 # Disk image does not exist, creating the virtualisation disk image...25lb: QEMU running (pid 50)26lb # Discarding device blocks: 0/262144 done27worker1 # Formatting '/build/vm-state-worker1/tmp.5jM1ZpkIVN', fmt=raw size=107374182428worker2 # Discarding device blocks: 0/262144 done29client # Discarding device blocks: 0/262144 done30lb # Creating filesystem with 262144 4k blocks and 65536 inodes31worker1 # mke2fs 1.47.4 (6-Mar-2025)32client # Creating filesystem with 262144 4k blocks and 65536 inodes33lb # Filesystem UUID: 8cb2c92a-85a4-4896-9264-a1ce39a4f9cc34worker1 # Discarding device blocks: 0/262144 done35client # Filesystem UUID: b6e2d0ae-d1f1-4def-b2ed-b2796ca7bdd936lb # Superblock backups stored on blocks:37worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes38client # Superblock backups stored on blocks:39lb # 32768, 98304, 163840, 22937640worker1 # Filesystem UUID: 4df9423c-3167-452e-81d0-b5b4e8f0539d41client # 32768, 98304, 163840, 22937642lb # 43worker1 # Superblock backups stored on blocks:44client # 45lb # Allocating group tables: 0/8 done46worker1 # 32768, 98304, 163840, 22937647client # Allocating group tables: 0/8 done48lb # Writing inode tables: 0/8 done49worker1 # 50client # Writing inode tables: 0/8 done51lb # Creating journal (8192 blocks): done52worker1 # Allocating group tables: 0/8 done53client # Creating journal (8192 blocks): done54lb # Writing superblocks and filesystem accounting information: 0/8 done55worker1 # Writing inode tables: 0/8 done56client # Writing superblocks and filesystem accounting information: 0/8 done57lb # 58worker1 # Creating journal (8192 blocks): done59client # 60lb # Virtualisation disk image created.61worker1 # Writing superblocks and filesystem accounting information: 0/8 done62client # Virtualisation disk image created.63(finished: start all VMs, in 0.49 seconds)64worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes65client: waiting for unit network-addresses-eth1.service66worker2 # Filesystem UUID: aec858d2-5d06-438b-9c8f-f6d3d233f71467client: waiting for the VM to finish booting68worker2 # Superblock backups stored on blocks:69worker1 # 70worker2 # 32768, 98304, 163840, 22937671worker1 # Virtualisation disk image created.72worker2 # 73worker2 # Allocating group tables: 0/8 done74worker2 # Writing inode tables: 0/8 done75worker2 # Creating journal (8192 blocks): done76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker2 # [ 0.000000] KASLR enabled82worker2 # [ 0.000000] random: crng init done83worker2 # [ 0.000000] Machine model: linux,dummy-virt84worker2 # [ 0.000000] efi: UEFI not found.85worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88worker2 # [ 0.000000] Zone ranges:89worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90worker2 # [ 0.000000] DMA32 empty91worker2 # [ 0.000000] Normal empty92worker2 # [ 0.000000] Device empty93worker2 # [ 0.000000] Movable zone start for each node94worker2 # [ 0.000000] Early memory node ranges95worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098worker2 # [ 0.000000] psci: probing for conduit method from DT.99worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.100worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101worker2 # [ 0.000000] psci: Trusted OS migration not required102worker2 # [ 0.000000] psci: SMC Calling Convention v1.1103worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105worker2 # [ 0.000000] Detected PIPT I-cache on CPU0106worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface108worker2 # [ 0.000000] CPU features: detected: Spectre-v4109worker2 # [ 0.000000] CPU features: detected: Spectre-BHB110worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112worker2 # [ 0.000000] alternatives: applying boot alternatives113worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1d3l1q1rzfvh0f7kbcwmr9fszyp0b0dz-nixos-system-worker2-test/init regInfo=/nix/store/ff87zia02lc2pva4ypygaxx75p990h0m-closure-info/registration console=ttyAMA0,115200n8 console=tty0114worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ff87zia02lc2pva4ypygaxx75p990h0m-closure-info/registration", will be passed to user space.115worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119worker2 # [ 0.000000] software IO TLB: area num 1.120worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122worker2 # [ 0.000000] Fallback order for Node 0: 0123worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124worker2 # [ 0.000000] Policy zone: DMA125worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127worker2 # [ 0.000000] allocated 3145728 bytes of page_ext128worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups130worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.131worker2 # [ 0.000000] rcu: RCU event tracing is enabled.132worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.134worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.135worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.136worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.139worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0142worker2 # [ 0.000000] GICv3: 256 SPIs implemented143worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented144worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq145worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI146worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0147worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000148worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]149worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)150worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)151worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000152worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000153worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.154worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns155worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).156worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns157worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns158worker2 # [ 0.000034] arm-pv: using stolen time PV159worker2 # [ 0.000649] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)160worker2 # [ 0.000818] Console: colour dummy device 80x25161worker2 # [ 0.000826] printk: legacy console [tty0] enabled162worker2 # [ 0.001013] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)163worker2 # [ 0.001019] pid_max: default: 32768 minimum: 301164worker2 # [ 0.001088] LSM: initializing lsm=capability,landlock,yama,bpf,ima165worker2 # [ 0.001258] landlock: Up and running.166worker2 # [ 0.001261] Yama: becoming mindful.167worker2 # [ 0.001920] LSM support for eBPF active168worker2 # [ 0.002091] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)169worker2 # [ 0.002129] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)170worker2 # [ 0.003237] cacheinfo: Unable to detect cache hierarchy for CPU 0171worker2 # [ 0.003976] rcu: Hierarchical SRCU implementation.172worker2 # [ 0.003979] rcu: Max phase no-delay instances is 1000.173worker2 # [ 0.005173] fsl-mc MSI: its@8080000 domain created174worker2 # [ 0.005262] EFI services will not be available.175worker2 # [ 0.005370] smp: Bringing up secondary CPUs ...176worker2 # [ 0.005378] smp: Brought up 1 node, 1 CPU177worker2 # [ 0.005381] SMP: Total of 1 processors activated.178worker2 # [ 0.005387] CPU: All CPU(s) started at EL1179worker2 # [ 0.005398] CPU features: detected: Branch Target Identification180worker2 # [ 0.005403] CPU features: detected: ARMv8.4 Translation Table Level181worker2 # [ 0.005406] CPU features: detected: Instruction cache invalidation not required for I/D coherence182worker2 # [ 0.005410] CPU features: detected: Data cache clean to the PoU not required for I/D coherence183worker2 # [ 0.005413] CPU features: detected: Common not Private translations184worker2 # [ 0.005416] CPU features: detected: CRC32 instructions185worker2 # [ 0.005419] CPU features: detected: Data cache clean to Point of Deep Persistence186worker2 # [ 0.005423] CPU features: detected: Data cache clean to Point of Persistence187worker2 # [ 0.005426] CPU features: detected: Data independent timing control (DIT)188worker2 # [ 0.005429] CPU features: detected: E0PD189worker2 # [ 0.005432] CPU features: detected: Enhanced Counter Virtualization190worker2 # [ 0.005435] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)191client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]192worker2 # [ 0.005439] CPU features: detected: Enhanced Virtualization Traps193worker2 # [ 0.005441] CPU features: detected: Fine Grained Traps194client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026195client # [ 0.000000] KASLR enabled196worker2 # [ 0.005445] CPU features: detected: Generic authentication (architected QARMA5 algorithm)197client # [ 0.000000] random: crng init done198client # [ 0.000000] Machine model: linux,dummy-virt199worker2 # [ 0.005449] CPU features: detected: RCpc load-acquire (LDAPR)200client # [ 0.000000] efi: UEFI not found.201worker2 # [ 0.005452] CPU features: detected: LSE atomic instructions202client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT203worker2 # [ 0.005455] CPU features: detected: Privileged Access Never204worker2 # [ 0.005458] CPU features: detected: PMUv3205client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]206client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]207client # [ 0.000000] Zone ranges:208worker2 # [ 0.005460] CPU features: detected: RAS Extension Support209client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]210worker2 # [ 0.005463] CPU features: detected: RASv1p1 Extension Support211client # [ 0.000000] DMA32 empty212client # [ 0.000000] Normal empty213worker2 # [ 0.005466] CPU features: detected: Random Number Generator214client # [ 0.000000] Device empty215lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]216worker2 # [ 0.005469] CPU features: detected: Speculation barrier (SB)217client # [ 0.000000] Movable zone start for each node218client # [ 0.000000] Early memory node ranges219worker2 # [ 0.005472] CPU features: detected: Stage-2 Force Write-Back220worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]221client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]222lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026223worker2 # [ 0.005475] CPU features: detected: TLB range maintenance instructions224lb # [ 0.000000] KASLR enabled225client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]226lb # [ 0.000000] random: crng init done227worker2 # [ 0.005479] CPU features: detected: Speculative Store Bypassing Safe (SSBS)228lb # [ 0.000000] Machine model: linux,dummy-virt229client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000230worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026231worker2 # [ 0.005541] alternatives: applying system-wide alternatives232lb # [ 0.000000] efi: UEFI not found.233worker1 # [ 0.000000] KASLR enabled234client # [ 0.000000] psci: probing for conduit method from DT.235worker1 # [ 0.000000] random: crng init done236worker2 # [ 0.008554] CPU features: detected: BBM Level 2 without TLB conflict abort237client # [ 0.000000] psci: PSCIv1.3 detected in firmware.238lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT239worker1 # [ 0.000000] Machine model: linux,dummy-virt240client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs241worker1 # [ 0.000000] efi: UEFI not found.242lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]243client # [ 0.000000] psci: Trusted OS migration not required244worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT245lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]246worker2 # [ 0.008710] Memory: 1406548K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)247client # [ 0.000000] psci: SMC Calling Convention v1.1248worker2 # [ 0.009118] devtmpfs: initialized249lb # [ 0.000000] Zone ranges:250worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]251lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]252client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)253worker2 # [ 0.010914] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)254lb # [ 0.000000] DMA32 empty255worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]256lb # [ 0.000000] Normal empty257worker1 # [ 0.000000] Zone ranges:258client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296259lb # [ 0.000000] Device empty260worker2 # [ 0.010937] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).261client # [ 0.000000] Detected PIPT I-cache on CPU0262worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]263lb # [ 0.000000] Movable zone start for each node264worker1 # [ 0.000000] DMA32 empty265worker2 # [ 0.011152] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL266lb # [ 0.000000] Early memory node ranges267worker1 # [ 0.000000] Normal empty268client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)269worker2 # [ 0.011157] 0 pages in range for non-PLT usage270worker1 # [ 0.000000] Device empty271lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]272client # [ 0.000000] CPU features: detected: GICv3 CPU interface273worker2 # [ 0.011158] 508288 pages in range for PLT usage274worker1 # [ 0.000000] Movable zone start for each node275client # [ 0.000000] CPU features: detected: Spectre-v4276worker1 # [ 0.000000] Early memory node ranges277lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]278worker2 # [ 0.011270] pinctrl core: initialized pinctrl subsystem279client # [ 0.000000] CPU features: detected: Spectre-BHB280worker2 # [ 0.012063] DMI not present or invalid.281lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000282worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]283client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38284worker2 # [ 0.015787] NET: Registered PF_NETLINK/PF_ROUTE protocol family285lb # [ 0.000000] psci: probing for conduit method from DT.286worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]287lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.288client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23289worker2 # [ 0.018023] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations290worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000291lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs292client # [ 0.000000] alternatives: applying boot alternatives293worker1 # [ 0.000000] psci: probing for conduit method from DT.294lb # [ 0.000000] psci: Trusted OS migration not required295worker2 # [ 0.018223] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations296worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.297lb # [ 0.000000] psci: SMC Calling Convention v1.1298worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs299worker2 # [ 0.018427] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations300worker1 # [ 0.000000] psci: Trusted OS migration not required301worker2 # [ 0.018449] audit: initializing netlink subsys (disabled)302lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)303worker1 # [ 0.000000] psci: SMC Calling Convention v1.1304worker2 # [ 0.019070] thermal_sys: Registered thermal governor 'fair_share'305lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296306lb # [ 0.000000] Detected PIPT I-cache on CPU0307worker2 # [ 0.019072] thermal_sys: Registered thermal governor 'bang_bang'308worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)309client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test/init regInfo=/nix/store/bs9wr4dhg08lmmqzzj6b672rzvy73rhp-closure-info/registration console=ttyAMA0,115200n8 console=tty0310worker2 # [ 0.019076] thermal_sys: Registered thermal governor 'step_wise'311lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)312worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296313worker1 # [ 0.000000] Detected PIPT I-cache on CPU0314worker2 # [ 0.019082] thermal_sys: Registered thermal governor 'user_space'315lb # [ 0.000000] CPU features: detected: GICv3 CPU interface316lb # [ 0.000000] CPU features: detected: Spectre-v4317client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/bs9wr4dhg08lmmqzzj6b672rzvy73rhp-closure-info/registration", will be passed to user space.318worker2 # [ 0.019084] thermal_sys: Registered thermal governor 'power_allocator'319worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)320lb # [ 0.000000] CPU features: detected: Spectre-BHB321client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes322worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface323worker2 # [ 0.019113] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1324lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38325worker1 # [ 0.000000] CPU features: detected: Spectre-v4326worker2 # [ 0.019121] cpuidle: using governor ladder327client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)328lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23329worker1 # [ 0.000000] CPU features: detected: Spectre-BHB330worker2 # [ 0.019128] cpuidle: using governor menu331lb # [ 0.000000] alternatives: applying boot alternatives332client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)333worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38334worker2 # [ 0.019323] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.335client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB336worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23337worker2 # [ 0.019340] ASID allocator initialised with 65536 entries338worker2 # [ 0.020615] Serial: AMBA PL011 UART driver339client # [ 0.000000] software IO TLB: area num 1.340worker1 # [ 0.000000] alternatives: applying boot alternatives341client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB342worker2 # [ 0.026049] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1343worker2 # [ 0.026178] printk: console [ttyAMA0] enabled344client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)345client # [ 0.000000] Fallback order for Node 0: 0346lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0347client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216348client # [ 0.000000] Policy zone: DMA349client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off350worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j8hg5v2mna41b2rmqffhgiw2p9n7fx0y-nixos-system-worker1-test/init regInfo=/nix/store/jsp8jrhhk8b4cd1nrwsv3w1mv7c8x67x-closure-info/registration console=ttyAMA0,115200n8 console=tty0351lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.352client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1353lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes354client # [ 0.000000] allocated 3145728 bytes of page_ext355worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/jsp8jrhhk8b4cd1nrwsv3w1mv7c8x67x-closure-info/registration", will be passed to user space.356client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages357lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)358client # [ 0.000000] ftrace: allocated 294 pages with 4 groups359worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes360lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)361client # [ 0.000000] rcu: Hierarchical RCU implementation.362worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)363client # [ 0.000000] rcu: RCU event tracing is enabled.364lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB365client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.366worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)367lb # [ 0.000000] software IO TLB: area num 1.368client # [ 0.000000] Trampoline variant of Tasks RCU enabled.369worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB370client # [ 0.000000] Rude variant of Tasks RCU enabled.371lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB372worker1 # [ 0.000000] software IO TLB: area num 1.373client # [ 0.000000] Tracing variant of Tasks RCU enabled.374worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB375lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)376lb # [ 0.000000] Fallback order for Node 0: 0377client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.378worker2 # [ 0.149302] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages379worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)380lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216381client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1382worker2 # [ 0.149321] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page383worker1 # [ 0.000000] Fallback order for Node 0: 0384lb # [ 0.000000] Policy zone: DMA385worker2 # [ 0.149326] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages386worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216387client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.388lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off389worker1 # [ 0.000000] Policy zone: DMA390worker2 # [ 0.149331] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page391lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1392worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off393client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.394worker2 # [ 0.149335] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages395lb # [ 0.000000] allocated 3145728 bytes of page_ext396worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1397lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages398client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.399worker2 # [ 0.149339] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page400worker1 # [ 0.000000] allocated 3145728 bytes of page_ext401lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups402client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0403worker2 # [ 0.149343] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages404worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages405client # [ 0.000000] GICv3: 256 SPIs implemented406lb # [ 0.000000] rcu: Hierarchical RCU implementation.407worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups408worker2 # [ 0.149347] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page409client # [ 0.000000] GICv3: 0 Extended SPIs implemented410lb # [ 0.000000] rcu: RCU event tracing is enabled.411worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.412client # [ 0.000000] Root IRQ handler: gic_handle_irq413lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.414worker1 # [ 0.000000] rcu: RCU event tracing is enabled.415client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI416lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.417client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0418worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.419lb # [ 0.000000] Rude variant of Tasks RCU enabled.420worker2 # [ 0.156523] fbcon: Taking over console421worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.422client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000423lb # [ 0.000000] Tracing variant of Tasks RCU enabled.424worker2 # [ 0.156537] ACPI: Interpreter disabled.425worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.426client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]427worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.428worker2 # [ 0.158401] iommu: Default domain type: Translated429lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.430client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)431worker2 # [ 0.158411] iommu: DMA domain TLB invalidation policy: strict mode432lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1433worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.434worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1435client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)436lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.437client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000438worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.439lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.440client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000441worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.442lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.443client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.444lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0445worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.446lb # [ 0.000000] GICv3: 256 SPIs implemented447client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns448worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0449lb # [ 0.000000] GICv3: 0 Extended SPIs implemented450client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).451worker1 # [ 0.000000] GICv3: 256 SPIs implemented452lb # [ 0.000000] Root IRQ handler: gic_handle_irq453worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented454lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI455worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq456client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns457worker2 # [ 0.165690] SCSI subsystem initialized458lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0459worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI460lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000461worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0462client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns463lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]464client # [ 0.000030] arm-pv: using stolen time PV465worker2 # [ 0.166362] usbcore: registered new interface driver usbfs466worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000467worker2 # [ 0.166394] usbcore: registered new interface driver hub468worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]469lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)470client # [ 0.000415] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)471worker2 # [ 0.166420] usbcore: registered new device driver usb472client # [ 0.000569] Console: colour dummy device 80x25473worker2 # [ 0.166706] pps_core: LinuxPPS API ver. 1 registered474worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)475client # [ 0.000577] printk: legacy console [tty0] enabled476lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)477lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000478worker2 # [ 0.166712] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>479worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)480client # [ 0.000762] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)481worker2 # [ 0.166723] PTP clock support registered482lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000483worker2 # [ 0.166778] EDAC MC: Ver: 3.0.0484worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000485client # [ 0.000769] pid_max: default: 32768 minimum: 301486lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.487client # [ 0.000841] LSM: initializing lsm=capability,landlock,yama,bpf,ima488worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000489worker2 # [ 0.171278] scmi_core: SCMI protocol bus registered490client # [ 0.000983] landlock: Up and running.491worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.492client # [ 0.000986] Yama: becoming mindful.493worker2 # [ 0.172206] FPGA manager framework494lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns495client # [ 0.001407] LSM support for eBPF active496worker2 # [ 0.173113] vgaarb: loaded497lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).498worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns499client # [ 0.001552] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)500worker2 # [ 0.173734] clocksource: Switched to clocksource arch_sys_counter501worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).502client # [ 0.001589] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)503lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns504client # [ 0.002651] cacheinfo: Unable to detect cache hierarchy for CPU 0505worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns506lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns507client # [ 0.003341] rcu: Hierarchical SRCU implementation.508lb # [ 0.000030] arm-pv: using stolen time PV509client # [ 0.003344] rcu: Max phase no-delay instances is 1000.510worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns511worker2 # [ 0.176529] VFS: Disk quotas dquot_6.6.0512worker1 # [ 0.000027] arm-pv: using stolen time PV513client # [ 0.004533] fsl-mc MSI: its@8080000 domain created514lb # [ 0.000402] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)515worker2 # [ 0.176565] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)516client # [ 0.004622] EFI services will not be available.517lb # [ 0.000562] Console: colour dummy device 80x25518client # [ 0.004700] smp: Bringing up secondary CPUs ...519worker1 # [ 0.000402] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)520lb # [ 0.000569] printk: legacy console [tty0] enabled521client # [ 0.004709] smp: Brought up 1 node, 1 CPU522worker1 # [ 0.000550] Console: colour dummy device 80x25523client # [ 0.004712] SMP: Total of 1 processors activated.524worker1 # [ 0.000558] printk: legacy console [tty0] enabled525lb # [ 0.000815] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)526client # [ 0.004717] CPU: All CPU(s) started at EL1527lb # [ 0.000822] pid_max: default: 32768 minimum: 301528client # [ 0.004727] CPU features: detected: Branch Target Identification529worker2 # [ 0.180152] netfs: FS-Cache loaded530worker1 # [ 0.000742] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)531worker2 # [ 0.180272] pnp: PnP ACPI: disabled532lb # [ 0.000896] LSM: initializing lsm=capability,landlock,yama,bpf,ima533client # [ 0.004732] CPU features: detected: ARMv8.4 Translation Table Level534worker1 # [ 0.000748] pid_max: default: 32768 minimum: 301535lb # [ 0.001026] landlock: Up and running.536lb # [ 0.001028] Yama: becoming mindful.537worker1 # [ 0.000814] LSM: initializing lsm=capability,landlock,yama,bpf,ima538client # [ 0.004735] CPU features: detected: Instruction cache invalidation not required for I/D coherence539lb # [ 0.001476] LSM support for eBPF active540worker1 # [ 0.000946] landlock: Up and running.541worker1 # [ 0.000948] Yama: becoming mindful.542lb # [ 0.001616] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)543client # [ 0.004739] CPU features: detected: Data cache clean to the PoU not required for I/D coherence544worker1 # [ 0.001409] LSM support for eBPF active545client # [ 0.004742] CPU features: detected: Common not Private translations546worker1 # [ 0.001549] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)547lb # [ 0.001648] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)548client # [ 0.004745] CPU features: detected: CRC32 instructions549lb # [ 0.002752] cacheinfo: Unable to detect cache hierarchy for CPU 0550worker1 # [ 0.001581] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)551lb # [ 0.003438] rcu: Hierarchical SRCU implementation.552client # [ 0.004748] CPU features: detected: Data cache clean to Point of Deep Persistence553worker1 # [ 0.002626] cacheinfo: Unable to detect cache hierarchy for CPU 0554lb # [ 0.003441] rcu: Max phase no-delay instances is 1000.555worker2 # [ 0.184056] NET: Registered PF_INET protocol family556client # [ 0.004752] CPU features: detected: Data cache clean to Point of Persistence557worker1 # [ 0.003322] rcu: Hierarchical SRCU implementation.558lb # [ 0.004598] fsl-mc MSI: its@8080000 domain created559worker1 # [ 0.003326] rcu: Max phase no-delay instances is 1000.560client # [ 0.004755] CPU features: detected: Data independent timing control (DIT)561worker2 # [ 0.184322] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)562lb # [ 0.004703] EFI services will not be available.563client # [ 0.004758] CPU features: detected: E0PD564worker1 # [ 0.004515] fsl-mc MSI: its@8080000 domain created565lb # [ 0.004770] smp: Bringing up secondary CPUs ...566worker1 # [ 0.004603] EFI services will not be available.567lb # [ 0.004778] smp: Brought up 1 node, 1 CPU568client # [ 0.004761] CPU features: detected: Enhanced Counter Virtualization569worker1 # [ 0.004679] smp: Bringing up secondary CPUs ...570lb # [ 0.004781] SMP: Total of 1 processors activated.571worker1 # [ 0.004687] smp: Brought up 1 node, 1 CPU572client # [ 0.004764] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)573lb # [ 0.004786] CPU: All CPU(s) started at EL1574worker1 # [ 0.004691] SMP: Total of 1 processors activated.575client # [ 0.004767] CPU features: detected: Enhanced Virtualization Traps576lb # [ 0.004796] CPU features: detected: Branch Target Identification577worker1 # [ 0.004696] CPU: All CPU(s) started at EL1578client # [ 0.004770] CPU features: detected: Fine Grained Traps579lb # [ 0.004801] CPU features: detected: ARMv8.4 Translation Table Level580worker1 # [ 0.004707] CPU features: detected: Branch Target Identification581client # [ 0.004773] CPU features: detected: Generic authentication (architected QARMA5 algorithm)582worker1 # [ 0.004712] CPU features: detected: ARMv8.4 Translation Table Level583lb # [ 0.004805] CPU features: detected: Instruction cache invalidation not required for I/D coherence584client # [ 0.004777] CPU features: detected: RCpc load-acquire (LDAPR)585worker1 # [ 0.004715] CPU features: detected: Instruction cache invalidation not required for I/D coherence586client # [ 0.004780] CPU features: detected: LSE atomic instructions587lb # [ 0.004808] CPU features: detected: Data cache clean to the PoU not required for I/D coherence588client # [ 0.004783] CPU features: detected: Privileged Access Never589lb # [ 0.004812] CPU features: detected: Common not Private translations590worker1 # [ 0.004718] CPU features: detected: Data cache clean to the PoU not required for I/D coherence591client # [ 0.004785] CPU features: detected: PMUv3592lb # [ 0.004815] CPU features: detected: CRC32 instructions593worker1 # [ 0.004722] CPU features: detected: Common not Private translations594client # [ 0.004788] CPU features: detected: RAS Extension Support595lb # [ 0.004818] CPU features: detected: Data cache clean to Point of Deep Persistence596worker1 # [ 0.004725] CPU features: detected: CRC32 instructions597client # [ 0.004791] CPU features: detected: RASv1p1 Extension Support598client # [ 0.004793] CPU features: detected: Random Number Generator599lb # [ 0.004821] CPU features: detected: Data cache clean to Point of Persistence600worker1 # [ 0.004728] CPU features: detected: Data cache clean to Point of Deep Persistence601client # [ 0.004796] CPU features: detected: Speculation barrier (SB)602lb # [ 0.004825] CPU features: detected: Data independent timing control (DIT)603worker1 # [ 0.004732] CPU features: detected: Data cache clean to Point of Persistence604lb # [ 0.004828] CPU features: detected: E0PD605client # [ 0.004799] CPU features: detected: Stage-2 Force Write-Back606worker1 # [ 0.004735] CPU features: detected: Data independent timing control (DIT)607lb # [ 0.004830] CPU features: detected: Enhanced Counter Virtualization608client # [ 0.004801] CPU features: detected: TLB range maintenance instructions609worker1 # [ 0.004738] CPU features: detected: E0PD610client # [ 0.004805] CPU features: detected: Speculative Store Bypassing Safe (SSBS)611lb # [ 0.004833] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)612worker1 # [ 0.004741] CPU features: detected: Enhanced Counter Virtualization613client # [ 0.004841] alternatives: applying system-wide alternatives614lb # [ 0.004836] CPU features: detected: Enhanced Virtualization Traps615worker1 # [ 0.004744] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)616lb # [ 0.004839] CPU features: detected: Fine Grained Traps617client # [ 0.007724] CPU features: detected: BBM Level 2 without TLB conflict abort618worker1 # [ 0.004747] CPU features: detected: Enhanced Virtualization Traps619worker1 # [ 0.004750] CPU features: detected: Fine Grained Traps620lb # [ 0.004843] CPU features: detected: Generic authentication (architected QARMA5 algorithm)621lb # [ 0.004848] CPU features: detected: RCpc load-acquire (LDAPR)622client # [ 0.007910] Memory: 1406496K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)623worker1 # [ 0.004754] CPU features: detected: Generic authentication (architected QARMA5 algorithm)624client # [ 0.008312] devtmpfs: initialized625lb # [ 0.004851] CPU features: detected: LSE atomic instructions626worker1 # [ 0.004759] CPU features: detected: RCpc load-acquire (LDAPR)627client # [ 0.010045] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)628lb # [ 0.004854] CPU features: detected: Privileged Access Never629worker1 # [ 0.004762] CPU features: detected: LSE atomic instructions630lb # [ 0.004857] CPU features: detected: PMUv3631worker1 # [ 0.004765] CPU features: detected: Privileged Access Never632client # [ 0.010066] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).633lb # [ 0.004860] CPU features: detected: RAS Extension Support634worker1 # [ 0.004768] CPU features: detected: PMUv3635client # [ 0.010234] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL636lb # [ 0.004863] CPU features: detected: RASv1p1 Extension Support637worker1 # [ 0.004771] CPU features: detected: RAS Extension Support638lb # [ 0.004865] CPU features: detected: Random Number Generator639worker1 # [ 0.004774] CPU features: detected: RASv1p1 Extension Support640client # [ 0.010239] 0 pages in range for non-PLT usage641lb # [ 0.004868] CPU features: detected: Speculation barrier (SB)642worker1 # [ 0.004776] CPU features: detected: Random Number Generator643client # [ 0.010240] 508288 pages in range for PLT usage644lb # [ 0.004871] CPU features: detected: Stage-2 Force Write-Back645worker1 # [ 0.004779] CPU features: detected: Speculation barrier (SB)646client # [ 0.010346] pinctrl core: initialized pinctrl subsystem647client # [ 0.011076] DMI not present or invalid.648lb # [ 0.004874] CPU features: detected: TLB range maintenance instructions649worker1 # [ 0.004782] CPU features: detected: Stage-2 Force Write-Back650client # [ 0.014222] NET: Registered PF_NETLINK/PF_ROUTE protocol family651worker1 # [ 0.004785] CPU features: detected: TLB range maintenance instructions652lb # [ 0.004878] CPU features: detected: Speculative Store Bypassing Safe (SSBS)653client # [ 0.016351] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations654lb # [ 0.004915] alternatives: applying system-wide alternatives655worker1 # [ 0.004789] CPU features: detected: Speculative Store Bypassing Safe (SSBS)656client # [ 0.016530] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations657worker1 # [ 0.004826] alternatives: applying system-wide alternatives658lb # [ 0.007797] CPU features: detected: BBM Level 2 without TLB conflict abort659worker1 # [ 0.007773] CPU features: detected: BBM Level 2 without TLB conflict abort660client # [ 0.016723] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations661client # [ 0.016745] audit: initializing netlink subsys (disabled)662lb # [ 0.008011] Memory: 1406600K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)663lb # [ 0.008405] devtmpfs: initialized664client # [ 0.017285] thermal_sys: Registered thermal governor 'fair_share'665worker1 # [ 0.007987] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)666worker1 # [ 0.008430] devtmpfs: initialized667client # [ 0.017287] thermal_sys: Registered thermal governor 'bang_bang'668lb # [ 0.010189] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)669client # [ 0.017290] thermal_sys: Registered thermal governor 'step_wise'670worker1 # [ 0.010212] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)671lb # [ 0.010210] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).672client # [ 0.017295] thermal_sys: Registered thermal governor 'user_space'673lb # [ 0.010391] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL674worker1 # [ 0.010233] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).675client # [ 0.017297] thermal_sys: Registered thermal governor 'power_allocator'676lb # [ 0.010395] 0 pages in range for non-PLT usage677worker1 # [ 0.010416] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL678lb # [ 0.010396] 508288 pages in range for PLT usage679worker1 # [ 0.010421] 0 pages in range for non-PLT usage680client # [ 0.017321] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1681lb # [ 0.010498] pinctrl core: initialized pinctrl subsystem682client # [ 0.017332] cpuidle: using governor ladder683worker1 # [ 0.010422] 508288 pages in range for PLT usage684client # [ 0.017337] cpuidle: using governor menu685worker1 # [ 0.010529] pinctrl core: initialized pinctrl subsystem686worker1 # [ 0.011273] DMI not present or invalid.687client # [ 0.017547] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.688worker1 # [ 0.014419] NET: Registered PF_NETLINK/PF_ROUTE protocol family689client # [ 0.017561] ASID allocator initialised with 65536 entries690client # [ 0.018716] Serial: AMBA PL011 UART driver691worker1 # [ 0.016616] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations692client # [ 0.023817] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1693worker1 # [ 0.016803] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations694client # [ 0.023942] printk: console [ttyAMA0] enabled695worker1 # [ 0.016999] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations696worker1 # [ 0.017018] audit: initializing netlink subsys (disabled)697worker1 # [ 0.017561] thermal_sys: Registered thermal governor 'fair_share'698worker2 # [ 0.213039] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)699worker1 # [ 0.017563] thermal_sys: Registered thermal governor 'bang_bang'700worker1 # [ 0.017566] thermal_sys: Registered thermal governor 'step_wise'701worker2 # [ 0.213082] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)702worker1 # [ 0.017571] thermal_sys: Registered thermal governor 'user_space'703lb # [ 0.011231] DMI not present or invalid.704worker2 # [ 0.213109] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)705worker1 # [ 0.017574] thermal_sys: Registered thermal governor 'power_allocator'706lb # [ 0.014361] NET: Registered PF_NETLINK/PF_ROUTE protocol family707worker2 # [ 0.213182] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)708worker1 # [ 0.017603] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1709lb # [ 0.016536] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations710worker2 # [ 0.213329] TCP: Hash tables configured (established 16384 bind 16384)711worker1 # [ 0.017612] cpuidle: using governor ladder712client # [ 0.140582] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages713lb # [ 0.016728] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations714worker2 # [ 0.213403] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)715client # [ 0.140600] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page716worker1 # [ 0.017618] cpuidle: using governor menu717lb # [ 0.016921] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations718worker2 # [ 0.213443] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)719client # [ 0.140606] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages720lb # [ 0.016942] audit: initializing netlink subsys (disabled)721worker1 # [ 0.017795] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.722worker2 # [ 0.213478] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)723client # [ 0.140610] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page724worker1 # [ 0.017810] ASID allocator initialised with 65536 entries725lb # [ 0.017452] thermal_sys: Registered thermal governor 'fair_share'726worker2 # [ 0.213581] NET: Registered PF_UNIX/PF_LOCAL protocol family727worker1 # [ 0.018942] Serial: AMBA PL011 UART driver728client # [ 0.140614] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages729lb # [ 0.017454] thermal_sys: Registered thermal governor 'bang_bang'730worker2 # [ 0.213604] NET: Registered PF_XDP protocol family731worker2 # [ 0.213620] PCI: CLS 0 bytes, default 64732client # [ 0.140619] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page733lb # [ 0.017457] thermal_sys: Registered thermal governor 'step_wise'734worker1 # [ 0.024010] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1735worker1 # [ 0.024154] printk: console [ttyAMA0] enabled736worker2 # [ 0.213818] Trying to unpack rootfs image as initramfs...737lb # [ 0.017462] thermal_sys: Registered thermal governor 'user_space'738client # [ 0.140623] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages739client # [ 0.140627] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page740lb # [ 0.017465] thermal_sys: Registered thermal governor 'power_allocator'741lb # [ 0.017502] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1742lb # [ 0.017512] cpuidle: using governor ladder743lb # [ 0.017518] cpuidle: using governor menu744client # [ 0.147820] fbcon: Taking over console745client # [ 0.147834] ACPI: Interpreter disabled.746lb # [ 0.017693] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.747lb # [ 0.017707] ASID allocator initialised with 65536 entries748lb # [ 0.018832] Serial: AMBA PL011 UART driver749lb # [ 0.024133] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1750lb # [ 0.024257] printk: console [ttyAMA0] enabled751worker2 # [ 0.231153] kvm [1]: HYP mode not available752lb # [ 0.144821] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages753lb # [ 0.144839] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page754worker1 # [ 0.144445] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages755lb # [ 0.144844] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages756worker1 # [ 0.144463] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page757lb # [ 0.144849] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page758worker1 # [ 0.144468] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages759lb # [ 0.144853] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages760worker1 # [ 0.144473] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page761lb # [ 0.144857] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page762client # [ 0.156821] iommu: Default domain type: Translated763worker1 # [ 0.144477] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages764lb # [ 0.144862] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages765client # [ 0.156832] iommu: DMA domain TLB invalidation policy: strict mode766worker1 # [ 0.144481] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page767client # [ 0.157168] SCSI subsystem initialized768lb # [ 0.144866] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page769worker1 # [ 0.144486] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages770worker1 # [ 0.144490] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page771client # [ 0.159101] usbcore: registered new interface driver usbfs772client # [ 0.159133] usbcore: registered new interface driver hub773lb # [ 0.152293] fbcon: Taking over console774client # [ 0.159151] usbcore: registered new device driver usb775lb # [ 0.152310] ACPI: Interpreter disabled.776client # [ 0.159421] pps_core: LinuxPPS API ver. 1 registered777worker1 # [ 0.151926] fbcon: Taking over console778lb # [ 0.154215] iommu: Default domain type: Translated779worker1 # [ 0.151942] ACPI: Interpreter disabled.780client # [ 0.159427] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>781lb # [ 0.154225] iommu: DMA domain TLB invalidation policy: strict mode782worker1 # [ 0.153806] iommu: Default domain type: Translated783client # [ 0.159437] PTP clock support registered784client # [ 0.159491] EDAC MC: Ver: 3.0.0785lb # [ 0.155927] SCSI subsystem initialized786worker1 # [ 0.153816] iommu: DMA domain TLB invalidation policy: strict mode787client # [ 0.164197] scmi_core: SCMI protocol bus registered788worker1 # [ 0.155494] SCSI subsystem initialized789client # [ 0.165209] FPGA manager framework790worker1 # [ 0.156194] usbcore: registered new interface driver usbfs791client # [ 0.166165] vgaarb: loaded792worker1 # [ 0.156226] usbcore: registered new interface driver hub793client # [ 0.166832] clocksource: Switched to clocksource arch_sys_counter794worker1 # [ 0.156244] usbcore: registered new device driver usb795worker1 # [ 0.156488] pps_core: LinuxPPS API ver. 1 registered796worker1 # [ 0.156494] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>797worker1 # [ 0.156504] PTP clock support registered798lb # [ 0.161198] usbcore: registered new interface driver usbfs799worker1 # [ 0.156559] EDAC MC: Ver: 3.0.0800lb # [ 0.161229] usbcore: registered new interface driver hub801worker1 # [ 0.161224] scmi_core: SCMI protocol bus registered802lb # [ 0.161247] usbcore: registered new device driver usb803lb # [ 0.161511] pps_core: LinuxPPS API ver. 1 registered804worker1 # [ 0.162200] FPGA manager framework805lb # [ 0.161517] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>806lb # [ 0.161533] PTP clock support registered807client # [ 0.172932] VFS: Disk quotas dquot_6.6.0808lb # [ 0.161580] EDAC MC: Ver: 3.0.0809client # [ 0.172972] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)810lb # [ 0.166208] scmi_core: SCMI protocol bus registered811client # [ 0.174587] netfs: FS-Cache loaded812client # [ 0.174709] pnp: PnP ACPI: disabled813lb # [ 0.167152] FPGA manager framework814lb # [ 0.168112] vgaarb: loaded815lb # [ 0.168739] clocksource: Switched to clocksource arch_sys_counter816worker1 # [ 0.168785] vgaarb: loaded817client # [ 0.178574] NET: Registered PF_INET protocol family818worker1 # [ 0.169480] clocksource: Switched to clocksource arch_sys_counter819lb # [ 0.172331] VFS: Disk quotas dquot_6.6.0820lb # [ 0.172358] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)821worker1 # [ 0.172756] VFS: Disk quotas dquot_6.6.0822client # [ 0.179467] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)823lb # [ 0.175919] netfs: FS-Cache loaded824lb # [ 0.176045] pnp: PnP ACPI: disabled825worker1 # [ 0.175356] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)826worker1 # [ 0.176494] netfs: FS-Cache loaded827worker1 # [ 0.176603] pnp: PnP ACPI: disabled828lb # [ 0.179815] NET: Registered PF_INET protocol family829lb # [ 0.180062] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)830worker1 # [ 0.180528] NET: Registered PF_INET protocol family831worker1 # [ 0.180777] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832client # [ 0.208201] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833client # [ 0.208245] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834client # [ 0.208270] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835client # [ 0.208347] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836client # [ 0.208497] TCP: Hash tables configured (established 16384 bind 16384)837client # [ 0.208575] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838client # [ 0.208611] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839client # [ 0.208647] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840client # [ 0.208781] NET: Registered PF_UNIX/PF_LOCAL protocol family841client # [ 0.208810] NET: Registered PF_XDP protocol family842client # [ 0.208826] PCI: CLS 0 bytes, default 64843client # [ 0.209052] Trying to unpack rootfs image as initramfs...844lb # [ 0.209052] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)845lb # [ 0.209097] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)846lb # [ 0.209125] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)847worker1 # [ 0.209824] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)848lb # [ 0.209195] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849worker1 # [ 0.209871] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)850lb # [ 0.209339] TCP: Hash tables configured (established 16384 bind 16384)851worker1 # [ 0.209898] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)852lb # [ 0.209419] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)853worker1 # [ 0.209969] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)854lb # [ 0.209454] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)855worker1 # [ 0.210111] TCP: Hash tables configured (established 16384 bind 16384)856client # [ 0.224390] kvm [1]: HYP mode not available857lb # [ 0.209490] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)858worker1 # [ 0.210202] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)859lb # [ 0.209591] NET: Registered PF_UNIX/PF_LOCAL protocol family860lb # [ 0.209613] NET: Registered PF_XDP protocol family861worker1 # [ 0.210238] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)862lb # [ 0.209629] PCI: CLS 0 bytes, default 64863worker1 # [ 0.210274] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)864lb # [ 0.209858] Trying to unpack rootfs image as initramfs...865worker1 # [ 0.210363] NET: Registered PF_UNIX/PF_LOCAL protocol family866worker1 # [ 0.210386] NET: Registered PF_XDP protocol family867worker1 # [ 0.210404] PCI: CLS 0 bytes, default 64868worker1 # [ 0.210647] Trying to unpack rootfs image as initramfs...869lb # [ 0.226492] kvm [1]: HYP mode not available870worker2 # [ 0.326297] Initialise system trusted keyrings871worker2 # [ 0.327040] workingset: timestamp_bits=42 max_order=19 bucket_order=0872worker1 # [ 0.227310] kvm [1]: HYP mode not available873worker2 # [ 0.328306] squashfs: version 4.0 (2009/01/31) Phillip Lougher874worker2 # [ 0.329076] 9p: Installing v9fs 9p2000 file system support875worker2 # [ 0.349643] Key type asymmetric registered876worker2 # [ 0.349666] Asymmetric key parser 'x509' registered877worker2 # [ 0.357773] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878worker2 # [ 0.358838] io scheduler mq-deadline registered879worker2 # [ 0.358849] io scheduler kyber registered880worker2 # [ 0.369856] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881worker2 # [ 0.371244] ledtrig-cpu: registered to indicate activity on CPUs882worker2 # [ 0.371632] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:883worker2 # [ 0.371651] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000884worker2 # [ 0.371663] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000885worker2 # [ 0.371671] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000886worker2 # [ 0.371690] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits887worker2 # [ 0.371717] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]888worker2 # [ 0.371795] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00889worker2 # [ 0.371804] pci_bus 0000:00: root bus resource [bus 00-ff]890worker2 # [ 0.371811] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]891worker2 # [ 0.371816] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]892worker2 # [ 0.371821] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]893worker2 # [ 0.371881] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint894worker2 # [ 0.372323] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint895worker2 # [ 0.372510] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]896worker2 # [ 0.372527] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]897worker2 # [ 0.372556] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]898worker2 # [ 0.372572] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]899worker2 # [ 0.373018] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint900worker2 # [ 0.373198] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]901worker2 # [ 0.373213] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]902worker2 # [ 0.373243] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]903worker2 # [ 0.373702] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint904worker2 # [ 0.393674] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]905worker2 # [ 0.393695] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]906worker2 # [ 0.393724] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]907worker2 # [ 0.396324] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint908worker2 # [ 0.396507] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]909worker2 # [ 0.396522] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]910worker2 # [ 0.396555] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]911client # [ 0.315374] Initialise system trusted keyrings912worker2 # [ 0.397005] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint913client # [ 0.316129] workingset: timestamp_bits=42 max_order=19 bucket_order=0914worker2 # [ 0.397184] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]915worker2 # [ 0.397199] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]916client # [ 0.317405] squashfs: version 4.0 (2009/01/31) Phillip Lougher917worker2 # [ 0.397229] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]918client # [ 0.318193] 9p: Installing v9fs 9p2000 file system support919worker2 # [ 0.397679] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint920lb # [ 0.317284] Initialise system trusted keyrings921lb # [ 0.318022] workingset: timestamp_bits=42 max_order=19 bucket_order=0922lb # [ 0.319313] squashfs: version 4.0 (2009/01/31) Phillip Lougher923lb # [ 0.320085] 9p: Installing v9fs 9p2000 file system support924worker2 # [ 0.409905] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]925worker2 # [ 0.409934] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]926worker2 # [ 0.409963] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]927worker2 # [ 0.410497] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint928worker1 # [ 0.322037] Initialise system trusted keyrings929worker2 # [ 0.410686] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]930worker1 # [ 0.322769] workingset: timestamp_bits=42 max_order=19 bucket_order=0931worker2 # [ 0.410701] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]932worker1 # [ 0.324047] squashfs: version 4.0 (2009/01/31) Phillip Lougher933worker2 # [ 0.410731] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]934worker2 # [ 0.410747] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]935worker1 # [ 0.324821] 9p: Installing v9fs 9p2000 file system support936worker2 # [ 0.411204] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint937worker2 # [ 0.411392] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]938worker2 # [ 0.411422] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]939worker2 # [ 0.411870] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint940worker2 # [ 0.412054] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]941client # [ 0.338737] Key type asymmetric registered942worker2 # [ 0.412084] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]943client # [ 0.338762] Asymmetric key parser 'x509' registered944worker2 # [ 0.412471] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint945client # [ 0.338832] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)946worker2 # [ 0.412653] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]947worker2 # [ 0.412901] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint948worker2 # [ 0.413165] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]949worker2 # [ 0.413182] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]950worker2 # [ 0.413211] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]951worker2 # [ 0.413667] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint952client # [ 0.347004] io scheduler mq-deadline registered953client # [ 0.347023] io scheduler kyber registered954lb # [ 0.340708] Key type asymmetric registered955lb # [ 0.340732] Asymmetric key parser 'x509' registered956worker2 # [ 0.433891] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]957worker2 # [ 0.433920] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]958worker2 # [ 0.433949] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]959worker1 # [ 0.345423] Key type asymmetric registered960worker2 # [ 0.434577] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned961worker1 # [ 0.345450] Asymmetric key parser 'x509' registered962client # [ 0.354979] pl061_gpio 9030000.pl061: PL061 GPIO chip registered963worker2 # [ 0.434589] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned964worker2 # [ 0.434595] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned965lb # [ 0.348830] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)966lb # [ 0.349896] io scheduler mq-deadline registered967worker2 # [ 0.434641] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned968lb # [ 0.349906] io scheduler kyber registered969worker2 # [ 0.434689] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned970client # [ 0.356347] ledtrig-cpu: registered to indicate activity on CPUs971worker2 # [ 0.434736] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned972client # [ 0.356744] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:973worker2 # [ 0.434783] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned974client # [ 0.356761] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000975worker2 # [ 0.434830] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned976client # [ 0.356773] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000977worker2 # [ 0.434878] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned978client # [ 0.356781] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000979worker1 # [ 0.353574] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)980worker2 # [ 0.434925] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned981worker1 # [ 0.354612] io scheduler mq-deadline registered982client # [ 0.356802] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits983worker1 # [ 0.354623] io scheduler kyber registered984worker2 # [ 0.434973] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned985client # [ 0.356825] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]986worker2 # [ 0.435020] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned987client # [ 0.356909] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00988worker2 # [ 0.435130] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned989client # [ 0.356918] pci_bus 0000:00: root bus resource [bus 00-ff]990worker2 # [ 0.435176] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned991client # [ 0.356924] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]992worker2 # [ 0.435198] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned993client # [ 0.356929] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]994worker2 # [ 0.435218] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned995client # [ 0.356934] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]996lb # [ 0.360867] pl061_gpio 9030000.pl061: PL061 GPIO chip registered997worker2 # [ 0.435240] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned998client # [ 0.356991] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint999worker2 # [ 0.435264] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1000client # [ 0.357431] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1001worker2 # [ 0.435286] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1002client # [ 0.357616] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1003worker2 # [ 0.435307] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1004client # [ 0.357632] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1005lb # [ 0.362201] ledtrig-cpu: registered to indicate activity on CPUs1006worker2 # [ 0.435329] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1007client # [ 0.357662] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1008lb # [ 0.362582] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1009worker2 # [ 0.435351] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1010client # [ 0.357677] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1011lb # [ 0.362598] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001012worker2 # [ 0.435372] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1013client # [ 0.358134] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1014worker2 # [ 0.435395] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1015lb # [ 0.362609] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001016client # [ 0.358318] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1017worker1 # [ 0.365602] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1018client # [ 0.358333] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1019worker2 # [ 0.435418] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1020lb # [ 0.362618] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001021worker2 # [ 0.435439] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1022client # [ 0.358362] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1023lb # [ 0.362638] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1024worker2 # [ 0.435460] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1025client # [ 0.358819] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1026worker2 # [ 0.435481] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1027lb # [ 0.362660] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1028worker1 # [ 0.366920] ledtrig-cpu: registered to indicate activity on CPUs1029worker2 # [ 0.435502] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1030lb # [ 0.362731] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001031worker1 # [ 0.367309] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1032worker2 # [ 0.435523] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1033lb # [ 0.362740] pci_bus 0000:00: root bus resource [bus 00-ff]1034worker2 # [ 0.435545] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1035worker1 # [ 0.367326] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001036lb # [ 0.362747] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1037worker2 # [ 0.435567] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1038lb # [ 0.362752] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1039worker1 # [ 0.367339] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001040worker2 # [ 0.435588] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1041lb # [ 0.362757] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1042worker2 # [ 0.435609] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1043worker1 # [ 0.367347] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001044worker2 # [ 0.435636] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1045lb # [ 0.362812] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1046worker1 # [ 0.367368] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1047worker2 # [ 0.435645] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1048lb # [ 0.363241] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1049worker2 # [ 0.435650] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1050worker1 # [ 0.367392] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1051lb # [ 0.363427] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1052worker2 # [ 0.436802] pci 0000:00:0a.0: enabling device (0000 -> 0002)1053worker1 # [ 0.367484] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001054lb # [ 0.363443] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1055worker1 # [ 0.367493] pci_bus 0000:00: root bus resource [bus 00-ff]1056lb # [ 0.363473] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1057worker1 # [ 0.367499] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1058lb # [ 0.363489] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1059worker1 # [ 0.367505] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1060lb # [ 0.363948] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1061lb # [ 0.364131] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1062worker1 # [ 0.367510] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1063lb # [ 0.364147] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1064worker1 # [ 0.367564] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1065lb # [ 0.364176] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1066worker1 # [ 0.368009] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1067lb # [ 0.364623] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1068worker1 # [ 0.368197] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1069worker1 # [ 0.368213] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1070lb # [ 0.384402] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1071lb # [ 0.384422] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1072worker1 # [ 0.368242] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1073worker1 # [ 0.368258] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1074lb # [ 0.384451] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1075client # [ 0.387061] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1076worker1 # [ 0.368713] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1077client # [ 0.387089] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1078worker1 # [ 0.368898] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1079client # [ 0.387119] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1080worker1 # [ 0.368914] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1081lb # [ 0.387064] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1082worker1 # [ 0.368943] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1083client # [ 0.387614] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1084lb # [ 0.387250] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1085client # [ 0.387798] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1086lb # [ 0.387266] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1087worker1 # [ 0.369392] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1088client # [ 0.387813] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1089lb # [ 0.387298] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1090client # [ 0.387846] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1091lb # [ 0.387756] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1092client # [ 0.388307] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1093lb # [ 0.387940] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1094client # [ 0.388495] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1095lb # [ 0.387956] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1096client # [ 0.388512] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1097lb # [ 0.387985] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1098worker1 # [ 0.389743] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1099client # [ 0.388541] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1100lb # [ 0.388432] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1101worker1 # [ 0.389763] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1102client # [ 0.388998] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1103lb # [ 0.388614] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1104worker1 # [ 0.389793] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1105client # [ 0.389181] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1106lb # [ 0.388630] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1107client # [ 0.389196] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1108worker1 # [ 0.390256] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1109lb # [ 0.388664] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1110worker1 # [ 0.390441] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1111client # [ 0.389225] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1112worker1 # [ 0.390456] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1113client # [ 0.389681] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1114worker1 # [ 0.390488] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1115client # [ 0.389866] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1116client # [ 0.389882] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1117worker1 # [ 0.390945] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1118worker1 # [ 0.391128] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1119worker2 # [ 0.492976] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1120client # [ 0.389911] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1121worker1 # [ 0.391144] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1122client # [ 0.389927] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1123worker1 # [ 0.391178] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1124client # [ 0.390386] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1125worker1 # [ 0.391628] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1126client # [ 0.390572] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1127worker1 # [ 0.391813] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1128client # [ 0.390601] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1129worker1 # [ 0.391828] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1130client # [ 0.391076] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1131worker1 # [ 0.391858] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1132client # [ 0.391265] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1133worker1 # [ 0.392320] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1134client # [ 0.391295] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1135worker1 # [ 0.392505] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1136client # [ 0.391704] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1137worker1 # [ 0.392521] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1138client # [ 0.391893] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1139worker1 # [ 0.392550] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1140client # [ 0.392137] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1141worker1 # [ 0.392566] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1142client # [ 0.392422] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1143worker1 # [ 0.393026] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1144client # [ 0.392439] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1145worker1 # [ 0.393214] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1146client # [ 0.392469] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1147worker1 # [ 0.393243] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1148client # [ 0.392929] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1149lb # [ 0.405192] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1150client # [ 0.393111] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1151lb # [ 0.405385] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1152client # [ 0.393127] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1153lb # [ 0.405401] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1154lb # [ 0.405430] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1155client # [ 0.393157] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1156lb # [ 0.405446] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1157client # [ 0.393727] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1158client # [ 0.393739] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1159lb # [ 0.405902] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1160worker2 # [ 0.507362] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1161lb # [ 0.406089] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1162client # [ 0.393745] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1163worker2 # [ 0.509345] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1164lb # [ 0.406119] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1165client # [ 0.393791] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1166lb # [ 0.406572] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1167client # [ 0.393837] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1168lb # [ 0.406759] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1169client # [ 0.393883] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1170worker2 # [ 0.513001] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1171lb # [ 0.406788] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1172client # [ 0.393929] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1173lb # [ 0.407173] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1174client # [ 0.393975] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1175lb # [ 0.407357] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1176worker1 # [ 0.417749] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1177client # [ 0.394021] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1178lb # [ 0.407607] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1179worker1 # [ 0.417951] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1180lb # [ 0.407865] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1181client # [ 0.394067] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1182worker1 # [ 0.417981] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1183lb # [ 0.407882] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1184client # [ 0.394113] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1185worker1 # [ 0.418384] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1186lb # [ 0.407911] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1187worker2 # [ 0.515921] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1188worker1 # [ 0.418567] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1189client # [ 0.394159] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1190lb # [ 0.408382] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1191worker1 # [ 0.418814] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1192client # [ 0.394220] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1193lb # [ 0.408564] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1194worker1 # [ 0.419070] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1195client # [ 0.394266] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1196lb # [ 0.408579] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1197worker1 # [ 0.419086] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1198client # [ 0.394287] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1199lb # [ 0.408608] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1200worker1 # [ 0.419115] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1201client # [ 0.394309] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1202lb # [ 0.409206] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1203worker1 # [ 0.419584] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1204client # [ 0.394331] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1205lb # [ 0.409217] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1206worker1 # [ 0.419768] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1207client # [ 0.394354] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1208lb # [ 0.409222] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1209worker1 # [ 0.419783] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1210client # [ 0.394376] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1211worker1 # [ 0.419812] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1212lb # [ 0.409266] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1213client # [ 0.394398] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1214worker1 # [ 0.420399] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1215lb # [ 0.409312] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1216client # [ 0.394420] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1217worker1 # [ 0.420410] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1218lb # [ 0.409357] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1219client # [ 0.394442] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1220worker1 # [ 0.420416] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1221client # [ 0.394464] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1222lb # [ 0.409404] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1223worker1 # [ 0.420460] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1224client # [ 0.394486] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1225lb # [ 0.409449] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1226worker2 # [ 0.525940] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1227client # [ 0.394508] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1228worker1 # [ 0.420506] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1229lb # [ 0.409496] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1230worker2 # [ 0.528016] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1231client # [ 0.394530] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1232worker1 # [ 0.420554] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1233lb # [ 0.409542] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1234client # [ 0.394551] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1235worker1 # [ 0.420600] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1236client # [ 0.394572] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1237lb # [ 0.409588] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1238client # [ 0.394594] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1239worker1 # [ 0.420647] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1240lb # [ 0.409634] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1241client # [ 0.394615] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1242worker1 # [ 0.420694] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1243lb # [ 0.409693] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1244client # [ 0.394636] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1245worker1 # [ 0.420742] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1246lb # [ 0.409739] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1247client # [ 0.394658] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1248client # [ 0.394680] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1249lb # [ 0.409768] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1250worker1 # [ 0.420789] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1251client # [ 0.394702] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1252lb # [ 0.409789] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1253worker1 # [ 0.420836] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1254client # [ 0.394729] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1255lb # [ 0.409811] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1256worker1 # [ 0.420904] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1257client # [ 0.394739] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1258lb # [ 0.409835] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1259worker1 # [ 0.420950] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1260client # [ 0.394743] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1261lb # [ 0.409856] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1262worker1 # [ 0.420972] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1263lb # [ 0.409878] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1264worker1 # [ 0.420993] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1265lb # [ 0.409899] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1266worker1 # [ 0.421015] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1267lb # [ 0.409921] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1268worker1 # [ 0.421039] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1269lb # [ 0.409943] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1270worker1 # [ 0.421062] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1271lb # [ 0.409965] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1272worker1 # [ 0.421084] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1273lb # [ 0.409987] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1274worker1 # [ 0.421106] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1275lb # [ 0.410008] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1276worker1 # [ 0.421128] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1277lb # [ 0.410030] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1278worker2 # [ 0.537914] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1279worker1 # [ 0.421150] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1280lb # [ 0.410051] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1281worker2 # [ 0.540736] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1282client # [ 0.459951] pci 0000:00:0a.0: enabling device (0000 -> 0002)1283worker1 # [ 0.421172] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1284lb # [ 0.410072] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1285worker2 # [ 0.542506] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1286lb # [ 0.410093] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1287worker1 # [ 0.421195] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1288worker2 # [ 0.544859] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1289lb # [ 0.410114] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1290worker1 # [ 0.421217] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1291lb # [ 0.410135] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1292worker1 # [ 0.421238] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1293lb # [ 0.410156] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1294worker1 # [ 0.421259] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1295lb # [ 0.410178] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1296worker1 # [ 0.421281] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1297lb # [ 0.410204] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1298worker1 # [ 0.421302] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1299lb # [ 0.410213] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1300worker1 # [ 0.421323] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1301lb # [ 0.410218] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1302worker1 # [ 0.421345] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1303lb # [ 0.411383] pci 0000:00:0a.0: enabling device (0000 -> 0002)1304worker1 # [ 0.421367] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1305worker1 # [ 0.421389] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1306worker1 # [ 0.421415] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1307worker1 # [ 0.421425] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1308worker1 # [ 0.421430] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1309worker2 # [ 0.562544] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1310worker2 # [ 0.565060] msm_serial: driver initialized1311worker2 # [ 0.565198] SuperH (H)SCI(F) driver initialized1312worker1 # [ 0.470676] pci 0000:00:0a.0: enabling device (0000 -> 0002)1313worker2 # [ 0.565251] STM32 USART driver initialized1314client # [ 0.480250] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1315client # [ 0.482359] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1316client # [ 0.493625] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1317lb # [ 0.487136] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1318worker1 # [ 0.491051] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1319worker1 # [ 0.493224] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1320lb # [ 0.493358] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1321lb # [ 0.495293] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1322worker2 # [ 0.596458] loop: module loaded1323worker2 # [ 0.596649] virtio_blk virtio5: 1/0/0 default/read/poll queues1324worker2 # [ 0.597390] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1325client # [ 0.507431] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1326worker1 # [ 0.504263] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1327client # [ 0.509396] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1328client # [ 0.511535] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1329lb # [ 0.505364] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1330client # [ 0.513703] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1331lb # [ 0.507343] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1332worker2 # [ 0.602332] megasas: 07.734.00.00-rc11333worker2 # [ 0.603042] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1334client # [ 0.524159] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1335client # [ 0.526414] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1336worker1 # [ 0.514200] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1337client # [ 0.529853] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1338worker1 # [ 0.518086] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1339worker1 # [ 0.520295] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1340lb # [ 0.517323] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1341lb # [ 0.520153] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1342lb # [ 0.522281] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1343worker2 # [ 0.614837] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001344lb # [ 0.524303] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1345worker2 # [ 0.614871] Intel/Sharp Extended Query Table at 0x00311346worker2 # [ 0.616552] Using buffer write method1347worker2 # [ 0.616624] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1348client # [ 0.538388] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1349worker1 # [ 0.531605] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1350lb # [ 0.534351] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1351lb # [ 0.536724] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1352worker2 # [ 0.631799] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001353worker2 # [ 0.631834] Intel/Sharp Extended Query Table at 0x00311354worker2 # [ 0.633408] Using buffer write method1355worker2 # [ 0.633434] Concatenating MTD devices:1356worker2 # [ 0.633438] (0): "0.flash"1357worker2 # [ 0.633442] (1): "0.flash"1358worker2 # [ 0.633446] into device "0.flash"1359worker1 # [ 0.537680] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1360worker1 # [ 0.539901] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1361worker1 # [ 0.550046] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1362client # [ 0.555770] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1363client # [ 0.557567] msm_serial: driver initialized1364worker1 # [ 0.552316] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1365client # [ 0.557716] SuperH (H)SCI(F) driver initialized1366client # [ 0.557768] STM32 USART driver initialized1367lb # [ 0.557923] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1368lb # [ 0.560489] msm_serial: driver initialized1369lb # [ 0.560668] SuperH (H)SCI(F) driver initialized1370lb # [ 0.560722] STM32 USART driver initialized1371worker1 # [ 0.566635] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1372worker1 # [ 0.569150] msm_serial: driver initialized1373worker1 # [ 0.569296] SuperH (H)SCI(F) driver initialized1374worker1 # [ 0.569348] STM32 USART driver initialized1375client # [ 0.592354] loop: module loaded1376client # [ 0.592558] virtio_blk virtio5: 1/0/0 default/read/poll queues1377client # [ 0.593346] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1378lb # [ 0.591466] loop: module loaded1379lb # [ 0.591643] virtio_blk virtio5: 1/0/0 default/read/poll queues1380lb # [ 0.592352] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1381client # [ 0.599429] megasas: 07.734.00.00-rc11382client # [ 0.600110] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1383client # [ 0.602429] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001384client # [ 0.602455] Intel/Sharp Extended Query Table at 0x00311385lb # [ 0.597320] megasas: 07.734.00.00-rc11386lb # [ 0.597982] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1387client # [ 0.611801] Using buffer write method1388client # [ 0.611867] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1389worker1 # [ 0.606083] loop: module loaded1390client # [ 0.614779] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001391worker1 # [ 0.606258] virtio_blk virtio5: 1/0/0 default/read/poll queues1392client # [ 0.614809] Intel/Sharp Extended Query Table at 0x00311393worker1 # [ 0.606970] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1394lb # [ 0.609777] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001395lb # [ 0.609809] Intel/Sharp Extended Query Table at 0x00311396lb # [ 0.611422] Using buffer write method1397lb # [ 0.611485] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1398client # [ 0.628020] Using buffer write method1399client # [ 0.628055] Concatenating MTD devices:1400client # [ 0.628059] (0): "0.flash"1401client # [ 0.628064] (1): "0.flash"1402client # [ 0.628067] into device "0.flash"1403worker1 # [ 0.618130] megasas: 07.734.00.00-rc11404worker1 # [ 0.618858] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1405worker1 # [ 0.620703] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001406lb # [ 0.626664] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001407worker1 # [ 0.620745] Intel/Sharp Extended Query Table at 0x00311408lb # [ 0.626699] Intel/Sharp Extended Query Table at 0x00311409worker1 # [ 0.622288] Using buffer write method1410lb # [ 0.628265] Using buffer write method1411lb # [ 0.628291] Concatenating MTD devices:1412lb # [ 0.628295] (0): "0.flash"1413lb # [ 0.628299] (1): "0.flash"1414lb # [ 0.628302] into device "0.flash"1415worker1 # [ 0.622348] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1416worker1 # [ 0.624194] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001417worker1 # [ 0.624245] Intel/Sharp Extended Query Table at 0x00311418worker1 # [ 0.642429] Using buffer write method1419worker1 # [ 0.642466] Concatenating MTD devices:1420worker1 # [ 0.642470] (0): "0.flash"1421worker1 # [ 0.642474] (1): "0.flash"1422worker1 # [ 0.642477] into device "0.flash"1423worker2 # [ 0.859884] Freeing initrd memory: 26148K1424worker2 # [ 0.865889] tun: Universal TUN/TAP device driver, 1.61425worker2 # [ 0.869555] thunder_xcv, ver 1.01426worker2 # [ 0.869599] thunder_bgx, ver 1.01427worker2 # [ 0.869623] nicpf, ver 1.01428worker2 # [ 0.871361] e1000: Intel(R) PRO/1000 Network Driver1429worker2 # [ 0.871373] e1000: Copyright (c) 1999-2006 Intel Corporation.1430worker2 # [ 0.871399] e1000e: Intel(R) PRO/1000 Network Driver1431worker2 # [ 0.871407] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432worker2 # [ 0.871436] igb: Intel(R) Gigabit Ethernet Network Driver1433worker2 # [ 0.871442] igb: Copyright (c) 2007-2014 Intel Corporation.1434worker2 # [ 0.871465] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435worker2 # [ 0.871471] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436worker2 # [ 0.871606] sky2: driver version 1.301437worker2 # [ 0.873184] usbcore: registered new interface driver usb-storage1438worker2 # [ 0.873287] usbcore: registered new interface driver usbserial_generic1439worker2 # [ 0.873302] usbserial: USB Serial support registered for generic1440worker2 # [ 0.874433] ehci-pci 0000:00:0a.0: EHCI Host Controller1441worker2 # [ 0.874458] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11442worker2 # [ 0.874743] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001443worker2 # [ 0.885298] hv_vmbus: registering driver hyperv_keyboard1444worker2 # [ 0.885783] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001445worker2 # [ 0.886160] hub 1-0:1.0: USB hub found1446worker2 # [ 0.886180] hub 1-0:1.0: 6 ports detected1447worker2 # [ 0.889268] rtc-pl031 9010000.pl031: registered as rtc01448worker2 # [ 0.889294] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:57 UTC (1789895097)1449worker2 # [ 0.889675] i2c_dev: i2c /dev entries driver1450worker2 # [ 0.894618] sdhci: Secure Digital Host Controller Interface driver1451worker2 # [ 0.894628] sdhci: Copyright(c) Pierre Ossman1452worker2 # [ 0.894896] Synopsys Designware Multimedia Card Interface Driver1453worker2 # [ 0.895280] sdhci-pltfm: SDHCI platform and OF driver helper1454worker2 # [ 0.896969] hid: raw HID events driver (C) Jiri Kosina1455worker2 # [ 0.897231] usbcore: registered new interface driver usbhid1456worker2 # [ 0.897238] usbhid: USB HID core driver1457worker2 # [ 0.902782] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1458worker2 # [ 0.904365] drop_monitor: Initializing network drop monitor service1459worker2 # [ 0.904531] NET: Registered PF_INET6 protocol family1460worker2 # [ 0.907527] Segment Routing with IPv61461worker2 # [ 0.907545] In-situ OAM (IOAM) with IPv61462worker2 # [ 0.907575] NET: Registered PF_PACKET protocol family1463worker2 # [ 0.909247] 9pnet: Installing 9P2000 support1464worker2 # [ 0.912084] Key type dns_resolver registered1465worker2 # [ 0.918357] registered taskstats version 11466worker2 # [ 0.918521] Loading compiled-in X.509 certificates1467worker2 # [ 0.927230] Demotion targets for Node 0: null1468worker2 # [ 0.927332] Key type .fscrypt registered1469worker2 # [ 0.927338] Key type fscrypt-provisioning registered1470worker2 # [ 0.927433] ima: No TPM chip found, activating TPM-bypass!1471worker2 # [ 0.927452] ima: Allocated hash algorithm: sha11472worker2 # [ 0.927474] ima: No architecture policies found1473worker2 # [ 0.931478] input: gpio-keys as /devices/platform/gpio-keys/input/input01474client # [ 0.849719] Freeing initrd memory: 26160K1475client # [ 0.855643] tun: Universal TUN/TAP device driver, 1.61476lb # [ 0.850291] Freeing initrd memory: 26140K1477client # [ 0.859265] thunder_xcv, ver 1.01478lb # [ 0.856226] tun: Universal TUN/TAP device driver, 1.61479client # [ 0.859309] thunder_bgx, ver 1.01480client # [ 0.859332] nicpf, ver 1.01481client # [ 0.859881] e1000: Intel(R) PRO/1000 Network Driver1482client # [ 0.859888] e1000: Copyright (c) 1999-2006 Intel Corporation.1483client # [ 0.859916] e1000e: Intel(R) PRO/1000 Network Driver1484client # [ 0.859924] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1485client # [ 0.859953] igb: Intel(R) Gigabit Ethernet Network Driver1486worker2 # [ 0.950948] clk: Disabling unused clocks1487lb # [ 0.859928] thunder_xcv, ver 1.01488client # [ 0.859959] igb: Copyright (c) 2007-2014 Intel Corporation.1489worker2 # [ 0.950980] PM: genpd: Disabling unused power domains1490lb # [ 0.859971] thunder_bgx, ver 1.01491lb # [ 0.859993] nicpf, ver 1.01492client # [ 0.859981] igbvf: Intel(R) Gigabit Virtual Function Network Driver1493lb # [ 0.860529] e1000: Intel(R) PRO/1000 Network Driver1494client # [ 0.859987] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1495client # [ 0.860118] sky2: driver version 1.301496lb # [ 0.860536] e1000: Copyright (c) 1999-2006 Intel Corporation.1497worker2 # [ 0.955252] Freeing unused kernel memory: 4736K1498lb # [ 0.860559] e1000e: Intel(R) PRO/1000 Network Driver1499client # [ 0.861682] usbcore: registered new interface driver usb-storage1500worker2 # [ 0.955470] Run /init as init process1501lb # [ 0.860567] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1502client # [ 0.861763] usbcore: registered new interface driver usbserial_generic1503lb # [ 0.860595] igb: Intel(R) Gigabit Ethernet Network Driver1504client # [ 0.861778] usbserial: USB Serial support registered for generic1505lb # [ 0.860601] igb: Copyright (c) 2007-2014 Intel Corporation.1506client # [ 0.862356] hv_vmbus: registering driver hyperv_keyboard1507lb # [ 0.860624] igbvf: Intel(R) Gigabit Virtual Function Network Driver1508client # [ 0.863578] ehci-pci 0000:00:0a.0: EHCI Host Controller1509lb # [ 0.860629] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1510client # [ 0.863603] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11511worker1 # [ 0.864503] Freeing initrd memory: 26148K1512client # [ 0.863878] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001513client # [ 0.875366] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001514client # [ 0.875730] hub 1-0:1.0: USB hub found1515lb # [ 0.867449] sky2: driver version 1.301516client # [ 0.875745] hub 1-0:1.0: 6 ports detected1517lb # [ 0.869372] ehci-pci 0000:00:0a.0: EHCI Host Controller1518lb # [ 0.869401] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11519client # [ 0.878756] rtc-pl031 9010000.pl031: registered as rtc01520lb # [ 0.869562] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001521worker1 # [ 0.870556] tun: Universal TUN/TAP device driver, 1.61522client # [ 0.878784] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:57 UTC (1789895097)1523lb # [ 0.872633] usbcore: registered new interface driver usb-storage1524client # [ 0.880840] i2c_dev: i2c /dev entries driver1525lb # [ 0.873564] usbcore: registered new interface driver usbserial_generic1526lb # [ 0.873582] usbserial: USB Serial support registered for generic1527lb # [ 0.874178] hv_vmbus: registering driver hyperv_keyboard1528lb # [ 0.877240] rtc-pl031 9010000.pl031: registered as rtc01529worker2 # [ 0.971936] systemd[1]: Successfully made /usr/ read-only.1530client # [ 0.883999] sdhci: Secure Digital Host Controller Interface driver1531lb # [ 0.877266] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:57 UTC (1789895097)1532client # [ 0.884009] sdhci: Copyright(c) Pierre Ossman1533worker1 # [ 0.874271] thunder_xcv, ver 1.01534lb # [ 0.877561] i2c_dev: i2c /dev entries driver1535worker1 # [ 0.874312] thunder_bgx, ver 1.01536client # [ 0.884267] Synopsys Designware Multimedia Card Interface Driver1537worker1 # [ 0.874333] nicpf, ver 1.01538client # [ 0.884645] sdhci-pltfm: SDHCI platform and OF driver helper1539worker1 # [ 0.874885] e1000: Intel(R) PRO/1000 Network Driver1540client # [ 0.886321] hid: raw HID events driver (C) Jiri Kosina1541worker1 # [ 0.874892] e1000: Copyright (c) 1999-2006 Intel Corporation.1542client # [ 0.886567] usbcore: registered new interface driver usbhid1543worker1 # [ 0.874916] e1000e: Intel(R) PRO/1000 Network Driver1544client # [ 0.886574] usbhid: USB HID core driver1545worker1 # [ 0.874924] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1546worker1 # [ 0.874951] igb: Intel(R) Gigabit Ethernet Network Driver1547worker1 # [ 0.874957] igb: Copyright (c) 2007-2014 Intel Corporation.1548lb # [ 0.882529] sdhci: Secure Digital Host Controller Interface driver1549worker1 # [ 0.874980] igbvf: Intel(R) Gigabit Virtual Function Network Driver1550lb # [ 0.882540] sdhci: Copyright(c) Pierre Ossman1551worker1 # [ 0.874986] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1552lb # [ 0.882800] Synopsys Designware Multimedia Card Interface Driver1553worker1 # [ 0.875114] sky2: driver version 1.301554client # [ 0.892164] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1555lb # [ 0.883190] sdhci-pltfm: SDHCI platform and OF driver helper1556worker1 # [ 0.876690] usbcore: registered new interface driver usb-storage1557client # [ 0.893669] drop_monitor: Initializing network drop monitor service1558lb # [ 0.884805] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001559client # [ 0.893845] NET: Registered PF_INET6 protocol family1560worker1 # [ 0.876807] usbcore: registered new interface driver usbserial_generic1561lb # [ 0.888427] hub 1-0:1.0: USB hub found1562worker1 # [ 0.876821] usbserial: USB Serial support registered for generic1563client # [ 0.896792] Segment Routing with IPv61564lb # [ 0.888458] hub 1-0:1.0: 6 ports detected1565worker1 # [ 0.877405] hv_vmbus: registering driver hyperv_keyboard1566client # [ 0.896822] In-situ OAM (IOAM) with IPv61567worker1 # [ 0.878199] ehci-pci 0000:00:0a.0: EHCI Host Controller1568client # [ 0.896852] NET: Registered PF_PACKET protocol family1569worker1 # [ 0.878224] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11570client # [ 0.898509] 9pnet: Installing 9P2000 support1571lb # [ 0.890023] hid: raw HID events driver (C) Jiri Kosina1572lb # [ 0.890280] usbcore: registered new interface driver usbhid1573lb # [ 0.890287] usbhid: USB HID core driver1574worker1 # [ 0.878516] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001575worker1 # [ 0.890248] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001576worker1 # [ 0.890582] hub 1-0:1.0: USB hub found1577worker1 # [ 0.890598] hub 1-0:1.0: 6 ports detected1578client # [ 0.901324] Key type dns_resolver registered1579lb # [ 0.893199] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1580lb # [ 0.894741] drop_monitor: Initializing network drop monitor service1581worker1 # [ 0.894205] rtc-pl031 9010000.pl031: registered as rtc01582lb # [ 0.894903] NET: Registered PF_INET6 protocol family1583worker1 # [ 0.894237] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:57 UTC (1789895097)1584lb # [ 0.897935] Segment Routing with IPv61585lb # [ 0.897953] In-situ OAM (IOAM) with IPv61586worker1 # [ 0.894538] i2c_dev: i2c /dev entries driver1587lb # [ 0.897986] NET: Registered PF_PACKET protocol family1588lb # [ 0.899600] 9pnet: Installing 9P2000 support1589worker1 # [ 0.899426] sdhci: Secure Digital Host Controller Interface driver1590client # [ 0.907819] registered taskstats version 11591worker1 # [ 0.899435] sdhci: Copyright(c) Pierre Ossman1592client # [ 0.907982] Loading compiled-in X.509 certificates1593worker1 # [ 0.899694] Synopsys Designware Multimedia Card Interface Driver1594lb # [ 0.902225] Key type dns_resolver registered1595worker1 # [ 0.900061] sdhci-pltfm: SDHCI platform and OF driver helper1596worker1 # [ 0.904433] hid: raw HID events driver (C) Jiri Kosina1597worker1 # [ 0.904673] usbcore: registered new interface driver usbhid1598worker1 # [ 0.904680] usbhid: USB HID core driver1599lb # [ 0.908347] registered taskstats version 11600client # [ 0.916520] Demotion targets for Node 0: null1601lb # [ 0.908488] Loading compiled-in X.509 certificates1602client # [ 0.916620] Key type .fscrypt registered1603client # [ 0.916626] Key type fscrypt-provisioning registered1604client # [ 0.916715] ima: No TPM chip found, activating TPM-bypass!1605worker1 # [ 0.907524] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1606client # [ 0.916735] ima: Allocated hash algorithm: sha11607client # [ 0.916755] ima: No architecture policies found1608worker1 # [ 0.909014] drop_monitor: Initializing network drop monitor service1609worker1 # [ 0.909148] NET: Registered PF_INET6 protocol family1610client # [ 0.920799] input: gpio-keys as /devices/platform/gpio-keys/input/input01611worker1 # [ 0.912393] Segment Routing with IPv61612worker1 # [ 0.912412] In-situ OAM (IOAM) with IPv61613worker1 # [ 0.912444] NET: Registered PF_PACKET protocol family1614lb # [ 0.917129] Demotion targets for Node 0: null1615lb # [ 0.917246] Key type .fscrypt registered1616lb # [ 0.917253] Key type fscrypt-provisioning registered1617worker1 # [ 0.914312] 9pnet: Installing 9P2000 support1618lb # [ 0.917346] ima: No TPM chip found, activating TPM-bypass!1619worker1 # [ 0.916468] Key type dns_resolver registered1620lb # [ 0.917365] ima: Allocated hash algorithm: sha11621lb # [ 0.917387] ima: No architecture policies found1622lb # [ 0.921626] input: gpio-keys as /devices/platform/gpio-keys/input/input01623worker1 # [ 0.923205] registered taskstats version 11624worker1 # [ 0.923374] Loading compiled-in X.509 certificates1625client # [ 0.938772] clk: Disabling unused clocks1626client # [ 0.938807] PM: genpd: Disabling unused power domains1627worker1 # [ 0.932051] Demotion targets for Node 0: null1628worker1 # [ 0.932164] Key type .fscrypt registered1629worker1 # [ 0.932170] Key type fscrypt-provisioning registered1630client # [ 0.943055] Freeing unused kernel memory: 4736K1631worker1 # [ 0.932269] ima: No TPM chip found, activating TPM-bypass!1632client # [ 0.943217] Run /init as init process1633worker1 # [ 0.932288] ima: Allocated hash algorithm: sha11634worker1 # [ 0.932311] ima: No architecture policies found1635worker1 # [ 0.936464] input: gpio-keys as /devices/platform/gpio-keys/input/input01636lb # [ 0.939332] clk: Disabling unused clocks1637lb # [ 0.939364] PM: genpd: Disabling unused power domains1638lb # [ 0.943608] Freeing unused kernel memory: 4736K1639lb # [ 0.943817] Run /init as init process1640client # [ 0.957053] systemd[1]: Successfully made /usr/ read-only.1641worker1 # [ 0.954968] clk: Disabling unused clocks1642lb # [ 0.958893] systemd[1]: Successfully made /usr/ read-only.1643worker1 # [ 0.954997] PM: genpd: Disabling unused power domains1644worker1 # [ 0.959285] Freeing unused kernel memory: 4736K1645worker1 # [ 0.959507] Run /init as init process1646worker1 # [ 0.975707] systemd[1]: Successfully made /usr/ read-only.1647worker2 # [ 1.133810] usb 1-1: new high-speed USB device number 2 using ehci-pci1648client # [ 1.122934] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.137563] usb 1-1: new high-speed USB device number 2 using ehci-pci1650lb # [ 1.140813] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker2 # [ 1.285917] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652worker2 # [ 1.306772] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653worker2 # [ 1.318341] systemd[1]: Detected virtualization qemu.1654worker2 # [ 1.320257] systemd[1]: Detected architecture arm64.1655worker2 # [ 1.322136] systemd[1]: Running in initrd.1656worker2 # [ 1.324620] systemd[1]: Initializing machine ID from random generator.1657worker2 # [ 1.327308] systemd[1]: Hostname set to <worker2>.1658client # [ 1.275256] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659worker2 # [ 1.370031] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01660client # [ 1.291894] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1661worker1 # [ 1.289778] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11662client # [ 1.303881] systemd[1]: Detected virtualization qemu.1663lb # [ 1.293030] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11664client # [ 1.305880] systemd[1]: Detected architecture arm64.1665client # [ 1.307827] systemd[1]: Running in initrd.1666client # [ 1.310414] systemd[1]: Initializing machine ID from random generator.1667client # [ 1.313355] systemd[1]: Hostname set to <client>.1668lb # [ 1.299154] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1669lb # [ 1.311489] systemd[1]: Detected virtualization qemu.1670lb # [ 1.313587] systemd[1]: Detected architecture arm64.1671lb # [ 1.315477] systemd[1]: Running in initrd.1672lb # [ 1.318062] systemd[1]: Initializing machine ID from random generator.1673lb # [ 1.320966] systemd[1]: Hostname set to <lb>.1674worker1 # [ 1.310499] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1675worker1 # [ 1.322447] systemd[1]: Detected virtualization qemu.1676worker1 # [ 1.324412] systemd[1]: Detected architecture arm64.1677worker1 # [ 1.326354] systemd[1]: Running in initrd.1678worker1 # [ 1.328898] systemd[1]: Initializing machine ID from random generator.1679worker1 # [ 1.331775] systemd[1]: Hostname set to <worker1>.1680client # [ 1.363110] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681worker1 # [ 1.377789] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682lb # [ 1.380976] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker2 # [ 1.489771] usb 1-2: new high-speed USB device number 3 using ehci-pci1684client # [ 1.482928] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker1 # [ 1.501564] usb 1-2: new high-speed USB device number 3 using ehci-pci1686lb # [ 1.504798] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker2 # [ 1.639398] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688worker2 # [ 1.657247] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21689worker2 # [ 1.657606] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01690client # [ 1.623378] systemd[1]: bpf-restrict-fs: LSM BPF program attached1691worker1 # [ 1.632753] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692client # [ 1.641787] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21693client # [ 1.647346] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01694worker2 # [ 1.750786] systemd[1]: Queued start job for default target Initrd Default Target.1695lb # [ 1.656855] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696worker1 # [ 1.659880] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21697lb # [ 1.662254] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01698worker2 # [ 1.760367] systemd[1]: Created slice Slice /system/modprobe.1699worker2 # [ 1.761719] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1700worker1 # [ 1.665050] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01701worker2 # [ 1.763260] systemd[1]: Expecting device /dev/disk/by-label/nixos...1702worker2 # [ 1.764520] systemd[1]: Reached target Path Units.1703worker2 # [ 1.765441] systemd[1]: Reached target Slice Units.1704worker2 # [ 1.766453] systemd[1]: Reached target Swaps.1705worker2 # [ 1.767293] systemd[1]: Reached target Timer Units.1706worker2 # [ 1.768431] systemd[1]: Listening on D-Bus System Message Bus Socket.1707worker2 # [ 1.769881] systemd[1]: Listening on Journal Socket (/dev/log).1708worker2 # [ 1.771147] systemd[1]: Listening on Journal Sockets.1709worker2 # [ 1.772258] systemd[1]: Listening on udev Control Socket.1710worker2 # [ 1.773397] systemd[1]: Listening on udev Kernel Socket.1711worker2 # [ 1.774481] systemd[1]: Reached target Socket Units.1712worker2 # [ 1.777288] systemd[1]: Starting Create List of Static Device Nodes...1713worker2 # [ 1.785948] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1714worker2 # [ 1.787231] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1715worker2 # [ 1.794178] systemd[1]: Mounting Kernel Configuration File System...1716worker2 # [ 1.819237] systemd[1]: Starting Journal Service...1717client # [ 1.736721] systemd[1]: Queued start job for default target Initrd Default Target.1718worker2 # [ 1.826029] systemd[1]: Starting Load Kernel Modules...1719worker2 # [ 1.826833] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1720client # [ 1.745206] systemd[1]: Created slice Slice /system/modprobe.1721client # [ 1.746355] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1722client # [ 1.747768] systemd[1]: Expecting device /dev/disk/by-label/nixos...1723client # [ 1.748919] systemd[1]: Reached target Path Units.1724client # [ 1.749741] systemd[1]: Reached target Slice Units.1725client # [ 1.750557] systemd[1]: Reached target Swaps.1726client # [ 1.751346] systemd[1]: Reached target Timer Units.1727client # [ 1.752340] systemd[1]: Listening on D-Bus System Message Bus Socket.1728client # [ 1.753556] systemd[1]: Listening on Journal Socket (/dev/log).1729worker2 # [ 1.838083] systemd[1]: Starting Coldplug All udev Devices...1730client # [ 1.754668] systemd[1]: Listening on Journal Sockets.1731lb # [ 1.747473] systemd[1]: bpf-restrict-fs: LSM BPF program attached1732client # [ 1.755705] systemd[1]: Listening on udev Control Socket.1733worker1 # [ 1.748024] systemd[1]: Queued start job for default target Initrd Default Target.1734client # [ 1.755823] systemd[1]: Listening on udev Kernel Socket.1735client # [ 1.755848] systemd[1]: Reached target Socket Units.1736client # [ 1.760005] systemd[1]: Starting Create List of Static Device Nodes...1737worker2 # [ 1.846397] systemd[1]: Finished Create List of Static Device Nodes.1738worker2 # [ 1.847240] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1739worker2 # [ 1.847518] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1740worker2 # [ 1.847739] systemd[1]: Mounted Kernel Configuration File System.1741worker1 # [ 1.759974] systemd[1]: Created slice Slice /system/modprobe.1742client # [ 1.770326] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1743worker1 # [ 1.761147] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1744worker1 # [ 1.762579] systemd[1]: Expecting device /dev/disk/by-label/nixos...1745client # [ 1.771711] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1746worker1 # [ 1.763680] systemd[1]: Reached target Path Units.1747worker1 # [ 1.764495] systemd[1]: Reached target Slice Units.1748worker1 # [ 1.765319] systemd[1]: Reached target Swaps.1749worker1 # [ 1.766152] systemd[1]: Reached target Timer Units.1750worker1 # [ 1.767161] systemd[1]: Listening on D-Bus System Message Bus Socket.1751worker1 # [ 1.768383] systemd[1]: Listening on Journal Socket (/dev/log).1752worker1 # [ 1.769536] systemd[1]: Listening on Journal Sockets.1753worker1 # [ 1.770529] systemd[1]: Listening on udev Control Socket.1754worker1 # [ 1.771565] systemd[1]: Listening on udev Kernel Socket.1755worker1 # [ 1.772457] systemd[1]: Reached target Socket Units.1756worker1 # [ 1.774910] systemd[1]: Starting Create List of Static Device Nodes...1757client # [ 1.784323] systemd[1]: Mounting Kernel Configuration File System...1758worker2 # [ 1.871337] systemd-journald[73]: Collecting audit messages is disabled.1759worker2 # [ 1.877895] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1760worker1 # [ 1.785257] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1761worker1 # [ 1.786584] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1762client # [ 1.807049] systemd[1]: Starting Journal Service...1763worker1 # [ 1.798974] systemd[1]: Mounting Kernel Configuration File System...1764client # [ 1.811057] systemd[1]: Starting Load Kernel Modules...1765client # [ 1.811955] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1766client # [ 1.816092] systemd[1]: Starting Coldplug All udev Devices...1767worker2 # [ 1.906043] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1768worker2 # [ 1.908397] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1769client # [ 1.827148] systemd[1]: Finished Create List of Static Device Nodes.1770worker2 # [ 1.914123] systemd[1]: Starting Create Static Device Nodes in /dev...1771client # [ 1.828952] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1772worker1 # [ 1.821695] systemd[1]: Starting Journal Service...1773worker1 # [ 1.825701] systemd[1]: Starting Load Kernel Modules...1774worker1 # [ 1.826602] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1775worker1 # [ 1.830713] systemd[1]: Starting Coldplug All udev Devices...1776lb # [ 1.835032] systemd[1]: Queued start job for default target Initrd Default Target.1777client # [ 1.843115] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1778worker2 # [ 1.925824] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1779worker2 # [ 1.930401] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01780worker2 # [ 1.930625] [drm] features: -virgl +edid -resource_blob -host_visible1781worker2 # [ 1.930634] [drm] features: -context_init1782worker2 # [ 1.931331] [drm] number of scanouts: 11783worker2 # [ 1.931348] [drm] number of cap sets: 01784lb # [ 1.842782] systemd[1]: Created slice Slice /system/modprobe.1785worker1 # [ 1.841725] systemd[1]: Finished Create List of Static Device Nodes.1786lb # [ 1.843795] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1787worker1 # [ 1.843589] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1788lb # [ 1.844980] systemd[1]: Expecting device /dev/disk/by-label/nixos...1789lb # [ 1.845016] systemd[1]: Reached target Path Units.1790lb # [ 1.845036] systemd[1]: Reached target Slice Units.1791lb # [ 1.845054] systemd[1]: Reached target Swaps.1792lb # [ 1.845074] systemd[1]: Reached target Timer Units.1793lb # [ 1.845254] systemd[1]: Listening on D-Bus System Message Bus Socket.1794lb # [ 1.845406] systemd[1]: Listening on Journal Socket (/dev/log).1795lb # [ 1.845548] systemd[1]: Listening on Journal Sockets.1796client # [ 1.860212] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1797lb # [ 1.845682] systemd[1]: Listening on udev Control Socket.1798client # [ 1.861895] systemd[1]: Mounted Kernel Configuration File System.1799lb # [ 1.845788] systemd[1]: Listening on udev Kernel Socket.1800lb # [ 1.845810] systemd[1]: Reached target Socket Units.1801worker1 # [ 1.853967] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1802lb # [ 1.856427] systemd[1]: Starting Create List of Static Device Nodes...1803lb # [ 1.862116] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1804lb # [ 1.863179] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1805client # [ 1.866747] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1806worker2 # [ 1.950392] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1807worker2 # [ 1.950413] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01808client # [ 1.877497] systemd-journald[73]: Collecting audit messages is disabled.1809lb # [ 1.874338] systemd[1]: Mounting Kernel Configuration File System...1810client # [ 1.883651] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1811worker1 # [ 1.878216] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1812worker2 # [ 1.974320] systemd[1]: Finished Create Static Device Nodes in /dev.1813worker2 # [ 1.974677] systemd[1]: Reached target Preparation for Local File Systems.1814worker2 # [ 1.974705] systemd[1]: Reached target Local File Systems.1815client # [ 1.891214] systemd[1]: Starting Create Static Device Nodes in /dev...1816worker2 # [ 1.978608] systemd[1]: Starting Rule-based Manager for Device Events and Files...1817worker1 # [ 1.890048] systemd[1]: Mounted Kernel Configuration File System.1818worker1 # [ 1.894658] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1819client # [ 1.899030] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1820client # [ 1.903611] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01821client # [ 1.903839] [drm] features: -virgl +edid -resource_blob -host_visible1822client # [ 1.903848] [drm] features: -context_init1823client # [ 1.904567] [drm] number of scanouts: 11824client # [ 1.904584] [drm] number of cap sets: 01825worker2 # [ 1.986122] Console: switching to colour frame buffer device 160x501826worker1 # [ 1.899365] systemd-journald[73]: Collecting audit messages is disabled.1827worker2 # [ 1.992644] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1828lb # [ 1.903515] systemd[1]: Starting Journal Service...1829worker1 # [ 1.910170] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1830worker1 # [ 1.912431] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1831lb # [ 1.917181] systemd[1]: Starting Load Kernel Modules...1832lb # [ 1.917305] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1833worker1 # [ 1.918208] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01834worker1 # [ 1.918447] [drm] features: -virgl +edid -resource_blob -host_visible1835worker1 # [ 1.918456] [drm] features: -context_init1836worker1 # [ 1.919201] [drm] number of scanouts: 11837worker1 # [ 1.919220] [drm] number of cap sets: 01838client # [ 1.926938] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1839client # [ 1.926960] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01840client # [ 1.936278] systemd[1]: Finished Create Static Device Nodes in /dev.1841worker2 # [ 2.022374] systemd[1]: Finished Load Kernel Modules.1842client # [ 1.936480] systemd[1]: Reached target Preparation for Local File Systems.1843worker1 # [ 1.922929] systemd[1]: Starting Create Static Device Nodes in /dev...1844client # [ 1.936507] systemd[1]: Reached target Local File Systems.1845client # [ 1.943186] systemd[1]: Starting Rule-based Manager for Device Events and Files...1846worker2 # [ 2.030120] systemd[1]: Starting Apply Kernel Variables...1847worker1 # [ 1.937848] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1848worker1 # [ 1.937868] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01849lb # [ 1.941251] systemd[1]: Starting Coldplug All udev Devices...1850lb # [ 1.945693] systemd[1]: Finished Create List of Static Device Nodes.1851lb # [ 1.946573] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1852lb # [ 1.946871] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1853lb # [ 1.947097] systemd[1]: Mounted Kernel Configuration File System.1854lb # [ 1.958187] systemd-journald[73]: Collecting audit messages is disabled.1855client # [ 1.959260] Console: switching to colour frame buffer device 160x501856lb # [ 1.961086] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1857worker1 # [ 1.965892] systemd[1]: Finished Create Static Device Nodes in /dev.1858worker1 # [ 1.966063] systemd[1]: Reached target Preparation for Local File Systems.1859worker1 # [ 1.966091] systemd[1]: Reached target Local File Systems.1860worker2 # [ 2.048330] systemd-modules-load[74]: Inserted module 'dm_mod'1861worker1 # [ 1.970086] systemd[1]: Starting Rule-based Manager for Device Events and Files...1862worker2 # [ 2.067194] systemd[1]: Started Journal Service.1863worker2 # [ 2.052710] systemd-modules-load[74]: Module 'virtio_balloon' is built in1864worker2 # [ 2.053833] systemd-modules-load[74]: Module 'virtio_console' is built in1865worker2 # [ 2.054877] systemd-modules-load[74]: Inserted module 'virtio_gpu'1866worker2 # [ 2.055873] systemd-modules-load[74]: Module 'virtio_rng' is built in1867client # [ 1.991444] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1868lb # [ 1.986782] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1869worker1 # [ 1.981744] Console: switching to colour frame buffer device 160x501870worker1 # [ 1.988137] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1871worker2 # [ 2.074606] systemd[1]: Starting Create System Files and Directories...1872client # [ 2.007420] systemd[1]: Finished Load Kernel Modules.1873lb # [ 2.004826] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1874worker2 # [ 2.075992] systemd-udevd[79]: Using default interface naming scheme 'v261'.1875client # [ 2.015226] systemd[1]: Starting Apply Kernel Variables...1876lb # [ 2.012619] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01877worker2 # [ 2.092382] systemd[1]: Finished Apply Kernel Variables.1878worker1 # [ 2.013779] systemd[1]: Finished Load Kernel Modules.1879worker1 # [ 2.017043] systemd[1]: Starting Apply Kernel Variables...1880lb # [ 2.025620] [drm] features: -virgl +edid -resource_blob -host_visible1881lb # [ 2.025640] [drm] features: -context_init1882lb # [ 2.026387] [drm] number of scanouts: 11883lb # [ 2.026405] [drm] number of cap sets: 01884lb # [ 2.029511] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1885worker2 # [ 2.106604] systemd[1]: Finished Create System Files and Directories.1886lb # [ 2.031983] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1887lb # [ 2.032003] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01888lb # [ 2.034832] systemd[1]: Starting Create Static Device Nodes in /dev...1889client # [ 2.047501] systemd[1]: Finished Apply Kernel Variables.1890worker2 # [ 2.125653] systemd[1]: Started Rule-based Manager for Device Events and Files.1891worker1 # [ 2.058208] systemd[1]: Finished Apply Kernel Variables.1892client # [ 2.070708] systemd[1]: Started Journal Service.1893lb # [ 2.061064] Console: switching to colour frame buffer device 160x501894client # [ 2.064218] systemd-modules-load[74]: Inserted module 'dm_mod'1895client # [ 2.065446] systemd-modules-load[74]: Module 'virtio_balloon' is built in1896client # [ 2.068336] systemd-modules-load[74]: Module 'virtio_console' is built in1897client # [ 2.073311] systemd-modules-load[74]: Inserted module 'virtio_gpu'1898lb # [ 2.085362] systemd[1]: Finished Create Static Device Nodes in /dev.1899client # [ 2.080124] systemd-modules-load[74]: Module 'virtio_rng' is built in1900lb # [ 2.085713] systemd[1]: Reached target Preparation for Local File Systems.1901lb # [ 2.085737] systemd[1]: Reached target Local File Systems.1902client # [ 2.084545] systemd-udevd[81]: Using default interface naming scheme 'v261'.1903lb # [ 2.089682] systemd[1]: Starting Rule-based Manager for Device Events and Files...1904worker1 # [ 2.089623] systemd[1]: Started Journal Service.1905worker1 # [ 2.080320] systemd-modules-load[74]: Inserted module 'dm_mod'1906client # [ 2.089314] systemd[1]: Starting Create System Files and Directories...1907worker1 # [ 2.081543] systemd-modules-load[74]: Module 'virtio_balloon' is built in1908lb # [ 2.102965] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1909worker1 # [ 2.092293] systemd-modules-load[74]: Module 'virtio_console' is built in1910worker1 # [ 2.093394] systemd-modules-load[74]: Inserted module 'virtio_gpu'1911worker2 # [ 2.184113] systemd[1]: Starting Virtual Console Setup...1912worker1 # [ 2.094399] systemd-modules-load[74]: Module 'virtio_rng' is built in1913worker1 # [ 2.095699] systemd-udevd[79]: Using default interface naming scheme 'v261'.1914client # [ 2.105966] systemd[1]: Finished Create System Files and Directories.1915client # [ 2.110862] systemd[1]: Started Rule-based Manager for Device Events and Files.1916lb # [ 2.117050] systemd[1]: Finished Load Kernel Modules.1917lb # [ 2.120014] systemd[1]: Starting Apply Kernel Variables...1918worker1 # [ 2.108486] systemd[1]: Starting Create System Files and Directories...1919worker1 # [ 2.123048] systemd[1]: Finished Create System Files and Directories.1920lb # [ 2.143329] systemd[1]: Started Journal Service.1921lb # [ 2.136317] systemd-modules-load[74]: Inserted module 'dm_mod'1922worker1 # [ 2.139069] systemd[1]: Started Rule-based Manager for Device Events and Files.1923lb # [ 2.137572] systemd-modules-load[74]: Module 'virtio_balloon' is built in1924lb # [ 2.138801] systemd-modules-load[74]: Module 'virtio_console' is built in1925lb # [ 2.139853] systemd-modules-load[74]: Inserted module 'virtio_gpu'1926worker2 # [ 2.232439] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1927worker2 # [ 2.235917] systemd[1]: Finished Virtual Console Setup.1928lb # [ 2.156380] systemd-modules-load[74]: Module 'virtio_rng' is built in1929lb # [ 2.157392] systemd[1]: Starting Create System Files and Directories...1930client # [ 2.168164] systemd[1]: Starting Virtual Console Setup...1931lb # [ 2.168123] systemd[1]: Finished Apply Kernel Variables.1932lb # [ 2.173596] systemd-udevd[80]: Using default interface naming scheme 'v261'.1933worker1 # [ 2.196189] systemd[1]: Starting Virtual Console Setup...1934lb # [ 2.198183] systemd[1]: Finished Create System Files and Directories.1935client # [ 2.216517] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1936client # [ 2.219918] systemd[1]: Finished Virtual Console Setup.1937lb # [ 2.216688] systemd[1]: Started Rule-based Manager for Device Events and Files.1938worker1 # [ 2.244457] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1939worker1 # [ 2.247663] systemd[1]: Finished Virtual Console Setup.1940lb # [ 2.270655] systemd[1]: Starting Virtual Console Setup...1941lb # [ 2.316515] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942lb # [ 2.319734] systemd[1]: Finished Virtual Console Setup.1943worker2 # [ 2.856734] systemd[1]: Finished Coldplug All udev Devices.1944worker2 # [ 2.857729] systemd[1]: Reached target System Initialization.1945worker2 # [ 2.858519] systemd[1]: Reached target Basic System.1946client # [ 2.830948] systemd[1]: Finished Coldplug All udev Devices.1947client # [ 2.831920] systemd[1]: Reached target System Initialization.1948client # [ 2.832853] systemd[1]: Reached target Basic System.1949worker2 # [ 2.967816] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1950worker1 # [ 2.880821] systemd[1]: Finished Coldplug All udev Devices.1951worker1 # [ 2.882616] systemd[1]: Reached target System Initialization.1952worker1 # [ 2.888786] systemd[1]: Reached target Basic System.1953worker2 # [ 3.022907] (udev-worker)[105]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1954worker2 # [ 3.027272] (udev-worker)[105]: Network interface NamePolicy= disabled on kernel command line.1955lb # [ 2.948122] systemd[1]: Finished Coldplug All udev Devices.1956lb # [ 2.949327] systemd[1]: Reached target System Initialization.1957lb # [ 2.950219] systemd[1]: Reached target Basic System.1958client # [ 2.982418] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1959client # [ 2.988323] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1960client # [ 3.001184] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1961worker2 # [ 3.098917] systemd[1]: Found device /dev/disk/by-label/nixos.1962worker2 # [ 3.103128] systemd[1]: Reached target Initrd Root Device.1963worker2 # [ 3.108090] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1964worker1 # [ 3.027887] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1965client # [ 3.057664] systemd[1]: Found device /dev/disk/by-label/nixos.1966client # [ 3.060239] systemd[1]: Reached target Initrd Root Device.1967client # [ 3.063423] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1968lb # [ 3.060788] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1969worker1 # [ 3.065223] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line.1970worker2 # [ 3.157244] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1971lb # [ 3.065081] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1972worker2 # [ 3.164072] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1973worker2 # [ 3.167020] systemd[1]: Mounting /sysroot...1974worker1 # [ 3.076706] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1975client # [ 3.116147] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1976worker2 # [ 3.220162] EXT4-fs (vda): mounted filesystem aec858d2-5d06-438b-9c8f-f6d3d233f714 r/w with ordered data mode. Quota mode: none.1977client # [ 3.122607] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1978lb # [ 3.115593] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1979worker2 # [ 3.209205] systemd[1]: Mounted /sysroot.1980worker2 # [ 3.210649] systemd[1]: Reached target Initrd Root File System.1981worker2 # [ 3.215945] systemd[1]: Starting Mountpoints Configured in the Real Root...1982client # [ 3.135784] systemd[1]: Mounting /sysroot...1983worker1 # [ 3.134235] systemd[1]: Found device /dev/disk/by-label/nixos.1984worker1 # [ 3.140794] systemd[1]: Reached target Initrd Root Device.1985worker1 # [ 3.145948] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1986worker2 # [ 3.243025] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1987worker2 # [ 3.248856] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1988worker2 # [ 3.253166] systemd[1]: Reloading...1989client # [ 3.186636] EXT4-fs (vda): mounted filesystem b6e2d0ae-d1f1-4def-b2ed-b2796ca7bdd9 r/w with ordered data mode. Quota mode: none.1990client # [ 3.177055] systemd[1]: Mounted /sysroot.1991client # [ 3.178953] systemd[1]: Reached target Initrd Root File System.1992client # [ 3.183992] systemd[1]: Starting Mountpoints Configured in the Real Root...1993lb # [ 3.176105] systemd[1]: Found device /dev/disk/by-label/nixos.1994lb # [ 3.178694] systemd[1]: Reached target Initrd Root Device.1995lb # [ 3.182289] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1996client # [ 3.202424] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload.1997worker1 # [ 3.197233] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1998client # [ 3.210379] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)...1999client # [ 3.212891] systemd[1]: Reloading...2000worker1 # [ 3.207192] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.
loading 1,352 hidden lines…
3353client # [ 14.860417] systemd[1]: Finished Virtual Console Setup.3354worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3355worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3356worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3357worker2: waiting for unit network-addresses-eth1.service3358worker2: waiting for the VM to finish booting3359worker2: Guest shell says: b'Spawning backdoor root shell...\n'3360worker2: connected to guest root shell3361worker2: (connecting took 0.00 seconds)3362worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3363worker2 # [ 14.990842] systemd-vconsole-setup[698]: Configuration of first virtual console was skipped, ignoring remaining ones.3364worker2 # [ 14.997093] systemd[1]: Finished Virtual Console Setup.3365worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds)3366worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3367worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3368lb: waiting for unit niks3.service3369client # [ 15.155298] dhcpcd[543]: eth0: soliciting an IPv6 router3370client # [ 15.158991] dhcpcd[543]: eth0: Router Advertisement from fe80::23371client # [ 15.161645] dhcpcd[543]: eth0: adding address fec0::5054:ff:fe12:3456/643372client # [ 15.164552] dhcpcd[543]: eth0: adding route to fec0::/643373client # [ 15.166754] dhcpcd[543]: eth0: adding default route via fe80::23374worker2 # [ 15.358384] dhcpcd[637]: eth0: soliciting a DHCP lease3375worker2 # [ 15.361872] dhcpcd[637]: eth0: offered 10.0.2.15 from 10.0.2.23376worker2 # [ 15.368489] dhcpcd[637]: eth0: probing address 10.0.2.15/243377worker1 # [ 15.334814] dhcpcd[643]: eth0: soliciting an IPv6 router3378worker1 # [ 15.338584] dhcpcd[643]: eth0: Router Advertisement from fe80::23379worker1 # [ 15.341216] dhcpcd[643]: eth0: adding address fec0::5054:ff:fe12:3456/643380worker1 # [ 15.343994] dhcpcd[643]: eth0: adding route to fec0::/643381worker1 # [ 15.346284] dhcpcd[643]: eth0: adding default route via fe80::23382lb # [ 15.628231] dhcpcd[656]: eth0: soliciting an IPv6 router3383lb # [ 15.629058] dhcpcd[656]: eth0: Router Advertisement from fe80::23384lb # [ 15.629863] dhcpcd[656]: eth0: adding address fec0::5054:ff:fe12:3456/643385lb # [ 15.630766] dhcpcd[656]: eth0: adding route to fec0::/643386lb # [ 15.631479] dhcpcd[656]: eth0: adding default route via fe80::23387worker2 # [ 15.965687] dhcpcd[637]: eth0: soliciting an IPv6 router3388worker2 # [ 15.969038] dhcpcd[637]: eth0: Router Advertisement from fe80::23389worker2 # [ 15.971555] dhcpcd[637]: eth0: adding address fec0::5054:ff:fe12:3456/643390worker2 # [ 15.975067] dhcpcd[637]: eth0: adding route to fec0::/643391worker2 # [ 15.977525] dhcpcd[637]: eth0: adding default route via fe80::23392lb # [ 16.008221] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3393lb # [ 16.009389] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3394lb # [ 16.010363] systemd[1]: Stopped Virtual Console Setup.3395lb # [ 16.011057] systemd[1]: Stopping Virtual Console Setup...3396lb # [ 16.020119] systemd[1]: Starting Virtual Console Setup...3397lb # [ 16.048627] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3398lb # [ 16.051919] systemd[1]: Stopped Virtual Console Setup.3399lb # [ 16.055517] systemd[1]: Starting Virtual Console Setup...3400lb # [ 16.107877] postgresql-pre-start[690]: selecting default time zone ... UTC3401lb # [ 16.112490] postgresql-pre-start[690]: creating configuration files ... ok3402lb # [ 16.481974] systemd-vconsole-setup[787]: Configuration of first virtual console was skipped, ignoring remaining ones.3403lb # [ 16.490566] systemd[1]: Finished Virtual Console Setup.3404lb # [ 16.497350] postgresql-pre-start[690]: running bootstrap script ... ok3405lb # [ 17.080129] postgresql-pre-start[690]: performing post-bootstrap initialization ... ok3406lb # [ 17.248103] postgresql-pre-start[690]: syncing data to disk ... ok3407lb # [ 17.249008] postgresql-pre-start[690]: initdb: warning: enabling "trust" authentication for local connections3408lb # [ 17.250242] postgresql-pre-start[690]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3409lb # [ 17.252273] postgresql-pre-start[690]: Success. You can now start the database server using:3410lb # [ 17.253444] postgresql-pre-start[690]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3411lb # [ 17.422959] postgres[806]: [806] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3412lb # [ 17.429270] postgres[806]: [806] LOG: listening on IPv6 address "::1", port 54323413lb # [ 17.430472] postgres[806]: [806] LOG: listening on IPv4 address "127.0.0.1", port 54323414lb # [ 17.432407] postgres[806]: [806] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3415lb # [ 17.447355] postgres[829]: [829] LOG: database system was shut down at 2026-09-20 09:05:13 GMT3416lb # [ 17.451855] postgres[806]: [806] LOG: database system is ready to accept connections3417lb # [ 17.457403] systemd[1]: Started PostgreSQL Server.3418lb # [ 17.466045] systemd[1]: Starting PostgreSQL Setup Scripts...3419lb # [ 17.686263] postgresql-setup-start[840]: CREATE DATABASE3420lb # [ 17.734097] postgresql-setup-start[845]: CREATE ROLE3421lb # [ 17.757934] postgresql-setup-start[847]: ALTER DATABASE3422lb # [ 17.764685] systemd[1]: Finished PostgreSQL Setup Scripts.3423lb # [ 17.766456] systemd[1]: Reached target PostgreSQL.3424worker1 # [ 18.193232] dhcpcd[643]: eth0: leased 10.0.2.15 for 86400 seconds3425worker1 # [ 18.196521] dhcpcd[643]: eth0: adding route to 10.0.2.0/243426worker1 # [ 18.199274] dhcpcd[643]: eth0: adding default route via 10.0.2.23427worker1 # [ 18.355357] systemd[1]: Started DHCP Client.3428worker1 # [ 18.357665] systemd[1]: Reached target Multi-User System.3429worker1 # [ 18.358509] systemd[1]: Startup finished in 950ms (kernel) + 5.491s (initrd) + 11.915s (userspace) = 18.357s.3430client # [ 18.938042] dhcpcd[543]: eth0: leased 10.0.2.15 for 86400 seconds3431client # [ 18.941181] dhcpcd[543]: eth0: adding route to 10.0.2.0/243432client # [ 18.941351] dhcpcd[543]: eth0: adding default route via 10.0.2.23433client # [ 19.114012] systemd[1]: Started DHCP Client.3434client # [ 19.118390] systemd[1]: Reached target Multi-User System.3435client # [ 19.119364] systemd[1]: Startup finished in 932ms (kernel) + 5.510s (initrd) + 12.674s (userspace) = 19.117s.3436lb # [ 19.716670] dhcpcd[656]: eth0: leased 10.0.2.15 for 86400 seconds3437lb # [ 19.720618] dhcpcd[656]: eth0: adding route to 10.0.2.0/243438lb # [ 19.722917] dhcpcd[656]: eth0: adding default route via 10.0.2.23439lb # [ 19.879087] systemd[1]: Started DHCP Client.3440lb # [ 19.881941] systemd[1]: Reached target Network is Online.3441lb # [ 19.886997] systemd[1]: Started Envoy reverse proxy.3442lb # [ 19.893902] systemd[1]: Started mock-oidc.service.3443lb # [ 20.006469] mock-oidc-server[924]: Mock OIDC Server running3444lb # [ 20.007306] mock-oidc-server[924]: OIDC Address: 192.168.1.2:80803445lb # [ 20.009891] mock-oidc-server[924]: Issue Address: 0.0.0.0:80813446lb # [ 20.011233] mock-oidc-server[924]: Issuer: http://192.168.1.2:8080/oidc3447lb # [ 20.013092] mock-oidc-server[924]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3448lb # [ 20.014664] mock-oidc-server[924]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3449lb # [ 20.016998] mock-oidc-server[924]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3450lb # [ 20.578320] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3451lb # [ 20.580294] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:469] statically linked extensions:3452lb # [ 20.582074] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3453lb # [ 20.584134] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3454lb # [ 20.586587] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3455lb # [ 20.589641] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3456lb # [ 20.592349] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3457lb # [ 20.596050] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3458worker2 # [ 20.702815] dhcpcd[637]: eth0: leased 10.0.2.15 for 86400 seconds3459worker2 # [ 20.706489] dhcpcd[637]: eth0: adding route to 10.0.2.0/243460lb # [ 20.619164] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3461worker2 # [ 20.710037] dhcpcd[637]: eth0: adding default route via 10.0.2.23462lb # [ 20.621691] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3463lb # [ 20.629709] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3464lb # [ 20.631703] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3465lb # [ 20.634928] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3466lb # [ 20.640032] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3467lb # [ 20.642802] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3468lb # [ 20.647722] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3469lb # [ 20.650440] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3470lb # [ 20.653394] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3471lb # [ 20.658014] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3472lb # [ 20.659992] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3473lb # [ 20.662758] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3474lb # [ 20.667965] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3475lb # [ 20.676353] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3476lb # [ 20.692763] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3477lb # [ 20.700188] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3478lb # [ 20.706079] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3479lb # [ 20.710745] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3480lb # [ 20.715641] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3481lb # [ 20.718265] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3482lb # [ 20.722545] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3483lb # [ 20.726769] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3484lb # [ 20.733609] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3485lb # [ 20.737969] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3486lb # [ 20.741505] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3487lb # [ 20.743834] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3488lb # [ 20.747123] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3489lb # [ 20.750496] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3490lb # [ 20.753135] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3491lb # [ 20.756683] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3492lb # [ 20.758831] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3493lb # [ 20.764558] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3494lb # [ 20.766518] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3495lb # [ 20.769740] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3496lb # [ 20.772268] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3497lb # [ 20.775547] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3498worker2 # [ 20.878084] systemd[1]: Started DHCP Client.3499lb # [ 20.785299] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13500worker2 # [ 20.880443] systemd[1]: Reached target Multi-User System.3501worker2 # [ 20.881342] systemd[1]: Startup finished in 942ms (kernel) + 5.512s (initrd) + 14.424s (userspace) = 20.879s.3502lb # [ 20.787804] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3503lb # [ 20.791797] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3504lb # [ 20.795266] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3505lb # [ 20.798642] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3506lb # [ 20.802373] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3507lb # [ 20.805541] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3508lb # [ 20.810007] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3509lb # [ 20.814604] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3510lb # [ 20.819837] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3511lb # [ 20.822442] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3512lb # [ 20.824857] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3513lb # [ 20.826785] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3514lb # [ 20.829383] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3515lb # [ 20.832041] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3516lb # [ 20.834793] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3517lb # [ 20.839002] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3518lb # [ 20.841659] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3519lb # [ 20.845263] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3520lb # [ 20.848824] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3521lb # [ 20.851027] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3522lb # [ 20.861305] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3523lb # [ 20.866509] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3524lb # [ 20.877797] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3525lb # [ 20.880132] envoy[923]: [2026-09-20 09:05:17.216][923][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3526lb # [ 20.885000] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3527lb # [ 20.892463] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3528lb # [ 20.923897] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3529lb # [ 20.926141] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23530lb # [ 20.928431] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83531lb # [ 20.930778] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3532lb # [ 20.935441] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3533lb # [ 20.939199] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3534lb # [ 20.943165] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3535lb # [ 20.946531] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3536lb # [ 20.949040] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3537lb # [ 20.953099] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3538lb # [ 20.961174] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3539lb # [ 20.974260] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3540lb # [ 20.977755] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3541lb # [ 20.980398] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3542lb # [ 20.983501] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3543lb # [ 20.986146] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3544lb # [ 20.989824] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23545lb # [ 20.992679] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3546lb # [ 20.994634] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3547lb # [ 20.997167] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3548lb # [ 20.999503] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3549lb # [ 21.003382] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3550lb # [ 21.006978] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3551lb # [ 21.013301] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3552worker1 # [ 21.016604] systemd[1]: Starting Nix worker-protocol over gRPC...3553lb # [ 21.015241] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3554lb # [ 21.022984] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3555lb # [ 21.027449] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3556lb # [ 21.031066] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3557lb # [ 21.034043] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3558lb # [ 21.036349] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3559worker2 # [ 21.130159] systemd[1]: Starting Nix worker-protocol over gRPC...3560lb # [ 21.039592] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3561lb # [ 21.047002] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23562lb # [ 21.049002] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3563lb # [ 21.051644] envoy[923]: [2026-09-20 09:05:17.217][923][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3564lb # [ 21.055956] envoy[923]: [2026-09-20 09:05:17.254][923][info][main] [source/server/server.cc:531] HTTP header map info:3565lb # [ 21.058563] envoy[923]: [2026-09-20 09:05:17.256][923][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3566lb # [ 21.075621] envoy[923]: [2026-09-20 09:05:17.256][923][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3567lb # [ 21.077664] envoy[923]: [2026-09-20 09:05:17.256][923][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3568lb # [ 21.087773] envoy[923]: [2026-09-20 09:05:17.256][923][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3569lb # [ 21.090195] envoy[923]: [2026-09-20 09:05:17.395][923][info][main] [source/server/server.cc:968] runtime: {}3570lb # [ 21.091956] envoy[923]: [2026-09-20 09:05:17.408][923][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3571lb # [ 21.094502] envoy[923]: [2026-09-20 09:05:17.408][923][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013572lb # [ 21.096893] envoy[923]: [2026-09-20 09:05:17.408][923][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013573lb # [ 21.100136] envoy[923]: [2026-09-20 09:05:17.415][923][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3574lb # [ 21.103088] envoy[923]: [2026-09-20 09:05:17.415][923][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3575lb # [ 21.106514] envoy[923]: [2026-09-20 09:05:17.415][923][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3576lb # [ 21.110273] envoy[923]: [2026-09-20 09:05:17.665][923][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3577lb # [ 21.111869] envoy[923]: [2026-09-20 09:05:17.742][923][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3578lb # [ 21.114776] envoy[923]: [2026-09-20 09:05:17.745][923][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3579lb # [ 21.118289] envoy[923]: [2026-09-20 09:05:17.745][923][info][main] [source/server/server.cc:1077] starting main dispatch loop3580worker1 # [ 21.268803] nix-grpc-daemon[774]: ts=2026-09-20T09:05:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3581worker1 # [ 21.280314] nix-grpc-daemon[774]: ts=2026-09-20T09:05:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13582worker2 # [ 21.382569] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3583worker2 # [ 21.394029] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13584worker1 # [ 21.324070] nix-grpc-daemon[774]: ts=2026-09-20T09:05:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3585worker1 # [ 21.328864] systemd[1]: Started Nix worker-protocol over gRPC.3586worker2 # [ 21.439773] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3587worker2 # [ 21.444928] systemd[1]: Started Nix worker-protocol over gRPC.3588lb # [ 21.370927] envoy[923]: [2026-09-20 09:05:18.009][923][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3589lb # [ 21.383547] envoy[923]: [2026-09-20 09:05:18.009][923][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3590worker1 # [ 21.395379] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=scheduler_connected addr=lb:500513591lb # [ 21.392234] envoy[923]: [2026-09-20 09:05:18.009][923][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3592lb # [ 21.399596] envoy[923]: [2026-09-20 09:05:18.009][923][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3593worker2 # [ 21.511252] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=scheduler_connected addr=lb:500513594worker1 # [ 21.423225] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3595worker2 # [ 21.527177] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3596worker1 # [ 21.624563] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=scheduler_connected addr=lb:500513597worker1 # [ 21.629920] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3598worker2 # [ 21.728615] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=scheduler_connected addr=lb:500513599worker2 # [ 21.733828] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3600worker1 # [ 21.830439] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=scheduler_connected addr=lb:500513601worker1 # [ 21.835798] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3602worker2 # [ 21.934437] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=scheduler_connected addr=lb:500513603worker2 # [ 21.939761] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3604worker1 # [ 22.036750] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=scheduler_connected addr=lb:500513605worker1 # [ 22.041983] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3606worker2 # [ 22.140621] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=scheduler_connected addr=lb:500513607worker2 # [ 22.146326] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3608worker1 # [ 22.242803] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=scheduler_connected addr=lb:500513609worker1 # [ 22.248157] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3610worker2 # [ 22.346985] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=scheduler_connected addr=lb:500513611worker2 # [ 22.352579] nix-grpc-daemon[772]: ts=2026-09-20T09:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3612worker1 # [ 22.450091] nix-grpc-daemon[774]: ts=2026-09-20T09:05:19Z level=info event=scheduler_connected addr=lb:500513613worker1 # [ 22.455118] nix-grpc-daemon[774]: ts=2026-09-20T09:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3614worker2 # [ 22.554510] nix-grpc-daemon[772]: ts=2026-09-20T09:05:19Z level=info event=scheduler_connected addr=lb:500513615worker2 # [ 22.559736] nix-grpc-daemon[772]: ts=2026-09-20T09:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3616worker1 # [ 22.655888] nix-grpc-daemon[774]: ts=2026-09-20T09:05:19Z level=info event=scheduler_connected addr=lb:500513617worker1 # [ 22.661044] nix-grpc-daemon[774]: ts=2026-09-20T09:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3618worker2 # [ 22.760450] nix-grpc-daemon[772]: ts=2026-09-20T09:05:19Z level=info event=scheduler_connected addr=lb:500513619worker2 # [ 22.765799] nix-grpc-daemon[772]: ts=2026-09-20T09:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3620worker1 # [ 22.861699] nix-grpc-daemon[774]: ts=2026-09-20T09:05:19Z level=info event=scheduler_connected addr=lb:500513621worker1 # [ 22.866833] nix-grpc-daemon[774]: ts=2026-09-20T09:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3622worker2 # [ 22.966808] nix-grpc-daemon[772]: ts=2026-09-20T09:05:19Z level=info event=scheduler_connected addr=lb:500513623worker2 # [ 22.972393] nix-grpc-daemon[772]: ts=2026-09-20T09:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3624worker1 # [ 23.068373] nix-grpc-daemon[774]: ts=2026-09-20T09:05:19Z level=info event=scheduler_connected addr=lb:500513625worker1 # [ 23.078873] nix-grpc-daemon[774]: ts=2026-09-20T09:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3626worker2 # [ 23.173002] nix-grpc-daemon[772]: ts=2026-09-20T09:05:19Z level=info event=scheduler_connected addr=lb:500513627worker2 # [ 23.178354] nix-grpc-daemon[772]: ts=2026-09-20T09:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3628worker1 # [ 23.275654] nix-grpc-daemon[774]: ts=2026-09-20T09:05:19Z level=info event=scheduler_connected addr=lb:500513629worker1 # [ 23.281442] nix-grpc-daemon[774]: ts=2026-09-20T09:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3630worker2 # [ 23.379262] nix-grpc-daemon[772]: ts=2026-09-20T09:05:20Z level=info event=scheduler_connected addr=lb:500513631worker2 # [ 23.384723] nix-grpc-daemon[772]: ts=2026-09-20T09:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3632worker1 # [ 23.483663] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=scheduler_connected addr=lb:500513633worker1 # [ 23.488842] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3634worker2 # [ 23.586620] nix-grpc-daemon[772]: ts=2026-09-20T09:05:20Z level=info event=scheduler_connected addr=lb:500513635worker2 # [ 23.591886] nix-grpc-daemon[772]: ts=2026-09-20T09:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3636worker1 # [ 23.689895] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=scheduler_connected addr=lb:500513637worker1 # [ 23.695171] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3638worker2 # [ 23.792584] nix-grpc-daemon[772]: ts=2026-09-20T09:05:20Z level=info event=scheduler_connected addr=lb:500513639worker2 # [ 23.798020] nix-grpc-daemon[772]: ts=2026-09-20T09:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3640worker1 # [ 23.895829] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=scheduler_connected addr=lb:500513641worker1 # [ 23.901124] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3642worker2 # [ 23.998567] nix-grpc-daemon[772]: ts=2026-09-20T09:05:20Z level=info event=scheduler_connected addr=lb:500513643worker2 # [ 24.003972] nix-grpc-daemon[772]: ts=2026-09-20T09:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3644worker1 # [ 24.101922] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=scheduler_connected addr=lb:500513645worker1 # [ 24.107222] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3646worker2 # [ 24.204836] nix-grpc-daemon[772]: ts=2026-09-20T09:05:20Z level=info event=scheduler_connected addr=lb:500513647worker2 # [ 24.210049] nix-grpc-daemon[772]: ts=2026-09-20T09:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3648worker1 # [ 24.308038] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=scheduler_connected addr=lb:500513649worker1 # [ 24.313284] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3650worker2 # [ 24.410649] nix-grpc-daemon[772]: ts=2026-09-20T09:05:21Z level=info event=scheduler_connected addr=lb:500513651worker2 # [ 24.416132] nix-grpc-daemon[772]: ts=2026-09-20T09:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3652worker1 # [ 24.515406] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=info event=scheduler_connected addr=lb:500513653worker1 # [ 24.520683] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3654worker2 # [ 24.617932] nix-grpc-daemon[772]: ts=2026-09-20T09:05:21Z level=info event=scheduler_connected addr=lb:500513655worker2 # [ 24.623427] nix-grpc-daemon[772]: ts=2026-09-20T09:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3656worker1 # [ 24.721456] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=info event=scheduler_connected addr=lb:500513657worker1 # [ 24.726435] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3658worker2 # [ 24.824113] nix-grpc-daemon[772]: ts=2026-09-20T09:05:21Z level=info event=scheduler_connected addr=lb:500513659worker2 # [ 24.829917] nix-grpc-daemon[772]: ts=2026-09-20T09:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3660worker1 # [ 24.927542] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=info event=scheduler_connected addr=lb:500513661worker1 # [ 24.933232] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3662worker2 # [ 25.029805] nix-grpc-daemon[772]: ts=2026-09-20T09:05:21Z level=info event=scheduler_connected addr=lb:500513663worker2 # [ 25.035330] nix-grpc-daemon[772]: ts=2026-09-20T09:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3664worker1 # [ 25.133888] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=info event=scheduler_connected addr=lb:500513665worker1 # [ 25.139326] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3666worker2 # [ 25.235983] nix-grpc-daemon[772]: ts=2026-09-20T09:05:21Z level=info event=scheduler_connected addr=lb:500513667worker2 # [ 25.241860] nix-grpc-daemon[772]: ts=2026-09-20T09:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3668worker1 # [ 25.340258] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=info event=scheduler_connected addr=lb:500513669worker1 # [ 25.346086] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3670worker2 # [ 25.442645] nix-grpc-daemon[772]: ts=2026-09-20T09:05:22Z level=info event=scheduler_connected addr=lb:500513671worker2 # [ 25.449359] nix-grpc-daemon[772]: ts=2026-09-20T09:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3672worker1 # [ 25.548505] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=info event=scheduler_connected addr=lb:500513673worker1 # [ 25.553703] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3674worker2 # [ 25.651345] nix-grpc-daemon[772]: ts=2026-09-20T09:05:22Z level=info event=scheduler_connected addr=lb:500513675worker2 # [ 25.657129] nix-grpc-daemon[772]: ts=2026-09-20T09:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3676worker1 # [ 25.754647] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=info event=scheduler_connected addr=lb:500513677worker1 # [ 25.760172] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3678worker2 # [ 25.857826] nix-grpc-daemon[772]: ts=2026-09-20T09:05:22Z level=info event=scheduler_connected addr=lb:500513679worker2 # [ 25.863477] nix-grpc-daemon[772]: ts=2026-09-20T09:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3680worker1 # [ 25.961007] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=info event=scheduler_connected addr=lb:500513681worker1 # [ 25.966524] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3682worker2 # [ 26.064144] nix-grpc-daemon[772]: ts=2026-09-20T09:05:22Z level=info event=scheduler_connected addr=lb:500513683worker2 # [ 26.069577] nix-grpc-daemon[772]: ts=2026-09-20T09:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3684worker1 # [ 26.167375] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=info event=scheduler_connected addr=lb:500513685worker1 # [ 26.173010] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3686worker2 # [ 26.270310] nix-grpc-daemon[772]: ts=2026-09-20T09:05:22Z level=info event=scheduler_connected addr=lb:500513687worker2 # [ 26.275885] nix-grpc-daemon[772]: ts=2026-09-20T09:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3688worker1 # [ 26.373930] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 26.476603] nix-grpc-daemon[772]: ts=2026-09-20T09:05:23Z level=info event=scheduler_connected addr=lb:500513690worker1 # [ 26.388216] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3691worker2 # [ 26.482067] nix-grpc-daemon[772]: ts=2026-09-20T09:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3692worker1 # [ 26.582706] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=info event=scheduler_connected addr=lb:500513693worker1 # [ 26.588154] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3694worker2 # [ 26.684358] nix-grpc-daemon[772]: ts=2026-09-20T09:05:23Z level=info event=scheduler_connected addr=lb:500513695worker2 # [ 26.689623] nix-grpc-daemon[772]: ts=2026-09-20T09:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3696worker1 # [ 26.789014] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=info event=scheduler_connected addr=lb:500513697worker1 # [ 26.794642] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3698worker2 # [ 26.890324] nix-grpc-daemon[772]: ts=2026-09-20T09:05:23Z level=info event=scheduler_connected addr=lb:500513699worker2 # [ 26.895889] nix-grpc-daemon[772]: ts=2026-09-20T09:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3700worker1 # [ 26.995401] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=info event=scheduler_connected addr=lb:500513701worker1 # [ 27.000857] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3702worker2 # [ 27.096498] nix-grpc-daemon[772]: ts=2026-09-20T09:05:23Z level=info event=scheduler_connected addr=lb:500513703worker2 # [ 27.101800] nix-grpc-daemon[772]: ts=2026-09-20T09:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3704worker1 # [ 27.201695] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=info event=scheduler_connected addr=lb:500513705worker1 # [ 27.206953] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3706worker2 # [ 27.302435] nix-grpc-daemon[772]: ts=2026-09-20T09:05:23Z level=info event=scheduler_connected addr=lb:500513707worker2 # [ 27.308328] nix-grpc-daemon[772]: ts=2026-09-20T09:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3708worker1 # [ 27.407792] nix-grpc-daemon[774]: ts=2026-09-20T09:05:24Z level=info event=scheduler_connected addr=lb:500513709worker1 # [ 27.413170] nix-grpc-daemon[774]: ts=2026-09-20T09:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3710worker2 # [ 27.509951] nix-grpc-daemon[772]: ts=2026-09-20T09:05:24Z level=info event=scheduler_connected addr=lb:500513711worker2 # [ 27.516850] nix-grpc-daemon[772]: ts=2026-09-20T09:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3712worker1 # [ 27.615106] nix-grpc-daemon[774]: ts=2026-09-20T09:05:24Z level=info event=scheduler_connected addr=lb:500513713worker1 # [ 27.620389] nix-grpc-daemon[774]: ts=2026-09-20T09:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3714worker2 # [ 27.718670] nix-grpc-daemon[772]: ts=2026-09-20T09:05:24Z level=info event=scheduler_connected addr=lb:500513715worker2 # [ 27.724199] nix-grpc-daemon[772]: ts=2026-09-20T09:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3716worker1 # [ 27.821399] nix-grpc-daemon[774]: ts=2026-09-20T09:05:24Z level=info event=scheduler_connected addr=lb:500513717worker1 # [ 27.828717] nix-grpc-daemon[774]: ts=2026-09-20T09:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3718worker2 # [ 27.925081] nix-grpc-daemon[772]: ts=2026-09-20T09:05:24Z level=info event=scheduler_connected addr=lb:500513719worker2 # [ 27.930614] nix-grpc-daemon[772]: ts=2026-09-20T09:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3720worker1 # [ 28.029814] nix-grpc-daemon[774]: ts=2026-09-20T09:05:24Z level=info event=scheduler_connected addr=lb:500513721worker1 # [ 28.035084] nix-grpc-daemon[774]: ts=2026-09-20T09:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3722worker2 # [ 28.131281] nix-grpc-daemon[772]: ts=2026-09-20T09:05:24Z level=info event=scheduler_connected addr=lb:500513723worker2 # [ 28.136893] nix-grpc-daemon[772]: ts=2026-09-20T09:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3724worker1 # [ 28.235763] nix-grpc-daemon[774]: ts=2026-09-20T09:05:24Z level=info event=scheduler_connected addr=lb:500513725worker1 # [ 28.241110] nix-grpc-daemon[774]: ts=2026-09-20T09:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3726worker2 # [ 28.337512] nix-grpc-daemon[772]: ts=2026-09-20T09:05:24Z level=info event=scheduler_connected addr=lb:500513727worker2 # [ 28.343022] nix-grpc-daemon[772]: ts=2026-09-20T09:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3728worker1 # [ 28.441654] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=info event=scheduler_connected addr=lb:500513729worker1 # [ 28.446837] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3730worker2 # [ 28.544044] nix-grpc-daemon[772]: ts=2026-09-20T09:05:25Z level=info event=scheduler_connected addr=lb:500513731worker2 # [ 28.549463] nix-grpc-daemon[772]: ts=2026-09-20T09:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3732worker1 # [ 28.649068] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=info event=scheduler_connected addr=lb:500513733worker1 # [ 28.654223] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3734worker2 # [ 28.752072] nix-grpc-daemon[772]: ts=2026-09-20T09:05:25Z level=info event=scheduler_connected addr=lb:500513735worker2 # [ 28.757779] nix-grpc-daemon[772]: ts=2026-09-20T09:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3736worker1 # [ 28.854962] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=info event=scheduler_connected addr=lb:500513737worker1 # [ 28.860306] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3738worker2 # [ 28.958264] nix-grpc-daemon[772]: ts=2026-09-20T09:05:25Z level=info event=scheduler_connected addr=lb:500513739worker2 # [ 28.963708] nix-grpc-daemon[772]: ts=2026-09-20T09:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3740worker1 # [ 29.061163] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=info event=scheduler_connected addr=lb:500513741worker1 # [ 29.066421] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3742worker2 # [ 29.164422] nix-grpc-daemon[772]: ts=2026-09-20T09:05:25Z level=info event=scheduler_connected addr=lb:500513743worker2 # [ 29.169733] nix-grpc-daemon[772]: ts=2026-09-20T09:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3744worker1 # [ 29.267222] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=info event=scheduler_connected addr=lb:500513745worker1 # [ 29.272598] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3746worker2 # [ 29.370390] nix-grpc-daemon[772]: ts=2026-09-20T09:05:25Z level=info event=scheduler_connected addr=lb:500513747worker2 # [ 29.375776] nix-grpc-daemon[772]: ts=2026-09-20T09:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3748worker1 # [ 29.473393] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=info event=scheduler_connected addr=lb:500513749worker1 # [ 29.478698] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3750worker2 # [ 29.576400] nix-grpc-daemon[772]: ts=2026-09-20T09:05:26Z level=info event=scheduler_connected addr=lb:500513751worker2 # [ 29.581688] nix-grpc-daemon[772]: ts=2026-09-20T09:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3752worker1 # [ 29.681304] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=info event=scheduler_connected addr=lb:500513753worker1 # [ 29.688318] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3754worker2 # [ 29.783077] nix-grpc-daemon[772]: ts=2026-09-20T09:05:26Z level=info event=scheduler_connected addr=lb:500513755worker2 # [ 29.786618] nix-grpc-daemon[772]: ts=2026-09-20T09:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3756worker1 # [ 29.888968] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=info event=scheduler_connected addr=lb:500513757worker1 # [ 29.894293] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3758worker2 # [ 29.987566] nix-grpc-daemon[772]: ts=2026-09-20T09:05:26Z level=info event=scheduler_connected addr=lb:500513759worker2 # [ 29.993029] nix-grpc-daemon[772]: ts=2026-09-20T09:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3760worker1 # [ 30.095300] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=info event=scheduler_connected addr=lb:500513761worker1 # [ 30.101273] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3762worker2 # [ 30.193884] nix-grpc-daemon[772]: ts=2026-09-20T09:05:26Z level=info event=scheduler_connected addr=lb:500513763worker2 # [ 30.199265] nix-grpc-daemon[772]: ts=2026-09-20T09:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3764worker1 # [ 30.302277] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=info event=scheduler_connected addr=lb:500513765worker1 # [ 30.307730] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3766worker2 # [ 30.400208] nix-grpc-daemon[772]: ts=2026-09-20T09:05:27Z level=info event=scheduler_connected addr=lb:500513767worker2 # [ 30.406008] nix-grpc-daemon[772]: ts=2026-09-20T09:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3768worker1 # [ 30.508465] nix-grpc-daemon[774]: ts=2026-09-20T09:05:27Z level=info event=scheduler_connected addr=lb:500513769worker1 # [ 30.513943] nix-grpc-daemon[774]: ts=2026-09-20T09:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3770worker2 # [ 30.607054] nix-grpc-daemon[772]: ts=2026-09-20T09:05:27Z level=info event=scheduler_connected addr=lb:500513771worker2 # [ 30.612821] nix-grpc-daemon[772]: ts=2026-09-20T09:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3772worker1 # [ 30.716260] nix-grpc-daemon[774]: ts=2026-09-20T09:05:27Z level=info event=scheduler_connected addr=lb:500513773worker1 # [ 30.721576] nix-grpc-daemon[774]: ts=2026-09-20T09:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3774worker2 # [ 30.815040] nix-grpc-daemon[772]: ts=2026-09-20T09:05:27Z level=info event=scheduler_connected addr=lb:500513775worker2 # [ 30.820709] nix-grpc-daemon[772]: ts=2026-09-20T09:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3776worker1 # [ 30.922336] nix-grpc-daemon[774]: ts=2026-09-20T09:05:27Z level=info event=scheduler_connected addr=lb:500513777worker1 # [ 30.927723] nix-grpc-daemon[774]: ts=2026-09-20T09:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3778worker2 # [ 31.021520] nix-grpc-daemon[772]: ts=2026-09-20T09:05:27Z level=info event=scheduler_connected addr=lb:500513779worker2 # [ 31.026762] nix-grpc-daemon[772]: ts=2026-09-20T09:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3780worker1 # [ 31.128820] nix-grpc-daemon[774]: ts=2026-09-20T09:05:27Z level=info event=scheduler_connected addr=lb:500513781worker1 # [ 31.134197] nix-grpc-daemon[774]: ts=2026-09-20T09:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3782worker2 # [ 31.227496] nix-grpc-daemon[772]: ts=2026-09-20T09:05:27Z level=info event=scheduler_connected addr=lb:500513783worker2 # [ 31.232944] nix-grpc-daemon[772]: ts=2026-09-20T09:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3784worker1 # [ 31.335068] nix-grpc-daemon[774]: ts=2026-09-20T09:05:27Z level=info event=scheduler_connected addr=lb:500513785worker1 # [ 31.340514] nix-grpc-daemon[774]: ts=2026-09-20T09:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3786worker2 # [ 31.433478] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=scheduler_connected addr=lb:500513787worker2 # [ 31.438695] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3788worker1 # [ 31.541470] nix-grpc-daemon[774]: ts=2026-09-20T09:05:28Z level=info event=scheduler_connected addr=lb:500513789worker1 # [ 31.546846] nix-grpc-daemon[774]: ts=2026-09-20T09:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3790worker2 # [ 31.639532] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=scheduler_connected addr=lb:500513791worker2 # [ 31.645633] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3792lb # [ 31.688791] rustfs-bucket-start[1033]: mb s3://farm3793lb # [ 31.699885] systemd[1]: Finished rustfs-bucket.service.3794lb # [ 31.710271] systemd[1]: Starting niks3 server...3795worker1 # [ 31.749029] nix-grpc-daemon[774]: ts=2026-09-20T09:05:28Z level=info event=scheduler_connected addr=lb:500513796worker1 # [ 31.754391] nix-grpc-daemon[774]: ts=2026-09-20T09:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3797worker2 # [ 31.847747] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=scheduler_connected addr=lb:500513798worker2 # [ 31.853832] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3799lb # [ 31.924641] postgres[1048]: [1048] ERROR: relation "goose_db_version" does not exist at character 363800lb # [ 31.925937] postgres[1048]: [1048] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3801worker1 # [ 31.955664] nix-grpc-daemon[774]: ts=2026-09-20T09:05:28Z level=info event=scheduler_connected addr=lb:500513802lb # [ 31.958797] niks3-server[1042]: 2026/09/20 09:05:28 OK 20241026095416_initial_model.sql (19.46ms)3803lb # [ 31.962181] niks3-server[1042]: 2026/09/20 09:05:28 OK 20251210153512_drop_unused_gin_index.sql (3.8ms)3804worker1 # [ 31.961054] nix-grpc-daemon[774]: ts=2026-09-20T09:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3805worker2 # [ 32.054705] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=scheduler_connected addr=lb:500513806lb # [ 31.969122] niks3-server[1042]: 2026/09/20 09:05:28 OK 20251218171726_add_pins.sql (6.88ms)3807worker2 # [ 32.059891] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3808lb # [ 31.973825] niks3-server[1042]: 2026/09/20 09:05:28 OK 20260628120000_add_object_size_and_stats.sql (4.66ms)3809lb # [ 31.978674] niks3-server[1042]: 2026/09/20 09:05:28 OK 20260905000000_add_claims.sql (4.81ms)3810lb # [ 31.983109] niks3-server[1042]: 2026/09/20 09:05:28 OK 20260920000000_drop_claims.sql (4.32ms)3811lb # [ 31.985213] niks3-server[1042]: 2026/09/20 09:05:28 goose: successfully migrated database to version: 202609200000003812lb # [ 31.989476] niks3-server[1042]: 2026/09/20 09:05:28 OK 1_commit_pending_closure.sql (6.34ms)3813lb # [ 31.992084] niks3-server[1042]: 2026/09/20 09:05:28 OK 2_object_stats_trigger.sql (2.44ms)3814lb # [ 31.993446] niks3-server[1042]: 2026/09/20 09:05:28 goose: up to current file version: 23815lb # [ 31.997456] niks3-server[1042]: 2026/09/20 09:05:28 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3816lb # [ 32.045389] niks3-server[1042]: 2026/09/20 09:05:28 INFO Read proxy enabled — serving cache objects from S33817lb # [ 32.046795] niks3-server[1042]: 2026/09/20 09:05:28 INFO Using socket-activated listener address=0.0.0.0:57513818lb # [ 32.050192] systemd[1]: Started niks3 server.3819lb # [ 32.050923] niks3-server[1042]: 2026/09/20 09:05:28 INFO systemd watchdog enabled interval=15s3820lb # [ 32.056678] niks3-server[1042]: 2026/09/20 09:05:28 INFO Starting HTTP server address=0.0.0.0:57513821lb # [ 32.059819] niks3-server[1042]: 2026/09/20 09:05:28 INFO lead: acquired remote=192.168.1.4:456263822worker2 # [ 32.151722] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=scheduler_take_over3823lb # [ 32.062607] systemd[1]: Reached target Multi-User System.3824lb # [ 32.066199] systemd[1]: Startup finished in 931ms (kernel) + 4.695s (initrd) + 26.427s (userspace) = 32.054s.3825worker1 # [ 32.161864] nix-grpc-daemon[774]: ts=2026-09-20T09:05:28Z level=info event=scheduler_connected addr=lb:500513826worker2 # [ 32.254909] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03827worker2 # [ 32.261937] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=scheduler_connected addr=lb:500513828worker2 # [ 32.267127] nix-grpc-daemon[772]: ts=2026-09-20T09:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3829lb: (finished: waiting for unit niks3.service, in 17.35 seconds)3830lb: waiting for TCP port 5751 on localhost3831worker2 # [ 32.467989] nix-grpc-daemon[772]: ts=2026-09-20T09:05:29Z level=info event=scheduler_connected addr=lb:500513832worker2 # [ 32.473480] nix-grpc-daemon[772]: ts=2026-09-20T09:05:29Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03833lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3834lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds)3835lb: waiting for unit envoy.service3836lb: (finished: waiting for unit envoy.service, in 0.06 seconds)3837lb: waiting for TCP port 50051 on localhost3838lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3839lb # [ 32.545651] envoy[923]: conn peer=[::1]:51560 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33840lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3841lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3842lb: must succeed: curl -sf localhost:9901/clusters3843lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3844lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)3845subtest: one node schedules and both builders hold a WorkerSession on it3846lb: must succeed: curl -sf localhost:9901/clusters3847lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3848worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3849worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.13 seconds)3850(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.18 seconds)3851subtest: balancer auth: client cert, bearer token, nothing, unknown CN3852worker1 # [ 33.363105] nix-grpc-daemon[774]: ts=2026-09-20T09:05:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582303853worker1 # [ 33.379243] systemd[1]: Started Nix Daemon.3854worker1 # [ 33.658554] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3855worker1 # [ 33.691140] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 1/5)3856worker1 # [ 33.724944] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 2/5)3857worker1 # [ 33.926226] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 151 ms (attempt 3/5)3858worker1 # [ 34.084859] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 699 ms (attempt 4/5)3859worker1 # [ 34.787637] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3860worker2 # [ 34.917333] nix-grpc-daemon[772]: ts=2026-09-20T09:05:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:352423861worker2 # [ 34.937125] systemd[1]: Started Nix Daemon.3862worker2 # [ 35.209072] nix-daemon[835]: accepted connection from pid 772, user nix-grpc-daemon (trusted)3863worker2 # [ 35.237686] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 1/5)3864worker2 # [ 35.244652] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 2/5)3865worker2 # [ 35.318836] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 250 ms (attempt 3/5)3866worker2 # [ 35.575863] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 793 ms (attempt 4/5)3867worker2 # [ 36.380590] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3868worker2 # [ 36.393088] nix-grpc-daemon[772]: ts=2026-09-20T09:05:33Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3869worker1 # [ 36.325144] nix-grpc-daemon[774]: ts=2026-09-20T09:05:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582303870worker1 # [ 36.342828] nix-grpc-daemon[774]: ts=2026-09-20T09:05:32Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3871client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3872client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds)3873client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3874client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3875worker1 # [ 36.805955] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=oidc_jwks provider=mock keys=13876worker1 # [ 36.811832] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:582303877worker1 # [ 36.824300] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:582303878worker1 # [ 36.836229] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3879worker2 # [ 36.940188] nix-grpc-daemon[772]: ts=2026-09-20T09:05:33Z level=info event=oidc_jwks provider=mock keys=13880worker2 # [ 36.948107] nix-grpc-daemon[772]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:352423881worker2 # [ 36.956392] nix-grpc-daemon[772]: ts=2026-09-20T09:05:33Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3882client: must succeed: rm -r /var/lib/nix-grpc-store3883client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3884worker2 # [ 39.273864] nix-grpc-daemon[772]: ts=2026-09-20T09:05:35Z level=info event=denied method=QueryMissing cn=- role=none3885worker1 # [ 39.429015] nix-grpc-daemon[774]: ts=2026-09-20T09:05:36Z level=info event=denied method=QueryMissing cn=stranger role=none3886(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 6.45 seconds)3887subtest: DAG build is scheduled across workers and lands in the cache3888client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23889client # don't know how to build these paths:3890worker1 # [ 39.682611] nix-grpc-daemon[774]: ts=2026-09-20T09:05:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582303891client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3892worker2 # [ 39.783727] nix-grpc-daemon[772]: ts=2026-09-20T09:05:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352423893worker2 # [ 39.818726] nix-grpc-daemon[772]: ts=2026-09-20T09:05:36Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03894worker2 # [ 39.823397] nix-grpc-daemon[772]: ts=2026-09-20T09:05:36Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13895worker1 # [ 39.775568] nix-grpc-daemon[774]: ts=2026-09-20T09:05:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582303896worker1 # [ 39.792648] nix-grpc-daemon[774]: ts=2026-09-20T09:05:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582303897client # copying 1 paths to 'lb:50051'...3898worker1 # [ 39.803524] nix-grpc-daemon[774]: ts=2026-09-20T09:05:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582303899client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3900worker1 # [ 39.821706] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3901worker1 # [ 39.846955] nix-grpc-daemon[774]: ts=2026-09-20T09:05:36Z level=info event=niks3_push_started pid=8433902worker1 # [ 40.299108] nix-daemon[832]: accepted connection from pid 856, user nix-grpc-daemon (trusted)3903worker1 # [ 40.317116] nix-daemon[832]: reaped child process 859, status = succeeded3904worker1 # [ 40.496415] nix-daemon[832]: accepted connection from pid 861, user nix-grpc-daemon (trusted)3905worker1 # [ 40.512901] nix-daemon[832]: reaped child process 864, status = succeeded3906lb # [ 40.525328] niks3-server[1042]: 2026/09/20 09:05:37 INFO Received uploads request method=POST path=/api/pending_closures3907worker1 # [ 40.552222] nix-grpc-daemon[843]: time=2026-09-20T09:05:37.170Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3908worker1 # [ 40.555984] nix-grpc-daemon[843]: time=2026-09-20T09:05:37.173Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3909lb # [ 40.602392] niks3-server[1042]: 2026/09/20 09:05:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3910lb # [ 40.610568] niks3-server[1042]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3911lb # [ 40.641355] niks3-server[1042]: 2026/09/20 09:05:37 INFO Signed narinfos id=1 count=13912worker1 # [ 40.646815] nix-grpc-daemon[843]: time=2026-09-20T09:05:37.265Z level=INFO msg="Uploading 1 narinfos"3913lb # [ 40.660528] niks3-server[1042]: 2026/09/20 09:05:37 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3914lb # [ 40.674222] niks3-server[1042]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3915lb # [ 40.685135] niks3-server[1042]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3916lb # [ 40.694220] niks3-server[1042]: 2026/09/20 09:05:37 INFO Completed upload id=13917worker1 # [ 40.696595] nix-grpc-daemon[843]: time=2026-09-20T09:05:37.315Z level=INFO msg="Upload complete. (580ms)"3918worker1 # [ 40.709219] nix-grpc-daemon[774]: ts=2026-09-20T09:05:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 paths=1 nar_bytes_in=5043919worker1 # [ 40.727280] nix-grpc-daemon[774]: ts=2026-09-20T09:05:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582303920worker1 # [ 40.739062] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3921worker1 # [ 40.751061] nix-daemon[832]: reaped child process 841, status = succeeded3922client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3923client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3924worker1 # [ 40.763886] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3925lb # [ 41.034709] envoy[923]: conn peer=[2001:db8:1::1]:59960 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=30553926lb # [ 41.039864] envoy[923]: conn peer=[2001:db8:1::1]:59976 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=873927lb # [ 41.044838] envoy[923]: conn peer=[2001:db8:1::1]:59988 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=123928lb # [ 41.049411] envoy[923]: conn peer=[2001:db8:1::1]:59996 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=123929client # farm-a> LOG-farm-a-t13930worker1 # [ 42.414131] nix-daemon[832]: reaped child process 868, status = succeeded3931worker1 # [ 42.591345] nix-daemon[832]: accepted connection from pid 883, user nix-grpc-daemon (trusted)3932worker1 # [ 42.608990] nix-daemon[832]: reaped child process 886, status = succeeded3933lb # [ 42.622448] niks3-server[1042]: 2026/09/20 09:05:39 INFO Received uploads request method=POST path=/api/pending_closures3934worker1 # [ 42.637143] nix-grpc-daemon[843]: time=2026-09-20T09:05:39.254Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3935worker1 # [ 42.639775] nix-grpc-daemon[843]: time=2026-09-20T09:05:39.254Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3936lb # [ 42.674256] niks3-server[1042]: 2026/09/20 09:05:39 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3937lb # [ 42.693511] niks3-server[1042]: 2026/09/20 09:05:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3938worker1 # [ 42.696215] nix-grpc-daemon[843]: time=2026-09-20T09:05:39.313Z level=INFO msg="Uploading 1 narinfos"3939lb # [ 42.701034] niks3-server[1042]: 2026/09/20 09:05:39 INFO Signed narinfos id=2 count=13940lb # [ 42.706788] niks3-server[1042]: 2026/09/20 09:05:39 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3941lb # [ 42.712874] niks3-server[1042]: 2026/09/20 09:05:39 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3942lb # [ 42.721942] niks3-server[1042]: 2026/09/20 09:05:39 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3943lb # [ 42.726558] niks3-server[1042]: 2026/09/20 09:05:39 INFO Completed upload id=23944worker1 # [ 42.728720] nix-grpc-daemon[843]: time=2026-09-20T09:05:39.347Z level=INFO msg="Upload complete. (349ms)"3945lb # [ 42.728781] niks3-server[1042]: 2026/09/20 09:05:39 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3946worker1 # [ 42.741299] nix-grpc-daemon[774]: ts=2026-09-20T09:05:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13947worker2 # [ 42.841861] nix-grpc-daemon[772]: ts=2026-09-20T09:05:39Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03948worker1 # [ 42.760805] nix-daemon[832]: reaped child process 866, status = succeeded3949worker2 # [ 42.848104] nix-grpc-daemon[772]: ts=2026-09-20T09:05:39Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13950worker1 # [ 42.803727] nix-grpc-daemon[774]: ts=2026-09-20T09:05:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582303951worker1 # [ 42.819417] nix-grpc-daemon[774]: ts=2026-09-20T09:05:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582303952worker1 # [ 42.834038] nix-grpc-daemon[843]: time=2026-09-20T09:05:39.453Z level=INFO msg="All 1 paths already cached"3953client # copying 1 paths to 'lb:50051'...3954worker1 # [ 42.844090] nix-grpc-daemon[774]: ts=2026-09-20T09:05:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582303955client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3956worker1 # [ 42.871295] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3957worker1 # [ 43.101333] nix-daemon[832]: accepted connection from pid 890, user nix-grpc-daemon (trusted)3958worker1 # [ 43.125829] nix-daemon[832]: reaped child process 893, status = succeeded3959worker1 # [ 43.296794] nix-daemon[832]: accepted connection from pid 896, user nix-grpc-daemon (trusted)3960worker1 # [ 43.315827] nix-daemon[832]: reaped child process 899, status = succeeded3961lb # [ 43.325200] niks3-server[1042]: 2026/09/20 09:05:39 INFO Received uploads request method=POST path=/api/pending_closures3962worker1 # [ 43.336064] nix-grpc-daemon[843]: time=2026-09-20T09:05:39.955Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3963worker1 # [ 43.337940] nix-grpc-daemon[843]: time=2026-09-20T09:05:39.955Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3964lb # [ 43.354019] niks3-server[1042]: 2026/09/20 09:05:39 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3965lb # [ 43.363522] niks3-server[1042]: 2026/09/20 09:05:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3966worker1 # [ 43.368965] nix-grpc-daemon[843]: time=2026-09-20T09:05:39.987Z level=INFO msg="Uploading 1 narinfos"3967lb # [ 43.371588] niks3-server[1042]: 2026/09/20 09:05:40 INFO Signed narinfos id=3 count=13968lb # [ 43.377009] niks3-server[1042]: 2026/09/20 09:05:40 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3969lb # [ 43.388192] niks3-server[1042]: 2026/09/20 09:05:40 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3970worker1 # [ 43.393414] nix-grpc-daemon[843]: time=2026-09-20T09:05:40.012Z level=INFO msg="Upload complete. (504ms)"3971lb # [ 43.392910] niks3-server[1042]: 2026/09/20 09:05:40 INFO Completed upload id=33972lb # [ 43.396344] niks3-server[1042]: 2026/09/20 09:05:40 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3973worker1 # [ 43.400116] nix-grpc-daemon[774]: ts=2026-09-20T09:05:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 paths=1 nar_bytes_in=6243974worker1 # [ 43.411887] nix-grpc-daemon[774]: ts=2026-09-20T09:05:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582303975worker1 # [ 43.418272] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3976worker1 # [ 43.423650] nix-daemon[832]: reaped child process 888, status = succeeded3977client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3978worker1 # [ 43.435382] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3979client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3980worker1 # [ 44.053561] nix-daemon[832]: reaped child process 903, status = succeeded3981client # farm-b> LOG-farm-b-t13982worker1 # [ 44.210968] nix-daemon[832]: accepted connection from pid 918, user nix-grpc-daemon (trusted)3983worker1 # [ 44.228413] nix-daemon[832]: reaped child process 921, status = succeeded3984lb # [ 44.239070] niks3-server[1042]: 2026/09/20 09:05:40 INFO Received uploads request method=POST path=/api/pending_closures3985worker1 # [ 44.251254] nix-grpc-daemon[843]: time=2026-09-20T09:05:40.869Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3986worker1 # [ 44.252826] nix-grpc-daemon[843]: time=2026-09-20T09:05:40.869Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3987lb # [ 44.267716] niks3-server[1042]: 2026/09/20 09:05:40 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3988lb # [ 44.285513] niks3-server[1042]: 2026/09/20 09:05:40 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3989worker1 # [ 44.299956] nix-grpc-daemon[843]: time=2026-09-20T09:05:40.918Z level=INFO msg="Uploading 1 narinfos"3990lb # [ 44.299588] niks3-server[1042]: 2026/09/20 09:05:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3991lb # [ 44.309219] niks3-server[1042]: 2026/09/20 09:05:40 INFO Signed narinfos id=4 count=13992lb # [ 44.311747] niks3-server[1042]: 2026/09/20 09:05:40 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3993lb # [ 44.321043] niks3-server[1042]: 2026/09/20 09:05:40 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3994lb # [ 44.326949] niks3-server[1042]: 2026/09/20 09:05:40 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3995lb # [ 44.330763] niks3-server[1042]: 2026/09/20 09:05:40 INFO Completed upload id=43996worker1 # [ 44.332654] nix-grpc-daemon[843]: time=2026-09-20T09:05:40.951Z level=INFO msg="Upload complete. (289ms)"3997worker1 # [ 44.343454] nix-grpc-daemon[774]: ts=2026-09-20T09:05:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13998worker2 # [ 44.438702] nix-grpc-daemon[772]: ts=2026-09-20T09:05:41Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03999worker2 # [ 44.444695] nix-grpc-daemon[772]: ts=2026-09-20T09:05:41Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=14000worker1 # [ 44.361901] nix-daemon[832]: reaped child process 901, status = succeeded4001worker1 # [ 44.399964] nix-grpc-daemon[774]: ts=2026-09-20T09:05:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304002worker1 # [ 44.415180] nix-grpc-daemon[774]: ts=2026-09-20T09:05:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304003worker1 # [ 44.430722] nix-grpc-daemon[843]: time=2026-09-20T09:05:41.049Z level=INFO msg="All 2 paths already cached"4004client # copying 1 paths to 'lb:50051'...4005worker1 # [ 44.440341] nix-grpc-daemon[774]: ts=2026-09-20T09:05:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582304006client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4007worker1 # [ 44.463299] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4008worker1 # [ 44.661054] nix-daemon[832]: accepted connection from pid 925, user nix-grpc-daemon (trusted)4009worker1 # [ 44.679548] nix-daemon[832]: reaped child process 928, status = succeeded4010worker1 # [ 44.851644] nix-daemon[832]: accepted connection from pid 930, user nix-grpc-daemon (trusted)4011worker1 # [ 44.870666] nix-daemon[832]: reaped child process 933, status = succeeded4012lb # [ 44.880285] niks3-server[1042]: 2026/09/20 09:05:41 INFO Received uploads request method=POST path=/api/pending_closures4013worker1 # [ 44.894490] nix-grpc-daemon[843]: time=2026-09-20T09:05:41.513Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4014worker1 # [ 44.895970] nix-grpc-daemon[843]: time=2026-09-20T09:05:41.513Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4015lb # [ 44.912285] niks3-server[1042]: 2026/09/20 09:05:41 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4016worker1 # [ 44.927588] nix-grpc-daemon[843]: time=2026-09-20T09:05:41.546Z level=INFO msg="Uploading 1 narinfos"4017lb # [ 44.929773] niks3-server[1042]: 2026/09/20 09:05:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4018lb # [ 44.940396] niks3-server[1042]: 2026/09/20 09:05:41 INFO Signed narinfos id=5 count=14019lb # [ 44.945667] niks3-server[1042]: 2026/09/20 09:05:41 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4020lb # [ 44.953892] niks3-server[1042]: 2026/09/20 09:05:41 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4021worker1 # [ 44.961462] nix-grpc-daemon[843]: time=2026-09-20T09:05:41.580Z level=INFO msg="Upload complete. (481ms)"4022lb # [ 44.960173] niks3-server[1042]: 2026/09/20 09:05:41 INFO Completed upload id=54023lb # [ 44.963917] niks3-server[1042]: 2026/09/20 09:05:41 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4024worker1 # [ 44.968202] nix-grpc-daemon[774]: ts=2026-09-20T09:05:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 paths=1 nar_bytes_in=7524025worker1 # [ 44.976719] nix-grpc-daemon[774]: ts=2026-09-20T09:05:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304026worker1 # [ 44.986641] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4027worker1 # [ 44.991135] nix-daemon[832]: reaped child process 923, status = succeeded4028client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4029client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4030worker1 # [ 45.004243] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4031client # farm-top> LOG-farm-top-t14032worker1 # [ 46.250686] nix-daemon[832]: reaped child process 937, status = succeeded4033worker1 # [ 46.448797] nix-daemon[832]: accepted connection from pid 952, user nix-grpc-daemon (trusted)4034worker1 # [ 46.474536] nix-daemon[832]: reaped child process 955, status = succeeded4035lb # [ 46.489839] niks3-server[1042]: 2026/09/20 09:05:43 INFO Received uploads request method=POST path=/api/pending_closures4036worker1 # [ 46.503904] nix-grpc-daemon[843]: time=2026-09-20T09:05:43.120Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4037worker1 # [ 46.505991] nix-grpc-daemon[843]: time=2026-09-20T09:05:43.120Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4038lb # [ 46.530586] niks3-server[1042]: 2026/09/20 09:05:43 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4039lb # [ 46.543642] niks3-server[1042]: 2026/09/20 09:05:43 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4040worker1 # [ 46.569534] nix-grpc-daemon[843]: time=2026-09-20T09:05:43.188Z level=INFO msg="Uploading 1 narinfos"4041lb # [ 46.558186] niks3-server[1042]: 2026/09/20 09:05:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4042lb # [ 46.574217] niks3-server[1042]: 2026/09/20 09:05:43 INFO Signed narinfos id=6 count=14043lb # [ 46.580551] niks3-server[1042]: 2026/09/20 09:05:43 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4044lb # [ 46.590092] niks3-server[1042]: 2026/09/20 09:05:43 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4045lb # [ 46.598725] niks3-server[1042]: 2026/09/20 09:05:43 INFO Completed upload id=64046worker1 # [ 46.598904] nix-grpc-daemon[843]: time=2026-09-20T09:05:43.217Z level=INFO msg="Upload complete. (384ms)"4047lb # [ 46.606066] niks3-server[1042]: 2026/09/20 09:05:43 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4048worker1 # [ 46.609480] nix-grpc-daemon[774]: ts=2026-09-20T09:05:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14049worker1 # [ 46.629905] nix-daemon[832]: reaped child process 935, status = succeeded4050client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.21 seconds)4051client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4052client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds)4053client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4054client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4055client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4056client # copying 3 paths...4057client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4058client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4059client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4060client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4061(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.87 seconds)4062subtest: repeat is answered Cached by the scheduler without building4063worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4064worker1 # finding garbage collector roots...4065worker1 # deleting specified paths...4066worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4067worker1 # deleting unused links...4068worker1 # note: hard linking is currently saving 0.0 KiB4069worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.27 seconds)4070worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4071worker2 # finding garbage collector roots...4072worker2 # deleting specified paths...4073worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4074worker2 # deleting unused links...4075worker2 # note: hard linking is currently saving 0.0 KiB4076worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4077client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24078worker2 # [ 48.222680] nix-grpc-daemon[772]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:352424079client # don't know how to build these paths:4080client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4081worker1 # [ 48.145637] nix-grpc-daemon[774]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304082worker1 # [ 48.158527] nix-grpc-daemon[843]: time=2026-09-20T09:05:44.776Z level=INFO msg="All 2 paths already cached"4083worker2 # [ 48.265866] nix-grpc-daemon[772]: ts=2026-09-20T09:05:44Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14084client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.33 seconds)4085client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4086client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds)4087lb: must succeed: curl -sf localhost:9901/clusters4088lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4089lb: must succeed: curl -sf localhost:9901/clusters4090lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4091worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4092worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.10 seconds)4093(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.49 seconds)4094subtest: inputs already in the cache are not sent to the scheduler4095lb: must succeed: curl -sf localhost:9901/clusters4096lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4097lb: must succeed: curl -sf localhost:9901/clusters4098lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4099worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4100worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4101client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24102client # don't know how to build these paths:4103client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4104worker2 # [ 49.431848] nix-grpc-daemon[772]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:352424105worker1 # [ 49.349943] nix-grpc-daemon[774]: ts=2026-09-20T09:05:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304106worker1 # [ 49.368353] nix-grpc-daemon[843]: time=2026-09-20T09:05:45.986Z level=INFO msg="All 2 paths already cached"4107worker2 # [ 49.480200] nix-grpc-daemon[772]: ts=2026-09-20T09:05:46Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04108worker2 # [ 49.487789] nix-grpc-daemon[772]: ts=2026-09-20T09:05:46Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14109worker1 # [ 49.440800] nix-grpc-daemon[774]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304110worker1 # [ 49.465728] nix-grpc-daemon[774]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304111worker1 # [ 49.483050] nix-grpc-daemon[843]: time=2026-09-20T09:05:46.102Z level=INFO msg="All 2 paths already cached"4112client # copying 1 paths to 'lb:50051'...4113worker1 # [ 49.494799] nix-grpc-daemon[774]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582304114client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4115worker1 # [ 49.518511] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4116worker1 # [ 49.748639] nix-daemon[832]: accepted connection from pid 973, user nix-grpc-daemon (trusted)4117worker1 # [ 49.770987] nix-daemon[832]: reaped child process 976, status = succeeded4118worker1 # [ 49.969747] nix-daemon[832]: accepted connection from pid 978, user nix-grpc-daemon (trusted)4119worker1 # [ 49.992630] nix-daemon[832]: reaped child process 981, status = succeeded4120lb # [ 50.005215] niks3-server[1042]: 2026/09/20 09:05:46 INFO Received uploads request method=POST path=/api/pending_closures4121worker1 # [ 50.025718] nix-grpc-daemon[843]: time=2026-09-20T09:05:46.644Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4122worker1 # [ 50.027230] nix-grpc-daemon[843]: time=2026-09-20T09:05:46.644Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4123lb # [ 50.057303] niks3-server[1042]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4124worker1 # [ 50.074128] nix-grpc-daemon[843]: time=2026-09-20T09:05:46.692Z level=INFO msg="Uploading 1 narinfos"4125lb # [ 50.073527] niks3-server[1042]: 2026/09/20 09:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4126lb # [ 50.082227] niks3-server[1042]: 2026/09/20 09:05:46 INFO Signed narinfos id=7 count=14127lb # [ 50.088399] niks3-server[1042]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4128lb # [ 50.100686] niks3-server[1042]: 2026/09/20 09:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4129lb # [ 50.106536] niks3-server[1042]: 2026/09/20 09:05:46 INFO Completed upload id=74130worker1 # [ 50.108685] nix-grpc-daemon[843]: time=2026-09-20T09:05:46.727Z level=INFO msg="Upload complete. (569ms)"4131lb # [ 50.108757] niks3-server[1042]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4132worker1 # [ 50.121012] nix-grpc-daemon[774]: ts=2026-09-20T09:05:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 paths=1 nar_bytes_in=7524133worker1 # [ 50.137528] nix-grpc-daemon[774]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304134worker1 # [ 50.155951] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4135worker1 # [ 50.162493] nix-daemon[832]: reaped child process 971, status = succeeded4136worker1 # [ 50.175378] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4137client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4138client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4139worker1 # [ 51.005180] nix-daemon[832]: reaped child process 985, status = succeeded4140client # farm-top> LOG-farm-top-t1b4141lb # [ 51.035446] envoy[923]: conn peer=[2001:db8:1::1]:60000 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9484 tx=3831 ms=69604142lb # [ 51.040912] envoy[923]: conn peer=[2001:db8:1::1]:57882 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=481 ms=654143worker1 # [ 51.186632] nix-daemon[832]: accepted connection from pid 1000, user nix-grpc-daemon (trusted)4144worker1 # [ 51.212417] nix-daemon[832]: reaped child process 1003, status = succeeded4145lb # [ 51.227218] niks3-server[1042]: 2026/09/20 09:05:47 INFO Received uploads request method=POST path=/api/pending_closures4146worker1 # [ 51.251740] nix-grpc-daemon[843]: time=2026-09-20T09:05:47.867Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4147worker1 # [ 51.253405] nix-grpc-daemon[843]: time=2026-09-20T09:05:47.867Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4148lb # [ 51.298657] niks3-server[1042]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4149lb # [ 51.312731] niks3-server[1042]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4150lb # [ 51.322767] niks3-server[1042]: 2026/09/20 09:05:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4151lb # [ 51.327172] niks3-server[1042]: 2026/09/20 09:05:47 INFO Signed narinfos id=8 count=14152worker1 # [ 51.329050] nix-grpc-daemon[843]: time=2026-09-20T09:05:47.946Z level=INFO msg="Uploading 1 narinfos"4153lb # [ 51.332304] niks3-server[1042]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4154lb # [ 51.341391] niks3-server[1042]: 2026/09/20 09:05:47 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4155lb # [ 51.348594] niks3-server[1042]: 2026/09/20 09:05:47 INFO Completed upload id=84156worker1 # [ 51.350878] nix-grpc-daemon[843]: time=2026-09-20T09:05:47.969Z level=INFO msg="Upload complete. (358ms)"4157lb # [ 51.350906] niks3-server[1042]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4158worker1 # [ 51.365404] nix-grpc-daemon[774]: ts=2026-09-20T09:05:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14159worker1 # [ 51.385599] nix-daemon[832]: reaped child process 983, status = succeeded4160client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.39 seconds)4161client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4162client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.28 seconds)4163lb: must succeed: curl -sf localhost:9901/clusters4164lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4165lb: must succeed: curl -sf localhost:9901/clusters4166lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4167worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4168worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4169(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.09 seconds)4170subtest: two clients wanting the same drv build it once4171client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4172client # [ 51.997954] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4173client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4174client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4175worker1 # [ 52.243827] nix-grpc-daemon[774]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582304176client # Running as unit: dedup1.service; invocation ID: cb4ad841dcc84471b5fd8ffd531225d54177client # [ 52.259589] nix[887]: don't know how to build these paths:4178client # [ 52.262369] nix[887]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4179worker2 # [ 52.357644] nix-grpc-daemon[772]: ts=2026-09-20T09:05:48Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04180worker2 # [ 52.358088] nix-grpc-daemon[772]: ts=2026-09-20T09:05:48Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14181worker2 # [ 52.371054] nix-grpc-daemon[772]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352424182worker2 # [ 52.395725] nix-grpc-daemon[772]: ts=2026-09-20T09:05:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352424183client # [ 52.329339] nix[887]: copying 1 paths to 'lb:50051'...4184worker2 # [ 52.410746] nix-grpc-daemon[772]: ts=2026-09-20T09:05:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:352424185client # [ 52.331433] nix[887]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4186worker2 # [ 52.429836] nix-daemon[835]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4187worker2 # [ 52.459755] nix-grpc-daemon[772]: ts=2026-09-20T09:05:49Z level=info event=niks3_push_started pid=8884188worker2 # [ 52.919333] nix-daemon[835]: accepted connection from pid 901, user nix-grpc-daemon (trusted)4189worker2 # [ 52.939410] nix-daemon[835]: reaped child process 904, status = succeeded4190worker2 # [ 53.114628] nix-daemon[835]: accepted connection from pid 906, user nix-grpc-daemon (trusted)4191worker2 # [ 53.131581] nix-daemon[835]: reaped child process 909, status = succeeded4192lb # [ 53.052865] niks3-server[1042]: 2026/09/20 09:05:49 INFO Received uploads request method=POST path=/api/pending_closures4193worker2 # [ 53.161127] nix-grpc-daemon[888]: time=2026-09-20T09:05:49.787Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4194worker2 # [ 53.162612] nix-grpc-daemon[888]: time=2026-09-20T09:05:49.787Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4195lb # [ 53.094799] niks3-server[1042]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4196worker2 # [ 53.207653] nix-grpc-daemon[888]: time=2026-09-20T09:05:49.835Z level=INFO msg="Uploading 1 narinfos"4197client # [ 53.115601] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4198lb # [ 53.109651] niks3-server[1042]: 2026/09/20 09:05:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4199lb # [ 53.121190] niks3-server[1042]: 2026/09/20 09:05:49 INFO Signed narinfos id=9 count=14200client # Running as unit: dedup2.service; invocation ID: 4421f475313a42418b0d65c8cb0847c24201lb # [ 53.127576] niks3-server[1042]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4202client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4203lb # [ 53.141637] niks3-server[1042]: 2026/09/20 09:05:49 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4204lb # [ 53.147087] niks3-server[1042]: 2026/09/20 09:05:49 INFO Completed upload id=94205worker2 # [ 53.239388] nix-grpc-daemon[888]: time=2026-09-20T09:05:49.867Z level=INFO msg="Upload complete. (505ms)"4206lb # [ 53.149804] niks3-server[1042]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4207worker2 # [ 53.248304] nix-grpc-daemon[772]: ts=2026-09-20T09:05:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35242 duration_s=0 paths=1 nar_bytes_in=4324208worker2 # [ 53.263697] nix-grpc-daemon[772]: ts=2026-09-20T09:05:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352424209worker2 # [ 53.270547] nix-daemon[835]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4210worker2 # [ 53.275759] nix-daemon[835]: reaped child process 886, status = succeeded4211client # [ 53.203495] nix[887]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4212worker2 # [ 53.289340] nix-daemon[835]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4213client # [ 53.429373] nix[903]: don't know how to build these paths:4214client # [ 53.430556] nix[903]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4215worker1 # [ 53.420719] nix-grpc-daemon[774]: ts=2026-09-20T09:05:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582304216worker2 # [ 53.525172] nix-grpc-daemon[772]: ts=2026-09-20T09:05:50Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04217client # [ 53.451334] nix[903]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4218worker2 # [ 53.533020] nix-grpc-daemon[772]: ts=2026-09-20T09:05:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352424219client: must succeed: sleep 24220client: (finished: must succeed: sleep 2, in 2.06 seconds)4221client: waiting for success: ! systemctl is-active dedup1 dedup24222worker2 # [ 56.934109] nix-daemon[835]: reaped child process 913, status = succeeded4223worker2 # [ 57.118201] nix-daemon[835]: accepted connection from pid 944, user nix-grpc-daemon (trusted)4224worker2 # [ 57.134597] nix-daemon[835]: reaped child process 947, status = succeeded4225lb # [ 57.055623] niks3-server[1042]: 2026/09/20 09:05:53 INFO Received uploads request method=POST path=/api/pending_closures4226worker2 # [ 57.160596] nix-grpc-daemon[888]: time=2026-09-20T09:05:53.787Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4227worker2 # [ 57.162373] nix-grpc-daemon[888]: time=2026-09-20T09:05:53.787Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4228lb # [ 57.105058] niks3-server[1042]: 2026/09/20 09:05:53 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4229worker2 # [ 57.209804] nix-grpc-daemon[888]: time=2026-09-20T09:05:53.837Z level=INFO msg="Uploading 1 narinfos"4230lb # [ 57.117176] niks3-server[1042]: 2026/09/20 09:05:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4231lb # [ 57.121866] niks3-server[1042]: 2026/09/20 09:05:53 INFO Signed narinfos id=10 count=14232lb # [ 57.126913] niks3-server[1042]: 2026/09/20 09:05:53 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4233lb # [ 57.137007] niks3-server[1042]: 2026/09/20 09:05:53 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4234lb # [ 57.146838] niks3-server[1042]: 2026/09/20 09:05:53 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4235lb # [ 57.154687] niks3-server[1042]: 2026/09/20 09:05:53 INFO Completed upload id=104236worker2 # [ 57.246878] nix-grpc-daemon[888]: time=2026-09-20T09:05:53.875Z level=INFO msg="Upload complete. (344ms)"4237lb # [ 57.157893] niks3-server[1042]: 2026/09/20 09:05:53 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4238worker2 # [ 57.259502] nix-grpc-daemon[772]: ts=2026-09-20T09:05:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35242 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14239worker2 # [ 57.275565] nix-grpc-daemon[772]: ts=2026-09-20T09:05:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35242 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14240worker2 # [ 57.282864] nix-daemon[835]: reaped child process 911, status = succeeded4241client # [ 57.234358] systemd[1]: dedup2.service: Deactivated successfully.4242client # [ 57.239770] systemd[1]: dedup2.service: Consumed 178ms CPU time over 4.122s wall clock time, 30.9M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic.4243client # [ 57.249762] systemd[1]: dedup1.service: Deactivated successfully.4244client # [ 57.255588] systemd[1]: dedup1.service: Consumed 164ms CPU time over 5.255s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.4245client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4246client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4247client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4248worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4249worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4250worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4251worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4252worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4253worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.10 seconds)4254worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4255worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds)4256(finished: subtest: two clients wanting the same drv build it once, in 6.30 seconds)4257subtest: build hook: nix-daemon with builders = grpc://lb4258client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4259client # [ 58.449002] systemd[1]: Started Nix Daemon.4260client # [ 58.633885] nix-daemon[945]: accepted connection from pid 942, user root (trusted)4261worker2 # [ 58.918343] nix-grpc-daemon[772]: ts=2026-09-20T09:05:55Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:352424262worker1 # [ 58.833868] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304263worker2 # [ 58.942378] nix-grpc-daemon[772]: ts=2026-09-20T09:05:55Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04264worker2 # [ 58.948528] nix-grpc-daemon[772]: ts=2026-09-20T09:05:55Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14265worker1 # [ 58.898537] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304266worker1 # [ 58.914705] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304267worker1 # [ 58.929551] nix-grpc-daemon[774]: ts=2026-09-20T09:05:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582304268worker1 # [ 58.947918] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4269worker1 # [ 59.159200] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4270worker1 # [ 59.178005] nix-daemon[832]: reaped child process 1033, status = succeeded4271worker1 # [ 59.349150] nix-daemon[832]: accepted connection from pid 1035, user nix-grpc-daemon (trusted)4272worker1 # [ 59.366026] nix-daemon[832]: reaped child process 1038, status = succeeded4273lb # [ 59.376708] niks3-server[1042]: 2026/09/20 09:05:56 INFO Received uploads request method=POST path=/api/pending_closures4274worker1 # [ 59.389358] nix-grpc-daemon[843]: time=2026-09-20T09:05:56.007Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4275worker1 # [ 59.390875] nix-grpc-daemon[843]: time=2026-09-20T09:05:56.007Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4276lb # [ 59.410737] niks3-server[1042]: 2026/09/20 09:05:56 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4277lb # [ 59.424402] niks3-server[1042]: 2026/09/20 09:05:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4278worker1 # [ 59.431855] nix-grpc-daemon[843]: time=2026-09-20T09:05:56.050Z level=INFO msg="Uploading 1 narinfos"4279lb # [ 59.435547] niks3-server[1042]: 2026/09/20 09:05:56 INFO Signed narinfos id=11 count=14280lb # [ 59.441564] niks3-server[1042]: 2026/09/20 09:05:56 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4281worker1 # [ 59.453030] nix-grpc-daemon[843]: time=2026-09-20T09:05:56.072Z level=INFO msg="Upload complete. (487ms)"4282lb # [ 59.451452] niks3-server[1042]: 2026/09/20 09:05:56 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4283worker1 # [ 59.460141] nix-grpc-daemon[774]: ts=2026-09-20T09:05:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 paths=1 nar_bytes_in=5124284lb # [ 59.458282] niks3-server[1042]: 2026/09/20 09:05:56 INFO Completed upload id=114285lb # [ 59.462941] niks3-server[1042]: 2026/09/20 09:05:56 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4286worker1 # [ 59.472245] nix-grpc-daemon[774]: ts=2026-09-20T09:05:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304287worker1 # [ 59.478439] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4288worker1 # [ 59.483149] nix-daemon[832]: reaped child process 1028, status = succeeded4289worker1 # [ 59.493643] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4290worker1 # [ 60.536785] nix-daemon[832]: reaped child process 1042, status = succeeded4291worker1 # [ 60.718567] nix-daemon[832]: accepted connection from pid 1057, user nix-grpc-daemon (trusted)4292worker1 # [ 60.735438] nix-daemon[832]: reaped child process 1060, status = succeeded4293lb # [ 60.747108] niks3-server[1042]: 2026/09/20 09:05:57 INFO Received uploads request method=POST path=/api/pending_closures4294worker1 # [ 60.760411] nix-grpc-daemon[843]: time=2026-09-20T09:05:57.377Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4295worker1 # [ 60.761920] nix-grpc-daemon[843]: time=2026-09-20T09:05:57.377Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4296lb # [ 60.778732] niks3-server[1042]: 2026/09/20 09:05:57 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4297worker1 # [ 60.800841] nix-grpc-daemon[843]: time=2026-09-20T09:05:57.419Z level=INFO msg="Uploading 1 narinfos"4298lb # [ 60.798382] niks3-server[1042]: 2026/09/20 09:05:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4299lb # [ 60.811896] niks3-server[1042]: 2026/09/20 09:05:57 INFO Signed narinfos id=12 count=14300lb # [ 60.818241] niks3-server[1042]: 2026/09/20 09:05:57 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4301lb # [ 60.823751] niks3-server[1042]: 2026/09/20 09:05:57 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4302worker1 # [ 60.834630] nix-grpc-daemon[843]: time=2026-09-20T09:05:57.453Z level=INFO msg="Upload complete. (328ms)"4303lb # [ 60.832002] niks3-server[1042]: 2026/09/20 09:05:57 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4304lb # [ 60.839144] niks3-server[1042]: 2026/09/20 09:05:57 INFO Completed upload id=124305lb # [ 60.842368] niks3-server[1042]: 2026/09/20 09:05:57 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4306worker1 # [ 60.845080] nix-grpc-daemon[774]: ts=2026-09-20T09:05:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14307worker2 # [ 60.944766] nix-grpc-daemon[772]: ts=2026-09-20T09:05:57Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:352424308worker1 # [ 60.861639] nix-daemon[832]: reaped child process 1040, status = succeeded4309worker2 # [ 60.960814] nix-grpc-daemon[772]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4310worker1 # [ 60.922992] nix-grpc-daemon[774]: ts=2026-09-20T09:05:57Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582304311worker1 # [ 60.929719] nix-grpc-daemon[774]: ts=2026-09-20T09:05:57Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 paths=1 nar_bytes_out=1284312lb # [ 61.030623] envoy[923]: conn peer=[2001:db8:1::1]:57890 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4185 tx=1728 ms=20524313lb # [ 61.035723] envoy[923]: conn peer=[2001:db8:1::1]:39158 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=37734314lb # [ 61.040663] envoy[923]: conn peer=[2001:db8:1::1]:39142 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1374 ms=49454315lb # [ 61.045629] envoy[923]: conn peer=[2001:db8:1::1]:47202 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=384316lb # [ 61.050342] envoy[923]: conn peer=[2001:db8:1::1]:39164 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3407 tx=1750 ms=21304317worker1 # [ 61.198058] nix-grpc-daemon[774]: ts=2026-09-20T09:05:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582304318worker1 # [ 61.205581] nix-grpc-daemon[774]: ts=2026-09-20T09:05:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304319worker1 # [ 61.212141] nix-grpc-daemon[843]: time=2026-09-20T09:05:57.830Z level=INFO msg="All 1 paths already cached"4320worker2 # [ 61.314586] nix-grpc-daemon[772]: ts=2026-09-20T09:05:57Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04321worker1 # [ 61.227511] nix-grpc-daemon[774]: ts=2026-09-20T09:05:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304322worker2 # [ 61.320695] nix-grpc-daemon[772]: ts=2026-09-20T09:05:57Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14323worker1 # [ 61.242517] nix-grpc-daemon[774]: ts=2026-09-20T09:05:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304324worker1 # [ 61.256534] nix-grpc-daemon[843]: time=2026-09-20T09:05:57.875Z level=INFO msg="All 1 paths already cached"4325worker1 # [ 61.265074] nix-grpc-daemon[774]: ts=2026-09-20T09:05:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582304326worker1 # [ 61.278927] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4327worker1 # [ 61.488375] nix-daemon[832]: accepted connection from pid 1064, user nix-grpc-daemon (trusted)4328worker1 # [ 61.508181] nix-daemon[832]: reaped child process 1067, status = succeeded4329worker1 # [ 61.678763] nix-daemon[832]: accepted connection from pid 1069, user nix-grpc-daemon (trusted)4330worker1 # [ 61.695941] nix-daemon[832]: reaped child process 1072, status = succeeded4331lb # [ 61.707936] niks3-server[1042]: 2026/09/20 09:05:58 INFO Received uploads request method=POST path=/api/pending_closures4332worker1 # [ 61.719335] nix-grpc-daemon[843]: time=2026-09-20T09:05:58.338Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4333worker1 # [ 61.720940] nix-grpc-daemon[843]: time=2026-09-20T09:05:58.338Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4334lb # [ 61.734768] niks3-server[1042]: 2026/09/20 09:05:58 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4335lb # [ 61.750075] niks3-server[1042]: 2026/09/20 09:05:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4336worker1 # [ 61.758438] nix-grpc-daemon[843]: time=2026-09-20T09:05:58.377Z level=INFO msg="Uploading 1 narinfos"4337lb # [ 61.760792] niks3-server[1042]: 2026/09/20 09:05:58 INFO Signed narinfos id=13 count=14338lb # [ 61.763693] niks3-server[1042]: 2026/09/20 09:05:58 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4339lb # [ 61.773783] niks3-server[1042]: 2026/09/20 09:05:58 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4340lb # [ 61.779684] niks3-server[1042]: 2026/09/20 09:05:58 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4341lb # [ 61.783464] niks3-server[1042]: 2026/09/20 09:05:58 INFO Completed upload id=134342worker1 # [ 61.785917] nix-grpc-daemon[843]: time=2026-09-20T09:05:58.404Z level=INFO msg="Upload complete. (489ms)"4343worker1 # [ 61.792213] nix-grpc-daemon[774]: ts=2026-09-20T09:05:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 paths=1 nar_bytes_in=6244344worker1 # [ 61.804460] nix-grpc-daemon[774]: ts=2026-09-20T09:05:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304345worker1 # [ 61.808450] nix-daemon[832]: reaped child process 1062, status = succeeded4346worker1 # [ 61.815021] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4347worker1 # [ 61.826114] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4348worker1 # [ 63.267601] nix-daemon[832]: reaped child process 1076, status = succeeded4349worker1 # [ 63.462890] nix-daemon[832]: accepted connection from pid 1091, user nix-grpc-daemon (trusted)4350worker1 # [ 63.481046] nix-daemon[832]: reaped child process 1094, status = succeeded4351lb # [ 63.491689] niks3-server[1042]: 2026/09/20 09:06:00 INFO Received uploads request method=POST path=/api/pending_closures4352worker1 # [ 63.504491] nix-grpc-daemon[843]: time=2026-09-20T09:06:00.121Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4353worker1 # [ 63.506274] nix-grpc-daemon[843]: time=2026-09-20T09:06:00.121Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4354lb # [ 63.528435] niks3-server[1042]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4355lb # [ 63.544171] niks3-server[1042]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4356lb # [ 63.552966] niks3-server[1042]: 2026/09/20 09:06:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4357worker1 # [ 63.560485] nix-grpc-daemon[843]: time=2026-09-20T09:06:00.179Z level=INFO msg="Uploading 1 narinfos"4358lb # [ 63.564956] niks3-server[1042]: 2026/09/20 09:06:00 INFO Signed narinfos id=14 count=14359lb # [ 63.567499] niks3-server[1042]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4360lb # [ 63.576434] niks3-server[1042]: 2026/09/20 09:06:00 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4361lb # [ 63.582699] niks3-server[1042]: 2026/09/20 09:06:00 INFO Completed upload id=144362lb # [ 63.585617] niks3-server[1042]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4363worker1 # [ 63.584550] nix-grpc-daemon[843]: time=2026-09-20T09:06:00.203Z level=INFO msg="Upload complete. (339ms)"4364worker1 # [ 63.598820] nix-grpc-daemon[774]: ts=2026-09-20T09:06:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14365worker1 # [ 63.616551] nix-grpc-daemon[774]: ts=2026-09-20T09:06:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582304366worker1 # [ 63.623967] nix-grpc-daemon[774]: ts=2026-09-20T09:06:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582304367worker1 # [ 63.628530] nix-grpc-daemon[774]: ts=2026-09-20T09:06:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 paths=1 nar_bytes_out=1764368worker1 # [ 63.633633] nix-daemon[832]: reaped child process 1074, status = succeeded4369worker1 # [ 63.934697] nix-grpc-daemon[774]: ts=2026-09-20T09:06:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582304370worker1 # [ 63.942182] nix-grpc-daemon[774]: ts=2026-09-20T09:06:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304371worker1 # [ 63.948628] nix-grpc-daemon[843]: time=2026-09-20T09:06:00.566Z level=INFO msg="All 2 paths already cached"4372worker2 # [ 64.053254] nix-grpc-daemon[772]: ts=2026-09-20T09:06:00Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04373worker2 # [ 64.059243] nix-grpc-daemon[772]: ts=2026-09-20T09:06:00Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14374worker1 # [ 64.014482] nix-grpc-daemon[774]: ts=2026-09-20T09:06:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304375worker1 # [ 64.030394] nix-grpc-daemon[774]: ts=2026-09-20T09:06:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304376worker1 # [ 64.045172] nix-grpc-daemon[843]: time=2026-09-20T09:06:00.664Z level=INFO msg="All 2 paths already cached"4377worker1 # [ 64.054337] nix-grpc-daemon[774]: ts=2026-09-20T09:06:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582304378worker1 # [ 64.068655] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4379worker1 # [ 64.277293] nix-daemon[832]: accepted connection from pid 1098, user nix-grpc-daemon (trusted)4380worker1 # [ 64.297439] nix-daemon[832]: reaped child process 1101, status = succeeded4381worker1 # [ 64.475396] nix-daemon[832]: accepted connection from pid 1103, user nix-grpc-daemon (trusted)4382worker1 # [ 64.492925] nix-daemon[832]: reaped child process 1106, status = succeeded4383lb # [ 64.503203] niks3-server[1042]: 2026/09/20 09:06:01 INFO Received uploads request method=POST path=/api/pending_closures4384worker1 # [ 64.515011] nix-grpc-daemon[843]: time=2026-09-20T09:06:01.133Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4385worker1 # [ 64.516555] nix-grpc-daemon[843]: time=2026-09-20T09:06:01.133Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4386lb # [ 64.533347] niks3-server[1042]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4387worker1 # [ 64.544423] nix-grpc-daemon[843]: time=2026-09-20T09:06:01.163Z level=INFO msg="Uploading 1 narinfos"4388lb # [ 64.546647] niks3-server[1042]: 2026/09/20 09:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4389lb # [ 64.558137] niks3-server[1042]: 2026/09/20 09:06:01 INFO Signed narinfos id=15 count=14390worker1 # [ 64.566497] nix-grpc-daemon[843]: time=2026-09-20T09:06:01.185Z level=INFO msg="Upload complete. (479ms)"4391lb # [ 64.564991] niks3-server[1042]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4392lb # [ 64.572488] niks3-server[1042]: 2026/09/20 09:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4393worker1 # [ 64.576223] nix-grpc-daemon[774]: ts=2026-09-20T09:06:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 paths=1 nar_bytes_in=7524394lb # [ 64.577895] niks3-server[1042]: 2026/09/20 09:06:01 INFO Completed upload id=154395lb # [ 64.580860] niks3-server[1042]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4396worker1 # [ 64.584776] nix-grpc-daemon[774]: ts=2026-09-20T09:06:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304397worker1 # [ 64.591463] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4398worker1 # [ 64.595917] nix-daemon[832]: reaped child process 1096, status = succeeded4399worker1 # [ 64.606266] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4400worker1 # [ 65.234319] nix-daemon[832]: reaped child process 1110, status = succeeded4401worker1 # [ 65.400896] nix-daemon[832]: accepted connection from pid 1125, user nix-grpc-daemon (trusted)4402worker1 # [ 65.420142] nix-daemon[832]: reaped child process 1128, status = succeeded4403lb # [ 65.431451] niks3-server[1042]: 2026/09/20 09:06:02 INFO Received uploads request method=POST path=/api/pending_closures4404worker1 # [ 65.444089] nix-grpc-daemon[843]: time=2026-09-20T09:06:02.061Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4405worker1 # [ 65.445642] nix-grpc-daemon[843]: time=2026-09-20T09:06:02.061Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4406lb # [ 65.477212] niks3-server[1042]: 2026/09/20 09:06:02 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4407worker1 # [ 65.493370] nix-grpc-daemon[843]: time=2026-09-20T09:06:02.112Z level=INFO msg="Uploading 1 narinfos"4408lb # [ 65.491824] niks3-server[1042]: 2026/09/20 09:06:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4409lb # [ 65.505501] niks3-server[1042]: 2026/09/20 09:06:02 INFO Signed narinfos id=16 count=14410lb # [ 65.511040] niks3-server[1042]: 2026/09/20 09:06:02 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4411lb # [ 65.519857] niks3-server[1042]: 2026/09/20 09:06:02 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4412lb # [ 65.525031] niks3-server[1042]: 2026/09/20 09:06:02 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4413lb # [ 65.528470] niks3-server[1042]: 2026/09/20 09:06:02 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4414lb # [ 65.531041] niks3-server[1042]: 2026/09/20 09:06:02 INFO Completed upload id=164415worker1 # [ 65.531555] nix-grpc-daemon[843]: time=2026-09-20T09:06:02.149Z level=INFO msg="Upload complete. (314ms)"4416worker2 # [ 65.635608] nix-grpc-daemon[772]: ts=2026-09-20T09:06:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:352424417worker1 # [ 65.545143] nix-grpc-daemon[774]: ts=2026-09-20T09:06:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14418worker1 # [ 65.560579] nix-daemon[832]: reaped child process 1108, status = succeeded4419worker2 # [ 65.655845] nix-grpc-daemon[772]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4420worker2 # [ 65.673393] nix-grpc-daemon[772]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4421worker2 # [ 65.714614] nix-grpc-daemon[772]: ts=2026-09-20T09:06:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:352424422worker2 # [ 65.721666] nix-grpc-daemon[772]: ts=2026-09-20T09:06:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35242 duration_s=0 paths=1 nar_bytes_out=2324423client # [ 65.770188] nix-daemon[945]: reaped child process 947, status = succeeded4424client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.57 seconds)4425client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4426client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4427client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4428client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4429client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4430client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4431(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.70 seconds)4432subtest: an input only one worker has still reaches the builder4433client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4434client # this derivation will be built:4435client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4436client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4437client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds)4438client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4439client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds)4440worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4441worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.23 seconds)4442worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4443worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4444client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24445client # [ 67.042118] nix-daemon[945]: accepted connection from pid 1028, user root (trusted)4446client # this derivation will be built:4447client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4448worker1 # [ 67.231155] nix-grpc-daemon[774]: ts=2026-09-20T09:06:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582304449client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4450worker2 # [ 67.325913] nix-grpc-daemon[772]: ts=2026-09-20T09:06:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352424451client # copying 1 paths...4452client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4453worker1 # [ 67.252109] nix-grpc-daemon[774]: ts=2026-09-20T09:06:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582304454worker1 # [ 67.267297] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4455worker1 # [ 67.471603] nix-daemon[832]: accepted connection from pid 1137, user nix-grpc-daemon (trusted)4456worker1 # [ 67.488894] nix-daemon[832]: reaped child process 1140, status = succeeded4457lb # [ 67.501831] niks3-server[1042]: 2026/09/20 09:06:04 INFO Received uploads request method=POST path=/api/pending_closures4458worker1 # [ 67.513609] nix-grpc-daemon[843]: time=2026-09-20T09:06:04.132Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4459worker1 # [ 67.515053] nix-grpc-daemon[843]: time=2026-09-20T09:06:04.132Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4460lb # [ 67.531113] niks3-server[1042]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4461lb # [ 67.549707] niks3-server[1042]: 2026/09/20 09:06:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4462worker1 # [ 67.558066] nix-grpc-daemon[843]: time=2026-09-20T09:06:04.176Z level=INFO msg="Uploading 1 narinfos"4463lb # [ 67.562752] niks3-server[1042]: 2026/09/20 09:06:04 INFO Signed narinfos id=17 count=14464lb # [ 67.569203] niks3-server[1042]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4465lb # [ 67.575560] niks3-server[1042]: 2026/09/20 09:06:04 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4466lb # [ 67.582567] niks3-server[1042]: 2026/09/20 09:06:04 INFO Completed upload id=174467worker1 # [ 67.583931] nix-grpc-daemon[843]: time=2026-09-20T09:06:04.203Z level=INFO msg="Upload complete. (302ms)"4468lb # [ 67.585286] niks3-server[1042]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4469worker1 # [ 67.592296] nix-grpc-daemon[774]: ts=2026-09-20T09:06:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=0 paths=1 nar_bytes_in=1204470worker1 # [ 67.605991] nix-daemon[832]: reaped child process 1135, status = succeeded4471worker2 # [ 67.698892] nix-grpc-daemon[772]: ts=2026-09-20T09:06:04Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04472worker2 # [ 67.706584] nix-grpc-daemon[772]: ts=2026-09-20T09:06:04Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14473worker2 # [ 67.744083] nix-grpc-daemon[772]: ts=2026-09-20T09:06:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352424474worker2 # [ 67.759373] nix-grpc-daemon[772]: ts=2026-09-20T09:06:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352424475client # copying 2 paths to 'lb:50051'...4476client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4477worker2 # [ 67.777966] nix-grpc-daemon[772]: ts=2026-09-20T09:06:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:352424478client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4479worker2 # [ 67.794107] nix-daemon[835]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4480worker2 # [ 68.004542] nix-daemon[835]: accepted connection from pid 976, user nix-grpc-daemon (trusted)4481worker2 # [ 68.024191] nix-daemon[835]: reaped child process 979, status = succeeded4482worker2 # [ 68.200074] nix-daemon[835]: accepted connection from pid 981, user nix-grpc-daemon (trusted)4483worker2 # [ 68.218977] nix-daemon[835]: reaped child process 984, status = succeeded4484lb # [ 68.138428] niks3-server[1042]: 2026/09/20 09:06:04 INFO Received uploads request method=POST path=/api/pending_closures4485lb # [ 68.148235] niks3-server[1042]: 2026/09/20 09:06:04 INFO Received uploads request method=POST path=/api/pending_closures4486worker2 # [ 68.250623] nix-grpc-daemon[888]: time=2026-09-20T09:06:04.878Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4487worker2 # [ 68.252199] nix-grpc-daemon[888]: time=2026-09-20T09:06:04.878Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4488worker2 # [ 68.253904] nix-grpc-daemon[888]: time=2026-09-20T09:06:04.878Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4489lb # [ 68.197152] niks3-server[1042]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4490worker2 # [ 68.304239] nix-grpc-daemon[888]: time=2026-09-20T09:06:04.931Z level=INFO msg="Uploading 3 narinfos"4491lb # [ 68.213727] niks3-server[1042]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4492lb # [ 68.224255] niks3-server[1042]: 2026/09/20 09:06:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4493lb # [ 68.227978] niks3-server[1042]: 2026/09/20 09:06:04 INFO Signed narinfos id=19 count=24494lb # [ 68.240082] niks3-server[1042]: 2026/09/20 09:06:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4495lb # [ 68.243856] niks3-server[1042]: 2026/09/20 09:06:04 INFO Signed narinfos id=18 count=14496lb # [ 68.250263] niks3-server[1042]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4497lb # [ 68.257990] niks3-server[1042]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4498lb # [ 68.264713] niks3-server[1042]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4499lb # [ 68.271096] niks3-server[1042]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4500lb # [ 68.275493] niks3-server[1042]: 2026/09/20 09:06:04 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4501lb # [ 68.278952] niks3-server[1042]: 2026/09/20 09:06:04 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4502lb # [ 68.282856] niks3-server[1042]: 2026/09/20 09:06:04 INFO Completed upload id=184503lb # [ 68.285806] niks3-server[1042]: 2026/09/20 09:06:04 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4504lb # [ 68.289447] niks3-server[1042]: 2026/09/20 09:06:04 INFO Completed upload id=194505worker2 # [ 68.381756] nix-grpc-daemon[888]: time=2026-09-20T09:06:05.010Z level=INFO msg="Upload complete. (568ms)"4506worker2 # [ 68.396756] nix-grpc-daemon[772]: ts=2026-09-20T09:06:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35242 duration_s=0 paths=2 nar_bytes_in=9844507worker2 # [ 68.410050] nix-grpc-daemon[772]: ts=2026-09-20T09:06:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352424508worker2 # [ 68.423691] nix-daemon[835]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4509worker2 # [ 68.433381] nix-daemon[835]: reaped child process 974, status = succeeded4510worker2 # [ 68.443510] nix-grpc-daemon[772]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4511client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4512client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4513worker2 # [ 68.462562] nix-daemon[835]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4514worker2 # [ 69.521491] nix-daemon[835]: reaped child process 989, status = succeeded4515worker2 # [ 69.703086] nix-daemon[835]: accepted connection from pid 1004, user nix-grpc-daemon (trusted)4516worker2 # [ 69.721802] nix-daemon[835]: reaped child process 1007, status = succeeded4517lb # [ 69.643011] niks3-server[1042]: 2026/09/20 09:06:06 INFO Received uploads request method=POST path=/api/pending_closures4518worker2 # [ 69.745007] nix-grpc-daemon[888]: time=2026-09-20T09:06:06.372Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4519lb # [ 69.672400] niks3-server[1042]: 2026/09/20 09:06:06 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4520worker2 # [ 69.776787] nix-grpc-daemon[888]: time=2026-09-20T09:06:06.404Z level=INFO msg="Uploading 1 narinfos"4521lb # [ 69.684556] niks3-server[1042]: 2026/09/20 09:06:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4522lb # [ 69.693442] niks3-server[1042]: 2026/09/20 09:06:06 INFO Signed narinfos id=20 count=14523lb # [ 69.700335] niks3-server[1042]: 2026/09/20 09:06:06 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4524lb # [ 69.708186] niks3-server[1042]: 2026/09/20 09:06:06 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4525lb # [ 69.717652] niks3-server[1042]: 2026/09/20 09:06:06 INFO Completed upload id=204526worker2 # [ 69.808885] nix-grpc-daemon[888]: time=2026-09-20T09:06:06.437Z level=INFO msg="Upload complete. (325ms)"4527lb # [ 69.721085] niks3-server[1042]: 2026/09/20 09:06:06 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4528worker2 # [ 69.821300] nix-grpc-daemon[772]: ts=2026-09-20T09:06:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35242 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14529worker2 # [ 69.839498] nix-daemon[835]: reaped child process 986, status = succeeded4530client # copying 1 paths...4531worker2 # [ 69.867294] nix-grpc-daemon[772]: ts=2026-09-20T09:06:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:352424532client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4533worker2 # [ 69.896104] nix-grpc-daemon[772]: ts=2026-09-20T09:06:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:352424534worker2 # [ 69.901841] nix-grpc-daemon[772]: ts=2026-09-20T09:06:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35242 duration_s=0 paths=1 nar_bytes_out=1204535client # [ 69.942893] nix-daemon[945]: reaped child process 1031, status = succeeded4536client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.14 seconds)4537client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24538client # [ 70.169146] nix-daemon[945]: accepted connection from pid 1049, user root (trusted)4539client # this derivation will be built:4540client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4541client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4542worker1 # [ 70.359330] nix-grpc-daemon[774]: ts=2026-09-20T09:06:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582304543worker1 # [ 70.366252] nix-grpc-daemon[774]: ts=2026-09-20T09:06:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304544worker1 # [ 70.377151] nix-grpc-daemon[843]: time=2026-09-20T09:06:06.995Z level=INFO msg="All 1 paths already cached"4545worker2 # [ 70.484948] nix-grpc-daemon[772]: ts=2026-09-20T09:06:07Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04546worker1 # [ 70.397877] nix-grpc-daemon[774]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304547worker2 # [ 70.491724] nix-grpc-daemon[772]: ts=2026-09-20T09:06:07Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14548worker1 # [ 70.413204] nix-grpc-daemon[774]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304549client # copying 1 paths to 'lb:50051'...4550worker1 # [ 70.440938] nix-grpc-daemon[774]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582304551client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4552worker1 # [ 70.457777] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4553worker1 # [ 70.482455] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 1/5)4554worker1 # [ 70.585826] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 191 ms (attempt 2/5)4555worker1 # [ 70.777449] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 362 ms (attempt 3/5)4556lb # [ 71.034061] envoy[923]: conn peer=[2001:db8:1::1]:47216 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3901 tx=1874 ms=24844557lb # [ 71.039300] envoy[923]: conn peer=[2001:db8:1::1]:47230 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=644558lb # [ 71.044903] envoy[923]: conn peer=[2001:db8:1::1]:47238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4313 tx=2199 ms=17564559lb # [ 71.050303] envoy[923]: conn peer=[2001:db8:1::1]:47242 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=724560lb # [ 71.055539] envoy[923]: conn peer=[2001:db8:1::1]:47272 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=684561lb # [ 71.060979] envoy[923]: conn peer=[2001:db8:1::1]:47258 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4226 tx=1770 ms=26404562worker1 # [ 71.147188] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 349 ms (attempt 4/5)4563worker1 # [ 71.505771] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4564worker1 # [ 71.515140] nix-grpc-daemon[774]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4565worker1 # [ 71.746868] nix-daemon[832]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4566worker1 # [ 71.765348] nix-daemon[832]: reaped child process 1151, status = succeeded4567worker1 # [ 71.940919] nix-daemon[832]: accepted connection from pid 1153, user nix-grpc-daemon (trusted)4568worker1 # [ 71.957256] nix-daemon[832]: reaped child process 1156, status = succeeded4569lb # [ 71.971162] niks3-server[1042]: 2026/09/20 09:06:08 INFO Received uploads request method=POST path=/api/pending_closures4570worker1 # [ 71.984952] nix-grpc-daemon[843]: time=2026-09-20T09:06:08.603Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4571worker1 # [ 71.986462] nix-grpc-daemon[843]: time=2026-09-20T09:06:08.603Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4572lb # [ 72.008920] niks3-server[1042]: 2026/09/20 09:06:08 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4573worker1 # [ 72.025966] nix-grpc-daemon[843]: time=2026-09-20T09:06:08.644Z level=INFO msg="Uploading 1 narinfos"4574lb # [ 72.023635] niks3-server[1042]: 2026/09/20 09:06:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4575lb # [ 72.031051] niks3-server[1042]: 2026/09/20 09:06:08 INFO Signed narinfos id=21 count=14576lb # [ 72.038773] niks3-server[1042]: 2026/09/20 09:06:08 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4577lb # [ 72.048991] niks3-server[1042]: 2026/09/20 09:06:08 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4578worker1 # [ 72.057325] nix-grpc-daemon[843]: time=2026-09-20T09:06:08.676Z level=INFO msg="Upload complete. (515ms)"4579lb # [ 72.057855] niks3-server[1042]: 2026/09/20 09:06:08 INFO Completed upload id=214580lb # [ 72.062627] niks3-server[1042]: 2026/09/20 09:06:08 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4581worker1 # [ 72.068304] nix-grpc-daemon[774]: ts=2026-09-20T09:06:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=1 paths=1 nar_bytes_in=5684582worker1 # [ 72.076747] nix-grpc-daemon[774]: ts=2026-09-20T09:06:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582304583worker1 # [ 72.089666] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4584worker1 # [ 72.094667] nix-daemon[832]: reaped child process 1142, status = succeeded4585client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4586worker1 # [ 72.109527] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4587client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4588worker1 # [ 73.357131] nix-daemon[832]: reaped child process 1160, status = succeeded4589worker1 # [ 73.545404] nix-daemon[832]: accepted connection from pid 1175, user nix-grpc-daemon (trusted)4590worker1 # [ 73.563046] nix-daemon[832]: reaped child process 1178, status = succeeded4591lb # [ 73.573833] niks3-server[1042]: 2026/09/20 09:06:10 INFO Received uploads request method=POST path=/api/pending_closures4592worker1 # [ 73.586900] nix-grpc-daemon[843]: time=2026-09-20T09:06:10.204Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4593lb # [ 73.612900] niks3-server[1042]: 2026/09/20 09:06:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4594worker1 # [ 73.624349] nix-grpc-daemon[843]: time=2026-09-20T09:06:10.243Z level=INFO msg="Uploading 1 narinfos"4595lb # [ 73.627590] niks3-server[1042]: 2026/09/20 09:06:10 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4596lb # [ 73.640312] niks3-server[1042]: 2026/09/20 09:06:10 INFO Signed narinfos id=22 count=14597lb # [ 73.643101] niks3-server[1042]: 2026/09/20 09:06:10 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4598lb # [ 73.650913] niks3-server[1042]: 2026/09/20 09:06:10 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4599lb # [ 73.660845] niks3-server[1042]: 2026/09/20 09:06:10 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4600lb # [ 73.668303] niks3-server[1042]: 2026/09/20 09:06:10 INFO Completed upload id=224601worker1 # [ 73.670480] nix-grpc-daemon[843]: time=2026-09-20T09:06:10.289Z level=INFO msg="Upload complete. (349ms)"4602client # copying 1 paths...4603worker1 # [ 73.681238] nix-grpc-daemon[774]: ts=2026-09-20T09:06:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58230 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14604client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4605worker1 # [ 73.701975] nix-grpc-daemon[774]: ts=2026-09-20T09:06:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582304606worker1 # [ 73.707169] nix-daemon[832]: reaped child process 1158, status = succeeded4607worker2 # [ 73.812801] nix-grpc-daemon[772]: ts=2026-09-20T09:06:10Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:352424608worker2 # [ 73.826969] nix-grpc-daemon[772]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4609worker2 # [ 73.843796] nix-grpc-daemon[772]: ts=2026-09-20T09:06:10Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35242 duration_s=0 paths=1 nar_bytes_out=1204610client # [ 73.893222] nix-daemon[945]: reaped child process 1052, status = succeeded4611client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.94 seconds)4612client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24613client # [ 74.121588] nix-daemon[945]: accepted connection from pid 1071, user root (trusted)4614client # this derivation will be built:4615client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4616worker2 # [ 74.399745] nix-grpc-daemon[772]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:352424617client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4618worker1 # [ 74.314794] nix-grpc-daemon[774]: ts=2026-09-20T09:06:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582304619worker1 # [ 74.325798] nix-grpc-daemon[843]: time=2026-09-20T09:06:10.944Z level=INFO msg="All 1 paths already cached"4620worker2 # [ 74.433060] nix-grpc-daemon[772]: ts=2026-09-20T09:06:11Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04621worker2 # [ 74.440478] nix-grpc-daemon[772]: ts=2026-09-20T09:06:11Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14622worker2 # [ 74.480120] nix-grpc-daemon[772]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352424623worker2 # [ 74.495916] nix-grpc-daemon[772]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:352424624client # copying 1 paths to 'lb:50051'...4625worker2 # [ 74.512235] nix-grpc-daemon[888]: time=2026-09-20T09:06:11.138Z level=INFO msg="All 1 paths already cached"4626client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4627worker2 # [ 74.517510] nix-grpc-daemon[772]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:352424628worker2 # [ 74.533110] nix-daemon[835]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4629worker2 # [ 74.736853] nix-daemon[835]: accepted connection from pid 1016, user nix-grpc-daemon (trusted)4630worker2 # [ 74.757817] nix-daemon[835]: reaped child process 1019, status = succeeded4631worker2 # [ 74.928973] nix-daemon[835]: accepted connection from pid 1021, user nix-grpc-daemon (trusted)4632worker2 # [ 74.947512] nix-daemon[835]: reaped child process 1024, status = succeeded4633lb # [ 74.869814] niks3-server[1042]: 2026/09/20 09:06:11 INFO Received uploads request method=POST path=/api/pending_closures4634worker2 # [ 74.971247] nix-grpc-daemon[888]: time=2026-09-20T09:06:11.599Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4635worker2 # [ 74.972887] nix-grpc-daemon[888]: time=2026-09-20T09:06:11.599Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4636lb # [ 74.898868] niks3-server[1042]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4637lb # [ 74.912975] niks3-server[1042]: 2026/09/20 09:06:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4638worker2 # [ 75.011886] nix-grpc-daemon[888]: time=2026-09-20T09:06:11.639Z level=INFO msg="Uploading 1 narinfos"4639lb # [ 74.923059] niks3-server[1042]: 2026/09/20 09:06:11 INFO Signed narinfos id=23 count=14640lb # [ 74.932338] niks3-server[1042]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4641lb # [ 74.944217] niks3-server[1042]: 2026/09/20 09:06:11 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4642lb # [ 74.948558] niks3-server[1042]: 2026/09/20 09:06:11 INFO Completed upload id=234643worker2 # [ 75.040748] nix-grpc-daemon[888]: time=2026-09-20T09:06:11.669Z level=INFO msg="Upload complete. (490ms)"4644lb # [ 74.951786] niks3-server[1042]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4645worker2 # [ 75.048805] nix-grpc-daemon[772]: ts=2026-09-20T09:06:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35242 duration_s=0 paths=1 nar_bytes_in=5684646worker2 # [ 75.063528] nix-grpc-daemon[772]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:352424647worker2 # [ 75.070030] nix-daemon[835]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4648worker2 # [ 75.074781] nix-daemon[835]: reaped child process 1014, status = succeeded4649client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4650worker2 # [ 75.086336] nix-daemon[835]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4651client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4652worker2 # [ 76.315451] nix-daemon[835]: reaped child process 1028, status = succeeded4653worker2 # [ 76.479025] nix-daemon[835]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)4654worker2 # [ 76.497421] nix-daemon[835]: reaped child process 1046, status = succeeded4655lb # [ 76.419859] niks3-server[1042]: 2026/09/20 09:06:13 INFO Received uploads request method=POST path=/api/pending_closures4656worker2 # [ 76.522404] nix-grpc-daemon[888]: time=2026-09-20T09:06:13.149Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4657lb # [ 76.450997] niks3-server[1042]: 2026/09/20 09:06:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4658worker2 # [ 76.553782] nix-grpc-daemon[888]: time=2026-09-20T09:06:13.181Z level=INFO msg="Uploading 1 narinfos"4659lb # [ 76.465522] niks3-server[1042]: 2026/09/20 09:06:13 INFO Signed narinfos id=24 count=14660lb # [ 76.473867] niks3-server[1042]: 2026/09/20 09:06:13 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4661worker2 # [ 76.578146] nix-grpc-daemon[888]: time=2026-09-20T09:06:13.206Z level=INFO msg="Upload complete. (279ms)"4662lb # [ 76.486037] niks3-server[1042]: 2026/09/20 09:06:13 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4663lb # [ 76.490733] niks3-server[1042]: 2026/09/20 09:06:13 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4664lb # [ 76.495009] niks3-server[1042]: 2026/09/20 09:06:13 INFO Completed upload id=244665lb # [ 76.497009] niks3-server[1042]: 2026/09/20 09:06:13 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4666worker2 # [ 76.587585] nix-grpc-daemon[772]: ts=2026-09-20T09:06:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35242 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14667worker2 # [ 76.600074] nix-daemon[835]: reaped child process 1026, status = succeeded4668client # copying 1 paths...4669worker2 # [ 76.632719] nix-grpc-daemon[772]: ts=2026-09-20T09:06:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:352424670client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4671worker2 # [ 76.660103] nix-grpc-daemon[772]: ts=2026-09-20T09:06:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:352424672worker2 # [ 76.666181] nix-grpc-daemon[772]: ts=2026-09-20T09:06:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35242 duration_s=0 paths=1 nar_bytes_out=1204673client # [ 76.718397] nix-daemon[945]: reaped child process 1074, status = succeeded4674client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.82 seconds)4675(finished: subtest: an input only one worker has still reaches the builder, in 10.81 seconds)4676subtest: upload whose reference the worker lacks is completed from the cache4677client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4678client # this derivation will be built:4679client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4680client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4681client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds)4682client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4683client # this derivation will be built:4684client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4685client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4686client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds)4687client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4688client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4689worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4690worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4691worker2 # [ 78.219974] systemd[1]: Stopping Nix worker-protocol over gRPC...4692worker2 # [ 78.476778] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=signal_exit4693worker2 # [ 78.729432] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=scheduler_yield4694worker2 # [ 78.735232] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=scheduler_restarting addr=lb:500514695worker1 # [ 78.646493] nix-grpc-daemon[774]: ts=2026-09-20T09:06:15Z level=info event=scheduler_restarting addr=lb:500514696lb # [ 78.643980] niks3-server[1042]: 2026/09/20 09:06:15 INFO lead: released remote=192.168.1.4:456264697worker2 # [ 78.741983] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:437504698worker2 # [ 78.746616] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=worker_gone addr=192.168.1.4:500514699worker2 # [ 78.750671] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:437504700worker2 # [ 78.755244] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=worker_gone addr=192.168.1.3:500514701worker2 # [ 78.936374] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=scheduler_connected addr=lb:500514702worker1 # [ 78.846995] nix-grpc-daemon[774]: ts=2026-09-20T09:06:15Z level=info event=scheduler_connected addr=lb:500514703worker2 # [ 78.944076] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4704worker1 # [ 78.875612] nix-grpc-daemon[774]: ts=2026-09-20T09:06:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4705worker2 # [ 79.145124] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=scheduler_connected addr=lb:500514706worker2 # [ 79.150548] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4707worker1 # [ 79.076720] nix-grpc-daemon[774]: ts=2026-09-20T09:06:15Z level=info event=scheduler_connected addr=lb:500514708worker1 # [ 79.081943] nix-grpc-daemon[774]: ts=2026-09-20T09:06:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4709worker2 # [ 79.351336] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=scheduler_connected addr=lb:500514710worker2 # [ 79.356810] nix-grpc-daemon[772]: ts=2026-09-20T09:06:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4711worker1 # [ 79.282480] nix-grpc-daemon[774]: ts=2026-09-20T09:06:15Z level=info event=scheduler_connected addr=lb:500514712worker1 # [ 79.288093] nix-grpc-daemon[774]: ts=2026-09-20T09:06:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4713worker2 # [ 79.558849] nix-grpc-daemon[772]: ts=2026-09-20T09:06:16Z level=info event=scheduler_connected addr=lb:500514714worker2 # [ 79.564211] nix-grpc-daemon[772]: ts=2026-09-20T09:06:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4715worker1 # [ 79.488652] nix-grpc-daemon[774]: ts=2026-09-20T09:06:16Z level=info event=scheduler_connected addr=lb:500514716worker1 # [ 79.494526] nix-grpc-daemon[774]: ts=2026-09-20T09:06:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4717worker2 # [ 79.735162] nix-grpc-daemon[772]: ts=2026-09-20T09:06:16Z level=info event=scheduler_restarting4718worker1 # [ 79.697102] nix-grpc-daemon[774]: ts=2026-09-20T09:06:16Z level=info event=scheduler_connected addr=lb:500514719worker2 # [ 79.790930] nix-grpc-daemon[772]: ts=2026-09-20T09:06:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4720worker1 # [ 79.702351] nix-grpc-daemon[774]: ts=2026-09-20T09:06:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4721worker2 # [ 79.796442] nix-daemon[835]: reaped child process 837, status = succeeded4722worker1 # [ 79.903197] nix-grpc-daemon[774]: ts=2026-09-20T09:06:16Z level=info event=scheduler_connected addr=lb:500514723worker2 # [ 79.995662] nix-grpc-daemon[772]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4724worker2 # [ 80.000305] nix-grpc-daemon[772]: E0000 00:00:1789895176.623612 815 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true4725worker1 # [ 80.244208] nix-grpc-daemon[774]: ts=2026-09-20T09:06:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4726worker2 # [ 80.350091] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4727worker2 # [ 80.351622] systemd[1]: Stopped Nix worker-protocol over gRPC.4728worker2 # [ 80.357283] systemd[1]: nix-grpc-daemon.service: Consumed 1.923s CPU time over 59.217s wall clock time, 54.8M memory peak, 55.6K incoming IP traffic, 101.1K outgoing IP traffic.4729worker2 # [ 80.365008] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4730worker2 # [ 80.366663] systemd[1]: Closed Nix worker-protocol over gRPC.4731worker2 # [ 80.369433] systemd[1]: nix-grpc-daemon.socket: Consumed 691us CPU time over 1min 8.535s wall clock time, 256K memory peak, 97.7K incoming IP traffic, 84.5K outgoing IP traffic.4732lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4733lb: must succeed: curl -sf localhost:9901/clusters4734lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4735lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4736client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24737worker1 # [ 80.445284] nix-grpc-daemon[774]: ts=2026-09-20T09:06:17Z level=info event=scheduler_connected addr=lb:500514738worker1 # [ 80.451947] nix-grpc-daemon[774]: ts=2026-09-20T09:06:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4739worker1 # [ 80.608516] nix-grpc-daemon[774]: ts=2026-09-20T09:06:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582304740worker1 # [ 80.616781] nix-grpc-daemon[774]: ts=2026-09-20T09:06:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582304741client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds)4742worker1 # [ 80.652874] nix-grpc-daemon[774]: ts=2026-09-20T09:06:17Z level=info event=scheduler_connected addr=lb:500514743worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4744worker1 # [ 80.658024] nix-grpc-daemon[774]: ts=2026-09-20T09:06:17Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4745worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4746worker2 # [ 80.850526] systemd[1]: Listening on Nix worker-protocol over gRPC.4747worker1 # [ 80.837851] systemd[1]: Stopping Nix worker-protocol over gRPC...4748worker1 # [ 80.859512] nix-grpc-daemon[774]: ts=2026-09-20T09:06:17Z level=info event=scheduler_connected addr=lb:500514749worker1 # [ 80.864310] nix-grpc-daemon[774]: ts=2026-09-20T09:06:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4750lb # [ 81.033959] envoy[923]: conn peer=[2001:db8:1::1]:47276 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=1804 ms=34544751lb # [ 81.034330] envoy[923]: conn peer=[2001:db8:1::1]:34472 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=954752lb # [ 81.034456] envoy[923]: conn peer=[2001:db8:1::1]:34482 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3753 tx=1820 ms=23244753lb # [ 81.034560] envoy[923]: conn peer=[2001:db8:1::1]:34484 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=684754lb # [ 81.034677] envoy[923]: conn peer=[2001:db8:1::4]:47440 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8564 tx=2413 ms=582654755lb # [ 81.034794] envoy[923]: conn peer=[2001:db8:1::1]:34498 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=284756worker1 # [ 81.065477] nix-grpc-daemon[774]: ts=2026-09-20T09:06:17Z level=info event=scheduler_connected addr=lb:500514757worker2 # [ 81.169531] systemd[1]: Starting Nix worker-protocol over gRPC...4758client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4759worker2 # [ 81.379033] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4760worker2 # [ 81.381891] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:18Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14761worker2 # [ 81.390164] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4762worker2 # [ 81.396831] systemd[1]: Started Nix worker-protocol over gRPC.4763lb # [ 81.311010] niks3-server[1042]: 2026/09/20 09:06:17 INFO lead: acquired remote=192.168.1.4:552624764worker2 # [ 81.407052] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:18Z level=info event=scheduler_take_over4765worker2 # [ 81.420363] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04766worker2 # [ 81.433813] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:18Z level=info event=scheduler_connected addr=lb:500514767worker2 # [ 81.436691] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4768worker1 # [ 81.365067] nix-grpc-daemon[774]: ts=2026-09-20T09:06:17Z level=info event=signal_exit4769worker2 # [ 81.637779] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:18Z level=info event=scheduler_connected addr=lb:500514770worker2 # [ 81.643652] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:18Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04771worker2 # [ 82.716865] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:501904772worker2 # [ 82.721697] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:19Z level=info event=worker_gone addr=192.168.1.3:500514773worker1 # [ 82.643126] nix-grpc-daemon[774]: ts=2026-09-20T09:06:19Z level=info event=scheduler_restarting4774worker1 # [ 82.660535] nix-grpc-daemon[774]: ts=2026-09-20T09:06:19Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4775worker1 # [ 82.678187] nix-daemon[832]: reaped child process 834, status = succeeded4776worker1 # [ 83.482744] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4777worker1 # [ 83.483181] nix-grpc-daemon[774]: E0000 00:00:1789895180.101590 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4778worker1 # [ 83.499670] nix-grpc-daemon[774]: E0000 00:00:1789895180.118648 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4779worker1 # [ 84.192575] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4780worker1 # [ 84.198336] systemd[1]: Stopped Nix worker-protocol over gRPC.4781worker1 # [ 84.203624] systemd[1]: nix-grpc-daemon.service: Consumed 3.729s CPU time over 1min 3.176s wall clock time, 58.5M memory peak, 91.2K incoming IP traffic, 164K outgoing IP traffic.4782worker1 # [ 84.217521] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4783worker1 # [ 84.219469] systemd[1]: Closed Nix worker-protocol over gRPC.4784worker1 # [ 84.223431] systemd[1]: nix-grpc-daemon.socket: Consumed 690us CPU time over 1min 12.470s wall clock time, 256K memory peak, 107.9K incoming IP traffic, 87.9K outgoing IP traffic.4785lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4786lb: must succeed: curl -sf localhost:9901/clusters4787lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4788lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4789client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24790worker2 # [ 84.662882] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:502184791worker2 # [ 84.678813] nix-daemon[835]: accepted connection from pid 1067, user nix-grpc-daemon (trusted)4792worker2 # [ 84.706720] nix-grpc-daemon[1067]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)4793worker2 # [ 84.753807] nix-grpc-daemon[1067]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 2/5)4794worker2 # [ 84.765459] nix-grpc-daemon[1067]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 335 ms (attempt 3/5)4795worker2 # [ 85.108462] nix-grpc-daemon[1067]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 476 ms (attempt 4/5)4796worker2 # [ 85.593422] nix-grpc-daemon[1067]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4797client # copying 2 paths...4798client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4799worker2 # [ 85.621059] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:502184800client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4801worker2 # [ 85.637372] nix-daemon[835]: accepted connection from pid 1067, user nix-grpc-daemon (trusted)4802worker2 # [ 85.674250] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:22Z level=info event=niks3_push_started pid=11234803worker2 # [ 86.072533] nix-daemon[835]: accepted connection from pid 1136, user nix-grpc-daemon (trusted)4804worker2 # [ 86.094762] nix-daemon[835]: reaped child process 1139, status = succeeded4805lb # [ 86.015668] niks3-server[1042]: 2026/09/20 09:06:22 INFO Received uploads request method=POST path=/api/pending_closures4806lb # [ 86.025626] niks3-server[1042]: 2026/09/20 09:06:22 INFO Received uploads request method=POST path=/api/pending_closures4807worker2 # [ 86.128533] nix-grpc-daemon[1123]: time=2026-09-20T09:06:22.755Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4808worker2 # [ 86.133593] nix-grpc-daemon[1123]: time=2026-09-20T09:06:22.755Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4809worker2 # [ 86.135593] nix-grpc-daemon[1123]: time=2026-09-20T09:06:22.756Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4810lb # [ 86.090095] niks3-server[1042]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4811lb # [ 86.099583] niks3-server[1042]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4812lb # [ 86.109021] niks3-server[1042]: 2026/09/20 09:06:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4813worker2 # [ 86.211492] nix-grpc-daemon[1123]: time=2026-09-20T09:06:22.837Z level=INFO msg="Uploading 3 narinfos"4814lb # [ 86.119895] niks3-server[1042]: 2026/09/20 09:06:22 INFO Signed narinfos id=25 count=14815lb # [ 86.124672] niks3-server[1042]: 2026/09/20 09:06:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4816lb # [ 86.127606] niks3-server[1042]: 2026/09/20 09:06:22 INFO Signed narinfos id=26 count=24817lb # [ 86.136223] niks3-server[1042]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4818lb # [ 86.138904] niks3-server[1042]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4819lb # [ 86.148393] niks3-server[1042]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4820lb # [ 86.157583] niks3-server[1042]: 2026/09/20 09:06:22 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4821lb # [ 86.165532] niks3-server[1042]: 2026/09/20 09:06:22 INFO Completed upload id=254822worker2 # [ 86.256548] nix-grpc-daemon[1123]: time=2026-09-20T09:06:22.884Z level=INFO msg="Upload complete. (358ms)"4823lb # [ 86.166999] niks3-server[1042]: 2026/09/20 09:06:22 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4824lb # [ 86.171565] niks3-server[1042]: 2026/09/20 09:06:22 INFO Completed upload id=264825lb # [ 86.174394] niks3-server[1042]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4826lb # [ 86.177558] niks3-server[1042]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4827worker2 # [ 86.266845] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50218 duration_s=0 paths=2 nar_bytes_in=3124828worker2 # [ 86.286513] nix-daemon[835]: reaped child process 1121, status = succeeded4829client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.90 seconds)4830worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4831worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4832worker1 # [ 86.340893] systemd[1]: Listening on Nix worker-protocol over gRPC.4833worker1 # [ 86.346421] systemd[1]: Starting Nix worker-protocol over gRPC...4834worker1 # [ 86.550214] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4835worker1 # [ 86.553544] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14836worker1 # [ 86.561188] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4837worker1 # [ 86.569416] systemd[1]: Started Nix worker-protocol over gRPC.4838lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4839lb: must succeed: curl -sf localhost:9901/clusters4840worker1 # [ 86.612094] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:23Z level=info event=scheduler_connected addr=lb:500514841worker2 # [ 86.705554] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04842lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4843lb: must succeed: curl -sf localhost:9901/clusters4844lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4845lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)4846(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.04 seconds)4847subtest: scheduler down: the other node takes the lock and keeps it4848lb: must succeed: curl -sf localhost:9901/clusters4849lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4850lb: must succeed: curl -sf localhost:9901/clusters4851lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4852lb: must succeed: curl -sf localhost:9901/clusters4853lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4854lb: must succeed: curl -sf localhost:9901/clusters4855lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4856worker2 # [ 88.123689] systemd[1]: Stopping Nix worker-protocol over gRPC...4857worker2 # [ 88.396624] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=signal_exit4858worker2 # [ 88.608931] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=scheduler_yield4859lb # [ 88.521370] niks3-server[1042]: 2026/09/20 09:06:25 INFO lead: released remote=192.168.1.4:552624860worker1 # [ 88.526333] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:25Z level=info event=scheduler_restarting addr=lb:500514861worker2 # [ 88.619639] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:501904862worker2 # [ 88.626967] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=worker_gone addr=192.168.1.3:500514863worker2 # [ 88.631277] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=scheduler_restarting addr=lb:500514864worker2 # [ 88.635393] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:501904865worker2 # [ 88.642651] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=worker_gone addr=192.168.1.4:500514866worker1 # [ 88.726353] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:25Z level=info event=scheduler_connected addr=lb:500514867worker2 # [ 88.826949] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=scheduler_connected addr=lb:500514868worker1 # [ 88.737008] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4869worker2 # [ 88.848258] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4870worker1 # [ 88.938006] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:25Z level=info event=scheduler_connected addr=lb:500514871worker1 # [ 88.945387] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4872worker2 # [ 89.049328] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=scheduler_connected addr=lb:500514873worker2 # [ 89.056360] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4874worker1 # [ 89.146519] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:25Z level=info event=scheduler_connected addr=lb:500514875worker1 # [ 89.153644] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4876worker2 # [ 89.257397] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=scheduler_connected addr=lb:500514877worker2 # [ 89.263859] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4878worker1 # [ 89.354706] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:25Z level=info event=scheduler_connected addr=lb:500514879worker1 # [ 89.361583] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4880worker2 # [ 89.467508] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:26Z level=info event=scheduler_connected addr=lb:500514881worker2 # [ 89.471723] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4882worker2 # [ 89.614267] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:26Z level=info event=scheduler_restarting4883worker2 # [ 89.644503] nix-grpc-daemon[1067]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4884worker2 # [ 89.648944] nix-grpc-daemon[1067]: E0000 00:00:1789895186.272430 1110 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4885worker2 # [ 89.657311] nix-daemon[835]: reaped child process 1116, status = succeeded4886worker1 # [ 89.566276] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:26Z level=info event=scheduler_connected addr=lb:500514887worker1 # [ 89.570528] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4888worker2 # [ 89.687478] nix-grpc-daemon[1067]: ts=2026-09-20T09:06:26Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4889worker2 # [ 89.693949] nix-grpc-daemon[1067]: E0000 00:00:1789895186.322163 1110 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4890worker1 # [ 89.766721] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:26Z level=info event=scheduler_connected addr=lb:500514891worker2 # [ 89.858743] nix-grpc-daemon[1067]: E0000 00:00:1789895186.486921 1110 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4892lb # [ 91.037874] envoy[923]: conn peer=[2001:db8:1::3]:38836 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10409 tx=3024 ms=612484893lb # [ 91.042998] envoy[923]: conn peer=[2001:db8:1::1]:58790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1007 tx=305 ms=16234894lb # [ 91.050305] envoy[923]: conn peer=[2001:db8:1::4]:36820 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1133 tx=413 ms=82434895worker1 # [ 91.323088] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4896worker2 # [ 91.432808] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4897worker2 # [ 91.437045] systemd[1]: Stopped Nix worker-protocol over gRPC.4898worker2 # [ 91.445336] systemd[1]: nix-grpc-daemon.service: Consumed 522ms CPU time over 10.263s wall clock time, 33.1M memory peak, 17.4K incoming IP traffic, 22.1K outgoing IP traffic.4899worker2 # [ 91.458098] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4900worker2 # [ 91.465271] systemd[1]: Closed Nix worker-protocol over gRPC.4901worker2 # [ 91.467969] systemd[1]: nix-grpc-daemon.socket: Consumed 837us CPU time over 10.620s wall clock time, 256K memory peak, 26.3K incoming IP traffic, 20.7K outgoing IP traffic.4902worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4903worker1 # [ 91.523309] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:28Z level=info event=scheduler_connected addr=lb:500514904worker1 # [ 91.530678] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4905lb # [ 91.570067] niks3-server[1042]: 2026/09/20 09:06:28 INFO lead: acquired remote=192.168.1.3:443924906worker1 # [ 91.576532] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:28Z level=info event=scheduler_take_over4907worker1 # [ 91.731990] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:28Z level=info event=scheduler_connected addr=lb:500514908worker1 # [ 91.737396] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4909worker1 # [ 91.938081] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:28Z level=info event=scheduler_connected addr=lb:500514910worker1 # [ 91.943838] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04911worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.16 seconds)4912worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4913worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4914client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24915worker1 # [ 92.861260] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:451684916worker1 # [ 92.876418] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4917client # don't know how to build these paths:4918client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4919worker1 # [ 92.898174] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:451684920worker1 # [ 92.918324] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 1/5)4921worker1 # [ 92.941934] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 2/5)4922worker1 # [ 93.094619] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 3/5)4923worker1 # [ 93.114260] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 509 ms (attempt 4/5)4924worker1 # [ 93.631222] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4925worker1 # [ 93.670843] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:30Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04926worker1 # [ 93.678248] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:30Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14927worker1 # [ 93.718888] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:451684928worker1 # [ 93.735440] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:451684929client # copying 1 paths to 'lb:50051'...4930client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4931worker1 # [ 93.751975] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:451684932worker1 # [ 93.766483] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4933worker1 # [ 93.794786] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:30Z level=info event=niks3_push_started pid=12764934worker1 # [ 94.181362] nix-daemon[832]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)4935worker1 # [ 94.201622] nix-daemon[832]: reaped child process 1292, status = succeeded4936worker1 # [ 94.376966] nix-daemon[832]: accepted connection from pid 1294, user nix-grpc-daemon (trusted)4937worker1 # [ 94.394049] nix-daemon[832]: reaped child process 1297, status = succeeded4938lb # [ 94.407169] niks3-server[1042]: 2026/09/20 09:06:31 INFO Received uploads request method=POST path=/api/pending_closures4939worker1 # [ 94.426114] nix-grpc-daemon[1276]: time=2026-09-20T09:06:31.043Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4940worker1 # [ 94.427654] nix-grpc-daemon[1276]: time=2026-09-20T09:06:31.043Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4941lb # [ 94.467592] niks3-server[1042]: 2026/09/20 09:06:31 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4942worker1 # [ 94.483614] nix-grpc-daemon[1276]: time=2026-09-20T09:06:31.102Z level=INFO msg="Uploading 1 narinfos"4943lb # [ 94.483160] niks3-server[1042]: 2026/09/20 09:06:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4944lb # [ 94.492917] niks3-server[1042]: 2026/09/20 09:06:31 INFO Signed narinfos id=27 count=14945lb # [ 94.498135] niks3-server[1042]: 2026/09/20 09:06:31 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4946lb # [ 94.506323] niks3-server[1042]: 2026/09/20 09:06:31 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4947lb # [ 94.515246] niks3-server[1042]: 2026/09/20 09:06:31 INFO Completed upload id=274948worker1 # [ 94.516721] nix-grpc-daemon[1276]: time=2026-09-20T09:06:31.135Z level=INFO msg="Upload complete. (508ms)"4949lb # [ 94.517573] niks3-server[1042]: 2026/09/20 09:06:31 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4950worker1 # [ 94.529407] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45168 duration_s=0 paths=1 nar_bytes_in=5204951worker1 # [ 94.544355] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:451684952worker1 # [ 94.555379] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4953worker1 # [ 94.557716] nix-daemon[832]: reaped child process 1274, status = succeeded4954client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4955client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4956worker1 # [ 94.571432] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4957client # farm-a> LOG-farm-a-on-standby4958worker1 # [ 95.991576] nix-daemon[832]: reaped child process 1301, status = succeeded4959worker1 # [ 96.149043] nix-daemon[832]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)4960worker1 # [ 96.168424] nix-daemon[832]: reaped child process 1319, status = succeeded4961lb # [ 96.178756] niks3-server[1042]: 2026/09/20 09:06:32 INFO Received uploads request method=POST path=/api/pending_closures4962worker1 # [ 96.192400] nix-grpc-daemon[1276]: time=2026-09-20T09:06:32.809Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4963worker1 # [ 96.193911] nix-grpc-daemon[1276]: time=2026-09-20T09:06:32.809Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4964lb # [ 96.223667] niks3-server[1042]: 2026/09/20 09:06:32 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4965lb # [ 96.235419] niks3-server[1042]: 2026/09/20 09:06:32 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4966lb # [ 96.243712] niks3-server[1042]: 2026/09/20 09:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4967worker1 # [ 96.252194] nix-grpc-daemon[1276]: time=2026-09-20T09:06:32.870Z level=INFO msg="Uploading 1 narinfos"4968lb # [ 96.250355] niks3-server[1042]: 2026/09/20 09:06:32 INFO Signed narinfos id=28 count=14969lb # [ 96.255879] niks3-server[1042]: 2026/09/20 09:06:32 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4970lb # [ 96.264662] niks3-server[1042]: 2026/09/20 09:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4971worker1 # [ 96.274114] nix-grpc-daemon[1276]: time=2026-09-20T09:06:32.893Z level=INFO msg="Upload complete. (293ms)"4972lb # [ 96.273703] niks3-server[1042]: 2026/09/20 09:06:32 INFO Completed upload id=284973lb # [ 96.277286] niks3-server[1042]: 2026/09/20 09:06:32 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4974worker1 # [ 96.296673] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45168 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14975worker1 # [ 96.306692] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:32Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04976worker1 # [ 96.309875] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:32Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14977worker1 # [ 96.313289] nix-daemon[832]: reaped child process 1299, status = succeeded4978worker1 # [ 96.338226] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:451684979worker1 # [ 96.352965] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:451684980worker1 # [ 96.367039] nix-grpc-daemon[1276]: time=2026-09-20T09:06:32.986Z level=INFO msg="All 1 paths already cached"4981client # copying 1 paths to 'lb:50051'...4982client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4983worker1 # [ 96.377322] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:451684984worker1 # [ 96.391281] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4985worker1 # [ 96.593031] nix-daemon[832]: accepted connection from pid 1325, user nix-grpc-daemon (trusted)4986worker1 # [ 96.612238] nix-daemon[832]: reaped child process 1328, status = succeeded4987worker1 # [ 96.783553] nix-daemon[832]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)4988worker1 # [ 96.802648] nix-daemon[832]: reaped child process 1333, status = succeeded4989lb # [ 96.811697] niks3-server[1042]: 2026/09/20 09:06:33 INFO Received uploads request method=POST path=/api/pending_closures4990worker1 # [ 96.823458] nix-grpc-daemon[1276]: time=2026-09-20T09:06:33.442Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4991worker1 # [ 96.825771] nix-grpc-daemon[1276]: time=2026-09-20T09:06:33.444Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4992lb # [ 96.844589] niks3-server[1042]: 2026/09/20 09:06:33 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4993lb # [ 96.855581] niks3-server[1042]: 2026/09/20 09:06:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4994worker1 # [ 96.865358] nix-grpc-daemon[1276]: time=2026-09-20T09:06:33.484Z level=INFO msg="Uploading 1 narinfos"4995lb # [ 96.866538] niks3-server[1042]: 2026/09/20 09:06:33 INFO Signed narinfos id=29 count=14996lb # [ 96.873232] niks3-server[1042]: 2026/09/20 09:06:33 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4997lb # [ 96.881644] niks3-server[1042]: 2026/09/20 09:06:33 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4998lb # [ 96.890542] niks3-server[1042]: 2026/09/20 09:06:33 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4999lb # [ 96.897038] niks3-server[1042]: 2026/09/20 09:06:33 INFO Completed upload id=295000worker1 # [ 96.899099] nix-grpc-daemon[1276]: time=2026-09-20T09:06:33.518Z level=INFO msg="Upload complete. (492ms)"5001worker1 # [ 96.907149] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45168 duration_s=0 paths=1 nar_bytes_in=6405002worker1 # [ 96.921958] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:451685003worker1 # [ 96.929064] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5004worker1 # [ 96.934171] nix-daemon[832]: reaped child process 1323, status = succeeded5005client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5006client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5007worker1 # [ 96.948183] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5008client # farm-b> LOG-farm-b-on-standby5009worker1 # [ 97.993526] nix-daemon[832]: reaped child process 1337, status = succeeded5010worker1 # [ 98.168564] nix-daemon[832]: accepted connection from pid 1352, user nix-grpc-daemon (trusted)5011worker1 # [ 98.185578] nix-daemon[832]: reaped child process 1355, status = succeeded5012lb # [ 98.197876] niks3-server[1042]: 2026/09/20 09:06:34 INFO Received uploads request method=POST path=/api/pending_closures5013worker1 # [ 98.211882] nix-grpc-daemon[1276]: time=2026-09-20T09:06:34.830Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5014worker1 # [ 98.215323] nix-grpc-daemon[1276]: time=2026-09-20T09:06:34.833Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5015lb # [ 98.249416] niks3-server[1042]: 2026/09/20 09:06:34 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5016worker1 # [ 98.259381] nix-grpc-daemon[1276]: time=2026-09-20T09:06:34.878Z level=INFO msg="Uploading 1 narinfos"5017lb # [ 98.264750] niks3-server[1042]: 2026/09/20 09:06:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5018lb # [ 98.280993] niks3-server[1042]: 2026/09/20 09:06:34 INFO Signed narinfos id=30 count=15019lb # [ 98.283373] niks3-server[1042]: 2026/09/20 09:06:34 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5020worker1 # [ 98.297103] nix-grpc-daemon[1276]: time=2026-09-20T09:06:34.916Z level=INFO msg="Upload complete. (338ms)"5021lb # [ 98.297073] niks3-server[1042]: 2026/09/20 09:06:34 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5022lb # [ 98.300457] niks3-server[1042]: 2026/09/20 09:06:34 INFO Completed upload id=305023lb # [ 98.303078] niks3-server[1042]: 2026/09/20 09:06:34 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5024lb # [ 98.306378] niks3-server[1042]: 2026/09/20 09:06:34 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5025worker1 # [ 98.312562] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45168 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15026worker1 # [ 98.333356] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:34Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05027worker1 # [ 98.340376] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:34Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15028worker1 # [ 98.345543] nix-daemon[832]: reaped child process 1335, status = succeeded5029worker1 # [ 98.370235] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:451685030worker1 # [ 98.385838] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:451685031worker1 # [ 98.400098] nix-grpc-daemon[1276]: time=2026-09-20T09:06:35.019Z level=INFO msg="All 2 paths already cached"5032client # copying 1 paths to 'lb:50051'...5033client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5034worker1 # [ 98.410935] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:451685035worker1 # [ 98.425129] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5036worker1 # [ 98.627783] nix-daemon[832]: accepted connection from pid 1361, user nix-grpc-daemon (trusted)5037worker1 # [ 98.647741] nix-daemon[832]: reaped child process 1364, status = succeeded5038worker1 # [ 98.819156] nix-daemon[832]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5039worker1 # [ 98.836419] nix-daemon[832]: reaped child process 1369, status = succeeded5040lb # [ 98.845193] niks3-server[1042]: 2026/09/20 09:06:35 INFO Received uploads request method=POST path=/api/pending_closures5041worker1 # [ 98.858812] nix-grpc-daemon[1276]: time=2026-09-20T09:06:35.477Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5042worker1 # [ 98.860357] nix-grpc-daemon[1276]: time=2026-09-20T09:06:35.477Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5043lb # [ 98.875891] niks3-server[1042]: 2026/09/20 09:06:35 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5044lb # [ 98.890572] niks3-server[1042]: 2026/09/20 09:06:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5045worker1 # [ 98.898571] nix-grpc-daemon[1276]: time=2026-09-20T09:06:35.517Z level=INFO msg="Uploading 1 narinfos"5046lb # [ 98.899587] niks3-server[1042]: 2026/09/20 09:06:35 INFO Signed narinfos id=31 count=15047lb # [ 98.907700] niks3-server[1042]: 2026/09/20 09:06:35 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5048lb # [ 98.918369] niks3-server[1042]: 2026/09/20 09:06:35 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5049lb # [ 98.922693] niks3-server[1042]: 2026/09/20 09:06:35 INFO Completed upload id=315050worker1 # [ 98.924745] nix-grpc-daemon[1276]: time=2026-09-20T09:06:35.543Z level=INFO msg="Upload complete. (484ms)"5051lb # [ 98.925164] niks3-server[1042]: 2026/09/20 09:06:35 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5052worker1 # [ 98.932131] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45168 duration_s=0 paths=1 nar_bytes_in=7685053worker1 # [ 98.944403] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:451685054worker1 # [ 98.950608] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5055worker1 # [ 98.955803] nix-daemon[832]: reaped child process 1359, status = succeeded5056client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5057worker1 # [ 98.967826] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5058client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5059client # farm-top> LOG-farm-top-on-standby5060worker1 # [ 100.613366] nix-daemon[832]: reaped child process 1373, status = succeeded5061worker1 # [ 100.800479] nix-daemon[832]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5062worker1 # [ 100.818173] nix-daemon[832]: reaped child process 1391, status = succeeded5063lb # [ 100.830114] niks3-server[1042]: 2026/09/20 09:06:37 INFO Received uploads request method=POST path=/api/pending_closures5064worker1 # [ 100.843304] nix-grpc-daemon[1276]: time=2026-09-20T09:06:37.460Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5065worker1 # [ 100.845036] nix-grpc-daemon[1276]: time=2026-09-20T09:06:37.460Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5066lb # [ 100.868662] niks3-server[1042]: 2026/09/20 09:06:37 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5067lb # [ 100.880424] niks3-server[1042]: 2026/09/20 09:06:37 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5068worker1 # [ 100.892538] nix-grpc-daemon[1276]: time=2026-09-20T09:06:37.511Z level=INFO msg="Uploading 1 narinfos"5069lb # [ 100.892443] niks3-server[1042]: 2026/09/20 09:06:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5070lb # [ 100.900223] niks3-server[1042]: 2026/09/20 09:06:37 INFO Signed narinfos id=32 count=15071lb # [ 100.905139] niks3-server[1042]: 2026/09/20 09:06:37 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5072lb # [ 100.912383] niks3-server[1042]: 2026/09/20 09:06:37 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5073lb # [ 100.916346] niks3-server[1042]: 2026/09/20 09:06:37 INFO Completed upload id=325074worker1 # [ 100.917834] nix-grpc-daemon[1276]: time=2026-09-20T09:06:37.536Z level=INFO msg="Upload complete. (335ms)"5075lb # [ 100.918609] niks3-server[1042]: 2026/09/20 09:06:37 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5076worker1 # [ 100.933210] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45168 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15077worker1 # [ 100.948242] nix-daemon[832]: reaped child process 1371, status = succeeded5078client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.38 seconds)5079client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5080lb # [ 101.042207] envoy[923]: conn peer=[2001:db8:1::1]:60052 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=3878 ms=80895081client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds)5082worker2 # [ 101.391028] systemd[1]: Listening on Nix worker-protocol over gRPC.5083worker2 # [ 101.401562] systemd[1]: Starting Nix worker-protocol over gRPC...5084worker2 # [ 101.602325] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:38Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5085worker2 # [ 101.604846] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:38Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15086worker2 # [ 101.612660] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:38Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5087worker2 # [ 101.614425] systemd[1]: Started Nix worker-protocol over gRPC.5088lb: must succeed: curl -sf localhost:9901/clusters5089worker2 # [ 101.663472] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:38Z level=info event=scheduler_connected addr=lb:500515090worker1 # [ 101.577957] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:38Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05091lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)5092worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5093worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5094lb: must succeed: curl -sf localhost:9901/clusters5095lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5096lb: must succeed: curl -sf localhost:9901/clusters5097lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5098worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5099worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5100(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.23 seconds)5101subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5102client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5103client # [ 102.068110] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5104client # Running as unit: rs.service; invocation ID: 5c065b4d191d48caacb27a67976f292f5105client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5106worker2 # [ 102.422924] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:432925107worker2 # [ 102.439834] nix-daemon[835]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)5108client # [ 102.376737] nix[1174]: don't know how to build these paths:5109client # [ 102.378008] nix[1174]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5110worker1 # [ 102.383683] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:38Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05111worker1 # [ 102.389866] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:39Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15112worker1 # [ 102.427294] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:451685113worker1 # [ 102.449140] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:451685114client # [ 102.472240] nix[1174]: copying 1 paths to 'lb:50051'...5115worker1 # [ 102.464105] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:451685116client # [ 102.474695] nix[1174]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5117worker1 # [ 102.479367] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5118worker1 # [ 102.695733] nix-daemon[832]: accepted connection from pid 1406, user nix-grpc-daemon (trusted)5119worker1 # [ 102.715620] nix-daemon[832]: reaped child process 1409, status = succeeded5120worker1 # [ 102.888714] nix-daemon[832]: accepted connection from pid 1411, user nix-grpc-daemon (trusted)5121worker1 # [ 102.908315] nix-daemon[832]: reaped child process 1414, status = succeeded5122lb # [ 102.918973] niks3-server[1042]: 2026/09/20 09:06:39 INFO Received uploads request method=POST path=/api/pending_closures5123worker1 # [ 102.931930] nix-grpc-daemon[1276]: time=2026-09-20T09:06:39.550Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5124worker1 # [ 102.933616] nix-grpc-daemon[1276]: time=2026-09-20T09:06:39.550Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5125lb # [ 102.951676] niks3-server[1042]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5126lb # [ 102.966511] niks3-server[1042]: 2026/09/20 09:06:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5127worker1 # [ 102.975812] nix-grpc-daemon[1276]: time=2026-09-20T09:06:39.594Z level=INFO msg="Uploading 1 narinfos"5128lb # [ 102.979938] niks3-server[1042]: 2026/09/20 09:06:39 INFO Signed narinfos id=33 count=15129lb # [ 102.983245] niks3-server[1042]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5130lb # [ 102.995106] niks3-server[1042]: 2026/09/20 09:06:39 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5131worker1 # [ 103.004767] nix-grpc-daemon[1276]: time=2026-09-20T09:06:39.623Z level=INFO msg="Upload complete. (508ms)"5132lb # [ 103.003860] niks3-server[1042]: 2026/09/20 09:06:39 INFO Completed upload id=335133lb # [ 103.008122] niks3-server[1042]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5134worker1 # [ 103.012159] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45168 duration_s=0 paths=1 nar_bytes_in=4165135worker1 # [ 103.028556] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:451685136worker1 # [ 103.035406] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5137worker1 # [ 103.041074] nix-daemon[832]: reaped child process 1404, status = succeeded5138client # [ 103.059318] nix[1174]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5139worker1 # [ 103.055813] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5140lb: must succeed: curl -sf localhost:9901/clusters5141lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5142lb: must succeed: curl -sf localhost:9901/clusters5143lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5144lb: must succeed: curl -sf localhost:9901/clusters5145lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5146lb: must succeed: curl -sf localhost:9901/clusters5147lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5148worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5149worker2 # [ 105.105540] systemd-journald[272]: Received client request to rotate journal, rotating.5150worker2 # [ 105.130240] systemd-journald[272]: Vacuuming done, freed 0B of archived journals from /var/log/journal/4ab690772307412ba1933f5183e27ad7.5151worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5152worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5153worker1 # [ 105.090101] systemd[1]: Stopping Nix worker-protocol over gRPC...5154worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5155client: must succeed: sleep 5.05156worker1 # [ 105.574491] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:42Z level=info event=draining5157client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5158worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5159worker1 # [ 110.494803] nix-daemon[832]: reaped child process 1418, status = succeeded5160worker1 # [ 110.666263] nix-daemon[832]: accepted connection from pid 1458, user nix-grpc-daemon (trusted)5161worker1 # [ 110.683333] nix-daemon[832]: reaped child process 1461, status = succeeded5162lb # [ 110.693712] niks3-server[1042]: 2026/09/20 09:06:47 INFO Received uploads request method=POST path=/api/pending_closures5163worker1 # [ 110.708041] nix-grpc-daemon[1276]: time=2026-09-20T09:06:47.324Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5164worker1 # [ 110.709545] nix-grpc-daemon[1276]: time=2026-09-20T09:06:47.324Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5165lb # [ 110.736814] niks3-server[1042]: 2026/09/20 09:06:47 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5166worker1 # [ 110.759391] nix-grpc-daemon[1276]: time=2026-09-20T09:06:47.378Z level=INFO msg="Uploading 1 narinfos"5167lb # [ 110.748327] niks3-server[1042]: 2026/09/20 09:06:47 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5168lb # [ 110.760426] niks3-server[1042]: 2026/09/20 09:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5169lb # [ 110.763745] niks3-server[1042]: 2026/09/20 09:06:47 INFO Signed narinfos id=34 count=15170lb # [ 110.771695] niks3-server[1042]: 2026/09/20 09:06:47 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5171worker1 # [ 110.781152] nix-grpc-daemon[1276]: time=2026-09-20T09:06:47.400Z level=INFO msg="Upload complete. (310ms)"5172lb # [ 110.778230] niks3-server[1042]: 2026/09/20 09:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5173lb # [ 110.783228] niks3-server[1042]: 2026/09/20 09:06:47 INFO Completed upload id=345174lb # [ 110.786481] niks3-server[1042]: 2026/09/20 09:06:47 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5175worker1 # [ 110.793766] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45168 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15176worker1 # [ 110.810055] nix-daemon[832]: reaped child process 1416, status = succeeded5177client # [ 110.847731] systemd[1]: rs.service: Deactivated successfully.5178client # [ 110.853198] systemd[1]: rs.service: Consumed 189ms CPU time over 8.783s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5179lb # [ 111.044327] envoy[923]: conn peer=[2001:db8:1::1]:37200 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1350 ms=84805180worker1 # [ 111.575376] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:48Z level=info event=signal_exit5181worker1 # [ 111.808400] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:48Z level=info event=scheduler_yield5182lb # [ 111.809399] niks3-server[1042]: 2026/09/20 09:06:48 INFO lead: released remote=192.168.1.3:443925183worker1 # [ 111.813396] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:48Z level=info event=scheduler_restarting addr=lb:500515184worker2 # [ 111.905030] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:48Z level=info event=scheduler_restarting addr=lb:500515185worker1 # [ 111.818838] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:372065186worker1 # [ 111.823463] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:48Z level=info event=worker_gone addr=192.168.1.4:500515187worker1 # [ 111.827506] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:372065188worker1 # [ 111.832033] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:48Z level=info event=worker_gone addr=192.168.1.3:500515189worker1 # [ 112.014363] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:48Z level=info event=scheduler_connected addr=lb:500515190worker2 # [ 112.105078] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:48Z level=info event=scheduler_connected addr=lb:500515191worker1 # [ 112.022075] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5192worker2 # [ 112.112333] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5193worker2 # [ 112.313463] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:48Z level=info event=scheduler_connected addr=lb:500515194worker1 # [ 112.223320] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:48Z level=info event=scheduler_connected addr=lb:500515195worker2 # [ 112.320915] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5196worker1 # [ 112.231828] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5197worker2 # [ 112.521980] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:49Z level=info event=scheduler_connected addr=lb:500515198worker1 # [ 112.433029] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:49Z level=info event=scheduler_connected addr=lb:500515199worker2 # [ 112.532955] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5200worker1 # [ 112.453141] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5201worker2 # [ 112.736110] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:49Z level=info event=scheduler_connected addr=lb:500515202worker2 # [ 112.742243] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5203worker1 # [ 112.654233] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:49Z level=info event=scheduler_connected addr=lb:500515204worker1 # [ 112.661657] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5205worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.22 seconds)5206client: waiting for success: ! systemctl is-active rs5207client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5208client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5209client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5210client: must fail: journalctl -u rs | grep -q 'reconnecting'5211worker1 # [ 112.815670] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:49Z level=info event=scheduler_restarting5212client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5213lb: must succeed: curl -sf localhost:9901/clusters5214worker1 # [ 112.844774] nix-daemon[832]: reaped child process 1267, status = succeeded5215worker2 # [ 112.943615] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:49Z level=info event=scheduler_connected addr=lb:500515216worker2 # [ 112.950740] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5217worker1 # [ 112.885339] nix-grpc-daemon[1201]: ts=2026-09-20T09:06:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5218lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5219worker2 # [ 113.151673] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:49Z level=info event=scheduler_connected addr=lb:500515220worker1 # [ 113.064042] nix-grpc-daemon[1201]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5221worker1 # [ 113.068533] nix-grpc-daemon[1201]: E0000 00:00:1789895209.682795 1244 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5222worker1 # [ 113.237002] nix-grpc-daemon[1201]: E0000 00:00:1789895209.855950 1244 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5223worker1 # [ 113.243597] nix-grpc-daemon[1201]: E0000 00:00:1789895209.856132 1244 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5224worker2 # [ 113.886953] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5225worker1 # [ 113.818136] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5226worker1 # [ 113.827251] systemd[1]: Stopped Nix worker-protocol over gRPC.5227worker1 # [ 113.831891] systemd[1]: nix-grpc-daemon.service: Consumed 1.824s CPU time over 27.471s wall clock time, 36.3M memory peak, 45.4K incoming IP traffic, 83.5K outgoing IP traffic.5228worker1 # [ 113.847133] systemd[1]: Starting Nix worker-protocol over gRPC...5229lb: must succeed: curl -sf localhost:9901/clusters5230worker2 # [ 114.091236] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:50Z level=info event=scheduler_connected addr=lb:500515231lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5232worker2 # [ 114.095603] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5233worker1 # [ 114.054367] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5234worker1 # [ 114.056882] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15235worker1 # [ 114.064621] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5236worker1 # [ 114.066502] systemd[1]: Started Nix worker-protocol over gRPC.5237worker1 # [ 114.078043] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:50Z level=info event=scheduler_take_over5238lb # [ 114.077266] niks3-server[1042]: 2026/09/20 09:06:50 INFO lead: acquired remote=192.168.1.3:439105239worker1 # [ 114.103314] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:50Z level=info event=scheduler_connected addr=lb:500515240worker1 # [ 114.114369] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:50Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05241worker2 # [ 114.292113] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:50Z level=info event=scheduler_connected addr=lb:500515242worker2 # [ 114.298889] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5243worker2 # [ 114.499976] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:51Z level=info event=scheduler_connected addr=lb:500515244worker1 # [ 114.412510] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05245lb: must succeed: curl -sf localhost:9901/clusters5246lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5247worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5248worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5249(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.18 seconds)5250subtest: scheduler restart mid-build: build finishes, no double build5251client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5252client # [ 115.253418] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5253client # Running as unit: mid.service; invocation ID: 3501c1f0d5cb487ea0d04db19db15d4c5254client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5255worker1 # [ 115.486287] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:423085256worker1 # [ 115.499420] nix-daemon[832]: accepted connection from pid 1468, user nix-grpc-daemon (trusted)5257client # [ 115.525081] nix[1210]: don't know how to build these paths:5258client # [ 115.526392] nix[1210]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5259worker1 # [ 115.529852] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:52Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05260worker1 # [ 115.536708] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:52Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15261worker1 # [ 115.582396] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423085262worker1 # [ 115.598673] nix-grpc-daemon[1468]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 1/5)5263worker1 # [ 115.678955] nix-grpc-daemon[1468]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 158 ms (attempt 2/5)5264worker1 # [ 115.844534] nix-grpc-daemon[1468]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 320 ms (attempt 3/5)5265worker1 # [ 116.172300] nix-grpc-daemon[1468]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 446 ms (attempt 4/5)5266worker1 # [ 116.621414] nix-grpc-daemon[1468]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5267worker1 # [ 116.642782] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423085268client # [ 116.668903] nix[1210]: copying 1 paths to 'lb:50051'...5269worker1 # [ 116.659666] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423085270client # [ 116.669201] nix[1210]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5271worker1 # [ 116.675522] nix-daemon[832]: accepted connection from pid 1468, user nix-grpc-daemon (trusted)5272worker1 # [ 116.703659] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:53Z level=info event=niks3_push_started pid=15395273worker1 # [ 117.086895] nix-daemon[832]: accepted connection from pid 1552, user nix-grpc-daemon (trusted)5274worker1 # [ 117.105902] nix-daemon[832]: reaped child process 1555, status = succeeded5275worker1 # [ 117.278653] nix-daemon[832]: accepted connection from pid 1557, user nix-grpc-daemon (trusted)5276worker1 # [ 117.295503] nix-daemon[832]: reaped child process 1560, status = succeeded5277lb # [ 117.306722] niks3-server[1042]: 2026/09/20 09:06:53 INFO Received uploads request method=POST path=/api/pending_closures5278worker1 # [ 117.320413] nix-grpc-daemon[1539]: time=2026-09-20T09:06:53.938Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5279worker1 # [ 117.321893] nix-grpc-daemon[1539]: time=2026-09-20T09:06:53.938Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5280lb # [ 117.345854] niks3-server[1042]: 2026/09/20 09:06:53 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5281worker1 # [ 117.358519] nix-grpc-daemon[1539]: time=2026-09-20T09:06:53.977Z level=INFO msg="Uploading 1 narinfos"5282lb # [ 117.355952] niks3-server[1042]: 2026/09/20 09:06:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5283lb # [ 117.366378] niks3-server[1042]: 2026/09/20 09:06:53 INFO Signed narinfos id=35 count=15284lb # [ 117.371064] niks3-server[1042]: 2026/09/20 09:06:54 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5285lb # [ 117.381906] niks3-server[1042]: 2026/09/20 09:06:54 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5286worker1 # [ 117.389678] nix-grpc-daemon[1539]: time=2026-09-20T09:06:54.008Z level=INFO msg="Upload complete. (474ms)"5287lb # [ 117.390182] niks3-server[1042]: 2026/09/20 09:06:54 INFO Completed upload id=355288worker1 # [ 117.398744] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42308 duration_s=0 paths=1 nar_bytes_in=4245289lb # [ 117.402998] niks3-server[1042]: 2026/09/20 09:06:54 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5290worker1 # [ 117.410842] nix-grpc-daemon[1468]: ts=2026-09-20T09:06:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423085291worker1 # [ 117.416601] nix-daemon[832]: accepted connection from pid 1468, user nix-grpc-daemon (trusted)5292worker1 # [ 117.421133] nix-daemon[832]: reaped child process 1537, status = succeeded5293client # [ 117.437637] nix[1210]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5294worker1 # [ 117.432859] nix-daemon[832]: accepted connection from pid 1468, user nix-grpc-daemon (trusted)5295lb: must succeed: curl -sf localhost:9901/clusters5296lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5297lb: must succeed: curl -sf localhost:9901/clusters5298lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5299worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5300worker1 # [ 119.258213] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1468 (nix-grpc-daemon) on client request.5301worker1 # [ 119.260897] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5302lb # [ 119.261284] niks3-server[1042]: 2026/09/20 09:06:55 INFO lead: released remote=192.168.1.3:439105303client # [ 119.269786] nix[1210]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5304worker2 # [ 119.351698] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5305worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5306client: must succeed: sleep 5.05307worker1 # [ 119.306010] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5308worker1 # [ 119.307845] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5309worker1 # [ 119.309282] systemd[1]: nix-grpc-daemon.service: Consumed 508ms CPU time over 5.451s wall clock time, 34M memory peak, 11.8K incoming IP traffic, 14.5K outgoing IP traffic.5310worker1 # [ 119.315115] nix-daemon[832]: reaped child process 1562, status = succeeded5311worker1 # [ 119.316479] nix-daemon[832]: reaped child process 1526, status = succeeded5312worker1 # [ 119.324430] nix-daemon[1564]: unexpected Nix daemon error: error: interrupted by the user5313worker1 # [ 119.330475] nix-daemon[832]: reaped child process 1564, status = failed with exit code 15314worker2 # [ 119.551653] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:56Z level=info event=scheduler_connected addr=lb:500515315worker1 # [ 119.465734] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5316worker1 # [ 119.478616] systemd[1]: Starting Nix worker-protocol over gRPC...5317worker1 # [ 119.685955] nix-grpc-daemon[1600]: ts=2026-09-20T09:06:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5318worker1 # [ 119.688356] nix-grpc-daemon[1600]: ts=2026-09-20T09:06:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15319worker1 # [ 119.696074] nix-grpc-daemon[1600]: ts=2026-09-20T09:06:56Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5320worker1 # [ 119.697828] systemd[1]: Started Nix worker-protocol over gRPC.5321worker1 # [ 119.709474] nix-grpc-daemon[1600]: ts=2026-09-20T09:06:56Z level=info event=scheduler_take_over5322lb # [ 119.707597] niks3-server[1042]: 2026/09/20 09:06:56 INFO lead: acquired remote=192.168.1.3:439665323worker1 # [ 119.724132] nix-grpc-daemon[1600]: ts=2026-09-20T09:06:56Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05324worker1 # [ 119.739236] nix-grpc-daemon[1600]: ts=2026-09-20T09:06:56Z level=info event=scheduler_connected addr=lb:500515325worker1 # [ 119.741180] nix-grpc-daemon[1600]: ts=2026-09-20T09:06:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05326worker1 # [ 119.769099] nix-grpc-daemon[1600]: ts=2026-09-20T09:06:56Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05327worker1 # [ 119.771316] nix-grpc-daemon[1600]: ts=2026-09-20T09:06:56Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15328worker2 # [ 119.904299] nix-grpc-daemon[1160]: ts=2026-09-20T09:06:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432925329worker2 # [ 119.922070] nix-grpc-daemon[1160]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 93 ms (attempt 1/5)5330client # [ 119.276334] nix[1210]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5331worker2 # [ 120.023184] nix-grpc-daemon[1160]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 158 ms (attempt 2/5)5332worker2 # [ 120.181679] nix-grpc-daemon[1160]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 262 ms (attempt 3/5)5333worker2 # [ 120.452813] nix-grpc-daemon[1160]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 793 ms (attempt 4/5)5334lb # [ 121.041619] envoy[923]: conn peer=[2001:db8:1::3]:51458 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3080 tx=1105 ms=262715335lb # [ 121.046824] envoy[923]: conn peer=[2001:db8:1::3]:45614 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=475 tx=226 ms=51645336worker2 # [ 121.254123] nix-grpc-daemon[1160]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5337worker2 # [ 121.274332] nix-grpc-daemon[1160]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5338worker2 # [ 121.307579] nix-daemon[835]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)5339client # [ 121.243704] nix[1210]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5340worker2 # [ 121.326828] nix-daemon[835]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)5341client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5342client: waiting for success: ! systemctl is-active mid5343worker2 # [ 124.964974] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:01Z level=info event=niks3_push_started pid=13135344worker2 # [ 125.006090] nix-daemon[835]: reaped child process 1289, status = succeeded5345worker2 # [ 125.368731] nix-daemon[835]: accepted connection from pid 1326, user nix-grpc-daemon (trusted)5346worker2 # [ 125.387548] nix-daemon[835]: reaped child process 1329, status = succeeded5347lb # [ 125.309094] niks3-server[1042]: 2026/09/20 09:07:01 INFO Received uploads request method=POST path=/api/pending_closures5348worker2 # [ 125.412434] nix-grpc-daemon[1313]: time=2026-09-20T09:07:02.038Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5349worker2 # [ 125.413942] nix-grpc-daemon[1313]: time=2026-09-20T09:07:02.038Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5350lb # [ 125.347023] niks3-server[1042]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5351lb # [ 125.359811] niks3-server[1042]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5352lb # [ 125.373081] niks3-server[1042]: 2026/09/20 09:07:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5353worker2 # [ 125.472098] nix-grpc-daemon[1313]: time=2026-09-20T09:07:02.099Z level=INFO msg="Uploading 1 narinfos"5354lb # [ 125.381305] niks3-server[1042]: 2026/09/20 09:07:02 INFO Signed narinfos id=36 count=15355lb # [ 125.401994] niks3-server[1042]: 2026/09/20 09:07:02 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5356worker2 # [ 125.501887] nix-grpc-daemon[1313]: time=2026-09-20T09:07:02.130Z level=INFO msg="Upload complete. (302ms)"5357lb # [ 125.415454] niks3-server[1042]: 2026/09/20 09:07:02 INFO Completed upload id=365358worker2 # [ 125.512261] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43292 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15359worker2 # [ 125.524774] nix-grpc-daemon[1313]: time=2026-09-20T09:07:02.146Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls error="server returned 404: object is not pending upload\n"5360worker2 # [ 125.532195] nix-grpc-daemon[1313]: time=2026-09-20T09:07:02.152Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5361worker2 # [ 125.537040] nix-daemon[835]: reaped child process 1287, status = succeeded5362client # [ 125.475415] systemd[1]: mid.service: Deactivated successfully.5363client # [ 125.479520] systemd[1]: mid.service: Consumed 162ms CPU time over 10.226s wall clock time, 39.2M memory peak, 9.6K incoming IP traffic, 10.7K outgoing IP traffic.5364client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5365client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5366client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5367(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.68 seconds)5368subtest: interrupting the client stops the build on the worker5369client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5370client # [ 125.908816] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5371client # Running as unit: intr.service; invocation ID: 4ebd9dbae1ad468dbf2cc97ace495cef5372client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5373worker2 # [ 126.211263] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:432925374client # [ 126.136239] nix[1246]: don't know how to build these paths:5375client # [ 126.137796] nix[1246]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5376worker1 # [ 126.144401] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:02Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05377worker1 # [ 126.149801] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:02Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15378worker1 # [ 126.194143] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165379worker1 # [ 126.209485] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5380worker1 # [ 126.232865] nix-grpc-daemon[1600]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 1/5)5381worker1 # [ 126.280797] nix-grpc-daemon[1600]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 2/5)5382worker1 # [ 126.353121] nix-grpc-daemon[1600]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 3/5)5383worker1 # [ 126.368490] nix-grpc-daemon[1600]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 105 ms (attempt 4/5)5384worker1 # [ 126.474351] nix-grpc-daemon[1600]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5385worker1 # [ 126.494561] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165386client # [ 126.516481] nix[1246]: copying 1 paths to 'lb:50051'...5387worker1 # [ 126.509977] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570165388client # [ 126.521306] nix[1246]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5389worker1 # [ 126.524280] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5390worker1 # [ 126.552825] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:03Z level=info event=niks3_push_started pid=16725391worker1 # [ 126.940346] nix-daemon[832]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)5392worker1 # [ 126.958039] nix-daemon[832]: reaped child process 1688, status = succeeded5393worker1 # [ 127.141925] nix-daemon[832]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)5394worker1 # [ 127.166784] nix-daemon[832]: reaped child process 1696, status = succeeded5395lb # [ 127.177905] niks3-server[1042]: 2026/09/20 09:07:03 INFO Received uploads request method=POST path=/api/pending_closures5396worker1 # [ 127.196610] nix-grpc-daemon[1672]: time=2026-09-20T09:07:03.814Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5397worker1 # [ 127.198120] nix-grpc-daemon[1672]: time=2026-09-20T09:07:03.814Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5398lb # [ 127.230343] niks3-server[1042]: 2026/09/20 09:07:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5399worker1 # [ 127.243525] nix-grpc-daemon[1672]: time=2026-09-20T09:07:03.862Z level=INFO msg="Uploading 1 narinfos"5400lb # [ 127.246456] niks3-server[1042]: 2026/09/20 09:07:03 INFO Signed narinfos id=37 count=15401lb # [ 127.254463] niks3-server[1042]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5402lb # [ 127.268257] niks3-server[1042]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5403lb # [ 127.271244] niks3-server[1042]: 2026/09/20 09:07:03 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5404worker1 # [ 127.276689] nix-grpc-daemon[1672]: time=2026-09-20T09:07:03.895Z level=INFO msg="Upload complete. (511ms)"5405lb # [ 127.275359] niks3-server[1042]: 2026/09/20 09:07:03 INFO Completed upload id=375406lb # [ 127.277652] niks3-server[1042]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5407worker1 # [ 127.284926] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=4245408worker1 # [ 127.298830] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165409worker1 # [ 127.305947] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5410worker1 # [ 127.310995] nix-daemon[832]: reaped child process 1670, status = succeeded5411client # [ 127.329547] nix[1246]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5412worker1 # [ 127.324172] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5413client: must succeed: systemctl kill -s INT intr5414client # [ 128.494512] systemd[1]: intr.service: Sent signal SIGINT to main process 1246 (nix) on client request.5415worker1 # [ 128.495261] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:05Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5416client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds)5417client # [ 128.504177] nix[1246]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5418client # [ 128.507981] nix[1246]: error: interrupted by the user5419client # [ 128.541977] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5420client # [ 128.544670] systemd[1]: intr.service: Failed with result 'exit-code'.5421client # [ 128.547765] systemd[1]: intr.service: Consumed 136ms CPU time over 2.635s wall clock time, 39.2M memory peak, 7.7K incoming IP traffic, 8.9K outgoing IP traffic.5422worker1 # [ 128.569132] nix-daemon[1701]: unexpected Nix daemon error: error: interrupted by the user5423worker1 # [ 128.572674] nix-daemon[832]: reaped child process 1699, status = succeeded5424worker1 # [ 128.580826] nix-daemon[832]: reaped child process 1701, status = failed with exit code 15425(finished: subtest: interrupting the client stops the build on the worker, in 2.80 seconds)5426subtest: a deploy mid-build drains: the build finishes, the new generation takes over5427client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5428client # [ 128.734985] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5429client # Running as unit: sw.service; invocation ID: 85600f9383d145dd9a5e403a2108a8125430client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5431worker2 # [ 129.054265] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:432925432client # [ 128.979693] nix[1266]: don't know how to build these paths:5433client # [ 128.980874] nix[1266]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5434worker1 # [ 128.980591] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:05Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05435worker1 # [ 128.987302] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:05Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15436worker2 # [ 129.124218] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432925437worker2 # [ 129.140120] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432925438client # [ 129.072169] nix[1266]: copying 1 paths to 'lb:50051'...5439worker2 # [ 129.154669] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432925440client # [ 129.074492] nix[1266]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5441worker2 # [ 129.171526] nix-daemon[835]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)5442worker2 # [ 129.381324] nix-daemon[835]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5443worker2 # [ 129.401642] nix-daemon[835]: reaped child process 1356, status = succeeded5444worker2 # [ 129.579607] nix-daemon[835]: accepted connection from pid 1358, user nix-grpc-daemon (trusted)5445worker2 # [ 129.596336] nix-daemon[835]: reaped child process 1361, status = succeeded5446lb # [ 129.519809] niks3-server[1042]: 2026/09/20 09:07:06 INFO Received uploads request method=POST path=/api/pending_closures5447worker2 # [ 129.622798] nix-grpc-daemon[1313]: time=2026-09-20T09:07:06.250Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5448worker2 # [ 129.624362] nix-grpc-daemon[1313]: time=2026-09-20T09:07:06.250Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5449lb # [ 129.549821] niks3-server[1042]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5450lb # [ 129.562859] niks3-server[1042]: 2026/09/20 09:07:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5451worker2 # [ 129.664642] nix-grpc-daemon[1313]: time=2026-09-20T09:07:06.292Z level=INFO msg="Uploading 1 narinfos"5452lb # [ 129.575785] niks3-server[1042]: 2026/09/20 09:07:06 INFO Signed narinfos id=38 count=15453lb # [ 129.581611] niks3-server[1042]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5454lb # [ 129.590538] niks3-server[1042]: 2026/09/20 09:07:06 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5455lb # [ 129.595514] niks3-server[1042]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5456lb # [ 129.599769] niks3-server[1042]: 2026/09/20 09:07:06 INFO Completed upload id=385457worker2 # [ 129.692520] nix-grpc-daemon[1313]: time=2026-09-20T09:07:06.320Z level=INFO msg="Upload complete. (503ms)"5458worker2 # [ 129.702246] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43292 duration_s=0 paths=1 nar_bytes_in=4165459worker2 # [ 129.715569] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432925460worker2 # [ 129.721958] nix-daemon[835]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)5461worker2 # [ 129.726520] nix-daemon[835]: reaped child process 1351, status = succeeded5462client # [ 129.654115] nix[1266]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5463worker2 # [ 129.739808] nix-daemon[835]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)5464lb # [ 131.042687] envoy[923]: conn peer=[2001:db8:1::1]:59972 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3854 tx=1684 ms=99585465lb # [ 131.047626] envoy[923]: conn peer=[2001:db8:1::1]:54450 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2957 tx=729 ms=23985466worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25467worker2 # Checking switch inhibitors... done5468worker2 # [ 132.327725] nixos[1396]: switching to system configuration /nix/store/gc2nh9hcwdf96y2b4sabb3shz4qv2p0r-nixos-system-worker2-test5469worker2 # [ 132.333407] systemd[1]: Stopped target Remote File Systems.5470worker2 # [ 132.335080] systemd[1]: Stopped target Local File Systems.5471worker2 # activating the configuration...5472worker2 # setting up /etc...5473worker2 # [ 133.131474] systemd[1]: Reload requested from client PID 1396 ('.switch-to-conf') (unit backdoor.service)...5474worker2 # [ 133.133981] systemd[1]: Reloading...5475worker2 # [ 134.024366] systemd[1]: Reloading finished in 887 ms.5476worker2 # restarting sysinit-reactivation.target5477worker2 # [ 134.101880] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5478worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5479worker2 # [ 134.264963] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5480worker2 # [ 134.266088] systemd[1]: Reached target Reactivate sysinit units.5481worker2 # [ 134.273537] systemd[1]: Reloading D-Bus System Message Bus...5482worker2 # [ 134.274771] dbus-broker-launch[498]: Caught SIGHUP, trigger reload.5483worker2 # [ 134.277552] systemd[1]: Reloading Nix worker-protocol over gRPC...5484worker2 # [ 134.299703] dbus-broker-launch[498]: Looking up NSS user entry for 'systemd-timesync'...5485worker2 # [ 134.302891] dbus-broker-launch[498]: NSS returned no entry for 'systemd-timesync'5486worker2 # [ 134.304788] dbus-broker-launch[498]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5487worker2 # [ 134.339410] systemd[1]: Reloaded Nix worker-protocol over gRPC.5488worker2 # [ 134.349685] systemd[1]: Reloaded D-Bus System Message Bus.5489worker2 # [ 134.352228] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5490worker2 # [ 134.353502] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5491worker2 # [ 134.360318] systemd[1]: Reached target Local File Systems.5492worker2 # [ 134.372229] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5493worker2 # [ 134.373672] systemd[1]: Starting Create SUID/SGID Wrappers...5494worker2 # [ 134.380125] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5495worker2 # [ 134.384382] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675496worker2 # [ 134.386510] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5497worker2 # [ 134.392667] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5498worker2 # [ 134.395370] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5499worker2 # [ 134.399377] systemd[1]: Reached target Remote File Systems.5500worker2 # [ 134.629574] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:11Z level=info event=draining5501worker2 # [ 134.889129] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5502worker2 # [ 134.890242] systemd[1]: Finished Create SUID/SGID Wrappers.5503worker2 # [ 134.893423] systemd[1]: Starting linger-users.service...5504worker2 # [ 134.951051] systemd[1]: linger-users.service: Deactivated successfully.5505worker2 # [ 134.956159] systemd[1]: Finished linger-users.service.5506worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5507worker2 # [ 135.210001] nixos[1396]: finished switching to system configuration /nix/store/gc2nh9hcwdf96y2b4sabb3shz4qv2p0r-nixos-system-worker2-test5508worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.73 seconds)5509worker2: must succeed: pgrep -f 'read -t [9]0 x'5510worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5511client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25512client # don't know how to build these paths:5513client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5514worker1 # [ 135.446431] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:570165515worker1 # [ 135.455490] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165516worker1 # [ 135.478364] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:12Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05517worker1 # [ 135.485327] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:12Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15518worker1 # [ 135.534969] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165519worker1 # [ 135.549716] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165520client # copying 1 paths to 'lb:50051'...5521worker1 # [ 135.565987] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570165522client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5523worker1 # [ 135.589265] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5524worker1 # [ 135.793623] nix-daemon[832]: accepted connection from pid 1747, user nix-grpc-daemon (trusted)5525worker1 # [ 135.811951] nix-daemon[832]: reaped child process 1750, status = succeeded5526worker1 # [ 135.989999] nix-daemon[832]: accepted connection from pid 1752, user nix-grpc-daemon (trusted)5527worker1 # [ 136.006923] nix-daemon[832]: reaped child process 1755, status = succeeded5528lb # [ 136.018610] niks3-server[1042]: 2026/09/20 09:07:12 INFO Received uploads request method=POST path=/api/pending_closures5529worker1 # [ 136.031650] nix-grpc-daemon[1672]: time=2026-09-20T09:07:12.650Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5530worker1 # [ 136.033328] nix-grpc-daemon[1672]: time=2026-09-20T09:07:12.650Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5531lb # [ 136.047285] niks3-server[1042]: 2026/09/20 09:07:12 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5532worker1 # [ 136.063045] nix-grpc-daemon[1672]: time=2026-09-20T09:07:12.681Z level=INFO msg="Uploading 1 narinfos"5533lb # [ 136.061379] niks3-server[1042]: 2026/09/20 09:07:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5534lb # [ 136.075422] niks3-server[1042]: 2026/09/20 09:07:12 INFO Signed narinfos id=39 count=15535lb # [ 136.081491] niks3-server[1042]: 2026/09/20 09:07:12 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5536lb # [ 136.088080] niks3-server[1042]: 2026/09/20 09:07:12 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5537lb # [ 136.094365] niks3-server[1042]: 2026/09/20 09:07:12 INFO Completed upload id=395538worker1 # [ 136.096366] nix-grpc-daemon[1672]: time=2026-09-20T09:07:12.715Z level=INFO msg="Upload complete. (488ms)"5539lb # [ 136.096822] niks3-server[1042]: 2026/09/20 09:07:12 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5540worker1 # [ 136.104271] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=5285541worker1 # [ 136.112634] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165542worker1 # [ 136.122770] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5543worker1 # [ 136.127508] nix-daemon[832]: reaped child process 1745, status = succeeded5544client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5545worker1 # [ 136.138670] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5546client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5547client # farm-a> LOG-farm-a-during-drain5548worker1 # [ 137.788278] nix-daemon[832]: reaped child process 1759, status = succeeded5549worker1 # [ 137.964538] nix-daemon[832]: accepted connection from pid 1774, user nix-grpc-daemon (trusted)5550worker1 # [ 137.981849] nix-daemon[832]: reaped child process 1777, status = succeeded5551lb # [ 137.994337] niks3-server[1042]: 2026/09/20 09:07:14 INFO Received uploads request method=POST path=/api/pending_closures5552worker1 # [ 138.007500] nix-grpc-daemon[1672]: time=2026-09-20T09:07:14.624Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5553worker1 # [ 138.012246] nix-grpc-daemon[1672]: time=2026-09-20T09:07:14.624Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5554lb # [ 138.030746] niks3-server[1042]: 2026/09/20 09:07:14 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5555lb # [ 138.043010] niks3-server[1042]: 2026/09/20 09:07:14 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5556lb # [ 138.057963] niks3-server[1042]: 2026/09/20 09:07:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5557worker1 # [ 138.068170] nix-grpc-daemon[1672]: time=2026-09-20T09:07:14.685Z level=INFO msg="Uploading 1 narinfos"5558lb # [ 138.070580] niks3-server[1042]: 2026/09/20 09:07:14 INFO Signed narinfos id=40 count=15559lb # [ 138.077075] niks3-server[1042]: 2026/09/20 09:07:14 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5560lb # [ 138.084215] niks3-server[1042]: 2026/09/20 09:07:14 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5561lb # [ 138.092408] niks3-server[1042]: 2026/09/20 09:07:14 INFO Completed upload id=405562worker1 # [ 138.093708] nix-grpc-daemon[1672]: time=2026-09-20T09:07:14.712Z level=INFO msg="Upload complete. (342ms)"5563lb # [ 138.095382] niks3-server[1042]: 2026/09/20 09:07:14 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5564worker1 # [ 138.111465] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15565worker1 # [ 138.128423] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:14Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05566worker1 # [ 138.133813] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:14Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15567worker1 # [ 138.138208] nix-daemon[832]: reaped child process 1757, status = succeeded5568worker1 # [ 138.154389] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165569worker1 # [ 138.169254] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165570worker1 # [ 138.183889] nix-grpc-daemon[1672]: time=2026-09-20T09:07:14.802Z level=INFO msg="All 1 paths already cached"5571client # copying 1 paths to 'lb:50051'...5572worker1 # [ 138.193691] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570165573client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5574worker1 # [ 138.217248] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5575worker1 # [ 138.423203] nix-daemon[832]: accepted connection from pid 1783, user nix-grpc-daemon (trusted)5576worker1 # [ 138.442473] nix-daemon[832]: reaped child process 1786, status = succeeded5577worker1 # [ 138.617369] nix-daemon[832]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)5578worker1 # [ 138.634510] nix-daemon[832]: reaped child process 1791, status = succeeded5579lb # [ 138.643727] niks3-server[1042]: 2026/09/20 09:07:15 INFO Received uploads request method=POST path=/api/pending_closures5580worker1 # [ 138.658237] nix-grpc-daemon[1672]: time=2026-09-20T09:07:15.276Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5581worker1 # [ 138.659732] nix-grpc-daemon[1672]: time=2026-09-20T09:07:15.277Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5582lb # [ 138.686586] niks3-server[1042]: 2026/09/20 09:07:15 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5583worker1 # [ 138.700879] nix-grpc-daemon[1672]: time=2026-09-20T09:07:15.319Z level=INFO msg="Uploading 1 narinfos"5584lb # [ 138.703700] niks3-server[1042]: 2026/09/20 09:07:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5585lb # [ 138.712676] niks3-server[1042]: 2026/09/20 09:07:15 INFO Signed narinfos id=41 count=15586lb # [ 138.715427] niks3-server[1042]: 2026/09/20 09:07:15 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5587lb # [ 138.722782] niks3-server[1042]: 2026/09/20 09:07:15 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5588lb # [ 138.730815] niks3-server[1042]: 2026/09/20 09:07:15 INFO Completed upload id=415589worker1 # [ 138.732869] nix-grpc-daemon[1672]: time=2026-09-20T09:07:15.351Z level=INFO msg="Upload complete. (498ms)"5590lb # [ 138.733734] niks3-server[1042]: 2026/09/20 09:07:15 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5591worker1 # [ 138.743064] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=6405592worker1 # [ 138.757984] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165593worker1 # [ 138.764150] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5594worker1 # [ 138.769073] nix-daemon[832]: reaped child process 1781, status = succeeded5595client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5596client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5597worker1 # [ 138.783264] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5598client # farm-b> LOG-farm-b-during-drain5599worker1 # [ 140.216185] nix-daemon[832]: reaped child process 1795, status = succeeded5600worker1 # [ 140.380173] nix-daemon[832]: accepted connection from pid 1810, user nix-grpc-daemon (trusted)5601worker1 # [ 140.399186] nix-daemon[832]: reaped child process 1813, status = succeeded5602lb # [ 140.409680] niks3-server[1042]: 2026/09/20 09:07:17 INFO Received uploads request method=POST path=/api/pending_closures5603worker1 # [ 140.422572] nix-grpc-daemon[1672]: time=2026-09-20T09:07:17.041Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5604worker1 # [ 140.425059] nix-grpc-daemon[1672]: time=2026-09-20T09:07:17.043Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5605lb # [ 140.448233] niks3-server[1042]: 2026/09/20 09:07:17 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5606lb # [ 140.462925] niks3-server[1042]: 2026/09/20 09:07:17 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5607lb # [ 140.470448] niks3-server[1042]: 2026/09/20 09:07:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5608worker1 # [ 140.477113] nix-grpc-daemon[1672]: time=2026-09-20T09:07:17.095Z level=INFO msg="Uploading 1 narinfos"5609lb # [ 140.478709] niks3-server[1042]: 2026/09/20 09:07:17 INFO Signed narinfos id=42 count=15610lb # [ 140.483916] niks3-server[1042]: 2026/09/20 09:07:17 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5611lb # [ 140.491703] niks3-server[1042]: 2026/09/20 09:07:17 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5612lb # [ 140.497797] niks3-server[1042]: 2026/09/20 09:07:17 INFO Completed upload id=425613worker1 # [ 140.499982] nix-grpc-daemon[1672]: time=2026-09-20T09:07:17.119Z level=INFO msg="Upload complete. (305ms)"5614lb # [ 140.501351] niks3-server[1042]: 2026/09/20 09:07:17 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5615worker1 # [ 140.516613] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15616worker1 # [ 140.531686] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:17Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05617worker1 # [ 140.535599] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:17Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15618worker1 # [ 140.539536] nix-daemon[832]: reaped child process 1793, status = succeeded5619worker1 # [ 140.562155] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165620worker1 # [ 140.577723] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165621worker1 # [ 140.591625] nix-grpc-daemon[1672]: time=2026-09-20T09:07:17.210Z level=INFO msg="All 2 paths already cached"5622client # copying 1 paths to 'lb:50051'...5623worker1 # [ 140.601676] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570165624client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5625worker1 # [ 140.624753] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5626worker1 # [ 140.827954] nix-daemon[832]: accepted connection from pid 1819, user nix-grpc-daemon (trusted)5627worker1 # [ 140.844481] nix-daemon[832]: reaped child process 1822, status = succeeded5628worker1 # [ 141.020873] nix-daemon[832]: accepted connection from pid 1824, user nix-grpc-daemon (trusted)5629worker1 # [ 141.037414] nix-daemon[832]: reaped child process 1827, status = succeeded5630lb # [ 141.048458] niks3-server[1042]: 2026/09/20 09:07:17 INFO Received uploads request method=POST path=/api/pending_closures5631worker1 # [ 141.059484] nix-grpc-daemon[1672]: time=2026-09-20T09:07:17.678Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5632worker1 # [ 141.061135] nix-grpc-daemon[1672]: time=2026-09-20T09:07:17.678Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5633lb # [ 141.078642] niks3-server[1042]: 2026/09/20 09:07:17 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5634lb # [ 141.088801] niks3-server[1042]: 2026/09/20 09:07:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5635worker1 # [ 141.097509] nix-grpc-daemon[1672]: time=2026-09-20T09:07:17.716Z level=INFO msg="Uploading 1 narinfos"5636lb # [ 141.100472] niks3-server[1042]: 2026/09/20 09:07:17 INFO Signed narinfos id=43 count=15637lb # [ 141.103696] niks3-server[1042]: 2026/09/20 09:07:17 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5638lb # [ 141.114510] niks3-server[1042]: 2026/09/20 09:07:17 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5639worker1 # [ 141.122933] nix-grpc-daemon[1672]: time=2026-09-20T09:07:17.742Z level=INFO msg="Upload complete. (480ms)"5640lb # [ 141.122335] niks3-server[1042]: 2026/09/20 09:07:17 INFO Completed upload id=435641lb # [ 141.125931] niks3-server[1042]: 2026/09/20 09:07:17 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5642worker1 # [ 141.132903] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=7685643worker1 # [ 141.143470] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165644worker1 # [ 141.149292] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5645worker1 # [ 141.153881] nix-daemon[832]: reaped child process 1817, status = succeeded5646client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5647client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5648worker1 # [ 141.166731] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5649client # farm-top> LOG-farm-top-during-drain5650worker1 # [ 142.608831] nix-daemon[832]: reaped child process 1831, status = succeeded5651worker1 # [ 142.792103] nix-daemon[832]: accepted connection from pid 1846, user nix-grpc-daemon (trusted)5652worker1 # [ 142.811151] nix-daemon[832]: reaped child process 1849, status = succeeded5653lb # [ 142.821866] niks3-server[1042]: 2026/09/20 09:07:19 INFO Received uploads request method=POST path=/api/pending_closures5654worker1 # [ 142.834189] nix-grpc-daemon[1672]: time=2026-09-20T09:07:19.453Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5655worker1 # [ 142.837410] nix-grpc-daemon[1672]: time=2026-09-20T09:07:19.455Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5656lb # [ 142.860613] niks3-server[1042]: 2026/09/20 09:07:19 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5657lb # [ 142.874520] niks3-server[1042]: 2026/09/20 09:07:19 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5658lb # [ 142.882674] niks3-server[1042]: 2026/09/20 09:07:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5659worker1 # [ 142.889969] nix-grpc-daemon[1672]: time=2026-09-20T09:07:19.508Z level=INFO msg="Uploading 1 narinfos"5660lb # [ 142.892370] niks3-server[1042]: 2026/09/20 09:07:19 INFO Signed narinfos id=44 count=15661lb # [ 142.894888] niks3-server[1042]: 2026/09/20 09:07:19 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5662lb # [ 142.905424] niks3-server[1042]: 2026/09/20 09:07:19 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5663lb # [ 142.912069] niks3-server[1042]: 2026/09/20 09:07:19 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5664lb # [ 142.917759] niks3-server[1042]: 2026/09/20 09:07:19 INFO Completed upload id=445665worker1 # [ 142.919892] nix-grpc-daemon[1672]: time=2026-09-20T09:07:19.538Z level=INFO msg="Upload complete. (338ms)"5666worker1 # [ 142.933561] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15667worker1 # [ 142.950543] nix-daemon[832]: reaped child process 1829, status = succeeded5668client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 7.79 seconds)5669client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5670client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5671worker2: must succeed: pkill -f 'read -t [9]0 x'5672worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5673client: waiting for success: ! systemctl is-active sw5674worker2 # [ 143.602797] nix-daemon[835]: reaped child process 1365, status = succeeded5675worker2 # [ 143.790266] nix-daemon[835]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5676worker2 # [ 143.809973] nix-daemon[835]: reaped child process 1539, status = succeeded5677lb # [ 143.730737] niks3-server[1042]: 2026/09/20 09:07:20 INFO Received uploads request method=POST path=/api/pending_closures5678worker2 # [ 143.833649] nix-grpc-daemon[1313]: time=2026-09-20T09:07:20.461Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5679worker2 # [ 143.835213] nix-grpc-daemon[1313]: time=2026-09-20T09:07:20.461Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5680lb # [ 143.765161] niks3-server[1042]: 2026/09/20 09:07:20 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5681lb # [ 143.779109] niks3-server[1042]: 2026/09/20 09:07:20 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5682lb # [ 143.788309] niks3-server[1042]: 2026/09/20 09:07:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5683worker2 # [ 143.887651] nix-grpc-daemon[1313]: time=2026-09-20T09:07:20.514Z level=INFO msg="Uploading 1 narinfos"5684lb # [ 143.794406] niks3-server[1042]: 2026/09/20 09:07:20 INFO Signed narinfos id=45 count=15685lb # [ 143.800197] niks3-server[1042]: 2026/09/20 09:07:20 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5686lb # [ 143.809102] niks3-server[1042]: 2026/09/20 09:07:20 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5687worker2 # [ 143.905824] nix-grpc-daemon[1313]: time=2026-09-20T09:07:20.534Z level=INFO msg="Upload complete. (340ms)"5688lb # [ 143.816152] niks3-server[1042]: 2026/09/20 09:07:20 INFO Completed upload id=455689lb # [ 143.820240] niks3-server[1042]: 2026/09/20 09:07:20 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5690worker2 # [ 143.917196] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43292 duration_s=14 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15691worker2 # [ 143.935158] nix-daemon[835]: reaped child process 1363, status = succeeded5692client # [ 143.874089] systemd[1]: sw.service: Deactivated successfully.5693client # [ 143.879545] systemd[1]: sw.service: Consumed 161ms CPU time over 15.142s wall clock time, 39M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5694client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds)5695client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5696client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)5697worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5698worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.07 seconds)5699lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5700lb: must succeed: curl -sf localhost:9901/clusters5701worker2 # [ 144.632537] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:21Z level=info event=signal_exit5702lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5703lb: must succeed: curl -sf localhost:9901/clusters5704lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5705worker1 # [ 145.784507] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:423245706worker1 # [ 145.784862] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:22Z level=info event=worker_gone addr=192.168.1.4:500515707worker2 # [ 145.883303] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:22Z level=info event=scheduler_restarting5708worker2 # [ 145.899369] nix-grpc-daemon[1160]: ts=2026-09-20T09:07:22Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5709worker2 # [ 145.922011] nix-daemon[835]: reaped child process 1218, status = succeeded5710worker2 # [ 146.161259] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5711worker2 # [ 146.167016] systemd[1]: nix-grpc-daemon.service: Consumed 973ms CPU time over 44.758s wall clock time, 33.5M memory peak, 23.6K incoming IP traffic, 32.7K outgoing IP traffic.5712worker2 # [ 146.744726] systemd[1]: Starting Nix worker-protocol over gRPC...5713lb: must succeed: curl -sf localhost:9901/clusters5714lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5715worker2 # [ 146.961766] nix-grpc-daemon[1551]: ts=2026-09-20T09:07:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5716worker2 # [ 146.964223] nix-grpc-daemon[1551]: ts=2026-09-20T09:07:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15717worker2 # [ 146.971853] nix-grpc-daemon[1551]: ts=2026-09-20T09:07:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5718worker2 # [ 146.982313] systemd[1]: Started Nix worker-protocol over gRPC.5719worker2 # [ 147.015314] nix-grpc-daemon[1551]: ts=2026-09-20T09:07:23Z level=info event=scheduler_connected addr=lb:500515720worker1 # [ 146.928357] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:23Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05721lb: must succeed: curl -sf localhost:9901/clusters5722lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5723lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 3.32 seconds)5724lb: must succeed: curl -sf localhost:9901/clusters5725lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5726worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5727worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5728(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 19.33 seconds)5729subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5730client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15731worker1 # [ 148.233901] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:570165732worker1 # [ 148.241866] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165733worker1 # [ 148.287097] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:24Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05734worker1 # [ 148.294157] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:24Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15735worker1 # [ 148.300250] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:24Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05736worker1 # [ 148.305342] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:24Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05737worker1 # [ 148.335301] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165738worker1 # [ 148.351071] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165739worker1 # [ 148.365457] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570165740worker1 # [ 148.380394] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5741worker1 # [ 148.583525] nix-daemon[832]: accepted connection from pid 1860, user nix-grpc-daemon (trusted)5742worker1 # [ 148.603220] nix-daemon[832]: reaped child process 1863, status = succeeded5743worker1 # [ 148.777521] nix-daemon[832]: accepted connection from pid 1865, user nix-grpc-daemon (trusted)5744worker1 # [ 148.794287] nix-daemon[832]: reaped child process 1868, status = succeeded5745lb # [ 148.805889] niks3-server[1042]: 2026/09/20 09:07:25 INFO Received uploads request method=POST path=/api/pending_closures5746worker1 # [ 148.816331] nix-grpc-daemon[1672]: time=2026-09-20T09:07:25.434Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5747worker1 # [ 148.817800] nix-grpc-daemon[1672]: time=2026-09-20T09:07:25.434Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5748lb # [ 148.832683] niks3-server[1042]: 2026/09/20 09:07:25 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5749lb # [ 148.845634] niks3-server[1042]: 2026/09/20 09:07:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5750worker1 # [ 148.854481] nix-grpc-daemon[1672]: time=2026-09-20T09:07:25.473Z level=INFO msg="Uploading 1 narinfos"5751lb # [ 148.859324] niks3-server[1042]: 2026/09/20 09:07:25 INFO Signed narinfos id=46 count=15752lb # [ 148.864748] niks3-server[1042]: 2026/09/20 09:07:25 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5753lb # [ 148.871653] niks3-server[1042]: 2026/09/20 09:07:25 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5754lb # [ 148.878507] niks3-server[1042]: 2026/09/20 09:07:25 INFO Completed upload id=465755worker1 # [ 148.880621] nix-grpc-daemon[1672]: time=2026-09-20T09:07:25.499Z level=INFO msg="Upload complete. (482ms)"5756lb # [ 148.881356] niks3-server[1042]: 2026/09/20 09:07:25 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5757worker1 # [ 148.888135] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=5125758worker1 # [ 148.902026] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165759worker1 # [ 148.908252] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5760worker1 # [ 148.913031] nix-daemon[832]: reaped child process 1858, status = succeeded5761worker1 # [ 148.926428] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5762worker1 # [ 150.372470] nix-daemon[832]: reaped child process 1872, status = succeeded5763worker1 # [ 150.550083] nix-daemon[832]: accepted connection from pid 1887, user nix-grpc-daemon (trusted)5764worker1 # [ 150.569145] nix-daemon[832]: reaped child process 1890, status = succeeded5765lb # [ 150.579674] niks3-server[1042]: 2026/09/20 09:07:27 INFO Received uploads request method=POST path=/api/pending_closures5766worker1 # [ 150.592396] nix-grpc-daemon[1672]: time=2026-09-20T09:07:27.210Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5767worker1 # [ 150.593865] nix-grpc-daemon[1672]: time=2026-09-20T09:07:27.211Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5768lb # [ 150.623414] niks3-server[1042]: 2026/09/20 09:07:27 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5769lb # [ 150.636066] niks3-server[1042]: 2026/09/20 09:07:27 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5770worker1 # [ 150.647935] nix-grpc-daemon[1672]: time=2026-09-20T09:07:27.266Z level=INFO msg="Uploading 1 narinfos"5771lb # [ 150.645753] niks3-server[1042]: 2026/09/20 09:07:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5772lb # [ 150.655027] niks3-server[1042]: 2026/09/20 09:07:27 INFO Signed narinfos id=47 count=15773lb # [ 150.660733] niks3-server[1042]: 2026/09/20 09:07:27 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5774worker1 # [ 150.669705] nix-grpc-daemon[1672]: time=2026-09-20T09:07:27.288Z level=INFO msg="Upload complete. (332ms)"5775lb # [ 150.669170] niks3-server[1042]: 2026/09/20 09:07:27 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5776lb # [ 150.674850] niks3-server[1042]: 2026/09/20 09:07:27 INFO Completed upload id=475777lb # [ 150.677991] niks3-server[1042]: 2026/09/20 09:07:27 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5778worker1 # [ 150.685578] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15779worker1 # [ 150.705682] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:27Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15780worker1 # [ 150.710932] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:27Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05781worker1 # [ 150.717160] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165782worker1 # [ 150.722674] nix-daemon[832]: reaped child process 1870, status = succeeded5783worker1 # [ 150.726138] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165784worker1 # [ 150.732294] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570165785worker1 # [ 150.746141] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5786worker1 # [ 150.927069] nix-daemon[832]: accepted connection from pid 1896, user nix-grpc-daemon (trusted)5787worker1 # [ 150.945330] nix-daemon[832]: reaped child process 1899, status = succeeded5788lb # [ 151.044692] envoy[923]: conn peer=[2001:db8:1::1]:52298 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9668 tx=3877 ms=75005789lb # [ 151.049738] envoy[923]: conn peer=[2001:db8:1::1]:54458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=1328 ms=148775790lb # [ 151.054729] envoy[923]: conn peer=[2001:db8:1::4]:59072 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2202 tx=866 ms=442265791worker1 # [ 151.119507] nix-daemon[832]: accepted connection from pid 1901, user nix-grpc-daemon (trusted)5792worker1 # [ 151.134966] nix-daemon[832]: reaped child process 1904, status = succeeded5793lb # [ 151.148789] niks3-server[1042]: 2026/09/20 09:07:27 INFO Received uploads request method=POST path=/api/pending_closures5794worker1 # [ 151.159172] nix-grpc-daemon[1672]: time=2026-09-20T09:07:27.778Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5795worker1 # [ 151.160825] nix-grpc-daemon[1672]: time=2026-09-20T09:07:27.778Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5796lb # [ 151.176660] niks3-server[1042]: 2026/09/20 09:07:27 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5797worker1 # [ 151.190689] nix-grpc-daemon[1672]: time=2026-09-20T09:07:27.809Z level=INFO msg="Uploading 1 narinfos"5798lb # [ 151.190061] niks3-server[1042]: 2026/09/20 09:07:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5799lb # [ 151.199807] niks3-server[1042]: 2026/09/20 09:07:27 INFO Signed narinfos id=48 count=15800lb # [ 151.211485] niks3-server[1042]: 2026/09/20 09:07:27 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5801worker1 # [ 151.219392] nix-grpc-daemon[1672]: time=2026-09-20T09:07:27.838Z level=INFO msg="Upload complete. (468ms)"5802lb # [ 151.218227] niks3-server[1042]: 2026/09/20 09:07:27 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5803lb # [ 151.223132] niks3-server[1042]: 2026/09/20 09:07:27 INFO Completed upload id=485804worker1 # [ 151.228207] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=5125805lb # [ 151.226118] niks3-server[1042]: 2026/09/20 09:07:27 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5806worker1 # [ 151.237594] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165807worker1 # [ 151.244655] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5808worker1 # [ 151.249536] nix-daemon[832]: reaped child process 1894, status = succeeded5809worker1 # [ 151.262875] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5810worker1 # [ 152.504719] nix-daemon[832]: reaped child process 1908, status = succeeded5811worker1 # [ 152.691757] nix-daemon[832]: accepted connection from pid 1923, user nix-grpc-daemon (trusted)5812worker1 # [ 152.711223] nix-daemon[832]: reaped child process 1926, status = succeeded5813lb # [ 152.721664] niks3-server[1042]: 2026/09/20 09:07:29 INFO Received uploads request method=POST path=/api/pending_closures5814worker1 # [ 152.736470] nix-grpc-daemon[1672]: time=2026-09-20T09:07:29.354Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5815worker1 # [ 152.738346] nix-grpc-daemon[1672]: time=2026-09-20T09:07:29.354Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5816lb # [ 152.776927] niks3-server[1042]: 2026/09/20 09:07:29 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5817lb # [ 152.787190] niks3-server[1042]: 2026/09/20 09:07:29 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5818lb # [ 152.794915] niks3-server[1042]: 2026/09/20 09:07:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5819lb # [ 152.801626] niks3-server[1042]: 2026/09/20 09:07:29 INFO Signed narinfos id=49 count=15820worker1 # [ 152.804111] nix-grpc-daemon[1672]: time=2026-09-20T09:07:29.422Z level=INFO msg="Uploading 1 narinfos"5821lb # [ 152.806104] niks3-server[1042]: 2026/09/20 09:07:29 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5822lb # [ 152.815382] niks3-server[1042]: 2026/09/20 09:07:29 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5823worker1 # [ 152.823664] nix-grpc-daemon[1672]: time=2026-09-20T09:07:29.442Z level=INFO msg="Upload complete. (351ms)"5824lb # [ 152.822499] niks3-server[1042]: 2026/09/20 09:07:29 INFO Completed upload id=495825lb # [ 152.825944] niks3-server[1042]: 2026/09/20 09:07:29 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5826worker1 # [ 152.842392] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15827worker1 # [ 152.865503] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:29Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15828worker1 # [ 152.869570] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165829worker1 # [ 152.873753] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:29Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05830worker1 # [ 152.878075] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165831worker1 # [ 152.882778] nix-daemon[832]: reaped child process 1906, status = succeeded5832worker1 # [ 152.885353] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570165833worker1 # [ 152.893848] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5834worker1 # [ 153.090275] nix-daemon[832]: accepted connection from pid 1932, user nix-grpc-daemon (trusted)5835worker1 # [ 153.109240] nix-daemon[832]: reaped child process 1935, status = succeeded5836worker1 # [ 153.287447] nix-daemon[832]: accepted connection from pid 1937, user nix-grpc-daemon (trusted)5837worker1 # [ 153.306304] nix-daemon[832]: reaped child process 1940, status = succeeded5838lb # [ 153.315477] niks3-server[1042]: 2026/09/20 09:07:29 INFO Received uploads request method=POST path=/api/pending_closures5839worker1 # [ 153.326649] nix-grpc-daemon[1672]: time=2026-09-20T09:07:29.945Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5840worker1 # [ 153.328230] nix-grpc-daemon[1672]: time=2026-09-20T09:07:29.945Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5841lb # [ 153.344444] niks3-server[1042]: 2026/09/20 09:07:29 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5842lb # [ 153.356747] niks3-server[1042]: 2026/09/20 09:07:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5843worker1 # [ 153.365203] nix-grpc-daemon[1672]: time=2026-09-20T09:07:29.984Z level=INFO msg="Uploading 1 narinfos"5844lb # [ 153.366948] niks3-server[1042]: 2026/09/20 09:07:30 INFO Signed narinfos id=50 count=15845lb # [ 153.373350] niks3-server[1042]: 2026/09/20 09:07:30 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5846lb # [ 153.381665] niks3-server[1042]: 2026/09/20 09:07:30 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5847lb # [ 153.387633] niks3-server[1042]: 2026/09/20 09:07:30 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5848lb # [ 153.392880] niks3-server[1042]: 2026/09/20 09:07:30 INFO Completed upload id=505849worker1 # [ 153.395020] nix-grpc-daemon[1672]: time=2026-09-20T09:07:30.014Z level=INFO msg="Upload complete. (491ms)"5850worker1 # [ 153.402624] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=5125851worker1 # [ 153.415039] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165852worker1 # [ 153.424720] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5853worker1 # [ 153.428320] nix-daemon[832]: reaped child process 1930, status = succeeded5854worker1 # [ 153.438504] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5855worker1 # [ 154.886399] nix-daemon[832]: reaped child process 1944, status = succeeded5856worker1 # [ 155.071860] nix-daemon[832]: accepted connection from pid 1959, user nix-grpc-daemon (trusted)5857worker1 # [ 155.090864] nix-daemon[832]: reaped child process 1962, status = succeeded5858lb # [ 155.102597] niks3-server[1042]: 2026/09/20 09:07:31 INFO Received uploads request method=POST path=/api/pending_closures5859worker1 # [ 155.115379] nix-grpc-daemon[1672]: time=2026-09-20T09:07:31.733Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5860worker1 # [ 155.117047] nix-grpc-daemon[1672]: time=2026-09-20T09:07:31.733Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5861lb # [ 155.143528] niks3-server[1042]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5862lb # [ 155.158687] niks3-server[1042]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5863worker1 # [ 155.168610] nix-grpc-daemon[1672]: time=2026-09-20T09:07:31.787Z level=INFO msg="Uploading 1 narinfos"5864lb # [ 155.170499] niks3-server[1042]: 2026/09/20 09:07:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5865lb # [ 155.178367] niks3-server[1042]: 2026/09/20 09:07:31 INFO Signed narinfos id=51 count=15866lb # [ 155.185755] niks3-server[1042]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5867worker1 # [ 155.187347] nix-grpc-daemon[1672]: time=2026-09-20T09:07:31.806Z level=INFO msg="Upload complete. (339ms)"5868lb # [ 155.189095] niks3-server[1042]: 2026/09/20 09:07:31 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5869lb # [ 155.193694] niks3-server[1042]: 2026/09/20 09:07:31 INFO Completed upload id=515870lb # [ 155.196485] niks3-server[1042]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5871worker1 # [ 155.203637] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15872worker1 # [ 155.223822] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:31Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15873worker1 # [ 155.229399] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:31Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05874worker1 # [ 155.234444] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165875worker1 # [ 155.239833] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165876worker1 # [ 155.245459] nix-daemon[832]: reaped child process 1942, status = succeeded5877worker1 # [ 155.250256] nix-grpc-daemon[1672]: time=2026-09-20T09:07:31.869Z level=INFO msg="All 1 paths already cached"5878worker1 # [ 155.258204] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570165879worker1 # [ 155.269480] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5880worker1 # [ 155.461680] nix-daemon[832]: accepted connection from pid 1968, user nix-grpc-daemon (trusted)5881worker1 # [ 155.481664] nix-daemon[832]: reaped child process 1971, status = succeeded5882worker1 # [ 155.664902] nix-daemon[832]: accepted connection from pid 1973, user nix-grpc-daemon (trusted)5883worker1 # [ 155.684984] nix-daemon[832]: reaped child process 1976, status = succeeded5884lb # [ 155.694462] niks3-server[1042]: 2026/09/20 09:07:32 INFO Received uploads request method=POST path=/api/pending_closures5885worker1 # [ 155.706507] nix-grpc-daemon[1672]: time=2026-09-20T09:07:32.325Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5886worker1 # [ 155.708061] nix-grpc-daemon[1672]: time=2026-09-20T09:07:32.325Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5887lb # [ 155.727078] niks3-server[1042]: 2026/09/20 09:07:32 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5888lb # [ 155.739129] niks3-server[1042]: 2026/09/20 09:07:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5889worker1 # [ 155.747905] nix-grpc-daemon[1672]: time=2026-09-20T09:07:32.366Z level=INFO msg="Uploading 1 narinfos"5890lb # [ 155.750477] niks3-server[1042]: 2026/09/20 09:07:32 INFO Signed narinfos id=52 count=15891lb # [ 155.756294] niks3-server[1042]: 2026/09/20 09:07:32 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5892lb # [ 155.763536] niks3-server[1042]: 2026/09/20 09:07:32 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5893lb # [ 155.769633] niks3-server[1042]: 2026/09/20 09:07:32 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5894lb # [ 155.774720] niks3-server[1042]: 2026/09/20 09:07:32 INFO Completed upload id=525895worker1 # [ 155.776784] nix-grpc-daemon[1672]: time=2026-09-20T09:07:32.395Z level=INFO msg="Upload complete. (494ms)"5896worker1 # [ 155.785033] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=6245897worker1 # [ 155.798363] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165898worker1 # [ 155.804883] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5899worker1 # [ 155.810471] nix-daemon[832]: reaped child process 1966, status = succeeded5900worker1 # [ 155.824432] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5901worker1 # [ 157.261522] nix-daemon[832]: reaped child process 1980, status = succeeded5902worker1 # [ 157.430085] nix-daemon[832]: accepted connection from pid 1995, user nix-grpc-daemon (trusted)5903worker1 # [ 157.447494] nix-daemon[832]: reaped child process 1998, status = succeeded5904lb # [ 157.458704] niks3-server[1042]: 2026/09/20 09:07:34 INFO Received uploads request method=POST path=/api/pending_closures5905worker1 # [ 157.472491] nix-grpc-daemon[1672]: time=2026-09-20T09:07:34.089Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5906worker1 # [ 157.473928] nix-grpc-daemon[1672]: time=2026-09-20T09:07:34.089Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5907lb # [ 157.499586] niks3-server[1042]: 2026/09/20 09:07:34 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5908lb # [ 157.514928] niks3-server[1042]: 2026/09/20 09:07:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5909worker1 # [ 157.523976] nix-grpc-daemon[1672]: time=2026-09-20T09:07:34.142Z level=INFO msg="Uploading 1 narinfos"5910lb # [ 157.526710] niks3-server[1042]: 2026/09/20 09:07:34 INFO Signed narinfos id=53 count=15911lb # [ 157.532366] niks3-server[1042]: 2026/09/20 09:07:34 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5912lb # [ 157.535698] niks3-server[1042]: 2026/09/20 09:07:34 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5913lb # [ 157.543251] niks3-server[1042]: 2026/09/20 09:07:34 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5914lb # [ 157.551717] niks3-server[1042]: 2026/09/20 09:07:34 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5915lb # [ 157.560492] niks3-server[1042]: 2026/09/20 09:07:34 INFO Completed upload id=535916worker1 # [ 157.562549] nix-grpc-daemon[1672]: time=2026-09-20T09:07:34.181Z level=INFO msg="Upload complete. (327ms)"5917worker1 # [ 157.580956] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15918worker1 # [ 157.601024] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:34Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15919worker1 # [ 157.606831] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165920worker1 # [ 157.611318] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:34Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05921worker1 # [ 157.616735] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165922worker1 # [ 157.621299] nix-daemon[832]: reaped child process 1978, status = succeeded5923worker1 # [ 157.623238] nix-grpc-daemon[1672]: time=2026-09-20T09:07:34.239Z level=INFO msg="All 1 paths already cached"5924worker1 # [ 157.626901] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570165925worker1 # [ 157.637218] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5926worker1 # [ 157.824917] nix-daemon[832]: accepted connection from pid 2004, user nix-grpc-daemon (trusted)5927worker1 # [ 157.842527] nix-daemon[832]: reaped child process 2007, status = succeeded5928worker1 # [ 158.015422] nix-daemon[832]: accepted connection from pid 2009, user nix-grpc-daemon (trusted)5929worker1 # [ 158.030497] nix-daemon[832]: reaped child process 2012, status = succeeded5930lb # [ 158.043559] niks3-server[1042]: 2026/09/20 09:07:34 INFO Received uploads request method=POST path=/api/pending_closures5931worker1 # [ 158.060420] nix-grpc-daemon[1672]: time=2026-09-20T09:07:34.679Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5932worker1 # [ 158.062038] nix-grpc-daemon[1672]: time=2026-09-20T09:07:34.679Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5933lb # [ 158.077771] niks3-server[1042]: 2026/09/20 09:07:34 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5934lb # [ 158.091583] niks3-server[1042]: 2026/09/20 09:07:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5935worker1 # [ 158.098903] nix-grpc-daemon[1672]: time=2026-09-20T09:07:34.717Z level=INFO msg="Uploading 1 narinfos"5936lb # [ 158.103247] niks3-server[1042]: 2026/09/20 09:07:34 INFO Signed narinfos id=54 count=15937lb # [ 158.108483] niks3-server[1042]: 2026/09/20 09:07:34 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5938lb # [ 158.116418] niks3-server[1042]: 2026/09/20 09:07:34 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5939lb # [ 158.123498] niks3-server[1042]: 2026/09/20 09:07:34 INFO Completed upload id=545940worker1 # [ 158.125646] nix-grpc-daemon[1672]: time=2026-09-20T09:07:34.744Z level=INFO msg="Upload complete. (476ms)"5941lb # [ 158.126373] niks3-server[1042]: 2026/09/20 09:07:34 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5942worker1 # [ 158.135643] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=6245943worker1 # [ 158.146276] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165944worker1 # [ 158.153069] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5945worker1 # [ 158.158021] nix-daemon[832]: reaped child process 2002, status = succeeded5946worker1 # [ 158.171019] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5947worker1 # [ 159.597848] nix-daemon[832]: reaped child process 2016, status = succeeded5948worker1 # [ 159.763336] nix-daemon[832]: accepted connection from pid 2031, user nix-grpc-daemon (trusted)5949worker1 # [ 159.783387] nix-daemon[832]: reaped child process 2034, status = succeeded5950lb # [ 159.793946] niks3-server[1042]: 2026/09/20 09:07:36 INFO Received uploads request method=POST path=/api/pending_closures5951worker1 # [ 159.806177] nix-grpc-daemon[1672]: time=2026-09-20T09:07:36.424Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5952worker1 # [ 159.807691] nix-grpc-daemon[1672]: time=2026-09-20T09:07:36.424Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5953lb # [ 159.827145] niks3-server[1042]: 2026/09/20 09:07:36 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5954lb # [ 159.842329] niks3-server[1042]: 2026/09/20 09:07:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5955worker1 # [ 159.849640] nix-grpc-daemon[1672]: time=2026-09-20T09:07:36.468Z level=INFO msg="Uploading 1 narinfos"5956lb # [ 159.854321] niks3-server[1042]: 2026/09/20 09:07:36 INFO Signed narinfos id=55 count=15957lb # [ 159.860582] niks3-server[1042]: 2026/09/20 09:07:36 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5958lb # [ 159.865479] niks3-server[1042]: 2026/09/20 09:07:36 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5959worker1 # [ 159.875227] nix-grpc-daemon[1672]: time=2026-09-20T09:07:36.494Z level=INFO msg="Upload complete. (294ms)"5960lb # [ 159.873626] niks3-server[1042]: 2026/09/20 09:07:36 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5961lb # [ 159.878023] niks3-server[1042]: 2026/09/20 09:07:36 INFO Completed upload id=555962lb # [ 159.880355] niks3-server[1042]: 2026/09/20 09:07:36 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5963worker1 # [ 159.885326] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15964worker1 # [ 159.900579] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:36Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15965worker1 # [ 159.904486] nix-daemon[832]: reaped child process 2014, status = succeeded5966worker1 # [ 159.927824] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165967worker1 # [ 159.937296] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:36Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05968worker1 # [ 159.948239] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570165969worker1 # [ 159.961465] nix-grpc-daemon[1672]: time=2026-09-20T09:07:36.580Z level=INFO msg="All 1 paths already cached"5970worker1 # [ 159.969935] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570165971worker1 # [ 159.983026] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5972worker1 # [ 160.184314] nix-daemon[832]: accepted connection from pid 2040, user nix-grpc-daemon (trusted)5973worker1 # [ 160.204409] nix-daemon[832]: reaped child process 2043, status = succeeded5974worker1 # [ 160.379204] nix-daemon[832]: accepted connection from pid 2045, user nix-grpc-daemon (trusted)5975worker1 # [ 160.396114] nix-daemon[832]: reaped child process 2048, status = succeeded5976lb # [ 160.405530] niks3-server[1042]: 2026/09/20 09:07:37 INFO Received uploads request method=POST path=/api/pending_closures5977worker1 # [ 160.417979] nix-grpc-daemon[1672]: time=2026-09-20T09:07:37.036Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5978worker1 # [ 160.419438] nix-grpc-daemon[1672]: time=2026-09-20T09:07:37.036Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5979lb # [ 160.433796] niks3-server[1042]: 2026/09/20 09:07:37 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5980worker1 # [ 160.449446] nix-grpc-daemon[1672]: time=2026-09-20T09:07:37.068Z level=INFO msg="Uploading 1 narinfos"5981lb # [ 160.446453] niks3-server[1042]: 2026/09/20 09:07:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5982lb # [ 160.458132] niks3-server[1042]: 2026/09/20 09:07:37 INFO Signed narinfos id=56 count=15983lb # [ 160.464877] niks3-server[1042]: 2026/09/20 09:07:37 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5984lb # [ 160.472937] niks3-server[1042]: 2026/09/20 09:07:37 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5985worker1 # [ 160.479214] nix-grpc-daemon[1672]: time=2026-09-20T09:07:37.098Z level=INFO msg="Upload complete. (482ms)"5986lb # [ 160.477838] niks3-server[1042]: 2026/09/20 09:07:37 INFO Completed upload id=565987lb # [ 160.482072] niks3-server[1042]: 2026/09/20 09:07:37 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5988worker1 # [ 160.488249] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=6245989worker1 # [ 160.498725] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570165990worker1 # [ 160.507749] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5991worker1 # [ 160.510188] nix-daemon[832]: reaped child process 2038, status = succeeded5992worker1 # [ 160.523349] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5993worker1 # [ 161.369345] nix-daemon[832]: reaped child process 2052, status = succeeded5994worker1 # [ 161.545208] nix-daemon[832]: accepted connection from pid 2067, user nix-grpc-daemon (trusted)5995worker1 # [ 161.562150] nix-daemon[832]: reaped child process 2070, status = succeeded5996lb # [ 161.572996] niks3-server[1042]: 2026/09/20 09:07:38 INFO Received uploads request method=POST path=/api/pending_closures5997worker1 # [ 161.586790] nix-grpc-daemon[1672]: time=2026-09-20T09:07:38.204Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5998worker1 # [ 161.588358] nix-grpc-daemon[1672]: time=2026-09-20T09:07:38.204Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5999lb # [ 161.612566] niks3-server[1042]: 2026/09/20 09:07:38 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6000lb # [ 161.623106] niks3-server[1042]: 2026/09/20 09:07:38 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6001worker1 # [ 161.637161] nix-grpc-daemon[1672]: time=2026-09-20T09:07:38.255Z level=INFO msg="Uploading 1 narinfos"6002lb # [ 161.634929] niks3-server[1042]: 2026/09/20 09:07:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6003lb # [ 161.640259] niks3-server[1042]: 2026/09/20 09:07:38 INFO Signed narinfos id=57 count=16004lb # [ 161.642620] niks3-server[1042]: 2026/09/20 09:07:38 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6005lb # [ 161.653611] niks3-server[1042]: 2026/09/20 09:07:38 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6006lb # [ 161.660292] niks3-server[1042]: 2026/09/20 09:07:38 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6007lb # [ 161.664584] niks3-server[1042]: 2026/09/20 09:07:38 INFO Completed upload id=576008worker1 # [ 161.666515] nix-grpc-daemon[1672]: time=2026-09-20T09:07:38.285Z level=INFO msg="Upload complete. (333ms)"6009worker1 # [ 161.681115] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16010worker1 # [ 161.694591] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:38Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16011worker1 # [ 161.699885] nix-daemon[832]: reaped child process 2050, status = succeeded6012worker1 # [ 161.720612] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570166013worker1 # [ 161.734002] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:38Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06014worker1 # [ 161.745623] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570166015worker1 # [ 161.759211] nix-grpc-daemon[1672]: time=2026-09-20T09:07:38.378Z level=INFO msg="All 2 paths already cached"6016worker1 # [ 161.768574] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570166017worker1 # [ 161.781788] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)6018worker1 # [ 161.978646] nix-daemon[832]: accepted connection from pid 2076, user nix-grpc-daemon (trusted)6019worker1 # [ 161.997552] nix-daemon[832]: reaped child process 2079, status = succeeded6020worker1 # [ 162.170610] nix-daemon[832]: accepted connection from pid 2081, user nix-grpc-daemon (trusted)6021worker1 # [ 162.187386] nix-daemon[832]: reaped child process 2084, status = succeeded6022lb # [ 162.197340] niks3-server[1042]: 2026/09/20 09:07:38 INFO Received uploads request method=POST path=/api/pending_closures6023worker1 # [ 162.211136] nix-grpc-daemon[1672]: time=2026-09-20T09:07:38.830Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6024worker1 # [ 162.212742] nix-grpc-daemon[1672]: time=2026-09-20T09:07:38.830Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6025lb # [ 162.229607] niks3-server[1042]: 2026/09/20 09:07:38 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6026lb # [ 162.241006] niks3-server[1042]: 2026/09/20 09:07:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6027worker1 # [ 162.249401] nix-grpc-daemon[1672]: time=2026-09-20T09:07:38.868Z level=INFO msg="Uploading 1 narinfos"6028lb # [ 162.251478] niks3-server[1042]: 2026/09/20 09:07:38 INFO Signed narinfos id=58 count=16029lb # [ 162.258018] niks3-server[1042]: 2026/09/20 09:07:38 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6030lb # [ 162.265415] niks3-server[1042]: 2026/09/20 09:07:38 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6031lb # [ 162.271919] niks3-server[1042]: 2026/09/20 09:07:38 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6032lb # [ 162.277503] niks3-server[1042]: 2026/09/20 09:07:38 INFO Completed upload id=586033worker1 # [ 162.279587] nix-grpc-daemon[1672]: time=2026-09-20T09:07:38.898Z level=INFO msg="Upload complete. (482ms)"6034worker1 # [ 162.289162] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=7526035worker1 # [ 162.302345] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570166036worker1 # [ 162.308926] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)6037worker1 # [ 162.313575] nix-daemon[832]: reaped child process 2074, status = succeeded6038worker1 # [ 162.326436] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)6039worker1 # [ 163.574318] nix-daemon[832]: reaped child process 2088, status = succeeded6040worker1 # [ 163.754152] nix-daemon[832]: accepted connection from pid 2103, user nix-grpc-daemon (trusted)6041worker1 # [ 163.771245] nix-daemon[832]: reaped child process 2106, status = succeeded6042lb # [ 163.781952] niks3-server[1042]: 2026/09/20 09:07:40 INFO Received uploads request method=POST path=/api/pending_closures6043worker1 # [ 163.794303] nix-grpc-daemon[1672]: time=2026-09-20T09:07:40.412Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6044worker1 # [ 163.795838] nix-grpc-daemon[1672]: time=2026-09-20T09:07:40.412Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6045lb # [ 163.819528] niks3-server[1042]: 2026/09/20 09:07:40 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6046lb # [ 163.831026] niks3-server[1042]: 2026/09/20 09:07:40 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6047worker1 # [ 163.846351] nix-grpc-daemon[1672]: time=2026-09-20T09:07:40.465Z level=INFO msg="Uploading 1 narinfos"6048lb # [ 163.844275] niks3-server[1042]: 2026/09/20 09:07:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6049lb # [ 163.852622] niks3-server[1042]: 2026/09/20 09:07:40 INFO Signed narinfos id=59 count=16050lb # [ 163.855365] niks3-server[1042]: 2026/09/20 09:07:40 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6051lb # [ 163.865504] niks3-server[1042]: 2026/09/20 09:07:40 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6052lb # [ 163.872468] niks3-server[1042]: 2026/09/20 09:07:40 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6053lb # [ 163.878193] niks3-server[1042]: 2026/09/20 09:07:40 INFO Completed upload id=596054worker1 # [ 163.880746] nix-grpc-daemon[1672]: time=2026-09-20T09:07:40.499Z level=INFO msg="Upload complete. (342ms)"6055worker1 # [ 163.893250] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16056worker1 # [ 163.910347] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:40Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16057worker1 # [ 163.915080] nix-daemon[832]: reaped child process 2086, status = succeeded6058worker1 # [ 163.934664] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570166059worker1 # [ 163.950094] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570166060worker1 # [ 163.965887] nix-grpc-daemon[1672]: time=2026-09-20T09:07:40.584Z level=INFO msg="All 2 paths already cached"6061worker1 # [ 163.974779] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570166062worker1 # [ 163.988710] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)6063worker1 # [ 164.186154] nix-daemon[832]: accepted connection from pid 2110, user nix-grpc-daemon (trusted)6064worker1 # [ 164.203430] nix-daemon[832]: reaped child process 2113, status = succeeded6065worker1 # [ 164.376106] nix-daemon[832]: accepted connection from pid 2115, user nix-grpc-daemon (trusted)6066worker1 # [ 164.392421] nix-daemon[832]: reaped child process 2118, status = succeeded6067lb # [ 164.404823] niks3-server[1042]: 2026/09/20 09:07:41 INFO Received uploads request method=POST path=/api/pending_closures6068worker1 # [ 164.415969] nix-grpc-daemon[1672]: time=2026-09-20T09:07:41.034Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6069worker1 # [ 164.417597] nix-grpc-daemon[1672]: time=2026-09-20T09:07:41.034Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6070lb # [ 164.433368] niks3-server[1042]: 2026/09/20 09:07:41 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6071lb # [ 164.444996] niks3-server[1042]: 2026/09/20 09:07:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6072worker1 # [ 164.454571] nix-grpc-daemon[1672]: time=2026-09-20T09:07:41.073Z level=INFO msg="Uploading 1 narinfos"6073lb # [ 164.452941] niks3-server[1042]: 2026/09/20 09:07:41 INFO Signed narinfos id=60 count=16074lb # [ 164.458805] niks3-server[1042]: 2026/09/20 09:07:41 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6075lb # [ 164.472154] niks3-server[1042]: 2026/09/20 09:07:41 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6076worker1 # [ 164.482455] nix-grpc-daemon[1672]: time=2026-09-20T09:07:41.101Z level=INFO msg="Upload complete. (477ms)"6077lb # [ 164.481116] niks3-server[1042]: 2026/09/20 09:07:41 INFO Completed upload id=606078lb # [ 164.484808] niks3-server[1042]: 2026/09/20 09:07:41 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6079worker1 # [ 164.492691] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=7526080worker1 # [ 164.501113] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570166081worker1 # [ 164.508163] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)6082worker1 # [ 164.512959] nix-daemon[832]: reaped child process 2108, status = succeeded6083worker1 # [ 164.526122] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)6084worker1 # [ 165.558533] nix-daemon[832]: reaped child process 2122, status = succeeded6085worker1 # [ 165.724812] nix-daemon[832]: accepted connection from pid 2137, user nix-grpc-daemon (trusted)6086worker1 # [ 165.742684] nix-daemon[832]: reaped child process 2140, status = succeeded6087lb # [ 165.757702] niks3-server[1042]: 2026/09/20 09:07:42 INFO Received uploads request method=POST path=/api/pending_closures6088worker1 # [ 165.772140] nix-grpc-daemon[1672]: time=2026-09-20T09:07:42.389Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6089worker1 # [ 165.773639] nix-grpc-daemon[1672]: time=2026-09-20T09:07:42.389Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6090lb # [ 165.791295] niks3-server[1042]: 2026/09/20 09:07:42 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6091worker1 # [ 165.814763] nix-grpc-daemon[1672]: time=2026-09-20T09:07:42.433Z level=INFO msg="Uploading 1 narinfos"6092lb # [ 165.807317] niks3-server[1042]: 2026/09/20 09:07:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6093lb # [ 165.819127] niks3-server[1042]: 2026/09/20 09:07:42 INFO Signed narinfos id=61 count=16094lb # [ 165.824816] niks3-server[1042]: 2026/09/20 09:07:42 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6095lb # [ 165.839396] niks3-server[1042]: 2026/09/20 09:07:42 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6096lb # [ 165.842990] niks3-server[1042]: 2026/09/20 09:07:42 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6097lb # [ 165.846488] niks3-server[1042]: 2026/09/20 09:07:42 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6098worker1 # [ 165.848492] nix-grpc-daemon[1672]: time=2026-09-20T09:07:42.467Z level=INFO msg="Upload complete. (312ms)"6099lb # [ 165.849603] niks3-server[1042]: 2026/09/20 09:07:42 INFO Completed upload id=616100worker1 # [ 165.861000] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16101worker1 # [ 165.875595] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:42Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16102worker1 # [ 165.880779] nix-daemon[832]: reaped child process 2120, status = succeeded6103worker1 # [ 165.902015] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570166104worker1 # [ 165.916614] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570166105worker1 # [ 165.931014] nix-grpc-daemon[1672]: time=2026-09-20T09:07:42.550Z level=INFO msg="All 2 paths already cached"6106worker1 # [ 165.939716] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570166107worker1 # [ 165.952860] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)6108worker1 # [ 166.156512] nix-daemon[832]: accepted connection from pid 2144, user nix-grpc-daemon (trusted)6109worker1 # [ 166.173490] nix-daemon[832]: reaped child process 2147, status = succeeded6110worker1 # [ 166.349435] nix-daemon[832]: accepted connection from pid 2149, user nix-grpc-daemon (trusted)6111worker1 # [ 166.365952] nix-daemon[832]: reaped child process 2152, status = succeeded6112lb # [ 166.375938] niks3-server[1042]: 2026/09/20 09:07:43 INFO Received uploads request method=POST path=/api/pending_closures6113worker1 # [ 166.387936] nix-grpc-daemon[1672]: time=2026-09-20T09:07:43.006Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6114worker1 # [ 166.389684] nix-grpc-daemon[1672]: time=2026-09-20T09:07:43.006Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6115lb # [ 166.405967] niks3-server[1042]: 2026/09/20 09:07:43 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6116lb # [ 166.419000] niks3-server[1042]: 2026/09/20 09:07:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6117worker1 # [ 166.427638] nix-grpc-daemon[1672]: time=2026-09-20T09:07:43.046Z level=INFO msg="Uploading 1 narinfos"6118lb # [ 166.430195] niks3-server[1042]: 2026/09/20 09:07:43 INFO Signed narinfos id=62 count=16119lb # [ 166.436083] niks3-server[1042]: 2026/09/20 09:07:43 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6120lb # [ 166.442778] niks3-server[1042]: 2026/09/20 09:07:43 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6121worker1 # [ 166.450458] nix-grpc-daemon[1672]: time=2026-09-20T09:07:43.069Z level=INFO msg="Upload complete. (480ms)"6122lb # [ 166.449678] niks3-server[1042]: 2026/09/20 09:07:43 INFO Completed upload id=626123lb # [ 166.453039] niks3-server[1042]: 2026/09/20 09:07:43 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6124worker1 # [ 166.459608] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=0 paths=1 nar_bytes_in=7526125worker1 # [ 166.470648] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570166126worker1 # [ 166.478726] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)6127worker1 # [ 166.480992] nix-daemon[832]: reaped child process 2142, status = succeeded6128worker1 # [ 166.493624] nix-daemon[832]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)6129worker1 # [ 167.915511] nix-daemon[832]: reaped child process 2156, status = succeeded6130worker1 # [ 168.075039] nix-daemon[832]: accepted connection from pid 2171, user nix-grpc-daemon (trusted)6131worker1 # [ 168.091972] nix-daemon[832]: reaped child process 2174, status = succeeded6132lb # [ 168.103872] niks3-server[1042]: 2026/09/20 09:07:44 INFO Received uploads request method=POST path=/api/pending_closures6133worker1 # [ 168.116160] nix-grpc-daemon[1672]: time=2026-09-20T09:07:44.734Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6134worker1 # [ 168.117648] nix-grpc-daemon[1672]: time=2026-09-20T09:07:44.734Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6135lb # [ 168.133150] niks3-server[1042]: 2026/09/20 09:07:44 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6136lb # [ 168.149048] niks3-server[1042]: 2026/09/20 09:07:44 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6137lb # [ 168.163318] niks3-server[1042]: 2026/09/20 09:07:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6138worker1 # [ 168.169723] nix-grpc-daemon[1672]: time=2026-09-20T09:07:44.788Z level=INFO msg="Uploading 1 narinfos"6139lb # [ 168.173036] niks3-server[1042]: 2026/09/20 09:07:44 INFO Signed narinfos id=63 count=16140lb # [ 168.175630] niks3-server[1042]: 2026/09/20 09:07:44 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6141lb # [ 168.186208] niks3-server[1042]: 2026/09/20 09:07:44 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6142lb # [ 168.191859] niks3-server[1042]: 2026/09/20 09:07:44 INFO Completed upload id=636143lb # [ 168.195059] niks3-server[1042]: 2026/09/20 09:07:44 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6144worker1 # [ 168.193306] nix-grpc-daemon[1672]: time=2026-09-20T09:07:44.812Z level=INFO msg="Upload complete. (290ms)"6145worker1 # [ 168.208178] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57016 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16146worker1 # [ 168.218792] nix-daemon[832]: reaped child process 2154, status = succeeded6147client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.29 seconds)6148worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6149worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.08 seconds)6150client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16151worker1 # [ 168.609994] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:570166152worker1 # [ 168.618252] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570166153worker1 # [ 168.636116] nix-grpc-daemon[1600]: ts=2026-09-20T09:07:45Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06154lb # [ 171.051353] envoy[923]: conn peer=[2001:db8:1::1]:37434 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27157 tx=10716 ms=199936155client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.35 seconds)6156(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 50.73 seconds)6157subtest: low disk drains a worker and builds go to the other6158worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6159worker1 # [ 199.750063] nix-grpc-daemon[1600]: ts=2026-09-20T09:08:16Z level=info event=unhealthy reason=min_free6160worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.16 seconds)6161worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6162worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.05 seconds)6163client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26164worker1 # [ 200.202117] nix-grpc-daemon[1600]: ts=2026-09-20T09:08:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:570166165client # don't know how to build these paths:6166client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6167worker2 # [ 200.318861] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429226168worker2 # [ 200.341807] nix-daemon[835]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)6169worker2 # [ 200.378996] nix-grpc-daemon[1551]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5)6170worker2 # [ 200.408414] nix-grpc-daemon[1551]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 121 ms (attempt 2/5)6171worker2 # [ 200.536314] nix-grpc-daemon[1551]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 397 ms (attempt 3/5)6172worker2 # [ 200.940975] nix-grpc-daemon[1551]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 330 ms (attempt 4/5)6173lb # [ 201.056953] envoy[923]: conn peer=[2001:db8:1::1]:57320 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=300656174worker2 # [ 201.279811] nix-grpc-daemon[1551]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6175worker1 # [ 201.235531] nix-grpc-daemon[1600]: ts=2026-09-20T09:08:17Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06176worker1 # [ 201.241443] nix-grpc-daemon[1600]: ts=2026-09-20T09:08:17Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16177worker2 # [ 201.376767] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429226178worker2 # [ 201.393816] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429226179client # copying 1 paths to 'lb:50051'...6180worker2 # [ 201.408355] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429226181client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6182worker2 # [ 201.425122] nix-daemon[835]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)6183worker2 # [ 201.465070] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:18Z level=info event=niks3_push_started pid=16076184worker2 # [ 201.871209] nix-daemon[835]: accepted connection from pid 1620, user nix-grpc-daemon (trusted)6185worker2 # [ 201.890749] nix-daemon[835]: reaped child process 1623, status = succeeded6186worker2 # [ 202.060523] nix-daemon[835]: accepted connection from pid 1625, user nix-grpc-daemon (trusted)6187worker2 # [ 202.077769] nix-daemon[835]: reaped child process 1628, status = succeeded6188lb # [ 202.002348] niks3-server[1042]: 2026/09/20 09:08:18 INFO Received uploads request method=POST path=/api/pending_closures6189worker2 # [ 202.108070] nix-grpc-daemon[1607]: time=2026-09-20T09:08:18.734Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6190worker2 # [ 202.109567] nix-grpc-daemon[1607]: time=2026-09-20T09:08:18.734Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6191lb # [ 202.053142] niks3-server[1042]: 2026/09/20 09:08:18 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6192worker2 # [ 202.158486] nix-grpc-daemon[1607]: time=2026-09-20T09:08:18.785Z level=INFO msg="Uploading 1 narinfos"6193lb # [ 202.065038] niks3-server[1042]: 2026/09/20 09:08:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6194lb # [ 202.073363] niks3-server[1042]: 2026/09/20 09:08:18 INFO Signed narinfos id=64 count=16195lb # [ 202.080798] niks3-server[1042]: 2026/09/20 09:08:18 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6196lb # [ 202.089706] niks3-server[1042]: 2026/09/20 09:08:18 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6197lb # [ 202.098346] niks3-server[1042]: 2026/09/20 09:08:18 INFO Completed upload id=646198worker2 # [ 202.189743] nix-grpc-daemon[1607]: time=2026-09-20T09:08:18.818Z level=INFO msg="Upload complete. (486ms)"6199lb # [ 202.100988] niks3-server[1042]: 2026/09/20 09:08:18 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6200worker2 # [ 202.200325] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42922 duration_s=0 paths=1 nar_bytes_in=5126201worker2 # [ 202.216431] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429226202worker2 # [ 202.223615] nix-daemon[835]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)6203worker2 # [ 202.229130] nix-daemon[835]: reaped child process 1605, status = succeeded6204client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6205client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6206worker2 # [ 202.244237] nix-daemon[835]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)6207client # farm-a> LOG-farm-a-drain6208worker2 # [ 203.669965] nix-daemon[835]: reaped child process 1632, status = succeeded6209worker2 # [ 203.842113] nix-daemon[835]: accepted connection from pid 1647, user nix-grpc-daemon (trusted)6210worker2 # [ 203.860406] nix-daemon[835]: reaped child process 1650, status = succeeded6211lb # [ 203.786702] niks3-server[1042]: 2026/09/20 09:08:20 INFO Received uploads request method=POST path=/api/pending_closures6212worker2 # [ 203.888386] nix-grpc-daemon[1607]: time=2026-09-20T09:08:20.514Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6213worker2 # [ 203.889846] nix-grpc-daemon[1607]: time=2026-09-20T09:08:20.514Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6214lb # [ 203.821610] niks3-server[1042]: 2026/09/20 09:08:20 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6215lb # [ 203.836118] niks3-server[1042]: 2026/09/20 09:08:20 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6216lb # [ 203.852143] niks3-server[1042]: 2026/09/20 09:08:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6217worker2 # [ 203.950837] nix-grpc-daemon[1607]: time=2026-09-20T09:08:20.577Z level=INFO msg="Uploading 1 narinfos"6218lb # [ 203.862778] niks3-server[1042]: 2026/09/20 09:08:20 INFO Signed narinfos id=65 count=16219lb # [ 203.869390] niks3-server[1042]: 2026/09/20 09:08:20 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6220lb # [ 203.876768] niks3-server[1042]: 2026/09/20 09:08:20 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6221lb # [ 203.883747] niks3-server[1042]: 2026/09/20 09:08:20 INFO Completed upload id=656222lb # [ 203.886433] niks3-server[1042]: 2026/09/20 09:08:20 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6223worker2 # [ 203.975405] nix-grpc-daemon[1607]: time=2026-09-20T09:08:20.603Z level=INFO msg="Upload complete. (320ms)"6224worker2 # [ 203.989362] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42922 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16225worker1 # [ 203.903063] nix-grpc-daemon[1600]: ts=2026-09-20T09:08:20Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06226worker1 # [ 203.909077] nix-grpc-daemon[1600]: ts=2026-09-20T09:08:20Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16227worker2 # [ 204.007624] nix-daemon[835]: reaped child process 1630, status = succeeded6228worker2 # [ 204.040946] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429226229worker2 # [ 204.055605] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429226230worker2 # [ 204.069762] nix-grpc-daemon[1607]: time=2026-09-20T09:08:20.698Z level=INFO msg="All 1 paths already cached"6231client # copying 1 paths to 'lb:50051'...6232worker2 # [ 204.079874] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429226233client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6234worker2 # [ 204.097429] nix-daemon[835]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)6235worker2 # [ 204.305207] nix-daemon[835]: accepted connection from pid 1654, user nix-grpc-daemon (trusted)6236worker2 # [ 204.323263] nix-daemon[835]: reaped child process 1657, status = succeeded6237worker2 # [ 204.497092] nix-daemon[835]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6238worker2 # [ 204.515770] nix-daemon[835]: reaped child process 1662, status = succeeded6239lb # [ 204.435927] niks3-server[1042]: 2026/09/20 09:08:21 INFO Received uploads request method=POST path=/api/pending_closures6240worker2 # [ 204.545082] nix-grpc-daemon[1607]: time=2026-09-20T09:08:21.172Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6241worker2 # [ 204.546651] nix-grpc-daemon[1607]: time=2026-09-20T09:08:21.173Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6242lb # [ 204.472989] niks3-server[1042]: 2026/09/20 09:08:21 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6243worker2 # [ 204.578391] nix-grpc-daemon[1607]: time=2026-09-20T09:08:21.206Z level=INFO msg="Uploading 1 narinfos"6244lb # [ 204.490158] niks3-server[1042]: 2026/09/20 09:08:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6245lb # [ 204.501637] niks3-server[1042]: 2026/09/20 09:08:21 INFO Signed narinfos id=66 count=16246worker2 # [ 204.604709] nix-grpc-daemon[1607]: time=2026-09-20T09:08:21.233Z level=INFO msg="Upload complete. (491ms)"6247lb # [ 204.506706] niks3-server[1042]: 2026/09/20 09:08:21 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6248lb # [ 204.517651] niks3-server[1042]: 2026/09/20 09:08:21 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6249lb # [ 204.522356] niks3-server[1042]: 2026/09/20 09:08:21 INFO Completed upload id=666250worker2 # [ 204.612164] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42922 duration_s=0 paths=1 nar_bytes_in=6326251lb # [ 204.524533] niks3-server[1042]: 2026/09/20 09:08:21 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6252worker2 # [ 204.627120] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429226253worker2 # [ 204.633461] nix-daemon[835]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)6254worker2 # [ 204.638421] nix-daemon[835]: reaped child process 1652, status = succeeded6255client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6256worker2 # [ 204.649717] nix-daemon[835]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)6257client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6258client # farm-b> LOG-farm-b-drain6259worker2 # [ 205.901078] nix-daemon[835]: reaped child process 1666, status = succeeded6260worker2 # [ 206.097008] nix-daemon[835]: accepted connection from pid 1681, user nix-grpc-daemon (trusted)6261worker2 # [ 206.118556] nix-daemon[835]: reaped child process 1684, status = succeeded6262lb # [ 206.047311] niks3-server[1042]: 2026/09/20 09:08:22 INFO Received uploads request method=POST path=/api/pending_closures6263worker2 # [ 206.155729] nix-grpc-daemon[1607]: time=2026-09-20T09:08:22.782Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6264worker2 # [ 206.157541] nix-grpc-daemon[1607]: time=2026-09-20T09:08:22.783Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6265lb # [ 206.100938] niks3-server[1042]: 2026/09/20 09:08:22 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6266lb # [ 206.111313] niks3-server[1042]: 2026/09/20 09:08:22 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6267lb # [ 206.118179] niks3-server[1042]: 2026/09/20 09:08:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6268worker2 # [ 206.215011] nix-grpc-daemon[1607]: time=2026-09-20T09:08:22.842Z level=INFO msg="Uploading 1 narinfos"6269lb # [ 206.125779] niks3-server[1042]: 2026/09/20 09:08:22 INFO Signed narinfos id=67 count=16270lb # [ 206.130728] niks3-server[1042]: 2026/09/20 09:08:22 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6271lb # [ 206.139661] niks3-server[1042]: 2026/09/20 09:08:22 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6272lb # [ 206.146140] niks3-server[1042]: 2026/09/20 09:08:22 INFO Completed upload id=676273worker2 # [ 206.238108] nix-grpc-daemon[1607]: time=2026-09-20T09:08:22.866Z level=INFO msg="Upload complete. (374ms)"6274lb # [ 206.148997] niks3-server[1042]: 2026/09/20 09:08:22 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6275worker2 # [ 206.249254] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42922 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16276worker1 # [ 206.165456] nix-grpc-daemon[1600]: ts=2026-09-20T09:08:22Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06277worker1 # [ 206.172114] nix-grpc-daemon[1600]: ts=2026-09-20T09:08:22Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16278worker2 # [ 206.271431] nix-daemon[835]: reaped child process 1664, status = succeeded6279worker2 # [ 206.312097] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429226280worker2 # [ 206.328998] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429226281worker2 # [ 206.346219] nix-grpc-daemon[1607]: time=2026-09-20T09:08:22.974Z level=INFO msg="All 2 paths already cached"6282client # copying 1 paths to 'lb:50051'...6283client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6284worker2 # [ 206.356147] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429226285worker2 # [ 206.371667] nix-daemon[835]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)6286worker2 # [ 206.609567] nix-daemon[835]: accepted connection from pid 1688, user nix-grpc-daemon (trusted)6287worker2 # [ 206.633613] nix-daemon[835]: reaped child process 1691, status = succeeded6288worker2 # [ 206.812535] nix-daemon[835]: accepted connection from pid 1693, user nix-grpc-daemon (trusted)6289worker2 # [ 206.831928] nix-daemon[835]: reaped child process 1696, status = succeeded6290lb # [ 206.750910] niks3-server[1042]: 2026/09/20 09:08:23 INFO Received uploads request method=POST path=/api/pending_closures6291worker2 # [ 206.854045] nix-grpc-daemon[1607]: time=2026-09-20T09:08:23.482Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6292worker2 # [ 206.855574] nix-grpc-daemon[1607]: time=2026-09-20T09:08:23.482Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6293lb # [ 206.779185] niks3-server[1042]: 2026/09/20 09:08:23 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6294worker2 # [ 206.885899] nix-grpc-daemon[1607]: time=2026-09-20T09:08:23.514Z level=INFO msg="Uploading 1 narinfos"6295lb # [ 206.793696] niks3-server[1042]: 2026/09/20 09:08:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6296lb # [ 206.804295] niks3-server[1042]: 2026/09/20 09:08:23 INFO Signed narinfos id=68 count=16297lb # [ 206.816317] niks3-server[1042]: 2026/09/20 09:08:23 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6298worker2 # [ 206.917100] nix-grpc-daemon[1607]: time=2026-09-20T09:08:23.545Z level=INFO msg="Upload complete. (522ms)"6299lb # [ 206.825622] niks3-server[1042]: 2026/09/20 09:08:23 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6300lb # [ 206.832126] niks3-server[1042]: 2026/09/20 09:08:23 INFO Completed upload id=686301lb # [ 206.835869] niks3-server[1042]: 2026/09/20 09:08:23 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6302worker2 # [ 206.923654] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42922 duration_s=0 paths=1 nar_bytes_in=7606303worker2 # [ 206.938465] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429226304worker2 # [ 206.944954] nix-daemon[835]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)6305worker2 # [ 206.949853] nix-daemon[835]: reaped child process 1686, status = succeeded6306client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6307worker2 # [ 206.962723] nix-daemon[835]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)6308client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6309client # farm-top> LOG-farm-top-drain6310worker2 # [ 208.413465] nix-daemon[835]: reaped child process 1700, status = succeeded6311worker2 # [ 208.600827] nix-daemon[835]: accepted connection from pid 1715, user nix-grpc-daemon (trusted)6312worker2 # [ 208.619002] nix-daemon[835]: reaped child process 1718, status = succeeded6313lb # [ 208.542433] niks3-server[1042]: 2026/09/20 09:08:25 INFO Received uploads request method=POST path=/api/pending_closures6314worker2 # [ 208.644084] nix-grpc-daemon[1607]: time=2026-09-20T09:08:25.270Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6315worker2 # [ 208.645854] nix-grpc-daemon[1607]: time=2026-09-20T09:08:25.270Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6316lb # [ 208.580931] niks3-server[1042]: 2026/09/20 09:08:25 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6317lb # [ 208.593260] niks3-server[1042]: 2026/09/20 09:08:25 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6318worker2 # [ 208.693539] nix-grpc-daemon[1607]: time=2026-09-20T09:08:25.321Z level=INFO msg="Uploading 1 narinfos"6319lb # [ 208.605240] niks3-server[1042]: 2026/09/20 09:08:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6320lb # [ 208.612327] niks3-server[1042]: 2026/09/20 09:08:25 INFO Signed narinfos id=69 count=16321lb # [ 208.614247] niks3-server[1042]: 2026/09/20 09:08:25 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6322lb # [ 208.622195] niks3-server[1042]: 2026/09/20 09:08:25 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6323lb # [ 208.626688] niks3-server[1042]: 2026/09/20 09:08:25 INFO Completed upload id=696324worker2 # [ 208.718862] nix-grpc-daemon[1607]: time=2026-09-20T09:08:25.347Z level=INFO msg="Upload complete. (344ms)"6325lb # [ 208.629190] niks3-server[1042]: 2026/09/20 09:08:25 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6326worker2 # [ 208.733201] nix-grpc-daemon[1551]: ts=2026-09-20T09:08:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42922 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16327worker2 # [ 208.747884] nix-daemon[835]: reaped child process 1698, status = succeeded6328client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 8.77 seconds)6329client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6330client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds)6331worker1: must succeed: rm /nix/.rw-store/fill6332worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds)6333worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6334worker1 # [ 209.756434] nix-grpc-daemon[1600]: ts=2026-09-20T09:08:26Z level=info event=healthy reason=min_free6335worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.13 seconds)6336(finished: subtest: low disk drains a worker and builds go to the other, in 11.60 seconds)6337(finished: run the VM test script, in 211.22 seconds)6338test script finished in 211.51s6339cleanup6340kill QemuMachine (pid 49)6341client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6342kill QemuMachine (pid 50)6343lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6344kill QemuMachine (pid 51)6345worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6346kill QemuMachine (pid 52)6347worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6348(finished: cleanup, in 0.96 seconds)6349additionally exposed symbols:6350 client, lb, worker1, worker2,6351 vlan1,6352 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh