vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #238
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb # Formatting '/build/vm-state-lb/tmp.sUjBL60fux', fmt=raw size=107374182414lb: QEMU running (pid 50)15lb # mke2fs 1.47.4 (6-Mar-2025)16worker2 # Disk image does not exist, creating the virtualisation disk image...17worker1 # Disk image does not exist, creating the virtualisation disk image...18worker1 # Formatting '/build/vm-state-worker1/tmp.8CtgCHkT9V', fmt=raw size=107374182419worker1 # mke2fs 1.47.4 (6-Mar-2025)20worker1: QEMU running (pid 52)21lb # Discarding device blocks: 0/262144 done22client: QEMU running (pid 49)23worker2: QEMU running (pid 51)24lb # Creating filesystem with 262144 4k blocks and 65536 inodes25worker2 # Formatting '/build/vm-state-worker2/tmp.t1AlAsLzy0', fmt=raw size=107374182426worker1 # Discarding device blocks: 0/262144 done27client # Disk image does not exist, creating the virtualisation disk image...28(finished: start all VMs, in 0.51 seconds)29worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes30client # Formatting '/build/vm-state-client/tmp.Xr1uTAE3wU', fmt=raw size=107374182431client: waiting for unit network-addresses-eth1.service32worker1 # Filesystem UUID: 2c9f9fa7-5e8b-4fbc-9739-6eda515110ed33client # mke2fs 1.47.4 (6-Mar-2025)34client: waiting for the VM to finish booting35worker1 # Superblock backups stored on blocks:36client # Discarding device blocks: 0/262144 done37worker2 # mke2fs 1.47.4 (6-Mar-2025)38lb # Filesystem UUID: 4d73c45d-1cee-4f3b-82cc-3063609d0b8239worker1 # 32768, 98304, 163840, 22937640client # Creating filesystem with 262144 4k blocks and 65536 inodes41worker2 # Discarding device blocks: 0/262144 done42lb # Superblock backups stored on blocks:43client # Filesystem UUID: bc5f26a8-d92d-497e-9085-e02da5eac31b44worker1 # 45worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes46lb # 32768, 98304, 163840, 22937647client # Superblock backups stored on blocks:48worker2 # Filesystem UUID: ea70fdbf-bf2d-4865-a271-244bec64a9a149lb # 50client # 32768, 98304, 163840, 22937651worker1 # Allocating group tables: 0/8 done52client # 53worker1 # Writing inode tables: 0/8 done54lb # Allocating group tables: 0/8 done55worker2 # Superblock backups stored on blocks:56client # Allocating group tables: 0/8 done57worker1 # Creating journal (8192 blocks): done58lb # Writing inode tables: 0/8 done59worker2 # 32768, 98304, 163840, 22937660client # Writing inode tables: 0/8 done61worker1 # Writing superblocks and filesystem accounting information: 0/8 done62lb # Creating journal (8192 blocks): done63worker2 # 64client # Creating journal (8192 blocks): done65worker1 # 66worker1 # Virtualisation disk image created.67worker2 # Allocating group tables: 0/8 done68client # Writing superblocks and filesystem accounting information: 0/8 done69worker2 # Writing inode tables: 0/8 done70client # 71worker2 # Creating journal (8192 blocks): done72client # Virtualisation disk image created.73worker2 # Writing superblocks and filesystem accounting information: 0/8 done74lb # Writing superblocks and filesystem accounting information: 0/8 done75worker2 # 76lb # 77worker2 # Virtualisation disk image created.78lb # Virtualisation disk image created.79lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681lb # [ 0.000000] KASLR enabled82lb # [ 0.000000] random: crng init done83lb # [ 0.000000] Machine model: linux,dummy-virt84lb # [ 0.000000] efi: UEFI not found.85lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88lb # [ 0.000000] Zone ranges:89lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90lb # [ 0.000000] DMA32 empty91lb # [ 0.000000] Normal empty92lb # [ 0.000000] Device empty93lb # [ 0.000000] Movable zone start for each node94lb # [ 0.000000] Early memory node ranges95lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098lb # [ 0.000000] psci: probing for conduit method from DT.99lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.100lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101lb # [ 0.000000] psci: Trusted OS migration not required102lb # [ 0.000000] psci: SMC Calling Convention v1.1103lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105lb # [ 0.000000] Detected PIPT I-cache on CPU0106lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107lb # [ 0.000000] CPU features: detected: GICv3 CPU interface108lb # [ 0.000000] CPU features: detected: Spectre-v4109lb # [ 0.000000] CPU features: detected: Spectre-BHB110lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112lb # [ 0.000000] alternatives: applying boot alternatives113lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0114lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.115lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119lb # [ 0.000000] software IO TLB: area num 1.120lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122lb # [ 0.000000] Fallback order for Node 0: 0123lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124lb # [ 0.000000] Policy zone: DMA125lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127lb # [ 0.000000] allocated 3145728 bytes of page_ext128lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups130lb # [ 0.000000] rcu: Hierarchical RCU implementation.131lb # [ 0.000000] rcu: RCU event tracing is enabled.132lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.134lb # [ 0.000000] Rude variant of Tasks RCU enabled.135lb # [ 0.000000] Tracing variant of Tasks RCU enabled.136lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.139lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0142lb # [ 0.000000] GICv3: 256 SPIs implemented143lb # [ 0.000000] GICv3: 0 Extended SPIs implemented144lb # [ 0.000000] Root IRQ handler: gic_handle_irq145lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI146lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0147lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000148lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]149lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)150lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)151lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000152lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000153lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.154lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns155lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).156lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns157lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns158lb # [ 0.000036] arm-pv: using stolen time PV159lb # [ 0.000723] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)160lb # [ 0.000896] Console: colour dummy device 80x25161lb # [ 0.000904] printk: legacy console [tty0] enabled162lb # [ 0.001136] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)163lb # [ 0.001143] pid_max: default: 32768 minimum: 301164lb # [ 0.001228] LSM: initializing lsm=capability,landlock,yama,bpf,ima165lb # [ 0.001400] landlock: Up and running.166lb # [ 0.001403] Yama: becoming mindful.167client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]168lb # [ 0.002133] LSM support for eBPF active169lb # [ 0.002332] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)170client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026171client # [ 0.000000] KASLR enabled172lb # [ 0.002368] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)173client # [ 0.000000] random: crng init done174lb # [ 0.003596] cacheinfo: Unable to detect cache hierarchy for CPU 0175client # [ 0.000000] Machine model: linux,dummy-virt176client # [ 0.000000] efi: UEFI not found.177lb # [ 0.004345] rcu: Hierarchical SRCU implementation.178lb # [ 0.004349] rcu: Max phase no-delay instances is 1000.179client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT180lb # [ 0.005627] fsl-mc MSI: its@8080000 domain created181client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]182lb # [ 0.005727] EFI services will not be available.183lb # [ 0.005801] smp: Bringing up secondary CPUs ...184client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]185client # [ 0.000000] Zone ranges:186lb # [ 0.005810] smp: Brought up 1 node, 1 CPU187lb # [ 0.005813] SMP: Total of 1 processors activated.188client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]189client # [ 0.000000] DMA32 empty190lb # [ 0.005818] CPU: All CPU(s) started at EL1191client # [ 0.000000] Normal empty192client # [ 0.000000] Device empty193lb # [ 0.005832] CPU features: detected: Branch Target Identification194client # [ 0.000000] Movable zone start for each node195lb # [ 0.005837] CPU features: detected: ARMv8.4 Translation Table Level196client # [ 0.000000] Early memory node ranges197client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]198lb # [ 0.005840] CPU features: detected: Instruction cache invalidation not required for I/D coherence199client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]200lb # [ 0.005844] CPU features: detected: Data cache clean to the PoU not required for I/D coherence201client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000202lb # [ 0.005847] CPU features: detected: Common not Private translations203client # [ 0.000000] psci: probing for conduit method from DT.204lb # [ 0.005850] CPU features: detected: CRC32 instructions205client # [ 0.000000] psci: PSCIv1.3 detected in firmware.206client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs207lb # [ 0.005853] CPU features: detected: Data cache clean to Point of Deep Persistence208client # [ 0.000000] psci: Trusted OS migration not required209lb # [ 0.005857] CPU features: detected: Data cache clean to Point of Persistence210client # [ 0.000000] psci: SMC Calling Convention v1.1211lb # [ 0.005860] CPU features: detected: Data independent timing control (DIT)212client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)213lb # [ 0.005863] CPU features: detected: E0PD214client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296215lb # [ 0.005865] CPU features: detected: Enhanced Counter Virtualization216client # [ 0.000000] Detected PIPT I-cache on CPU0217lb # [ 0.005868] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)218client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)219lb # [ 0.005871] CPU features: detected: Enhanced Virtualization Traps220client # [ 0.000000] CPU features: detected: GICv3 CPU interface221lb # [ 0.005874] CPU features: detected: Fine Grained Traps222client # [ 0.000000] CPU features: detected: Spectre-v4223client # [ 0.000000] CPU features: detected: Spectre-BHB224lb # [ 0.005877] CPU features: detected: Generic authentication (architected QARMA5 algorithm)225client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38226lb # [ 0.005882] CPU features: detected: RCpc load-acquire (LDAPR)227client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23228lb # [ 0.005885] CPU features: detected: LSE atomic instructions229client # [ 0.000000] alternatives: applying boot alternatives230lb # [ 0.005888] CPU features: detected: Privileged Access Never231lb # [ 0.005891] CPU features: detected: PMUv3232lb # [ 0.005894] CPU features: detected: RAS Extension Support233lb # [ 0.005896] CPU features: detected: RASv1p1 Extension Support234worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]235lb # [ 0.005899] CPU features: detected: Random Number Generator236lb # [ 0.005901] CPU features: detected: Speculation barrier (SB)237client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test/init regInfo=/nix/store/73dicn7n37i2ayqhspx0lbm4yw0nma90-closure-info/registration console=ttyAMA0,115200n8 console=tty0238lb # [ 0.005904] CPU features: detected: Stage-2 Force Write-Back239worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026240worker2 # [ 0.000000] KASLR enabled241worker2 # [ 0.000000] random: crng init done242lb # [ 0.005907] CPU features: detected: TLB range maintenance instructions243worker2 # [ 0.000000] Machine model: linux,dummy-virt244client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/73dicn7n37i2ayqhspx0lbm4yw0nma90-closure-info/registration", will be passed to user space.245lb # [ 0.005913] CPU features: detected: Speculative Store Bypassing Safe (SSBS)246worker2 # [ 0.000000] efi: UEFI not found.247lb # [ 0.005952] alternatives: applying system-wide alternatives248client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes249worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT250worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]251lb # [ 0.009063] CPU features: detected: BBM Level 2 without TLB conflict abort252client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)253worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]254worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]255client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)256worker2 # [ 0.000000] Zone ranges:257worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026258lb # [ 0.009309] Memory: 1406540K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)259worker1 # [ 0.000000] KASLR enabled260client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB261lb # [ 0.009771] devtmpfs: initialized262worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]263worker1 # [ 0.000000] random: crng init done264client # [ 0.000000] software IO TLB: area num 1.265worker2 # [ 0.000000] DMA32 empty266worker1 # [ 0.000000] Machine model: linux,dummy-virt267lb # [ 0.011782] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)268worker2 # [ 0.000000] Normal empty269worker1 # [ 0.000000] efi: UEFI not found.270client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB271worker2 # [ 0.000000] Device empty272worker2 # [ 0.000000] Movable zone start for each node273lb # [ 0.011808] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).274worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT275client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)276worker2 # [ 0.000000] Early memory node ranges277client # [ 0.000000] Fallback order for Node 0: 0278lb # [ 0.011994] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL279worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]280worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]281lb # [ 0.011999] 0 pages in range for non-PLT usage282client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216283worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]284client # [ 0.000000] Policy zone: DMA285worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]286lb # [ 0.012000] 508288 pages in range for PLT usage287worker1 # [ 0.000000] Zone ranges:288worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000289lb # [ 0.012123] pinctrl core: initialized pinctrl subsystem290client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off291worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]292lb # [ 0.013186] DMI not present or invalid.293worker1 # [ 0.000000] DMA32 empty294worker2 # [ 0.000000] psci: probing for conduit method from DT.295client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1296worker1 # [ 0.000000] Normal empty297worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.298lb # [ 0.016869] NET: Registered PF_NETLINK/PF_ROUTE protocol family299worker1 # [ 0.000000] Device empty300client # [ 0.000000] allocated 3145728 bytes of page_ext301worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs302worker1 # [ 0.000000] Movable zone start for each node303lb # [ 0.019195] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations304client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages305worker1 # [ 0.000000] Early memory node ranges306worker2 # [ 0.000000] psci: Trusted OS migration not required307client # [ 0.000000] ftrace: allocated 294 pages with 4 groups308worker2 # [ 0.000000] psci: SMC Calling Convention v1.1309lb # [ 0.019371] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations310worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]311client # [ 0.000000] rcu: Hierarchical RCU implementation.312client # [ 0.000000] rcu: RCU event tracing is enabled.313worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]314lb # [ 0.019576] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations315worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)316worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000317lb # [ 0.019601] audit: initializing netlink subsys (disabled)318client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.319worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296320worker1 # [ 0.000000] psci: probing for conduit method from DT.321client # [ 0.000000] Trampoline variant of Tasks RCU enabled.322lb # [ 0.020277] thermal_sys: Registered thermal governor 'fair_share'323worker2 # [ 0.000000] Detected PIPT I-cache on CPU0324worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.325client # [ 0.000000] Rude variant of Tasks RCU enabled.326lb # [ 0.020279] thermal_sys: Registered thermal governor 'bang_bang'327worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs328worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)329lb # [ 0.020283] thermal_sys: Registered thermal governor 'step_wise'330worker1 # [ 0.000000] psci: Trusted OS migration not required331worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface332client # [ 0.000000] Tracing variant of Tasks RCU enabled.333client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.334worker1 # [ 0.000000] psci: SMC Calling Convention v1.1335lb # [ 0.020289] thermal_sys: Registered thermal governor 'user_space'336worker2 # [ 0.000000] CPU features: detected: Spectre-v4337client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1338worker2 # [ 0.000000] CPU features: detected: Spectre-BHB339lb # [ 0.020292] thermal_sys: Registered thermal governor 'power_allocator'340worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)341worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38342client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.343lb # [ 0.020319] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1344worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296345worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23346lb # [ 0.020329] cpuidle: using governor ladder347worker1 # [ 0.000000] Detected PIPT I-cache on CPU0348lb # [ 0.020334] cpuidle: using governor menu349client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.350worker2 # [ 0.000000] alternatives: applying boot alternatives351worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)352lb # [ 0.020543] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.353client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.354worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface355lb # [ 0.020560] ASID allocator initialised with 65536 entries356client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0357worker1 # [ 0.000000] CPU features: detected: Spectre-v4358lb # [ 0.021908] Serial: AMBA PL011 UART driver359client # [ 0.000000] GICv3: 256 SPIs implemented360worker1 # [ 0.000000] CPU features: detected: Spectre-BHB361client # [ 0.000000] GICv3: 0 Extended SPIs implemented362lb # [ 0.027480] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1363worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38364client # [ 0.000000] Root IRQ handler: gic_handle_irq365lb # [ 0.027634] printk: console [ttyAMA0] enabled366worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23367worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2g5mhbvf9fs6iiwsdsjwn9a1dxd2rcf0-nixos-system-worker2-test/init regInfo=/nix/store/0mrxlavbw2bq59qzkmlgjv59qy19l5wh-closure-info/registration console=ttyAMA0,115200n8 console=tty0368client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI369worker1 # [ 0.000000] alternatives: applying boot alternatives370client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0371client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000372worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/0mrxlavbw2bq59qzkmlgjv59qy19l5wh-closure-info/registration", will be passed to user space.373client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]374worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes375client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)376worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)377client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)378worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6m1k0db9w5wmmbl9c4r51z8s449nwzad-nixos-system-worker1-test/init regInfo=/nix/store/mrisf2bbh36vsfnljbp0rvk6l69lhx33-closure-info/registration console=ttyAMA0,115200n8 console=tty0379worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)380client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000381worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB382worker2 # [ 0.000000] software IO TLB: area num 1.383client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000384worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB385client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.386lb # [ 0.149863] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages387worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/mrisf2bbh36vsfnljbp0rvk6l69lhx33-closure-info/registration", will be passed to user space.388lb # [ 0.149882] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page389worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)390worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes391client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns392worker2 # [ 0.000000] Fallback order for Node 0: 0393lb # [ 0.149887] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages394worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)395client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).396worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216397lb # [ 0.149892] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page398worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)399lb # [ 0.149896] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages400client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns401worker2 # [ 0.000000] Policy zone: DMA402worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB403lb # [ 0.149900] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page404worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off405worker1 # [ 0.000000] software IO TLB: area num 1.406client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns407client # [ 0.000033] arm-pv: using stolen time PV408lb # [ 0.149904] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages409worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB410worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1411worker2 # [ 0.000000] allocated 3145728 bytes of page_ext412lb # [ 0.149909] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page413worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)414client # [ 0.000561] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)415worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages416worker1 # [ 0.000000] Fallback order for Node 0: 0417client # [ 0.000729] Console: colour dummy device 80x25418worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups419client # [ 0.000737] printk: legacy console [tty0] enabled420worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216421worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.422worker1 # [ 0.000000] Policy zone: DMA423lb # [ 0.157211] fbcon: Taking over console424worker2 # [ 0.000000] rcu: RCU event tracing is enabled.425worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off426client # [ 0.000936] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)427lb # [ 0.157229] ACPI: Interpreter disabled.428worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.429client # [ 0.000943] pid_max: default: 32768 minimum: 301430worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1431worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.432client # [ 0.001014] LSM: initializing lsm=capability,landlock,yama,bpf,ima433worker1 # [ 0.000000] allocated 3145728 bytes of page_ext434worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.435client # [ 0.001160] landlock: Up and running.436worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages437worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.438client # [ 0.001163] Yama: becoming mindful.439client # [ 0.001712] LSM support for eBPF active440worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups441worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.442worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.443client # [ 0.001871] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)444worker1 # [ 0.000000] rcu: RCU event tracing is enabled.445worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1446client # [ 0.001905] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)447worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.448worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.449client # [ 0.003028] cacheinfo: Unable to detect cache hierarchy for CPU 0450worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.451client # [ 0.003867] rcu: Hierarchical SRCU implementation.452worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.453worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.454worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.455client # [ 0.003871] rcu: Max phase no-delay instances is 1000.456client # [ 0.005109] fsl-mc MSI: its@8080000 domain created457worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.458worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.459client # [ 0.005204] EFI services will not be available.460worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0461client # [ 0.005276] smp: Bringing up secondary CPUs ...462worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1463lb # [ 0.166238] iommu: Default domain type: Translated464worker2 # [ 0.000000] GICv3: 256 SPIs implemented465client # [ 0.005283] smp: Brought up 1 node, 1 CPU466worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented467lb # [ 0.166249] iommu: DMA domain TLB invalidation policy: strict mode468client # [ 0.005287] SMP: Total of 1 processors activated.469worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.470worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq471client # [ 0.005292] CPU: All CPU(s) started at EL1472lb # [ 0.167899] SCSI subsystem initialized473worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI474worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.475client # [ 0.005303] CPU features: detected: Branch Target Identification476worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0477client # [ 0.005308] CPU features: detected: ARMv8.4 Translation Table Level478worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.479lb # [ 0.168559] usbcore: registered new interface driver usbfs480worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000481worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]482lb # [ 0.168591] usbcore: registered new interface driver hub483worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0484client # [ 0.005311] CPU features: detected: Instruction cache invalidation not required for I/D coherence485worker1 # [ 0.000000] GICv3: 256 SPIs implemented486lb # [ 0.168610] usbcore: registered new device driver usb487worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented488worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)489client # [ 0.005315] CPU features: detected: Data cache clean to the PoU not required for I/D coherence490lb # [ 0.168891] pps_core: LinuxPPS API ver. 1 registered491worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq492client # [ 0.005318] CPU features: detected: Common not Private translations493worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI494lb # [ 0.168897] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>495worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)496client # [ 0.005322] CPU features: detected: CRC32 instructions497lb # [ 0.168932] PTP clock support registered498worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0499worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000500lb # [ 0.168985] EDAC MC: Ver: 3.0.0501client # [ 0.005324] CPU features: detected: Data cache clean to Point of Deep Persistence502worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000503worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000504lb # [ 0.173488] scmi_core: SCMI protocol bus registered505worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]506client # [ 0.005328] CPU features: detected: Data cache clean to Point of Persistence507worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.508lb # [ 0.174458] FPGA manager framework509client # [ 0.005331] CPU features: detected: Data independent timing control (DIT)510worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)511lb # [ 0.175377] vgaarb: loaded512client # [ 0.005334] CPU features: detected: E0PD513worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns514client # [ 0.005336] CPU features: detected: Enhanced Counter Virtualization515worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)516worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).517lb # [ 0.176000] clocksource: Switched to clocksource arch_sys_counter518client # [ 0.005339] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)519worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000520client # [ 0.005343] CPU features: detected: Enhanced Virtualization Traps521worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns522worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000523client # [ 0.005346] CPU features: detected: Fine Grained Traps524worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.525worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns526worker2 # [ 0.000028] arm-pv: using stolen time PV527client # [ 0.005349] CPU features: detected: Generic authentication (architected QARMA5 algorithm)528client # [ 0.005354] CPU features: detected: RCpc load-acquire (LDAPR)529worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns530worker2 # [ 0.000392] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)531client # [ 0.005357] CPU features: detected: LSE atomic instructions532worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).533worker2 # [ 0.000539] Console: colour dummy device 80x25534client # [ 0.005359] CPU features: detected: Privileged Access Never535worker2 # [ 0.000546] printk: legacy console [tty0] enabled536client # [ 0.005362] CPU features: detected: PMUv3537worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns538client # [ 0.005365] CPU features: detected: RAS Extension Support539lb # [ 0.182225] VFS: Disk quotas dquot_6.6.0540worker2 # [ 0.000734] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)541worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns542worker1 # [ 0.000029] arm-pv: using stolen time PV543worker2 # [ 0.000741] pid_max: default: 32768 minimum: 301544lb # [ 0.182274] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)545client # [ 0.005367] CPU features: detected: RASv1p1 Extension Support546worker2 # [ 0.000808] LSM: initializing lsm=capability,landlock,yama,bpf,ima547lb # [ 0.183872] netfs: FS-Cache loaded548client # [ 0.005370] CPU features: detected: Random Number Generator549worker2 # [ 0.000945] landlock: Up and running.550worker1 # [ 0.000400] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)551lb # [ 0.184425] pnp: PnP ACPI: disabled552worker2 # [ 0.000948] Yama: becoming mindful.553worker1 # [ 0.000572] Console: colour dummy device 80x25554client # [ 0.005373] CPU features: detected: Speculation barrier (SB)555worker2 # [ 0.001393] LSM support for eBPF active556worker1 # [ 0.000581] printk: legacy console [tty0] enabled557client # [ 0.005376] CPU features: detected: Stage-2 Force Write-Back558worker2 # [ 0.001545] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)559client # [ 0.005378] CPU features: detected: TLB range maintenance instructions560worker1 # [ 0.000773] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)561worker2 # [ 0.001577] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)562client # [ 0.005383] CPU features: detected: Speculative Store Bypassing Safe (SSBS)563worker1 # [ 0.000779] pid_max: default: 32768 minimum: 301564worker2 # [ 0.002688] cacheinfo: Unable to detect cache hierarchy for CPU 0565client # [ 0.005421] alternatives: applying system-wide alternatives566worker1 # [ 0.000857] LSM: initializing lsm=capability,landlock,yama,bpf,ima567worker2 # [ 0.003422] rcu: Hierarchical SRCU implementation.568worker1 # [ 0.001001] landlock: Up and running.569lb # [ 0.187904] NET: Registered PF_INET protocol family570client # [ 0.008440] CPU features: detected: BBM Level 2 without TLB conflict abort571worker1 # [ 0.001004] Yama: becoming mindful.572worker2 # [ 0.003426] rcu: Max phase no-delay instances is 1000.573worker1 # [ 0.001462] LSM support for eBPF active574worker2 # [ 0.004615] fsl-mc MSI: its@8080000 domain created575worker1 # [ 0.001622] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)576worker2 # [ 0.004708] EFI services will not be available.577client # [ 0.008703] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)578client # [ 0.009094] devtmpfs: initialized579worker2 # [ 0.004787] smp: Bringing up secondary CPUs ...580worker1 # [ 0.001656] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)581worker2 # [ 0.004796] smp: Brought up 1 node, 1 CPU582client # [ 0.010945] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)583worker2 # [ 0.004799] SMP: Total of 1 processors activated.584worker1 # [ 0.003202] cacheinfo: Unable to detect cache hierarchy for CPU 0585worker2 # [ 0.004804] CPU: All CPU(s) started at EL1586worker1 # [ 0.003922] rcu: Hierarchical SRCU implementation.587client # [ 0.010968] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).588lb # [ 0.188823] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)589worker2 # [ 0.004814] CPU features: detected: Branch Target Identification590worker1 # [ 0.003926] rcu: Max phase no-delay instances is 1000.591client # [ 0.011162] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL592worker1 # [ 0.005139] fsl-mc MSI: its@8080000 domain created593worker2 # [ 0.004820] CPU features: detected: ARMv8.4 Translation Table Level594client # [ 0.011167] 0 pages in range for non-PLT usage595worker1 # [ 0.005231] EFI services will not be available.596client # [ 0.011168] 508288 pages in range for PLT usage597worker1 # [ 0.005319] smp: Bringing up secondary CPUs ...598worker2 # [ 0.004823] CPU features: detected: Instruction cache invalidation not required for I/D coherence599client # [ 0.011262] pinctrl core: initialized pinctrl subsystem600worker1 # [ 0.005327] smp: Brought up 1 node, 1 CPU601client # [ 0.012052] DMI not present or invalid.602worker1 # [ 0.005331] SMP: Total of 1 processors activated.603worker2 # [ 0.004826] CPU features: detected: Data cache clean to the PoU not required for I/D coherence604client # [ 0.015532] NET: Registered PF_NETLINK/PF_ROUTE protocol family605worker1 # [ 0.005336] CPU: All CPU(s) started at EL1606worker2 # [ 0.004830] CPU features: detected: Common not Private translations607client # [ 0.018189] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations608worker1 # [ 0.005347] CPU features: detected: Branch Target Identification609worker2 # [ 0.004833] CPU features: detected: CRC32 instructions610worker1 # [ 0.005352] CPU features: detected: ARMv8.4 Translation Table Level611client # [ 0.018358] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations612worker2 # [ 0.004836] CPU features: detected: Data cache clean to Point of Deep Persistence613worker1 # [ 0.005355] CPU features: detected: Instruction cache invalidation not required for I/D coherence614client # [ 0.018554] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations615worker2 # [ 0.004839] CPU features: detected: Data cache clean to Point of Persistence616client # [ 0.018576] audit: initializing netlink subsys (disabled)617worker1 # [ 0.005359] CPU features: detected: Data cache clean to the PoU not required for I/D coherence618worker2 # [ 0.004843] CPU features: detected: Data independent timing control (DIT)619client # [ 0.019196] thermal_sys: Registered thermal governor 'fair_share'620worker2 # [ 0.004846] CPU features: detected: E0PD621worker1 # [ 0.005363] CPU features: detected: Common not Private translations622client # [ 0.019198] thermal_sys: Registered thermal governor 'bang_bang'623worker2 # [ 0.004848] CPU features: detected: Enhanced Counter Virtualization624worker1 # [ 0.005366] CPU features: detected: CRC32 instructions625client # [ 0.019202] thermal_sys: Registered thermal governor 'step_wise'626worker2 # [ 0.004851] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)627worker1 # [ 0.005369] CPU features: detected: Data cache clean to Point of Deep Persistence628client # [ 0.019207] thermal_sys: Registered thermal governor 'user_space'629worker2 # [ 0.004854] CPU features: detected: Enhanced Virtualization Traps630worker1 # [ 0.005372] CPU features: detected: Data cache clean to Point of Persistence631client # [ 0.019210] thermal_sys: Registered thermal governor 'power_allocator'632worker2 # [ 0.004857] CPU features: detected: Fine Grained Traps633worker1 # [ 0.005375] CPU features: detected: Data independent timing control (DIT)634client # [ 0.019234] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1635worker1 # [ 0.005378] CPU features: detected: E0PD636worker2 # [ 0.004861] CPU features: detected: Generic authentication (architected QARMA5 algorithm)637client # [ 0.019242] cpuidle: using governor ladder638worker1 # [ 0.005381] CPU features: detected: Enhanced Counter Virtualization639worker2 # [ 0.004865] CPU features: detected: RCpc load-acquire (LDAPR)640client # [ 0.019248] cpuidle: using governor menu641worker2 # [ 0.004868] CPU features: detected: LSE atomic instructions642worker1 # [ 0.005384] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)643client # [ 0.019464] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.644worker2 # [ 0.004871] CPU features: detected: Privileged Access Never645client # [ 0.019481] ASID allocator initialised with 65536 entries646worker1 # [ 0.005387] CPU features: detected: Enhanced Virtualization Traps647worker2 # [ 0.004873] CPU features: detected: PMUv3648client # [ 0.020691] Serial: AMBA PL011 UART driver649worker1 # [ 0.005390] CPU features: detected: Fine Grained Traps650worker2 # [ 0.004876] CPU features: detected: RAS Extension Support651client # [ 0.026053] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1652worker1 # [ 0.005394] CPU features: detected: Generic authentication (architected QARMA5 algorithm)653worker2 # [ 0.004879] CPU features: detected: RASv1p1 Extension Support654client # [ 0.026214] printk: console [ttyAMA0] enabled655worker1 # [ 0.005399] CPU features: detected: RCpc load-acquire (LDAPR)656worker2 # [ 0.004881] CPU features: detected: Random Number Generator657worker1 # [ 0.005402] CPU features: detected: LSE atomic instructions658worker2 # [ 0.004884] CPU features: detected: Speculation barrier (SB)659worker1 # [ 0.005405] CPU features: detected: Privileged Access Never660worker2 # [ 0.004887] CPU features: detected: Stage-2 Force Write-Back661worker1 # [ 0.005407] CPU features: detected: PMUv3662worker2 # [ 0.004889] CPU features: detected: TLB range maintenance instructions663worker1 # [ 0.005410] CPU features: detected: RAS Extension Support664worker2 # [ 0.004894] CPU features: detected: Speculative Store Bypassing Safe (SSBS)665worker1 # [ 0.005413] CPU features: detected: RASv1p1 Extension Support666worker2 # [ 0.004930] alternatives: applying system-wide alternatives667worker1 # [ 0.005416] CPU features: detected: Random Number Generator668worker1 # [ 0.005418] CPU features: detected: Speculation barrier (SB)669worker2 # [ 0.007890] CPU features: detected: BBM Level 2 without TLB conflict abort670worker1 # [ 0.005421] CPU features: detected: Stage-2 Force Write-Back671worker1 # [ 0.005424] CPU features: detected: TLB range maintenance instructions672worker2 # [ 0.008102] Memory: 1406532K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)673worker2 # [ 0.008521] devtmpfs: initialized674worker1 # [ 0.005429] CPU features: detected: Speculative Store Bypassing Safe (SSBS)675worker1 # [ 0.005468] alternatives: applying system-wide alternatives676worker2 # [ 0.010373] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)677worker1 # [ 0.008486] CPU features: detected: BBM Level 2 without TLB conflict abort678worker2 # [ 0.010396] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).679client # [ 0.147056] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages680worker2 # [ 0.010583] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL681client # [ 0.147077] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page682worker1 # [ 0.008671] Memory: 1406516K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)683worker2 # [ 0.010587] 0 pages in range for non-PLT usage684worker1 # [ 0.009058] devtmpfs: initialized685worker2 # [ 0.010588] 508288 pages in range for PLT usage686client # [ 0.147083] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages687worker2 # [ 0.010683] pinctrl core: initialized pinctrl subsystem688client # [ 0.147087] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page689worker2 # [ 0.011451] DMI not present or invalid.690client # [ 0.147091] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages691worker2 # [ 0.014615] NET: Registered PF_NETLINK/PF_ROUTE protocol family692client # [ 0.147096] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page693worker2 # [ 0.017009] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations694client # [ 0.147100] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages695worker2 # [ 0.017204] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations696client # [ 0.147104] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page697worker2 # [ 0.017413] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations698worker2 # [ 0.017435] audit: initializing netlink subsys (disabled)699worker2 # [ 0.018050] thermal_sys: Registered thermal governor 'fair_share'700lb # [ 0.217860] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)701client # [ 0.154614] fbcon: Taking over console702client # [ 0.154630] ACPI: Interpreter disabled.703lb # [ 0.217918] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)704client # [ 0.156562] iommu: Default domain type: Translated705lb # [ 0.217950] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)706client # [ 0.156573] iommu: DMA domain TLB invalidation policy: strict mode707worker1 # [ 0.010884] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)708lb # [ 0.218026] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)709lb # [ 0.218169] TCP: Hash tables configured (established 16384 bind 16384)710worker1 # [ 0.010906] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).711lb # [ 0.218260] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)712worker1 # [ 0.011105] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL713worker1 # [ 0.011110] 0 pages in range for non-PLT usage714lb # [ 0.218298] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)715worker1 # [ 0.011111] 508288 pages in range for PLT usage716lb # [ 0.218336] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)717worker1 # [ 0.011223] pinctrl core: initialized pinctrl subsystem718worker1 # [ 0.011978] DMI not present or invalid.719lb # [ 0.218426] NET: Registered PF_UNIX/PF_LOCAL protocol family720worker1 # [ 0.015136] NET: Registered PF_NETLINK/PF_ROUTE protocol family721lb # [ 0.218485] NET: Registered PF_XDP protocol family722lb # [ 0.218504] PCI: CLS 0 bytes, default 64723worker1 # [ 0.017476] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations724client # [ 0.163639] SCSI subsystem initialized725lb # [ 0.218764] Trying to unpack rootfs image as initramfs...726worker2 # [ 0.018052] thermal_sys: Registered thermal governor 'bang_bang'727worker1 # [ 0.017652] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations728worker2 # [ 0.018056] thermal_sys: Registered thermal governor 'step_wise'729client # [ 0.164339] usbcore: registered new interface driver usbfs730worker1 # [ 0.017847] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations731worker2 # [ 0.018061] thermal_sys: Registered thermal governor 'user_space'732client # [ 0.164381] usbcore: registered new interface driver hub733worker1 # [ 0.017868] audit: initializing netlink subsys (disabled)734worker2 # [ 0.018063] thermal_sys: Registered thermal governor 'power_allocator'735client # [ 0.164400] usbcore: registered new device driver usb736worker1 # [ 0.018486] thermal_sys: Registered thermal governor 'fair_share'737client # [ 0.164666] pps_core: LinuxPPS API ver. 1 registered738worker2 # [ 0.018094] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1739worker1 # [ 0.018488] thermal_sys: Registered thermal governor 'bang_bang'740worker2 # [ 0.018104] cpuidle: using governor ladder741client # [ 0.164672] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>742worker2 # [ 0.018110] cpuidle: using governor menu743worker1 # [ 0.018491] thermal_sys: Registered thermal governor 'step_wise'744client # [ 0.164682] PTP clock support registered745worker1 # [ 0.018496] thermal_sys: Registered thermal governor 'user_space'746worker2 # [ 0.018294] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.747client # [ 0.164730] EDAC MC: Ver: 3.0.0748worker2 # [ 0.018313] ASID allocator initialised with 65536 entries749worker1 # [ 0.018499] thermal_sys: Registered thermal governor 'power_allocator'750client # [ 0.169326] scmi_core: SCMI protocol bus registered751worker2 # [ 0.019553] Serial: AMBA PL011 UART driver752worker1 # [ 0.018523] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1753client # [ 0.170274] FPGA manager framework754worker2 # [ 0.024936] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1755worker1 # [ 0.018532] cpuidle: using governor ladder756lb # [ 0.233903] kvm [1]: HYP mode not available757worker1 # [ 0.018538] cpuidle: using governor menu758worker2 # [ 0.025103] printk: console [ttyAMA0] enabled759client # [ 0.171241] vgaarb: loaded760worker1 # [ 0.018723] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.761client # [ 0.171905] clocksource: Switched to clocksource arch_sys_counter762worker2 # [ 0.147458] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages763worker1 # [ 0.018739] ASID allocator initialised with 65536 entries764worker1 # [ 0.019886] Serial: AMBA PL011 UART driver765worker2 # [ 0.147479] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page766worker2 # [ 0.147485] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages767worker1 # [ 0.025067] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1768worker1 # [ 0.025231] printk: console [ttyAMA0] enabled769worker2 # [ 0.147489] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page770client # [ 0.175149] VFS: Disk quotas dquot_6.6.0771worker2 # [ 0.147493] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages772client # [ 0.175194] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)773worker1 # [ 0.146764] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages774worker2 # [ 0.147498] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page775worker1 # [ 0.146791] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page776worker2 # [ 0.147502] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages777worker1 # [ 0.146797] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages778worker2 # [ 0.147506] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page779worker1 # [ 0.146801] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page780client # [ 0.179018] netfs: FS-Cache loaded781worker1 # [ 0.146805] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages782client # [ 0.179142] pnp: PnP ACPI: disabled783worker1 # [ 0.146809] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page784worker2 # [ 0.155150] fbcon: Taking over console785worker2 # [ 0.155166] ACPI: Interpreter disabled.786worker1 # [ 0.146814] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages787worker1 # [ 0.146818] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page788client # [ 0.183112] NET: Registered PF_INET protocol family789worker1 # [ 0.154496] fbcon: Taking over console790worker1 # [ 0.154515] ACPI: Interpreter disabled.791client # [ 0.183428] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)792worker1 # [ 0.156420] iommu: Default domain type: Translated793worker1 # [ 0.156432] iommu: DMA domain TLB invalidation policy: strict mode794worker1 # [ 0.158160] SCSI subsystem initialized795worker2 # [ 0.164184] iommu: Default domain type: Translated796worker2 # [ 0.164206] iommu: DMA domain TLB invalidation policy: strict mode797worker2 # [ 0.165937] SCSI subsystem initialized798worker2 # [ 0.166634] usbcore: registered new interface driver usbfs799worker2 # [ 0.166669] usbcore: registered new interface driver hub800worker1 # [ 0.163316] usbcore: registered new interface driver usbfs801worker2 # [ 0.166688] usbcore: registered new device driver usb802worker1 # [ 0.163351] usbcore: registered new interface driver hub803worker2 # [ 0.166992] pps_core: LinuxPPS API ver. 1 registered804worker1 # [ 0.163371] usbcore: registered new device driver usb805worker1 # [ 0.163687] pps_core: LinuxPPS API ver. 1 registered806worker2 # [ 0.166999] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>807worker2 # [ 0.167009] PTP clock support registered808worker2 # [ 0.167062] EDAC MC: Ver: 3.0.0809worker1 # [ 0.163694] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>810worker1 # [ 0.163704] PTP clock support registered811worker2 # [ 0.171751] scmi_core: SCMI protocol bus registered812worker1 # [ 0.163754] EDAC MC: Ver: 3.0.0813worker1 # [ 0.168371] scmi_core: SCMI protocol bus registered814worker2 # [ 0.172742] FPGA manager framework815worker2 # [ 0.173696] vgaarb: loaded816worker1 # [ 0.169376] FPGA manager framework817worker1 # [ 0.170400] vgaarb: loaded818worker2 # [ 0.174339] clocksource: Switched to clocksource arch_sys_counter819worker1 # [ 0.171080] clocksource: Switched to clocksource arch_sys_counter820worker2 # [ 0.175024] VFS: Disk quotas dquot_6.6.0821worker2 # [ 0.175057] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)822worker2 # [ 0.179680] netfs: FS-Cache loaded823worker2 # [ 0.179794] pnp: PnP ACPI: disabled824worker1 # [ 0.177485] VFS: Disk quotas dquot_6.6.0825worker1 # [ 0.177528] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)826worker1 # [ 0.180135] netfs: FS-Cache loaded827worker1 # [ 0.180252] pnp: PnP ACPI: disabled828worker2 # [ 0.183779] NET: Registered PF_INET protocol family829worker2 # [ 0.184059] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)830worker1 # [ 0.184137] NET: Registered PF_INET protocol family831worker1 # [ 0.184424] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832client # [ 0.213398] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833client # [ 0.213453] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834client # [ 0.213482] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835client # [ 0.213554] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836client # [ 0.213696] TCP: Hash tables configured (established 16384 bind 16384)837client # [ 0.213781] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838client # [ 0.213817] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839client # [ 0.213854] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840client # [ 0.213982] NET: Registered PF_UNIX/PF_LOCAL protocol family841client # [ 0.214012] NET: Registered PF_XDP protocol family842client # [ 0.214032] PCI: CLS 0 bytes, default 64843client # [ 0.214270] Trying to unpack rootfs image as initramfs...844client # [ 0.229678] kvm [1]: HYP mode not available845worker2 # [ 0.214159] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846worker2 # [ 0.214215] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847worker2 # [ 0.214249] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)848worker2 # [ 0.214331] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849worker2 # [ 0.218554] TCP: Hash tables configured (established 16384 bind 16384)850worker2 # [ 0.218651] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)851worker1 # [ 0.214060] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)852worker2 # [ 0.218689] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)853worker1 # [ 0.214124] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)854worker2 # [ 0.218726] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)855worker1 # [ 0.214157] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)856worker2 # [ 0.218828] NET: Registered PF_UNIX/PF_LOCAL protocol family857worker2 # [ 0.218859] NET: Registered PF_XDP protocol family858worker1 # [ 0.214243] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)859worker2 # [ 0.218878] PCI: CLS 0 bytes, default 64860worker1 # [ 0.214418] TCP: Hash tables configured (established 16384 bind 16384)861worker2 # [ 0.219148] Trying to unpack rootfs image as initramfs...862worker1 # [ 0.214508] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)863worker1 # [ 0.214550] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)864worker1 # [ 0.214587] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)865worker2 # [ 0.232400] kvm [1]: HYP mode not available866worker1 # [ 0.214698] NET: Registered PF_UNIX/PF_LOCAL protocol family867worker1 # [ 0.214724] NET: Registered PF_XDP protocol family868worker1 # [ 0.214744] PCI: CLS 0 bytes, default 64869worker1 # [ 0.215008] Trying to unpack rootfs image as initramfs...870worker1 # [ 0.232906] kvm [1]: HYP mode not available871lb # [ 0.340591] Initialise system trusted keyrings872lb # [ 0.341392] workingset: timestamp_bits=42 max_order=19 bucket_order=0873lb # [ 0.342733] squashfs: version 4.0 (2009/01/31) Phillip Lougher874lb # [ 0.343504] 9p: Installing v9fs 9p2000 file system support875lb # [ 0.372296] Key type asymmetric registered876lb # [ 0.372329] Asymmetric key parser 'x509' registered877lb # [ 0.372405] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878lb # [ 0.374579] io scheduler mq-deadline registered879lb # [ 0.374593] io scheduler kyber registered880lb # [ 0.384158] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881lb # [ 0.385652] ledtrig-cpu: registered to indicate activity on CPUs882lb # [ 0.386048] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:883lb # [ 0.386067] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000884lb # [ 0.386080] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000885lb # [ 0.386088] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000886lb # [ 0.386117] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits887lb # [ 0.386144] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]888lb # [ 0.386226] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00889lb # [ 0.386235] pci_bus 0000:00: root bus resource [bus 00-ff]890lb # [ 0.386242] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]891lb # [ 0.386247] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]892lb # [ 0.386256] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]893lb # [ 0.386349] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint894lb # [ 0.386797] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint895lb # [ 0.386988] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]896lb # [ 0.387005] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]897lb # [ 0.387036] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]898lb # [ 0.387052] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]899lb # [ 0.387509] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint900lb # [ 0.387695] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]901lb # [ 0.387711] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]902client # [ 0.336462] Initialise system trusted keyrings903lb # [ 0.387740] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]904client # [ 0.337210] workingset: timestamp_bits=42 max_order=19 bucket_order=0905client # [ 0.338535] squashfs: version 4.0 (2009/01/31) Phillip Lougher906client # [ 0.339311] 9p: Installing v9fs 9p2000 file system support907lb # [ 0.412288] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint908lb # [ 0.412498] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]909lb # [ 0.412516] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]910lb # [ 0.412549] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]911lb # [ 0.413028] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint912lb # [ 0.413210] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]913lb # [ 0.413226] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]914lb # [ 0.413259] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915lb # [ 0.413709] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint916lb # [ 0.413889] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]917lb # [ 0.413905] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]918lb # [ 0.413936] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]919lb # [ 0.414387] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint920lb # [ 0.414569] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]921lb # [ 0.414585] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]922lb # [ 0.414615] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]923lb # [ 0.415062] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint924lb # [ 0.415245] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]925lb # [ 0.415261] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]926lb # [ 0.415290] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]927lb # [ 0.415306] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]928worker2 # [ 0.342328] Initialise system trusted keyrings929lb # [ 0.415806] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint930worker2 # [ 0.343145] workingset: timestamp_bits=42 max_order=19 bucket_order=0931client # [ 0.368020] Key type asymmetric registered932lb # [ 0.416013] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]933client # [ 0.368053] Asymmetric key parser 'x509' registered934worker1 # [ 0.339713] Initialise system trusted keyrings935worker2 # [ 0.344481] squashfs: version 4.0 (2009/01/31) Phillip Lougher936lb # [ 0.416041] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]937client # [ 0.368142] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)938worker1 # [ 0.340483] workingset: timestamp_bits=42 max_order=19 bucket_order=0939lb # [ 0.416492] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint940client # [ 0.370265] io scheduler mq-deadline registered941worker1 # [ 0.341766] squashfs: version 4.0 (2009/01/31) Phillip Lougher942client # [ 0.370277] io scheduler kyber registered943worker2 # [ 0.345248] 9p: Installing v9fs 9p2000 file system support944lb # [ 0.416677] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]945lb # [ 0.416706] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]946worker1 # [ 0.342548] 9p: Installing v9fs 9p2000 file system support947lb # [ 0.417106] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint948lb # [ 0.417289] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]949lb # [ 0.417538] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint950lb # [ 0.417841] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]951lb # [ 0.417859] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]952lb # [ 0.417889] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]953lb # [ 0.418351] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint954lb # [ 0.418534] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]955lb # [ 0.418550] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]956lb # [ 0.418579] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]957client # [ 0.380071] pl061_gpio 9030000.pl061: PL061 GPIO chip registered958lb # [ 0.419167] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned959lb # [ 0.419179] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned960lb # [ 0.419185] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned961lb # [ 0.419229] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned962client # [ 0.381530] ledtrig-cpu: registered to indicate activity on CPUs963lb # [ 0.419275] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned964client # [ 0.381908] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:965lb # [ 0.419320] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned966client # [ 0.381927] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000967lb # [ 0.419365] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned968client # [ 0.381939] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000969lb # [ 0.419411] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned970client # [ 0.381947] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000971lb # [ 0.419459] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned972client # [ 0.381970] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits973lb # [ 0.419505] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned974client # [ 0.382014] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]975lb # [ 0.419552] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned976client # [ 0.382094] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00977lb # [ 0.419598] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned978client # [ 0.382104] pci_bus 0000:00: root bus resource [bus 00-ff]979client # [ 0.382110] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]980lb # [ 0.419671] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned981client # [ 0.382115] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]982lb # [ 0.419717] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned983worker2 # [ 0.369241] Key type asymmetric registered984client # [ 0.382120] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]985lb # [ 0.419738] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned986worker2 # [ 0.369274] Asymmetric key parser 'x509' registered987client # [ 0.382181] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint988lb # [ 0.419760] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned989worker2 # [ 0.369350] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)990lb # [ 0.419782] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned991worker2 # [ 0.371521] io scheduler mq-deadline registered992client # [ 0.382623] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint993worker2 # [ 0.371531] io scheduler kyber registered994client # [ 0.382808] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]995lb # [ 0.419806] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned996client # [ 0.382824] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]997lb # [ 0.419828] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned998client # [ 0.382853] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]999lb # [ 0.419849] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1000client # [ 0.382869] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1001lb # [ 0.419871] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1002lb # [ 0.419893] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1003client # [ 0.383330] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1004worker1 # [ 0.371255] Key type asymmetric registered1005client # [ 0.383533] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1006worker1 # [ 0.371288] Asymmetric key parser 'x509' registered1007lb # [ 0.419915] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1008client # [ 0.383550] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1009lb # [ 0.419938] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1010worker1 # [ 0.371369] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1011client # [ 0.383579] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1012worker1 # [ 0.373453] io scheduler mq-deadline registered1013lb # [ 0.419962] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1014worker1 # [ 0.373465] io scheduler kyber registered1015lb # [ 0.419984] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1016client # [ 0.403175] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1017client # [ 0.403374] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1018client # [ 0.403401] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1019client # [ 0.403430] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1020client # [ 0.403882] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1021worker2 # [ 0.382447] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1022worker1 # [ 0.383230] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1023worker2 # [ 0.383884] ledtrig-cpu: registered to indicate activity on CPUs1024worker2 # [ 0.384272] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1025worker1 # [ 0.384657] ledtrig-cpu: registered to indicate activity on CPUs1026worker2 # [ 0.384290] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001027worker1 # [ 0.385058] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1028lb # [ 0.484034] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1029worker2 # [ 0.384302] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001030worker1 # [ 0.385075] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001031lb # [ 0.484102] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1032worker2 # [ 0.384310] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001033worker1 # [ 0.385087] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001034lb # [ 0.484127] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1035worker2 # [ 0.384330] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1036lb # [ 0.484150] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1037worker1 # [ 0.385095] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001038lb # [ 0.484173] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1039worker2 # [ 0.384351] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1040worker1 # [ 0.385118] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1041lb # [ 0.484196] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1042worker2 # [ 0.384426] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001043worker1 # [ 0.385144] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1044lb # [ 0.484223] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1045worker2 # [ 0.384435] pci_bus 0000:00: root bus resource [bus 00-ff]1046lb # [ 0.484247] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1047worker1 # [ 0.385239] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001048worker2 # [ 0.384441] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1049lb # [ 0.484283] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1050client # [ 0.416124] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1051worker1 # [ 0.385248] pci_bus 0000:00: root bus resource [bus 00-ff]1052worker2 # [ 0.384445] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1053lb # [ 0.484293] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1054client # [ 0.416156] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1055worker1 # [ 0.385254] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1056worker2 # [ 0.384451] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1057lb # [ 0.484298] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1058client # [ 0.416188] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1059worker1 # [ 0.385260] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1060lb # [ 0.485498] pci 0000:00:0a.0: enabling device (0000 -> 0002)1061worker2 # [ 0.384510] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1062worker1 # [ 0.385264] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1063client # [ 0.416692] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1064client # [ 0.416876] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1065worker2 # [ 0.384948] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1066worker1 # [ 0.385325] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1067client # [ 0.416891] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1068worker2 # [ 0.385133] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1069worker1 # [ 0.385770] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1070worker2 # [ 0.385150] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1071client # [ 0.416920] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1072worker1 # [ 0.385963] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1073worker2 # [ 0.385179] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1074worker1 # [ 0.385980] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1075client # [ 0.417381] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1076worker2 # [ 0.385195] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1077client # [ 0.417564] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1078worker1 # [ 0.386010] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1079client # [ 0.417579] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1080worker2 # [ 0.385641] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1081worker1 # [ 0.386027] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1082worker2 # [ 0.385819] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1083client # [ 0.417608] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1084worker1 # [ 0.386519] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1085worker2 # [ 0.385835] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1086worker1 # [ 0.386706] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1087client # [ 0.418092] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1088worker2 # [ 0.385864] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1089client # [ 0.418278] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1090worker1 # [ 0.386722] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1091client # [ 0.418294] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1092worker2 # [ 0.386303] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1093worker1 # [ 0.386752] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1094worker2 # [ 0.386510] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1095client # [ 0.418323] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1096worker2 # [ 0.386527] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1097client # [ 0.418339] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1098worker2 # [ 0.386555] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1099worker1 # [ 0.405932] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1100client # [ 0.418798] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1101worker1 # [ 0.406130] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1102worker2 # [ 0.387056] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1103client # [ 0.418983] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1104worker1 # [ 0.406146] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1105worker2 # [ 0.387247] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1106client # [ 0.419013] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1107worker2 # [ 0.387263] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1108worker1 # [ 0.406176] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1109client # [ 0.419484] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1110worker2 # [ 0.387295] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1111worker1 # [ 0.406665] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1112client # [ 0.419675] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1113worker1 # [ 0.406852] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1114worker2 # [ 0.387742] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1115client # [ 0.419705] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1116worker1 # [ 0.406868] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1117worker2 # [ 0.387919] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1118client # [ 0.420131] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1119worker2 # [ 0.387935] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1120worker1 # [ 0.406900] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1121client # [ 0.420316] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1122worker2 # [ 0.387964] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1123client # [ 0.420576] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1124worker2 # [ 0.388406] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1125client # [ 0.420884] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1126worker2 # [ 0.388586] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1127client # [ 0.420902] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1128worker2 # [ 0.388601] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1129client # [ 0.420931] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1130worker2 # [ 0.388630] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131client # [ 0.421402] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1132worker2 # [ 0.389101] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1133lb # [ 0.514880] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1134worker2 # [ 0.389284] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1135client # [ 0.421584] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1136client # [ 0.421599] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1137worker2 # [ 0.389300] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1138client # [ 0.421632] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1139worker2 # [ 0.389329] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1140client # [ 0.422216] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1141worker2 # [ 0.389345] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1142client # [ 0.422227] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1143worker2 # [ 0.389835] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1144client # [ 0.422232] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1145worker2 # [ 0.390020] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1146worker2 # [ 0.390053] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1147client # [ 0.422277] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1148client # [ 0.422329] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1149client # [ 0.422378] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1150client # [ 0.422424] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1151client # [ 0.422469] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1152worker1 # [ 0.419440] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1153worker1 # [ 0.419644] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1154client # [ 0.422517] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1155worker1 # [ 0.419661] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1156client # [ 0.422564] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1157worker1 # [ 0.419691] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1158lb # [ 0.525770] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1159client # [ 0.422611] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1160worker1 # [ 0.420148] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1161client # [ 0.422657] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1162worker1 # [ 0.420334] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1163worker1 # [ 0.420350] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1164client # [ 0.422725] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1165worker1 # [ 0.420379] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1166client # [ 0.422771] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1167lb # [ 0.528901] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1168client # [ 0.422792] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1169worker1 # [ 0.420831] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1170worker2 # [ 0.434618] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1171worker1 # [ 0.421018] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1172lb # [ 0.531175] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1173client # [ 0.422813] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1174worker2 # [ 0.434843] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1175worker1 # [ 0.421034] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1176client # [ 0.422835] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1177worker2 # [ 0.434874] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1178worker1 # [ 0.421063] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1179client # [ 0.422859] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1180worker1 # [ 0.421080] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1181worker2 # [ 0.435289] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1182client # [ 0.422881] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1183worker2 # [ 0.435476] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1184worker1 # [ 0.421568] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1185client # [ 0.422903] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1186worker1 # [ 0.421756] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1187worker2 # [ 0.435721] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1188client # [ 0.422924] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1189worker1 # [ 0.421785] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1190worker2 # [ 0.436025] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1191client # [ 0.422947] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1192worker2 # [ 0.436043] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1193worker1 # [ 0.422243] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1194client # [ 0.422969] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1195worker2 # [ 0.436075] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1196worker1 # [ 0.422449] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1197client # [ 0.422991] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1198worker2 # [ 0.436552] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1199worker1 # [ 0.422481] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1200client # [ 0.423013] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1201worker2 # [ 0.436738] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1202client # [ 0.423034] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1203worker1 # [ 0.422888] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1204worker2 # [ 0.436753] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1205client # [ 0.423055] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1206worker1 # [ 0.423075] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1207worker2 # [ 0.436783] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1208client # [ 0.423076] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1209worker1 # [ 0.423354] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1210worker2 # [ 0.437365] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1211client # [ 0.423099] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1212worker1 # [ 0.423661] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1213client # [ 0.423120] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1214worker2 # [ 0.437377] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1215worker1 # [ 0.423679] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1216client # [ 0.423141] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1217worker1 # [ 0.423712] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1218worker2 # [ 0.437382] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1219lb # [ 0.541490] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1220client # [ 0.423162] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1221lb # [ 0.543951] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1222worker2 # [ 0.437428] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1223worker1 # [ 0.424182] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1224client # [ 0.423184] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1225worker1 # [ 0.424366] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1226worker2 # [ 0.437475] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1227client # [ 0.423206] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1228worker1 # [ 0.424383] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1229client # [ 0.423233] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1230worker2 # [ 0.437526] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1231worker1 # [ 0.424412] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1232client # [ 0.423242] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1233worker2 # [ 0.437573] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1234lb # [ 0.547631] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1235worker1 # [ 0.425020] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1236client # [ 0.423246] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1237worker1 # [ 0.425032] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1238worker2 # [ 0.437624] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1239worker2 # [ 0.437672] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1240worker1 # [ 0.425038] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1241worker2 # [ 0.437723] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1242worker1 # [ 0.425086] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1243worker1 # [ 0.425133] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1244worker2 # [ 0.437772] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1245worker1 # [ 0.425180] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1246worker2 # [ 0.437819] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1247worker1 # [ 0.425228] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1248worker2 # [ 0.437889] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1249worker2 # [ 0.437934] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1250worker1 # [ 0.425275] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1251worker2 # [ 0.437956] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1252worker1 # [ 0.425323] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1253worker2 # [ 0.437977] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1254worker1 # [ 0.425370] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1255worker2 # [ 0.437999] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1256worker1 # [ 0.425417] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1257worker2 # [ 0.438024] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1258worker2 # [ 0.438045] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1259worker1 # [ 0.425467] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1260client # [ 0.488545] pci 0000:00:0a.0: enabling device (0000 -> 0002)1261lb # [ 0.556793] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1262worker2 # [ 0.438067] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1263worker1 # [ 0.425539] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1264lb # [ 0.559182] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1265worker2 # [ 0.438088] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1266worker1 # [ 0.425586] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1267worker2 # [ 0.438110] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1268worker1 # [ 0.425608] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1269worker2 # [ 0.438131] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1270worker1 # [ 0.425630] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1271worker2 # [ 0.438154] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1272worker1 # [ 0.425652] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1273worker2 # [ 0.438176] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1274worker1 # [ 0.425677] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1275worker2 # [ 0.438197] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1276worker1 # [ 0.425699] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1277worker2 # [ 0.438218] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1278worker1 # [ 0.425721] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1279worker2 # [ 0.438239] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1280worker1 # [ 0.425743] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1281worker2 # [ 0.438262] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1282worker1 # [ 0.425765] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1283worker2 # [ 0.438284] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1284worker1 # [ 0.425788] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1285worker2 # [ 0.438306] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1286worker1 # [ 0.425813] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1287worker2 # [ 0.438327] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1288worker1 # [ 0.425836] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1289worker1 # [ 0.425857] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1290worker1 # [ 0.425878] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1291worker1 # [ 0.425900] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1292worker1 # [ 0.425922] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1293worker1 # [ 0.425944] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1294worker1 # [ 0.425965] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1295worker1 # [ 0.425987] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1296worker1 # [ 0.426009] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1297worker1 # [ 0.426032] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1298worker1 # [ 0.426059] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1299worker1 # [ 0.426069] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1300worker1 # [ 0.426074] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1301worker2 # [ 0.482392] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1302lb # [ 0.577509] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1303worker2 # [ 0.482431] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1304worker2 # [ 0.482466] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1305worker2 # [ 0.482475] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1306client # [ 0.509456] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1307worker2 # [ 0.482480] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1308client # [ 0.511661] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1309worker2 # [ 0.483669] pci 0000:00:0a.0: enabling device (0000 -> 0002)1310lb # [ 0.581074] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1311worker1 # [ 0.487342] pci 0000:00:0a.0: enabling device (0000 -> 0002)1312client # [ 0.522351] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1313lb # [ 0.593285] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1314lb # [ 0.596068] msm_serial: driver initialized1315lb # [ 0.596222] SuperH (H)SCI(F) driver initialized1316lb # [ 0.596279] STM32 USART driver initialized1317client # [ 0.528616] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1318client # [ 0.531106] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1319worker2 # [ 0.513077] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1320worker1 # [ 0.508426] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1321worker2 # [ 0.516261] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1322client # [ 0.541466] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1323client # [ 0.543736] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1324worker1 # [ 0.519255] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1325worker1 # [ 0.523057] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1326worker2 # [ 0.526494] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1327worker2 # [ 0.528753] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1328worker2 # [ 0.532694] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1329client # [ 0.556228] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1330client # [ 0.558607] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1331lb # [ 0.630161] loop: module loaded1332lb # [ 0.630368] virtio_blk virtio5: 1/0/0 default/read/poll queues1333lb # [ 0.631159] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1334worker1 # [ 0.532533] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1335worker2 # [ 0.538962] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1336lb # [ 0.636731] megasas: 07.734.00.00-rc11337lb # [ 0.637590] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1338worker1 # [ 0.539256] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1339client # [ 0.568561] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1340lb # [ 0.639672] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001341worker1 # [ 0.541419] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1342client # [ 0.571508] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1343lb # [ 0.639699] Intel/Sharp Extended Query Table at 0x00311344worker2 # [ 0.546552] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1345worker2 # [ 0.548786] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1346lb # [ 0.649554] Using buffer write method1347lb # [ 0.649640] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1348lb # [ 0.651331] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001349lb # [ 0.651365] Intel/Sharp Extended Query Table at 0x00311350worker2 # [ 0.558585] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1351worker2 # [ 0.560558] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1352worker1 # [ 0.551346] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1353worker1 # [ 0.555196] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1354client # [ 0.589156] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1355worker1 # [ 0.557495] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1356lb # [ 0.665238] Using buffer write method1357lb # [ 0.665283] Concatenating MTD devices:1358lb # [ 0.665287] (0): "0.flash"1359lb # [ 0.665291] (1): "0.flash"1360lb # [ 0.665295] into device "0.flash"1361worker2 # [ 0.570624] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1362client # [ 0.596948] msm_serial: driver initialized1363client # [ 0.597104] SuperH (H)SCI(F) driver initialized1364worker1 # [ 0.567687] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1365client # [ 0.597158] STM32 USART driver initialized1366worker1 # [ 0.570181] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1367worker2 # [ 0.587739] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1368worker1 # [ 0.588330] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1369worker2 # [ 0.590587] msm_serial: driver initialized1370worker2 # [ 0.590799] SuperH (H)SCI(F) driver initialized1371worker1 # [ 0.591074] msm_serial: driver initialized1372worker2 # [ 0.590854] STM32 USART driver initialized1373worker1 # [ 0.591804] SuperH (H)SCI(F) driver initialized1374worker1 # [ 0.591863] STM32 USART driver initialized1375client # [ 0.627263] loop: module loaded1376client # [ 0.627509] virtio_blk virtio5: 1/0/0 default/read/poll queues1377client # [ 0.636567] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1378client # [ 0.640050] megasas: 07.734.00.00-rc11379client # [ 0.640791] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1380client # [ 0.646592] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001381client # [ 0.646636] Intel/Sharp Extended Query Table at 0x00311382worker2 # [ 0.631171] loop: module loaded1383worker2 # [ 0.631408] virtio_blk virtio5: 1/0/0 default/read/poll queues1384worker1 # [ 0.627718] loop: module loaded1385worker1 # [ 0.627932] virtio_blk virtio5: 1/0/0 default/read/poll queues1386worker2 # [ 0.632277] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1387client # [ 0.656656] Using buffer write method1388worker1 # [ 0.628721] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1389client # [ 0.656765] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1390client # [ 0.658637] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001391client # [ 0.658715] Intel/Sharp Extended Query Table at 0x00311392client # [ 0.663877] Using buffer write method1393client # [ 0.663948] Concatenating MTD devices:1394client # [ 0.663953] (0): "0.flash"1395client # [ 0.663958] (1): "0.flash"1396client # [ 0.663961] into device "0.flash"1397worker2 # [ 0.639268] megasas: 07.734.00.00-rc11398worker2 # [ 0.640080] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1399worker2 # [ 0.644350] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001400worker2 # [ 0.644426] Intel/Sharp Extended Query Table at 0x00311401worker2 # [ 0.646140] Using buffer write method1402worker2 # [ 0.646232] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1403worker1 # [ 0.639833] megasas: 07.734.00.00-rc11404worker1 # [ 0.640589] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1405worker1 # [ 0.642618] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001406worker1 # [ 0.642648] Intel/Sharp Extended Query Table at 0x00311407worker1 # [ 0.644499] Using buffer write method1408worker1 # [ 0.644575] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1409worker1 # [ 0.646700] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001410worker1 # [ 0.646736] Intel/Sharp Extended Query Table at 0x00311411worker2 # [ 0.659720] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001412worker2 # [ 0.659780] Intel/Sharp Extended Query Table at 0x00311413worker2 # [ 0.661636] Using buffer write method1414worker2 # [ 0.661678] Concatenating MTD devices:1415worker2 # [ 0.661682] (0): "0.flash"1416worker1 # [ 0.660108] Using buffer write method1417worker2 # [ 0.661686] (1): "0.flash"1418worker1 # [ 0.660167] Concatenating MTD devices:1419worker2 # [ 0.661689] into device "0.flash"1420worker1 # [ 0.660172] (0): "0.flash"1421worker1 # [ 0.660176] (1): "0.flash"1422worker1 # [ 0.660180] into device "0.flash"1423lb # [ 0.941830] Freeing initrd memory: 26140K1424lb # [ 0.947841] tun: Universal TUN/TAP device driver, 1.61425lb # [ 0.951060] thunder_xcv, ver 1.01426lb # [ 0.951102] thunder_bgx, ver 1.01427lb # [ 0.951124] nicpf, ver 1.01428lb # [ 0.951684] e1000: Intel(R) PRO/1000 Network Driver1429lb # [ 0.951692] e1000: Copyright (c) 1999-2006 Intel Corporation.1430lb # [ 0.951717] e1000e: Intel(R) PRO/1000 Network Driver1431lb # [ 0.951726] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432lb # [ 0.951756] igb: Intel(R) Gigabit Ethernet Network Driver1433lb # [ 0.951761] igb: Copyright (c) 2007-2014 Intel Corporation.1434lb # [ 0.951784] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435lb # [ 0.951790] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436lb # [ 0.951927] sky2: driver version 1.301437lb # [ 0.961474] usbcore: registered new interface driver usb-storage1438lb # [ 0.961570] usbcore: registered new interface driver usbserial_generic1439lb # [ 0.961585] usbserial: USB Serial support registered for generic1440lb # [ 0.962201] hv_vmbus: registering driver hyperv_keyboard1441lb # [ 0.963479] ehci-pci 0000:00:0a.0: EHCI Host Controller1442lb # [ 0.963504] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11443lb # [ 0.963710] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001444lb # [ 0.969309] rtc-pl031 9010000.pl031: registered as rtc01445lb # [ 0.969344] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:30 UTC (1789892190)1446lb # [ 0.969724] i2c_dev: i2c /dev entries driver1447lb # [ 0.972739] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001448lb # [ 0.973206] hub 1-0:1.0: USB hub found1449lb # [ 0.973226] hub 1-0:1.0: 6 ports detected1450lb # [ 0.977362] sdhci: Secure Digital Host Controller Interface driver1451lb # [ 0.977377] sdhci: Copyright(c) Pierre Ossman1452lb # [ 0.977652] Synopsys Designware Multimedia Card Interface Driver1453lb # [ 0.978029] sdhci-pltfm: SDHCI platform and OF driver helper1454lb # [ 0.979799] hid: raw HID events driver (C) Jiri Kosina1455lb # [ 0.983435] usbcore: registered new interface driver usbhid1456lb # [ 0.983444] usbhid: USB HID core driver1457lb # [ 0.985912] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1458lb # [ 0.987467] drop_monitor: Initializing network drop monitor service1459lb # [ 0.987646] NET: Registered PF_INET6 protocol family1460lb # [ 0.990783] Segment Routing with IPv61461lb # [ 0.990804] In-situ OAM (IOAM) with IPv61462lb # [ 0.990834] NET: Registered PF_PACKET protocol family1463lb # [ 0.992536] 9pnet: Installing 9P2000 support1464lb # [ 0.994834] Key type dns_resolver registered1465lb # [ 1.002032] registered taskstats version 11466lb # [ 1.002186] Loading compiled-in X.509 certificates1467client # [ 0.935596] Freeing initrd memory: 26160K1468client # [ 0.941801] tun: Universal TUN/TAP device driver, 1.61469lb # [ 1.010991] Demotion targets for Node 0: null1470lb # [ 1.011110] Key type .fscrypt registered1471lb # [ 1.011117] Key type fscrypt-provisioning registered1472lb # [ 1.011216] ima: No TPM chip found, activating TPM-bypass!1473lb # [ 1.011235] ima: Allocated hash algorithm: sha11474lb # [ 1.011262] ima: No architecture policies found1475lb # [ 1.015544] input: gpio-keys as /devices/platform/gpio-keys/input/input01476client # [ 0.945757] thunder_xcv, ver 1.01477client # [ 0.945809] thunder_bgx, ver 1.01478client # [ 0.945832] nicpf, ver 1.01479client # [ 0.946375] e1000: Intel(R) PRO/1000 Network Driver1480client # [ 0.946382] e1000: Copyright (c) 1999-2006 Intel Corporation.1481client # [ 0.946407] e1000e: Intel(R) PRO/1000 Network Driver1482client # [ 0.946417] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1483client # [ 0.946447] igb: Intel(R) Gigabit Ethernet Network Driver1484client # [ 0.946452] igb: Copyright (c) 2007-2014 Intel Corporation.1485client # [ 0.946476] igbvf: Intel(R) Gigabit Virtual Function Network Driver1486client # [ 0.946482] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1487client # [ 0.946610] sky2: driver version 1.301488client # [ 0.955970] ehci-pci 0000:00:0a.0: EHCI Host Controller1489client # [ 0.956002] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11490client # [ 0.956172] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001491client # [ 0.958892] usbcore: registered new interface driver usb-storage1492client # [ 0.958949] usbcore: registered new interface driver usbserial_generic1493client # [ 0.958964] usbserial: USB Serial support registered for generic1494client # [ 0.959623] hv_vmbus: registering driver hyperv_keyboard1495worker2 # [ 0.935044] Freeing initrd memory: 26148K1496worker1 # [ 0.934055] Freeing initrd memory: 26148K1497client # [ 0.963539] rtc-pl031 9010000.pl031: registered as rtc01498client # [ 0.963577] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:30 UTC (1789892190)1499client # [ 0.963882] i2c_dev: i2c /dev entries driver1500worker2 # [ 0.941148] tun: Universal TUN/TAP device driver, 1.61501lb # [ 1.034021] clk: Disabling unused clocks1502lb # [ 1.034056] PM: genpd: Disabling unused power domains1503lb # [ 1.038338] Freeing unused kernel memory: 4736K1504worker1 # [ 0.940204] tun: Universal TUN/TAP device driver, 1.61505lb # [ 1.038509] Run /init as init process1506worker2 # [ 0.945026] thunder_xcv, ver 1.01507worker2 # [ 0.945074] thunder_bgx, ver 1.01508worker2 # [ 0.945096] nicpf, ver 1.01509client # [ 0.969028] sdhci: Secure Digital Host Controller Interface driver1510worker2 # [ 0.945640] e1000: Intel(R) PRO/1000 Network Driver1511client # [ 0.969040] sdhci: Copyright(c) Pierre Ossman1512worker2 # [ 0.945648] e1000: Copyright (c) 1999-2006 Intel Corporation.1513client # [ 0.969303] Synopsys Designware Multimedia Card Interface Driver1514worker2 # [ 0.945673] e1000e: Intel(R) PRO/1000 Network Driver1515client # [ 0.969665] sdhci-pltfm: SDHCI platform and OF driver helper1516worker2 # [ 0.945682] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1517client # [ 0.971349] hid: raw HID events driver (C) Jiri Kosina1518worker2 # [ 0.945713] igb: Intel(R) Gigabit Ethernet Network Driver1519client # [ 0.971592] usbcore: registered new interface driver usbhid1520worker2 # [ 0.945719] igb: Copyright (c) 2007-2014 Intel Corporation.1521client # [ 0.971598] usbhid: USB HID core driver1522worker2 # [ 0.945741] igbvf: Intel(R) Gigabit Virtual Function Network Driver1523worker1 # [ 0.944120] thunder_xcv, ver 1.01524worker2 # [ 0.945747] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1525client # [ 0.976469] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001526worker1 # [ 0.944167] thunder_bgx, ver 1.01527worker2 # [ 0.945883] sky2: driver version 1.301528client # [ 0.976804] hub 1-0:1.0: USB hub found1529worker1 # [ 0.944190] nicpf, ver 1.01530client # [ 0.976825] hub 1-0:1.0: 6 ports detected1531worker1 # [ 0.944739] e1000: Intel(R) PRO/1000 Network Driver1532worker1 # [ 0.944746] e1000: Copyright (c) 1999-2006 Intel Corporation.1533worker1 # [ 0.944778] e1000e: Intel(R) PRO/1000 Network Driver1534client # [ 0.979660] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1535worker1 # [ 0.944790] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1536worker1 # [ 0.944824] igb: Intel(R) Gigabit Ethernet Network Driver1537worker1 # [ 0.944833] igb: Copyright (c) 2007-2014 Intel Corporation.1538worker2 # [ 0.954875] usbcore: registered new interface driver usb-storage1539worker1 # [ 0.944859] igbvf: Intel(R) Gigabit Virtual Function Network Driver1540client # [ 0.982283] drop_monitor: Initializing network drop monitor service1541worker2 # [ 0.954980] usbcore: registered new interface driver usbserial_generic1542worker1 # [ 0.944868] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1543client # [ 0.982464] NET: Registered PF_INET6 protocol family1544worker1 # [ 0.945003] sky2: driver version 1.301545worker2 # [ 0.954995] usbserial: USB Serial support registered for generic1546client # [ 0.984379] Segment Routing with IPv61547worker2 # [ 0.955614] hv_vmbus: registering driver hyperv_keyboard1548worker1 # [ 0.946645] usbcore: registered new interface driver usb-storage1549client # [ 0.984406] In-situ OAM (IOAM) with IPv61550worker2 # [ 0.956998] ehci-pci 0000:00:0a.0: EHCI Host Controller1551lb # [ 1.054453] systemd[1]: Successfully made /usr/ read-only.1552worker1 # [ 0.946711] usbcore: registered new interface driver usbserial_generic1553client # [ 0.984436] NET: Registered PF_PACKET protocol family1554worker2 # [ 0.957026] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11555worker1 # [ 0.946729] usbserial: USB Serial support registered for generic1556worker1 # [ 0.947857] ehci-pci 0000:00:0a.0: EHCI Host Controller1557worker2 # [ 0.957316] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001558worker1 # [ 0.947885] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11559client # [ 0.986012] 9pnet: Installing 9P2000 support1560worker1 # [ 0.948184] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001561worker2 # [ 0.962810] rtc-pl031 9010000.pl031: registered as rtc01562worker1 # [ 0.959784] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001563worker2 # [ 0.962841] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:30 UTC (1789892190)1564worker1 # [ 0.960201] hub 1-0:1.0: USB hub found1565worker2 # [ 0.963213] i2c_dev: i2c /dev entries driver1566worker1 # [ 0.960222] hub 1-0:1.0: 6 ports detected1567client # [ 0.988884] Key type dns_resolver registered1568worker1 # [ 0.962624] hv_vmbus: registering driver hyperv_keyboard1569worker1 # [ 0.964160] rtc-pl031 9010000.pl031: registered as rtc01570worker2 # [ 0.968208] sdhci: Secure Digital Host Controller Interface driver1571worker1 # [ 0.964191] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:30 UTC (1789892190)1572worker2 # [ 0.968220] sdhci: Copyright(c) Pierre Ossman1573client # [ 0.995180] registered taskstats version 11574worker1 # [ 0.964506] i2c_dev: i2c /dev entries driver1575client # [ 0.995339] Loading compiled-in X.509 certificates1576worker2 # [ 0.968490] Synopsys Designware Multimedia Card Interface Driver1577worker2 # [ 0.968896] sdhci-pltfm: SDHCI platform and OF driver helper1578worker2 # [ 0.973070] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001579worker2 # [ 0.973420] hub 1-0:1.0: USB hub found1580worker2 # [ 0.973451] hub 1-0:1.0: 6 ports detected1581worker1 # [ 0.969426] sdhci: Secure Digital Host Controller Interface driver1582worker1 # [ 0.969441] sdhci: Copyright(c) Pierre Ossman1583worker1 # [ 0.969714] Synopsys Designware Multimedia Card Interface Driver1584worker2 # [ 0.975797] hid: raw HID events driver (C) Jiri Kosina1585worker1 # [ 0.970097] sdhci-pltfm: SDHCI platform and OF driver helper1586worker2 # [ 0.976082] usbcore: registered new interface driver usbhid1587worker2 # [ 0.976094] usbhid: USB HID core driver1588worker1 # [ 0.974524] hid: raw HID events driver (C) Jiri Kosina1589worker1 # [ 0.974767] usbcore: registered new interface driver usbhid1590client # [ 1.004374] Demotion targets for Node 0: null1591worker1 # [ 0.974774] usbhid: USB HID core driver1592client # [ 1.004514] Key type .fscrypt registered1593client # [ 1.004521] Key type fscrypt-provisioning registered1594worker2 # [ 0.979025] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1595client # [ 1.004624] ima: No TPM chip found, activating TPM-bypass!1596worker2 # [ 0.980555] drop_monitor: Initializing network drop monitor service1597client # [ 1.004643] ima: Allocated hash algorithm: sha11598worker2 # [ 0.980709] NET: Registered PF_INET6 protocol family1599client # [ 1.004667] ima: No architecture policies found1600worker2 # [ 0.983794] Segment Routing with IPv61601worker1 # [ 0.977646] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1602worker2 # [ 0.983813] In-situ OAM (IOAM) with IPv61603client # [ 1.008749] input: gpio-keys as /devices/platform/gpio-keys/input/input01604worker2 # [ 0.983843] NET: Registered PF_PACKET protocol family1605worker1 # [ 0.980259] drop_monitor: Initializing network drop monitor service1606worker1 # [ 0.980408] NET: Registered PF_INET6 protocol family1607worker2 # [ 0.985472] 9pnet: Installing 9P2000 support1608worker1 # [ 0.982328] Segment Routing with IPv61609worker1 # [ 0.982359] In-situ OAM (IOAM) with IPv61610worker1 # [ 0.982407] NET: Registered PF_PACKET protocol family1611worker2 # [ 0.988268] Key type dns_resolver registered1612worker1 # [ 0.984249] 9pnet: Installing 9P2000 support1613worker1 # [ 0.986534] Key type dns_resolver registered1614worker2 # [ 0.994840] registered taskstats version 11615worker2 # [ 0.994994] Loading compiled-in X.509 certificates1616worker1 # [ 0.993588] registered taskstats version 11617worker1 # [ 0.993746] Loading compiled-in X.509 certificates1618client # [ 1.026627] clk: Disabling unused clocks1619client # [ 1.026661] PM: genpd: Disabling unused power domains1620worker2 # [ 1.003876] Demotion targets for Node 0: null1621worker2 # [ 1.003998] Key type .fscrypt registered1622worker2 # [ 1.004005] Key type fscrypt-provisioning registered1623worker2 # [ 1.004111] ima: No TPM chip found, activating TPM-bypass!1624worker2 # [ 1.004134] ima: Allocated hash algorithm: sha11625client # [ 1.030949] Freeing unused kernel memory: 4736K1626client # [ 1.031158] Run /init as init process1627worker2 # [ 1.004159] ima: No architecture policies found1628worker1 # [ 1.002643] Demotion targets for Node 0: null1629worker1 # [ 1.002766] Key type .fscrypt registered1630worker1 # [ 1.002772] Key type fscrypt-provisioning registered1631worker2 # [ 1.008397] input: gpio-keys as /devices/platform/gpio-keys/input/input01632worker1 # [ 1.002870] ima: No TPM chip found, activating TPM-bypass!1633worker1 # [ 1.002889] ima: Allocated hash algorithm: sha11634worker1 # [ 1.002913] ima: No architecture policies found1635worker1 # [ 1.007015] input: gpio-keys as /devices/platform/gpio-keys/input/input01636client # [ 1.046287] systemd[1]: Successfully made /usr/ read-only.1637worker2 # [ 1.026859] clk: Disabling unused clocks1638worker2 # [ 1.026892] PM: genpd: Disabling unused power domains1639worker1 # [ 1.025244] clk: Disabling unused clocks1640worker2 # [ 1.031184] Freeing unused kernel memory: 4736K1641worker1 # [ 1.025275] PM: genpd: Disabling unused power domains1642worker2 # [ 1.031378] Run /init as init process1643worker1 # [ 1.029574] Freeing unused kernel memory: 4736K1644worker1 # [ 1.029774] Run /init as init process1645worker2 # [ 1.048705] systemd[1]: Successfully made /usr/ read-only.1646worker1 # [ 1.045412] systemd[1]: Successfully made /usr/ read-only.1647lb # [ 1.220099] usb 1-1: new high-speed USB device number 2 using ehci-pci1648client # [ 1.223966] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.207185] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker2 # [ 1.218435] usb 1-1: new high-speed USB device number 2 using ehci-pci1651lb # [ 1.374509] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652lb # [ 1.389343] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653lb # [ 1.401903] systemd[1]: Detected virtualization qemu.1654lb # [ 1.403973] systemd[1]: Detected architecture arm64.1655lb # [ 1.405993] systemd[1]: Running in initrd.1656lb # [ 1.408760] systemd[1]: Initializing machine ID from random generator.1657lb # [ 1.411678] systemd[1]: Hostname set to <lb>.1658client # [ 1.371504] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659client # [ 1.381018] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1660client # [ 1.385280] systemd[1]: Detected virtualization qemu.1661client # [ 1.386038] systemd[1]: Detected architecture arm64.1662client # [ 1.386691] systemd[1]: Running in initrd.1663client # [ 1.387753] systemd[1]: Initializing machine ID from random generator.1664client # [ 1.388810] systemd[1]: Hostname set to <client>.1665lb # [ 1.456401] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01666worker1 # [ 1.363541] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11667worker2 # [ 1.372390] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11668worker2 # [ 1.383410] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1669worker2 # [ 1.389276] systemd[1]: Detected virtualization qemu.1670worker2 # [ 1.390279] systemd[1]: Detected architecture arm64.1671worker2 # [ 1.391213] systemd[1]: Running in initrd.1672worker1 # [ 1.380209] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1673worker2 # [ 1.392448] systemd[1]: Initializing machine ID from random generator.1674worker1 # [ 1.388652] systemd[1]: Detected virtualization qemu.1675worker2 # [ 1.393805] systemd[1]: Hostname set to <worker2>.1676worker1 # [ 1.390031] systemd[1]: Detected architecture arm64.1677worker1 # [ 1.391351] systemd[1]: Running in initrd.1678worker1 # [ 1.393043] systemd[1]: Initializing machine ID from random generator.1679worker1 # [ 1.394883] systemd[1]: Hostname set to <worker1>.1680client # [ 1.456146] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681worker1 # [ 1.443350] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682worker2 # [ 1.458603] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683lb # [ 1.580071] usb 1-2: new high-speed USB device number 3 using ehci-pci1684client # [ 1.576051] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker1 # [ 1.563188] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker2 # [ 1.578470] usb 1-2: new high-speed USB device number 3 using ehci-pci1687client # [ 1.638455] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688lb # [ 1.741370] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689lb # [ 1.744876] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690lb # [ 1.745284] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691worker2 # [ 1.664605] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692client # [ 1.720526] systemd[1]: Queued start job for default target Initrd Default Target.1693worker1 # [ 1.691358] systemd[1]: bpf-restrict-fs: LSM BPF program attached1694client # [ 1.727896] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21695client # [ 1.733092] systemd[1]: Created slice Slice /system/modprobe.1696client # [ 1.734089] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697client # [ 1.736503] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1698client # [ 1.737889] systemd[1]: Expecting device /dev/disk/by-label/nixos...1699client # [ 1.738910] systemd[1]: Reached target Path Units.1700client # [ 1.739702] systemd[1]: Reached target Slice Units.1701client # [ 1.740559] systemd[1]: Reached target Swaps.1702client # [ 1.741276] systemd[1]: Reached target Timer Units.1703client # [ 1.742326] systemd[1]: Listening on D-Bus System Message Bus Socket.1704client # [ 1.743735] systemd[1]: Listening on Journal Socket (/dev/log).1705client # [ 1.744954] systemd[1]: Listening on Journal Sockets.1706client # [ 1.745097] systemd[1]: Listening on udev Control Socket.1707client # [ 1.745225] systemd[1]: Listening on udev Kernel Socket.1708client # [ 1.745248] systemd[1]: Reached target Socket Units.1709client # [ 1.750295] systemd[1]: Starting Create List of Static Device Nodes...1710worker1 # [ 1.723895] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21711worker2 # [ 1.733561] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21712client # [ 1.760077] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1713client # [ 1.760182] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1714worker1 # [ 1.731374] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01715worker2 # [ 1.736914] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01716client # [ 1.764046] systemd[1]: Mounting Kernel Configuration File System...1717client # [ 1.775719] systemd[1]: Starting Journal Service...1718lb # [ 1.848368] systemd[1]: Queued start job for default target Initrd Default Target.1719lb # [ 1.858459] systemd[1]: Created slice Slice /system/modprobe.1720lb # [ 1.859622] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1721lb # [ 1.861001] systemd[1]: Expecting device /dev/disk/by-label/nixos...1722lb # [ 1.861983] systemd[1]: Reached target Path Units.1723lb # [ 1.862743] systemd[1]: Reached target Slice Units.1724lb # [ 1.863567] systemd[1]: Reached target Swaps.1725lb # [ 1.864348] systemd[1]: Reached target Timer Units.1726lb # [ 1.865307] systemd[1]: Listening on D-Bus System Message Bus Socket.1727worker2 # [ 1.771000] systemd[1]: Queued start job for default target Initrd Default Target.1728lb # [ 1.866481] systemd[1]: Listening on Journal Socket (/dev/log).1729client # [ 1.796433] systemd[1]: Starting Load Kernel Modules...1730lb # [ 1.867536] systemd[1]: Listening on Journal Sockets.1731client # [ 1.796592] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1732lb # [ 1.868536] systemd[1]: Listening on udev Control Socket.1733lb # [ 1.869568] systemd[1]: Listening on udev Kernel Socket.1734lb # [ 1.870425] systemd[1]: Reached target Socket Units.1735lb # [ 1.873110] systemd[1]: Starting Create List of Static Device Nodes...1736worker2 # [ 1.781467] systemd[1]: Created slice Slice /system/modprobe.1737worker2 # [ 1.783067] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1738worker2 # [ 1.783113] systemd[1]: Expecting device /dev/disk/by-label/nixos...1739worker2 # [ 1.783146] systemd[1]: Reached target Path Units.1740worker2 # [ 1.783167] systemd[1]: Reached target Slice Units.1741worker2 # [ 1.783187] systemd[1]: Reached target Swaps.1742lb # [ 1.883656] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1743worker2 # [ 1.783209] systemd[1]: Reached target Timer Units.1744worker2 # [ 1.783417] systemd[1]: Listening on D-Bus System Message Bus Socket.1745worker2 # [ 1.783576] systemd[1]: Listening on Journal Socket (/dev/log).1746lb # [ 1.885092] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1747worker2 # [ 1.783725] systemd[1]: Listening on Journal Sockets.1748worker2 # [ 1.783868] systemd[1]: Listening on udev Control Socket.1749worker2 # [ 1.783987] systemd[1]: Listening on udev Kernel Socket.1750worker2 # [ 1.784012] systemd[1]: Reached target Socket Units.1751worker2 # [ 1.796727] systemd[1]: Starting Create List of Static Device Nodes...1752worker2 # [ 1.803968] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1753client # [ 1.828174] systemd[1]: Starting Coldplug All udev Devices...1754worker2 # [ 1.805168] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1755lb # [ 1.900529] systemd[1]: Mounting Kernel Configuration File System...1756client # [ 1.835466] systemd-journald[73]: Collecting audit messages is disabled.1757worker2 # [ 1.814545] systemd[1]: Mounting Kernel Configuration File System...1758worker1 # [ 1.813385] systemd[1]: Queued start job for default target Initrd Default Target.1759client # [ 1.844067] systemd[1]: Finished Create List of Static Device Nodes.1760client # [ 1.845021] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1761worker1 # [ 1.821370] systemd[1]: Created slice Slice /system/modprobe.1762lb # [ 1.920311] systemd[1]: Starting Journal Service...1763worker1 # [ 1.822533] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1764worker1 # [ 1.823776] systemd[1]: Expecting device /dev/disk/by-label/nixos...1765client # [ 1.852179] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1766worker1 # [ 1.824697] systemd[1]: Reached target Path Units.1767worker1 # [ 1.825419] systemd[1]: Reached target Slice Units.1768worker1 # [ 1.826140] systemd[1]: Reached target Swaps.1769worker1 # [ 1.826803] systemd[1]: Reached target Timer Units.1770worker1 # [ 1.827764] systemd[1]: Listening on D-Bus System Message Bus Socket.1771worker1 # [ 1.828839] systemd[1]: Listening on Journal Socket (/dev/log).1772worker1 # [ 1.829911] systemd[1]: Listening on Journal Sockets.1773worker2 # [ 1.834566] systemd[1]: Starting Journal Service...1774worker1 # [ 1.830804] systemd[1]: Listening on udev Control Socket.1775worker1 # [ 1.831793] systemd[1]: Listening on udev Kernel Socket.1776worker1 # [ 1.831820] systemd[1]: Reached target Socket Units.1777lb # [ 1.932280] systemd[1]: Starting Load Kernel Modules...1778worker1 # [ 1.834849] systemd[1]: Starting Create List of Static Device Nodes...1779lb # [ 1.933220] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1780worker2 # [ 1.846596] systemd[1]: Starting Load Kernel Modules...1781worker2 # [ 1.847509] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1782worker1 # [ 1.843276] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1783worker1 # [ 1.843396] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1784client # [ 1.876127] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1785client # [ 1.877741] systemd[1]: Mounted Kernel Configuration File System.1786worker1 # [ 1.851381] systemd[1]: Mounting Kernel Configuration File System...1787worker2 # [ 1.859136] systemd[1]: Starting Coldplug All udev Devices...1788lb # [ 1.952211] systemd[1]: Starting Coldplug All udev Devices...1789lb # [ 1.964284] systemd[1]: Finished Create List of Static Device Nodes.1790lb # [ 1.966505] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1791client # [ 1.897525] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1792lb # [ 1.977643] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1793lb # [ 1.979889] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1794worker1 # [ 1.881743] systemd[1]: Starting Journal Service...1795lb # [ 1.981264] systemd[1]: Mounted Kernel Configuration File System.1796worker2 # [ 1.886757] systemd[1]: Finished Create List of Static Device Nodes.1797worker2 # [ 1.887781] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1798worker2 # [ 1.888103] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1799worker2 # [ 1.888359] systemd[1]: Mounted Kernel Configuration File System.1800worker1 # [ 1.888439] systemd[1]: Starting Load Kernel Modules...1801lb # [ 1.986924] systemd-journald[73]: Collecting audit messages is disabled.1802worker2 # [ 1.893308] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1803worker1 # [ 1.889317] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1804client # [ 1.920602] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1805lb # [ 1.987872] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1806client # [ 1.923033] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1807lb # [ 1.994760] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1808worker1 # [ 1.900705] systemd[1]: Starting Coldplug All udev Devices...1809client # [ 1.928400] systemd[1]: Starting Create Static Device Nodes in /dev...1810client # [ 1.937026] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01811client # [ 1.937285] [drm] features: -virgl +edid -resource_blob -host_visible1812client # [ 1.937295] [drm] features: -context_init1813client # [ 1.938021] [drm] number of scanouts: 11814client # [ 1.938040] [drm] number of cap sets: 01815lb # [ 2.014097] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01816worker1 # [ 1.916711] systemd[1]: Finished Create List of Static Device Nodes.1817worker1 # [ 1.918591] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1818lb # [ 2.014348] [drm] features: -virgl +edid -resource_blob -host_visible1819lb # [ 2.014359] [drm] features: -context_init1820lb # [ 2.015054] [drm] number of scanouts: 11821lb # [ 2.015072] [drm] number of cap sets: 01822client # [ 1.952327] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1823client # [ 1.952354] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01824lb # [ 2.024380] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1825lb # [ 2.024410] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01826worker1 # [ 1.927845] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1827worker1 # [ 1.928255] systemd[1]: Mounted Kernel Configuration File System.1828worker1 # [ 1.935537] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1829worker2 # [ 1.934275] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1830worker2 # [ 1.938610] systemd-journald[73]: Collecting audit messages is disabled.1831worker2 # [ 1.945450] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1832worker2 # [ 1.951379] systemd[1]: Starting Create Static Device Nodes in /dev...1833worker2 # [ 1.954874] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1834lb # [ 2.052754] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1835lb # [ 2.055572] systemd[1]: Starting Create Static Device Nodes in /dev...1836worker2 # [ 1.962308] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01837worker1 # [ 1.961562] systemd-journald[73]: Collecting audit messages is disabled.1838client # [ 1.988298] Console: switching to colour frame buffer device 160x501839client # [ 1.995457] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1840worker1 # [ 1.969147] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1841lb # [ 2.064372] Console: switching to colour frame buffer device 160x501842worker2 # [ 1.978633] [drm] features: -virgl +edid -resource_blob -host_visible1843worker2 # [ 1.978655] [drm] features: -context_init1844worker2 # [ 1.979470] [drm] number of scanouts: 11845worker2 # [ 1.979491] [drm] number of cap sets: 01846client # [ 2.008608] systemd[1]: Finished Create Static Device Nodes in /dev.1847client # [ 2.008825] systemd[1]: Reached target Preparation for Local File Systems.1848client # [ 2.008860] systemd[1]: Reached target Local File Systems.1849worker2 # [ 1.982333] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1850client # [ 2.013079] systemd[1]: Starting Rule-based Manager for Device Events and Files...1851worker2 # [ 1.982381] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01852lb # [ 2.092649] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1853worker1 # [ 1.995205] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1854worker1 # [ 2.000001] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01855worker1 # [ 2.000262] [drm] features: -virgl +edid -resource_blob -host_visible1856worker1 # [ 2.000273] [drm] features: -context_init1857client # [ 2.016953] systemd-modules-load[75]: Inserted module 'dm_mod'1858worker1 # [ 2.001042] [drm] number of scanouts: 11859worker1 # [ 2.001063] [drm] number of cap sets: 01860client # [ 2.020209] systemd-modules-load[75]: Module 'virtio_balloon' is built in1861client # [ 2.037226] systemd[1]: Started Journal Service.1862worker2 # [ 2.015117] systemd[1]: Finished Create Static Device Nodes in /dev.1863worker2 # [ 2.015521] systemd[1]: Reached target Preparation for Local File Systems.1864lb # [ 2.108802] systemd[1]: Finished Load Kernel Modules.1865worker2 # [ 2.015551] systemd[1]: Reached target Local File Systems.1866worker1 # [ 2.015911] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1867worker1 # [ 2.018672] systemd[1]: Starting Create Static Device Nodes in /dev...1868client # [ 2.032362] systemd-modules-load[75]: Module 'virtio_console' is built in1869lb # [ 2.116459] systemd[1]: Starting Apply Kernel Variables...1870worker2 # [ 2.019657] Console: switching to colour frame buffer device 160x501871client # [ 2.037600] systemd-modules-load[75]: Inserted module 'virtio_gpu'1872worker2 # [ 2.030842] systemd[1]: Starting Rule-based Manager for Device Events and Files...1873client # [ 2.044371] systemd-modules-load[75]: Module 'virtio_rng' is built in1874worker1 # [ 2.023571] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1875worker1 # [ 2.023602] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01876lb # [ 2.135106] systemd[1]: Finished Create Static Device Nodes in /dev.1877client # [ 2.052373] systemd[1]: Finished Load Kernel Modules.1878client # [ 2.053426] systemd[1]: Starting Apply Kernel Variables...1879lb # [ 2.137656] systemd[1]: Reached target Preparation for Local File Systems.1880lb # [ 2.139753] systemd[1]: Reached target Local File Systems.1881client # [ 2.061625] systemd[1]: Starting Create System Files and Directories...1882worker2 # [ 2.051096] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1883lb # [ 2.148512] systemd[1]: Starting Rule-based Manager for Device Events and Files...1884worker1 # [ 2.051958] Console: switching to colour frame buffer device 160x501885worker2 # [ 2.063988] systemd[1]: Finished Load Kernel Modules.1886worker2 # [ 2.075003] systemd[1]: Starting Apply Kernel Variables...1887worker1 # [ 2.083964] systemd[1]: Finished Create Static Device Nodes in /dev.1888worker1 # [ 2.084383] systemd[1]: Reached target Preparation for Local File Systems.1889worker1 # [ 2.084409] systemd[1]: Reached target Local File Systems.1890lb # [ 2.184803] systemd[1]: Finished Apply Kernel Variables.1891client # [ 2.105526] systemd-udevd[79]: Using default interface naming scheme 'v261'.1892worker1 # [ 2.088641] systemd[1]: Starting Rule-based Manager for Device Events and Files...1893worker1 # [ 2.091847] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1894client # [ 2.110657] systemd[1]: Finished Apply Kernel Variables.1895lb # [ 2.196399] systemd[1]: Started Journal Service.1896lb # [ 2.189574] systemd-modules-load[74]: Inserted module 'dm_mod'1897lb # [ 2.190889] systemd-modules-load[74]: Module 'virtio_balloon' is built in1898client # [ 2.125368] systemd[1]: Finished Create System Files and Directories.1899lb # [ 2.200130] systemd-modules-load[74]: Module 'virtio_console' is built in1900lb # [ 2.201421] systemd-modules-load[74]: Inserted module 'virtio_gpu'1901lb # [ 2.203539] systemd-modules-load[74]: Module 'virtio_rng' is built in1902worker1 # [ 2.119781] systemd[1]: Finished Load Kernel Modules.1903worker1 # [ 2.123891] systemd[1]: Starting Apply Kernel Variables...1904worker2 # [ 2.135270] systemd[1]: Finished Apply Kernel Variables.1905lb # [ 2.216516] systemd[1]: Starting Create System Files and Directories...1906client # [ 2.148873] systemd[1]: Started Rule-based Manager for Device Events and Files.1907worker2 # [ 2.129969] systemd-modules-load[74]: Inserted module 'dm_mod'1908worker2 # [ 2.131036] systemd-modules-load[74]: Module 'virtio_balloon' is built in1909worker2 # [ 2.146640] systemd[1]: Started Journal Service.1910worker2 # [ 2.140351] systemd-modules-load[74]: Module 'virtio_console' is built in1911worker2 # [ 2.142750] systemd-modules-load[74]: Inserted module 'virtio_gpu'1912lb # [ 2.238666] systemd[1]: Finished Create System Files and Directories.1913worker2 # [ 2.148582] systemd-modules-load[74]: Module 'virtio_rng' is built in1914worker2 # [ 2.152670] systemd-udevd[79]: Using default interface naming scheme 'v261'.1915worker1 # [ 2.162618] systemd[1]: Started Journal Service.1916lb # [ 2.248616] systemd-udevd[81]: Using default interface naming scheme 'v261'.1917worker2 # [ 2.156362] systemd[1]: Starting Create System Files and Directories...1918worker1 # [ 2.167013] systemd-modules-load[74]: Inserted module 'dm_mod'1919worker1 # [ 2.168472] systemd-modules-load[74]: Module 'virtio_balloon' is built in1920worker1 # [ 2.169578] systemd-modules-load[74]: Module 'virtio_console' is built in1921worker1 # [ 2.170658] systemd-modules-load[74]: Inserted module 'virtio_gpu'1922worker1 # [ 2.171672] systemd-modules-load[74]: Module 'virtio_rng' is built in1923lb # [ 2.281368] systemd[1]: Started Rule-based Manager for Device Events and Files.1924client # [ 2.212103] systemd[1]: Starting Virtual Console Setup...1925worker1 # [ 2.192621] systemd[1]: Starting Create System Files and Directories...1926worker1 # [ 2.193793] systemd[1]: Finished Apply Kernel Variables.1927worker2 # [ 2.198816] systemd[1]: Started Rule-based Manager for Device Events and Files.1928worker1 # [ 2.194983] systemd-udevd[79]: Using default interface naming scheme 'v261'.1929worker2 # [ 2.209538] systemd[1]: Finished Create System Files and Directories.1930worker1 # [ 2.217290] systemd[1]: Finished Create System Files and Directories.1931client # [ 2.264548] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1932client # [ 2.268598] systemd[1]: Finished Virtual Console Setup.1933worker1 # [ 2.241776] systemd[1]: Started Rule-based Manager for Device Events and Files.1934lb # [ 2.344831] systemd[1]: Starting Virtual Console Setup...1935worker2 # [ 2.268573] systemd[1]: Starting Virtual Console Setup...1936lb # [ 2.392521] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1937lb # [ 2.396047] systemd[1]: Finished Virtual Console Setup.1938worker1 # [ 2.305112] systemd[1]: Starting Virtual Console Setup...1939worker2 # [ 2.332628] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940worker2 # [ 2.336328] systemd[1]: Finished Virtual Console Setup.1941worker1 # [ 2.360580] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942worker1 # [ 2.368598] systemd[1]: Finished Virtual Console Setup.1943client # [ 2.882002] systemd[1]: Finished Coldplug All udev Devices.1944client # [ 2.885598] systemd[1]: Reached target System Initialization.1945client # [ 2.888134] systemd[1]: Reached target Basic System.1946worker2 # [ 2.950223] systemd[1]: Finished Coldplug All udev Devices.1947worker2 # [ 2.951801] systemd[1]: Reached target System Initialization.1948worker2 # [ 2.952996] systemd[1]: Reached target Basic System.1949lb # [ 3.049148] systemd[1]: Finished Coldplug All udev Devices.1950lb # [ 3.051188] systemd[1]: Reached target System Initialization.1951lb # [ 3.057288] systemd[1]: Reached target Basic System.1952worker1 # [ 2.998161] systemd[1]: Finished Coldplug All udev Devices.1953worker1 # [ 2.999142] systemd[1]: Reached target System Initialization.1954worker1 # [ 3.000067] systemd[1]: Reached target Basic System.1955client # [ 3.047780] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1956client # [ 3.083795] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1957client # [ 3.090439] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line.1958worker2 # [ 3.120211] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1959lb # [ 3.224351] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1960worker2 # [ 3.141660] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1961worker2 # [ 3.148892] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1962lb # [ 3.244504] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1963lb # [ 3.248984] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1964client # [ 3.191851] systemd[1]: Found device /dev/disk/by-label/nixos.1965client # [ 3.195241] systemd[1]: Reached target Initrd Root Device.1966client # [ 3.198015] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1967worker1 # [ 3.187669] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1968worker1 # [ 3.206519] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1969worker1 # [ 3.212301] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1970worker2 # [ 3.218629] systemd[1]: Found device /dev/disk/by-label/nixos.1971lb # [ 3.312939] systemd[1]: Found device /dev/disk/by-label/nixos.1972worker2 # [ 3.220830] systemd[1]: Reached target Initrd Root Device.1973lb # [ 3.316168] systemd[1]: Reached target Initrd Root Device.1974worker2 # [ 3.224847] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1975lb # [ 3.318412] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1976client # [ 3.250024] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1977client # [ 3.256804] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1978client # [ 3.260720] systemd[1]: Mounting /sysroot...1979client # [ 3.317549] EXT4-fs (vda): mounted filesystem bc5f26a8-d92d-497e-9085-e02da5eac31b r/w with ordered data mode. Quota mode: none.1980lb # [ 3.377436] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1981client # [ 3.309076] systemd[1]: Mounted /sysroot.1982worker2 # [ 3.285948] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1983client # [ 3.311367] systemd[1]: Reached target Initrd Root File System.1984lb # [ 3.385266] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1985client # [ 3.315872] systemd[1]: Starting Mountpoints Configured in the Real Root...1986worker2 # [ 3.293481] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1987worker1 # [ 3.289630] systemd[1]: Found device /dev/disk/by-label/nixos.1988worker2 # [ 3.298388] systemd[1]: Mounting /sysroot...1989lb # [ 3.391916] systemd[1]: Mounting /sysroot...1990worker1 # [ 3.296503] systemd[1]: Reached target Initrd Root Device.1991worker1 # [ 3.304641] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1992client # [ 3.347739] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1993client # [ 3.356343] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1994client # [ 3.360683] systemd[1]: Reloading...1995worker2 # [ 3.351901] EXT4-fs (vda): mounted filesystem ea70fdbf-bf2d-4865-a271-244bec64a9a1 r/w with ordered data mode. Quota mode: none.1996worker2 # [ 3.344997] systemd[1]: Mounted /sysroot.1997lb # [ 3.451301] EXT4-fs (vda): mounted filesystem 4d73c45d-1cee-4f3b-82cc-3063609d0b82 r/w with ordered data mode. Quota mode: none.1998worker2 # [ 3.346893] systemd[1]: Reached target Initrd Root File System.1999lb # [ 3.441313] systemd[1]: Mounted /sysroot.2000lb # [ 3.442388] systemd[1]: Reached target Initrd Root File System.
loading 1,179 hidden lines…
3180worker1 # [ 13.729302] systemd[1]: Starting Permit User Sessions...3181client: (connecting took 14.20 seconds)3182worker1 # [ 13.748576] cfg80211: Loading compiled-in X.509 certificates for regulatory database3183client: (finished: waiting for the VM to finish booting, in 14.20 seconds)3184client # [ 13.746510] (udev-worker)[534]: Network interface NamePolicy= disabled on kernel command line.3185client # [ 13.794226] cfg80211: Loading compiled-in X.509 certificates for regulatory database3186lb # [ 13.868231] systemd[1]: Finished Extra networking commands..3187worker1 # [ 13.790793] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3188lb # [ 13.877041] systemd[1]: Reached target Network.3189worker1 # [ 13.793392] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3190worker1 # [ 13.798251] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23191worker1 # [ 13.798628] cfg80211: failed to load regulatory.db3192client # [ 13.848297] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3193client # [ 13.848836] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3194client # [ 13.853009] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23195client # [ 13.853340] cfg80211: failed to load regulatory.db3196lb # [ 13.911385] systemd[1]: Starting PostgreSQL Server...3197lb # [ 13.915935] systemd[1]: Starting Permit User Sessions...3198worker1 # [ 13.827631] systemd[1]: Finished Permit User Sessions.3199worker1 # [ 13.832882] systemd[1]: Started Getty on tty1.3200worker1 # [ 13.838501] systemd[1]: Reached target Login Prompts.3201lb # connecting to host...3202client # [ 13.886989] systemd-vconsole-setup[588]: Configuration of first virtual console was skipped, ignoring remaining ones.3203client # [ 13.905540] systemd[1]: Finished Virtual Console Setup.3204worker1 # [ 13.917951] 8021q: adding VLAN 0 to HW filter on device eth03205worker1 # [ 13.905600] dhcpcd[643]: eth0: waiting for carrier3206worker1 # [ 13.908739] dhcpcd[643]: libudev: received NULL device3207worker1 # [ 13.909657] dhcpcd[643]: libudev: received NULL device3208worker1 # [ 13.910472] dhcpcd[643]: eth0: carrier acquired3209worker2 # [ 13.919590] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.3210worker1 # [ 13.925457] dhcpcd[643]: DUID 00:01:00:01:32:42:52:eb:52:54:00:12:34:563211worker1 # [ 13.926497] dhcpcd[643]: eth0: IAID 00:12:34:563212worker1 # [ 13.927140] dhcpcd[643]: eth0: adding address fe80::5054:ff:fe12:34563213lb # [ 14.041540] (udev-worker)[630]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3214lb # [ 14.075800] cfg80211: Loading compiled-in X.509 certificates for regulatory database3215lb # [ 14.069688] (udev-worker)[624]: Network interface NamePolicy= disabled on kernel command line.3216worker1 # [ 13.975808] dhcpcd[643]: eth0: IAID 00:12:34:563217lb # [ 14.082329] (udev-worker)[630]: Network interface NamePolicy= disabled on kernel command line.3218worker1 # [ 14.000974] systemd-logind[516]: Watching system buttons on /dev/input/event0 (gpio-keys)3219lb # [ 14.099777] systemd[1]: Finished Permit User Sessions.3220worker2 # [ 14.007338] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.3221worker1 # [ 14.007951] systemd[1]: Condition check resulted in Virtio network device being skipped.3222worker2 # [ 14.014181] systemd[1]: Started backdoor.service.3223worker1 # [ 14.012997] systemd[1]: Starting Address configuration of eth1...3224lb # [ 14.115976] systemd[1]: Started Getty on tty1.3225lb # [ 14.124253] systemd[1]: Reached target Login Prompts.3226client # [ 14.081097] systemd[1]: Condition check resulted in Virtio network device being skipped.3227client # [ 14.089754] systemd[1]: Starting Address configuration of eth1...3228worker2 # [ 14.082108] 8021q: 802.1Q VLAN Support v1.83229lb # [ 14.188068] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3230lb # [ 14.188615] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3231lb # [ 14.194302] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23232lb # [ 14.194637] cfg80211: failed to load regulatory.db3233worker2 # [ 14.098436] (udev-worker)[648]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3234worker2 # [ 14.109244] (udev-worker)[648]: Network interface NamePolicy= disabled on kernel command line.3235worker1 # [ 14.139649] 8021q: adding VLAN 0 to HW filter on device eth13236client # [ 14.167559] 8021q: adding VLAN 0 to HW filter on device eth03237client # [ 14.157661] dhcpcd[517]: eth0: waiting for carrier3238client # [ 14.158428] dhcpcd[517]: eth0: carrier acquired3239worker2 # [ 14.143804] (udev-worker)[630]: Network interface NamePolicy= disabled on kernel command line.3240worker1 # [ 14.151600] network-addresses-eth1-start[684]: adding address 192.168.1.3/24... done3241client # [ 14.185647] dhcpcd[517]: DUID 00:01:00:01:32:42:52:eb:52:54:00:12:34:563242client # [ 14.189897] dhcpcd[517]: eth0: IAID 00:12:34:563243client # [ 14.190629] dhcpcd[517]: eth0: adding address fe80::5054:ff:fe12:34563244worker1 # [ 14.168776] network-addresses-eth1-start[684]: adding address 2001:db8:1::3/64... done3245worker2 # [ 14.191380] cfg80211: Loading compiled-in X.509 certificates for regulatory database3246worker1 # [ 14.195544] systemd[1]: Finished Address configuration of eth1.3247client # [ 14.240465] 8021q: adding VLAN 0 to HW filter on device eth13248worker2 # connecting to host...3249client # [ 14.232758] systemd-logind[418]: Watching system buttons on /dev/input/event0 (gpio-keys)3250worker2 # [ 14.235681] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3251worker2 # [ 14.236238] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3252client # [ 14.250994] network-addresses-eth1-start[619]: adding address 192.168.1.1/24... done3253worker2 # [ 14.241614] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23254worker2 # [ 14.241991] cfg80211: failed to load regulatory.db3255lb # [ 14.340426] 8021q: adding VLAN 0 to HW filter on device eth03256lb # [ 14.329351] dhcpcd[669]: eth0: waiting for carrier3257lb # [ 14.334082] dhcpcd[669]: eth0: carrier acquired3258client # [ 14.269579] network-addresses-eth1-start[619]: adding address 2001:db8:1::1/64... done3259lb # [ 14.358655] dhcpcd[669]: DUID 00:01:00:01:32:42:52:eb:52:54:00:12:34:563260client # [ 14.293234] systemd[1]: Finished Address configuration of eth1.3261lb # [ 14.365055] dhcpcd[669]: eth0: IAID 00:12:34:563262lb # [ 14.365865] dhcpcd[669]: eth0: adding address fe80::5054:ff:fe12:34563263worker1 # [ 14.309525] mousedev: PS/2 mouse device common for all mice3264worker1 # [ 14.350111] systemd-logind[516]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3265client # [ 14.446140] mousedev: PS/2 mouse device common for all mice3266lb # [ 14.509410] postgresql-pre-start[713]: The files belonging to this database system will be owned by user "postgres".3267lb # [ 14.511003] postgresql-pre-start[713]: This user must also own the server process.3268worker2 # [ 14.432875] systemd[1]: Condition check resulted in Virtio network device being skipped.3269lb # [ 14.532086] postgresql-pre-start[713]: The database cluster will be initialized with locale "en_US.UTF-8".3270lb # [ 14.533530] postgresql-pre-start[713]: The default database encoding has accordingly been set to "UTF8".3271worker2 # [ 14.439505] systemd[1]: Starting Address configuration of eth1...3272lb # [ 14.534752] postgresql-pre-start[713]: The default text search configuration will be set to "english".3273lb # [ 14.535964] postgresql-pre-start[713]: Data page checksums are enabled.3274worker2 # [ 14.454352] systemd-vconsole-setup[658]: Configuration of first virtual console was skipped, ignoring remaining ones.3275worker2 # [ 14.462593] systemd[1]: Finished Virtual Console Setup.3276lb # [ 14.551556] postgresql-pre-start[713]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3277lb # [ 14.560523] postgresql-pre-start[713]: creating subdirectories ... ok3278lb # [ 14.561471] postgresql-pre-start[713]: selecting dynamic shared memory implementation ... posix3279client # [ 14.510968] systemd-logind[418]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3280lb # [ 14.586192] systemd[1]: Condition check resulted in Virtio network device being skipped.3281lb # [ 14.608607] systemd[1]: Starting Address configuration of eth1...3282lb # [ 14.619805] dhcpcd[669]: eth0: IAID 00:12:34:563283worker2 # [ 14.580008] 8021q: adding VLAN 0 to HW filter on device eth03284worker2 # [ 14.571922] dhcpcd[638]: eth0: waiting for carrier3285worker2 # [ 14.573695] dhcpcd[638]: eth0: carrier acquired3286worker2 # [ 14.600472] dhcpcd[638]: DUID 00:01:00:01:32:42:52:ec:52:54:00:12:34:563287worker2 # [ 14.602962] dhcpcd[638]: eth0: IAID 00:12:34:563288worker2 # [ 14.605973] dhcpcd[638]: eth0: adding address fe80::5054:ff:fe12:34563289worker2 # [ 14.628618] 8021q: adding VLAN 0 to HW filter on device eth13290worker2 # [ 14.645472] network-addresses-eth1-start[677]: adding address 192.168.1.4/24... done3291worker2 # [ 14.671967] network-addresses-eth1-start[677]: adding address 2001:db8:1::4/64... done3292worker2 # [ 14.701791] systemd-logind[500]: Watching system buttons on /dev/input/event0 (gpio-keys)3293worker2 # [ 14.706243] systemd[1]: Finished Address configuration of eth1.3294lb # [ 14.847309] 8021q: adding VLAN 0 to HW filter on device eth13295lb # [ 14.880430] network-addresses-eth1-start[724]: adding address 192.168.1.2/24... done3296lb # [ 14.890812] postgresql-pre-start[713]: selecting default "max_connections" ... 1003297worker1 # [ 14.804703] dhcpcd[643]: eth0: soliciting a DHCP lease3298worker1 # [ 14.812729] dhcpcd[643]: eth0: offered 10.0.2.15 from 10.0.2.23299worker1 # [ 14.820289] dhcpcd[643]: eth0: probing address 10.0.2.15/243300lb # [ 14.921969] network-addresses-eth1-start[724]: adding address 2001:db8:1::2/64... done3301worker2 # [ 14.845000] mousedev: PS/2 mouse device common for all mice3302lb # [ 14.973668] systemd[1]: Finished Address configuration of eth1.3303worker2 # [ 14.979623] systemd-logind[500]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3304lb # [ 15.111844] systemd-logind[526]: Watching system buttons on /dev/input/event0 (gpio-keys)3305client: (finished: waiting for unit network-addresses-eth1.service, in 15.47 seconds)3306lb # [ 15.131972] postgresql-pre-start[713]: selecting default "shared_buffers" ... 128MB3307client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3308worker1 # [ 15.103484] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33309client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.07 seconds)3310lb: waiting for unit network-addresses-eth1.service3311lb: waiting for the VM to finish booting3312lb: Guest shell says: b'Spawning backdoor root shell...\n'3313lb: connected to guest root shell3314lb: (connecting took 0.00 seconds)3315lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3316worker1 # [ 15.171687] dhcpcd[643]: eth0: soliciting an IPv6 router3317worker1 # [ 15.176201] dhcpcd[643]: eth0: Router Advertisement from fe80::23318worker1 # [ 15.177116] dhcpcd[643]: eth0: adding address fec0::5054:ff:fe12:3456/643319worker1 # [ 15.178070] dhcpcd[643]: eth0: adding route to fec0::/643320worker1 # [ 15.178915] dhcpcd[643]: eth0: adding default route via fe80::23321lb: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds)3322lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3323lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.09 seconds)3324worker1: waiting for unit network-addresses-eth1.service3325worker1: waiting for the VM to finish booting3326worker1: Guest shell says: b'Spawning backdoor root shell...\n'3327worker1: connected to guest root shell3328worker1: (connecting took 0.00 seconds)3329worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3330lb # [ 15.424249] mousedev: PS/2 mouse device common for all mice3331lb # [ 15.510182] dhcpcd[669]: eth0: soliciting a DHCP lease3332lb # [ 15.518125] dhcpcd[669]: eth0: offered 10.0.2.15 from 10.0.2.23333lb # [ 15.524323] dhcpcd[669]: eth0: probing address 10.0.2.15/243334worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.13 seconds)3335worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3336worker2 # [ 15.453234] dhcpcd[638]: eth0: soliciting a DHCP lease3337worker2 # [ 15.460788] dhcpcd[638]: eth0: offered 10.0.2.15 from 10.0.2.23338worker2 # [ 15.468350] dhcpcd[638]: eth0: probing address 10.0.2.15/243339lb # [ 15.605719] systemd-logind[526]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3340worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.08 seconds)3341worker2: waiting for unit network-addresses-eth1.service3342worker2: waiting for the VM to finish booting3343worker2: Guest shell says: b'Spawning backdoor root shell...\n'3344worker2: connected to guest root shell3345worker2: (connecting took 0.00 seconds)3346worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3347worker1 # [ 15.562517] systemd[1]: Starting Virtual Console Setup...3348worker1 # [ 15.595212] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3349worker1 # [ 15.597614] systemd[1]: Stopped Virtual Console Setup.3350worker1 # [ 15.602002] systemd[1]: Starting Virtual Console Setup...3351client # [ 15.635245] dhcpcd[517]: eth0: soliciting a DHCP lease3352client # [ 15.640697] dhcpcd[517]: eth0: offered 10.0.2.15 from 10.0.2.23353worker1 # [ 15.618470] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3354client # [ 15.648343] dhcpcd[517]: eth0: probing address 10.0.2.15/243355worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.12 seconds)3356worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3357worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.07 seconds)3358lb: waiting for unit niks3.service3359worker1 # [ 15.723721] systemd-logind[516]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3360client # [ 15.846008] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3361client # [ 15.850489] systemd[1]: Stopped Virtual Console Setup.3362client # [ 15.851416] systemd[1]: Stopping Virtual Console Setup...3363client # [ 15.858701] systemd[1]: Starting Virtual Console Setup...3364client # [ 15.885313] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3365client # [ 15.891939] systemd[1]: Stopped Virtual Console Setup.3366client # [ 15.897832] systemd[1]: Starting Virtual Console Setup...3367client # [ 15.915669] systemd-logind[418]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3368client # [ 15.933504] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3369worker1 # [ 16.083072] systemd-vconsole-setup[710]: Configuration of first virtual console was skipped, ignoring remaining ones.3370worker1 # [ 16.086860] systemd[1]: Finished Virtual Console Setup.3371client # [ 16.254798] systemd-vconsole-setup[660]: Configuration of first virtual console was skipped, ignoring remaining ones.3372client # [ 16.259527] systemd[1]: Finished Virtual Console Setup.3373worker2 # [ 16.336518] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3374worker2 # [ 16.338718] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3375worker2 # [ 16.339796] systemd[1]: Stopped Virtual Console Setup.3376worker2 # [ 16.343257] systemd[1]: Stopping Virtual Console Setup...3377worker2 # [ 16.348759] systemd[1]: Starting Virtual Console Setup...3378client # [ 16.378902] dhcpcd[517]: eth0: soliciting an IPv6 router3379client # [ 16.381223] dhcpcd[517]: eth0: Router Advertisement from fe80::23380client # [ 16.382372] dhcpcd[517]: eth0: adding address fec0::5054:ff:fe12:3456/643381client # [ 16.384285] dhcpcd[517]: eth0: adding route to fec0::/643382client # [ 16.385635] dhcpcd[517]: eth0: adding default route via fe80::23383worker2 # [ 16.399038] systemd-logind[500]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3384lb # [ 16.690934] dhcpcd[669]: eth0: soliciting an IPv6 router3385lb # [ 16.691891] dhcpcd[669]: eth0: Router Advertisement from fe80::23386lb # [ 16.694223] dhcpcd[669]: eth0: adding address fec0::5054:ff:fe12:3456/643387lb # [ 16.696913] dhcpcd[669]: eth0: adding route to fec0::/643388lb # [ 16.698622] dhcpcd[669]: eth0: adding default route via fe80::23389worker2 # [ 16.679069] dhcpcd[638]: eth0: soliciting an IPv6 router3390worker2 # [ 16.680961] dhcpcd[638]: eth0: Router Advertisement from fe80::23391worker2 # [ 16.681923] dhcpcd[638]: eth0: adding address fec0::5054:ff:fe12:3456/643392worker2 # [ 16.682905] dhcpcd[638]: eth0: adding route to fec0::/643393worker2 # [ 16.683673] dhcpcd[638]: eth0: adding default route via fe80::23394worker2 # [ 16.730630] systemd-vconsole-setup[720]: Configuration of first virtual console was skipped, ignoring remaining ones.3395worker2 # [ 16.734187] systemd[1]: Finished Virtual Console Setup.3396lb # [ 16.886751] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33397lb # [ 17.509744] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3398lb # [ 17.524128] systemd[1]: Starting Virtual Console Setup...3399lb # [ 17.555217] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3400lb # [ 17.559005] systemd[1]: Stopped Virtual Console Setup.3401lb # [ 17.569892] systemd[1]: Starting Virtual Console Setup...3402lb # [ 17.667500] systemd-logind[526]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3403lb # [ 18.046766] systemd-vconsole-setup[784]: Configuration of first virtual console was skipped, ignoring remaining ones.3404lb # [ 18.052084] systemd[1]: Finished Virtual Console Setup.3405lb # [ 18.123697] postgresql-pre-start[713]: selecting default time zone ... UTC3406lb # [ 18.131147] postgresql-pre-start[713]: creating configuration files ... ok3407lb # [ 18.491079] postgresql-pre-start[713]: running bootstrap script ... ok3408lb # [ 19.307406] postgresql-pre-start[713]: performing post-bootstrap initialization ... ok3409lb # [ 19.439475] postgresql-pre-start[713]: syncing data to disk ... ok3410lb # [ 19.442369] postgresql-pre-start[713]: initdb: warning: enabling "trust" authentication for local connections3411lb # [ 19.443679] postgresql-pre-start[713]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3412lb # [ 19.445927] postgresql-pre-start[713]: Success. You can now start the database server using:3413lb # [ 19.447121] postgresql-pre-start[713]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3414lb # [ 19.582091] postgres[817]: [817] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3415lb # [ 19.586698] postgres[817]: [817] LOG: listening on IPv6 address "::1", port 54323416lb # [ 19.587924] postgres[817]: [817] LOG: listening on IPv4 address "127.0.0.1", port 54323417lb # [ 19.591165] postgres[817]: [817] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3418lb # [ 19.604525] postgres[826]: [826] LOG: database system was shut down at 2026-09-20 08:16:48 GMT3419lb # [ 19.612417] postgres[817]: [817] LOG: database system is ready to accept connections3420lb # [ 19.617526] systemd[1]: Started PostgreSQL Server.3421worker2 # [ 19.529480] dhcpcd[638]: eth0: leased 10.0.2.15 for 86400 seconds3422worker2 # [ 19.531690] dhcpcd[638]: eth0: adding route to 10.0.2.0/243423lb # [ 19.626903] systemd[1]: Starting PostgreSQL Setup Scripts...3424worker2 # [ 19.534110] dhcpcd[638]: eth0: adding default route via 10.0.2.23425worker2 # [ 19.682646] systemd[1]: Started DHCP Client.3426worker2 # [ 19.684966] systemd[1]: Reached target Multi-User System.3427worker2 # [ 19.685837] systemd[1]: Startup finished in 1.021s (kernel) + 4.841s (initrd) + 13.821s (userspace) = 19.684s.3428lb # [ 19.867253] postgresql-setup-start[837]: CREATE DATABASE3429lb # [ 19.926478] postgresql-setup-start[842]: CREATE ROLE3430lb # [ 19.954719] postgresql-setup-start[844]: ALTER DATABASE3431lb # [ 19.962858] systemd[1]: Finished PostgreSQL Setup Scripts.3432lb # [ 19.964847] systemd[1]: Reached target PostgreSQL.3433worker1 # [ 20.104920] dhcpcd[643]: eth0: leased 10.0.2.15 for 86400 seconds3434worker1 # [ 20.109768] dhcpcd[643]: eth0: adding route to 10.0.2.0/243435worker1 # [ 20.113504] dhcpcd[643]: eth0: adding default route via 10.0.2.23436worker1 # [ 20.273219] systemd[1]: Started DHCP Client.3437worker1 # [ 20.275421] systemd[1]: Reached target Multi-User System.3438worker1 # [ 20.276943] systemd[1]: Startup finished in 1.019s (kernel) + 5.570s (initrd) + 13.685s (userspace) = 20.275s.3439lb # [ 20.448657] dhcpcd[669]: eth0: leased 10.0.2.15 for 86400 seconds3440lb # [ 20.450273] dhcpcd[669]: eth0: adding route to 10.0.2.0/243441lb # [ 20.453136] dhcpcd[669]: eth0: adding default route via 10.0.2.23442client # [ 20.505258] dhcpcd[517]: eth0: leased 10.0.2.15 for 86400 seconds3443client # [ 20.511221] dhcpcd[517]: eth0: adding route to 10.0.2.0/243444client # [ 20.519694] dhcpcd[517]: eth0: adding default route via 10.0.2.23445lb # [ 20.594542] systemd[1]: Started DHCP Client.3446lb # [ 20.596747] systemd[1]: Reached target Network is Online.3447lb # [ 20.602227] systemd[1]: Started Envoy reverse proxy.3448lb # [ 20.610492] systemd[1]: Started mock-oidc.service.3449lb # [ 20.730406] mock-oidc-server[912]: Mock OIDC Server running3450lb # [ 20.731349] mock-oidc-server[912]: OIDC Address: 192.168.1.2:80803451lb # [ 20.733291] mock-oidc-server[912]: Issue Address: 0.0.0.0:80813452lb # [ 20.737143] mock-oidc-server[912]: Issuer: http://192.168.1.2:8080/oidc3453lb # [ 20.740157] mock-oidc-server[912]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3454lb # [ 20.742034] mock-oidc-server[912]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3455lb # [ 20.743584] mock-oidc-server[912]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3456client # [ 20.679265] systemd[1]: Started DHCP Client.3457client # [ 20.681380] systemd[1]: Reached target Multi-User System.3458client # [ 20.682666] systemd[1]: Startup finished in 1.020s (kernel) + 4.805s (initrd) + 14.856s (userspace) = 20.682s.3459lb # [ 21.355733] envoy[911]: [2026-09-20 08:16:50.900][911][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3460lb # [ 21.358050] envoy[911]: [2026-09-20 08:16:50.900][911][info][main] [source/server/server.cc:469] statically linked extensions:3461lb # [ 21.359844] envoy[911]: [2026-09-20 08:16:50.900][911][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3462lb # [ 21.362145] envoy[911]: [2026-09-20 08:16:50.900][911][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3463lb # [ 21.364832] envoy[911]: [2026-09-20 08:16:50.900][911][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3464lb # [ 21.370709] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3465lb # [ 21.392577] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3466lb # [ 21.395170] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3467lb # [ 21.399095] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3468lb # [ 21.402334] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3469lb # [ 21.404408] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3470lb # [ 21.408050] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3471lb # [ 21.410383] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3472lb # [ 21.413347] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23473lb # [ 21.417037] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3474lb # [ 21.419007] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3475lb # [ 21.422194] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3476lb # [ 21.424137] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3477lb # [ 21.434667] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3478lb # [ 21.438296] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3479lb # [ 21.444972] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3480lb # [ 21.448264] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3481lb # [ 21.450193] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3482lb # [ 21.455587] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3483lb # [ 21.460968] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3484lb # [ 21.463169] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3485lb # [ 21.468077] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3486lb # [ 21.471273] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3487lb # [ 21.474745] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3488lb # [ 21.476806] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3489lb # [ 21.478972] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23490lb # [ 21.481175] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3491lb # [ 21.484350] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3492lb # [ 21.487851] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3493lb # [ 21.493184] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3494lb # [ 21.496824] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3495lb # [ 21.501326] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3496lb # [ 21.503461] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3497lb # [ 21.512090] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3498lb # [ 21.514307] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3499lb # [ 21.516767] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3500lb # [ 21.519481] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3501lb # [ 21.523327] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3502lb # [ 21.557963] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3503lb # [ 21.568983] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3504lb # [ 21.572564] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3505lb # [ 21.575608] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3506lb # [ 21.584084] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3507lb # [ 21.589715] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3508lb # [ 21.593969] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3509lb # [ 21.597395] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3510lb # [ 21.601517] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3511lb # [ 21.604327] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3512lb # [ 21.606222] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3513lb # [ 21.607968] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3514lb # [ 21.610352] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3515lb # [ 21.615056] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3516lb # [ 21.618472] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3517lb # [ 21.625275] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3518lb # [ 21.629687] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3519lb # [ 21.632843] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3520lb # [ 21.645625] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3521lb # [ 21.647700] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3522lb # [ 21.650430] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3523lb # [ 21.654007] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3524lb # [ 21.658417] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3525lb # [ 21.661497] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3526lb # [ 21.667203] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3527lb # [ 21.672491] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3528lb # [ 21.681476] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3529lb # [ 21.683644] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3530lb # [ 21.685988] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13531lb # [ 21.688442] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3532lb # [ 21.691058] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3533lb # [ 21.693689] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83534lb # [ 21.695875] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3535lb # [ 21.698308] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3536lb # [ 21.702747] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3537lb # [ 21.706325] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3538lb # [ 21.708394] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3539lb # [ 21.711342] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3540lb # [ 21.713684] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3541lb # [ 21.719844] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3542lb # [ 21.736456] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3543lb # [ 21.741249] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23544lb # [ 21.743392] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3545lb # [ 21.747269] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3546lb # [ 21.756835] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3547lb # [ 21.759047] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3548lb # [ 21.762947] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3549lb # [ 21.768655] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3550lb # [ 21.777022] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3551lb # [ 21.779503] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3552lb # [ 21.781682] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3553lb # [ 21.783809] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3554lb # [ 21.786497] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3555lb # [ 21.789333] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3556lb # [ 21.791801] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3557lb # [ 21.796212] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3558lb # [ 21.799817] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3559lb # [ 21.804767] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3560lb # [ 21.807893] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3561lb # [ 21.811320] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3562lb # [ 21.814504] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3563worker1 # [ 21.721779] systemd[1]: Starting Nix worker-protocol over gRPC...3564lb # [ 21.822579] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3565lb # [ 21.827680] envoy[911]: [2026-09-20 08:16:50.901][911][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3566lb # [ 21.834926] envoy[911]: [2026-09-20 08:16:50.930][911][info][main] [source/server/server.cc:531] HTTP header map info:3567worker2 # [ 21.748525] systemd[1]: Starting Nix worker-protocol over gRPC...3568lb # [ 21.838299] envoy[911]: [2026-09-20 08:16:50.932][911][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3569lb # [ 21.856785] envoy[911]: [2026-09-20 08:16:50.932][911][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3570lb # [ 21.859526] envoy[911]: [2026-09-20 08:16:50.932][911][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3571lb # [ 21.872980] envoy[911]: [2026-09-20 08:16:50.932][911][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3572lb # [ 21.875473] envoy[911]: [2026-09-20 08:16:51.116][911][info][main] [source/server/server.cc:968] runtime: {}3573lb # [ 21.877655] envoy[911]: [2026-09-20 08:16:51.127][911][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3574lb # [ 21.880564] envoy[911]: [2026-09-20 08:16:51.127][911][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013575lb # [ 21.883707] envoy[911]: [2026-09-20 08:16:51.127][911][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013576lb # [ 21.886652] envoy[911]: [2026-09-20 08:16:51.128][911][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3577lb # [ 21.892191] envoy[911]: [2026-09-20 08:16:51.128][911][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3578lb # [ 21.894052] envoy[911]: [2026-09-20 08:16:51.128][911][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3579lb # [ 21.895982] envoy[911]: [2026-09-20 08:16:51.367][911][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3580lb # [ 21.897875] envoy[911]: [2026-09-20 08:16:51.435][911][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3581lb # [ 21.899721] envoy[911]: [2026-09-20 08:16:51.437][911][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3582lb # [ 21.904535] envoy[911]: [2026-09-20 08:16:51.437][911][info][main] [source/server/server.cc:1077] starting main dispatch loop3583worker2 # [ 21.986322] nix-grpc-daemon[784]: ts=2026-09-20T08:16:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3584worker1 # [ 21.988754] nix-grpc-daemon[775]: ts=2026-09-20T08:16:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3585worker2 # [ 21.998484] nix-grpc-daemon[784]: ts=2026-09-20T08:16:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13586worker1 # [ 22.001191] nix-grpc-daemon[775]: ts=2026-09-20T08:16:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13587worker2 # [ 22.046034] nix-grpc-daemon[784]: ts=2026-09-20T08:16:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3588worker2 # [ 22.050819] systemd[1]: Started Nix worker-protocol over gRPC.3589worker1 # [ 22.051588] nix-grpc-daemon[775]: ts=2026-09-20T08:16:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3590worker1 # [ 22.056786] systemd[1]: Started Nix worker-protocol over gRPC.3591lb # [ 22.185967] envoy[911]: [2026-09-20 08:16:51.731][911][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3592lb # [ 22.193980] envoy[911]: [2026-09-20 08:16:51.731][911][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3593lb # [ 22.204328] envoy[911]: [2026-09-20 08:16:51.731][911][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3594lb # [ 22.216405] envoy[911]: [2026-09-20 08:16:51.731][911][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3595worker2 # [ 22.136925] nix-grpc-daemon[784]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513596worker1 # [ 22.133477] nix-grpc-daemon[775]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513597worker1 # [ 22.144952] nix-grpc-daemon[775]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3598worker2 # [ 22.151106] nix-grpc-daemon[784]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3599worker1 # [ 22.346471] nix-grpc-daemon[775]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513600worker2 # [ 22.352582] nix-grpc-daemon[784]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513601worker2 # [ 22.359895] nix-grpc-daemon[784]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3602worker1 # [ 22.355151] nix-grpc-daemon[775]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3603worker2 # [ 22.560614] nix-grpc-daemon[784]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513604worker1 # [ 22.556274] nix-grpc-daemon[775]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513605worker2 # [ 22.565261] nix-grpc-daemon[784]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3606worker1 # [ 22.562679] nix-grpc-daemon[775]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3607worker2 # [ 22.766583] nix-grpc-daemon[784]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513608worker1 # [ 22.763813] nix-grpc-daemon[775]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513609worker2 # [ 22.774056] nix-grpc-daemon[784]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3610worker1 # [ 22.771240] nix-grpc-daemon[775]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3611worker1 # [ 22.972244] nix-grpc-daemon[775]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513612worker2 # [ 22.975565] nix-grpc-daemon[784]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513613worker1 # [ 22.976950] nix-grpc-daemon[775]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3614worker2 # [ 22.982946] nix-grpc-daemon[784]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3615worker1 # [ 23.180850] nix-grpc-daemon[775]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 23.187346] nix-grpc-daemon[784]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513617worker2 # [ 23.191694] nix-grpc-daemon[784]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3618worker1 # [ 23.186510] nix-grpc-daemon[775]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3619worker2 # [ 23.388455] nix-grpc-daemon[784]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513620worker1 # [ 23.387366] nix-grpc-daemon[775]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513621worker2 # [ 23.395761] nix-grpc-daemon[784]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3622worker1 # [ 23.394634] nix-grpc-daemon[775]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3623worker2 # [ 23.597255] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 23.595931] nix-grpc-daemon[775]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513625worker2 # [ 23.604659] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3626worker1 # [ 23.603159] nix-grpc-daemon[775]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3627worker2 # [ 23.805606] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 23.810828] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3629worker1 # [ 23.806880] nix-grpc-daemon[775]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513630worker1 # [ 23.818038] nix-grpc-daemon[775]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3631worker2 # [ 24.012223] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513632worker2 # [ 24.019858] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3633worker1 # [ 24.016375] nix-grpc-daemon[775]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513634worker1 # [ 24.024376] nix-grpc-daemon[775]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3635worker2 # [ 24.226893] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 24.231780] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3637worker1 # [ 24.230296] nix-grpc-daemon[775]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513638worker1 # [ 24.235510] nix-grpc-daemon[775]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3639worker2 # [ 24.427471] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 24.434545] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3641worker1 # [ 24.431487] nix-grpc-daemon[775]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513642worker1 # [ 24.438542] nix-grpc-daemon[775]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3643worker2 # [ 24.635829] nix-grpc-daemon[784]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513644worker1 # [ 24.639877] nix-grpc-daemon[775]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513645worker2 # [ 24.643638] nix-grpc-daemon[784]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3646worker1 # [ 24.647036] nix-grpc-daemon[775]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3647worker2 # [ 24.844817] nix-grpc-daemon[784]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 24.851714] nix-grpc-daemon[784]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3649worker1 # [ 24.848601] nix-grpc-daemon[775]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513650worker1 # [ 24.855732] nix-grpc-daemon[775]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3651worker2 # [ 25.053105] nix-grpc-daemon[784]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 25.061240] nix-grpc-daemon[784]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3653worker1 # [ 25.058554] nix-grpc-daemon[775]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513654worker1 # [ 25.064225] nix-grpc-daemon[775]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3655worker2 # [ 25.265195] nix-grpc-daemon[784]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 25.271414] nix-grpc-daemon[784]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3657worker1 # [ 25.268739] nix-grpc-daemon[775]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513658worker1 # [ 25.273197] nix-grpc-daemon[775]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3659worker2 # [ 25.471806] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513660worker1 # [ 25.469181] nix-grpc-daemon[775]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513661worker2 # [ 25.478642] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3662worker1 # [ 25.475890] nix-grpc-daemon[775]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3663worker2 # [ 25.679755] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513664worker1 # [ 25.677334] nix-grpc-daemon[775]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513665worker2 # [ 25.687118] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3666worker1 # [ 25.684629] nix-grpc-daemon[775]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3667worker2 # [ 25.888449] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513668worker1 # [ 25.886042] nix-grpc-daemon[775]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513669worker2 # [ 25.896233] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3670worker1 # [ 25.893635] nix-grpc-daemon[775]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3671worker2 # [ 26.097550] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513672worker1 # [ 26.095010] nix-grpc-daemon[775]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513673worker2 # [ 26.105778] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3674worker1 # [ 26.102358] nix-grpc-daemon[775]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3675worker2 # [ 26.307944] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513676worker1 # [ 26.305048] nix-grpc-daemon[775]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 26.313445] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3678worker1 # [ 26.312719] nix-grpc-daemon[775]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3679worker2 # [ 26.514678] nix-grpc-daemon[784]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 26.514295] nix-grpc-daemon[775]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 26.522164] nix-grpc-daemon[784]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3682worker1 # [ 26.521967] nix-grpc-daemon[775]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3683worker2 # [ 26.723740] nix-grpc-daemon[784]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513684worker1 # [ 26.723174] nix-grpc-daemon[775]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513685worker2 # [ 26.730854] nix-grpc-daemon[784]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3686worker1 # [ 26.730534] nix-grpc-daemon[775]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3687worker2 # [ 26.932332] nix-grpc-daemon[784]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513688worker1 # [ 26.931780] nix-grpc-daemon[775]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 26.938943] nix-grpc-daemon[784]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3690worker1 # [ 26.938909] nix-grpc-daemon[775]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3691worker2 # [ 27.140325] nix-grpc-daemon[784]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513692worker1 # [ 27.140942] nix-grpc-daemon[775]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513693worker2 # [ 27.147330] nix-grpc-daemon[784]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3694worker1 # [ 27.148781] nix-grpc-daemon[775]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3695worker2 # [ 27.351604] nix-grpc-daemon[784]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513696worker1 # [ 27.352600] nix-grpc-daemon[775]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513697worker2 # [ 27.356278] nix-grpc-daemon[784]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3698worker1 # [ 27.356834] nix-grpc-daemon[775]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3699worker2 # [ 27.552604] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513700worker1 # [ 27.552914] nix-grpc-daemon[775]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513701worker2 # [ 27.559706] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3702worker1 # [ 27.559573] nix-grpc-daemon[775]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3703worker2 # [ 27.760991] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513704worker1 # [ 27.760282] nix-grpc-daemon[775]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513705worker1 # [ 27.763400] nix-grpc-daemon[775]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3706worker2 # [ 27.768121] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3707worker1 # [ 27.964293] nix-grpc-daemon[775]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513708worker2 # [ 27.969315] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513709worker1 # [ 27.968578] nix-grpc-daemon[775]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3710worker2 # [ 27.976592] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3711worker1 # [ 28.169795] nix-grpc-daemon[775]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513712worker2 # [ 28.178481] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513713worker1 # [ 28.176561] nix-grpc-daemon[775]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3714worker2 # [ 28.184390] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3715worker1 # [ 28.378469] nix-grpc-daemon[775]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513716worker2 # [ 28.387912] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513717worker1 # [ 28.385261] nix-grpc-daemon[775]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3718worker2 # [ 28.393514] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3719worker1 # [ 28.585967] nix-grpc-daemon[775]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513720worker2 # [ 28.593951] nix-grpc-daemon[784]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513721worker1 # [ 28.594985] nix-grpc-daemon[775]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3722worker2 # [ 28.600219] nix-grpc-daemon[784]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3723worker2 # [ 28.801167] nix-grpc-daemon[784]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513724worker1 # [ 28.796233] nix-grpc-daemon[775]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513725worker2 # [ 28.808650] nix-grpc-daemon[784]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3726worker1 # [ 28.803537] nix-grpc-daemon[775]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3727worker2 # [ 29.009837] nix-grpc-daemon[784]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513728worker1 # [ 29.005007] nix-grpc-daemon[775]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513729lb # [ 29.112325] rustfs-bucket-start[993]: mb s3://farm3730worker2 # [ 29.017867] nix-grpc-daemon[784]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3731worker1 # [ 29.013327] nix-grpc-daemon[775]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3732lb # [ 29.118480] systemd[1]: Finished rustfs-bucket.service.3733lb # [ 29.126695] systemd[1]: Starting niks3 server...3734worker2 # [ 29.219145] nix-grpc-daemon[784]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513735worker1 # [ 29.214485] nix-grpc-daemon[775]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513736worker2 # [ 29.226318] nix-grpc-daemon[784]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3737worker1 # [ 29.222109] nix-grpc-daemon[775]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3738lb # [ 29.358052] postgres[1008]: [1008] ERROR: relation "goose_db_version" does not exist at character 363739lb # [ 29.359414] postgres[1008]: [1008] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3740lb # [ 29.393431] niks3-server[1003]: 2026/09/20 08:16:58 OK 20241026095416_initial_model.sql (20.59ms)3741lb # [ 29.397169] niks3-server[1003]: 2026/09/20 08:16:58 OK 20251210153512_drop_unused_gin_index.sql (4.17ms)3742lb # [ 29.403407] niks3-server[1003]: 2026/09/20 08:16:58 OK 20251218171726_add_pins.sql (6.17ms)3743lb # [ 29.408532] niks3-server[1003]: 2026/09/20 08:16:58 OK 20260628120000_add_object_size_and_stats.sql (5.08ms)3744lb # [ 29.414368] niks3-server[1003]: 2026/09/20 08:16:58 OK 20260905000000_add_claims.sql (5.79ms)3745lb # [ 29.419563] niks3-server[1003]: 2026/09/20 08:16:58 OK 20260920000000_drop_claims.sql (5.04ms)3746lb # [ 29.421740] niks3-server[1003]: 2026/09/20 08:16:58 goose: successfully migrated database to version: 202609200000003747lb # [ 29.426599] niks3-server[1003]: 2026/09/20 08:16:58 OK 1_commit_pending_closure.sql (7ms)3748lb # [ 29.429639] niks3-server[1003]: 2026/09/20 08:16:58 OK 2_object_stats_trigger.sql (2.89ms)3749lb # [ 29.431002] niks3-server[1003]: 2026/09/20 08:16:58 goose: up to current file version: 23750lb # [ 29.435294] niks3-server[1003]: 2026/09/20 08:16:58 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3751lb # [ 29.483917] niks3-server[1003]: 2026/09/20 08:16:59 INFO Read proxy enabled — serving cache objects from S33752lb # [ 29.486085] niks3-server[1003]: 2026/09/20 08:16:59 INFO Using socket-activated listener address=0.0.0.0:57513753lb # [ 29.490538] niks3-server[1003]: 2026/09/20 08:16:59 INFO systemd watchdog enabled interval=15s3754lb # [ 29.496140] systemd[1]: Started niks3 server.3755lb # [ 29.496974] niks3-server[1003]: 2026/09/20 08:16:59 INFO Starting HTTP server address=0.0.0.0:57513756lb # [ 29.498144] systemd[1]: Reached target Multi-User System.3757lb # [ 29.498941] systemd[1]: Startup finished in 1.027s (kernel) + 5.683s (initrd) + 22.783s (userspace) = 29.494s.3758lb # [ 29.503308] niks3-server[1003]: 2026/09/20 08:16:59 INFO lead: acquired remote=192.168.1.3:334303759worker1 # [ 29.412777] nix-grpc-daemon[775]: ts=2026-09-20T08:16:58Z level=info event=scheduler_take_over3760worker1 # [ 29.423253] nix-grpc-daemon[775]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513761worker2 # [ 29.431016] nix-grpc-daemon[784]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513762worker1 # [ 29.429840] nix-grpc-daemon[775]: ts=2026-09-20T08:16:58Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03763worker2 # [ 29.435462] nix-grpc-daemon[784]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3764worker2 # [ 29.631612] nix-grpc-daemon[784]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513765worker2 # [ 29.638966] nix-grpc-daemon[784]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3766lb: (finished: waiting for unit niks3.service, in 13.98 seconds)3767lb: waiting for TCP port 5751 on localhost3768lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3769lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds)3770lb: waiting for unit envoy.service3771worker2 # [ 29.840329] nix-grpc-daemon[784]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513772worker1 # [ 29.837447] nix-grpc-daemon[775]: ts=2026-09-20T08:16:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03773lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3774lb: waiting for TCP port 50051 on localhost3775lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3776lb # [ 29.986399] envoy[911]: conn peer=[::1]:53196 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33777lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3778lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3779lb: must succeed: curl -sf localhost:9901/clusters3780lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)3781lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)3782subtest: one node schedules and both builders hold a WorkerSession on it3783lb: must succeed: curl -sf localhost:9901/clusters3784lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3785worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3786worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.11 seconds)3787(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.17 seconds)3788subtest: balancer auth: client cert, bearer token, nothing, unknown CN3789worker2 # [ 30.730635] nix-grpc-daemon[784]: ts=2026-09-20T08:17:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:557203790worker2 # [ 30.750865] systemd[1]: Started Nix Daemon.3791worker2 # [ 32.404370] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)3792worker2 # [ 32.444217] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5)3793worker2 # [ 32.544622] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 2/5)3794worker2 # [ 32.607245] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 347 ms (attempt 3/5)3795worker2 # [ 32.962416] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 275 ms (attempt 4/5)3796worker2 # [ 33.247975] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3797worker1 # [ 33.284972] nix-grpc-daemon[775]: ts=2026-09-20T08:17:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:417823798worker1 # [ 33.305687] systemd[1]: Started Nix Daemon.3799worker1 # [ 33.602065] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3800worker1 # [ 33.631052] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 74 ms (attempt 1/5)3801worker1 # [ 33.708600] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 2/5)3802worker1 # [ 33.808165] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 285 ms (attempt 3/5)3803worker1 # [ 34.102412] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 563 ms (attempt 4/5)3804worker1 # [ 34.678348] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3805worker1 # [ 34.697516] nix-grpc-daemon[775]: ts=2026-09-20T08:17:04Z level=debug event=path_info_miss path=2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test error="error: path '/nix/store/2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test' is required, but there is no substituter that can build it"3806worker2 # [ 34.718448] nix-grpc-daemon[784]: ts=2026-09-20T08:17:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:557203807worker2 # [ 34.736220] nix-grpc-daemon[784]: ts=2026-09-20T08:17:04Z level=debug event=path_info_miss path=2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test error="error: path '/nix/store/2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test' is required, but there is no substituter that can build it"3808client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3809client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds)3810client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3811client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3812worker1 # [ 35.199538] nix-grpc-daemon[775]: ts=2026-09-20T08:17:04Z level=info event=oidc_jwks provider=mock keys=13813worker1 # [ 35.206003] nix-grpc-daemon[775]: ts=2026-09-20T08:17:04Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:417823814worker1 # [ 35.225191] nix-grpc-daemon[775]: ts=2026-09-20T08:17:04Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:417823815worker1 # [ 35.237899] nix-grpc-daemon[775]: ts=2026-09-20T08:17:04Z level=debug event=path_info_miss path=2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test error="error: path '/nix/store/2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test' is required, but there is no substituter that can build it"3816worker2 # [ 35.261964] nix-grpc-daemon[784]: ts=2026-09-20T08:17:04Z level=info event=oidc_jwks provider=mock keys=13817worker2 # [ 35.268637] nix-grpc-daemon[784]: ts=2026-09-20T08:17:04Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:557203818worker2 # [ 35.277340] nix-grpc-daemon[784]: ts=2026-09-20T08:17:04Z level=debug event=path_info_miss path=2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test error="error: path '/nix/store/2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test' is required, but there is no substituter that can build it"3819client: must succeed: rm -r /var/lib/nix-grpc-store3820client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds)3821worker1 # [ 35.579289] nix-grpc-daemon[775]: ts=2026-09-20T08:17:05Z level=info event=denied method=QueryMissing cn=- role=none3822worker1 # [ 35.821326] nix-grpc-daemon[775]: ts=2026-09-20T08:17:05Z level=info event=denied method=QueryMissing cn=stranger role=none3823(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.50 seconds)3824subtest: DAG build is scheduled across workers and lands in the cache3825client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&23826client # don't know how to build these paths:3827client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3828worker2 # [ 36.075675] nix-grpc-daemon[784]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:557203829worker1 # [ 36.092126] nix-grpc-daemon[775]: ts=2026-09-20T08:17:05Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03830worker1 # [ 36.099635] nix-grpc-daemon[775]: ts=2026-09-20T08:17:05Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13831worker1 # [ 36.142171] nix-grpc-daemon[775]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417823832worker1 # [ 36.166158] nix-grpc-daemon[775]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417823833client # copying 1 paths to 'lb:50051'...3834worker1 # [ 36.184684] nix-grpc-daemon[775]: ts=2026-09-20T08:17:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417823835client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3836worker1 # [ 36.210637] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3837worker1 # [ 36.250265] nix-grpc-daemon[775]: ts=2026-09-20T08:17:05Z level=info event=niks3_push_started pid=8493838worker1 # [ 36.725550] nix-daemon[837]: accepted connection from pid 862, user nix-grpc-daemon (trusted)3839worker1 # [ 36.746621] nix-daemon[837]: reaped child process 865, status = succeeded3840worker1 # [ 36.907451] nix-daemon[837]: accepted connection from pid 867, user nix-grpc-daemon (trusted)3841worker1 # [ 36.929583] nix-daemon[837]: reaped child process 870, status = succeeded3842lb # [ 37.038558] niks3-server[1003]: 2026/09/20 08:17:06 INFO Received uploads request method=POST path=/api/pending_closures3843worker1 # [ 36.969392] nix-grpc-daemon[849]: time=2026-09-20T08:17:06.518Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3844worker1 # [ 36.970981] nix-grpc-daemon[849]: time=2026-09-20T08:17:06.518Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3845lb # [ 37.116973] niks3-server[1003]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3846lb # [ 37.131672] niks3-server[1003]: 2026/09/20 08:17:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3847lb # [ 37.141096] niks3-server[1003]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3848lb # [ 37.164432] niks3-server[1003]: 2026/09/20 08:17:06 INFO Signed narinfos id=1 count=13849worker1 # [ 37.071298] nix-grpc-daemon[849]: time=2026-09-20T08:17:06.620Z level=INFO msg="Uploading 1 narinfos"3850lb # [ 37.179215] niks3-server[1003]: 2026/09/20 08:17:06 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3851lb # [ 37.190650] niks3-server[1003]: 2026/09/20 08:17:06 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3852lb # [ 37.208248] niks3-server[1003]: 2026/09/20 08:17:06 INFO Completed upload id=13853worker1 # [ 37.116222] nix-grpc-daemon[849]: time=2026-09-20T08:17:06.662Z level=INFO msg="Upload complete. (564ms)"3854worker1 # [ 37.129484] nix-grpc-daemon[775]: ts=2026-09-20T08:17:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=0 paths=1 nar_bytes_in=5043855worker1 # [ 37.155306] nix-grpc-daemon[775]: ts=2026-09-20T08:17:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417823856worker1 # [ 37.164173] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3857worker1 # [ 37.167301] nix-daemon[837]: reaped child process 847, status = succeeded3858client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3859worker1 # [ 37.183725] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3860client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3861client # farm-a> LOG-farm-a-t13862worker1 # [ 38.419535] nix-daemon[837]: reaped child process 874, status = succeeded3863worker1 # [ 38.582358] nix-daemon[837]: accepted connection from pid 890, user nix-grpc-daemon (trusted)3864worker1 # [ 38.602989] nix-daemon[837]: reaped child process 893, status = succeeded3865lb # [ 38.717750] niks3-server[1003]: 2026/09/20 08:17:08 INFO Received uploads request method=POST path=/api/pending_closures3866worker1 # [ 38.635220] nix-grpc-daemon[849]: time=2026-09-20T08:17:08.184Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3867worker1 # [ 38.637274] nix-grpc-daemon[849]: time=2026-09-20T08:17:08.184Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3868lb # [ 38.788745] niks3-server[1003]: 2026/09/20 08:17:08 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3869worker1 # [ 38.704241] nix-grpc-daemon[849]: time=2026-09-20T08:17:08.254Z level=INFO msg="Uploading 1 narinfos"3870lb # [ 38.801204] niks3-server[1003]: 2026/09/20 08:17:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3871lb # [ 38.809802] niks3-server[1003]: 2026/09/20 08:17:08 INFO Signed narinfos id=2 count=13872lb # [ 38.817937] niks3-server[1003]: 2026/09/20 08:17:08 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3873lb # [ 38.826809] niks3-server[1003]: 2026/09/20 08:17:08 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3874lb # [ 38.835131] niks3-server[1003]: 2026/09/20 08:17:08 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3875lb # [ 38.844638] niks3-server[1003]: 2026/09/20 08:17:08 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3876lb # [ 38.849890] niks3-server[1003]: 2026/09/20 08:17:08 INFO Completed upload id=23877worker1 # [ 38.752726] nix-grpc-daemon[849]: time=2026-09-20T08:17:08.303Z level=INFO msg="Upload complete. (344ms)"3878worker1 # [ 38.777114] nix-grpc-daemon[775]: ts=2026-09-20T08:17:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13879worker1 # [ 38.792351] nix-grpc-daemon[775]: ts=2026-09-20T08:17:08Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03880worker1 # [ 38.798754] nix-grpc-daemon[775]: ts=2026-09-20T08:17:08Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13881worker1 # [ 38.802634] nix-daemon[837]: reaped child process 872, status = succeeded3882worker1 # [ 38.823099] nix-grpc-daemon[775]: ts=2026-09-20T08:17:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417823883worker1 # [ 38.835010] nix-grpc-daemon[775]: ts=2026-09-20T08:17:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417823884worker1 # [ 38.881042] nix-grpc-daemon[849]: time=2026-09-20T08:17:08.431Z level=INFO msg="All 1 paths already cached"3885client # copying 1 paths to 'lb:50051'...3886worker1 # [ 38.892738] nix-grpc-daemon[775]: ts=2026-09-20T08:17:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417823887client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3888worker1 # [ 38.916248] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3889worker1 # [ 39.135870] nix-daemon[837]: accepted connection from pid 899, user nix-grpc-daemon (trusted)3890worker1 # [ 39.155213] nix-daemon[837]: reaped child process 902, status = succeeded3891worker1 # [ 39.336434] nix-daemon[837]: accepted connection from pid 904, user nix-grpc-daemon (trusted)3892worker1 # [ 39.355371] nix-daemon[837]: reaped child process 907, status = succeeded3893lb # [ 39.460712] niks3-server[1003]: 2026/09/20 08:17:09 INFO Received uploads request method=POST path=/api/pending_closures3894worker1 # [ 39.373794] nix-grpc-daemon[849]: time=2026-09-20T08:17:08.924Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3895worker1 # [ 39.375977] nix-grpc-daemon[849]: time=2026-09-20T08:17:08.926Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3896lb # [ 39.499053] niks3-server[1003]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3897lb # [ 39.520373] niks3-server[1003]: 2026/09/20 08:17:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3898lb # [ 39.528170] niks3-server[1003]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3899lb # [ 39.537633] niks3-server[1003]: 2026/09/20 08:17:09 INFO Signed narinfos id=3 count=13900worker1 # [ 39.440895] nix-grpc-daemon[849]: time=2026-09-20T08:17:08.991Z level=INFO msg="Uploading 1 narinfos"3901lb # [ 39.549782] niks3-server[1003]: 2026/09/20 08:17:09 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3902lb # [ 39.556504] niks3-server[1003]: 2026/09/20 08:17:09 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3903lb # [ 39.567716] niks3-server[1003]: 2026/09/20 08:17:09 INFO Completed upload id=33904worker1 # [ 39.473007] nix-grpc-daemon[849]: time=2026-09-20T08:17:09.023Z level=INFO msg="Upload complete. (538ms)"3905worker1 # [ 39.483105] nix-grpc-daemon[775]: ts=2026-09-20T08:17:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=0 paths=1 nar_bytes_in=6243906worker1 # [ 39.496957] nix-grpc-daemon[775]: ts=2026-09-20T08:17:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417823907worker1 # [ 39.511635] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3908worker1 # [ 39.518820] nix-daemon[837]: reaped child process 897, status = succeeded3909client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3910worker1 # [ 39.532610] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3911client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3912client # farm-b> LOG-farm-b-t13913worker1 # [ 40.560139] nix-daemon[837]: reaped child process 911, status = succeeded3914worker1 # [ 40.721315] nix-daemon[837]: accepted connection from pid 927, user nix-grpc-daemon (trusted)3915worker1 # [ 40.740284] nix-daemon[837]: reaped child process 930, status = succeeded3916lb # [ 40.850642] niks3-server[1003]: 2026/09/20 08:17:10 INFO Received uploads request method=POST path=/api/pending_closures3917worker1 # [ 40.769858] nix-grpc-daemon[849]: time=2026-09-20T08:17:10.319Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3918worker1 # [ 40.771360] nix-grpc-daemon[849]: time=2026-09-20T08:17:10.319Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3919lb # [ 40.893789] niks3-server[1003]: 2026/09/20 08:17:10 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3920lb # [ 40.908161] niks3-server[1003]: 2026/09/20 08:17:10 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3921lb # [ 40.916831] niks3-server[1003]: 2026/09/20 08:17:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3922lb # [ 40.922210] niks3-server[1003]: 2026/09/20 08:17:10 INFO Signed narinfos id=4 count=13923worker1 # [ 40.824506] nix-grpc-daemon[849]: time=2026-09-20T08:17:10.374Z level=INFO msg="Uploading 1 narinfos"3924lb # [ 40.927100] niks3-server[1003]: 2026/09/20 08:17:10 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3925lb # [ 40.937069] niks3-server[1003]: 2026/09/20 08:17:10 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3926lb # [ 40.944404] niks3-server[1003]: 2026/09/20 08:17:10 INFO Completed upload id=43927worker1 # [ 40.847215] nix-grpc-daemon[849]: time=2026-09-20T08:17:10.397Z level=INFO msg="Upload complete. (300ms)"3928lb # [ 40.946941] niks3-server[1003]: 2026/09/20 08:17:10 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3929worker1 # [ 40.862614] nix-grpc-daemon[775]: ts=2026-09-20T08:17:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13930worker1 # [ 40.876825] nix-grpc-daemon[775]: ts=2026-09-20T08:17:10Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03931worker1 # [ 40.880521] nix-grpc-daemon[775]: ts=2026-09-20T08:17:10Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13932worker1 # [ 40.883997] nix-daemon[837]: reaped child process 909, status = succeeded3933worker1 # [ 40.907878] nix-grpc-daemon[775]: ts=2026-09-20T08:17:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417823934worker1 # [ 40.932818] nix-grpc-daemon[775]: ts=2026-09-20T08:17:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417823935worker1 # [ 40.949523] nix-grpc-daemon[849]: time=2026-09-20T08:17:10.500Z level=INFO msg="All 2 paths already cached"3936client # copying 1 paths to 'lb:50051'...3937worker1 # [ 40.961094] nix-grpc-daemon[775]: ts=2026-09-20T08:17:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417823938client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3939worker1 # [ 40.984304] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3940worker1 # [ 41.179781] nix-daemon[837]: accepted connection from pid 936, user nix-grpc-daemon (trusted)3941worker1 # [ 41.201559] nix-daemon[837]: reaped child process 939, status = succeeded3942worker1 # [ 41.363410] nix-daemon[837]: accepted connection from pid 941, user nix-grpc-daemon (trusted)3943worker1 # [ 41.382270] nix-daemon[837]: reaped child process 944, status = succeeded3944lb # [ 41.492900] niks3-server[1003]: 2026/09/20 08:17:11 INFO Received uploads request method=POST path=/api/pending_closures3945worker1 # [ 41.409983] nix-grpc-daemon[849]: time=2026-09-20T08:17:10.960Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3946worker1 # [ 41.411539] nix-grpc-daemon[849]: time=2026-09-20T08:17:10.960Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3947lb # [ 41.534301] niks3-server[1003]: 2026/09/20 08:17:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3948worker1 # [ 41.445393] nix-grpc-daemon[849]: time=2026-09-20T08:17:10.995Z level=INFO msg="Uploading 1 narinfos"3949lb # [ 41.549833] niks3-server[1003]: 2026/09/20 08:17:11 INFO Signed narinfos id=5 count=13950lb # [ 41.557470] niks3-server[1003]: 2026/09/20 08:17:11 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3951lb # [ 41.571378] niks3-server[1003]: 2026/09/20 08:17:11 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3952lb # [ 41.575979] niks3-server[1003]: 2026/09/20 08:17:11 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3953lb # [ 41.581315] niks3-server[1003]: 2026/09/20 08:17:11 INFO Completed upload id=53954worker1 # [ 41.483328] nix-grpc-daemon[849]: time=2026-09-20T08:17:11.034Z level=INFO msg="Upload complete. (480ms)"3955lb # [ 41.584633] niks3-server[1003]: 2026/09/20 08:17:11 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3956worker1 # [ 41.496268] nix-grpc-daemon[775]: ts=2026-09-20T08:17:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=0 paths=1 nar_bytes_in=7523957worker1 # [ 41.508477] nix-grpc-daemon[775]: ts=2026-09-20T08:17:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417823958worker1 # [ 41.516958] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3959worker1 # [ 41.522330] nix-daemon[837]: reaped child process 934, status = succeeded3960client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3961worker1 # [ 41.535697] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3962client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3963lb # [ 41.826276] envoy[911]: conn peer=[2001:db8:1::1]:40168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=40753964lb # [ 41.831726] envoy[911]: conn peer=[2001:db8:1::1]:33680 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1023965lb # [ 41.836826] envoy[911]: conn peer=[2001:db8:1::1]:33684 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=133966lb # [ 41.841328] envoy[911]: conn peer=[2001:db8:1::1]:33700 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=143967client # farm-top> LOG-farm-top-t13968worker1 # [ 42.577151] nix-daemon[837]: reaped child process 948, status = succeeded3969worker1 # [ 42.751818] nix-daemon[837]: accepted connection from pid 963, user nix-grpc-daemon (trusted)3970worker1 # [ 42.774320] nix-daemon[837]: reaped child process 966, status = succeeded3971lb # [ 42.886257] niks3-server[1003]: 2026/09/20 08:17:12 INFO Received uploads request method=POST path=/api/pending_closures3972worker1 # [ 42.799323] nix-grpc-daemon[849]: time=2026-09-20T08:17:12.348Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3973worker1 # [ 42.801036] nix-grpc-daemon[849]: time=2026-09-20T08:17:12.348Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3974lb # [ 42.934238] niks3-server[1003]: 2026/09/20 08:17:12 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3975lb # [ 42.946105] niks3-server[1003]: 2026/09/20 08:17:12 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3976worker1 # [ 42.856884] nix-grpc-daemon[849]: time=2026-09-20T08:17:12.407Z level=INFO msg="Uploading 1 narinfos"3977lb # [ 42.958174] niks3-server[1003]: 2026/09/20 08:17:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3978lb # [ 42.965478] niks3-server[1003]: 2026/09/20 08:17:12 INFO Signed narinfos id=6 count=13979lb # [ 42.967658] niks3-server[1003]: 2026/09/20 08:17:12 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3980lb # [ 42.978053] niks3-server[1003]: 2026/09/20 08:17:12 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3981lb # [ 42.986705] niks3-server[1003]: 2026/09/20 08:17:12 INFO Completed upload id=63982worker1 # [ 42.889581] nix-grpc-daemon[849]: time=2026-09-20T08:17:12.440Z level=INFO msg="Upload complete. (339ms)"3983lb # [ 42.990061] niks3-server[1003]: 2026/09/20 08:17:12 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3984worker1 # [ 42.905370] nix-grpc-daemon[775]: ts=2026-09-20T08:17:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13985worker1 # [ 42.922971] nix-daemon[837]: reaped child process 946, status = succeeded3986client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 7.11 seconds)3987client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath3988client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.25 seconds)3989client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3990client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.02 seconds)3991client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3992client # copying 3 paths...3993client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3994client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3995client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3996client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)3997(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.81 seconds)3998subtest: repeat is answered Cached by the scheduler without building3999worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4000worker1 # finding garbage collector roots...4001worker1 # deleting specified paths...4002worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4003worker1 # deleting unused links...4004worker1 # note: hard linking is currently saving 0.0 KiB4005worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)4006worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4007worker2 # finding garbage collector roots...4008worker2 # deleting specified paths...4009worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4010worker2 # deleting unused links...4011worker2 # note: hard linking is currently saving 0.0 KiB4012worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.35 seconds)4013client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&24014client # don't know how to build these paths:4015client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4016worker2 # [ 44.581285] nix-grpc-daemon[784]: ts=2026-09-20T08:17:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:557204017worker1 # [ 44.593480] nix-grpc-daemon[775]: ts=2026-09-20T08:17:14Z level=debug event=want client=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=14018worker1 # [ 44.611124] nix-grpc-daemon[775]: ts=2026-09-20T08:17:14Z level=debug event=want client=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=14019worker1 # [ 44.625984] nix-grpc-daemon[775]: ts=2026-09-20T08:17:14Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14020client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 0.36 seconds)4021client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath4022client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.23 seconds)4023lb: must succeed: curl -sf localhost:9901/clusters4024lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4025lb: must succeed: curl -sf localhost:9901/clusters4026lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4027worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4028worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds)4029(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.59 seconds)4030subtest: two clients wanting the same drv build it once4031client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4032client # [ 45.348875] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4033client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4034client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4035client # Running as unit: dedup1.service; invocation ID: 21dc2d591108490eb4ce5492dcebfc144036client # [ 45.599306] nix[869]: don't know how to build these paths:4037client # [ 45.601439] nix[869]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4038worker2 # [ 45.572866] nix-grpc-daemon[784]: ts=2026-09-20T08:17:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:557204039worker1 # [ 45.585727] nix-grpc-daemon[775]: ts=2026-09-20T08:17:15Z level=debug event=want client=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04040worker1 # [ 45.586324] nix-grpc-daemon[775]: ts=2026-09-20T08:17:15Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14041worker2 # [ 45.610053] nix-grpc-daemon[784]: ts=2026-09-20T08:17:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557204042worker2 # [ 45.629273] nix-grpc-daemon[784]: ts=2026-09-20T08:17:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557204043client # [ 45.666178] nix[869]: copying 1 paths to 'lb:50051'...4044client # [ 45.671323] nix[869]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4045worker2 # [ 45.648133] nix-grpc-daemon[784]: ts=2026-09-20T08:17:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:557204046worker2 # [ 45.663848] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4047worker2 # [ 45.689528] nix-grpc-daemon[784]: ts=2026-09-20T08:17:15Z level=info event=niks3_push_started pid=8684048worker2 # [ 46.146137] nix-daemon[840]: accepted connection from pid 881, user nix-grpc-daemon (trusted)4049worker2 # [ 46.166156] nix-daemon[840]: reaped child process 884, status = succeeded4050worker2 # [ 46.343167] nix-daemon[840]: accepted connection from pid 886, user nix-grpc-daemon (trusted)4051worker2 # [ 46.363532] nix-daemon[840]: reaped child process 889, status = succeeded4052lb # [ 46.467798] niks3-server[1003]: 2026/09/20 08:17:16 INFO Received uploads request method=POST path=/api/pending_closures4053worker2 # [ 46.387187] nix-grpc-daemon[868]: time=2026-09-20T08:17:15.938Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4054worker2 # [ 46.389430] nix-grpc-daemon[868]: time=2026-09-20T08:17:15.940Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4055lb # [ 46.507712] niks3-server[1003]: 2026/09/20 08:17:16 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4056lb # [ 46.522578] niks3-server[1003]: 2026/09/20 08:17:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4057worker2 # [ 46.437134] nix-grpc-daemon[868]: time=2026-09-20T08:17:15.987Z level=INFO msg="Uploading 1 narinfos"4058lb # [ 46.536370] niks3-server[1003]: 2026/09/20 08:17:16 INFO Signed narinfos id=7 count=14059lb # [ 46.544663] niks3-server[1003]: 2026/09/20 08:17:16 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4060lb # [ 46.558623] niks3-server[1003]: 2026/09/20 08:17:16 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4061client # [ 46.481395] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4062worker2 # [ 46.471165] nix-grpc-daemon[868]: time=2026-09-20T08:17:16.022Z level=INFO msg="Upload complete. (516ms)"4063lb # [ 46.564121] niks3-server[1003]: 2026/09/20 08:17:16 INFO Completed upload id=74064lb # [ 46.566994] niks3-server[1003]: 2026/09/20 08:17:16 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4065worker2 # [ 46.479738] nix-grpc-daemon[784]: ts=2026-09-20T08:17:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=0 paths=1 nar_bytes_in=4324066client # Running as unit: dedup2.service; invocation ID: 3fc37ef5c46e4315b1542d702a0f9d044067worker2 # [ 46.493051] nix-grpc-daemon[784]: ts=2026-09-20T08:17:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557204068worker2 # [ 46.496668] nix-daemon[840]: reaped child process 866, status = succeeded4069client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.15 seconds)4070worker2 # [ 46.504172] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4071client # [ 46.538733] nix[869]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4072worker2 # [ 46.517201] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4073worker1 # [ 46.771036] nix-grpc-daemon[775]: ts=2026-09-20T08:17:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417824074client # [ 46.807421] nix[885]: don't know how to build these paths:4075client # [ 46.808692] nix[885]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4076worker1 # [ 46.793795] nix-grpc-daemon[775]: ts=2026-09-20T08:17:16Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04077client # [ 46.829111] nix[885]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4078worker2 # [ 46.805373] nix-grpc-daemon[784]: ts=2026-09-20T08:17:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557204079client: must succeed: sleep 24080client: (finished: must succeed: sleep 2, in 2.07 seconds)4081client: waiting for success: ! systemctl is-active dedup1 dedup24082worker2 # [ 50.165528] nix-daemon[840]: reaped child process 893, status = succeeded4083worker2 # [ 50.338927] nix-daemon[840]: accepted connection from pid 923, user nix-grpc-daemon (trusted)4084worker2 # [ 50.358973] nix-daemon[840]: reaped child process 926, status = succeeded4085lb # [ 50.465687] niks3-server[1003]: 2026/09/20 08:17:20 INFO Received uploads request method=POST path=/api/pending_closures4086worker2 # [ 50.386608] nix-grpc-daemon[868]: time=2026-09-20T08:17:19.937Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4087worker2 # [ 50.389160] nix-grpc-daemon[868]: time=2026-09-20T08:17:19.939Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4088lb # [ 50.513482] niks3-server[1003]: 2026/09/20 08:17:20 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4089lb # [ 50.524280] niks3-server[1003]: 2026/09/20 08:17:20 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4090lb # [ 50.531370] niks3-server[1003]: 2026/09/20 08:17:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4091lb # [ 50.535932] niks3-server[1003]: 2026/09/20 08:17:20 INFO Signed narinfos id=8 count=14092worker2 # [ 50.444115] nix-grpc-daemon[868]: time=2026-09-20T08:17:19.993Z level=INFO msg="Uploading 1 narinfos"4093lb # [ 50.537978] niks3-server[1003]: 2026/09/20 08:17:20 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4094lb # [ 50.546773] niks3-server[1003]: 2026/09/20 08:17:20 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4095lb # [ 50.553132] niks3-server[1003]: 2026/09/20 08:17:20 INFO Completed upload id=84096worker2 # [ 50.460829] nix-grpc-daemon[868]: time=2026-09-20T08:17:20.012Z level=INFO msg="Upload complete. (326ms)"4097lb # [ 50.555122] niks3-server[1003]: 2026/09/20 08:17:20 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4098worker2 # [ 50.473039] nix-grpc-daemon[784]: ts=2026-09-20T08:17:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14099worker2 # [ 50.487320] nix-grpc-daemon[784]: ts=2026-09-20T08:17:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14100worker2 # [ 50.493264] nix-daemon[840]: reaped child process 891, status = succeeded4101client # [ 50.535885] systemd[1]: dedup1.service: Deactivated successfully.4102client # [ 50.537910] systemd[1]: dedup1.service: Consumed 157ms CPU time over 5.188s wall clock time, 39.2M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.4103client # [ 50.541965] systemd[1]: dedup2.service: Deactivated successfully.4104client # [ 50.544780] systemd[1]: dedup2.service: Consumed 168ms CPU time over 4.064s wall clock time, 31.1M memory peak, 7.4K incoming IP traffic, 6.5K outgoing IP traffic.4105client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds)4106client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4107client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.06 seconds)4108worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4109worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4110worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4111worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4112worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4113worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4114worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4115worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4116(finished: subtest: two clients wanting the same drv build it once, in 6.27 seconds)4117subtest: build hook: nix-daemon with builders = grpc://lb4118client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log4119lb # [ 51.823988] envoy[911]: conn peer=[2001:db8:1::1]:33712 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9397 tx=3771 ms=68594120client # [ 51.762739] systemd[1]: Started Nix Daemon.4121lb # [ 51.829270] envoy[911]: conn peer=[2001:db8:1::1]:60380 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1162 tx=481 ms=744122lb # [ 51.834563] envoy[911]: conn peer=[2001:db8:1::1]:60388 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1086 ms=37164123lb # [ 51.839717] envoy[911]: conn peer=[2001:db8:1::1]:60386 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1374 ms=49144124client # [ 51.953387] nix-daemon[928]: accepted connection from pid 925, user root (trusted)4125worker1 # [ 52.150257] nix-grpc-daemon[775]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:417824126worker1 # [ 52.157771] nix-grpc-daemon[775]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417824127worker1 # [ 52.173476] nix-grpc-daemon[775]: ts=2026-09-20T08:17:21Z level=debug event=want client=5 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04128worker1 # [ 52.186467] nix-grpc-daemon[775]: ts=2026-09-20T08:17:21Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14129worker1 # [ 52.197066] nix-grpc-daemon[775]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417824130worker1 # [ 52.208957] nix-grpc-daemon[775]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417824131worker1 # [ 52.225291] nix-grpc-daemon[775]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417824132worker1 # [ 52.242138] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4133worker1 # [ 52.449711] nix-daemon[837]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4134worker1 # [ 52.471836] nix-daemon[837]: reaped child process 1028, status = succeeded4135worker1 # [ 52.651529] nix-daemon[837]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4136worker1 # [ 52.671266] nix-daemon[837]: reaped child process 1033, status = succeeded4137lb # [ 52.786011] niks3-server[1003]: 2026/09/20 08:17:22 INFO Received uploads request method=POST path=/api/pending_closures4138worker1 # [ 52.700479] nix-grpc-daemon[849]: time=2026-09-20T08:17:22.250Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4139worker1 # [ 52.702018] nix-grpc-daemon[849]: time=2026-09-20T08:17:22.250Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4140lb # [ 52.816541] niks3-server[1003]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4141lb # [ 52.826716] niks3-server[1003]: 2026/09/20 08:17:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4142worker1 # [ 52.732698] nix-grpc-daemon[849]: time=2026-09-20T08:17:22.283Z level=INFO msg="Uploading 1 narinfos"4143lb # [ 52.833960] niks3-server[1003]: 2026/09/20 08:17:22 INFO Signed narinfos id=9 count=14144lb # [ 52.835712] niks3-server[1003]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4145lb # [ 52.843660] niks3-server[1003]: 2026/09/20 08:17:22 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4146lb # [ 52.849035] niks3-server[1003]: 2026/09/20 08:17:22 INFO Completed upload id=94147worker1 # [ 52.750893] nix-grpc-daemon[849]: time=2026-09-20T08:17:22.301Z level=INFO msg="Upload complete. (493ms)"4148lb # [ 52.850944] niks3-server[1003]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4149worker1 # [ 52.756268] nix-grpc-daemon[775]: ts=2026-09-20T08:17:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=0 paths=1 nar_bytes_in=5124150worker1 # [ 52.764397] nix-grpc-daemon[775]: ts=2026-09-20T08:17:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417824151worker1 # [ 52.777253] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4152worker1 # [ 52.779735] nix-daemon[837]: reaped child process 1023, status = succeeded4153worker1 # [ 52.789838] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4154worker1 # [ 53.816770] nix-daemon[837]: reaped child process 1037, status = succeeded4155worker1 # [ 53.984361] nix-daemon[837]: accepted connection from pid 1052, user nix-grpc-daemon (trusted)4156worker1 # [ 54.007863] nix-daemon[837]: reaped child process 1055, status = succeeded4157lb # [ 54.122156] niks3-server[1003]: 2026/09/20 08:17:23 INFO Received uploads request method=POST path=/api/pending_closures4158worker1 # [ 54.036435] nix-grpc-daemon[849]: time=2026-09-20T08:17:23.585Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4159worker1 # [ 54.037948] nix-grpc-daemon[849]: time=2026-09-20T08:17:23.585Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4160lb # [ 54.163966] niks3-server[1003]: 2026/09/20 08:17:23 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4161lb # [ 54.179297] niks3-server[1003]: 2026/09/20 08:17:23 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4162lb # [ 54.194227] niks3-server[1003]: 2026/09/20 08:17:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4163worker1 # [ 54.101474] nix-grpc-daemon[849]: time=2026-09-20T08:17:23.651Z level=INFO msg="Uploading 1 narinfos"4164lb # [ 54.202570] niks3-server[1003]: 2026/09/20 08:17:23 INFO Signed narinfos id=10 count=14165lb # [ 54.208706] niks3-server[1003]: 2026/09/20 08:17:23 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4166lb # [ 54.218267] niks3-server[1003]: 2026/09/20 08:17:23 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4167lb # [ 54.225639] niks3-server[1003]: 2026/09/20 08:17:23 INFO Completed upload id=104168worker1 # [ 54.126799] nix-grpc-daemon[849]: time=2026-09-20T08:17:23.677Z level=INFO msg="Upload complete. (325ms)"4169lb # [ 54.228618] niks3-server[1003]: 2026/09/20 08:17:23 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4170worker1 # [ 54.145203] nix-grpc-daemon[775]: ts=2026-09-20T08:17:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=5 outputs=14171worker2 # [ 54.154630] nix-grpc-daemon[784]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:557204172worker1 # [ 54.163964] nix-daemon[837]: reaped child process 1035, status = succeeded4173worker2 # [ 54.168992] nix-grpc-daemon[784]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4174worker2 # [ 54.224332] nix-grpc-daemon[784]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:557204175worker2 # [ 54.231391] nix-grpc-daemon[784]: ts=2026-09-20T08:17:23Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=0 paths=1 nar_bytes_out=1284176worker2 # [ 54.562282] nix-grpc-daemon[784]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:557204177worker1 # [ 54.562665] nix-grpc-daemon[775]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417824178worker1 # [ 54.575630] nix-grpc-daemon[849]: time=2026-09-20T08:17:24.126Z level=INFO msg="All 1 paths already cached"4179worker1 # [ 54.596917] nix-grpc-daemon[775]: ts=2026-09-20T08:17:24Z level=debug event=want client=6 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04180worker1 # [ 54.604499] nix-grpc-daemon[775]: ts=2026-09-20T08:17:24Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14181worker1 # [ 54.645882] nix-grpc-daemon[775]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417824182worker1 # [ 54.664504] nix-grpc-daemon[775]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417824183worker1 # [ 54.681808] nix-grpc-daemon[849]: time=2026-09-20T08:17:24.232Z level=INFO msg="All 1 paths already cached"4184worker1 # [ 54.694755] nix-grpc-daemon[775]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417824185worker1 # [ 54.711075] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4186worker1 # [ 54.932917] nix-daemon[837]: accepted connection from pid 1061, user nix-grpc-daemon (trusted)4187worker1 # [ 54.954745] nix-daemon[837]: reaped child process 1064, status = succeeded4188worker1 # [ 55.132695] nix-daemon[837]: accepted connection from pid 1066, user nix-grpc-daemon (trusted)4189worker1 # [ 55.151382] nix-daemon[837]: reaped child process 1069, status = succeeded4190lb # [ 55.262138] niks3-server[1003]: 2026/09/20 08:17:24 INFO Received uploads request method=POST path=/api/pending_closures4191worker1 # [ 55.176806] nix-grpc-daemon[849]: time=2026-09-20T08:17:24.726Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4192worker1 # [ 55.178291] nix-grpc-daemon[849]: time=2026-09-20T08:17:24.726Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4193lb # [ 55.295578] niks3-server[1003]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4194lb # [ 55.316413] niks3-server[1003]: 2026/09/20 08:17:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4195worker1 # [ 55.226394] nix-grpc-daemon[849]: time=2026-09-20T08:17:24.776Z level=INFO msg="Uploading 1 narinfos"4196lb # [ 55.332293] niks3-server[1003]: 2026/09/20 08:17:24 INFO Signed narinfos id=11 count=14197lb # [ 55.335218] niks3-server[1003]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4198lb # [ 55.346711] niks3-server[1003]: 2026/09/20 08:17:24 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4199lb # [ 55.353439] niks3-server[1003]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4200lb # [ 55.358417] niks3-server[1003]: 2026/09/20 08:17:24 INFO Completed upload id=114201worker1 # [ 55.261232] nix-grpc-daemon[849]: time=2026-09-20T08:17:24.811Z level=INFO msg="Upload complete. (530ms)"4202worker1 # [ 55.273750] nix-grpc-daemon[775]: ts=2026-09-20T08:17:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=0 paths=1 nar_bytes_in=6244203worker1 # [ 55.288894] nix-grpc-daemon[775]: ts=2026-09-20T08:17:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417824204worker1 # [ 55.302356] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4205worker1 # [ 55.306107] nix-daemon[837]: reaped child process 1059, status = succeeded4206worker1 # [ 55.320474] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4207worker1 # [ 56.174711] nix-daemon[837]: reaped child process 1073, status = succeeded4208worker1 # [ 56.367109] nix-daemon[837]: accepted connection from pid 1088, user nix-grpc-daemon (trusted)4209worker1 # [ 56.388475] nix-daemon[837]: reaped child process 1091, status = succeeded4210lb # [ 56.497946] niks3-server[1003]: 2026/09/20 08:17:26 INFO Received uploads request method=POST path=/api/pending_closures4211worker1 # [ 56.412446] nix-grpc-daemon[849]: time=2026-09-20T08:17:25.962Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4212worker1 # [ 56.413971] nix-grpc-daemon[849]: time=2026-09-20T08:17:25.962Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4213lb # [ 56.552273] niks3-server[1003]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4214lb # [ 56.563830] niks3-server[1003]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4215worker1 # [ 56.474652] nix-grpc-daemon[849]: time=2026-09-20T08:17:26.024Z level=INFO msg="Uploading 1 narinfos"4216lb # [ 56.576109] niks3-server[1003]: 2026/09/20 08:17:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4217lb # [ 56.579152] niks3-server[1003]: 2026/09/20 08:17:26 INFO Signed narinfos id=12 count=14218lb # [ 56.585239] niks3-server[1003]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4219lb # [ 56.592436] niks3-server[1003]: 2026/09/20 08:17:26 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4220worker1 # [ 56.495069] nix-grpc-daemon[849]: time=2026-09-20T08:17:26.045Z level=INFO msg="Upload complete. (357ms)"4221lb # [ 56.595157] niks3-server[1003]: 2026/09/20 08:17:26 INFO Completed upload id=124222lb # [ 56.600113] niks3-server[1003]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4223worker1 # [ 56.508340] nix-grpc-daemon[775]: ts=2026-09-20T08:17:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=6 outputs=14224worker1 # [ 56.528402] nix-grpc-daemon[775]: ts=2026-09-20T08:17:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:417824225worker1 # [ 56.532821] nix-daemon[837]: reaped child process 1071, status = succeeded4226worker1 # [ 56.548144] nix-grpc-daemon[775]: ts=2026-09-20T08:17:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:417824227worker1 # [ 56.554883] nix-grpc-daemon[775]: ts=2026-09-20T08:17:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=0 paths=1 nar_bytes_out=1764228worker1 # [ 56.877275] nix-grpc-daemon[775]: ts=2026-09-20T08:17:26Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:417824229worker2 # [ 56.890312] nix-grpc-daemon[784]: ts=2026-09-20T08:17:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557204230worker2 # [ 56.910269] nix-grpc-daemon[868]: time=2026-09-20T08:17:26.460Z level=INFO msg="All 1 paths already cached"4231worker1 # [ 56.926605] nix-grpc-daemon[775]: ts=2026-09-20T08:17:26Z level=debug event=want client=7 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04232worker1 # [ 56.934366] nix-grpc-daemon[775]: ts=2026-09-20T08:17:26Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14233worker1 # [ 56.944818] nix-grpc-daemon[775]: ts=2026-09-20T08:17:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417824234worker1 # [ 56.957493] nix-grpc-daemon[775]: ts=2026-09-20T08:17:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417824235worker1 # [ 56.972754] nix-grpc-daemon[849]: time=2026-09-20T08:17:26.523Z level=INFO msg="All 2 paths already cached"4236worker1 # [ 56.983683] nix-grpc-daemon[775]: ts=2026-09-20T08:17:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417824237worker1 # [ 56.998817] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4238worker1 # [ 57.210059] nix-daemon[837]: accepted connection from pid 1097, user nix-grpc-daemon (trusted)4239worker1 # [ 57.232908] nix-daemon[837]: reaped child process 1100, status = succeeded4240worker1 # [ 57.417123] nix-daemon[837]: accepted connection from pid 1102, user nix-grpc-daemon (trusted)4241worker1 # [ 57.435977] nix-daemon[837]: reaped child process 1105, status = succeeded4242lb # [ 57.545204] niks3-server[1003]: 2026/09/20 08:17:27 INFO Received uploads request method=POST path=/api/pending_closures4243worker1 # [ 57.458994] nix-grpc-daemon[849]: time=2026-09-20T08:17:27.009Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4244worker1 # [ 57.460601] nix-grpc-daemon[849]: time=2026-09-20T08:17:27.009Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4245lb # [ 57.579619] niks3-server[1003]: 2026/09/20 08:17:27 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4246worker1 # [ 57.497659] nix-grpc-daemon[849]: time=2026-09-20T08:17:27.048Z level=INFO msg="Uploading 1 narinfos"4247lb # [ 57.596788] niks3-server[1003]: 2026/09/20 08:17:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4248lb # [ 57.608271] niks3-server[1003]: 2026/09/20 08:17:27 INFO Signed narinfos id=13 count=14249lb # [ 57.613677] niks3-server[1003]: 2026/09/20 08:17:27 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4250lb # [ 57.622328] niks3-server[1003]: 2026/09/20 08:17:27 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4251lb # [ 57.627097] niks3-server[1003]: 2026/09/20 08:17:27 INFO Completed upload id=134252worker1 # [ 57.529829] nix-grpc-daemon[849]: time=2026-09-20T08:17:27.080Z level=INFO msg="Upload complete. (513ms)"4253lb # [ 57.629898] niks3-server[1003]: 2026/09/20 08:17:27 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4254worker1 # [ 57.541147] nix-grpc-daemon[775]: ts=2026-09-20T08:17:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=0 paths=1 nar_bytes_in=7524255worker1 # [ 57.554436] nix-grpc-daemon[775]: ts=2026-09-20T08:17:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417824256worker1 # [ 57.560953] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4257worker1 # [ 57.566244] nix-daemon[837]: reaped child process 1095, status = succeeded4258worker1 # [ 57.580888] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4259worker1 # [ 58.427919] nix-daemon[837]: reaped child process 1109, status = succeeded4260worker1 # [ 58.613551] nix-daemon[837]: accepted connection from pid 1124, user nix-grpc-daemon (trusted)4261worker1 # [ 58.634221] nix-daemon[837]: reaped child process 1127, status = succeeded4262lb # [ 58.745973] niks3-server[1003]: 2026/09/20 08:17:28 INFO Received uploads request method=POST path=/api/pending_closures4263worker1 # [ 58.660478] nix-grpc-daemon[849]: time=2026-09-20T08:17:28.209Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4264worker1 # [ 58.661966] nix-grpc-daemon[849]: time=2026-09-20T08:17:28.209Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4265lb # [ 58.789286] niks3-server[1003]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4266lb # [ 58.802845] niks3-server[1003]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4267lb # [ 58.813745] niks3-server[1003]: 2026/09/20 08:17:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4268worker1 # [ 58.721783] nix-grpc-daemon[849]: time=2026-09-20T08:17:28.272Z level=INFO msg="Uploading 1 narinfos"4269lb # [ 58.821396] niks3-server[1003]: 2026/09/20 08:17:28 INFO Signed narinfos id=14 count=14270lb # [ 58.827361] niks3-server[1003]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4271lb # [ 58.839510] niks3-server[1003]: 2026/09/20 08:17:28 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4272lb # [ 58.846136] niks3-server[1003]: 2026/09/20 08:17:28 INFO Completed upload id=144273worker1 # [ 58.748271] nix-grpc-daemon[849]: time=2026-09-20T08:17:28.299Z level=INFO msg="Upload complete. (356ms)"4274lb # [ 58.849513] niks3-server[1003]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4275worker1 # [ 58.761752] nix-grpc-daemon[775]: ts=2026-09-20T08:17:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=7 outputs=14276worker2 # [ 58.772652] nix-grpc-daemon[784]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:557204277worker1 # [ 58.783499] nix-daemon[837]: reaped child process 1107, status = succeeded4278worker2 # [ 58.788185] nix-grpc-daemon[784]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4279worker2 # [ 58.806614] nix-grpc-daemon[784]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4280worker1 # [ 58.848171] nix-grpc-daemon[775]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:417824281worker1 # [ 58.855046] nix-grpc-daemon[775]: ts=2026-09-20T08:17:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=0 paths=1 nar_bytes_out=2324282client # [ 58.982037] nix-daemon[928]: reaped child process 930, status = succeeded4283client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.45 seconds)4284client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4285client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4286client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4287client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4288client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4289client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4290(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.58 seconds)4291subtest: an input only one worker has still reaches the builder4292client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4293client # this derivation will be built:4294client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4295client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4296client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.46 seconds)4297client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4298client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds)4299worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4300worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.24 seconds)4301worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4302worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4303client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24304client # [ 60.318395] nix-daemon[928]: accepted connection from pid 1011, user root (trusted)4305client # this derivation will be built:4306client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4307worker1 # [ 60.503229] nix-grpc-daemon[775]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:417824308client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4309worker2 # [ 60.518151] nix-grpc-daemon[784]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557204310client # copying 1 paths...4311client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4312worker2 # [ 60.537350] nix-grpc-daemon[784]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:557204313worker2 # [ 60.554030] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4314worker2 # [ 60.779605] nix-daemon[840]: accepted connection from pid 947, user nix-grpc-daemon (trusted)4315worker2 # [ 60.801468] nix-daemon[840]: reaped child process 950, status = succeeded4316lb # [ 60.905110] niks3-server[1003]: 2026/09/20 08:17:30 INFO Received uploads request method=POST path=/api/pending_closures4317worker2 # [ 60.823224] nix-grpc-daemon[868]: time=2026-09-20T08:17:30.373Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4318worker2 # [ 60.825074] nix-grpc-daemon[868]: time=2026-09-20T08:17:30.373Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4319lb # [ 60.936424] niks3-server[1003]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4320lb # [ 60.955541] niks3-server[1003]: 2026/09/20 08:17:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4321worker2 # [ 60.870384] nix-grpc-daemon[868]: time=2026-09-20T08:17:30.420Z level=INFO msg="Uploading 1 narinfos"4322lb # [ 60.969194] niks3-server[1003]: 2026/09/20 08:17:30 INFO Signed narinfos id=15 count=14323lb # [ 60.976267] niks3-server[1003]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4324lb # [ 60.984516] niks3-server[1003]: 2026/09/20 08:17:30 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4325lb # [ 60.992524] niks3-server[1003]: 2026/09/20 08:17:30 INFO Completed upload id=154326worker2 # [ 60.898637] nix-grpc-daemon[868]: time=2026-09-20T08:17:30.449Z level=INFO msg="Upload complete. (324ms)"4327lb # [ 60.995943] niks3-server[1003]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4328worker2 # [ 60.908405] nix-grpc-daemon[784]: ts=2026-09-20T08:17:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=0 paths=1 nar_bytes_in=1204329worker2 # [ 60.928311] nix-daemon[840]: reaped child process 945, status = succeeded4330worker1 # [ 60.924168] nix-grpc-daemon[775]: ts=2026-09-20T08:17:30Z level=debug event=want client=8 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04331worker1 # [ 60.930939] nix-grpc-daemon[775]: ts=2026-09-20T08:17:30Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14332worker2 # [ 60.980932] nix-grpc-daemon[784]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557204333worker2 # [ 60.999053] nix-grpc-daemon[784]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557204334client # copying 2 paths to 'lb:50051'...4335client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4336worker2 # [ 61.021830] nix-grpc-daemon[784]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:557204337client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4338worker2 # [ 61.044682] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4339worker2 # [ 61.265053] nix-daemon[840]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4340worker2 # [ 61.287440] nix-daemon[840]: reaped child process 957, status = succeeded4341worker2 # [ 61.481194] nix-daemon[840]: accepted connection from pid 959, user nix-grpc-daemon (trusted)4342worker2 # [ 61.500381] nix-daemon[840]: reaped child process 962, status = succeeded4343lb # [ 61.603527] niks3-server[1003]: 2026/09/20 08:17:31 INFO Received uploads request method=POST path=/api/pending_closures4344lb # [ 61.614320] niks3-server[1003]: 2026/09/20 08:17:31 INFO Received uploads request method=POST path=/api/pending_closures4345worker2 # [ 61.532090] nix-grpc-daemon[868]: time=2026-09-20T08:17:31.082Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4346worker2 # [ 61.534031] nix-grpc-daemon[868]: time=2026-09-20T08:17:31.082Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4347worker2 # [ 61.535771] nix-grpc-daemon[868]: time=2026-09-20T08:17:31.082Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4348lb # [ 61.659008] niks3-server[1003]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4349lb # [ 61.670480] niks3-server[1003]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4350lb # [ 61.684375] niks3-server[1003]: 2026/09/20 08:17:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4351worker2 # [ 61.599372] nix-grpc-daemon[868]: time=2026-09-20T08:17:31.149Z level=INFO msg="Uploading 3 narinfos"4352lb # [ 61.694079] niks3-server[1003]: 2026/09/20 08:17:31 INFO Signed narinfos id=16 count=14353lb # [ 61.699329] niks3-server[1003]: 2026/09/20 08:17:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4354lb # [ 61.705166] niks3-server[1003]: 2026/09/20 08:17:31 INFO Signed narinfos id=17 count=24355lb # [ 61.707041] niks3-server[1003]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4356lb # [ 61.715234] niks3-server[1003]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4357lb # [ 61.725305] niks3-server[1003]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4358lb # [ 61.733164] niks3-server[1003]: 2026/09/20 08:17:31 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4359lb # [ 61.738406] niks3-server[1003]: 2026/09/20 08:17:31 INFO Completed upload id=164360lb # [ 61.739769] niks3-server[1003]: 2026/09/20 08:17:31 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4361lb # [ 61.745367] niks3-server[1003]: 2026/09/20 08:17:31 INFO Completed upload id=174362worker2 # [ 61.652397] nix-grpc-daemon[868]: time=2026-09-20T08:17:31.203Z level=INFO msg="Upload complete. (585ms)"4363lb # [ 61.748129] niks3-server[1003]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4364lb # [ 61.752034] niks3-server[1003]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4365worker2 # [ 61.665108] nix-grpc-daemon[784]: ts=2026-09-20T08:17:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=0 paths=2 nar_bytes_in=9844366worker2 # [ 61.680871] nix-grpc-daemon[784]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557204367worker2 # [ 61.695403] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4368worker2 # [ 61.701770] nix-daemon[840]: reaped child process 952, status = succeeded4369client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4370client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4371worker2 # [ 61.718781] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4372lb # [ 61.827771] envoy[911]: conn peer=[2001:db8:1::1]:54000 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3388 tx=1751 ms=21384373lb # [ 61.833459] envoy[911]: conn peer=[2001:db8:1::1]:54004 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=764374lb # [ 61.839688] envoy[911]: conn peer=[2001:db8:1::1]:54014 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3862 tx=1877 ms=20614375lb # [ 61.845302] envoy[911]: conn peer=[2001:db8:1::1]:54016 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=744376lb # [ 61.851669] envoy[911]: conn peer=[2001:db8:1::1]:54042 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=304377lb # [ 61.858511] envoy[911]: conn peer=[2001:db8:1::1]:54032 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4300 tx=2199 ms=19984378worker2 # [ 62.762606] nix-daemon[840]: reaped child process 966, status = succeeded4379worker2 # [ 62.949930] nix-daemon[840]: accepted connection from pid 981, user nix-grpc-daemon (trusted)4380worker2 # [ 62.968906] nix-daemon[840]: reaped child process 984, status = succeeded4381lb # [ 63.073001] niks3-server[1003]: 2026/09/20 08:17:32 INFO Received uploads request method=POST path=/api/pending_closures4382worker2 # [ 62.991095] nix-grpc-daemon[868]: time=2026-09-20T08:17:32.541Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4383lb # [ 63.108189] niks3-server[1003]: 2026/09/20 08:17:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4384worker2 # [ 63.026021] nix-grpc-daemon[868]: time=2026-09-20T08:17:32.577Z level=INFO msg="Uploading 1 narinfos"4385lb # [ 63.122314] niks3-server[1003]: 2026/09/20 08:17:32 INFO Signed narinfos id=18 count=14386lb # [ 63.130453] niks3-server[1003]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4387lb # [ 63.139478] niks3-server[1003]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4388lb # [ 63.148916] niks3-server[1003]: 2026/09/20 08:17:32 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4389worker2 # [ 63.056562] nix-grpc-daemon[868]: time=2026-09-20T08:17:32.607Z level=INFO msg="Upload complete. (319ms)"4390lb # [ 63.152986] niks3-server[1003]: 2026/09/20 08:17:32 INFO Completed upload id=184391lb # [ 63.156329] niks3-server[1003]: 2026/09/20 08:17:32 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4392client # copying 1 paths...4393worker1 # [ 63.075366] nix-grpc-daemon[775]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:417824394worker2 # [ 63.069343] nix-grpc-daemon[784]: ts=2026-09-20T08:17:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=8 outputs=14395worker2 # [ 63.089207] nix-daemon[840]: reaped child process 964, status = succeeded4396worker1 # [ 63.087240] nix-grpc-daemon[775]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4397client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4398worker2 # [ 63.145604] nix-grpc-daemon[784]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:557204399worker2 # [ 63.149813] nix-grpc-daemon[784]: ts=2026-09-20T08:17:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=0 paths=1 nar_bytes_out=1204400client # [ 63.298491] nix-daemon[928]: reaped child process 1014, status = succeeded4401client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.23 seconds)4402client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24403client # [ 63.531263] nix-daemon[928]: accepted connection from pid 1032, user root (trusted)4404client # this derivation will be built:4405client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4406worker1 # [ 63.705386] nix-grpc-daemon[775]: ts=2026-09-20T08:17:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:417824407client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4408worker1 # [ 63.713652] nix-grpc-daemon[775]: ts=2026-09-20T08:17:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417824409worker1 # [ 63.721526] nix-grpc-daemon[849]: time=2026-09-20T08:17:33.270Z level=INFO msg="All 1 paths already cached"4410worker1 # [ 63.733319] nix-grpc-daemon[775]: ts=2026-09-20T08:17:33Z level=debug event=want client=9 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04411worker1 # [ 63.741131] nix-grpc-daemon[775]: ts=2026-09-20T08:17:33Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14412worker1 # [ 63.750486] nix-grpc-daemon[775]: ts=2026-09-20T08:17:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417824413worker1 # [ 63.763378] nix-grpc-daemon[775]: ts=2026-09-20T08:17:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417824414client # copying 1 paths to 'lb:50051'...4415client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4416worker1 # [ 63.785994] nix-grpc-daemon[775]: ts=2026-09-20T08:17:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417824417worker1 # [ 63.802022] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4418worker1 # [ 63.823400] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5)4419worker1 # [ 63.869410] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 129 ms (attempt 2/5)4420worker1 # [ 63.998925] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 3/5)4421worker1 # [ 64.045188] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 711 ms (attempt 4/5)4422worker1 # [ 64.758352] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4423worker1 # [ 64.766601] nix-grpc-daemon[775]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4424worker1 # [ 65.003137] nix-daemon[837]: accepted connection from pid 1145, user nix-grpc-daemon (trusted)4425worker1 # [ 65.022387] nix-daemon[837]: reaped child process 1148, status = succeeded4426worker1 # [ 65.202066] nix-daemon[837]: accepted connection from pid 1150, user nix-grpc-daemon (trusted)4427worker1 # [ 65.220513] nix-daemon[837]: reaped child process 1153, status = succeeded4428lb # [ 65.329759] niks3-server[1003]: 2026/09/20 08:17:34 INFO Received uploads request method=POST path=/api/pending_closures4429worker1 # [ 65.242967] nix-grpc-daemon[849]: time=2026-09-20T08:17:34.793Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4430worker1 # [ 65.245475] nix-grpc-daemon[849]: time=2026-09-20T08:17:34.793Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4431lb # [ 65.359574] niks3-server[1003]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4432worker1 # [ 65.277443] nix-grpc-daemon[849]: time=2026-09-20T08:17:34.828Z level=INFO msg="Uploading 1 narinfos"4433lb # [ 65.374759] niks3-server[1003]: 2026/09/20 08:17:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4434lb # [ 65.386971] niks3-server[1003]: 2026/09/20 08:17:34 INFO Signed narinfos id=19 count=14435lb # [ 65.393956] niks3-server[1003]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4436lb # [ 65.402945] niks3-server[1003]: 2026/09/20 08:17:34 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4437lb # [ 65.409672] niks3-server[1003]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4438lb # [ 65.415046] niks3-server[1003]: 2026/09/20 08:17:34 INFO Completed upload id=194439worker1 # [ 65.317756] nix-grpc-daemon[849]: time=2026-09-20T08:17:34.868Z level=INFO msg="Upload complete. (515ms)"4440worker1 # [ 65.324277] nix-grpc-daemon[775]: ts=2026-09-20T08:17:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=1 paths=1 nar_bytes_in=5684441worker1 # [ 65.336229] nix-grpc-daemon[775]: ts=2026-09-20T08:17:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417824442worker1 # [ 65.350531] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4443worker1 # [ 65.355699] nix-daemon[837]: reaped child process 1139, status = succeeded4444client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4445worker1 # [ 65.368314] nix-daemon[837]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4446client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4447worker1 # [ 66.600158] nix-daemon[837]: reaped child process 1157, status = succeeded4448worker1 # [ 66.767181] nix-daemon[837]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)4449worker1 # [ 66.785789] nix-daemon[837]: reaped child process 1175, status = succeeded4450lb # [ 66.897369] niks3-server[1003]: 2026/09/20 08:17:36 INFO Received uploads request method=POST path=/api/pending_closures4451worker1 # [ 66.840457] nix-grpc-daemon[849]: time=2026-09-20T08:17:36.389Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4452lb # [ 66.961793] niks3-server[1003]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4453worker1 # [ 66.872940] nix-grpc-daemon[849]: time=2026-09-20T08:17:36.423Z level=INFO msg="Uploading 1 narinfos"4454lb # [ 66.973838] niks3-server[1003]: 2026/09/20 08:17:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4455lb # [ 66.984504] niks3-server[1003]: 2026/09/20 08:17:36 INFO Signed narinfos id=20 count=14456lb # [ 66.987504] niks3-server[1003]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4457lb # [ 67.000569] niks3-server[1003]: 2026/09/20 08:17:36 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4458lb # [ 67.007595] niks3-server[1003]: 2026/09/20 08:17:36 INFO Completed upload id=204459worker1 # [ 66.909591] nix-grpc-daemon[849]: time=2026-09-20T08:17:36.460Z level=INFO msg="Upload complete. (328ms)"4460lb # [ 67.011796] niks3-server[1003]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4461worker1 # [ 66.924887] nix-grpc-daemon[775]: ts=2026-09-20T08:17:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41782 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=9 outputs=14462worker1 # [ 66.941677] nix-daemon[837]: reaped child process 1155, status = succeeded4463client # copying 1 paths...4464worker1 # [ 66.971904] nix-grpc-daemon[775]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:417824465client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4466worker2 # [ 67.007678] nix-grpc-daemon[784]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:557204467worker2 # [ 67.022912] nix-grpc-daemon[784]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4468worker2 # [ 67.042200] nix-grpc-daemon[784]: ts=2026-09-20T08:17:36Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=0 paths=1 nar_bytes_out=1204469client # [ 67.197086] nix-daemon[928]: reaped child process 1035, status = succeeded4470client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.89 seconds)4471client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24472client # [ 67.414050] nix-daemon[928]: accepted connection from pid 1054, user root (trusted)4473client # this derivation will be built:4474client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4475worker2 # [ 67.593855] nix-grpc-daemon[784]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:557204476client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4477worker1 # [ 67.598053] nix-grpc-daemon[775]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417824478worker1 # [ 67.608185] nix-grpc-daemon[849]: time=2026-09-20T08:17:37.158Z level=INFO msg="All 1 paths already cached"4479worker1 # [ 67.626508] nix-grpc-daemon[775]: ts=2026-09-20T08:17:37Z level=debug event=want client=10 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04480worker2 # [ 67.635059] nix-grpc-daemon[784]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557204481worker1 # [ 67.633024] nix-grpc-daemon[775]: ts=2026-09-20T08:17:37Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14482worker2 # [ 67.651352] nix-grpc-daemon[784]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:557204483client # copying 1 paths to 'lb:50051'...4484worker2 # [ 67.676935] nix-grpc-daemon[868]: time=2026-09-20T08:17:37.226Z level=INFO msg="All 1 paths already cached"4485client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4486worker2 # [ 67.682275] nix-grpc-daemon[784]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:557204487worker2 # [ 67.698131] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4488worker2 # [ 67.897048] nix-daemon[840]: accepted connection from pid 989, user nix-grpc-daemon (trusted)4489worker2 # [ 67.917919] nix-daemon[840]: reaped child process 992, status = succeeded4490worker2 # [ 68.089141] nix-daemon[840]: accepted connection from pid 994, user nix-grpc-daemon (trusted)4491worker2 # [ 68.109981] nix-daemon[840]: reaped child process 997, status = succeeded4492lb # [ 68.213610] niks3-server[1003]: 2026/09/20 08:17:37 INFO Received uploads request method=POST path=/api/pending_closures4493worker2 # [ 68.132170] nix-grpc-daemon[868]: time=2026-09-20T08:17:37.683Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4494worker2 # [ 68.133677] nix-grpc-daemon[868]: time=2026-09-20T08:17:37.683Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4495lb # [ 68.245477] niks3-server[1003]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4496worker2 # [ 68.168070] nix-grpc-daemon[868]: time=2026-09-20T08:17:37.719Z level=INFO msg="Uploading 1 narinfos"4497lb # [ 68.263471] niks3-server[1003]: 2026/09/20 08:17:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4498lb # [ 68.274717] niks3-server[1003]: 2026/09/20 08:17:37 INFO Signed narinfos id=21 count=14499lb # [ 68.283482] niks3-server[1003]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4500worker2 # [ 68.196241] nix-grpc-daemon[868]: time=2026-09-20T08:17:37.747Z level=INFO msg="Upload complete. (480ms)"4501lb # [ 68.289148] niks3-server[1003]: 2026/09/20 08:17:37 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4502lb # [ 68.293551] niks3-server[1003]: 2026/09/20 08:17:37 INFO Completed upload id=214503lb # [ 68.296431] niks3-server[1003]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4504worker2 # [ 68.205297] nix-grpc-daemon[784]: ts=2026-09-20T08:17:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=0 paths=1 nar_bytes_in=5684505worker2 # [ 68.219240] nix-grpc-daemon[784]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:557204506worker2 # [ 68.225515] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4507worker2 # [ 68.230482] nix-daemon[840]: reaped child process 987, status = succeeded4508client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4509worker2 # [ 68.241360] nix-daemon[840]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4510client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4511worker2 # [ 69.089408] nix-daemon[840]: reaped child process 1001, status = succeeded4512worker2 # [ 69.274830] nix-daemon[840]: accepted connection from pid 1016, user nix-grpc-daemon (trusted)4513worker2 # [ 69.294622] nix-daemon[840]: reaped child process 1019, status = succeeded4514lb # [ 69.399996] niks3-server[1003]: 2026/09/20 08:17:38 INFO Received uploads request method=POST path=/api/pending_closures4515worker2 # [ 69.320488] nix-grpc-daemon[868]: time=2026-09-20T08:17:38.869Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4516lb # [ 69.436488] niks3-server[1003]: 2026/09/20 08:17:38 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4517worker2 # [ 69.351879] nix-grpc-daemon[868]: time=2026-09-20T08:17:38.902Z level=INFO msg="Uploading 1 narinfos"4518lb # [ 69.448656] niks3-server[1003]: 2026/09/20 08:17:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4519lb # [ 69.458475] niks3-server[1003]: 2026/09/20 08:17:38 INFO Signed narinfos id=22 count=14520lb # [ 69.466313] niks3-server[1003]: 2026/09/20 08:17:39 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4521lb # [ 69.542055] niks3-server[1003]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4522lb # [ 69.549951] niks3-server[1003]: 2026/09/20 08:17:39 INFO Completed upload id=224523worker2 # [ 69.456803] nix-grpc-daemon[868]: time=2026-09-20T08:17:39.008Z level=INFO msg="Upload complete. (402ms)"4524lb # [ 69.554959] niks3-server[1003]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4525worker2 # [ 69.469322] nix-grpc-daemon[784]: ts=2026-09-20T08:17:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=10 outputs=14526worker2 # [ 69.488305] nix-daemon[840]: reaped child process 999, status = succeeded4527client # copying 1 paths...4528worker2 # [ 69.514163] nix-grpc-daemon[784]: ts=2026-09-20T08:17:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:557204529client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4530worker2 # [ 69.543891] nix-grpc-daemon[784]: ts=2026-09-20T08:17:39Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:557204531worker2 # [ 69.549248] nix-grpc-daemon[784]: ts=2026-09-20T08:17:39Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55720 duration_s=0 paths=1 nar_bytes_out=1204532client # [ 69.697819] nix-daemon[928]: reaped child process 1057, status = succeeded4533client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.50 seconds)4534(finished: subtest: an input only one worker has still reaches the builder, in 10.58 seconds)4535subtest: upload whose reference the worker lacks is completed from the cache4536client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4537client # this derivation will be built:4538client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4539client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4540client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.48 seconds)4541client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4542client # this derivation will be built:4543client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4544client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4545client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.44 seconds)4546client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4547client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds)4548worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4549worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4550worker2 # [ 71.142872] systemd[1]: Stopping Nix worker-protocol over gRPC...4551lb # [ 71.827873] envoy[911]: conn peer=[2001:db8:1::1]:52750 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=684552lb # [ 71.828302] envoy[911]: conn peer=[2001:db8:1::1]:54058 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4206 tx=1882 ms=27034553lb # [ 71.828470] envoy[911]: conn peer=[2001:db8:1::1]:52758 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1825 ms=33904554lb # [ 71.828577] envoy[911]: conn peer=[2001:db8:1::1]:52762 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=994555lb # [ 71.828694] envoy[911]: conn peer=[2001:db8:1::1]:52770 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3724 tx=1779 ms=20114556lb # [ 71.828798] envoy[911]: conn peer=[2001:db8:1::1]:52774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=664557worker2 # [ 72.087904] nix-grpc-daemon[784]: ts=2026-09-20T08:17:41Z level=info event=signal_exit4558worker2 # [ 73.346448] nix-grpc-daemon[784]: ts=2026-09-20T08:17:42Z level=info event=scheduler_restarting4559worker1 # [ 73.352804] nix-grpc-daemon[775]: ts=2026-09-20T08:17:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:453644560worker1 # [ 73.353513] nix-grpc-daemon[775]: ts=2026-09-20T08:17:42Z level=info event=worker_gone addr=192.168.1.4:500514561worker2 # [ 73.380426] nix-grpc-daemon[784]: ts=2026-09-20T08:17:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4562worker2 # [ 73.408829] nix-daemon[840]: reaped child process 843, status = succeeded4563worker2 # [ 73.579290] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4564worker2 # [ 73.587005] systemd[1]: Stopped Nix worker-protocol over gRPC.4565worker2 # [ 73.593829] systemd[1]: nix-grpc-daemon.service: Consumed 1.939s CPU time over 51.834s wall clock time, 51M memory peak, 48.7K incoming IP traffic, 83.9K outgoing IP traffic.4566worker2 # [ 73.604675] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4567worker2 # [ 73.606747] systemd[1]: Closed Nix worker-protocol over gRPC.4568worker2 # [ 73.610188] systemd[1]: nix-grpc-daemon.socket: Consumed 783us CPU time over 1min 1.455s wall clock time, 256K memory peak, 71.7K incoming IP traffic, 65.3K outgoing IP traffic.4569lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4570lb: must succeed: curl -sf localhost:9901/clusters4571lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4572lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4573client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24574worker1 # [ 73.942821] nix-grpc-daemon[775]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417824575worker1 # [ 73.951069] nix-grpc-daemon[775]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:417824576client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4577client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds)4578worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4579worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4580worker2 # [ 74.103451] systemd[1]: Listening on Nix worker-protocol over gRPC.4581worker1 # [ 74.181701] systemd[1]: Stopping Nix worker-protocol over gRPC...4582worker2 # [ 74.216410] systemd[1]: Starting Nix worker-protocol over gRPC...4583worker2 # [ 74.432437] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4584worker2 # [ 74.435973] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14585worker2 # [ 74.443927] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4586worker2 # [ 74.454297] systemd[1]: Started Nix worker-protocol over gRPC.4587worker2 # [ 74.489859] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:44Z level=info event=scheduler_connected addr=lb:500514588worker1 # [ 74.488371] nix-grpc-daemon[775]: ts=2026-09-20T08:17:44Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04589worker1 # [ 75.089754] nix-grpc-daemon[775]: ts=2026-09-20T08:17:44Z level=info event=signal_exit4590worker1 # [ 75.366193] nix-grpc-daemon[775]: ts=2026-09-20T08:17:44Z level=info event=scheduler_yield4591worker2 # [ 75.378345] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:44Z level=info event=scheduler_restarting addr=lb:500514592lb # [ 75.471149] niks3-server[1003]: 2026/09/20 08:17:45 INFO lead: released remote=192.168.1.3:334304593worker1 # [ 75.375050] nix-grpc-daemon[775]: ts=2026-09-20T08:17:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:453644594worker1 # [ 75.381281] nix-grpc-daemon[775]: ts=2026-09-20T08:17:44Z level=info event=worker_gone addr=192.168.1.4:500514595worker1 # [ 75.387433] nix-grpc-daemon[775]: ts=2026-09-20T08:17:44Z level=info event=scheduler_restarting addr=lb:500514596worker1 # [ 75.391662] nix-grpc-daemon[775]: ts=2026-09-20T08:17:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:453644597worker1 # [ 75.396234] nix-grpc-daemon[775]: ts=2026-09-20T08:17:44Z level=info event=worker_gone addr=192.168.1.3:500514598worker2 # [ 75.580943] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500514599worker1 # [ 75.583761] nix-grpc-daemon[775]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500514600worker2 # [ 75.591602] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4601worker1 # [ 75.603355] nix-grpc-daemon[775]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4602worker2 # [ 75.792674] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500514603worker2 # [ 75.799891] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4604worker1 # [ 75.804722] nix-grpc-daemon[775]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500514605worker1 # [ 75.811515] nix-grpc-daemon[775]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4606worker2 # [ 76.001085] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500514607worker2 # [ 76.007844] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4608worker1 # [ 76.012794] nix-grpc-daemon[775]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500514609worker1 # [ 76.019951] nix-grpc-daemon[775]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4610worker2 # [ 76.209111] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500514611worker2 # [ 76.215804] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4612worker1 # [ 76.221105] nix-grpc-daemon[775]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500514613worker1 # [ 76.227787] nix-grpc-daemon[775]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4614worker1 # [ 76.371580] nix-grpc-daemon[775]: ts=2026-09-20T08:17:45Z level=info event=scheduler_restarting4615worker1 # [ 76.406845] nix-daemon[837]: reaped child process 839, status = succeeded4616worker2 # [ 76.416929] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500514617worker2 # [ 76.423700] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4618worker1 # [ 76.455304] nix-grpc-daemon[775]: ts=2026-09-20T08:17:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4619worker2 # [ 76.625943] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:46Z level=info event=scheduler_connected addr=lb:500514620worker1 # [ 76.622964] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4621worker1 # [ 76.627510] nix-grpc-daemon[775]: E0000 00:00:1789892266.172355 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true4622worker1 # [ 77.273279] nix-grpc-daemon[775]: E0000 00:00:1789892266.823840 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4623worker1 # [ 77.273678] nix-grpc-daemon[775]: E0000 00:00:1789892266.824050 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4624worker2 # [ 77.472432] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:47Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4625worker1 # [ 77.486928] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4626worker1 # [ 77.495903] systemd[1]: Stopped Nix worker-protocol over gRPC.4627worker1 # [ 77.503648] systemd[1]: nix-grpc-daemon.service: Consumed 3.364s CPU time over 55.767s wall clock time, 62.5M memory peak, 80.5K incoming IP traffic, 154.7K outgoing IP traffic.4628worker1 # [ 77.519611] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4629worker1 # [ 77.522762] systemd[1]: Closed Nix worker-protocol over gRPC.4630worker1 # [ 77.527589] systemd[1]: nix-grpc-daemon.socket: Consumed 695us CPU time over 1min 5.041s wall clock time, 256K memory peak, 106.3K incoming IP traffic, 86.1K outgoing IP traffic.4631lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4632lb: must succeed: curl -sf localhost:9901/clusters4633lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4634lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4635client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24636worker2 # [ 77.675997] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:47Z level=info event=scheduler_connected addr=lb:500514637worker2 # [ 77.681271] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4638worker2 # [ 77.869593] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:588904639worker2 # [ 77.884869] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:47Z level=info event=scheduler_connected addr=lb:500514640worker2 # [ 77.901329] nix-daemon[840]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4641worker2 # [ 77.908449] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:47Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4642worker2 # [ 77.926678] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5)4643worker2 # [ 77.968307] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 2/5)4644worker2 # [ 78.091174] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:47Z level=info event=scheduler_connected addr=lb:500514645worker2 # [ 78.098162] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4646worker2 # [ 78.152923] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 3/5)4647worker2 # [ 78.216660] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 278 ms (attempt 4/5)4648worker2 # [ 78.299314] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:47Z level=info event=scheduler_connected addr=lb:500514649worker2 # [ 78.305666] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:47Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4650worker2 # [ 78.502702] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4651worker2 # [ 78.515692] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=scheduler_connected addr=lb:500514652worker2 # [ 78.520788] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4653client # copying 2 paths...4654client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4655worker2 # [ 78.538590] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:588904656client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4657worker2 # [ 78.556573] nix-daemon[840]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4658worker2 # [ 78.717940] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=scheduler_connected addr=lb:500514659worker2 # [ 78.723226] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4660worker2 # [ 78.798621] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=niks3_push_started pid=10964661worker2 # [ 78.923799] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=scheduler_connected addr=lb:500514662worker2 # [ 78.927367] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4663worker2 # [ 79.128238] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=scheduler_connected addr=lb:500514664worker2 # [ 79.131201] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4665worker2 # [ 79.218586] nix-daemon[840]: accepted connection from pid 1109, user nix-grpc-daemon (trusted)4666worker2 # [ 79.237985] nix-daemon[840]: reaped child process 1112, status = succeeded4667lb # [ 79.343385] niks3-server[1003]: 2026/09/20 08:17:48 INFO Received uploads request method=POST path=/api/pending_closures4668lb # [ 79.369809] niks3-server[1003]: 2026/09/20 08:17:48 INFO Received uploads request method=POST path=/api/pending_closures4669worker2 # [ 79.288535] nix-grpc-daemon[1096]: time=2026-09-20T08:17:48.838Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4670worker2 # [ 79.290272] nix-grpc-daemon[1096]: time=2026-09-20T08:17:48.838Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4671worker2 # [ 79.295386] nix-grpc-daemon[1096]: time=2026-09-20T08:17:48.839Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4672worker2 # [ 79.332082] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=scheduler_connected addr=lb:500514673worker2 # [ 79.343787] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4674lb # [ 79.426929] niks3-server[1003]: 2026/09/20 08:17:48 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4675lb # [ 79.442689] niks3-server[1003]: 2026/09/20 08:17:48 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4676lb # [ 79.459305] niks3-server[1003]: 2026/09/20 08:17:49 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4677lb # [ 79.468546] niks3-server[1003]: 2026/09/20 08:17:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4678lb # [ 79.475780] niks3-server[1003]: 2026/09/20 08:17:49 INFO Signed narinfos id=23 count=14679worker2 # [ 79.383927] nix-grpc-daemon[1096]: time=2026-09-20T08:17:48.935Z level=INFO msg="Uploading 3 narinfos"4680lb # [ 79.478950] niks3-server[1003]: 2026/09/20 08:17:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4681lb # [ 79.482578] niks3-server[1003]: 2026/09/20 08:17:49 INFO Signed narinfos id=24 count=24682lb # [ 79.487704] niks3-server[1003]: 2026/09/20 08:17:49 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4683lb # [ 79.512471] niks3-server[1003]: 2026/09/20 08:17:49 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4684lb # [ 79.521212] niks3-server[1003]: 2026/09/20 08:17:49 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4685lb # [ 79.526003] niks3-server[1003]: 2026/09/20 08:17:49 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4686lb # [ 79.529305] niks3-server[1003]: 2026/09/20 08:17:49 INFO Completed upload id=234687worker2 # [ 79.436985] nix-grpc-daemon[1096]: time=2026-09-20T08:17:48.988Z level=INFO msg="Upload complete. (398ms)"4688lb # [ 79.530937] niks3-server[1003]: 2026/09/20 08:17:49 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4689lb # [ 79.533574] niks3-server[1003]: 2026/09/20 08:17:49 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4690lb # [ 79.537451] niks3-server[1003]: 2026/09/20 08:17:49 INFO Completed upload id=244691lb # [ 79.552747] niks3-server[1003]: 2026/09/20 08:17:49 INFO lead: acquired remote=192.168.1.4:481604692worker2 # [ 79.448478] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58890 duration_s=0 paths=2 nar_bytes_in=3124693worker2 # [ 79.466333] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:49Z level=info event=scheduler_take_over4694worker2 # [ 79.472300] nix-daemon[840]: reaped child process 1094, status = succeeded4695client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.87 seconds)4696worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4697worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4698worker2 # [ 79.545249] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:49Z level=info event=scheduler_connected addr=lb:500514699worker2 # [ 79.551772] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:49Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04700worker1 # [ 79.611618] systemd[1]: Listening on Nix worker-protocol over gRPC.4701worker1 # [ 79.623045] systemd[1]: Starting Nix worker-protocol over gRPC...4702worker1 # [ 79.830965] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4703worker1 # [ 79.833631] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14704worker1 # [ 79.841272] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4705worker1 # [ 79.843045] systemd[1]: Started Nix worker-protocol over gRPC.4706lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4707lb: must succeed: curl -sf localhost:9901/clusters4708worker1 # [ 79.887998] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:49Z level=info event=scheduler_connected addr=lb:500514709worker2 # [ 79.896742] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04710lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4711lb: must succeed: curl -sf localhost:9901/clusters4712lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4713lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.20 seconds)4714(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.37 seconds)4715subtest: scheduler down: the other node takes the lock and keeps it4716lb: must succeed: curl -sf localhost:9901/clusters4717lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4718lb: must succeed: curl -sf localhost:9901/clusters4719lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4720lb: must succeed: curl -sf localhost:9901/clusters4721lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4722lb: must succeed: curl -sf localhost:9901/clusters4723lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4724worker2 # [ 81.341594] systemd[1]: Stopping Nix worker-protocol over gRPC...4725worker2 # [ 81.457987] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=signal_exit4726worker2 # [ 81.664620] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=scheduler_yield4727lb # [ 81.765359] niks3-server[1003]: 2026/09/20 08:17:51 INFO lead: released remote=192.168.1.4:481604728worker1 # [ 81.670986] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:51Z level=info event=scheduler_restarting addr=lb:500514729worker2 # [ 81.679160] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:588884730worker2 # [ 81.686839] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=worker_gone addr=192.168.1.3:500514731worker2 # [ 81.691137] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=scheduler_restarting addr=lb:500514732worker2 # [ 81.695233] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:588884733worker2 # [ 81.699733] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=worker_gone addr=192.168.1.4:500514734lb # [ 81.826186] envoy[911]: conn peer=[2001:db8:1::4]:33116 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5878 tx=1686 ms=512484735lb # [ 81.831516] envoy[911]: conn peer=[2001:db8:1::1]:39696 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=523 ms=284736lb # [ 81.836402] envoy[911]: conn peer=[2001:db8:1::3]:37288 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7122 tx=2116 ms=543134737lb # [ 81.841527] envoy[911]: conn peer=[2001:db8:1::1]:39708 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1007 tx=305 ms=15944738worker1 # [ 81.871016] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500514739worker2 # [ 81.886743] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500514740worker1 # [ 81.881616] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4741worker2 # [ 81.906841] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4742worker1 # [ 82.082789] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500514743worker1 # [ 82.090019] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4744worker2 # [ 82.107981] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500514745worker2 # [ 82.116260] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4746worker1 # [ 82.291189] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500514747worker1 # [ 82.298650] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4748worker2 # [ 82.317496] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500514749worker2 # [ 82.324575] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4750worker1 # [ 82.499664] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:52Z level=info event=scheduler_connected addr=lb:500514751worker1 # [ 82.506259] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4752worker2 # [ 82.528797] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:52Z level=info event=scheduler_connected addr=lb:500514753worker2 # [ 82.533131] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4754worker2 # [ 82.669987] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:52Z level=info event=scheduler_restarting4755worker2 # [ 82.702390] nix-daemon[840]: reaped child process 1089, status = succeeded4756worker1 # [ 82.709080] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:52Z level=info event=scheduler_connected addr=lb:500514757worker1 # [ 82.715613] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4758worker2 # [ 82.749875] nix-grpc-daemon[1040]: ts=2026-09-20T08:17:52Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4759worker1 # [ 82.916791] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:52Z level=info event=scheduler_connected addr=lb:500514760worker2 # [ 82.924684] nix-grpc-daemon[1040]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4761worker2 # [ 82.929432] nix-grpc-daemon[1040]: E0000 00:00:1789892272.475658 1083 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true4762worker2 # [ 83.466822] nix-grpc-daemon[1040]: E0000 00:00:1789892273.017992 1083 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4763worker2 # [ 83.479944] nix-grpc-daemon[1040]: E0000 00:00:1789892273.031163 1083 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4764worker1 # [ 84.462599] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:54Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4765worker2 # [ 84.490047] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4766worker2 # [ 84.493889] systemd[1]: Stopped Nix worker-protocol over gRPC.4767worker2 # [ 84.499390] systemd[1]: nix-grpc-daemon.service: Consumed 563ms CPU time over 10.270s wall clock time, 33.3M memory peak, 21K incoming IP traffic, 28.2K outgoing IP traffic.4768worker2 # [ 84.514957] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4769worker2 # [ 84.518281] systemd[1]: Closed Nix worker-protocol over gRPC.4770worker2 # [ 84.522484] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 10.420s wall clock time, 256K memory peak, 30.6K incoming IP traffic, 24.7K outgoing IP traffic.4771worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4772worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds)4773worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4774worker1 # [ 84.662305] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:54Z level=info event=scheduler_connected addr=lb:500514775worker1 # [ 84.667210] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4776worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4777worker1 # [ 84.853528] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:54Z level=info event=scheduler_take_over4778lb # [ 84.951556] niks3-server[1003]: 2026/09/20 08:17:54 INFO lead: acquired remote=192.168.1.3:556844779worker1 # [ 84.868660] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:54Z level=info event=scheduler_connected addr=lb:500514780worker1 # [ 84.874964] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:54Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4781worker1 # [ 85.075614] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:54Z level=info event=scheduler_connected addr=lb:500514782worker1 # [ 85.081505] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:54Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04783worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4784worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4785client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&24786worker1 # [ 86.014933] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:544444787worker1 # [ 86.026314] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4788client # don't know how to build these paths:4789client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4790worker1 # [ 86.061291] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:55Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04791worker1 # [ 86.068574] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:55Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14792worker1 # [ 86.107450] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544444793worker1 # [ 86.125482] nix-grpc-daemon[1200]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 1/5)4794worker1 # [ 86.221218] nix-grpc-daemon[1200]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 2/5)4795worker1 # [ 86.270993] nix-grpc-daemon[1200]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 3/5)4796worker1 # [ 86.330686] nix-grpc-daemon[1200]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 259 ms (attempt 4/5)4797worker1 # [ 86.590771] nix-grpc-daemon[1200]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4798worker1 # [ 86.613185] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:544444799client # copying 1 paths to 'lb:50051'...4800client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4801worker1 # [ 86.630920] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:544444802worker1 # [ 86.646243] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4803worker1 # [ 86.675977] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:56Z level=info event=niks3_push_started pid=12744804worker1 # [ 87.066479] nix-daemon[837]: accepted connection from pid 1287, user nix-grpc-daemon (trusted)4805worker1 # [ 87.086487] nix-daemon[837]: reaped child process 1290, status = succeeded4806worker1 # [ 87.266626] nix-daemon[837]: accepted connection from pid 1292, user nix-grpc-daemon (trusted)4807worker1 # [ 87.286307] nix-daemon[837]: reaped child process 1295, status = succeeded4808lb # [ 87.397222] niks3-server[1003]: 2026/09/20 08:17:56 INFO Received uploads request method=POST path=/api/pending_closures4809worker1 # [ 87.309926] nix-grpc-daemon[1274]: time=2026-09-20T08:17:56.860Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4810worker1 # [ 87.313296] nix-grpc-daemon[1274]: time=2026-09-20T08:17:56.862Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4811lb # [ 87.442167] niks3-server[1003]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4812worker1 # [ 87.358543] nix-grpc-daemon[1274]: time=2026-09-20T08:17:56.908Z level=INFO msg="Uploading 1 narinfos"4813lb # [ 87.455638] niks3-server[1003]: 2026/09/20 08:17:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4814lb # [ 87.468878] niks3-server[1003]: 2026/09/20 08:17:57 INFO Signed narinfos id=25 count=14815lb # [ 87.475598] niks3-server[1003]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4816worker1 # [ 87.389334] nix-grpc-daemon[1274]: time=2026-09-20T08:17:56.940Z level=INFO msg="Upload complete. (494ms)"4817lb # [ 87.488405] niks3-server[1003]: 2026/09/20 08:17:57 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4818worker1 # [ 87.396778] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54444 duration_s=0 paths=1 nar_bytes_in=5204819lb # [ 87.498654] niks3-server[1003]: 2026/09/20 08:17:57 INFO Completed upload id=254820worker1 # [ 87.412560] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544444821worker1 # [ 87.415927] nix-grpc-daemon[1274]: time=2026-09-20T08:17:56.963Z level=WARN msg="Failed to register uploaded object" key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo error="server returned 404: object is not pending upload\n"4822worker1 # [ 87.425827] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4823worker1 # [ 87.428326] nix-daemon[837]: reaped child process 1272, status = succeeded4824client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4825client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4826worker1 # [ 87.441498] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4827client # farm-a> LOG-farm-a-on-standby4828worker1 # [ 88.689772] nix-daemon[837]: reaped child process 1299, status = succeeded4829worker1 # [ 88.872296] nix-daemon[837]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)4830worker1 # [ 88.893356] nix-daemon[837]: reaped child process 1317, status = succeeded4831lb # [ 89.004319] niks3-server[1003]: 2026/09/20 08:17:58 INFO Received uploads request method=POST path=/api/pending_closures4832worker1 # [ 88.920546] nix-grpc-daemon[1274]: time=2026-09-20T08:17:58.469Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4833worker1 # [ 88.922217] nix-grpc-daemon[1274]: time=2026-09-20T08:17:58.469Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4834lb # [ 89.057094] niks3-server[1003]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4835lb # [ 89.069613] niks3-server[1003]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4836lb # [ 89.082398] niks3-server[1003]: 2026/09/20 08:17:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4837worker1 # [ 88.994029] nix-grpc-daemon[1274]: time=2026-09-20T08:17:58.542Z level=INFO msg="Uploading 1 narinfos"4838lb # [ 89.094691] niks3-server[1003]: 2026/09/20 08:17:58 INFO Signed narinfos id=26 count=14839lb # [ 89.100392] niks3-server[1003]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4840lb # [ 89.109241] niks3-server[1003]: 2026/09/20 08:17:58 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4841lb # [ 89.115998] niks3-server[1003]: 2026/09/20 08:17:58 INFO Completed upload id=264842worker1 # [ 89.018900] nix-grpc-daemon[1274]: time=2026-09-20T08:17:58.569Z level=INFO msg="Upload complete. (366ms)"4843lb # [ 89.119372] niks3-server[1003]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4844worker1 # [ 89.045391] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54444 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14845worker1 # [ 89.060718] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:58Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04846worker1 # [ 89.064514] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:58Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14847worker1 # [ 89.068535] nix-daemon[837]: reaped child process 1297, status = succeeded4848worker1 # [ 89.083410] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544444849worker1 # [ 89.098782] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:544444850worker1 # [ 89.114912] nix-grpc-daemon[1274]: time=2026-09-20T08:17:58.665Z level=INFO msg="All 1 paths already cached"4851client # copying 1 paths to 'lb:50051'...4852client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4853worker1 # [ 89.124125] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:544444854worker1 # [ 89.138603] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4855worker1 # [ 89.338131] nix-daemon[837]: accepted connection from pid 1323, user nix-grpc-daemon (trusted)4856worker1 # [ 89.359013] nix-daemon[837]: reaped child process 1326, status = succeeded4857worker1 # [ 89.542301] nix-daemon[837]: accepted connection from pid 1328, user nix-grpc-daemon (trusted)4858worker1 # [ 89.561061] nix-daemon[837]: reaped child process 1331, status = succeeded4859lb # [ 89.669804] niks3-server[1003]: 2026/09/20 08:17:59 INFO Received uploads request method=POST path=/api/pending_closures4860worker1 # [ 89.583963] nix-grpc-daemon[1274]: time=2026-09-20T08:17:59.134Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4861worker1 # [ 89.585544] nix-grpc-daemon[1274]: time=2026-09-20T08:17:59.134Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4862lb # [ 89.699834] niks3-server[1003]: 2026/09/20 08:17:59 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4863worker1 # [ 89.617559] nix-grpc-daemon[1274]: time=2026-09-20T08:17:59.168Z level=INFO msg="Uploading 1 narinfos"4864lb # [ 89.719495] niks3-server[1003]: 2026/09/20 08:17:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4865lb # [ 89.729950] niks3-server[1003]: 2026/09/20 08:17:59 INFO Signed narinfos id=27 count=14866lb # [ 89.738403] niks3-server[1003]: 2026/09/20 08:17:59 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4867lb # [ 89.742098] niks3-server[1003]: 2026/09/20 08:17:59 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4868worker1 # [ 89.648467] nix-grpc-daemon[1274]: time=2026-09-20T08:17:59.199Z level=INFO msg="Upload complete. (492ms)"4869lb # [ 89.746336] niks3-server[1003]: 2026/09/20 08:17:59 INFO Completed upload id=274870lb # [ 89.750583] niks3-server[1003]: 2026/09/20 08:17:59 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4871worker1 # [ 89.656140] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54444 duration_s=0 paths=1 nar_bytes_in=6404872worker1 # [ 89.668233] nix-grpc-daemon[1200]: ts=2026-09-20T08:17:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544444873worker1 # [ 89.675479] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4874worker1 # [ 89.681160] nix-daemon[837]: reaped child process 1321, status = succeeded4875client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4876client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4877worker1 # [ 89.692682] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4878client # farm-b> LOG-farm-b-on-standby4879worker1 # [ 91.334999] nix-daemon[837]: reaped child process 1335, status = succeeded4880worker1 # [ 91.515147] nix-daemon[837]: accepted connection from pid 1350, user nix-grpc-daemon (trusted)4881worker1 # [ 91.535859] nix-daemon[837]: reaped child process 1353, status = succeeded4882lb # [ 91.647098] niks3-server[1003]: 2026/09/20 08:18:01 INFO Received uploads request method=POST path=/api/pending_closures4883worker1 # [ 91.560461] nix-grpc-daemon[1274]: time=2026-09-20T08:18:01.110Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4884worker1 # [ 91.562358] nix-grpc-daemon[1274]: time=2026-09-20T08:18:01.110Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4885lb # [ 91.698121] niks3-server[1003]: 2026/09/20 08:18:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4886worker1 # [ 91.608654] nix-grpc-daemon[1274]: time=2026-09-20T08:18:01.158Z level=INFO msg="Uploading 1 narinfos"4887lb # [ 91.711578] niks3-server[1003]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4888lb # [ 91.723337] niks3-server[1003]: 2026/09/20 08:18:01 INFO Signed narinfos id=28 count=14889lb # [ 91.733659] niks3-server[1003]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4890lb # [ 91.738988] niks3-server[1003]: 2026/09/20 08:18:01 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4891lb # [ 91.742915] niks3-server[1003]: 2026/09/20 08:18:01 INFO Completed upload id=284892worker1 # [ 91.645331] nix-grpc-daemon[1274]: time=2026-09-20T08:18:01.196Z level=INFO msg="Upload complete. (342ms)"4893lb # [ 91.745596] niks3-server[1003]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4894lb # [ 91.752657] niks3-server[1003]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4895worker1 # [ 91.663397] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54444 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14896worker1 # [ 91.679968] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:01Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04897worker1 # [ 91.684429] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:01Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=14898worker1 # [ 91.689053] nix-daemon[837]: reaped child process 1333, status = succeeded4899worker1 # [ 91.706908] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544444900worker1 # [ 91.722205] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:544444901lb # [ 91.828993] envoy[911]: conn peer=[2001:db8:1::4]:45576 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3139 tx=1016 ms=82494902worker1 # [ 91.743888] nix-grpc-daemon[1274]: time=2026-09-20T08:18:01.294Z level=INFO msg="All 2 paths already cached"4903client # copying 1 paths to 'lb:50051'...4904client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4905worker1 # [ 91.755149] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:544444906worker1 # [ 91.769810] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4907worker1 # [ 91.980190] nix-daemon[837]: accepted connection from pid 1359, user nix-grpc-daemon (trusted)4908worker1 # [ 92.003009] nix-daemon[837]: reaped child process 1362, status = succeeded4909worker1 # [ 92.180843] nix-daemon[837]: accepted connection from pid 1364, user nix-grpc-daemon (trusted)4910worker1 # [ 92.201424] nix-daemon[837]: reaped child process 1367, status = succeeded4911lb # [ 92.313884] niks3-server[1003]: 2026/09/20 08:18:01 INFO Received uploads request method=POST path=/api/pending_closures4912worker1 # [ 92.228747] nix-grpc-daemon[1274]: time=2026-09-20T08:18:01.779Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4913worker1 # [ 92.230964] nix-grpc-daemon[1274]: time=2026-09-20T08:18:01.781Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4914lb # [ 92.349861] niks3-server[1003]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst4915worker1 # [ 92.266459] nix-grpc-daemon[1274]: time=2026-09-20T08:18:01.816Z level=INFO msg="Uploading 1 narinfos"4916lb # [ 92.366595] niks3-server[1003]: 2026/09/20 08:18:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4917lb # [ 92.376608] niks3-server[1003]: 2026/09/20 08:18:01 INFO Signed narinfos id=29 count=14918lb # [ 92.379147] niks3-server[1003]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls4919lb # [ 92.386967] niks3-server[1003]: 2026/09/20 08:18:01 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4920worker1 # [ 92.296663] nix-grpc-daemon[1274]: time=2026-09-20T08:18:01.847Z level=INFO msg="Upload complete. (510ms)"4921lb # [ 92.394787] niks3-server[1003]: 2026/09/20 08:18:01 INFO Completed upload id=294922lb # [ 92.397492] niks3-server[1003]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo4923worker1 # [ 92.304169] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54444 duration_s=0 paths=1 nar_bytes_in=7684924worker1 # [ 92.319936] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544444925worker1 # [ 92.326867] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4926worker1 # [ 92.332152] nix-daemon[837]: reaped child process 1357, status = succeeded4927client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...4928client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4929worker1 # [ 92.348898] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4930client # farm-top> LOG-farm-top-on-standby4931worker1 # [ 93.171734] nix-daemon[837]: reaped child process 1371, status = succeeded4932worker1 # [ 93.340105] nix-daemon[837]: accepted connection from pid 1386, user nix-grpc-daemon (trusted)4933worker1 # [ 93.362093] nix-daemon[837]: reaped child process 1389, status = succeeded4934lb # [ 93.471232] niks3-server[1003]: 2026/09/20 08:18:03 INFO Received uploads request method=POST path=/api/pending_closures4935worker1 # [ 93.385555] nix-grpc-daemon[1274]: time=2026-09-20T08:18:02.934Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4936worker1 # [ 93.387105] nix-grpc-daemon[1274]: time=2026-09-20T08:18:02.934Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"4937lb # [ 93.510529] niks3-server[1003]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4938lb # [ 93.522496] niks3-server[1003]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst4939lb # [ 93.535227] niks3-server[1003]: 2026/09/20 08:18:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4940worker1 # [ 93.443572] nix-grpc-daemon[1274]: time=2026-09-20T08:18:02.993Z level=INFO msg="Uploading 1 narinfos"4941lb # [ 93.544083] niks3-server[1003]: 2026/09/20 08:18:03 INFO Signed narinfos id=30 count=14942lb # [ 93.546439] niks3-server[1003]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls4943lb # [ 93.557963] niks3-server[1003]: 2026/09/20 08:18:03 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4944lb # [ 93.565069] niks3-server[1003]: 2026/09/20 08:18:03 INFO Completed upload id=304945worker1 # [ 93.467971] nix-grpc-daemon[1274]: time=2026-09-20T08:18:03.018Z level=INFO msg="Upload complete. (309ms)"4946lb # [ 93.568095] niks3-server[1003]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo4947worker1 # [ 93.481230] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54444 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=14948worker1 # [ 93.497630] nix-daemon[837]: reaped child process 1369, status = succeeded4949client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&2, in 7.77 seconds)4950client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath4951client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath, in 0.24 seconds)4952worker2 # [ 93.873087] systemd[1]: Listening on Nix worker-protocol over gRPC.4953worker2 # [ 93.881604] systemd[1]: Starting Nix worker-protocol over gRPC...4954worker2 # [ 94.082483] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4955worker2 # [ 94.085130] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14956worker2 # [ 94.092930] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4957worker2 # [ 94.094747] systemd[1]: Started Nix worker-protocol over gRPC.4958lb: must succeed: curl -sf localhost:9901/clusters4959worker2 # [ 94.139141] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:03Z level=info event=scheduler_connected addr=lb:500514960worker1 # [ 94.137425] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04961lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4962worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4963worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4964lb: must succeed: curl -sf localhost:9901/clusters4965lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4966lb: must succeed: curl -sf localhost:9901/clusters4967lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4968worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4969worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)4970(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.48 seconds)4971subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise4972client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs4973client # [ 94.633593] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.4974client # Running as unit: rs.service; invocation ID: 87a074f1fa8a4dcdbec55955de0c51a94975client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)4976client # [ 94.871783] nix[1157]: don't know how to build these paths:4977client # [ 94.873820] nix[1157]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv4978worker1 # [ 94.843239] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:544444979worker1 # [ 94.856275] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:04Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=04980worker1 # [ 94.862539] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:04Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=14981worker1 # [ 94.906998] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544444982worker1 # [ 94.923552] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:544444983client # [ 94.966229] nix[1157]: copying 1 paths to 'lb:50051'...4984client # [ 94.967662] nix[1157]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...4985worker1 # [ 94.938556] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:544444986worker1 # [ 94.954032] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4987worker1 # [ 95.162704] nix-daemon[837]: accepted connection from pid 1404, user nix-grpc-daemon (trusted)4988worker1 # [ 95.183067] nix-daemon[837]: reaped child process 1407, status = succeeded4989worker1 # [ 95.363744] nix-daemon[837]: accepted connection from pid 1409, user nix-grpc-daemon (trusted)4990worker1 # [ 95.381960] nix-daemon[837]: reaped child process 1412, status = succeeded4991lb # [ 95.493227] niks3-server[1003]: 2026/09/20 08:18:05 INFO Received uploads request method=POST path=/api/pending_closures4992worker1 # [ 95.406306] nix-grpc-daemon[1274]: time=2026-09-20T08:18:04.956Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4993worker1 # [ 95.407814] nix-grpc-daemon[1274]: time=2026-09-20T08:18:04.956Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"4994lb # [ 95.522590] niks3-server[1003]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst4995lb # [ 95.539567] niks3-server[1003]: 2026/09/20 08:18:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4996worker1 # [ 95.447929] nix-grpc-daemon[1274]: time=2026-09-20T08:18:04.998Z level=INFO msg="Uploading 1 narinfos"4997lb # [ 95.552679] niks3-server[1003]: 2026/09/20 08:18:05 INFO Signed narinfos id=31 count=14998lb # [ 95.559787] niks3-server[1003]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls4999lb # [ 95.566081] niks3-server[1003]: 2026/09/20 08:18:05 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5000lb # [ 95.577384] niks3-server[1003]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5001lb # [ 95.581175] niks3-server[1003]: 2026/09/20 08:18:05 INFO Completed upload id=315002worker1 # [ 95.484105] nix-grpc-daemon[1274]: time=2026-09-20T08:18:05.034Z level=INFO msg="Upload complete. (512ms)"5003worker1 # [ 95.493412] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54444 duration_s=0 paths=1 nar_bytes_in=4165004worker1 # [ 95.508367] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544445005worker1 # [ 95.515588] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)5006worker1 # [ 95.521231] nix-daemon[837]: reaped child process 1402, status = succeeded5007client # [ 95.559910] nix[1157]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5008worker1 # [ 95.535857] nix-daemon[837]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)5009lb: must succeed: curl -sf localhost:9901/clusters5010lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5011lb: must succeed: curl -sf localhost:9901/clusters5012lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5013lb: must succeed: curl -sf localhost:9901/clusters5014lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5015lb: must succeed: curl -sf localhost:9901/clusters5016lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5017worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5018worker2 # [ 97.634211] systemd-journald[267]: Received client request to rotate journal, rotating.5019worker2 # [ 97.658151] systemd-journald[267]: Vacuuming done, freed 0B of archived journals from /var/log/journal/7396f16e1c7c4c09be01268571ad1143.5020worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5021worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5022worker1 # [ 97.714670] systemd[1]: Stopping Nix worker-protocol over gRPC...5023worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5024client: must succeed: sleep 5.05025worker1 # [ 97.857260] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:07Z level=info event=draining5026lb # [ 101.826139] envoy[911]: conn peer=[2001:db8:1::1]:39970 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9484 tx=3836 ms=74845027client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5028worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5029worker1 # [ 103.189945] nix-daemon[837]: reaped child process 1416, status = succeeded5030worker1 # [ 103.375074] nix-daemon[837]: accepted connection from pid 1456, user nix-grpc-daemon (trusted)5031worker1 # [ 103.397735] nix-daemon[837]: reaped child process 1459, status = succeeded5032lb # [ 103.507015] niks3-server[1003]: 2026/09/20 08:18:13 INFO Received uploads request method=POST path=/api/pending_closures5033worker1 # [ 103.421891] nix-grpc-daemon[1274]: time=2026-09-20T08:18:12.972Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5034worker1 # [ 103.427340] nix-grpc-daemon[1274]: time=2026-09-20T08:18:12.974Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5035lb # [ 103.550423] niks3-server[1003]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5036lb # [ 103.567277] niks3-server[1003]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5037lb # [ 103.581498] niks3-server[1003]: 2026/09/20 08:18:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5038worker1 # [ 103.489198] nix-grpc-daemon[1274]: time=2026-09-20T08:18:13.039Z level=INFO msg="Uploading 1 narinfos"5039lb # [ 103.590349] niks3-server[1003]: 2026/09/20 08:18:13 INFO Signed narinfos id=32 count=15040lb # [ 103.596093] niks3-server[1003]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5041lb # [ 103.604408] niks3-server[1003]: 2026/09/20 08:18:13 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5042lb # [ 103.613782] niks3-server[1003]: 2026/09/20 08:18:13 INFO Completed upload id=325043worker1 # [ 103.515149] nix-grpc-daemon[1274]: time=2026-09-20T08:18:13.065Z level=INFO msg="Upload complete. (362ms)"5044lb # [ 103.616651] niks3-server[1003]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5045worker1 # [ 103.529344] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54444 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15046worker1 # [ 103.552208] nix-daemon[837]: reaped child process 1414, status = succeeded5047client # [ 103.600448] systemd[1]: rs.service: Deactivated successfully.5048client # [ 103.604887] systemd[1]: rs.service: Consumed 155ms CPU time over 8.970s wall clock time, 37.2M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.5049worker1 # [ 103.858309] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:13Z level=info event=signal_exit5050worker1 # [ 104.090899] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:13Z level=info event=scheduler_yield5051lb # [ 104.193230] niks3-server[1003]: 2026/09/20 08:18:13 INFO lead: released remote=192.168.1.3:556845052worker1 # [ 104.097094] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:13Z level=info event=scheduler_restarting addr=lb:500515053worker2 # [ 104.103339] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:13Z level=info event=scheduler_restarting addr=lb:500515054worker1 # [ 104.102579] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:544345055worker1 # [ 104.107754] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:13Z level=info event=worker_gone addr=192.168.1.3:500515056worker1 # [ 104.111894] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:544345057worker1 # [ 104.116424] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:13Z level=info event=worker_gone addr=192.168.1.4:500515058worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.13 seconds)5059client: waiting for success: ! systemctl is-active rs5060client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5061client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5062worker2 # [ 104.109236] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:13Z level=info event=scheduler_take_over5063worker1 # [ 104.298544] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:13Z level=info event=scheduler_connected addr=lb:500515064worker2 # [ 104.303431] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:13Z level=info event=scheduler_connected addr=lb:500515065worker1 # [ 104.307001] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5066worker2 # [ 104.312535] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5067client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5068client: must fail: journalctl -u rs | grep -q 'reconnecting'5069client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5070lb: must succeed: curl -sf localhost:9901/clusters5071lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5072worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5073worker1 # [ 104.508200] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:14Z level=info event=scheduler_connected addr=lb:500515074worker2 # [ 104.513359] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:14Z level=info event=scheduler_connected addr=lb:500515075worker2 # [ 104.520410] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5076worker1 # [ 104.517427] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5077worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)5078worker2 # [ 104.721406] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:14Z level=info event=scheduler_connected addr=lb:500515079worker1 # [ 104.718083] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:14Z level=info event=scheduler_connected addr=lb:500515080lb # [ 104.200262] niks3-server[1003]: 2026/09/20 08:18:13 INFO lead: acquired remote=192.168.1.4:494525081worker2 # [ 104.730698] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05082worker1 # [ 104.738808] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5083worker1 # [ 104.939792] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:14Z level=info event=scheduler_connected addr=lb:500515084worker2 # [ 104.947451] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=0 running=05085worker1 # [ 105.096235] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:14Z level=info event=scheduler_restarting5086worker2 # [ 105.114903] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:406685087worker2 # [ 105.120075] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:14Z level=info event=worker_gone addr=192.168.1.3:500515088worker1 # [ 105.135316] nix-grpc-daemon[1200]: ts=2026-09-20T08:18:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5089worker1 # [ 105.153868] nix-daemon[837]: reaped child process 1265, status = succeeded5090worker1 # [ 105.529220] nix-grpc-daemon[1200]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5091worker1 # [ 105.533946] nix-grpc-daemon[1200]: E0000 00:00:1789892295.079742 1243 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5092worker1 # [ 105.541459] nix-grpc-daemon[1200]: E0000 00:00:1789892295.092058 1243 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5093lb: must succeed: curl -sf localhost:9901/clusters5094lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5095worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5096worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5097worker1 # [ 106.602789] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5098worker1 # [ 106.609414] systemd[1]: Stopped Nix worker-protocol over gRPC.5099worker1 # [ 106.611909] systemd[1]: nix-grpc-daemon.service: Consumed 1.900s CPU time over 26.978s wall clock time, 36.2M memory peak, 46.2K incoming IP traffic, 96.4K outgoing IP traffic.5100worker1 # [ 106.629825] systemd[1]: Starting Nix worker-protocol over gRPC...5101lb: must succeed: curl -sf localhost:9901/clusters5102lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5103worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5104worker1 # [ 106.828838] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5105worker1 # [ 106.830806] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15106worker1 # [ 106.839355] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5107worker1 # [ 106.843577] systemd[1]: Started Nix worker-protocol over gRPC.5108worker1 # [ 106.875370] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500515109worker2 # [ 106.884467] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05110worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5111(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.37 seconds)5112subtest: scheduler restart mid-build: build finishes, no double build5113client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5114client # [ 107.003202] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5115client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5116worker2 # [ 107.211894] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406705117worker2 # [ 107.226633] nix-daemon[840]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)5118client # Running as unit: mid.service; invocation ID: 3d79e8ab9f3b4cd39515a456f7d3c7775119client # [ 107.266727] nix[1193]: don't know how to build these paths:5120client # [ 107.269858] nix[1193]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5121worker2 # [ 107.254710] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:16Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05122worker2 # [ 107.260974] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:16Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15123worker2 # [ 107.308649] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406705124worker2 # [ 107.327992] nix-grpc-daemon[1133]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5)5125worker2 # [ 107.390765] nix-grpc-daemon[1133]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 2/5)5126worker2 # [ 107.476436] nix-grpc-daemon[1133]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 212 ms (attempt 3/5)5127worker2 # [ 107.696074] nix-grpc-daemon[1133]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 789 ms (attempt 4/5)5128worker2 # [ 108.494673] nix-grpc-daemon[1133]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5129worker2 # [ 108.517108] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406705130client # [ 108.557259] nix[1193]: copying 1 paths to 'lb:50051'...5131worker2 # [ 108.533374] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406705132client # [ 108.557516] nix[1193]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5133worker2 # [ 108.553654] nix-daemon[840]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)5134worker2 # [ 108.581240] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:18Z level=info event=niks3_push_started pid=12555135worker2 # [ 108.974367] nix-daemon[840]: accepted connection from pid 1268, user nix-grpc-daemon (trusted)5136worker2 # [ 108.991716] nix-daemon[840]: reaped child process 1271, status = succeeded5137worker2 # [ 109.167978] nix-daemon[840]: accepted connection from pid 1273, user nix-grpc-daemon (trusted)5138worker2 # [ 109.186908] nix-daemon[840]: reaped child process 1276, status = succeeded5139lb # [ 109.291663] niks3-server[1003]: 2026/09/20 08:18:18 INFO Received uploads request method=POST path=/api/pending_closures5140worker2 # [ 109.210281] nix-grpc-daemon[1255]: time=2026-09-20T08:18:18.761Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5141worker2 # [ 109.213585] nix-grpc-daemon[1255]: time=2026-09-20T08:18:18.763Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5142lb # [ 109.329948] niks3-server[1003]: 2026/09/20 08:18:18 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5143worker2 # [ 109.255818] nix-grpc-daemon[1255]: time=2026-09-20T08:18:18.806Z level=INFO msg="Uploading 1 narinfos"5144lb # [ 109.341642] niks3-server[1003]: 2026/09/20 08:18:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5145lb # [ 109.354181] niks3-server[1003]: 2026/09/20 08:18:18 INFO Signed narinfos id=33 count=15146lb # [ 109.361373] niks3-server[1003]: 2026/09/20 08:18:18 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5147worker2 # [ 109.281740] nix-grpc-daemon[1255]: time=2026-09-20T08:18:18.833Z level=INFO msg="Upload complete. (479ms)"5148lb # [ 109.375799] niks3-server[1003]: 2026/09/20 08:18:18 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5149lb # [ 109.381276] niks3-server[1003]: 2026/09/20 08:18:18 INFO Completed upload id=335150worker2 # [ 109.288292] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40670 duration_s=0 paths=1 nar_bytes_in=4245151lb # [ 109.384572] niks3-server[1003]: 2026/09/20 08:18:18 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5152worker2 # [ 109.303253] nix-grpc-daemon[1133]: ts=2026-09-20T08:18:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406705153worker2 # [ 109.309454] nix-daemon[840]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)5154worker2 # [ 109.314403] nix-daemon[840]: reaped child process 1253, status = succeeded5155client # [ 109.346827] nix[1193]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5156worker2 # [ 109.327461] nix-daemon[840]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)5157lb: must succeed: curl -sf localhost:9901/clusters5158lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5159lb: must succeed: curl -sf localhost:9901/clusters5160lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5161worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5162worker2 # [ 110.965713] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1133 (nix-grpc-daemon) on client request.5163worker2 # [ 110.967322] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5164lb # [ 111.077114] niks3-server[1003]: 2026/09/20 08:18:20 INFO lead: released remote=192.168.1.4:494525165client # [ 111.011690] nix[1193]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5166worker1 # [ 110.983415] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:20Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5167worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5168client # [ 111.017898] nix[1193]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5169client: must succeed: sleep 5.05170worker2 # [ 111.017187] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5171worker2 # [ 111.018734] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5172worker2 # [ 111.020301] systemd[1]: nix-grpc-daemon.service: Consumed 577ms CPU time over 17.128s wall clock time, 33.9M memory peak, 13.4K incoming IP traffic, 19.6K outgoing IP traffic.5173worker2 # [ 111.027500] nix-daemon[840]: reaped child process 1278, status = succeeded5174worker2 # [ 111.028904] nix-daemon[840]: reaped child process 1242, status = succeeded5175worker2 # [ 111.036427] nix-daemon[1280]: unexpected Nix daemon error: error: interrupted by the user5176worker2 # [ 111.042861] nix-daemon[840]: reaped child process 1280, status = failed with exit code 15177worker1 # [ 111.183592] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:20Z level=info event=scheduler_connected addr=lb:500515178worker2 # [ 111.193615] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5179worker2 # [ 111.206826] systemd[1]: Starting Nix worker-protocol over gRPC...5180worker2 # [ 111.412784] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5181worker2 # [ 111.415227] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15182worker2 # [ 111.423180] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5183worker2 # [ 111.431159] systemd[1]: Started Nix worker-protocol over gRPC.5184lb # [ 111.528632] niks3-server[1003]: 2026/09/20 08:18:21 INFO lead: acquired remote=192.168.1.4:367465185worker2 # [ 111.444106] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:20Z level=info event=scheduler_take_over5186worker2 # [ 111.445290] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05187worker2 # [ 111.469005] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:21Z level=info event=scheduler_connected addr=lb:500515188worker2 # [ 111.471065] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05189worker2 # [ 111.497572] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:21Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05190worker2 # [ 111.500478] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:21Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15191worker1 # [ 111.544171] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599025192worker1 # [ 111.559656] nix-daemon[837]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)5193worker1 # [ 111.585441] nix-grpc-daemon[1471]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)5194worker1 # [ 111.629372] nix-grpc-daemon[1471]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 113 ms (attempt 2/5)5195lb # [ 111.823620] envoy[911]: conn peer=[2001:db8:1::1]:54380 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1349 ms=87005196lb # [ 111.828798] envoy[911]: conn peer=[2001:db8:1::3]:46612 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3093 tx=1100 ms=252355197lb # [ 111.833765] envoy[911]: conn peer=[2001:db8:1::4]:57872 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=916 tx=440 ms=168615198worker1 # [ 111.742804] nix-grpc-daemon[1471]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 3/5)5199worker1 # [ 111.750590] nix-grpc-daemon[1471]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 796 ms (attempt 4/5)5200worker1 # [ 112.556988] nix-grpc-daemon[1471]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5201worker1 # [ 112.576509] nix-grpc-daemon[1471]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5202worker1 # [ 112.607167] nix-daemon[837]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)5203worker1 # [ 112.628386] nix-daemon[837]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)5204client # [ 112.655849] nix[1193]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5205client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5206client: waiting for success: ! systemctl is-active mid5207worker1 # [ 116.464700] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:26Z level=info event=niks3_push_started pid=15725208worker1 # [ 116.504431] nix-daemon[837]: reaped child process 1548, status = succeeded5209worker1 # [ 116.867320] nix-daemon[837]: accepted connection from pid 1585, user nix-grpc-daemon (trusted)5210worker1 # [ 116.885240] nix-daemon[837]: reaped child process 1588, status = succeeded5211lb # [ 116.998440] niks3-server[1003]: 2026/09/20 08:18:26 INFO Received uploads request method=POST path=/api/pending_closures5212worker1 # [ 116.914714] nix-grpc-daemon[1572]: time=2026-09-20T08:18:26.463Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5213worker1 # [ 116.917620] nix-grpc-daemon[1572]: time=2026-09-20T08:18:26.463Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5214lb # [ 117.055120] niks3-server[1003]: 2026/09/20 08:18:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5215lb # [ 117.064862] niks3-server[1003]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5216lb # [ 117.074206] niks3-server[1003]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5217lb # [ 117.089200] niks3-server[1003]: 2026/09/20 08:18:26 INFO Signed narinfos id=34 count=15218worker1 # [ 116.993408] nix-grpc-daemon[1572]: time=2026-09-20T08:18:26.542Z level=INFO msg="Uploading 1 narinfos"5219lb # [ 117.107116] niks3-server[1003]: 2026/09/20 08:18:26 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5220lb # [ 117.116680] niks3-server[1003]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5221lb # [ 117.120119] niks3-server[1003]: 2026/09/20 08:18:26 INFO Completed upload id=345222worker1 # [ 117.023100] nix-grpc-daemon[1572]: time=2026-09-20T08:18:26.573Z level=INFO msg="Upload complete. (326ms)"5223lb # [ 117.127368] niks3-server[1003]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5224worker1 # [ 117.036505] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59902 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15225worker1 # [ 117.054505] nix-daemon[837]: reaped child process 1546, status = succeeded5226client # [ 117.110537] systemd[1]: mid.service: Deactivated successfully.5227client # [ 117.115675] systemd[1]: mid.service: Consumed 164ms CPU time over 10.111s wall clock time, 37.2M memory peak, 9.7K incoming IP traffic, 10.7K outgoing IP traffic.5228client: (finished: waiting for success: ! systemctl is-active mid, in 1.12 seconds)5229client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5230client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)5231(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.62 seconds)5232subtest: interrupting the client stops the build on the worker5233client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5234client # [ 117.599421] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5235client # Running as unit: intr.service; invocation ID: 1be81c1e7bda4332912f1a8f20a3022b5236client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5237client # [ 117.824738] nix[1229]: don't know how to build these paths:5238client # [ 117.825661] nix[1229]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5239worker1 # [ 117.796108] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:599025240worker2 # [ 117.813470] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:27Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05241worker2 # [ 117.819676] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:27Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15242worker2 # [ 117.868214] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479725243worker2 # [ 117.883455] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5244worker2 # [ 117.908168] nix-grpc-daemon[1316]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5)5245worker2 # [ 117.937565] nix-grpc-daemon[1316]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 2/5)5246worker2 # [ 118.142322] nix-grpc-daemon[1316]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 29 ms (attempt 3/5)5247worker2 # [ 118.178862] nix-grpc-daemon[1316]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 479 ms (attempt 4/5)5248worker2 # [ 118.665973] nix-grpc-daemon[1316]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5249worker2 # [ 118.687521] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479725250client # [ 118.724080] nix[1229]: copying 1 paths to 'lb:50051'...5251client # [ 118.729317] nix[1229]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5252worker2 # [ 118.706869] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479725253worker2 # [ 118.722334] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5254worker2 # [ 118.749053] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:28Z level=info event=niks3_push_started pid=13885255worker2 # [ 119.142886] nix-daemon[840]: accepted connection from pid 1405, user nix-grpc-daemon (trusted)5256worker2 # [ 119.160092] nix-daemon[840]: reaped child process 1408, status = succeeded5257worker2 # [ 119.333629] nix-daemon[840]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5258worker2 # [ 119.350910] nix-daemon[840]: reaped child process 1413, status = succeeded5259lb # [ 119.455290] niks3-server[1003]: 2026/09/20 08:18:29 INFO Received uploads request method=POST path=/api/pending_closures5260worker2 # [ 119.376440] nix-grpc-daemon[1388]: time=2026-09-20T08:18:28.926Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5261worker2 # [ 119.377893] nix-grpc-daemon[1388]: time=2026-09-20T08:18:28.927Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5262lb # [ 119.495543] niks3-server[1003]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5263worker2 # [ 119.416403] nix-grpc-daemon[1388]: time=2026-09-20T08:18:28.967Z level=INFO msg="Uploading 1 narinfos"5264lb # [ 119.508855] niks3-server[1003]: 2026/09/20 08:18:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5265lb # [ 119.520320] niks3-server[1003]: 2026/09/20 08:18:29 INFO Signed narinfos id=35 count=15266lb # [ 119.528723] niks3-server[1003]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5267lb # [ 119.535504] niks3-server[1003]: 2026/09/20 08:18:29 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5268lb # [ 119.546463] niks3-server[1003]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5269lb # [ 119.552581] niks3-server[1003]: 2026/09/20 08:18:29 INFO Completed upload id=355270worker2 # [ 119.460670] nix-grpc-daemon[1388]: time=2026-09-20T08:18:29.011Z level=INFO msg="Upload complete. (487ms)"5271worker2 # [ 119.471507] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=0 paths=1 nar_bytes_in=4245272worker2 # [ 119.488252] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479725273worker2 # [ 119.494224] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5274worker2 # [ 119.499169] nix-daemon[840]: reaped child process 1386, status = succeeded5275client # [ 119.533649] nix[1229]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5276worker2 # [ 119.513390] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5277client: must succeed: systemctl kill -s INT intr5278client # [ 121.297027] systemd[1]: intr.service: Sent signal SIGINT to main process 1229 (nix) on client request.5279worker2 # [ 121.282520] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:30Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5280client # [ 121.304989] nix[1229]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5281client # [ 121.313454] nix[1229]: error: interrupted by the user5282client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5283client # [ 121.349044] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5284client # [ 121.351879] systemd[1]: intr.service: Failed with result 'exit-code'.5285client # [ 121.356206] systemd[1]: intr.service: Consumed 141ms CPU time over 3.754s wall clock time, 39.2M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5286worker2 # [ 121.340492] nix-daemon[1417]: unexpected Nix daemon error: error: interrupted by the user5287worker2 # [ 121.348562] nix-daemon[840]: reaped child process 1415, status = succeeded5288worker2 # [ 121.350527] nix-daemon[840]: reaped child process 1417, status = failed with exit code 15289(finished: subtest: interrupting the client stops the build on the worker, in 3.89 seconds)5290subtest: a deploy mid-build drains: the build finishes, the new generation takes over5291client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5292client # [ 121.511524] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5293client # Running as unit: sw.service; invocation ID: 41af954df48b4a9abb50ac6a333118375294client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5295client # [ 121.744506] nix[1249]: don't know how to build these paths:5296client # [ 121.745390] nix[1249]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5297worker2 # [ 121.720244] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:479725298worker2 # [ 121.733592] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:31Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05299lb # [ 121.826387] envoy[911]: conn peer=[2001:db8:1::1]:36228 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3858 tx=1678 ms=98505300worker2 # [ 121.739614] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:31Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15301worker1 # [ 121.778241] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599025302worker1 # [ 121.790566] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:599025303client # [ 121.832136] nix[1249]: copying 1 paths to 'lb:50051'...5304client # [ 121.837328] nix[1249]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5305worker1 # [ 121.808915] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:599025306worker1 # [ 121.824414] nix-daemon[837]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)5307worker1 # [ 122.042642] nix-daemon[837]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5308worker1 # [ 122.061459] nix-daemon[837]: reaped child process 1619, status = succeeded5309worker1 # [ 122.237453] nix-daemon[837]: accepted connection from pid 1621, user nix-grpc-daemon (trusted)5310worker1 # [ 122.256669] nix-daemon[837]: reaped child process 1624, status = succeeded5311lb # [ 121.832513] envoy[911]: conn peer=[2001:db8:1::1]:35022 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=755 ms=35035312lb # [ 122.369126] niks3-server[1003]: 2026/09/20 08:18:31 INFO Received uploads request method=POST path=/api/pending_closures5313worker1 # [ 122.288088] nix-grpc-daemon[1572]: time=2026-09-20T08:18:31.838Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5314worker1 # [ 122.290319] nix-grpc-daemon[1572]: time=2026-09-20T08:18:31.840Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5315lb # [ 122.416643] niks3-server[1003]: 2026/09/20 08:18:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5316worker1 # [ 122.327872] nix-grpc-daemon[1572]: time=2026-09-20T08:18:31.878Z level=INFO msg="Uploading 1 narinfos"5317lb # [ 122.429845] niks3-server[1003]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5318lb # [ 122.447448] niks3-server[1003]: 2026/09/20 08:18:31 INFO Signed narinfos id=36 count=15319lb # [ 122.451111] niks3-server[1003]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5320lb # [ 122.454359] niks3-server[1003]: 2026/09/20 08:18:31 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5321lb # [ 122.458474] niks3-server[1003]: 2026/09/20 08:18:32 INFO Completed upload id=365322worker1 # [ 122.360323] nix-grpc-daemon[1572]: time=2026-09-20T08:18:31.911Z level=INFO msg="Upload complete. (518ms)"5323lb # [ 122.460970] niks3-server[1003]: 2026/09/20 08:18:32 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5324worker1 # [ 122.370687] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59902 duration_s=0 paths=1 nar_bytes_in=4165325worker1 # [ 122.386380] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599025326worker1 # [ 122.393597] nix-daemon[837]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)5327worker1 # [ 122.399047] nix-daemon[837]: reaped child process 1614, status = succeeded5328client # [ 122.437624] nix[1249]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5329worker1 # [ 122.414186] nix-daemon[837]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)5330worker1: must succeed: systemctl reload nix-grpc-daemon.service5331worker1 # [ 124.190824] systemd[1]: Reloading Nix worker-protocol over gRPC...5332worker1 # [ 124.243441] systemd[1]: Reloaded Nix worker-protocol over gRPC.5333worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5334worker1: must succeed: pgrep -f 'read -t [9]0 x'5335worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5336client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&25337worker1 # [ 124.559886] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:599025338client # don't know how to build these paths:5339client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5340worker2 # [ 124.583110] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:34Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05341worker2 # [ 124.589808] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:34Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15342worker2 # [ 124.627758] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479725343worker2 # [ 124.644454] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479725344client # copying 1 paths to 'lb:50051'...5345worker2 # [ 124.660921] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479725346client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5347worker2 # [ 124.685404] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5348worker1 # [ 124.852389] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:34Z level=info event=draining5349worker2 # [ 124.891390] nix-daemon[840]: accepted connection from pid 1467, user nix-grpc-daemon (trusted)5350worker2 # [ 124.911843] nix-daemon[840]: reaped child process 1470, status = succeeded5351worker2 # [ 125.089705] nix-daemon[840]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)5352worker2 # [ 125.109678] nix-daemon[840]: reaped child process 1475, status = succeeded5353lb # [ 125.215813] niks3-server[1003]: 2026/09/20 08:18:34 INFO Received uploads request method=POST path=/api/pending_closures5354worker2 # [ 125.133998] nix-grpc-daemon[1388]: time=2026-09-20T08:18:34.684Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5355worker2 # [ 125.135480] nix-grpc-daemon[1388]: time=2026-09-20T08:18:34.684Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5356lb # [ 125.244163] niks3-server[1003]: 2026/09/20 08:18:34 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5357lb # [ 125.259548] niks3-server[1003]: 2026/09/20 08:18:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5358worker2 # [ 125.173635] nix-grpc-daemon[1388]: time=2026-09-20T08:18:34.724Z level=INFO msg="Uploading 1 narinfos"5359lb # [ 125.272906] niks3-server[1003]: 2026/09/20 08:18:34 INFO Signed narinfos id=37 count=15360lb # [ 125.284228] niks3-server[1003]: 2026/09/20 08:18:34 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5361worker2 # [ 125.198052] nix-grpc-daemon[1388]: time=2026-09-20T08:18:34.749Z level=INFO msg="Upload complete. (496ms)"5362lb # [ 125.291548] niks3-server[1003]: 2026/09/20 08:18:34 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5363lb # [ 125.296966] niks3-server[1003]: 2026/09/20 08:18:34 INFO Completed upload id=375364lb # [ 125.300461] niks3-server[1003]: 2026/09/20 08:18:34 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5365worker2 # [ 125.208228] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=0 paths=1 nar_bytes_in=5285366worker2 # [ 125.218734] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479725367worker2 # [ 125.225389] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5368worker2 # [ 125.229940] nix-daemon[840]: reaped child process 1465, status = succeeded5369client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5370client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5371worker2 # [ 125.242651] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5372client # farm-a> LOG-farm-a-during-drain5373worker2 # [ 126.287446] nix-daemon[840]: reaped child process 1479, status = succeeded5374worker2 # [ 126.475945] nix-daemon[840]: accepted connection from pid 1494, user nix-grpc-daemon (trusted)5375worker2 # [ 126.495004] nix-daemon[840]: reaped child process 1497, status = succeeded5376lb # [ 126.600678] niks3-server[1003]: 2026/09/20 08:18:36 INFO Received uploads request method=POST path=/api/pending_closures5377worker2 # [ 126.523191] nix-grpc-daemon[1388]: time=2026-09-20T08:18:36.071Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5378worker2 # [ 126.525399] nix-grpc-daemon[1388]: time=2026-09-20T08:18:36.071Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5379lb # [ 126.631842] niks3-server[1003]: 2026/09/20 08:18:36 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5380lb # [ 126.655203] niks3-server[1003]: 2026/09/20 08:18:36 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5381lb # [ 126.665098] niks3-server[1003]: 2026/09/20 08:18:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5382worker2 # [ 126.578923] nix-grpc-daemon[1388]: time=2026-09-20T08:18:36.129Z level=INFO msg="Uploading 1 narinfos"5383lb # [ 126.677728] niks3-server[1003]: 2026/09/20 08:18:36 INFO Signed narinfos id=38 count=15384lb # [ 126.683111] niks3-server[1003]: 2026/09/20 08:18:36 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5385lb # [ 126.690433] niks3-server[1003]: 2026/09/20 08:18:36 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5386lb # [ 126.697637] niks3-server[1003]: 2026/09/20 08:18:36 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5387lb # [ 126.702892] niks3-server[1003]: 2026/09/20 08:18:36 INFO Completed upload id=385388worker2 # [ 126.610758] nix-grpc-daemon[1388]: time=2026-09-20T08:18:36.162Z level=INFO msg="Upload complete. (358ms)"5389worker2 # [ 126.626316] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15390worker2 # [ 126.643583] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:36Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05391worker2 # [ 126.648869] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:36Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15392worker2 # [ 126.653566] nix-daemon[840]: reaped child process 1477, status = succeeded5393worker2 # [ 126.672513] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479725394worker2 # [ 126.688315] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479725395worker2 # [ 126.703411] nix-grpc-daemon[1388]: time=2026-09-20T08:18:36.254Z level=INFO msg="All 1 paths already cached"5396client # copying 1 paths to 'lb:50051'...5397worker2 # [ 126.718462] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479725398client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5399worker2 # [ 126.743580] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5400worker2 # [ 126.950066] nix-daemon[840]: accepted connection from pid 1503, user nix-grpc-daemon (trusted)5401worker2 # [ 126.969351] nix-daemon[840]: reaped child process 1506, status = succeeded5402worker2 # [ 127.140552] nix-daemon[840]: accepted connection from pid 1508, user nix-grpc-daemon (trusted)5403worker2 # [ 127.159596] nix-daemon[840]: reaped child process 1511, status = succeeded5404lb # [ 127.263118] niks3-server[1003]: 2026/09/20 08:18:36 INFO Received uploads request method=POST path=/api/pending_closures5405worker2 # [ 127.180799] nix-grpc-daemon[1388]: time=2026-09-20T08:18:36.731Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5406worker2 # [ 127.182310] nix-grpc-daemon[1388]: time=2026-09-20T08:18:36.731Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5407lb # [ 127.290381] niks3-server[1003]: 2026/09/20 08:18:36 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5408lb # [ 127.304152] niks3-server[1003]: 2026/09/20 08:18:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5409worker2 # [ 127.220305] nix-grpc-daemon[1388]: time=2026-09-20T08:18:36.771Z level=INFO msg="Uploading 1 narinfos"5410lb # [ 127.312738] niks3-server[1003]: 2026/09/20 08:18:36 INFO Signed narinfos id=39 count=15411lb # [ 127.322437] niks3-server[1003]: 2026/09/20 08:18:36 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5412lb # [ 127.331128] niks3-server[1003]: 2026/09/20 08:18:36 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5413worker2 # [ 127.245222] nix-grpc-daemon[1388]: time=2026-09-20T08:18:36.796Z level=INFO msg="Upload complete. (483ms)"5414lb # [ 127.339917] niks3-server[1003]: 2026/09/20 08:18:36 INFO Completed upload id=395415worker2 # [ 127.251673] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=0 paths=1 nar_bytes_in=6405416lb # [ 127.344503] niks3-server[1003]: 2026/09/20 08:18:36 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5417worker2 # [ 127.260842] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479725418worker2 # [ 127.271945] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5419worker2 # [ 127.276926] nix-daemon[840]: reaped child process 1501, status = succeeded5420client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5421client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5422worker2 # [ 127.291300] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5423client # farm-b> LOG-farm-b-during-drain5424worker2 # [ 128.515370] nix-daemon[840]: reaped child process 1515, status = succeeded5425worker2 # [ 128.683998] nix-daemon[840]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5426worker2 # [ 128.701713] nix-daemon[840]: reaped child process 1533, status = succeeded5427lb # [ 128.806239] niks3-server[1003]: 2026/09/20 08:18:38 INFO Received uploads request method=POST path=/api/pending_closures5428worker2 # [ 128.725417] nix-grpc-daemon[1388]: time=2026-09-20T08:18:38.275Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5429worker2 # [ 128.726883] nix-grpc-daemon[1388]: time=2026-09-20T08:18:38.275Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5430lb # [ 128.838095] niks3-server[1003]: 2026/09/20 08:18:38 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5431lb # [ 128.850606] niks3-server[1003]: 2026/09/20 08:18:38 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5432worker2 # [ 128.770758] nix-grpc-daemon[1388]: time=2026-09-20T08:18:38.321Z level=INFO msg="Uploading 1 narinfos"5433lb # [ 128.862901] niks3-server[1003]: 2026/09/20 08:18:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5434lb # [ 128.871672] niks3-server[1003]: 2026/09/20 08:18:38 INFO Signed narinfos id=40 count=15435lb # [ 128.877297] niks3-server[1003]: 2026/09/20 08:18:38 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5436lb # [ 128.885319] niks3-server[1003]: 2026/09/20 08:18:38 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5437worker2 # [ 128.797947] nix-grpc-daemon[1388]: time=2026-09-20T08:18:38.349Z level=INFO msg="Upload complete. (297ms)"5438lb # [ 128.893021] niks3-server[1003]: 2026/09/20 08:18:38 INFO Completed upload id=405439lb # [ 128.897774] niks3-server[1003]: 2026/09/20 08:18:38 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5440worker2 # [ 128.810664] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15441worker2 # [ 128.829004] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:38Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05442worker2 # [ 128.833113] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:38Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15443worker2 # [ 128.837254] nix-daemon[840]: reaped child process 1513, status = succeeded5444worker2 # [ 128.868590] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479725445worker2 # [ 128.883429] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479725446worker2 # [ 128.899106] nix-grpc-daemon[1388]: time=2026-09-20T08:18:38.450Z level=INFO msg="All 2 paths already cached"5447client # copying 1 paths to 'lb:50051'...5448client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5449worker2 # [ 128.909671] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479725450worker2 # [ 128.924646] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5451worker2 # [ 129.125985] nix-daemon[840]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)5452worker2 # [ 129.144137] nix-daemon[840]: reaped child process 1542, status = succeeded5453worker2 # [ 129.318753] nix-daemon[840]: accepted connection from pid 1544, user nix-grpc-daemon (trusted)5454worker2 # [ 129.336223] nix-daemon[840]: reaped child process 1547, status = succeeded5455lb # [ 129.440144] niks3-server[1003]: 2026/09/20 08:18:38 INFO Received uploads request method=POST path=/api/pending_closures5456worker2 # [ 129.358025] nix-grpc-daemon[1388]: time=2026-09-20T08:18:38.909Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5457worker2 # [ 129.359501] nix-grpc-daemon[1388]: time=2026-09-20T08:18:38.909Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5458lb # [ 129.468120] niks3-server[1003]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5459worker2 # [ 129.395519] nix-grpc-daemon[1388]: time=2026-09-20T08:18:38.946Z level=INFO msg="Uploading 1 narinfos"5460lb # [ 129.481846] niks3-server[1003]: 2026/09/20 08:18:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5461lb # [ 129.494523] niks3-server[1003]: 2026/09/20 08:18:39 INFO Signed narinfos id=41 count=15462lb # [ 129.500892] niks3-server[1003]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5463worker2 # [ 129.417904] nix-grpc-daemon[1388]: time=2026-09-20T08:18:38.969Z level=INFO msg="Upload complete. (477ms)"5464lb # [ 129.510620] niks3-server[1003]: 2026/09/20 08:18:39 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5465lb # [ 129.516217] niks3-server[1003]: 2026/09/20 08:18:39 INFO Completed upload id=415466worker2 # [ 129.426494] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=0 paths=1 nar_bytes_in=7685467lb # [ 129.519426] niks3-server[1003]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5468worker2 # [ 129.438243] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479725469worker2 # [ 129.444002] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5470worker2 # [ 129.448625] nix-daemon[840]: reaped child process 1537, status = succeeded5471client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5472worker2 # [ 129.461301] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5473client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5474client # farm-top> LOG-farm-top-during-drain5475worker2 # [ 130.884200] nix-daemon[840]: reaped child process 1551, status = succeeded5476worker2 # [ 131.043178] nix-daemon[840]: accepted connection from pid 1566, user nix-grpc-daemon (trusted)5477worker2 # [ 131.062920] nix-daemon[840]: reaped child process 1569, status = succeeded5478lb # [ 131.167969] niks3-server[1003]: 2026/09/20 08:18:40 INFO Received uploads request method=POST path=/api/pending_closures5479worker2 # [ 131.088058] nix-grpc-daemon[1388]: time=2026-09-20T08:18:40.639Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5480worker2 # [ 131.091275] nix-grpc-daemon[1388]: time=2026-09-20T08:18:40.641Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5481lb # [ 131.213983] niks3-server[1003]: 2026/09/20 08:18:40 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5482lb # [ 131.227379] niks3-server[1003]: 2026/09/20 08:18:40 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5483lb # [ 131.237862] niks3-server[1003]: 2026/09/20 08:18:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5484worker2 # [ 131.150568] nix-grpc-daemon[1388]: time=2026-09-20T08:18:40.701Z level=INFO msg="Uploading 1 narinfos"5485lb # [ 131.244960] niks3-server[1003]: 2026/09/20 08:18:40 INFO Signed narinfos id=42 count=15486lb # [ 131.253499] niks3-server[1003]: 2026/09/20 08:18:40 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5487lb # [ 131.261517] niks3-server[1003]: 2026/09/20 08:18:40 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5488lb # [ 131.268416] niks3-server[1003]: 2026/09/20 08:18:40 INFO Completed upload id=425489lb # [ 131.271076] niks3-server[1003]: 2026/09/20 08:18:40 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5490worker2 # [ 131.176310] nix-grpc-daemon[1388]: time=2026-09-20T08:18:40.727Z level=INFO msg="Upload complete. (305ms)"5491worker2 # [ 131.189498] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15492worker2 # [ 131.206970] nix-daemon[840]: reaped child process 1549, status = succeeded5493client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&2, in 6.92 seconds)5494client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath5495client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath, in 0.24 seconds)5496worker1: must succeed: pkill -f 'read -t [9]0 x'5497worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5498client: waiting for success: ! systemctl is-active sw5499worker1 # [ 131.668619] nix-daemon[837]: reaped child process 1628, status = succeeded5500lb # [ 131.827213] envoy[911]: conn peer=[2001:db8:1::1]:33758 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9469 tx=3759 ms=66355501worker1 # [ 131.844725] nix-daemon[837]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)5502worker1 # [ 131.862529] nix-daemon[837]: reaped child process 1672, status = succeeded5503lb # [ 131.972156] niks3-server[1003]: 2026/09/20 08:18:41 INFO Received uploads request method=POST path=/api/pending_closures5504worker1 # [ 131.886060] nix-grpc-daemon[1572]: time=2026-09-20T08:18:41.435Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5505worker1 # [ 131.887527] nix-grpc-daemon[1572]: time=2026-09-20T08:18:41.435Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5506lb # [ 132.009035] niks3-server[1003]: 2026/09/20 08:18:41 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5507lb # [ 132.022527] niks3-server[1003]: 2026/09/20 08:18:41 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5508worker1 # [ 131.933454] nix-grpc-daemon[1572]: time=2026-09-20T08:18:41.483Z level=INFO msg="Uploading 1 narinfos"5509lb # [ 132.033572] niks3-server[1003]: 2026/09/20 08:18:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5510lb # [ 132.043863] niks3-server[1003]: 2026/09/20 08:18:41 INFO Signed narinfos id=43 count=15511lb # [ 132.049958] niks3-server[1003]: 2026/09/20 08:18:41 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5512lb # [ 132.059994] niks3-server[1003]: 2026/09/20 08:18:41 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5513lb # [ 132.065325] niks3-server[1003]: 2026/09/20 08:18:41 INFO Completed upload id=435514worker1 # [ 131.967434] nix-grpc-daemon[1572]: time=2026-09-20T08:18:41.518Z level=INFO msg="Upload complete. (332ms)"5515lb # [ 132.068388] niks3-server[1003]: 2026/09/20 08:18:41 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5516worker1 # [ 131.981014] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59902 duration_s=9 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15517worker1 # [ 131.995391] nix-daemon[837]: reaped child process 1626, status = succeeded5518client # [ 132.045848] systemd[1]: sw.service: Deactivated successfully.5519client # [ 132.051104] systemd[1]: sw.service: Consumed 152ms CPU time over 10.537s wall clock time, 35M memory peak, 8.2K incoming IP traffic, 8.9K outgoing IP traffic.5520client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds)5521client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5522client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)5523worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5524worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.07 seconds)5525lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5526lb: must succeed: curl -sf localhost:9901/clusters5527worker1 # [ 132.857822] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:42Z level=info event=signal_exit5528lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5529lb: must succeed: curl -sf localhost:9901/clusters5530lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5531worker2 # [ 134.089665] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:479425532worker1 # [ 134.087447] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:43Z level=info event=scheduler_restarting5533worker2 # [ 134.090152] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:43Z level=info event=worker_gone addr=192.168.1.3:500515534worker1 # [ 134.110778] nix-grpc-daemon[1471]: ts=2026-09-20T08:18:43Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5535worker1 # [ 134.140813] nix-daemon[837]: reaped child process 1540, status = succeeded5536worker1 # [ 134.656546] nix-grpc-daemon[1471]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5537worker1 # [ 134.661265] nix-grpc-daemon[1471]: E0000 00:00:1789892324.206669 1514 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5538worker1 # [ 134.668212] nix-grpc-daemon[1471]: E0000 00:00:1789892324.207182 1514 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5539worker1 # [ 134.903154] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5540worker1 # [ 134.908507] systemd[1]: nix-grpc-daemon.service: Consumed 902ms CPU time over 28.267s wall clock time, 33.4M memory peak, 21.2K incoming IP traffic, 27.8K outgoing IP traffic.5541lb: must succeed: curl -sf localhost:9901/clusters5542lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5543worker1 # [ 135.886414] systemd[1]: Starting Nix worker-protocol over gRPC...5544lb: must succeed: curl -sf localhost:9901/clusters5545worker1 # [ 136.109903] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5546worker1 # [ 136.112628] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15547worker1 # [ 136.121614] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5548worker1 # [ 136.123710] systemd[1]: Started Nix worker-protocol over gRPC.5549lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5550worker1 # [ 136.164305] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:45Z level=info event=scheduler_connected addr=lb:500515551worker2 # [ 136.173099] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:45Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05552lb: must succeed: curl -sf localhost:9901/clusters5553lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5554lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 4.45 seconds)5555lb: must succeed: curl -sf localhost:9901/clusters5556lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5557worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5558worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5559(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.96 seconds)5560subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5561client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15562worker1 # [ 137.650242] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:556085563worker1 # [ 137.661119] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5564worker2 # [ 137.705318] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:47Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05565worker2 # [ 137.711760] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:47Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15566worker2 # [ 137.717989] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:47Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05567worker2 # [ 137.723551] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:47Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05568worker1 # [ 137.747929] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085569worker1 # [ 137.767473] nix-grpc-daemon[1684]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5)5570worker1 # [ 137.872598] nix-grpc-daemon[1684]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 2/5)5571worker1 # [ 138.046558] nix-grpc-daemon[1684]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 89 ms (attempt 3/5)5572worker1 # [ 138.149548] nix-grpc-daemon[1684]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 705 ms (attempt 4/5)5573worker1 # [ 138.865447] nix-grpc-daemon[1684]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5574worker1 # [ 138.888503] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:556085575worker1 # [ 138.905066] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:556085576worker1 # [ 138.921536] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5577worker1 # [ 138.951977] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:48Z level=info event=niks3_push_started pid=17405578worker1 # [ 139.357050] nix-daemon[837]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)5579worker1 # [ 139.375656] nix-daemon[837]: reaped child process 1756, status = succeeded5580worker1 # [ 139.553635] nix-daemon[837]: accepted connection from pid 1758, user nix-grpc-daemon (trusted)5581worker1 # [ 139.571634] nix-daemon[837]: reaped child process 1761, status = succeeded5582lb # [ 139.681847] niks3-server[1003]: 2026/09/20 08:18:49 INFO Received uploads request method=POST path=/api/pending_closures5583worker1 # [ 139.596364] nix-grpc-daemon[1740]: time=2026-09-20T08:18:49.145Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5584worker1 # [ 139.597939] nix-grpc-daemon[1740]: time=2026-09-20T08:18:49.145Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5585lb # [ 139.748880] niks3-server[1003]: 2026/09/20 08:18:49 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5586worker1 # [ 139.659527] nix-grpc-daemon[1740]: time=2026-09-20T08:18:49.209Z level=INFO msg="Uploading 1 narinfos"5587lb # [ 139.760467] niks3-server[1003]: 2026/09/20 08:18:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5588lb # [ 139.763895] niks3-server[1003]: 2026/09/20 08:18:49 INFO Signed narinfos id=44 count=15589lb # [ 139.774110] niks3-server[1003]: 2026/09/20 08:18:49 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5590worker1 # [ 139.686340] nix-grpc-daemon[1740]: time=2026-09-20T08:18:49.237Z level=INFO msg="Upload complete. (507ms)"5591lb # [ 139.783915] niks3-server[1003]: 2026/09/20 08:18:49 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5592lb # [ 139.789028] niks3-server[1003]: 2026/09/20 08:18:49 INFO Completed upload id=445593lb # [ 139.792979] niks3-server[1003]: 2026/09/20 08:18:49 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5594worker1 # [ 139.696349] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=0 paths=1 nar_bytes_in=5125595worker1 # [ 139.714799] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085596worker1 # [ 139.722073] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5597worker1 # [ 139.727733] nix-daemon[837]: reaped child process 1738, status = succeeded5598worker1 # [ 139.741083] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5599worker1 # [ 140.572312] nix-daemon[837]: reaped child process 1765, status = succeeded5600worker1 # [ 140.739158] nix-daemon[837]: accepted connection from pid 1780, user nix-grpc-daemon (trusted)5601worker1 # [ 140.758688] nix-daemon[837]: reaped child process 1783, status = succeeded5602lb # [ 140.869957] niks3-server[1003]: 2026/09/20 08:18:50 INFO Received uploads request method=POST path=/api/pending_closures5603worker1 # [ 140.781732] nix-grpc-daemon[1740]: time=2026-09-20T08:18:50.331Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5604worker1 # [ 140.783315] nix-grpc-daemon[1740]: time=2026-09-20T08:18:50.331Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5605lb # [ 140.909481] niks3-server[1003]: 2026/09/20 08:18:50 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5606lb # [ 140.922716] niks3-server[1003]: 2026/09/20 08:18:50 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5607lb # [ 140.931371] niks3-server[1003]: 2026/09/20 08:18:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5608lb # [ 140.937383] niks3-server[1003]: 2026/09/20 08:18:50 INFO Signed narinfos id=45 count=15609worker1 # [ 140.840202] nix-grpc-daemon[1740]: time=2026-09-20T08:18:50.389Z level=INFO msg="Uploading 1 narinfos"5610lb # [ 140.940634] niks3-server[1003]: 2026/09/20 08:18:50 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5611lb # [ 140.952308] niks3-server[1003]: 2026/09/20 08:18:50 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5612worker1 # [ 140.861696] nix-grpc-daemon[1740]: time=2026-09-20T08:18:50.412Z level=INFO msg="Upload complete. (306ms)"5613lb # [ 140.960538] niks3-server[1003]: 2026/09/20 08:18:50 INFO Completed upload id=455614lb # [ 140.963559] niks3-server[1003]: 2026/09/20 08:18:50 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5615worker2 # [ 140.878675] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:50Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15616worker1 # [ 140.873107] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15617worker2 # [ 140.891810] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:50Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05618worker1 # [ 140.891304] nix-daemon[837]: reaped child process 1763, status = succeeded5619worker1 # [ 140.929373] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085620worker1 # [ 140.945260] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:556085621worker1 # [ 140.959951] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:556085622worker1 # [ 140.974086] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5623worker1 # [ 141.183141] nix-daemon[837]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)5624worker1 # [ 141.201097] nix-daemon[837]: reaped child process 1790, status = succeeded5625worker1 # [ 141.375555] nix-daemon[837]: accepted connection from pid 1792, user nix-grpc-daemon (trusted)5626worker1 # [ 141.391626] nix-daemon[837]: reaped child process 1795, status = succeeded5627lb # [ 141.505310] niks3-server[1003]: 2026/09/20 08:18:51 INFO Received uploads request method=POST path=/api/pending_closures5628worker1 # [ 141.417050] nix-grpc-daemon[1740]: time=2026-09-20T08:18:50.967Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5629worker1 # [ 141.418568] nix-grpc-daemon[1740]: time=2026-09-20T08:18:50.967Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5630lb # [ 141.533840] niks3-server[1003]: 2026/09/20 08:18:51 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5631worker1 # [ 141.451827] nix-grpc-daemon[1740]: time=2026-09-20T08:18:51.002Z level=INFO msg="Uploading 1 narinfos"5632lb # [ 141.552198] niks3-server[1003]: 2026/09/20 08:18:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5633lb # [ 141.560993] niks3-server[1003]: 2026/09/20 08:18:51 INFO Signed narinfos id=46 count=15634lb # [ 141.563555] niks3-server[1003]: 2026/09/20 08:18:51 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5635worker1 # [ 141.476823] nix-grpc-daemon[1740]: time=2026-09-20T08:18:51.027Z level=INFO msg="Upload complete. (485ms)"5636lb # [ 141.574728] niks3-server[1003]: 2026/09/20 08:18:51 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5637lb # [ 141.580080] niks3-server[1003]: 2026/09/20 08:18:51 INFO Completed upload id=465638lb # [ 141.583069] niks3-server[1003]: 2026/09/20 08:18:51 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5639worker1 # [ 141.484106] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=0 paths=1 nar_bytes_in=5125640worker1 # [ 141.492775] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085641worker1 # [ 141.504157] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5642worker1 # [ 141.508169] nix-daemon[837]: reaped child process 1785, status = succeeded5643worker1 # [ 141.520622] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5644lb # [ 141.830311] envoy[911]: conn peer=[2001:db8:1::1]:33742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2935 tx=1306 ms=102775645lb # [ 141.835498] envoy[911]: conn peer=[2001:db8:1::3]:41888 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=448 ms=272255646worker1 # [ 142.766141] nix-daemon[837]: reaped child process 1799, status = succeeded5647worker1 # [ 142.946839] nix-daemon[837]: accepted connection from pid 1814, user nix-grpc-daemon (trusted)5648worker1 # [ 142.964569] nix-daemon[837]: reaped child process 1817, status = succeeded5649lb # [ 143.074166] niks3-server[1003]: 2026/09/20 08:18:52 INFO Received uploads request method=POST path=/api/pending_closures5650worker1 # [ 142.986776] nix-grpc-daemon[1740]: time=2026-09-20T08:18:52.536Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5651worker1 # [ 142.988385] nix-grpc-daemon[1740]: time=2026-09-20T08:18:52.536Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5652lb # [ 143.118633] niks3-server[1003]: 2026/09/20 08:18:52 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5653worker1 # [ 143.032681] nix-grpc-daemon[1740]: time=2026-09-20T08:18:52.583Z level=INFO msg="Uploading 1 narinfos"5654lb # [ 143.132195] niks3-server[1003]: 2026/09/20 08:18:52 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5655lb # [ 143.142040] niks3-server[1003]: 2026/09/20 08:18:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5656lb # [ 143.147988] niks3-server[1003]: 2026/09/20 08:18:52 INFO Signed narinfos id=47 count=15657lb # [ 143.156099] niks3-server[1003]: 2026/09/20 08:18:52 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5658lb # [ 143.159793] niks3-server[1003]: 2026/09/20 08:18:52 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5659lb # [ 143.164832] niks3-server[1003]: 2026/09/20 08:18:52 INFO Completed upload id=475660worker1 # [ 143.066883] nix-grpc-daemon[1740]: time=2026-09-20T08:18:52.617Z level=INFO msg="Upload complete. (336ms)"5661lb # [ 143.167900] niks3-server[1003]: 2026/09/20 08:18:52 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5662worker2 # [ 143.082804] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:52Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15663worker1 # [ 143.077139] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15664worker2 # [ 143.096327] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:52Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05665worker1 # [ 143.096275] nix-daemon[837]: reaped child process 1797, status = succeeded5666worker1 # [ 143.130744] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085667worker1 # [ 143.146386] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:556085668worker1 # [ 143.162094] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:556085669worker1 # [ 143.175823] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5670worker1 # [ 143.379143] nix-daemon[837]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)5671worker1 # [ 143.399098] nix-daemon[837]: reaped child process 1824, status = succeeded5672worker1 # [ 143.576078] nix-daemon[837]: accepted connection from pid 1826, user nix-grpc-daemon (trusted)5673worker1 # [ 143.593185] nix-daemon[837]: reaped child process 1829, status = succeeded5674lb # [ 143.704382] niks3-server[1003]: 2026/09/20 08:18:53 INFO Received uploads request method=POST path=/api/pending_closures5675worker1 # [ 143.616633] nix-grpc-daemon[1740]: time=2026-09-20T08:18:53.167Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5676worker1 # [ 143.618129] nix-grpc-daemon[1740]: time=2026-09-20T08:18:53.167Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5677lb # [ 143.735938] niks3-server[1003]: 2026/09/20 08:18:53 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5678worker1 # [ 143.648361] nix-grpc-daemon[1740]: time=2026-09-20T08:18:53.198Z level=INFO msg="Uploading 1 narinfos"5679lb # [ 143.748941] niks3-server[1003]: 2026/09/20 08:18:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5680lb # [ 143.760390] niks3-server[1003]: 2026/09/20 08:18:53 INFO Signed narinfos id=48 count=15681lb # [ 143.765837] niks3-server[1003]: 2026/09/20 08:18:53 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5682worker1 # [ 143.676746] nix-grpc-daemon[1740]: time=2026-09-20T08:18:53.227Z level=INFO msg="Upload complete. (486ms)"5683lb # [ 143.776067] niks3-server[1003]: 2026/09/20 08:18:53 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5684lb # [ 143.782190] niks3-server[1003]: 2026/09/20 08:18:53 INFO Completed upload id=485685worker1 # [ 143.684123] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=0 paths=1 nar_bytes_in=5125686lb # [ 143.786279] niks3-server[1003]: 2026/09/20 08:18:53 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5687worker1 # [ 143.695828] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085688worker1 # [ 143.702258] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5689worker1 # [ 143.706929] nix-daemon[837]: reaped child process 1819, status = succeeded5690worker1 # [ 143.717391] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5691worker1 # [ 145.171073] nix-daemon[837]: reaped child process 1833, status = succeeded5692worker1 # [ 145.357728] nix-daemon[837]: accepted connection from pid 1848, user nix-grpc-daemon (trusted)5693worker1 # [ 145.376112] nix-daemon[837]: reaped child process 1851, status = succeeded5694lb # [ 145.485805] niks3-server[1003]: 2026/09/20 08:18:55 INFO Received uploads request method=POST path=/api/pending_closures5695worker1 # [ 145.399312] nix-grpc-daemon[1740]: time=2026-09-20T08:18:54.948Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5696worker1 # [ 145.400938] nix-grpc-daemon[1740]: time=2026-09-20T08:18:54.948Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5697lb # [ 145.530776] niks3-server[1003]: 2026/09/20 08:18:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5698worker1 # [ 145.441558] nix-grpc-daemon[1740]: time=2026-09-20T08:18:54.991Z level=INFO msg="Uploading 1 narinfos"5699lb # [ 145.541203] niks3-server[1003]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5700lb # [ 145.554120] niks3-server[1003]: 2026/09/20 08:18:55 INFO Signed narinfos id=49 count=15701lb # [ 145.559723] niks3-server[1003]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5702lb # [ 145.563518] niks3-server[1003]: 2026/09/20 08:18:55 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5703lb # [ 145.567297] niks3-server[1003]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5704lb # [ 145.571428] niks3-server[1003]: 2026/09/20 08:18:55 INFO Completed upload id=495705worker1 # [ 145.473628] nix-grpc-daemon[1740]: time=2026-09-20T08:18:55.024Z level=INFO msg="Upload complete. (342ms)"5706lb # [ 145.574190] niks3-server[1003]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5707worker1 # [ 145.486051] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15708worker2 # [ 145.492331] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:55Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15709worker2 # [ 145.500583] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:55Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05710worker1 # [ 145.501244] nix-daemon[837]: reaped child process 1831, status = succeeded5711worker1 # [ 145.530829] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085712worker1 # [ 145.546431] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:556085713worker1 # [ 145.561282] nix-grpc-daemon[1740]: time=2026-09-20T08:18:55.112Z level=INFO msg="All 1 paths already cached"5714worker1 # [ 145.570148] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:556085715worker1 # [ 145.584267] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5716worker1 # [ 145.786231] nix-daemon[837]: accepted connection from pid 1855, user nix-grpc-daemon (trusted)5717worker1 # [ 145.804083] nix-daemon[837]: reaped child process 1858, status = succeeded5718worker1 # [ 145.981885] nix-daemon[837]: accepted connection from pid 1860, user nix-grpc-daemon (trusted)5719worker1 # [ 145.999321] nix-daemon[837]: reaped child process 1863, status = succeeded5720lb # [ 146.108120] niks3-server[1003]: 2026/09/20 08:18:55 INFO Received uploads request method=POST path=/api/pending_closures5721worker1 # [ 146.020220] nix-grpc-daemon[1740]: time=2026-09-20T08:18:55.570Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5722worker1 # [ 146.021705] nix-grpc-daemon[1740]: time=2026-09-20T08:18:55.571Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5723lb # [ 146.141119] niks3-server[1003]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5724worker1 # [ 146.056473] nix-grpc-daemon[1740]: time=2026-09-20T08:18:55.607Z level=INFO msg="Uploading 1 narinfos"5725lb # [ 146.156446] niks3-server[1003]: 2026/09/20 08:18:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5726lb # [ 146.167442] niks3-server[1003]: 2026/09/20 08:18:55 INFO Signed narinfos id=50 count=15727lb # [ 146.175914] niks3-server[1003]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5728worker1 # [ 146.083612] nix-grpc-daemon[1740]: time=2026-09-20T08:18:55.634Z level=INFO msg="Upload complete. (483ms)"5729lb # [ 146.181808] niks3-server[1003]: 2026/09/20 08:18:55 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5730lb # [ 146.186133] niks3-server[1003]: 2026/09/20 08:18:55 INFO Completed upload id=505731lb # [ 146.188904] niks3-server[1003]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5732worker1 # [ 146.092137] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=0 paths=1 nar_bytes_in=6245733worker1 # [ 146.100771] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085734worker1 # [ 146.112706] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5735worker1 # [ 146.115302] nix-daemon[837]: reaped child process 1853, status = succeeded5736worker1 # [ 146.125969] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5737worker1 # [ 147.772837] nix-daemon[837]: reaped child process 1867, status = succeeded5738worker1 # [ 147.941784] nix-daemon[837]: accepted connection from pid 1882, user nix-grpc-daemon (trusted)5739worker1 # [ 147.958959] nix-daemon[837]: reaped child process 1885, status = succeeded5740lb # [ 148.069131] niks3-server[1003]: 2026/09/20 08:18:57 INFO Received uploads request method=POST path=/api/pending_closures5741worker1 # [ 147.983240] nix-grpc-daemon[1740]: time=2026-09-20T08:18:57.531Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5742worker1 # [ 147.984839] nix-grpc-daemon[1740]: time=2026-09-20T08:18:57.531Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5743lb # [ 148.099702] niks3-server[1003]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5744lb # [ 148.121047] niks3-server[1003]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5745lb # [ 148.130416] niks3-server[1003]: 2026/09/20 08:18:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5746worker1 # [ 148.038811] nix-grpc-daemon[1740]: time=2026-09-20T08:18:57.589Z level=INFO msg="Uploading 1 narinfos"5747lb # [ 148.139429] niks3-server[1003]: 2026/09/20 08:18:57 INFO Signed narinfos id=51 count=15748lb # [ 148.145228] niks3-server[1003]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5749lb # [ 148.155831] niks3-server[1003]: 2026/09/20 08:18:57 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5750lb # [ 148.163408] niks3-server[1003]: 2026/09/20 08:18:57 INFO Completed upload id=515751worker1 # [ 148.065496] nix-grpc-daemon[1740]: time=2026-09-20T08:18:57.616Z level=INFO msg="Upload complete. (325ms)"5752lb # [ 148.166509] niks3-server[1003]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5753worker2 # [ 148.081543] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:57Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15754worker1 # [ 148.077193] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15755worker2 # [ 148.097653] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:57Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05756worker1 # [ 148.097068] nix-daemon[837]: reaped child process 1865, status = succeeded5757worker1 # [ 148.132470] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085758worker1 # [ 148.147931] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:556085759worker1 # [ 148.161734] nix-grpc-daemon[1740]: time=2026-09-20T08:18:57.712Z level=INFO msg="All 1 paths already cached"5760worker1 # [ 148.171287] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:556085761worker1 # [ 148.185934] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5762worker1 # [ 148.386098] nix-daemon[837]: accepted connection from pid 1889, user nix-grpc-daemon (trusted)5763worker1 # [ 148.403566] nix-daemon[837]: reaped child process 1892, status = succeeded5764worker1 # [ 148.578937] nix-daemon[837]: accepted connection from pid 1894, user nix-grpc-daemon (trusted)5765worker1 # [ 148.596502] nix-daemon[837]: reaped child process 1897, status = succeeded5766lb # [ 148.704809] niks3-server[1003]: 2026/09/20 08:18:58 INFO Received uploads request method=POST path=/api/pending_closures5767worker1 # [ 148.616708] nix-grpc-daemon[1740]: time=2026-09-20T08:18:58.167Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5768worker1 # [ 148.618212] nix-grpc-daemon[1740]: time=2026-09-20T08:18:58.167Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5769lb # [ 148.733935] niks3-server[1003]: 2026/09/20 08:18:58 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5770worker1 # [ 148.648560] nix-grpc-daemon[1740]: time=2026-09-20T08:18:58.199Z level=INFO msg="Uploading 1 narinfos"5771lb # [ 148.750932] niks3-server[1003]: 2026/09/20 08:18:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5772lb # [ 148.762146] niks3-server[1003]: 2026/09/20 08:18:58 INFO Signed narinfos id=52 count=15773lb # [ 148.773973] niks3-server[1003]: 2026/09/20 08:18:58 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5774worker1 # [ 148.681933] nix-grpc-daemon[1740]: time=2026-09-20T08:18:58.232Z level=INFO msg="Upload complete. (479ms)"5775lb # [ 148.779731] niks3-server[1003]: 2026/09/20 08:18:58 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5776lb # [ 148.785918] niks3-server[1003]: 2026/09/20 08:18:58 INFO Completed upload id=525777worker1 # [ 148.688935] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=0 paths=1 nar_bytes_in=6245778lb # [ 148.789936] niks3-server[1003]: 2026/09/20 08:18:58 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5779worker1 # [ 148.703245] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085780worker1 # [ 148.709919] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5781worker1 # [ 148.714727] nix-daemon[837]: reaped child process 1887, status = succeeded5782worker1 # [ 148.728798] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5783worker1 # [ 149.549337] nix-daemon[837]: reaped child process 1901, status = succeeded5784worker1 # [ 149.709602] nix-daemon[837]: accepted connection from pid 1916, user nix-grpc-daemon (trusted)5785worker1 # [ 149.727280] nix-daemon[837]: reaped child process 1919, status = succeeded5786lb # [ 149.841634] niks3-server[1003]: 2026/09/20 08:18:59 INFO Received uploads request method=POST path=/api/pending_closures5787worker1 # [ 149.755458] nix-grpc-daemon[1740]: time=2026-09-20T08:18:59.304Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5788worker1 # [ 149.757259] nix-grpc-daemon[1740]: time=2026-09-20T08:18:59.304Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5789lb # [ 149.873590] niks3-server[1003]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5790lb # [ 149.890586] niks3-server[1003]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5791lb # [ 149.901989] niks3-server[1003]: 2026/09/20 08:18:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5792worker1 # [ 149.810041] nix-grpc-daemon[1740]: time=2026-09-20T08:18:59.360Z level=INFO msg="Uploading 1 narinfos"5793lb # [ 149.907713] niks3-server[1003]: 2026/09/20 08:18:59 INFO Signed narinfos id=53 count=15794lb # [ 149.913155] niks3-server[1003]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5795lb # [ 149.923131] niks3-server[1003]: 2026/09/20 08:18:59 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5796lb # [ 149.929366] niks3-server[1003]: 2026/09/20 08:18:59 INFO Completed upload id=535797worker1 # [ 149.831188] nix-grpc-daemon[1740]: time=2026-09-20T08:18:59.381Z level=INFO msg="Upload complete. (293ms)"5798lb # [ 149.932054] niks3-server[1003]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5799worker1 # [ 149.843549] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15800worker2 # [ 149.850424] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:59Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15801worker2 # [ 149.858918] nix-grpc-daemon[1316]: ts=2026-09-20T08:18:59Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05802worker1 # [ 149.860314] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085803worker1 # [ 149.868812] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:556085804worker1 # [ 149.874119] nix-daemon[837]: reaped child process 1899, status = succeeded5805worker1 # [ 149.876841] nix-grpc-daemon[1740]: time=2026-09-20T08:18:59.427Z level=INFO msg="All 1 paths already cached"5806worker1 # [ 149.884361] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:556085807worker1 # [ 149.894897] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5808worker1 # [ 150.083991] nix-daemon[837]: accepted connection from pid 1923, user nix-grpc-daemon (trusted)5809worker1 # [ 150.101980] nix-daemon[837]: reaped child process 1926, status = succeeded5810worker1 # [ 150.282568] nix-daemon[837]: accepted connection from pid 1928, user nix-grpc-daemon (trusted)5811worker1 # [ 150.300495] nix-daemon[837]: reaped child process 1931, status = succeeded5812lb # [ 150.409150] niks3-server[1003]: 2026/09/20 08:18:59 INFO Received uploads request method=POST path=/api/pending_closures5813worker1 # [ 150.320618] nix-grpc-daemon[1740]: time=2026-09-20T08:18:59.871Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5814worker1 # [ 150.322123] nix-grpc-daemon[1740]: time=2026-09-20T08:18:59.871Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5815lb # [ 150.435165] niks3-server[1003]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5816worker1 # [ 150.350594] nix-grpc-daemon[1740]: time=2026-09-20T08:18:59.901Z level=INFO msg="Uploading 1 narinfos"5817lb # [ 150.452268] niks3-server[1003]: 2026/09/20 08:18:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5818lb # [ 150.462469] niks3-server[1003]: 2026/09/20 08:18:59 INFO Signed narinfos id=54 count=15819lb # [ 150.467817] niks3-server[1003]: 2026/09/20 08:19:00 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5820lb # [ 150.475916] niks3-server[1003]: 2026/09/20 08:19:00 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5821worker1 # [ 150.382675] nix-grpc-daemon[1740]: time=2026-09-20T08:18:59.933Z level=INFO msg="Upload complete. (475ms)"5822lb # [ 150.480646] niks3-server[1003]: 2026/09/20 08:19:00 INFO Completed upload id=545823lb # [ 150.483534] niks3-server[1003]: 2026/09/20 08:19:00 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5824worker1 # [ 150.392230] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=0 paths=1 nar_bytes_in=6245825worker1 # [ 150.403180] nix-grpc-daemon[1684]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085826worker1 # [ 150.409433] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5827worker1 # [ 150.414221] nix-daemon[837]: reaped child process 1921, status = succeeded5828worker1 # [ 150.428001] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5829worker1 # [ 151.863929] nix-daemon[837]: reaped child process 1935, status = succeeded5830worker1 # [ 152.031896] nix-daemon[837]: accepted connection from pid 1950, user nix-grpc-daemon (trusted)5831worker1 # [ 152.048909] nix-daemon[837]: reaped child process 1953, status = succeeded5832lb # [ 152.161185] niks3-server[1003]: 2026/09/20 08:19:01 INFO Received uploads request method=POST path=/api/pending_closures5833worker1 # [ 152.074233] nix-grpc-daemon[1740]: time=2026-09-20T08:19:01.623Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5834worker1 # [ 152.075716] nix-grpc-daemon[1740]: time=2026-09-20T08:19:01.623Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5835lb # [ 152.200572] niks3-server[1003]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5836worker1 # [ 152.113258] nix-grpc-daemon[1740]: time=2026-09-20T08:19:01.663Z level=INFO msg="Uploading 1 narinfos"5837lb # [ 152.214754] niks3-server[1003]: 2026/09/20 08:19:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5838lb # [ 152.225281] niks3-server[1003]: 2026/09/20 08:19:01 INFO Signed narinfos id=55 count=15839lb # [ 152.227653] niks3-server[1003]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5840lb # [ 152.233098] niks3-server[1003]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5841worker1 # [ 152.143193] nix-grpc-daemon[1740]: time=2026-09-20T08:19:01.693Z level=INFO msg="Upload complete. (305ms)"5842lb # [ 152.241469] niks3-server[1003]: 2026/09/20 08:19:01 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5843lb # [ 152.245817] niks3-server[1003]: 2026/09/20 08:19:01 INFO Completed upload id=555844lb # [ 152.249560] niks3-server[1003]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5845worker2 # [ 152.158876] nix-grpc-daemon[1316]: ts=2026-09-20T08:19:01Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15846worker1 # [ 152.157028] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=15847worker2 # [ 152.171748] nix-grpc-daemon[1316]: ts=2026-09-20T08:19:01Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05848worker1 # [ 152.173219] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085849worker1 # [ 152.180826] nix-daemon[837]: reaped child process 1933, status = succeeded5850worker1 # [ 152.185075] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:556085851worker1 # [ 152.195612] nix-grpc-daemon[1740]: time=2026-09-20T08:19:01.746Z level=INFO msg="All 2 paths already cached"5852worker1 # [ 152.203218] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:556085853worker1 # [ 152.215419] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5854worker1 # [ 152.404731] nix-daemon[837]: accepted connection from pid 1957, user nix-grpc-daemon (trusted)5855worker1 # [ 152.425646] nix-daemon[837]: reaped child process 1960, status = succeeded5856worker1 # [ 152.598818] nix-daemon[837]: accepted connection from pid 1962, user nix-grpc-daemon (trusted)5857worker1 # [ 152.618376] nix-daemon[837]: reaped child process 1965, status = succeeded5858lb # [ 152.727477] niks3-server[1003]: 2026/09/20 08:19:02 INFO Received uploads request method=POST path=/api/pending_closures5859worker1 # [ 152.640708] nix-grpc-daemon[1740]: time=2026-09-20T08:19:02.191Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5860worker1 # [ 152.642177] nix-grpc-daemon[1740]: time=2026-09-20T08:19:02.191Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5861lb # [ 152.758495] niks3-server[1003]: 2026/09/20 08:19:02 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5862worker1 # [ 152.671794] nix-grpc-daemon[1740]: time=2026-09-20T08:19:02.222Z level=INFO msg="Uploading 1 narinfos"5863lb # [ 152.774386] niks3-server[1003]: 2026/09/20 08:19:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5864lb # [ 152.785065] niks3-server[1003]: 2026/09/20 08:19:02 INFO Signed narinfos id=56 count=15865worker1 # [ 152.695507] nix-grpc-daemon[1740]: time=2026-09-20T08:19:02.246Z level=INFO msg="Upload complete. (467ms)"5866lb # [ 152.793658] niks3-server[1003]: 2026/09/20 08:19:02 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5867lb # [ 152.797824] niks3-server[1003]: 2026/09/20 08:19:02 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5868lb # [ 152.802507] niks3-server[1003]: 2026/09/20 08:19:02 INFO Completed upload id=565869worker1 # [ 152.704244] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=0 paths=1 nar_bytes_in=7525870lb # [ 152.804805] niks3-server[1003]: 2026/09/20 08:19:02 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5871worker1 # [ 152.714071] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085872worker1 # [ 152.719726] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5873worker1 # [ 152.724435] nix-daemon[837]: reaped child process 1955, status = succeeded5874worker1 # [ 152.736792] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5875worker1 # [ 154.158759] nix-daemon[837]: reaped child process 1969, status = succeeded5876worker1 # [ 154.316710] nix-daemon[837]: accepted connection from pid 1984, user nix-grpc-daemon (trusted)5877worker1 # [ 154.336994] nix-daemon[837]: reaped child process 1987, status = succeeded5878lb # [ 154.447092] niks3-server[1003]: 2026/09/20 08:19:03 INFO Received uploads request method=POST path=/api/pending_closures5879worker1 # [ 154.360393] nix-grpc-daemon[1740]: time=2026-09-20T08:19:03.910Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5880worker1 # [ 154.361858] nix-grpc-daemon[1740]: time=2026-09-20T08:19:03.910Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5881lb # [ 154.483182] niks3-server[1003]: 2026/09/20 08:19:04 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5882lb # [ 154.507084] niks3-server[1003]: 2026/09/20 08:19:04 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5883lb # [ 154.520163] niks3-server[1003]: 2026/09/20 08:19:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5884lb # [ 154.525100] niks3-server[1003]: 2026/09/20 08:19:04 INFO Signed narinfos id=57 count=15885worker1 # [ 154.427681] nix-grpc-daemon[1740]: time=2026-09-20T08:19:03.978Z level=INFO msg="Uploading 1 narinfos"5886lb # [ 154.529805] niks3-server[1003]: 2026/09/20 08:19:04 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5887lb # [ 154.536680] niks3-server[1003]: 2026/09/20 08:19:04 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5888lb # [ 154.544199] niks3-server[1003]: 2026/09/20 08:19:04 INFO Completed upload id=575889worker1 # [ 154.447007] nix-grpc-daemon[1740]: time=2026-09-20T08:19:03.997Z level=INFO msg="Upload complete. (301ms)"5890lb # [ 154.546868] niks3-server[1003]: 2026/09/20 08:19:04 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo5891worker2 # [ 154.460851] nix-grpc-daemon[1316]: ts=2026-09-20T08:19:04Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=15892worker1 # [ 154.461089] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=15893worker1 # [ 154.476645] nix-daemon[837]: reaped child process 1967, status = succeeded5894worker1 # [ 154.498641] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085895worker1 # [ 154.514572] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:556085896worker1 # [ 154.533019] nix-grpc-daemon[1740]: time=2026-09-20T08:19:04.083Z level=INFO msg="All 2 paths already cached"5897worker1 # [ 154.542583] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:556085898worker1 # [ 154.556185] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5899worker1 # [ 154.759292] nix-daemon[837]: accepted connection from pid 1991, user nix-grpc-daemon (trusted)5900worker1 # [ 154.777322] nix-daemon[837]: reaped child process 1994, status = succeeded5901worker1 # [ 154.955269] nix-daemon[837]: accepted connection from pid 1996, user nix-grpc-daemon (trusted)5902worker1 # [ 154.972344] nix-daemon[837]: reaped child process 1999, status = succeeded5903lb # [ 155.084603] niks3-server[1003]: 2026/09/20 08:19:04 INFO Received uploads request method=POST path=/api/pending_closures5904worker1 # [ 154.998588] nix-grpc-daemon[1740]: time=2026-09-20T08:19:04.549Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5905worker1 # [ 155.000134] nix-grpc-daemon[1740]: time=2026-09-20T08:19:04.549Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"5906lb # [ 155.115383] niks3-server[1003]: 2026/09/20 08:19:04 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst5907worker1 # [ 155.030800] nix-grpc-daemon[1740]: time=2026-09-20T08:19:04.581Z level=INFO msg="Uploading 1 narinfos"5908lb # [ 155.132236] niks3-server[1003]: 2026/09/20 08:19:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5909lb # [ 155.143968] niks3-server[1003]: 2026/09/20 08:19:04 INFO Signed narinfos id=58 count=15910worker1 # [ 155.057263] nix-grpc-daemon[1740]: time=2026-09-20T08:19:04.608Z level=INFO msg="Upload complete. (484ms)"5911lb # [ 155.148957] niks3-server[1003]: 2026/09/20 08:19:04 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls5912lb # [ 155.160800] niks3-server[1003]: 2026/09/20 08:19:04 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5913lb # [ 155.166628] niks3-server[1003]: 2026/09/20 08:19:04 INFO Completed upload id=585914lb # [ 155.169870] niks3-server[1003]: 2026/09/20 08:19:04 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo5915worker1 # [ 155.063036] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=0 paths=1 nar_bytes_in=7525916worker1 # [ 155.077301] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085917worker1 # [ 155.083737] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5918worker1 # [ 155.088791] nix-daemon[837]: reaped child process 1989, status = succeeded5919worker1 # [ 155.101309] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5920worker1 # [ 155.947880] nix-daemon[837]: reaped child process 2003, status = succeeded5921worker1 # [ 156.127698] nix-daemon[837]: accepted connection from pid 2018, user nix-grpc-daemon (trusted)5922worker1 # [ 156.146036] nix-daemon[837]: reaped child process 2021, status = succeeded5923lb # [ 156.257733] niks3-server[1003]: 2026/09/20 08:19:05 INFO Received uploads request method=POST path=/api/pending_closures5924worker1 # [ 156.170274] nix-grpc-daemon[1740]: time=2026-09-20T08:19:05.719Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5925worker1 # [ 156.171838] nix-grpc-daemon[1740]: time=2026-09-20T08:19:05.719Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"5926lb # [ 156.294089] niks3-server[1003]: 2026/09/20 08:19:05 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv5927lb # [ 156.307243] niks3-server[1003]: 2026/09/20 08:19:05 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst5928lb # [ 156.317785] niks3-server[1003]: 2026/09/20 08:19:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5929worker1 # [ 156.225725] nix-grpc-daemon[1740]: time=2026-09-20T08:19:05.776Z level=INFO msg="Uploading 1 narinfos"5930lb # [ 156.324795] niks3-server[1003]: 2026/09/20 08:19:05 INFO Signed narinfos id=59 count=15931lb # [ 156.330788] niks3-server[1003]: 2026/09/20 08:19:05 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls5932lb # [ 156.339689] niks3-server[1003]: 2026/09/20 08:19:05 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5933lb # [ 156.346753] niks3-server[1003]: 2026/09/20 08:19:05 INFO Completed upload id=595934worker1 # [ 156.249441] nix-grpc-daemon[1740]: time=2026-09-20T08:19:05.800Z level=INFO msg="Upload complete. (338ms)"5935lb # [ 156.349872] niks3-server[1003]: 2026/09/20 08:19:05 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo5936worker2 # [ 156.265033] nix-grpc-daemon[1316]: ts=2026-09-20T08:19:05Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=15937worker1 # [ 156.263408] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=15938worker1 # [ 156.280462] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085939worker1 # [ 156.286761] nix-daemon[837]: reaped child process 2001, status = succeeded5940worker1 # [ 156.294533] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:556085941worker1 # [ 156.307354] nix-grpc-daemon[1740]: time=2026-09-20T08:19:05.858Z level=INFO msg="All 2 paths already cached"5942worker1 # [ 156.316003] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:556085943worker1 # [ 156.329030] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5944worker1 # [ 156.522819] nix-daemon[837]: accepted connection from pid 2025, user nix-grpc-daemon (trusted)5945worker1 # [ 156.542264] nix-daemon[837]: reaped child process 2028, status = succeeded5946worker1 # [ 156.718479] nix-daemon[837]: accepted connection from pid 2030, user nix-grpc-daemon (trusted)5947worker1 # [ 156.735428] nix-daemon[837]: reaped child process 2033, status = succeeded5948lb # [ 156.844616] niks3-server[1003]: 2026/09/20 08:19:06 INFO Received uploads request method=POST path=/api/pending_closures5949worker1 # [ 156.755859] nix-grpc-daemon[1740]: time=2026-09-20T08:19:06.306Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5950worker1 # [ 156.757545] nix-grpc-daemon[1740]: time=2026-09-20T08:19:06.306Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"5951lb # [ 156.871170] niks3-server[1003]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst5952worker1 # [ 156.786641] nix-grpc-daemon[1740]: time=2026-09-20T08:19:06.337Z level=INFO msg="Uploading 1 narinfos"5953lb # [ 156.888173] niks3-server[1003]: 2026/09/20 08:19:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign5954lb # [ 156.898673] niks3-server[1003]: 2026/09/20 08:19:06 INFO Signed narinfos id=60 count=15955lb # [ 156.903442] niks3-server[1003]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls5956lb # [ 156.911196] niks3-server[1003]: 2026/09/20 08:19:06 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete5957lb # [ 156.916385] niks3-server[1003]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo5958lb # [ 156.920969] niks3-server[1003]: 2026/09/20 08:19:06 INFO Completed upload id=605959worker1 # [ 156.823242] nix-grpc-daemon[1740]: time=2026-09-20T08:19:06.374Z level=INFO msg="Upload complete. (479ms)"5960worker1 # [ 156.832167] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=0 paths=1 nar_bytes_in=7525961worker1 # [ 156.843766] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:556085962worker1 # [ 156.850833] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5963worker1 # [ 156.855314] nix-daemon[837]: reaped child process 2023, status = succeeded5964worker1 # [ 156.866051] nix-daemon[837]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5965worker1 # [ 157.710362] nix-daemon[837]: reaped child process 2037, status = succeeded5966worker1 # [ 157.896534] nix-daemon[837]: accepted connection from pid 2052, user nix-grpc-daemon (trusted)5967worker1 # [ 157.916578] nix-daemon[837]: reaped child process 2055, status = succeeded5968lb # [ 158.027840] niks3-server[1003]: 2026/09/20 08:19:07 INFO Received uploads request method=POST path=/api/pending_closures5969worker1 # [ 157.944160] nix-grpc-daemon[1740]: time=2026-09-20T08:19:07.491Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5970worker1 # [ 157.945874] nix-grpc-daemon[1740]: time=2026-09-20T08:19:07.491Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"5971lb # [ 158.065113] niks3-server[1003]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv5972lb # [ 158.076140] niks3-server[1003]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst5973lb # [ 158.086935] niks3-server[1003]: 2026/09/20 08:19:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign5974worker1 # [ 157.994450] nix-grpc-daemon[1740]: time=2026-09-20T08:19:07.544Z level=INFO msg="Uploading 1 narinfos"5975lb # [ 158.094717] niks3-server[1003]: 2026/09/20 08:19:07 INFO Signed narinfos id=61 count=15976lb # [ 158.099730] niks3-server[1003]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls5977lb # [ 158.106553] niks3-server[1003]: 2026/09/20 08:19:07 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete5978worker1 # [ 158.016335] nix-grpc-daemon[1740]: time=2026-09-20T08:19:07.567Z level=INFO msg="Upload complete. (337ms)"5979lb # [ 158.114335] niks3-server[1003]: 2026/09/20 08:19:07 INFO Completed upload id=615980lb # [ 158.117484] niks3-server[1003]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo5981worker1 # [ 158.028996] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55608 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=15982worker1 # [ 158.042860] nix-daemon[837]: reaped child process 2035, status = succeeded5983client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.77 seconds)5984worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'5985worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.09 seconds)5986client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&15987worker1 # [ 158.474759] nix-grpc-daemon[1684]: ts=2026-09-20T08:19:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:556085988worker2 # [ 158.498535] nix-grpc-daemon[1316]: ts=2026-09-20T08:19:08Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=05989lb # [ 161.829524] envoy[911]: conn peer=[2001:db8:1::1]:35336 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26901 tx=10737 ms=204525990client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 120.31 seconds)5991(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 141.17 seconds)5992subtest: low disk drains a worker and builds go to the other5993worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill5994worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds)5995worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'5996worker1 # [ 280.190288] nix-grpc-daemon[1684]: ts=2026-09-20T08:21:09Z level=info event=unhealthy reason=min_free5997worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds)5998client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&25999client # don't know how to build these paths:6000client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6001worker2 # [ 281.059999] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:479726002worker2 # [ 281.081517] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:10Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06003worker2 # [ 281.088422] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:10Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16004worker2 # [ 281.129778] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479726005worker2 # [ 281.159310] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479726006client # copying 1 paths to 'lb:50051'...6007client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6008worker2 # [ 281.177294] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479726009worker2 # [ 281.201810] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)6010worker2 # [ 281.429938] nix-daemon[840]: accepted connection from pid 1598, user nix-grpc-daemon (trusted)6011worker2 # [ 281.452787] nix-daemon[840]: reaped child process 1601, status = succeeded6012worker2 # [ 281.632863] nix-daemon[840]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)6013worker2 # [ 281.650932] nix-daemon[840]: reaped child process 1606, status = succeeded6014lb # [ 281.758497] niks3-server[1003]: 2026/09/20 08:21:11 INFO Received uploads request method=POST path=/api/pending_closures6015worker2 # [ 281.679087] nix-grpc-daemon[1388]: time=2026-09-20T08:21:11.229Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6016worker2 # [ 281.680997] nix-grpc-daemon[1388]: time=2026-09-20T08:21:11.229Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6017lb # [ 281.801390] niks3-server[1003]: 2026/09/20 08:21:11 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6018lb # [ 281.817787] niks3-server[1003]: 2026/09/20 08:21:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6019worker2 # [ 281.732293] nix-grpc-daemon[1388]: time=2026-09-20T08:21:11.283Z level=INFO msg="Uploading 1 narinfos"6020lb # [ 281.829491] niks3-server[1003]: 2026/09/20 08:21:11 INFO Signed narinfos id=62 count=16021lb # [ 281.838335] niks3-server[1003]: 2026/09/20 08:21:11 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6022lb # [ 281.847542] envoy[911]: conn peer=[2001:db8:1::1]:51304 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=727 tx=456 ms=1200406023lb # [ 281.859824] niks3-server[1003]: 2026/09/20 08:21:11 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6024lb # [ 281.865575] niks3-server[1003]: 2026/09/20 08:21:11 INFO Completed upload id=626025worker2 # [ 281.772762] nix-grpc-daemon[1388]: time=2026-09-20T08:21:11.324Z level=INFO msg="Upload complete. (550ms)"6026lb # [ 281.868703] niks3-server[1003]: 2026/09/20 08:21:11 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6027worker2 # [ 281.784427] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=0 paths=1 nar_bytes_in=5126028worker2 # [ 281.800358] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479726029worker2 # [ 281.810118] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)6030worker2 # [ 281.818384] nix-daemon[840]: reaped child process 1596, status = succeeded6031client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6032client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6033worker2 # [ 281.832127] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)6034client # farm-a> LOG-farm-a-drain6035worker2 # [ 283.077476] nix-daemon[840]: reaped child process 1610, status = succeeded6036worker2 # [ 283.263530] nix-daemon[840]: accepted connection from pid 1625, user nix-grpc-daemon (trusted)6037worker2 # [ 283.281086] nix-daemon[840]: reaped child process 1628, status = succeeded6038lb # [ 283.389883] niks3-server[1003]: 2026/09/20 08:21:12 INFO Received uploads request method=POST path=/api/pending_closures6039worker2 # [ 283.307220] nix-grpc-daemon[1388]: time=2026-09-20T08:21:12.856Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6040worker2 # [ 283.309212] nix-grpc-daemon[1388]: time=2026-09-20T08:21:12.856Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6041lb # [ 283.425416] niks3-server[1003]: 2026/09/20 08:21:12 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6042lb # [ 283.439771] niks3-server[1003]: 2026/09/20 08:21:12 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6043lb # [ 283.452370] niks3-server[1003]: 2026/09/20 08:21:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6044worker2 # [ 283.364949] nix-grpc-daemon[1388]: time=2026-09-20T08:21:12.915Z level=INFO msg="Uploading 1 narinfos"6045lb # [ 283.461467] niks3-server[1003]: 2026/09/20 08:21:13 INFO Signed narinfos id=63 count=16046lb # [ 283.463923] niks3-server[1003]: 2026/09/20 08:21:13 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6047lb # [ 283.472886] niks3-server[1003]: 2026/09/20 08:21:13 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6048lb # [ 283.480433] niks3-server[1003]: 2026/09/20 08:21:13 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6049lb # [ 283.485957] niks3-server[1003]: 2026/09/20 08:21:13 INFO Completed upload id=636050worker2 # [ 283.393833] nix-grpc-daemon[1388]: time=2026-09-20T08:21:12.945Z level=INFO msg="Upload complete. (346ms)"6051worker2 # [ 283.413155] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16052worker2 # [ 283.426629] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:12Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06053worker2 # [ 283.430370] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:12Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16054worker2 # [ 283.433967] nix-daemon[840]: reaped child process 1608, status = succeeded6055worker2 # [ 283.456241] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479726056worker2 # [ 283.473106] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479726057worker2 # [ 283.490156] nix-grpc-daemon[1388]: time=2026-09-20T08:21:13.041Z level=INFO msg="All 1 paths already cached"6058client # copying 1 paths to 'lb:50051'...6059worker2 # [ 283.500814] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479726060client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6061worker2 # [ 283.517907] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)6062worker2 # [ 283.722298] nix-daemon[840]: accepted connection from pid 1634, user nix-grpc-daemon (trusted)6063worker2 # [ 283.741867] nix-daemon[840]: reaped child process 1637, status = succeeded6064worker2 # [ 283.916561] nix-daemon[840]: accepted connection from pid 1639, user nix-grpc-daemon (trusted)6065worker2 # [ 283.936214] nix-daemon[840]: reaped child process 1642, status = succeeded6066lb # [ 284.039299] niks3-server[1003]: 2026/09/20 08:21:13 INFO Received uploads request method=POST path=/api/pending_closures6067worker2 # [ 283.956981] nix-grpc-daemon[1388]: time=2026-09-20T08:21:13.508Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6068worker2 # [ 283.958643] nix-grpc-daemon[1388]: time=2026-09-20T08:21:13.508Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6069lb # [ 284.073038] niks3-server[1003]: 2026/09/20 08:21:13 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6070worker2 # [ 283.990000] nix-grpc-daemon[1388]: time=2026-09-20T08:21:13.541Z level=INFO msg="Uploading 1 narinfos"6071lb # [ 284.084678] niks3-server[1003]: 2026/09/20 08:21:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6072lb # [ 284.095927] niks3-server[1003]: 2026/09/20 08:21:13 INFO Signed narinfos id=64 count=16073worker2 # [ 284.012712] nix-grpc-daemon[1388]: time=2026-09-20T08:21:13.564Z level=INFO msg="Upload complete. (477ms)"6074lb # [ 284.100374] niks3-server[1003]: 2026/09/20 08:21:13 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6075lb # [ 284.109762] niks3-server[1003]: 2026/09/20 08:21:13 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6076lb # [ 284.114066] niks3-server[1003]: 2026/09/20 08:21:13 INFO Completed upload id=646077worker2 # [ 284.020213] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=0 paths=1 nar_bytes_in=6326078lb # [ 284.116076] niks3-server[1003]: 2026/09/20 08:21:13 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6079worker2 # [ 284.031683] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479726080worker2 # [ 284.037268] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)6081worker2 # [ 284.041620] nix-daemon[840]: reaped child process 1632, status = succeeded6082client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6083worker2 # [ 284.053459] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)6084client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6085client # farm-b> LOG-farm-b-drain6086worker2 # [ 284.900543] nix-daemon[840]: reaped child process 1646, status = succeeded6087worker2 # [ 285.083522] nix-daemon[840]: accepted connection from pid 1661, user nix-grpc-daemon (trusted)6088worker2 # [ 285.101705] nix-daemon[840]: reaped child process 1664, status = succeeded6089lb # [ 285.207947] niks3-server[1003]: 2026/09/20 08:21:14 INFO Received uploads request method=POST path=/api/pending_closures6090worker2 # [ 285.125601] nix-grpc-daemon[1388]: time=2026-09-20T08:21:14.676Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6091worker2 # [ 285.127103] nix-grpc-daemon[1388]: time=2026-09-20T08:21:14.676Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6092lb # [ 285.250623] niks3-server[1003]: 2026/09/20 08:21:14 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6093worker2 # [ 285.171348] nix-grpc-daemon[1388]: time=2026-09-20T08:21:14.721Z level=INFO msg="Uploading 1 narinfos"6094lb # [ 285.263048] niks3-server[1003]: 2026/09/20 08:21:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6095lb # [ 285.275475] niks3-server[1003]: 2026/09/20 08:21:14 INFO Signed narinfos id=65 count=16096lb # [ 285.282245] niks3-server[1003]: 2026/09/20 08:21:14 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6097lb # [ 285.289519] niks3-server[1003]: 2026/09/20 08:21:14 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6098worker2 # [ 285.206842] nix-grpc-daemon[1388]: time=2026-09-20T08:21:14.758Z level=INFO msg="Upload complete. (344ms)"6099lb # [ 285.299223] niks3-server[1003]: 2026/09/20 08:21:14 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6100lb # [ 285.304137] niks3-server[1003]: 2026/09/20 08:21:14 INFO Completed upload id=656101lb # [ 285.307915] niks3-server[1003]: 2026/09/20 08:21:14 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6102worker2 # [ 285.224300] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16103worker2 # [ 285.240999] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:14Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06104worker2 # [ 285.247342] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:14Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16105worker2 # [ 285.252645] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479726106worker2 # [ 285.257743] nix-daemon[840]: reaped child process 1644, status = succeeded6107worker2 # [ 285.261324] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479726108worker2 # [ 285.272921] nix-grpc-daemon[1388]: time=2026-09-20T08:21:14.824Z level=INFO msg="All 2 paths already cached"6109client # copying 1 paths to 'lb:50051'...6110worker2 # [ 285.282326] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479726111client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6112worker2 # [ 285.298497] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)6113worker2 # [ 285.497657] nix-daemon[840]: accepted connection from pid 1670, user nix-grpc-daemon (trusted)6114worker2 # [ 285.516868] nix-daemon[840]: reaped child process 1673, status = succeeded6115worker2 # [ 285.692342] nix-daemon[840]: accepted connection from pid 1675, user nix-grpc-daemon (trusted)6116worker2 # [ 285.710493] nix-daemon[840]: reaped child process 1678, status = succeeded6117lb # [ 285.815517] niks3-server[1003]: 2026/09/20 08:21:15 INFO Received uploads request method=POST path=/api/pending_closures6118worker2 # [ 285.732759] nix-grpc-daemon[1388]: time=2026-09-20T08:21:15.283Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6119worker2 # [ 285.734267] nix-grpc-daemon[1388]: time=2026-09-20T08:21:15.283Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6120lb # [ 285.845277] niks3-server[1003]: 2026/09/20 08:21:15 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6121lb # [ 285.860572] niks3-server[1003]: 2026/09/20 08:21:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6122worker2 # [ 285.774090] nix-grpc-daemon[1388]: time=2026-09-20T08:21:15.325Z level=INFO msg="Uploading 1 narinfos"6123lb # [ 285.872571] niks3-server[1003]: 2026/09/20 08:21:15 INFO Signed narinfos id=66 count=16124lb # [ 285.880871] niks3-server[1003]: 2026/09/20 08:21:15 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6125lb # [ 285.891424] niks3-server[1003]: 2026/09/20 08:21:15 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6126lb # [ 285.897005] niks3-server[1003]: 2026/09/20 08:21:15 INFO Completed upload id=666127worker2 # [ 285.804752] nix-grpc-daemon[1388]: time=2026-09-20T08:21:15.356Z level=INFO msg="Upload complete. (492ms)"6128lb # [ 285.899952] niks3-server[1003]: 2026/09/20 08:21:15 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6129worker2 # [ 285.815571] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=0 paths=1 nar_bytes_in=7606130worker2 # [ 285.829370] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479726131worker2 # [ 285.836527] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)6132worker2 # [ 285.841671] nix-daemon[840]: reaped child process 1668, status = succeeded6133client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6134client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6135worker2 # [ 285.855624] nix-daemon[840]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)6136client # farm-top> LOG-farm-top-drain6137worker2 # [ 287.299955] nix-daemon[840]: reaped child process 1682, status = succeeded6138worker2 # [ 287.485854] nix-daemon[840]: accepted connection from pid 1697, user nix-grpc-daemon (trusted)6139worker2 # [ 287.508512] nix-daemon[840]: reaped child process 1700, status = succeeded6140lb # [ 287.613579] niks3-server[1003]: 2026/09/20 08:21:17 INFO Received uploads request method=POST path=/api/pending_closures6141worker2 # [ 287.532473] nix-grpc-daemon[1388]: time=2026-09-20T08:21:17.081Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6142worker2 # [ 287.534036] nix-grpc-daemon[1388]: time=2026-09-20T08:21:17.081Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6143lb # [ 287.657927] niks3-server[1003]: 2026/09/20 08:21:17 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6144worker2 # [ 287.579935] nix-grpc-daemon[1388]: time=2026-09-20T08:21:17.130Z level=INFO msg="Uploading 1 narinfos"6145lb # [ 287.672571] niks3-server[1003]: 2026/09/20 08:21:17 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6146lb # [ 287.682448] niks3-server[1003]: 2026/09/20 08:21:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6147lb # [ 287.689671] niks3-server[1003]: 2026/09/20 08:21:17 INFO Signed narinfos id=67 count=16148worker2 # [ 287.603917] nix-grpc-daemon[1388]: time=2026-09-20T08:21:17.155Z level=INFO msg="Upload complete. (336ms)"6149lb # [ 287.696673] niks3-server[1003]: 2026/09/20 08:21:17 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6150lb # [ 287.702628] niks3-server[1003]: 2026/09/20 08:21:17 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6151lb # [ 287.707671] niks3-server[1003]: 2026/09/20 08:21:17 INFO Completed upload id=676152worker2 # [ 287.612850] nix-grpc-daemon[1316]: ts=2026-09-20T08:21:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47972 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16153lb # [ 287.710059] niks3-server[1003]: 2026/09/20 08:21:17 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6154worker2 # [ 287.630921] nix-daemon[840]: reaped child process 1680, status = succeeded6155client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&2, in 6.87 seconds)6156client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath6157client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath, in 0.24 seconds)6158worker1: must succeed: rm /nix/.rw-store/fill6159worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6160worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6161worker1 # [ 288.201384] nix-grpc-daemon[1684]: ts=2026-09-20T08:21:17Z level=info event=healthy reason=min_free6162worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 0.05 seconds)6163(finished: subtest: low disk drains a worker and builds go to the other, in 9.67 seconds)6164(finished: run the VM test script, in 289.17 seconds)6165test script finished in 289.47s6166cleanup6167kill QemuMachine (pid 49)6168client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6169kill QemuMachine (pid 50)6170lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6171kill QemuMachine (pid 52)6172worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6173kill QemuMachine (pid 51)6174worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6175(finished: cleanup, in 1.20 seconds)6176additionally exposed symbols:6177 client, lb, worker1, worker2,6178 vlan1,6179 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh