vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #224
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.01 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13worker1 # Formatting '/build/vm-state-worker1/tmp.sCgR2GUWVd', fmt=raw size=107374182414worker1: QEMU running (pid 51)15client # Disk image does not exist, creating the virtualisation disk image...16lb # Disk image does not exist, creating the virtualisation disk image...17worker2 # Disk image does not exist, creating the virtualisation disk image...18client # Formatting '/build/vm-state-client/tmp.AiIQc9JhO4', fmt=raw size=107374182419worker1 # mke2fs 1.47.4 (6-Mar-2025)20lb # Formatting '/build/vm-state-lb/tmp.IBEqL2Tf7s', fmt=raw size=107374182421worker2 # Formatting '/build/vm-state-worker2/tmp.nxBZae3DTz', fmt=raw size=107374182422client # mke2fs 1.47.4 (6-Mar-2025)23worker1 # Discarding device blocks: 0/262144 done24lb # mke2fs 1.47.4 (6-Mar-2025)25worker2 # mke2fs 1.47.4 (6-Mar-2025)26worker2: QEMU running (pid 52)27lb: QEMU running (pid 50)28worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes29client # Discarding device blocks: 0/262144 done30lb # Discarding device blocks: 0/262144 done31worker2 # Discarding device blocks: 0/262144 done32lb # Creating filesystem with 262144 4k blocks and 65536 inodes33worker1 # Filesystem UUID: 28e0f280-7b06-4bf7-8535-ea289976294234client: QEMU running (pid 48)35lb # Filesystem UUID: 5c4101e1-1dc3-48cc-9b76-c64a90af2d7636worker1 # Superblock backups stored on blocks:37worker1 # 32768, 98304, 163840, 22937638client # Creating filesystem with 262144 4k blocks and 65536 inodes39worker1 # 40lb # Superblock backups stored on blocks:41client # Filesystem UUID: 7e7ea7cf-f10c-4ced-882a-1c7c19f090d942(finished: start all VMs, in 0.67 seconds)43worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes44worker1 # Allocating group tables: 0/8 done45client: waiting for unit network-addresses-eth1.service46worker2 # Filesystem UUID: f19773ca-8ccc-4792-9bd1-71cf5dba37ed47worker2 # Superblock backups stored on blocks:48worker2 # 32768, 98304, 163840, 22937649client: waiting for the VM to finish booting50worker1 # Writing inode tables: 0/8 done51worker1 # Creating journal (8192 blocks): done52client # Superblock backups stored on blocks:53worker1 # Writing superblocks and filesystem accounting information: 0/8 done54lb # 32768, 98304, 163840, 22937655client # 32768, 98304, 163840, 22937656client # 57lb # 58lb # Allocating group tables: 0/8 done59client # Allocating group tables: 0/8 done60lb # Writing inode tables: 0/8 done61worker1 # 62client # Writing inode tables: 0/8 done63client # Creating journal (8192 blocks): done64worker1 # Virtualisation disk image created.65worker2 # 66lb # Creating journal (8192 blocks): done67client # Writing superblocks and filesystem accounting information: 0/8 done68worker2 # Allocating group tables: 0/8 done69lb # Writing superblocks and filesystem accounting information: 0/8 done70worker2 # Writing inode tables: 0/8 done71lb # 72worker2 # Creating journal (8192 blocks): done73lb # Virtualisation disk image created.74worker2 # Writing superblocks and filesystem accounting information: 0/8 done75client # 76worker2 # 77client # Virtualisation disk image created.78worker2 # Virtualisation disk image created.79client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681client # [ 0.000000] KASLR enabled82client # [ 0.000000] random: crng init done83client # [ 0.000000] Machine model: linux,dummy-virt84client # [ 0.000000] efi: UEFI not found.85client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88client # [ 0.000000] Zone ranges:89client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90client # [ 0.000000] DMA32 empty91client # [ 0.000000] Normal empty92client # [ 0.000000] Device empty93client # [ 0.000000] Movable zone start for each node94client # [ 0.000000] Early memory node ranges95client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098client # [ 0.000000] psci: probing for conduit method from DT.99client # [ 0.000000] psci: PSCIv1.3 detected in firmware.100client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101client # [ 0.000000] psci: Trusted OS migration not required102client # [ 0.000000] psci: SMC Calling Convention v1.1103client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105client # [ 0.000000] Detected PIPT I-cache on CPU0106client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107client # [ 0.000000] CPU features: detected: GICv3 CPU interface108client # [ 0.000000] CPU features: detected: Spectre-v4109client # [ 0.000000] CPU features: detected: Spectre-BHB110client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112client # [ 0.000000] alternatives: applying boot alternatives113client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test/init regInfo=/nix/store/pmvqrw562x9yyxd3dvmdxxgfykn65j59-closure-info/registration console=ttyAMA0,115200n8 console=tty0114client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/pmvqrw562x9yyxd3dvmdxxgfykn65j59-closure-info/registration", will be passed to user space.115client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]118client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)119client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB120client # [ 0.000000] software IO TLB: area num 1.121worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026122worker1 # [ 0.000000] KASLR enabled123client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB124worker1 # [ 0.000000] random: crng init done125worker1 # [ 0.000000] Machine model: linux,dummy-virt126client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)127worker1 # [ 0.000000] efi: UEFI not found.128client # [ 0.000000] Fallback order for Node 0: 0129worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT130client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216131client # [ 0.000000] Policy zone: DMA132worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]133client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off134worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]135worker1 # [ 0.000000] Zone ranges:136client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1137worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]138lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]139client # [ 0.000000] allocated 3145728 bytes of page_ext140worker1 # [ 0.000000] DMA32 empty141client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages142worker1 # [ 0.000000] Normal empty143worker1 # [ 0.000000] Device empty144client # [ 0.000000] ftrace: allocated 294 pages with 4 groups145worker1 # [ 0.000000] Movable zone start for each node146lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026147client # [ 0.000000] rcu: Hierarchical RCU implementation.148worker1 # [ 0.000000] Early memory node ranges149lb # [ 0.000000] KASLR enabled150client # [ 0.000000] rcu: RCU event tracing is enabled.151lb # [ 0.000000] random: crng init done152worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]153lb # [ 0.000000] Machine model: linux,dummy-virt154client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.155lb # [ 0.000000] efi: UEFI not found.156worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]157client # [ 0.000000] Trampoline variant of Tasks RCU enabled.158worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000159lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT160client # [ 0.000000] Rude variant of Tasks RCU enabled.161worker1 # [ 0.000000] psci: probing for conduit method from DT.162client # [ 0.000000] Tracing variant of Tasks RCU enabled.163lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]164worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.165client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.166lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]167worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs168lb # [ 0.000000] Zone ranges:169client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1170worker1 # [ 0.000000] psci: Trusted OS migration not required171lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]172worker1 # [ 0.000000] psci: SMC Calling Convention v1.1173lb # [ 0.000000] DMA32 empty174client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.175lb # [ 0.000000] Normal empty176lb # [ 0.000000] Device empty177worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)178lb # [ 0.000000] Movable zone start for each node179client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.180lb # [ 0.000000] Early memory node ranges181worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296182worker1 # [ 0.000000] Detected PIPT I-cache on CPU0183lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]184client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.185client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0186worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)187lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]188client # [ 0.000000] GICv3: 256 SPIs implemented189worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface190lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000191client # [ 0.000000] GICv3: 0 Extended SPIs implemented192worker1 # [ 0.000000] CPU features: detected: Spectre-v4193lb # [ 0.000000] psci: probing for conduit method from DT.194client # [ 0.000000] Root IRQ handler: gic_handle_irq195worker1 # [ 0.000000] CPU features: detected: Spectre-BHB196lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.197client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI198lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs199worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38200worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]201client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0202lb # [ 0.000000] psci: Trusted OS migration not required203worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23204client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000205lb # [ 0.000000] psci: SMC Calling Convention v1.1206worker1 # [ 0.000000] alternatives: applying boot alternatives207client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]208worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026209lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)210worker2 # [ 0.000000] KASLR enabled211worker2 # [ 0.000000] random: crng init done212client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)213lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296214worker2 # [ 0.000000] Machine model: linux,dummy-virt215lb # [ 0.000000] Detected PIPT I-cache on CPU0216worker2 # [ 0.000000] efi: UEFI not found.217client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)218worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT219lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)220client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000221lb # [ 0.000000] CPU features: detected: GICv3 CPU interface222worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]223worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1mkwdgwcymjjiqwpvs4ar1vasmmkgm5n-nixos-system-worker1-test/init regInfo=/nix/store/fcv9f7jsq88241xzrmimra15crix7gaq-closure-info/registration console=ttyAMA0,115200n8 console=tty0224client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000225lb # [ 0.000000] CPU features: detected: Spectre-v4226worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]227lb # [ 0.000000] CPU features: detected: Spectre-BHB228worker2 # [ 0.000000] Zone ranges:229client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.230lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38231worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]232worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/fcv9f7jsq88241xzrmimra15crix7gaq-closure-info/registration", will be passed to user space.233worker2 # [ 0.000000] DMA32 empty234client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns235lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23236worker2 # [ 0.000000] Normal empty237worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes238worker2 # [ 0.000000] Device empty239client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).240lb # [ 0.000000] alternatives: applying boot alternatives241worker2 # [ 0.000000] Movable zone start for each node242worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)243worker2 # [ 0.000000] Early memory node ranges244client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns245worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)246worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]247client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns248worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB249worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]250client # [ 0.000057] arm-pv: using stolen time PV251worker1 # [ 0.000000] software IO TLB: area num 1.252worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000253worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB254worker2 # [ 0.000000] psci: probing for conduit method from DT.255worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.256client # [ 0.001093] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)257lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0258worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)259client # [ 0.001324] Console: colour dummy device 80x25260worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs261client # [ 0.001333] printk: legacy console [tty0] enabled262worker1 # [ 0.000000] Fallback order for Node 0: 0263worker2 # [ 0.000000] psci: Trusted OS migration not required264lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.265worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216266worker2 # [ 0.000000] psci: SMC Calling Convention v1.1267worker1 # [ 0.000000] Policy zone: DMA268client # [ 0.001537] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)269lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes270client # [ 0.001544] pid_max: default: 32768 minimum: 301271worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)272worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off273lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)274client # [ 0.001620] LSM: initializing lsm=capability,landlock,yama,bpf,ima275worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296276worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1277client # [ 0.001840] landlock: Up and running.278lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)279worker2 # [ 0.000000] Detected PIPT I-cache on CPU0280worker1 # [ 0.000000] allocated 3145728 bytes of page_ext281client # [ 0.001843] Yama: becoming mindful.282client # [ 0.002595] LSM support for eBPF active283worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages284lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB285worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)286lb # [ 0.000000] software IO TLB: area num 1.287worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups288client # [ 0.002816] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)289worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface290worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.291lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB292worker2 # [ 0.000000] CPU features: detected: Spectre-v4293worker1 # [ 0.000000] rcu: RCU event tracing is enabled.294client # [ 0.002852] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)295worker2 # [ 0.000000] CPU features: detected: Spectre-BHB296lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)297client # [ 0.004050] cacheinfo: Unable to detect cache hierarchy for CPU 0298worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.299lb # [ 0.000000] Fallback order for Node 0: 0300worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38301client # [ 0.004897] rcu: Hierarchical SRCU implementation.302worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.303worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23304lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216305client # [ 0.004903] rcu: Max phase no-delay instances is 1000.306worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.307worker2 # [ 0.000000] alternatives: applying boot alternatives308worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.309client # [ 0.006236] fsl-mc MSI: its@8080000 domain created310lb # [ 0.000000] Policy zone: DMA311client # [ 0.006332] EFI services will not be available.312worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.313client # [ 0.006430] smp: Bringing up secondary CPUs ...314lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off315client # [ 0.006440] smp: Brought up 1 node, 1 CPU316worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1317lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1318client # [ 0.006443] SMP: Total of 1 processors activated.319lb # [ 0.000000] allocated 3145728 bytes of page_ext320client # [ 0.006455] CPU: All CPU(s) started at EL1321worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.322lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages323client # [ 0.006468] CPU features: detected: Branch Target Identification324worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qg68w562d3yaxrj7cqcnj76qmy692bcv-nixos-system-worker2-test/init regInfo=/nix/store/vb974qbr7pkj3k67wn303xgh99r1jy98-closure-info/registration console=ttyAMA0,115200n8 console=tty0325lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups326worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.327client # [ 0.006474] CPU features: detected: ARMv8.4 Translation Table Level328lb # [ 0.000000] rcu: Hierarchical RCU implementation.329lb # [ 0.000000] rcu: RCU event tracing is enabled.330worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.331client # [ 0.006477] CPU features: detected: Instruction cache invalidation not required for I/D coherence332worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/vb974qbr7pkj3k67wn303xgh99r1jy98-closure-info/registration", will be passed to user space.333worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0334lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.335worker1 # [ 0.000000] GICv3: 256 SPIs implemented336client # [ 0.006481] CPU features: detected: Data cache clean to the PoU not required for I/D coherence337worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes338lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.339worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented340lb # [ 0.000000] Rude variant of Tasks RCU enabled.341client # [ 0.006484] CPU features: detected: Common not Private translations342worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)343worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq344lb # [ 0.000000] Tracing variant of Tasks RCU enabled.345client # [ 0.006487] CPU features: detected: CRC32 instructions346worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI347worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)348worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0349lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.350client # [ 0.006490] CPU features: detected: Data cache clean to Point of Deep Persistence351worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB352worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000353lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1354client # [ 0.006494] CPU features: detected: Data cache clean to Point of Persistence355worker2 # [ 0.000000] software IO TLB: area num 1.356worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]357client # [ 0.006498] CPU features: detected: Data independent timing control (DIT)358worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB359lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.360client # [ 0.006501] CPU features: detected: E0PD361worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)362worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)363client # [ 0.006503] CPU features: detected: Enhanced Counter Virtualization364lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.365worker2 # [ 0.000000] Fallback order for Node 0: 0366worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)367client # [ 0.006506] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)368worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216369lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.370worker2 # [ 0.000000] Policy zone: DMA371worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000372client # [ 0.006510] CPU features: detected: Enhanced Virtualization Traps373lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0374worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off375client # [ 0.006512] CPU features: detected: Fine Grained Traps376lb # [ 0.000000] GICv3: 256 SPIs implemented377worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000378lb # [ 0.000000] GICv3: 0 Extended SPIs implemented379worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1380worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.381client # [ 0.006516] CPU features: detected: Generic authentication (architected QARMA5 algorithm)382lb # [ 0.000000] Root IRQ handler: gic_handle_irq383worker2 # [ 0.000000] allocated 3145728 bytes of page_ext384client # [ 0.006522] CPU features: detected: RCpc load-acquire (LDAPR)385lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI386worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages387worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns388lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0389client # [ 0.006525] CPU features: detected: LSE atomic instructions390worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups391worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).392client # [ 0.006528] CPU features: detected: Privileged Access Never393lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000394worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.395client # [ 0.006531] CPU features: detected: PMUv3396lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]397worker2 # [ 0.000000] rcu: RCU event tracing is enabled.398client # [ 0.006534] CPU features: detected: RAS Extension Support399worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns400worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.401lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)402client # [ 0.006536] CPU features: detected: RASv1p1 Extension Support403worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.404worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns405client # [ 0.006539] CPU features: detected: Random Number Generator406worker1 # [ 0.000038] arm-pv: using stolen time PV407worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.408lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)409client # [ 0.006542] CPU features: detected: Speculation barrier (SB)410worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.411lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000412worker1 # [ 0.000558] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)413client # [ 0.006545] CPU features: detected: Stage-2 Force Write-Back414worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.415worker1 # [ 0.000755] Console: colour dummy device 80x25416lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000417client # [ 0.006548] CPU features: detected: TLB range maintenance instructions418worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1419worker1 # [ 0.000765] printk: legacy console [tty0] enabled420lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.421client # [ 0.006552] CPU features: detected: Speculative Store Bypassing Safe (SSBS)422worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.423client # [ 0.006605] alternatives: applying system-wide alternatives424worker1 # [ 0.001001] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)425lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns426worker1 # [ 0.001008] pid_max: default: 32768 minimum: 301427client # [ 0.009991] CPU features: detected: BBM Level 2 without TLB conflict abort428worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.429lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).430worker1 # [ 0.001145] LSM: initializing lsm=capability,landlock,yama,bpf,ima431worker1 # [ 0.001350] landlock: Up and running.432worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.433worker1 # [ 0.001353] Yama: becoming mindful.434lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns435client # [ 0.010256] Memory: 1406504K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)436worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0437worker1 # [ 0.001981] LSM support for eBPF active438client # [ 0.010761] devtmpfs: initialized439worker2 # [ 0.000000] GICv3: 256 SPIs implemented440lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns441worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented442worker1 # [ 0.002147] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)443client # [ 0.012763] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)444lb # [ 0.000038] arm-pv: using stolen time PV445worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq446worker1 # [ 0.002190] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)447worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI448client # [ 0.012790] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).449lb # [ 0.000776] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)450worker1 # [ 0.003365] cacheinfo: Unable to detect cache hierarchy for CPU 0451worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0452client # [ 0.012999] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL453lb # [ 0.000970] Console: colour dummy device 80x25454worker1 # [ 0.004162] rcu: Hierarchical SRCU implementation.455worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000456client # [ 0.013004] 0 pages in range for non-PLT usage457lb # [ 0.000980] printk: legacy console [tty0] enabled458worker1 # [ 0.004168] rcu: Max phase no-delay instances is 1000.459worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]460client # [ 0.013005] 508288 pages in range for PLT usage461worker1 # [ 0.005506] fsl-mc MSI: its@8080000 domain created462client # [ 0.013118] pinctrl core: initialized pinctrl subsystem463lb # [ 0.001214] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)464worker1 # [ 0.005600] EFI services will not be available.465worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)466client # [ 0.013946] DMI not present or invalid.467lb # [ 0.001222] pid_max: default: 32768 minimum: 301468worker1 # [ 0.005690] smp: Bringing up secondary CPUs ...469client # [ 0.018846] NET: Registered PF_NETLINK/PF_ROUTE protocol family470worker1 # [ 0.005700] smp: Brought up 1 node, 1 CPU471lb # [ 0.001319] LSM: initializing lsm=capability,landlock,yama,bpf,ima472worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)473lb # [ 0.001472] landlock: Up and running.474worker1 # [ 0.005703] SMP: Total of 1 processors activated.475client # [ 0.021892] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations476lb # [ 0.001475] Yama: becoming mindful.477worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000478worker1 # [ 0.005711] CPU: All CPU(s) started at EL1479lb # [ 0.002071] LSM support for eBPF active480client # [ 0.022152] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations481worker1 # [ 0.005724] CPU features: detected: Branch Target Identification482worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000483lb # [ 0.002240] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)484client # [ 0.022407] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations485worker1 # [ 0.005729] CPU features: detected: ARMv8.4 Translation Table Level486worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.487lb # [ 0.002281] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)488client # [ 0.022454] audit: initializing netlink subsys (disabled)489worker1 # [ 0.005732] CPU features: detected: Instruction cache invalidation not required for I/D coherence490worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns491lb # [ 0.003693] cacheinfo: Unable to detect cache hierarchy for CPU 0492client # [ 0.023134] thermal_sys: Registered thermal governor 'fair_share'493lb # [ 0.004554] rcu: Hierarchical SRCU implementation.494worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).495client # [ 0.023137] thermal_sys: Registered thermal governor 'bang_bang'496worker1 # [ 0.005736] CPU features: detected: Data cache clean to the PoU not required for I/D coherence497lb # [ 0.004559] rcu: Max phase no-delay instances is 1000.498client # [ 0.023141] thermal_sys: Registered thermal governor 'step_wise'499worker1 # [ 0.005740] CPU features: detected: Common not Private translations500lb # [ 0.005882] fsl-mc MSI: its@8080000 domain created501worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns502client # [ 0.023148] thermal_sys: Registered thermal governor 'user_space'503lb # [ 0.005992] EFI services will not be available.504worker1 # [ 0.005743] CPU features: detected: CRC32 instructions505lb # [ 0.006083] smp: Bringing up secondary CPUs ...506client # [ 0.023150] thermal_sys: Registered thermal governor 'power_allocator'507worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns508worker1 # [ 0.005746] CPU features: detected: Data cache clean to Point of Deep Persistence509lb # [ 0.006092] smp: Brought up 1 node, 1 CPU510worker1 # [ 0.005750] CPU features: detected: Data cache clean to Point of Persistence511lb # [ 0.006095] SMP: Total of 1 processors activated.512client # [ 0.023179] audit: type=2000 audit(0.020:1): state=initialized audit_enabled=0 res=1513worker2 # [ 0.000035] arm-pv: using stolen time PV514client # [ 0.023191] cpuidle: using governor ladder515lb # [ 0.006102] CPU: All CPU(s) started at EL1516worker2 # [ 0.000471] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)517worker1 # [ 0.005753] CPU features: detected: Data independent timing control (DIT)518client # [ 0.023196] cpuidle: using governor menu519lb # [ 0.006114] CPU features: detected: Branch Target Identification520worker1 # [ 0.005756] CPU features: detected: E0PD521client # [ 0.023422] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.522worker1 # [ 0.005758] CPU features: detected: Enhanced Counter Virtualization523lb # [ 0.006118] CPU features: detected: ARMv8.4 Translation Table Level524worker2 # [ 0.000699] Console: colour dummy device 80x25525client # [ 0.023441] ASID allocator initialised with 65536 entries526worker1 # [ 0.005762] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)527client # [ 0.024807] Serial: AMBA PL011 UART driver528worker2 # [ 0.000708] printk: legacy console [tty0] enabled529lb # [ 0.006121] CPU features: detected: Instruction cache invalidation not required for I/D coherence530worker1 # [ 0.005765] CPU features: detected: Enhanced Virtualization Traps531client # [ 0.030307] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1532lb # [ 0.006125] CPU features: detected: Data cache clean to the PoU not required for I/D coherence533worker2 # [ 0.000921] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)534worker1 # [ 0.005768] CPU features: detected: Fine Grained Traps535client # [ 0.030533] printk: console [ttyAMA0] enabled536worker2 # [ 0.000928] pid_max: default: 32768 minimum: 301537lb # [ 0.006129] CPU features: detected: Common not Private translations538worker1 # [ 0.005772] CPU features: detected: Generic authentication (architected QARMA5 algorithm)539lb # [ 0.006132] CPU features: detected: CRC32 instructions540worker2 # [ 0.001020] LSM: initializing lsm=capability,landlock,yama,bpf,ima541worker1 # [ 0.005777] CPU features: detected: RCpc load-acquire (LDAPR)542worker2 # [ 0.001159] landlock: Up and running.543worker2 # [ 0.001162] Yama: becoming mindful.544worker1 # [ 0.005780] CPU features: detected: LSE atomic instructions545lb # [ 0.006135] CPU features: detected: Data cache clean to Point of Deep Persistence546worker2 # [ 0.001633] LSM support for eBPF active547lb # [ 0.006139] CPU features: detected: Data cache clean to Point of Persistence548worker1 # [ 0.005783] CPU features: detected: Privileged Access Never549worker1 # [ 0.005785] CPU features: detected: PMUv3550worker2 # [ 0.001778] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)551lb # [ 0.006143] CPU features: detected: Data independent timing control (DIT)552worker1 # [ 0.005788] CPU features: detected: RAS Extension Support553lb # [ 0.006145] CPU features: detected: E0PD554worker2 # [ 0.001817] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)555worker1 # [ 0.005791] CPU features: detected: RASv1p1 Extension Support556lb # [ 0.006148] CPU features: detected: Enhanced Counter Virtualization557worker2 # [ 0.003241] cacheinfo: Unable to detect cache hierarchy for CPU 0558worker1 # [ 0.005794] CPU features: detected: Random Number Generator559lb # [ 0.006151] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)560worker2 # [ 0.004106] rcu: Hierarchical SRCU implementation.561worker1 # [ 0.005796] CPU features: detected: Speculation barrier (SB)562worker2 # [ 0.004111] rcu: Max phase no-delay instances is 1000.563lb # [ 0.006154] CPU features: detected: Enhanced Virtualization Traps564worker1 # [ 0.005799] CPU features: detected: Stage-2 Force Write-Back565worker2 # [ 0.005397] fsl-mc MSI: its@8080000 domain created566lb # [ 0.006157] CPU features: detected: Fine Grained Traps567worker2 # [ 0.005490] EFI services will not be available.568worker1 # [ 0.005802] CPU features: detected: TLB range maintenance instructions569worker2 # [ 0.005578] smp: Bringing up secondary CPUs ...570lb # [ 0.006161] CPU features: detected: Generic authentication (architected QARMA5 algorithm)571worker1 # [ 0.005807] CPU features: detected: Speculative Store Bypassing Safe (SSBS)572worker2 # [ 0.005588] smp: Brought up 1 node, 1 CPU573lb # [ 0.006166] CPU features: detected: RCpc load-acquire (LDAPR)574worker2 # [ 0.005592] SMP: Total of 1 processors activated.575worker1 # [ 0.005849] alternatives: applying system-wide alternatives576lb # [ 0.006169] CPU features: detected: LSE atomic instructions577worker2 # [ 0.005597] CPU: All CPU(s) started at EL1578client # [ 0.153511] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages579worker1 # [ 0.009200] CPU features: detected: BBM Level 2 without TLB conflict abort580lb # [ 0.006172] CPU features: detected: Privileged Access Never581worker2 # [ 0.005610] CPU features: detected: Branch Target Identification582client # [ 0.153539] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page583lb # [ 0.006174] CPU features: detected: PMUv3584worker2 # [ 0.005615] CPU features: detected: ARMv8.4 Translation Table Level585lb # [ 0.006177] CPU features: detected: RAS Extension Support586client # [ 0.153544] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages587worker1 # [ 0.009471] Memory: 1406544K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)588lb # [ 0.006180] CPU features: detected: RASv1p1 Extension Support589client # [ 0.153549] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page590worker2 # [ 0.005618] CPU features: detected: Instruction cache invalidation not required for I/D coherence591worker1 # [ 0.009943] devtmpfs: initialized592lb # [ 0.006183] CPU features: detected: Random Number Generator593client # [ 0.153553] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages594worker1 # [ 0.011883] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)595worker2 # [ 0.005622] CPU features: detected: Data cache clean to the PoU not required for I/D coherence596lb # [ 0.006185] CPU features: detected: Speculation barrier (SB)597client # [ 0.153557] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page598worker2 # [ 0.005626] CPU features: detected: Common not Private translations599lb # [ 0.006188] CPU features: detected: Stage-2 Force Write-Back600worker1 # [ 0.011915] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).601client # [ 0.153562] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages602worker2 # [ 0.005629] CPU features: detected: CRC32 instructions603lb # [ 0.006191] CPU features: detected: TLB range maintenance instructions604worker1 # [ 0.012108] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL605client # [ 0.153566] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page606worker1 # [ 0.012113] 0 pages in range for non-PLT usage607worker2 # [ 0.005632] CPU features: detected: Data cache clean to Point of Deep Persistence608lb # [ 0.006196] CPU features: detected: Speculative Store Bypassing Safe (SSBS)609worker1 # [ 0.012114] 508288 pages in range for PLT usage610lb # [ 0.006242] alternatives: applying system-wide alternatives611worker2 # [ 0.005636] CPU features: detected: Data cache clean to Point of Persistence612worker1 # [ 0.012246] pinctrl core: initialized pinctrl subsystem613worker1 # [ 0.013062] DMI not present or invalid.614lb # [ 0.009513] CPU features: detected: BBM Level 2 without TLB conflict abort615worker2 # [ 0.005639] CPU features: detected: Data independent timing control (DIT)616worker2 # [ 0.005642] CPU features: detected: E0PD617worker1 # [ 0.016662] NET: Registered PF_NETLINK/PF_ROUTE protocol family618client # [ 0.161541] fbcon: Taking over console619worker2 # [ 0.005645] CPU features: detected: Enhanced Counter Virtualization620client # [ 0.161561] ACPI: Interpreter disabled.621worker1 # [ 0.019216] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations622lb # [ 0.009783] Memory: 1406576K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)623lb # [ 0.010257] devtmpfs: initialized624worker2 # [ 0.005648] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)625worker1 # [ 0.019413] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations626worker2 # [ 0.005651] CPU features: detected: Enhanced Virtualization Traps627lb # [ 0.012214] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)628worker1 # [ 0.019632] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations629worker2 # [ 0.005654] CPU features: detected: Fine Grained Traps630worker1 # [ 0.019662] audit: initializing netlink subsys (disabled)631lb # [ 0.012243] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).632worker2 # [ 0.005658] CPU features: detected: Generic authentication (architected QARMA5 algorithm)633lb # [ 0.012484] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL634worker1 # [ 0.020751] thermal_sys: Registered thermal governor 'fair_share'635worker2 # [ 0.005664] CPU features: detected: RCpc load-acquire (LDAPR)636lb # [ 0.012490] 0 pages in range for non-PLT usage637worker1 # [ 0.020754] thermal_sys: Registered thermal governor 'bang_bang'638lb # [ 0.012491] 508288 pages in range for PLT usage639worker2 # [ 0.005667] CPU features: detected: LSE atomic instructions640worker1 # [ 0.020758] thermal_sys: Registered thermal governor 'step_wise'641lb # [ 0.012619] pinctrl core: initialized pinctrl subsystem642worker2 # [ 0.005670] CPU features: detected: Privileged Access Never643lb # [ 0.013448] DMI not present or invalid.644worker2 # [ 0.005673] CPU features: detected: PMUv3645worker1 # [ 0.020763] thermal_sys: Registered thermal governor 'user_space'646lb # [ 0.017611] NET: Registered PF_NETLINK/PF_ROUTE protocol family647worker2 # [ 0.005675] CPU features: detected: RAS Extension Support648client # [ 0.169258] iommu: Default domain type: Translated649worker1 # [ 0.020766] thermal_sys: Registered thermal governor 'power_allocator'650worker2 # [ 0.005678] CPU features: detected: RASv1p1 Extension Support651lb # [ 0.020100] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations652client # [ 0.169272] iommu: DMA domain TLB invalidation policy: strict mode653worker1 # [ 0.020798] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1654worker2 # [ 0.005681] CPU features: detected: Random Number Generator655lb # [ 0.020314] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations656worker1 # [ 0.020808] cpuidle: using governor ladder657worker2 # [ 0.005683] CPU features: detected: Speculation barrier (SB)658client # [ 0.171019] SCSI subsystem initialized659worker1 # [ 0.020814] cpuidle: using governor menu660lb # [ 0.020530] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations661worker2 # [ 0.005686] CPU features: detected: Stage-2 Force Write-Back662worker1 # [ 0.021081] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.663lb # [ 0.020562] audit: initializing netlink subsys (disabled)664client # [ 0.171723] usbcore: registered new interface driver usbfs665worker2 # [ 0.005689] CPU features: detected: TLB range maintenance instructions666worker1 # [ 0.021101] ASID allocator initialised with 65536 entries667client # [ 0.171756] usbcore: registered new interface driver hub668worker1 # [ 0.022408] Serial: AMBA PL011 UART driver669lb # [ 0.021178] thermal_sys: Registered thermal governor 'fair_share'670worker2 # [ 0.005695] CPU features: detected: Speculative Store Bypassing Safe (SSBS)671client # [ 0.171773] usbcore: registered new device driver usb672lb # [ 0.021180] thermal_sys: Registered thermal governor 'bang_bang'673worker2 # [ 0.005741] alternatives: applying system-wide alternatives674client # [ 0.172088] pps_core: LinuxPPS API ver. 1 registered675worker1 # [ 0.028317] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1676lb # [ 0.021184] thermal_sys: Registered thermal governor 'step_wise'677worker2 # [ 0.009064] CPU features: detected: BBM Level 2 without TLB conflict abort678client # [ 0.172097] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>679lb # [ 0.021189] thermal_sys: Registered thermal governor 'user_space'680worker1 # [ 0.028472] printk: console [ttyAMA0] enabled681client # [ 0.172107] PTP clock support registered682client # [ 0.172158] EDAC MC: Ver: 3.0.0683lb # [ 0.021191] thermal_sys: Registered thermal governor 'power_allocator'684worker2 # [ 0.009300] Memory: 1406504K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)685worker2 # [ 0.009834] devtmpfs: initialized686client # [ 0.177077] scmi_core: SCMI protocol bus registered687lb # [ 0.021218] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1688worker2 # [ 0.011814] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)689lb # [ 0.021229] cpuidle: using governor ladder690client # [ 0.178130] FPGA manager framework691lb # [ 0.021234] cpuidle: using governor menu692client # [ 0.179210] vgaarb: loaded693worker2 # [ 0.011839] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).694lb # [ 0.021430] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.695worker2 # [ 0.012095] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL696client # [ 0.179947] clocksource: Switched to clocksource arch_sys_counter697worker2 # [ 0.012100] 0 pages in range for non-PLT usage698lb # [ 0.021446] ASID allocator initialised with 65536 entries699lb # [ 0.022729] Serial: AMBA PL011 UART driver700worker2 # [ 0.012101] 508288 pages in range for PLT usage701worker2 # [ 0.012241] pinctrl core: initialized pinctrl subsystem702lb # [ 0.028239] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1703worker2 # [ 0.013104] DMI not present or invalid.704worker2 # [ 0.016733] NET: Registered PF_NETLINK/PF_ROUTE protocol family705worker2 # [ 0.019195] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations706worker1 # [ 0.151809] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages707worker2 # [ 0.019423] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations708worker1 # [ 0.151836] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page709worker2 # [ 0.019647] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations710worker1 # [ 0.151841] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages711worker2 # [ 0.019687] audit: initializing netlink subsys (disabled)712worker1 # [ 0.151846] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page713client # [ 0.186381] VFS: Disk quotas dquot_6.6.0714worker2 # [ 0.020414] thermal_sys: Registered thermal governor 'fair_share'715worker1 # [ 0.151851] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages716client # [ 0.186450] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)717worker2 # [ 0.020416] thermal_sys: Registered thermal governor 'bang_bang'718worker1 # [ 0.151855] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page719client # [ 0.188233] netfs: FS-Cache loaded720worker2 # [ 0.020421] thermal_sys: Registered thermal governor 'step_wise'721client # [ 0.188388] pnp: PnP ACPI: disabled722worker1 # [ 0.151860] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages723worker2 # [ 0.020426] thermal_sys: Registered thermal governor 'user_space'724worker1 # [ 0.151864] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page725worker2 # [ 0.020430] thermal_sys: Registered thermal governor 'power_allocator'726lb # [ 0.028390] printk: console [ttyAMA0] enabled727worker2 # [ 0.020461] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1728worker2 # [ 0.020470] cpuidle: using governor ladder729worker1 # [ 0.159849] fbcon: Taking over console730lb # [ 0.152530] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages731worker2 # [ 0.020476] cpuidle: using governor menu732worker1 # [ 0.159870] ACPI: Interpreter disabled.733lb # [ 0.152554] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page734worker2 # [ 0.020694] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.735worker2 # [ 0.020714] ASID allocator initialised with 65536 entries736lb # [ 0.152560] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages737worker2 # [ 0.021966] Serial: AMBA PL011 UART driver738lb # [ 0.152564] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page739worker2 # [ 0.027474] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1740lb # [ 0.152568] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages741worker2 # [ 0.027673] printk: console [ttyAMA0] enabled742lb # [ 0.152573] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page743client # [ 0.192359] NET: Registered PF_INET protocol family744lb # [ 0.152577] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages745client # [ 0.192731] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)746lb # [ 0.152581] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page747lb # [ 0.160198] fbcon: Taking over console748lb # [ 0.160217] ACPI: Interpreter disabled.749worker1 # [ 0.168330] iommu: Default domain type: Translated750lb # [ 0.162161] iommu: Default domain type: Translated751worker1 # [ 0.168345] iommu: DMA domain TLB invalidation policy: strict mode752worker1 # [ 0.168746] SCSI subsystem initialized753lb # [ 0.162173] iommu: DMA domain TLB invalidation policy: strict mode754lb # [ 0.163869] SCSI subsystem initialized755worker1 # [ 0.170849] usbcore: registered new interface driver usbfs756worker1 # [ 0.170893] usbcore: registered new interface driver hub757worker1 # [ 0.170913] usbcore: registered new device driver usb758worker2 # [ 0.151303] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages759worker1 # [ 0.171237] pps_core: LinuxPPS API ver. 1 registered760worker2 # [ 0.151326] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page761worker2 # [ 0.151331] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages762worker1 # [ 0.171243] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>763worker1 # [ 0.171254] PTP clock support registered764worker2 # [ 0.151335] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page765worker1 # [ 0.171312] EDAC MC: Ver: 3.0.0766worker2 # [ 0.151339] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages767worker1 # [ 0.176036] scmi_core: SCMI protocol bus registered768worker2 # [ 0.151344] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page769worker2 # [ 0.151348] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages770worker1 # [ 0.177101] FPGA manager framework771worker1 # [ 0.178185] vgaarb: loaded772worker2 # [ 0.151352] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page773worker1 # [ 0.178848] clocksource: Switched to clocksource arch_sys_counter774lb # [ 0.171849] usbcore: registered new interface driver usbfs775lb # [ 0.171884] usbcore: registered new interface driver hub776worker2 # [ 0.159211] fbcon: Taking over console777worker2 # [ 0.159232] ACPI: Interpreter disabled.778lb # [ 0.171903] usbcore: registered new device driver usb779lb # [ 0.172234] pps_core: LinuxPPS API ver. 1 registered780lb # [ 0.172240] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>781lb # [ 0.172251] PTP clock support registered782lb # [ 0.172305] EDAC MC: Ver: 3.0.0783lb # [ 0.177077] scmi_core: SCMI protocol bus registered784worker1 # [ 0.185335] VFS: Disk quotas dquot_6.6.0785lb # [ 0.178117] FPGA manager framework786lb # [ 0.179124] vgaarb: loaded787worker1 # [ 0.185411] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)788worker1 # [ 0.187209] netfs: FS-Cache loaded789worker1 # [ 0.187358] pnp: PnP ACPI: disabled790lb # [ 0.179856] clocksource: Switched to clocksource arch_sys_counter791lb # [ 0.180548] VFS: Disk quotas dquot_6.6.0792worker2 # [ 0.167594] iommu: Default domain type: Translated793lb # [ 0.180583] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)794worker2 # [ 0.167608] iommu: DMA domain TLB invalidation policy: strict mode795lb # [ 0.182978] netfs: FS-Cache loaded796worker2 # [ 0.169437] SCSI subsystem initialized797lb # [ 0.183095] pnp: PnP ACPI: disabled798worker2 # [ 0.170174] usbcore: registered new interface driver usbfs799worker2 # [ 0.170208] usbcore: registered new interface driver hub800worker2 # [ 0.170227] usbcore: registered new device driver usb801worker2 # [ 0.170539] pps_core: LinuxPPS API ver. 1 registered802worker2 # [ 0.170546] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>803worker1 # [ 0.191484] NET: Registered PF_INET protocol family804worker2 # [ 0.170557] PTP clock support registered805worker2 # [ 0.170609] EDAC MC: Ver: 3.0.0806worker1 # [ 0.191792] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)807worker2 # [ 0.175337] scmi_core: SCMI protocol bus registered808worker2 # [ 0.176406] FPGA manager framework809worker2 # [ 0.177355] vgaarb: loaded810lb # [ 0.189410] NET: Registered PF_INET protocol family811worker2 # [ 0.178030] clocksource: Switched to clocksource arch_sys_counter812lb # [ 0.189731] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)813client # [ 0.225316] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)814client # [ 0.225384] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)815client # [ 0.225423] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)816worker2 # [ 0.181759] VFS: Disk quotas dquot_6.6.0817client # [ 0.225517] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)818worker2 # [ 0.181816] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)819client # [ 0.225664] TCP: Hash tables configured (established 16384 bind 16384)820client # [ 0.225770] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)821client # [ 0.225825] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)822client # [ 0.225865] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)823worker2 # [ 0.186238] netfs: FS-Cache loaded824client # [ 0.225978] NET: Registered PF_UNIX/PF_LOCAL protocol family825worker2 # [ 0.186398] pnp: PnP ACPI: disabled826client # [ 0.226003] NET: Registered PF_XDP protocol family827client # [ 0.226023] PCI: CLS 0 bytes, default 64828client # [ 0.226302] Trying to unpack rootfs image as initramfs...829worker2 # [ 0.190669] NET: Registered PF_INET protocol family830client # [ 0.241805] kvm [1]: HYP mode not available831worker2 # [ 0.190975] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832worker1 # [ 0.225469] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833worker1 # [ 0.225536] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834worker1 # [ 0.225572] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835worker1 # [ 0.225671] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836worker1 # [ 0.225816] TCP: Hash tables configured (established 16384 bind 16384)837lb # [ 0.223067] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)838worker1 # [ 0.225919] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)839lb # [ 0.223142] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)840worker1 # [ 0.225963] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)841lb # [ 0.223181] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)842worker1 # [ 0.226003] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)843lb # [ 0.223282] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)844worker1 # [ 0.226102] NET: Registered PF_UNIX/PF_LOCAL protocol family845lb # [ 0.223426] TCP: Hash tables configured (established 16384 bind 16384)846lb # [ 0.223536] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)847worker1 # [ 0.226130] NET: Registered PF_XDP protocol family848lb # [ 0.223580] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)849worker1 # [ 0.226149] PCI: CLS 0 bytes, default 64850lb # [ 0.223618] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)851lb # [ 0.223716] NET: Registered PF_UNIX/PF_LOCAL protocol family852lb # [ 0.223741] NET: Registered PF_XDP protocol family853lb # [ 0.223762] PCI: CLS 0 bytes, default 64854lb # [ 0.223976] Trying to unpack rootfs image as initramfs...855worker1 # [ 0.226446] Trying to unpack rootfs image as initramfs...856worker1 # [ 0.249953] kvm [1]: HYP mode not available857lb # [ 0.241490] kvm [1]: HYP mode not available858worker2 # [ 0.231560] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)859worker2 # [ 0.232733] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)860worker2 # [ 0.232870] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)861worker2 # [ 0.232977] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)862worker2 # [ 0.233148] TCP: Hash tables configured (established 16384 bind 16384)863worker2 # [ 0.233292] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)864worker2 # [ 0.233345] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)865worker2 # [ 0.233392] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)866worker2 # [ 0.233523] NET: Registered PF_UNIX/PF_LOCAL protocol family867worker2 # [ 0.233616] NET: Registered PF_XDP protocol family868worker2 # [ 0.233640] PCI: CLS 0 bytes, default 64869worker2 # [ 0.233980] Trying to unpack rootfs image as initramfs...870worker2 # [ 0.251828] kvm [1]: HYP mode not available871client # [ 0.435138] Initialise system trusted keyrings872client # [ 0.444018] workingset: timestamp_bits=42 max_order=19 bucket_order=0873client # [ 0.445780] squashfs: version 4.0 (2009/01/31) Phillip Lougher874client # [ 0.446573] 9p: Installing v9fs 9p2000 file system support875client # [ 0.467326] Key type asymmetric registered876client # [ 0.467360] Asymmetric key parser 'x509' registered877client # [ 0.467463] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878lb # [ 0.434880] Initialise system trusted keyrings879lb # [ 0.435677] workingset: timestamp_bits=42 max_order=19 bucket_order=0880client # [ 0.476045] io scheduler mq-deadline registered881lb # [ 0.437246] squashfs: version 4.0 (2009/01/31) Phillip Lougher882client # [ 0.476074] io scheduler kyber registered883lb # [ 0.438052] 9p: Installing v9fs 9p2000 file system support884worker1 # [ 0.455459] Initialise system trusted keyrings885worker1 # [ 0.456247] workingset: timestamp_bits=42 max_order=19 bucket_order=0886worker1 # [ 0.457754] squashfs: version 4.0 (2009/01/31) Phillip Lougher887worker1 # [ 0.458575] 9p: Installing v9fs 9p2000 file system support888client # [ 0.488184] pl061_gpio 9030000.pl061: PL061 GPIO chip registered889client # [ 0.488940] ledtrig-cpu: registered to indicate activity on CPUs890client # [ 0.489357] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:891client # [ 0.489377] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000892worker2 # [ 0.446224] Initialise system trusted keyrings893client # [ 0.489389] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000894worker2 # [ 0.447125] workingset: timestamp_bits=42 max_order=19 bucket_order=0895client # [ 0.489398] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000896lb # [ 0.462126] Key type asymmetric registered897worker2 # [ 0.448561] squashfs: version 4.0 (2009/01/31) Phillip Lougher898lb # [ 0.462173] Asymmetric key parser 'x509' registered899client # [ 0.489437] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits900lb # [ 0.462281] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)901client # [ 0.489465] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]902lb # [ 0.464504] io scheduler mq-deadline registered903lb # [ 0.464514] io scheduler kyber registered904client # [ 0.489562] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00905client # [ 0.489573] pci_bus 0000:00: root bus resource [bus 00-ff]906client # [ 0.489580] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]907client # [ 0.489585] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]908client # [ 0.489590] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]909client # [ 0.489688] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint910client # [ 0.490153] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint911client # [ 0.490349] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]912client # [ 0.490366] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]913client # [ 0.490395] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]914client # [ 0.490412] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]915client # [ 0.490885] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint916client # [ 0.491074] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]917client # [ 0.491090] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]918worker2 # [ 0.454113] 9p: Installing v9fs 9p2000 file system support919client # [ 0.491122] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]920client # [ 0.491581] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint921client # [ 0.491766] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]922client # [ 0.491782] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]923client # [ 0.491812] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]924worker1 # [ 0.487547] Key type asymmetric registered925client # [ 0.492309] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint926worker1 # [ 0.487586] Asymmetric key parser 'x509' registered927client # [ 0.492493] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]928worker1 # [ 0.487693] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)929client # [ 0.492509] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]930client # [ 0.492541] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]931worker1 # [ 0.489933] io scheduler mq-deadline registered932worker1 # [ 0.489946] io scheduler kyber registered933client # [ 0.493045] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint934client # [ 0.493230] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]935client # [ 0.493245] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]936client # [ 0.493275] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]937client # [ 0.493740] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint938client # [ 0.493925] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]939lb # [ 0.480106] pl061_gpio 9030000.pl061: PL061 GPIO chip registered940worker2 # [ 0.474172] Key type asymmetric registered941client # [ 0.493941] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]942lb # [ 0.480875] ledtrig-cpu: registered to indicate activity on CPUs943worker2 # [ 0.474208] Asymmetric key parser 'x509' registered944client # [ 0.493970] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]945lb # [ 0.481312] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:946worker2 # [ 0.474300] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)947client # [ 0.494470] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint948lb # [ 0.481333] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000949client # [ 0.494650] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]950client # [ 0.494665] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]951lb # [ 0.481347] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000952client # [ 0.494694] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]953lb # [ 0.481355] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000954client # [ 0.494710] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]955lb # [ 0.481378] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits956client # [ 0.495168] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint957lb # [ 0.481406] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]958client # [ 0.495351] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]959client # [ 0.495380] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]960lb # [ 0.481500] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00961lb # [ 0.481510] pci_bus 0000:00: root bus resource [bus 00-ff]962client # [ 0.495833] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint963lb # [ 0.481516] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]964lb # [ 0.481521] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]965lb # [ 0.481526] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]966lb # [ 0.481667] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint967worker2 # [ 0.482114] io scheduler mq-deadline registered968worker2 # [ 0.482144] io scheduler kyber registered969lb # [ 0.482166] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint970lb # [ 0.482355] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]971worker2 # [ 0.487719] pl061_gpio 9030000.pl061: PL061 GPIO chip registered972lb # [ 0.482372] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]973lb # [ 0.482401] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]974worker1 # [ 0.503493] pl061_gpio 9030000.pl061: PL061 GPIO chip registered975lb # [ 0.482417] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]976worker2 # [ 0.489095] ledtrig-cpu: registered to indicate activity on CPUs977worker1 # [ 0.504202] ledtrig-cpu: registered to indicate activity on CPUs978worker2 # [ 0.489488] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:979lb # [ 0.482883] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint980worker1 # [ 0.504648] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:981lb # [ 0.483067] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]982worker2 # [ 0.489508] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000983lb # [ 0.483083] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]984worker1 # [ 0.504667] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000985worker2 # [ 0.489520] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000986lb # [ 0.483112] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]987worker1 # [ 0.504689] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000988worker2 # [ 0.489528] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000989lb # [ 0.483573] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint990worker1 # [ 0.504698] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000991lb # [ 0.483757] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]992worker2 # [ 0.489560] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits993lb # [ 0.483772] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]994worker1 # [ 0.504726] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits995worker2 # [ 0.489582] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]996lb # [ 0.483801] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]997worker1 # [ 0.504750] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]998worker2 # [ 0.489662] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00999lb # [ 0.484284] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1000worker2 # [ 0.489673] pci_bus 0000:00: root bus resource [bus 00-ff]1001worker1 # [ 0.504829] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001002lb # [ 0.484474] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1003client # [ 0.544175] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1004worker1 # [ 0.504849] pci_bus 0000:00: root bus resource [bus 00-ff]1005worker2 # [ 0.489679] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1006lb # [ 0.484490] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1007client # [ 0.544235] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1008worker1 # [ 0.504855] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1009worker2 # [ 0.489684] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1010lb # [ 0.484523] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1011worker1 # [ 0.504861] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1012client # [ 0.544782] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1013worker2 # [ 0.489689] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1014lb # [ 0.484995] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1015client # [ 0.544975] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1016worker1 # [ 0.504866] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1017lb # [ 0.485187] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1018worker2 # [ 0.489793] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1019client # [ 0.545244] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1020worker1 # [ 0.504941] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1021lb # [ 0.485204] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1022client # [ 0.545528] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1023lb # [ 0.485236] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1024worker1 # [ 0.505445] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1025client # [ 0.545546] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1026worker1 # [ 0.505644] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1027lb # [ 0.485685] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1028client # [ 0.545581] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1029worker1 # [ 0.505662] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1030lb # [ 0.485884] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1031worker1 # [ 0.505693] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1032client # [ 0.546068] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1033lb # [ 0.485901] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1034client # [ 0.546255] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1035worker1 # [ 0.505710] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1036lb # [ 0.485933] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1037client # [ 0.546271] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1038worker1 # [ 0.506191] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1039lb # [ 0.486409] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1040client # [ 0.546303] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1041worker1 # [ 0.506384] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1042lb # [ 0.486592] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1043client # [ 0.546930] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1044worker1 # [ 0.506401] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1045lb # [ 0.486607] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1046client # [ 0.546943] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1047worker1 # [ 0.506432] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1048lb # [ 0.486636] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1049lb # [ 0.486652] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1050client # [ 0.546949] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1051worker1 # [ 0.506927] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1052worker1 # [ 0.507119] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1053lb # [ 0.487134] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1054client # [ 0.547001] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1055worker1 # [ 0.507136] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1056lb # [ 0.487324] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1057client # [ 0.547050] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1058worker1 # [ 0.507169] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1059lb # [ 0.487353] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1060client # [ 0.547099] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1061worker1 # [ 0.507644] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1062lb # [ 0.487806] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1063client # [ 0.547147] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1064worker1 # [ 0.507834] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1065worker1 # [ 0.507851] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1066client # [ 0.547195] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1067worker1 # [ 0.507884] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1068client # [ 0.547245] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1069worker1 # [ 0.508366] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1070client # [ 0.547294] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1071worker1 # [ 0.508552] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1072client # [ 0.547343] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1073worker2 # [ 0.510455] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1074worker1 # [ 0.508569] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1075worker2 # [ 0.510693] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1076client # [ 0.547391] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1077worker1 # [ 0.508603] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1078worker2 # [ 0.510711] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1079client # [ 0.547500] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1080worker1 # [ 0.509079] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1081worker2 # [ 0.510742] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1082worker1 # [ 0.509265] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1083client # [ 0.547548] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1084worker2 # [ 0.510758] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1085worker1 # [ 0.509282] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1086client # [ 0.547571] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1087worker2 # [ 0.511235] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1088worker1 # [ 0.509312] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1089client # [ 0.547596] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1090worker2 # [ 0.511421] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1091client # [ 0.547619] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1092worker1 # [ 0.509771] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1093worker2 # [ 0.511437] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1094worker1 # [ 0.509962] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1095client # [ 0.547645] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1096worker2 # [ 0.511467] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1097worker1 # [ 0.509979] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1098client # [ 0.547667] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1099worker2 # [ 0.511977] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1100worker1 # [ 0.510009] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1101client # [ 0.547690] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1102worker2 # [ 0.512162] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1103worker1 # [ 0.510026] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1104client # [ 0.547714] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1105worker2 # [ 0.512177] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1106client # [ 0.547737] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1107worker1 # [ 0.510533] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1108worker2 # [ 0.512206] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1109worker1 # [ 0.510727] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1110client # [ 0.547760] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1111worker2 # [ 0.512672] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1112lb # [ 0.536110] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1113client # [ 0.547786] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1114worker1 # [ 0.510758] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1115worker2 # [ 0.512859] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1116client # [ 0.547810] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1117lb # [ 0.536168] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1118worker2 # [ 0.512875] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1119client # [ 0.547831] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1120worker2 # [ 0.512908] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1121lb # [ 0.536664] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1122client # [ 0.547853] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1123lb # [ 0.536855] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1124worker2 # [ 0.513378] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1125client # [ 0.547875] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1126worker2 # [ 0.513565] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1127lb # [ 0.537121] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1128client # [ 0.547896] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1129worker2 # [ 0.513581] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1130lb # [ 0.537444] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1131client # [ 0.547920] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1132worker2 # [ 0.513610] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1133lb # [ 0.537462] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1134client # [ 0.547942] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1135lb # [ 0.537491] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1136worker2 # [ 0.514088] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1137client # [ 0.547986] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1138worker2 # [ 0.514274] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1139client # [ 0.548009] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1140lb # [ 0.537988] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1141worker2 # [ 0.514289] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1142client # [ 0.548035] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1143lb # [ 0.538171] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1144worker2 # [ 0.514319] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1145client # [ 0.548067] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1146lb # [ 0.538186] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1147client # [ 0.548077] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1148worker2 # [ 0.514774] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1149lb # [ 0.538218] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1150client # [ 0.548082] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1151worker2 # [ 0.514957] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1152lb # [ 0.538820] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1153client # [ 0.549345] pci 0000:00:0a.0: enabling device (0000 -> 0002)1154worker2 # [ 0.514973] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1155lb # [ 0.538832] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1156worker2 # [ 0.515003] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1157lb # [ 0.538838] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1158worker2 # [ 0.515019] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1159lb # [ 0.538886] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1160worker2 # [ 0.515546] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1161worker2 # [ 0.515741] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1162lb # [ 0.538936] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1163worker2 # [ 0.515770] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1164lb # [ 0.538983] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1165worker2 # [ 0.516263] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1166lb # [ 0.539030] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1167worker2 # [ 0.516451] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1168worker1 # [ 0.559484] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1169lb # [ 0.539077] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1170worker2 # [ 0.516480] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1171worker1 # [ 0.559720] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1172lb # [ 0.539126] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1173worker1 # [ 0.559753] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1174worker2 # [ 0.516878] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1175worker2 # [ 0.517061] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1176lb # [ 0.539178] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1177worker1 # [ 0.560165] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1178worker2 # [ 0.517310] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1179worker1 # [ 0.560350] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1180lb # [ 0.539226] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1181worker2 # [ 0.517618] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1182lb # [ 0.539273] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1183worker1 # [ 0.560614] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1184worker2 # [ 0.517636] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1185worker1 # [ 0.560913] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1186lb # [ 0.539353] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1187worker2 # [ 0.517665] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1188worker1 # [ 0.560934] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1189lb # [ 0.539399] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1190worker1 # [ 0.560965] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1191lb # [ 0.539421] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1192worker1 # [ 0.561470] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1193lb # [ 0.539442] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1194worker1 # [ 0.561658] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1195lb # [ 0.539467] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1196worker1 # [ 0.561675] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1197lb # [ 0.539494] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1198worker1 # [ 0.561705] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1199lb # [ 0.539516] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1200worker1 # [ 0.562319] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1201lb # [ 0.539538] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1202worker1 # [ 0.562333] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1203lb # [ 0.539560] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1204worker1 # [ 0.562338] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1205lb # [ 0.539585] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1206lb # [ 0.539607] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1207worker1 # [ 0.562389] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1208lb # [ 0.539630] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1209worker1 # [ 0.562438] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1210lb # [ 0.539655] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1211worker1 # [ 0.562491] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1212lb # [ 0.539676] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1213worker1 # [ 0.562544] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1214lb # [ 0.539698] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1215lb # [ 0.539718] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1216worker1 # [ 0.562594] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1217worker2 # [ 0.558272] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1218lb # [ 0.539739] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1219worker2 # [ 0.558497] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1220worker1 # [ 0.562643] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1221lb # [ 0.539760] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1222worker2 # [ 0.558515] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1223worker1 # [ 0.562694] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1224lb # [ 0.539782] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1225worker2 # [ 0.558550] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1226lb # [ 0.539803] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1227worker1 # [ 0.562743] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1228worker2 # [ 0.559202] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1229client # [ 0.618840] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1230lb # [ 0.539824] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1231worker1 # [ 0.562791] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1232worker2 # [ 0.559216] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1233lb # [ 0.539846] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1234worker1 # [ 0.562900] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1235lb # [ 0.539902] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1236worker2 # [ 0.559222] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1237lb # [ 0.539912] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1238worker1 # [ 0.562948] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1239worker2 # [ 0.559270] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1240lb # [ 0.539916] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1241worker1 # [ 0.562972] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1242worker2 # [ 0.559319] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1243lb # [ 0.541140] pci 0000:00:0a.0: enabling device (0000 -> 0002)1244worker1 # [ 0.562994] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1245client # [ 0.622234] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1246worker2 # [ 0.559368] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1247worker1 # [ 0.563017] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1248worker2 # [ 0.559415] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1249worker1 # [ 0.563043] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1250worker2 # [ 0.559464] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1251worker1 # [ 0.563066] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1252worker1 # [ 0.563089] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1253worker2 # [ 0.559524] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1254worker1 # [ 0.563112] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1255worker2 # [ 0.559578] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1256worker1 # [ 0.563135] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1257worker2 # [ 0.559627] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1258worker1 # [ 0.563159] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1259worker2 # [ 0.559676] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1260worker1 # [ 0.563183] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1261worker1 # [ 0.563207] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1262worker2 # [ 0.559815] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1263worker1 # [ 0.563229] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1264worker2 # [ 0.559864] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1265worker1 # [ 0.563252] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1266worker2 # [ 0.559886] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1267worker1 # [ 0.563275] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1268worker2 # [ 0.559908] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1269worker1 # [ 0.563297] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1270worker2 # [ 0.559960] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1271worker1 # [ 0.563320] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1272worker2 # [ 0.559995] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1273worker1 # [ 0.563344] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1274client # [ 0.632753] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1275worker2 # [ 0.560017] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1276worker1 # [ 0.563367] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1277client # [ 0.635054] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1278worker2 # [ 0.560040] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1279worker1 # [ 0.563391] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1280worker2 # [ 0.560062] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1281worker1 # [ 0.563414] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1282worker2 # [ 0.560084] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1283worker1 # [ 0.563445] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1284worker1 # [ 0.563455] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1285worker2 # [ 0.560106] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1286client # [ 0.639184] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1287worker1 # [ 0.563460] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1288worker2 # [ 0.560133] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1289worker1 # [ 0.564663] pci 0000:00:0a.0: enabling device (0000 -> 0002)1290worker2 # [ 0.560157] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1291worker2 # [ 0.560179] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1292worker2 # [ 0.560200] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1293worker2 # [ 0.560222] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1294worker2 # [ 0.560243] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1295worker2 # [ 0.560266] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1296worker2 # [ 0.560287] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1297worker2 # [ 0.560309] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1298worker2 # [ 0.560330] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1299worker2 # [ 0.560354] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1300client # [ 0.646392] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1301worker2 # [ 0.560384] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1302worker2 # [ 0.560393] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1303worker2 # [ 0.560398] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1304worker2 # [ 0.561592] pci 0000:00:0a.0: enabling device (0000 -> 0002)1305lb # [ 0.611124] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1306lb # [ 0.614572] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1307client # [ 0.656976] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1308client # [ 0.659479] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1309lb # [ 0.621066] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1310worker1 # [ 0.634164] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1311client # [ 0.664137] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1312client # [ 0.666191] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1313lb # [ 0.632655] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1314lb # [ 0.634989] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1315worker1 # [ 0.644657] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1316worker1 # [ 0.648705] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1317lb # [ 0.646139] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1318worker2 # [ 0.626650] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1319worker1 # [ 0.650970] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1320worker2 # [ 0.629006] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1321client # [ 0.685631] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1322worker2 # [ 0.631381] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1323worker1 # [ 0.653398] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1324worker2 # [ 0.633656] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1325lb # [ 0.649283] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1326lb # [ 0.651675] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1327client # [ 0.692171] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1328worker2 # [ 0.643892] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1329client # [ 0.697158] msm_serial: driver initialized1330client # [ 0.697307] SuperH (H)SCI(F) driver initialized1331client # [ 0.697361] STM32 USART driver initialized1332lb # [ 0.661854] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1333lb # [ 0.663845] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1334worker1 # [ 0.671632] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1335worker1 # [ 0.674177] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1336worker1 # [ 0.678586] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1337lb # [ 0.675425] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1338worker2 # [ 0.658346] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1339worker2 # [ 0.660890] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1340worker1 # [ 0.687507] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1341worker2 # [ 0.663388] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1342worker1 # [ 0.689684] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1343worker2 # [ 0.665919] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1344lb # [ 0.685251] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1345lb # [ 0.693376] msm_serial: driver initialized1346worker2 # [ 0.679697] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1347worker1 # [ 0.700965] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1348lb # [ 0.693562] SuperH (H)SCI(F) driver initialized1349lb # [ 0.693617] STM32 USART driver initialized1350client # [ 0.734711] loop: module loaded1351client # [ 0.734939] virtio_blk virtio5: 1/0/0 default/read/poll queues1352client # [ 0.735755] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1353worker2 # [ 0.683164] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1354worker2 # [ 0.697101] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1355worker1 # [ 0.719929] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1356worker2 # [ 0.699913] msm_serial: driver initialized1357worker2 # [ 0.700117] SuperH (H)SCI(F) driver initialized1358worker2 # [ 0.700173] STM32 USART driver initialized1359client # [ 0.748893] megasas: 07.734.00.00-rc11360client # [ 0.749674] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1361client # [ 0.752311] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001362worker1 # [ 0.723110] msm_serial: driver initialized1363worker1 # [ 0.723273] SuperH (H)SCI(F) driver initialized1364client # [ 0.752347] Intel/Sharp Extended Query Table at 0x00311365client # [ 0.754279] Using buffer write method1366worker1 # [ 0.723333] STM32 USART driver initialized1367client # [ 0.754393] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1368client # [ 0.763996] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001369client # [ 0.764035] Intel/Sharp Extended Query Table at 0x00311370lb # [ 0.729340] loop: module loaded1371lb # [ 0.729607] virtio_blk virtio5: 1/0/0 default/read/poll queues1372lb # [ 0.730604] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1373client # [ 0.775983] Using buffer write method1374client # [ 0.776029] Concatenating MTD devices:1375client # [ 0.776034] (0): "0.flash"1376client # [ 0.776039] (1): "0.flash"1377client # [ 0.776042] into device "0.flash"1378lb # [ 0.736649] megasas: 07.734.00.00-rc11379lb # [ 0.737507] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1380lb # [ 0.739836] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001381worker2 # [ 0.737260] loop: module loaded1382worker2 # [ 0.737518] virtio_blk virtio5: 1/0/0 default/read/poll queues1383worker2 # [ 0.739559] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1384lb # [ 0.748021] Intel/Sharp Extended Query Table at 0x00311385worker1 # [ 0.760308] loop: module loaded1386worker1 # [ 0.760555] virtio_blk virtio5: 1/0/0 default/read/poll queues1387worker1 # [ 0.761697] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1388lb # [ 0.757309] Using buffer write method1389lb # [ 0.757452] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1390lb # [ 0.759698] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001391lb # [ 0.759755] Intel/Sharp Extended Query Table at 0x00311392worker2 # [ 0.750954] megasas: 07.734.00.00-rc11393worker2 # [ 0.751745] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1394worker2 # [ 0.754025] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001395worker2 # [ 0.754103] Intel/Sharp Extended Query Table at 0x00311396worker2 # [ 0.756119] Using buffer write method1397worker1 # [ 0.775872] megasas: 07.734.00.00-rc11398worker1 # [ 0.776717] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1399worker2 # [ 0.756239] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1400lb # [ 0.777310] Using buffer write method1401worker1 # [ 0.779022] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001402worker2 # [ 0.758019] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001403lb # [ 0.777402] Concatenating MTD devices:1404worker1 # [ 0.779061] Intel/Sharp Extended Query Table at 0x00311405lb # [ 0.777406] (0): "0.flash"1406worker1 # [ 0.781223] Using buffer write method1407lb # [ 0.777410] (1): "0.flash"1408lb # [ 0.777414] into device "0.flash"1409worker1 # [ 0.781343] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1410worker2 # [ 0.770106] Intel/Sharp Extended Query Table at 0x00311411worker2 # [ 0.771920] Using buffer write method1412worker2 # [ 0.771994] Concatenating MTD devices:1413worker2 # [ 0.771999] (0): "0.flash"1414worker2 # [ 0.772003] (1): "0.flash"1415worker2 # [ 0.772007] into device "0.flash"1416worker1 # [ 0.795535] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001417worker1 # [ 0.795607] Intel/Sharp Extended Query Table at 0x00311418worker1 # [ 0.797320] Using buffer write method1419worker1 # [ 0.797372] Concatenating MTD devices:1420worker1 # [ 0.797377] (0): "0.flash"1421worker1 # [ 0.797382] (1): "0.flash"1422worker1 # [ 0.797385] into device "0.flash"1423client # [ 1.064628] Freeing initrd memory: 26160K1424client # [ 1.071117] tun: Universal TUN/TAP device driver, 1.61425client # [ 1.075172] thunder_xcv, ver 1.01426client # [ 1.075233] thunder_bgx, ver 1.01427client # [ 1.075256] nicpf, ver 1.01428client # [ 1.075807] e1000: Intel(R) PRO/1000 Network Driver1429client # [ 1.075816] e1000: Copyright (c) 1999-2006 Intel Corporation.1430client # [ 1.075840] e1000e: Intel(R) PRO/1000 Network Driver1431client # [ 1.075850] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432client # [ 1.075881] igb: Intel(R) Gigabit Ethernet Network Driver1433client # [ 1.075886] igb: Copyright (c) 2007-2014 Intel Corporation.1434client # [ 1.075911] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435client # [ 1.075917] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436client # [ 1.082952] sky2: driver version 1.301437client # [ 1.085143] usbcore: registered new interface driver usb-storage1438client # [ 1.085294] usbcore: registered new interface driver usbserial_generic1439client # [ 1.085310] usbserial: USB Serial support registered for generic1440client # [ 1.085913] hv_vmbus: registering driver hyperv_keyboard1441client # [ 1.087274] ehci-pci 0000:00:0a.0: EHCI Host Controller1442client # [ 1.087305] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11443client # [ 1.087481] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001444client # [ 1.093169] rtc-pl031 9010000.pl031: registered as rtc01445client # [ 1.093201] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:04:54 UTC (1789891494)1446client # [ 1.093619] i2c_dev: i2c /dev entries driver1447client # [ 1.096722] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001448client # [ 1.097090] hub 1-0:1.0: USB hub found1449client # [ 1.097113] hub 1-0:1.0: 6 ports detected1450client # [ 1.101389] sdhci: Secure Digital Host Controller Interface driver1451client # [ 1.101403] sdhci: Copyright(c) Pierre Ossman1452client # [ 1.101667] Synopsys Designware Multimedia Card Interface Driver1453client # [ 1.102037] sdhci-pltfm: SDHCI platform and OF driver helper1454client # [ 1.103805] hid: raw HID events driver (C) Jiri Kosina1455client # [ 1.107459] usbcore: registered new interface driver usbhid1456client # [ 1.107471] usbhid: USB HID core driver1457client # [ 1.109892] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1458client # [ 1.111428] drop_monitor: Initializing network drop monitor service1459client # [ 1.111599] NET: Registered PF_INET6 protocol family1460client # [ 1.114911] Segment Routing with IPv61461client # [ 1.114935] In-situ OAM (IOAM) with IPv61462client # [ 1.114967] NET: Registered PF_PACKET protocol family1463client # [ 1.116721] 9pnet: Installing 9P2000 support1464client # [ 1.119119] Key type dns_resolver registered1465worker2 # [ 1.073194] Freeing initrd memory: 26148K1466lb # [ 1.085326] Freeing initrd memory: 26140K1467worker1 # [ 1.095996] Freeing initrd memory: 26148K1468client # [ 1.126415] registered taskstats version 11469client # [ 1.126571] Loading compiled-in X.509 certificates1470lb # [ 1.092010] tun: Universal TUN/TAP device driver, 1.61471worker2 # [ 1.079729] tun: Universal TUN/TAP device driver, 1.61472worker1 # [ 1.102737] tun: Universal TUN/TAP device driver, 1.61473client # [ 1.135484] Demotion targets for Node 0: null1474client # [ 1.135628] Key type .fscrypt registered1475client # [ 1.135635] Key type fscrypt-provisioning registered1476client # [ 1.135748] ima: No TPM chip found, activating TPM-bypass!1477client # [ 1.135769] ima: Allocated hash algorithm: sha11478worker2 # [ 1.084162] thunder_xcv, ver 1.01479client # [ 1.135794] ima: No architecture policies found1480worker2 # [ 1.084226] thunder_bgx, ver 1.01481lb # [ 1.096470] thunder_xcv, ver 1.01482lb # [ 1.096518] thunder_bgx, ver 1.01483worker2 # [ 1.084255] nicpf, ver 1.01484lb # [ 1.096541] nicpf, ver 1.01485worker2 # [ 1.084830] e1000: Intel(R) PRO/1000 Network Driver1486client # [ 1.140297] input: gpio-keys as /devices/platform/gpio-keys/input/input01487worker2 # [ 1.084840] e1000: Copyright (c) 1999-2006 Intel Corporation.1488lb # [ 1.097126] e1000: Intel(R) PRO/1000 Network Driver1489worker2 # [ 1.084865] e1000e: Intel(R) PRO/1000 Network Driver1490worker2 # [ 1.084876] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1491lb # [ 1.097133] e1000: Copyright (c) 1999-2006 Intel Corporation.1492lb # [ 1.097159] e1000e: Intel(R) PRO/1000 Network Driver1493worker2 # [ 1.084908] igb: Intel(R) Gigabit Ethernet Network Driver1494lb # [ 1.097170] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1495worker2 # [ 1.084914] igb: Copyright (c) 2007-2014 Intel Corporation.1496worker1 # [ 1.107240] thunder_xcv, ver 1.01497worker1 # [ 1.107292] thunder_bgx, ver 1.01498lb # [ 1.097198] igb: Intel(R) Gigabit Ethernet Network Driver1499worker2 # [ 1.084938] igbvf: Intel(R) Gigabit Virtual Function Network Driver1500worker1 # [ 1.107315] nicpf, ver 1.01501lb # [ 1.097204] igb: Copyright (c) 2007-2014 Intel Corporation.1502worker2 # [ 1.084944] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1503worker1 # [ 1.107912] e1000: Intel(R) PRO/1000 Network Driver1504worker2 # [ 1.085088] sky2: driver version 1.301505lb # [ 1.097227] igbvf: Intel(R) Gigabit Virtual Function Network Driver1506worker1 # [ 1.107922] e1000: Copyright (c) 1999-2006 Intel Corporation.1507worker1 # [ 1.107947] e1000e: Intel(R) PRO/1000 Network Driver1508lb # [ 1.097233] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1509lb # [ 1.097371] sky2: driver version 1.301510worker1 # [ 1.107958] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1511lb # [ 1.099086] usbcore: registered new interface driver usb-storage1512worker1 # [ 1.107990] igb: Intel(R) Gigabit Ethernet Network Driver1513worker2 # [ 1.093894] usbcore: registered new interface driver usb-storage1514lb # [ 1.099268] usbcore: registered new interface driver usbserial_generic1515worker1 # [ 1.107996] igb: Copyright (c) 2007-2014 Intel Corporation.1516worker2 # [ 1.094753] ehci-pci 0000:00:0a.0: EHCI Host Controller1517lb # [ 1.099289] usbserial: USB Serial support registered for generic1518worker1 # [ 1.108043] igbvf: Intel(R) Gigabit Virtual Function Network Driver1519worker2 # [ 1.094786] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11520lb # [ 1.100680] ehci-pci 0000:00:0a.0: EHCI Host Controller1521worker1 # [ 1.108066] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1522worker2 # [ 1.095002] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001523worker1 # [ 1.108300] sky2: driver version 1.301524lb # [ 1.100719] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11525worker1 # [ 1.110069] usbcore: registered new interface driver usb-storage1526worker1 # [ 1.110201] usbcore: registered new interface driver usbserial_generic1527lb # [ 1.100968] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001528worker1 # [ 1.110217] usbserial: USB Serial support registered for generic1529worker2 # [ 1.098093] usbcore: registered new interface driver usbserial_generic1530lb # [ 1.112310] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001531lb # [ 1.112707] hub 1-0:1.0: USB hub found1532worker1 # [ 1.111616] ehci-pci 0000:00:0a.0: EHCI Host Controller1533worker2 # [ 1.098116] usbserial: USB Serial support registered for generic1534worker2 # [ 1.098848] hv_vmbus: registering driver hyperv_keyboard1535lb # [ 1.114739] hub 1-0:1.0: 6 ports detected1536worker1 # [ 1.111650] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11537lb # [ 1.115722] hv_vmbus: registering driver hyperv_keyboard1538worker1 # [ 1.111876] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001539worker2 # [ 1.102108] rtc-pl031 9010000.pl031: registered as rtc01540worker1 # [ 1.123011] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001541worker1 # [ 1.123409] hub 1-0:1.0: USB hub found1542worker2 # [ 1.102142] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:04:54 UTC (1789891494)1543worker1 # [ 1.123425] hub 1-0:1.0: 6 ports detected1544lb # [ 1.117558] rtc-pl031 9010000.pl031: registered as rtc01545worker2 # [ 1.102475] i2c_dev: i2c /dev entries driver1546worker1 # [ 1.126295] hv_vmbus: registering driver hyperv_keyboard1547lb # [ 1.117598] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:04:54 UTC (1789891494)1548lb # [ 1.117960] i2c_dev: i2c /dev entries driver1549worker1 # [ 1.128155] rtc-pl031 9010000.pl031: registered as rtc01550worker1 # [ 1.128193] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:04:54 UTC (1789891494)1551worker1 # [ 1.128517] i2c_dev: i2c /dev entries driver1552worker2 # [ 1.107666] sdhci: Secure Digital Host Controller Interface driver1553lb # [ 1.123262] sdhci: Secure Digital Host Controller Interface driver1554worker2 # [ 1.107684] sdhci: Copyright(c) Pierre Ossman1555lb # [ 1.123275] sdhci: Copyright(c) Pierre Ossman1556client # [ 1.161851] clk: Disabling unused clocks1557worker2 # [ 1.107981] Synopsys Designware Multimedia Card Interface Driver1558lb # [ 1.123552] Synopsys Designware Multimedia Card Interface Driver1559client # [ 1.161900] PM: genpd: Disabling unused power domains1560worker2 # [ 1.108417] sdhci-pltfm: SDHCI platform and OF driver helper1561worker2 # [ 1.112766] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001562worker1 # [ 1.133833] sdhci: Secure Digital Host Controller Interface driver1563client # [ 1.166376] Freeing unused kernel memory: 4736K1564lb # [ 1.126041] sdhci-pltfm: SDHCI platform and OF driver helper1565worker2 # [ 1.113149] hub 1-0:1.0: USB hub found1566worker1 # [ 1.133850] sdhci: Copyright(c) Pierre Ossman1567client # [ 1.166584] Run /init as init process1568lb # [ 1.127763] hid: raw HID events driver (C) Jiri Kosina1569worker2 # [ 1.113170] hub 1-0:1.0: 6 ports detected1570worker1 # [ 1.134132] Synopsys Designware Multimedia Card Interface Driver1571worker1 # [ 1.134509] sdhci-pltfm: SDHCI platform and OF driver helper1572lb # [ 1.129380] usbcore: registered new interface driver usbhid1573worker2 # [ 1.115670] hid: raw HID events driver (C) Jiri Kosina1574lb # [ 1.129393] usbhid: USB HID core driver1575worker2 # [ 1.116007] usbcore: registered new interface driver usbhid1576worker2 # [ 1.116014] usbhid: USB HID core driver1577lb # [ 1.131805] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1578worker1 # [ 1.139221] hid: raw HID events driver (C) Jiri Kosina1579worker1 # [ 1.139485] usbcore: registered new interface driver usbhid1580worker1 # [ 1.139492] usbhid: USB HID core driver1581lb # [ 1.134611] drop_monitor: Initializing network drop monitor service1582worker2 # [ 1.119020] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1583lb # [ 1.134825] NET: Registered PF_INET6 protocol family1584worker1 # [ 1.142499] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1585worker2 # [ 1.120651] drop_monitor: Initializing network drop monitor service1586worker2 # [ 1.120858] NET: Registered PF_INET6 protocol family1587lb # [ 1.137147] Segment Routing with IPv61588lb # [ 1.137171] In-situ OAM (IOAM) with IPv61589worker2 # [ 1.124004] Segment Routing with IPv61590worker2 # [ 1.124037] In-situ OAM (IOAM) with IPv61591lb # [ 1.137208] NET: Registered PF_PACKET protocol family1592worker1 # [ 1.145210] drop_monitor: Initializing network drop monitor service1593worker2 # [ 1.124070] NET: Registered PF_PACKET protocol family1594worker1 # [ 1.145444] NET: Registered PF_INET6 protocol family1595worker2 # [ 1.125725] 9pnet: Installing 9P2000 support1596lb # [ 1.138937] 9pnet: Installing 9P2000 support1597worker1 # [ 1.147745] Segment Routing with IPv61598worker1 # [ 1.147765] In-situ OAM (IOAM) with IPv61599worker1 # [ 1.147798] NET: Registered PF_PACKET protocol family1600worker1 # [ 1.149529] 9pnet: Installing 9P2000 support1601worker2 # [ 1.128702] Key type dns_resolver registered1602lb # [ 1.142092] Key type dns_resolver registered1603client # [ 1.182617] systemd[1]: Successfully made /usr/ read-only.1604worker1 # [ 1.152749] Key type dns_resolver registered1605worker2 # [ 1.135682] registered taskstats version 11606lb # [ 1.148851] registered taskstats version 11607worker2 # [ 1.135848] Loading compiled-in X.509 certificates1608lb # [ 1.149025] Loading compiled-in X.509 certificates1609worker1 # [ 1.159375] registered taskstats version 11610worker1 # [ 1.159570] Loading compiled-in X.509 certificates1611lb # [ 1.158137] Demotion targets for Node 0: null1612lb # [ 1.158294] Key type .fscrypt registered1613worker2 # [ 1.144919] Demotion targets for Node 0: null1614worker2 # [ 1.145054] Key type .fscrypt registered1615lb # [ 1.158300] Key type fscrypt-provisioning registered1616worker2 # [ 1.145062] Key type fscrypt-provisioning registered1617lb # [ 1.158403] ima: No TPM chip found, activating TPM-bypass!1618worker2 # [ 1.145171] ima: No TPM chip found, activating TPM-bypass!1619lb # [ 1.158422] ima: Allocated hash algorithm: sha11620worker2 # [ 1.145192] ima: Allocated hash algorithm: sha11621lb # [ 1.158450] ima: No architecture policies found1622worker1 # [ 1.168638] Demotion targets for Node 0: null1623worker2 # [ 1.145218] ima: No architecture policies found1624worker1 # [ 1.168789] Key type .fscrypt registered1625worker1 # [ 1.168796] Key type fscrypt-provisioning registered1626lb # [ 1.162929] input: gpio-keys as /devices/platform/gpio-keys/input/input01627worker2 # [ 1.149542] input: gpio-keys as /devices/platform/gpio-keys/input/input01628worker1 # [ 1.168915] ima: No TPM chip found, activating TPM-bypass!1629worker1 # [ 1.168936] ima: Allocated hash algorithm: sha11630worker1 # [ 1.168963] ima: No architecture policies found1631worker1 # [ 1.173344] input: gpio-keys as /devices/platform/gpio-keys/input/input01632worker2 # [ 1.172309] clk: Disabling unused clocks1633lb # [ 1.186155] clk: Disabling unused clocks1634worker2 # [ 1.172352] PM: genpd: Disabling unused power domains1635lb # [ 1.186198] PM: genpd: Disabling unused power domains1636worker2 # [ 1.176849] Freeing unused kernel memory: 4736K1637lb # [ 1.190689] Freeing unused kernel memory: 4736K1638worker2 # [ 1.177069] Run /init as init process1639lb # [ 1.190924] Run /init as init process1640worker1 # [ 1.197399] clk: Disabling unused clocks1641worker1 # [ 1.197443] PM: genpd: Disabling unused power domains1642worker1 # [ 1.201834] Freeing unused kernel memory: 4736K1643worker1 # [ 1.202056] Run /init as init process1644worker2 # [ 1.192716] systemd[1]: Successfully made /usr/ read-only.1645lb # [ 1.206682] systemd[1]: Successfully made /usr/ read-only.1646worker1 # [ 1.217551] systemd[1]: Successfully made /usr/ read-only.1647client # [ 1.344085] usb 1-1: new high-speed USB device number 2 using ehci-pci1648lb # [ 1.359990] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.370902] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker2 # [ 1.358150] usb 1-1: new high-speed USB device number 2 using ehci-pci1651client # [ 1.494021] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652client # [ 1.517654] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653client # [ 1.525382] systemd[1]: Detected virtualization qemu.1654client # [ 1.526626] systemd[1]: Detected architecture arm64.1655client # [ 1.527912] systemd[1]: Running in initrd.1656client # [ 1.529542] systemd[1]: Initializing machine ID from random generator.1657client # [ 1.531266] systemd[1]: Hostname set to <client>.1658worker1 # [ 1.521148] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659lb # [ 1.514103] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660worker2 # [ 1.510947] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661client # [ 1.584241] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01662worker1 # [ 1.552459] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1663worker2 # [ 1.527915] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1664lb # [ 1.541533] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1665lb # [ 1.547580] systemd[1]: Detected virtualization qemu.1666lb # [ 1.548629] systemd[1]: Detected architecture arm64.1667lb # [ 1.549529] systemd[1]: Running in initrd.1668worker2 # [ 1.536052] systemd[1]: Detected virtualization qemu.1669worker1 # [ 1.556856] systemd[1]: Detected virtualization qemu.1670worker1 # [ 1.557788] systemd[1]: Detected architecture arm64.1671worker2 # [ 1.536974] systemd[1]: Detected architecture arm64.1672worker1 # [ 1.558484] systemd[1]: Running in initrd.1673worker2 # [ 1.537699] systemd[1]: Running in initrd.1674lb # [ 1.550949] systemd[1]: Initializing machine ID from random generator.1675worker1 # [ 1.559525] systemd[1]: Initializing machine ID from random generator.1676lb # [ 1.552475] systemd[1]: Hostname set to <lb>.1677worker2 # [ 1.538773] systemd[1]: Initializing machine ID from random generator.1678worker1 # [ 1.560691] systemd[1]: Hostname set to <worker1>.1679worker2 # [ 1.539815] systemd[1]: Hostname set to <worker2>.1680worker1 # [ 1.611163] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681lb # [ 1.608191] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682worker2 # [ 1.598390] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683client # [ 1.704060] usb 1-2: new high-speed USB device number 3 using ehci-pci1684worker1 # [ 1.730915] usb 1-2: new high-speed USB device number 3 using ehci-pci1685lb # [ 1.727925] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker2 # [ 1.718125] usb 1-2: new high-speed USB device number 3 using ehci-pci1687client # [ 1.808162] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688worker1 # [ 1.817294] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689client # [ 1.863012] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690client # [ 1.864981] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691worker2 # [ 1.822775] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692client # [ 1.878709] systemd[1]: Queued start job for default target Initrd Default Target.1693lb # [ 1.844634] systemd[1]: bpf-restrict-fs: LSM BPF program attached1694client # [ 1.886184] systemd[1]: Created slice Slice /system/modprobe.1695client # [ 1.887252] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1696client # [ 1.888392] systemd[1]: Expecting device /dev/disk/by-label/nixos...1697client # [ 1.888430] systemd[1]: Reached target Path Units.1698client # [ 1.888447] systemd[1]: Reached target Slice Units.1699client # [ 1.888465] systemd[1]: Reached target Swaps.1700client # [ 1.888482] systemd[1]: Reached target Timer Units.1701client # [ 1.888707] systemd[1]: Listening on D-Bus System Message Bus Socket.1702client # [ 1.888855] systemd[1]: Listening on Journal Socket (/dev/log).1703client # [ 1.888979] systemd[1]: Listening on Journal Sockets.1704client # [ 1.889091] systemd[1]: Listening on udev Control Socket.1705client # [ 1.889203] systemd[1]: Listening on udev Kernel Socket.1706client # [ 1.889222] systemd[1]: Reached target Socket Units.1707client # [ 1.898244] systemd[1]: Starting Create List of Static Device Nodes...1708client # [ 1.908240] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1709client # [ 1.908351] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1710client # [ 1.917122] systemd[1]: Mounting Kernel Configuration File System...1711worker1 # [ 1.885914] systemd[1]: Queued start job for default target Initrd Default Target.1712worker1 # [ 1.889844] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21713lb # [ 1.882165] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21714worker1 # [ 1.891796] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01715lb # [ 1.887504] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01716worker1 # [ 1.897197] systemd[1]: Created slice Slice /system/modprobe.1717worker2 # [ 1.874307] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21718worker1 # [ 1.898250] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1719worker1 # [ 1.899491] systemd[1]: Expecting device /dev/disk/by-label/nixos...1720worker1 # [ 1.900329] systemd[1]: Reached target Path Units.1721worker1 # [ 1.900958] systemd[1]: Reached target Slice Units.1722worker2 # [ 1.878368] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01723worker1 # [ 1.901770] systemd[1]: Reached target Swaps.1724worker1 # [ 1.902402] systemd[1]: Reached target Timer Units.1725worker1 # [ 1.903321] systemd[1]: Listening on D-Bus System Message Bus Socket.1726worker1 # [ 1.904420] systemd[1]: Listening on Journal Socket (/dev/log).1727worker1 # [ 1.905349] systemd[1]: Listening on Journal Sockets.1728worker1 # [ 1.906124] systemd[1]: Listening on udev Control Socket.1729worker1 # [ 1.906959] systemd[1]: Listening on udev Kernel Socket.1730worker1 # [ 1.907673] systemd[1]: Reached target Socket Units.1731worker1 # [ 1.909900] systemd[1]: Starting Create List of Static Device Nodes...1732client # [ 1.947052] systemd[1]: Starting Journal Service...1733worker1 # [ 1.919116] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1734worker1 # [ 1.920182] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1735client # [ 1.956948] systemd[1]: Starting Load Kernel Modules...1736client # [ 1.957870] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1737worker1 # [ 1.927242] systemd[1]: Mounting Kernel Configuration File System...1738lb # [ 1.931585] systemd[1]: Queued start job for default target Initrd Default Target.1739client # [ 1.972488] systemd[1]: Starting Coldplug All udev Devices...1740lb # [ 1.938123] systemd[1]: Created slice Slice /system/modprobe.1741lb # [ 1.939194] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1742worker2 # [ 1.925230] systemd[1]: Queued start job for default target Initrd Default Target.1743lb # [ 1.940308] systemd[1]: Expecting device /dev/disk/by-label/nixos...1744lb # [ 1.941119] systemd[1]: Reached target Path Units.1745lb # [ 1.941850] systemd[1]: Reached target Slice Units.1746lb # [ 1.942521] systemd[1]: Reached target Swaps.1747lb # [ 1.943121] systemd[1]: Reached target Timer Units.1748worker1 # [ 1.947376] systemd[1]: Starting Journal Service...1749lb # [ 1.944093] systemd[1]: Listening on D-Bus System Message Bus Socket.1750lb # [ 1.945095] systemd[1]: Listening on Journal Socket (/dev/log).1751lb # [ 1.946007] systemd[1]: Listening on Journal Sockets.1752lb # [ 1.946819] systemd[1]: Listening on udev Control Socket.1753lb # [ 1.947661] systemd[1]: Listening on udev Kernel Socket.1754lb # [ 1.948458] systemd[1]: Reached target Socket Units.1755worker2 # [ 1.937133] systemd[1]: Created slice Slice /system/modprobe.1756worker1 # [ 1.959164] systemd[1]: Starting Load Kernel Modules...1757lb # [ 1.950764] systemd[1]: Starting Create List of Static Device Nodes...1758worker2 # [ 1.938441] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1759worker1 # [ 1.960107] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1760worker2 # [ 1.939797] systemd[1]: Expecting device /dev/disk/by-label/nixos...1761worker2 # [ 1.941004] systemd[1]: Reached target Path Units.1762worker2 # [ 1.941825] systemd[1]: Reached target Slice Units.1763client # [ 1.992168] systemd[1]: Finished Create List of Static Device Nodes.1764worker2 # [ 1.942733] systemd[1]: Reached target Swaps.1765worker2 # [ 1.943498] systemd[1]: Reached target Timer Units.1766client # [ 1.993310] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1767client # [ 1.993655] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1768worker2 # [ 1.944628] systemd[1]: Listening on D-Bus System Message Bus Socket.1769client # [ 1.993919] systemd[1]: Mounted Kernel Configuration File System.1770worker2 # [ 1.945916] systemd[1]: Listening on Journal Socket (/dev/log).1771lb # [ 1.960130] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1772worker2 # [ 1.947173] systemd[1]: Listening on Journal Sockets.1773lb # [ 1.961157] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1774worker2 # [ 1.948220] systemd[1]: Listening on udev Control Socket.1775worker2 # [ 1.949333] systemd[1]: Listening on udev Kernel Socket.1776worker2 # [ 1.950285] systemd[1]: Reached target Socket Units.1777worker2 # [ 1.953139] systemd[1]: Starting Create List of Static Device Nodes...1778lb # [ 1.968247] systemd[1]: Mounting Kernel Configuration File System...1779client # [ 2.014402] systemd-journald[73]: Collecting audit messages is disabled.1780client # [ 2.015519] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1781worker2 # [ 1.962352] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1782worker2 # [ 1.962495] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1783worker1 # [ 1.991118] systemd[1]: Starting Coldplug All udev Devices...1784client # [ 2.021837] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1785worker2 # [ 1.974326] systemd[1]: Mounting Kernel Configuration File System...1786lb # [ 1.992270] systemd[1]: Starting Journal Service...1787client # [ 2.040129] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1788worker1 # [ 2.007135] systemd[1]: Finished Create List of Static Device Nodes.1789lb # [ 2.004139] systemd[1]: Starting Load Kernel Modules...1790worker1 # [ 2.008667] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1791worker1 # [ 2.009092] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1792lb # [ 2.005089] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1793worker1 # [ 2.009363] systemd[1]: Mounted Kernel Configuration File System.1794client # [ 2.048468] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01795client # [ 2.048748] [drm] features: -virgl +edid -resource_blob -host_visible1796worker1 # [ 2.017948] systemd-journald[73]: Collecting audit messages is disabled.1797client # [ 2.048759] [drm] features: -context_init1798lb # [ 2.012258] systemd[1]: Starting Coldplug All udev Devices...1799client # [ 2.049526] [drm] number of scanouts: 11800client # [ 2.049545] [drm] number of cap sets: 01801worker1 # [ 2.024099] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1802worker2 # [ 2.006482] systemd[1]: Starting Journal Service...1803worker2 # [ 2.009189] systemd[1]: Starting Load Kernel Modules...1804worker2 # [ 2.010371] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1805worker1 # [ 2.035284] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1806worker1 # [ 2.036964] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1807worker2 # [ 2.019812] systemd[1]: Starting Coldplug All udev Devices...1808lb # [ 2.032253] systemd[1]: Finished Create List of Static Device Nodes.1809client # [ 2.072832] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1810lb # [ 2.033341] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1811lb # [ 2.033677] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1812client # [ 2.075751] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1813lb # [ 2.034006] systemd[1]: Mounted Kernel Configuration File System.1814client # [ 2.075786] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01815worker1 # [ 2.051296] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01816worker1 # [ 2.051558] [drm] features: -virgl +edid -resource_blob -host_visible1817worker1 # [ 2.051569] [drm] features: -context_init1818worker1 # [ 2.052420] [drm] number of scanouts: 11819worker1 # [ 2.052442] [drm] number of cap sets: 01820lb # [ 2.048464] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1821client # [ 2.088747] systemd[1]: Starting Create Static Device Nodes in /dev...1822worker2 # [ 2.038408] systemd[1]: Finished Create List of Static Device Nodes.1823worker2 # [ 2.039713] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1824worker2 # [ 2.040121] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1825worker2 # [ 2.040399] systemd[1]: Mounted Kernel Configuration File System.1826worker2 # [ 2.058712] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1827client # [ 2.105646] Console: switching to colour frame buffer device 160x501828worker1 # [ 2.079285] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1829worker1 # [ 2.079319] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01830lb # [ 2.086733] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1831worker1 # [ 2.099676] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1832lb # [ 2.094506] systemd-journald[73]: Collecting audit messages is disabled.1833client # [ 2.136806] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1834worker1 # [ 2.107466] systemd[1]: Starting Create Static Device Nodes in /dev...1835worker2 # [ 2.093273] systemd-journald[73]: Collecting audit messages is disabled.1836client # [ 2.149553] systemd[1]: Finished Load Kernel Modules.1837worker1 # [ 2.111549] Console: switching to colour frame buffer device 160x501838worker1 # [ 2.119501] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1839client # [ 2.156530] systemd[1]: Starting Apply Kernel Variables...1840lb # [ 2.112006] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1841lb # [ 2.117176] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01842lb # [ 2.117506] [drm] features: -virgl +edid -resource_blob -host_visible1843lb # [ 2.117518] [drm] features: -context_init1844lb # [ 2.118309] [drm] number of scanouts: 11845lb # [ 2.118335] [drm] number of cap sets: 01846worker2 # [ 2.117715] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1847lb # [ 2.132744] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1848lb # [ 2.135808] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1849lb # [ 2.135845] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01850worker2 # [ 2.121228] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1851worker2 # [ 2.130714] systemd[1]: Starting Create Static Device Nodes in /dev...1852client # [ 2.180221] systemd[1]: Finished Create Static Device Nodes in /dev.1853client # [ 2.180847] systemd[1]: Reached target Preparation for Local File Systems.1854client # [ 2.180893] systemd[1]: Reached target Local File Systems.1855worker1 # [ 2.151249] systemd[1]: Finished Load Kernel Modules.1856worker1 # [ 2.155420] systemd[1]: Starting Apply Kernel Variables...1857client # [ 2.188471] systemd[1]: Starting Rule-based Manager for Device Events and Files...1858worker2 # [ 2.134217] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1859lb # [ 2.148645] systemd[1]: Starting Create Static Device Nodes in /dev...1860worker2 # [ 2.139997] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01861worker2 # [ 2.140269] [drm] features: -virgl +edid -resource_blob -host_visible1862worker2 # [ 2.140280] [drm] features: -context_init1863worker2 # [ 2.141091] [drm] number of scanouts: 11864worker2 # [ 2.141111] [drm] number of cap sets: 01865lb # [ 2.176417] Console: switching to colour frame buffer device 160x501866lb # [ 2.182572] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1867client # [ 2.224546] systemd[1]: Finished Apply Kernel Variables.1868worker1 # [ 2.191413] systemd[1]: Finished Create Static Device Nodes in /dev.1869worker1 # [ 2.191761] systemd[1]: Reached target Preparation for Local File Systems.1870worker2 # [ 2.166478] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1871worker1 # [ 2.191802] systemd[1]: Reached target Local File Systems.1872worker2 # [ 2.166512] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01873client # [ 2.216478] systemd-modules-load[74]: Inserted module 'dm_mod'1874worker1 # [ 2.199538] systemd[1]: Starting Rule-based Manager for Device Events and Files...1875client # [ 2.217754] systemd-modules-load[74]: Module 'virtio_balloon' is built in1876client # [ 2.234841] systemd[1]: Started Journal Service.1877client # [ 2.225397] systemd-modules-load[74]: Module 'virtio_console' is built in1878client # [ 2.229981] systemd-modules-load[74]: Inserted module 'virtio_gpu'1879lb # [ 2.211713] systemd[1]: Finished Load Kernel Modules.1880lb # [ 2.215486] systemd[1]: Starting Apply Kernel Variables...1881client # [ 2.240567] systemd-modules-load[74]: Module 'virtio_rng' is built in1882worker1 # [ 2.207072] systemd-modules-load[74]: Inserted module 'dm_mod'1883worker2 # [ 2.202452] Console: switching to colour frame buffer device 160x501884client # [ 2.244480] systemd[1]: Starting Create System Files and Directories...1885worker2 # [ 2.206680] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1886worker1 # [ 2.227340] systemd[1]: Started Journal Service.1887worker1 # [ 2.212885] systemd-modules-load[74]: Module 'virtio_balloon' is built in1888worker2 # [ 2.211824] systemd[1]: Finished Create Static Device Nodes in /dev.1889worker1 # [ 2.217313] systemd-modules-load[74]: Module 'virtio_console' is built in1890worker2 # [ 2.212155] systemd[1]: Reached target Preparation for Local File Systems.1891worker2 # [ 2.212194] systemd[1]: Reached target Local File Systems.1892worker2 # [ 2.218221] systemd[1]: Starting Rule-based Manager for Device Events and Files...1893worker1 # [ 2.228520] systemd-modules-load[74]: Inserted module 'virtio_gpu'1894worker1 # [ 2.232604] systemd-modules-load[74]: Module 'virtio_rng' is built in1895lb # [ 2.244358] systemd[1]: Finished Create Static Device Nodes in /dev.1896worker1 # [ 2.236460] systemd[1]: Starting Create System Files and Directories...1897lb # [ 2.244915] systemd[1]: Reached target Preparation for Local File Systems.1898lb # [ 2.244961] systemd[1]: Reached target Local File Systems.1899lb # [ 2.250712] systemd[1]: Starting Rule-based Manager for Device Events and Files...1900worker1 # [ 2.244536] systemd[1]: Finished Apply Kernel Variables.1901worker2 # [ 2.242815] systemd[1]: Finished Load Kernel Modules.1902worker2 # [ 2.250764] systemd[1]: Starting Apply Kernel Variables...1903client # [ 2.292633] systemd-udevd[81]: Using default interface naming scheme 'v261'.1904lb # [ 2.282205] systemd[1]: Started Journal Service.1905lb # [ 2.259808] systemd-modules-load[74]: Inserted module 'dm_mod'1906client # [ 2.311806] systemd[1]: Finished Create System Files and Directories.1907lb # [ 2.269349] systemd-modules-load[74]: Module 'virtio_balloon' is built in1908lb # [ 2.270667] systemd-modules-load[74]: Module 'virtio_console' is built in1909lb # [ 2.284661] systemd-modules-load[74]: Inserted module 'virtio_gpu'1910lb # [ 2.286010] systemd-modules-load[74]: Module 'virtio_rng' is built in1911lb # [ 2.287054] systemd[1]: Finished Apply Kernel Variables.1912worker1 # [ 2.295953] systemd-udevd[81]: Using default interface naming scheme 'v261'.1913client # [ 2.337280] systemd[1]: Started Rule-based Manager for Device Events and Files.1914lb # [ 2.295222] systemd[1]: Starting Create System Files and Directories...1915worker2 # [ 2.306384] systemd[1]: Started Journal Service.1916worker1 # [ 2.313430] systemd[1]: Finished Create System Files and Directories.1917worker2 # [ 2.283733] systemd-modules-load[74]: Inserted module 'dm_mod'1918worker2 # [ 2.305251] systemd-modules-load[74]: Module 'virtio_balloon' is built in1919worker2 # [ 2.306549] systemd-modules-load[74]: Module 'virtio_console' is built in1920worker2 # [ 2.307692] systemd-modules-load[74]: Inserted module 'virtio_gpu'1921worker2 # [ 2.316773] systemd-modules-load[74]: Module 'virtio_rng' is built in1922worker1 # [ 2.338444] systemd[1]: Started Rule-based Manager for Device Events and Files.1923worker2 # [ 2.325502] systemd[1]: Starting Create System Files and Directories...1924worker2 # [ 2.329740] systemd[1]: Finished Apply Kernel Variables.1925lb # [ 2.346094] systemd[1]: Finished Create System Files and Directories.1926lb # [ 2.355146] systemd-udevd[80]: Using default interface naming scheme 'v261'.1927worker2 # [ 2.344807] systemd-udevd[79]: Using default interface naming scheme 'v261'.1928client # [ 2.416575] systemd[1]: Starting Virtual Console Setup...1929lb # [ 2.387243] systemd[1]: Started Rule-based Manager for Device Events and Files.1930worker2 # [ 2.377739] systemd[1]: Finished Create System Files and Directories.1931worker2 # [ 2.393766] systemd[1]: Started Rule-based Manager for Device Events and Files.1932worker1 # [ 2.415164] systemd[1]: Starting Virtual Console Setup...1933client # [ 2.468617] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1934client # [ 2.471856] systemd[1]: Finished Virtual Console Setup.1935lb # [ 2.464554] systemd[1]: Starting Virtual Console Setup...1936worker1 # [ 2.476645] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1937worker1 # [ 2.480579] systemd[1]: Finished Virtual Console Setup.1938worker2 # [ 2.466798] systemd[1]: Starting Virtual Console Setup...1939lb # [ 2.517200] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1940lb # [ 2.521417] systemd[1]: Finished Virtual Console Setup.1941worker2 # [ 2.528628] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942worker2 # [ 2.531804] systemd[1]: Finished Virtual Console Setup.1943client # [ 3.085170] systemd[1]: Finished Coldplug All udev Devices.1944client # [ 3.088207] systemd[1]: Reached target System Initialization.1945client # [ 3.089134] systemd[1]: Reached target Basic System.1946worker1 # [ 3.084542] systemd[1]: Finished Coldplug All udev Devices.1947worker1 # [ 3.087028] systemd[1]: Reached target System Initialization.1948worker1 # [ 3.092307] systemd[1]: Reached target Basic System.1949lb # [ 3.122461] systemd[1]: Finished Coldplug All udev Devices.1950lb # [ 3.123462] systemd[1]: Reached target System Initialization.1951lb # [ 3.124366] systemd[1]: Reached target Basic System.1952worker2 # [ 3.135896] systemd[1]: Finished Coldplug All udev Devices.1953worker2 # [ 3.137991] systemd[1]: Reached target System Initialization.1954worker2 # [ 3.140163] systemd[1]: Reached target Basic System.1955client # [ 3.283902] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1956worker1 # [ 3.258810] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1957client # [ 3.299339] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958client # [ 3.304394] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1959worker1 # [ 3.279597] (udev-worker)[107]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1960worker1 # [ 3.285088] (udev-worker)[107]: Network interface NamePolicy= disabled on kernel command line.1961lb # [ 3.313807] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1962lb # [ 3.322325] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1963worker2 # [ 3.319460] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1964lb # [ 3.334418] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1965client # [ 3.392598] systemd[1]: Found device /dev/disk/by-label/nixos.1966worker2 # [ 3.348178] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1967client # [ 3.406156] systemd[1]: Reached target Initrd Root Device.1968worker2 # [ 3.354304] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1969client # [ 3.410072] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1970worker1 # [ 3.376688] systemd[1]: Found device /dev/disk/by-label/nixos.1971worker1 # [ 3.384367] systemd[1]: Reached target Initrd Root Device.1972worker1 # [ 3.390650] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1973lb # [ 3.419155] systemd[1]: Found device /dev/disk/by-label/nixos.1974lb # [ 3.423381] systemd[1]: Reached target Initrd Root Device.1975lb # [ 3.426899] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1976client # [ 3.478995] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1977worker1 # [ 3.451418] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1978client # [ 3.488244] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1979worker1 # [ 3.460348] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1980client # [ 3.500208] systemd[1]: Mounting /sysroot...1981worker1 # [ 3.468445] systemd[1]: Mounting /sysroot...1982worker2 # [ 3.460177] systemd[1]: Found device /dev/disk/by-label/nixos.1983worker2 # [ 3.465435] systemd[1]: Reached target Initrd Root Device.1984worker2 # [ 3.470366] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1985lb # [ 3.493201] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1986lb # [ 3.500292] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1987lb # [ 3.504375] systemd[1]: Mounting /sysroot...1988worker1 # [ 3.530009] EXT4-fs (vda): mounted filesystem 28e0f280-7b06-4bf7-8535-ea2899762942 r/w with ordered data mode. Quota mode: none.1989client # [ 3.562403] EXT4-fs (vda): mounted filesystem 7e7ea7cf-f10c-4ced-882a-1c7c19f090d9 r/w with ordered data mode. Quota mode: none.1990worker1 # [ 3.518676] systemd[1]: Mounted /sysroot.1991client # [ 3.554220] systemd[1]: Mounted /sysroot.1992worker1 # [ 3.521698] systemd[1]: Reached target Initrd Root File System.1993client # [ 3.556403] systemd[1]: Reached target Initrd Root File System.1994client # [ 3.561395] systemd[1]: Starting Mountpoints Configured in the Real Root...1995worker1 # [ 3.528271] systemd[1]: Starting Mountpoints Configured in the Real Root...1996worker2 # [ 3.532243] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1997lb # [ 3.571262] EXT4-fs (vda): mounted filesystem 5c4101e1-1dc3-48cc-9b76-c64a90af2d76 r/w with ordered data mode. Quota mode: none.1998worker2 # [ 3.541455] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1999client # [ 3.597026] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.2000worker1 # [ 3.564102] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload.
loading 1,187 hidden lines…
3188lb # [ 14.488818] systemd[1]: Reached target Login Prompts.3189worker2 # [ 14.476659] systemd[1]: linger-users.service: Deactivated successfully.3190client # [ 14.533893] systemd[1]: Starting Extra networking commands....3191worker2 # [ 14.482098] systemd[1]: Finished linger-users.service.3192lb # [ 14.514144] cfg80211: Loading compiled-in X.509 certificates for regulatory database3193worker2 # [ 14.513313] systemd[1]: Started Name Service Cache Daemon (nsncd).3194worker2 # [ 14.514386] systemd[1]: Reached target Host and Network Name Lookups.3195worker2 # [ 14.515239] systemd[1]: Reached target User and Group Name Lookups.3196worker1 # [ 14.561832] 8021q: adding VLAN 0 to HW filter on device eth13197worker2 # [ 14.522500] nsncd[642]: Sep 20 08:05:07.932 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3198worker1 # [ 14.575499] 8021q: adding VLAN 0 to HW filter on device eth03199lb # [ 14.571804] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3200worker1 # [ 14.559670] dhcpcd[622]: eth0: waiting for carrier3201worker1 # [ 14.563727] dhcpcd[622]: eth0: carrier acquired3202lb # [ 14.574512] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3203worker1 # [ 14.567658] systemd-logind[501]: Watching system buttons on /dev/input/event0 (gpio-keys)3204lb # [ 14.581408] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23205lb # [ 14.581844] cfg80211: failed to load regulatory.db3206worker1 # [ 14.579864] network-addresses-eth1-start[679]: adding address 192.168.1.3/24... done3207worker2 # [ 14.568155] systemd[1]: Finished resolvconf update.3208worker1 # [ 14.588892] dhcpcd[622]: DUID 00:01:00:01:32:42:50:33:52:54:00:12:34:563209worker2 # [ 14.569027] systemd[1]: Reached target Preparation for Network.3210worker1 # [ 14.589940] dhcpcd[622]: eth0: IAID 00:12:34:563211worker1 # [ 14.590626] dhcpcd[622]: eth0: adding address fe80::5054:ff:fe12:34563212worker2 # [ 14.577464] systemd[1]: Starting DHCP Client...3213worker1 # [ 14.601328] network-addresses-eth1-start[679]: adding address 2001:db8:1::3/64... done3214worker2 # [ 14.582920] systemd[1]: Starting Address configuration of eth1...3215worker2 # [ 14.591847] systemd[1]: Starting Extra networking commands....3216worker1 # [ 14.625279] systemd[1]: Finished Address configuration of eth1.3217worker1 # [ 14.715934] mousedev: PS/2 mouse device common for all mice3218lb # [ 14.734521] 8021q: adding VLAN 0 to HW filter on device eth03219lb # [ 14.717467] dhcpcd[691]: eth0: waiting for carrier3220lb # [ 14.719218] dhcpcd[691]: libudev: received NULL device3221lb # [ 14.721078] dhcpcd[691]: libudev: received NULL device3222lb # [ 14.724539] dhcpcd[691]: eth0: carrier acquired3223lb # [ 14.741457] dhcpcd[691]: DUID 00:01:00:01:32:42:50:34:52:54:00:12:34:563224lb # [ 14.744285] dhcpcd[691]: eth0: IAID 00:12:34:563225lb # [ 14.746800] dhcpcd[691]: eth0: adding address fe80::5054:ff:fe12:34563226client # [ 14.806433] systemd[1]: Finished Extra networking commands..3227client # [ 14.811206] systemd[1]: Reached target Network.3228client # [ 14.820345] systemd[1]: Starting Permit User Sessions...3229worker1 # [ 14.814527] systemd-logind[501]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3230worker2 # [ 14.805983] network-addresses-eth1-start[670]: adding address 192.168.1.4/24... done3231lb # [ 14.835799] postgresql-pre-start[719]: The files belonging to this database system will be owned by user "postgres".3232lb # [ 14.840273] postgresql-pre-start[719]: This user must also own the server process.3233client # [ 14.884532] systemd[1]: Finished Permit User Sessions.3234client # [ 14.898236] systemd[1]: Started Getty on tty1.3235client # [ 14.901741] systemd[1]: Reached target Login Prompts.3236lb # [ 14.859811] postgresql-pre-start[719]: The database cluster will be initialized with locale "en_US.UTF-8".3237lb # [ 14.863446] postgresql-pre-start[719]: The default database encoding has accordingly been set to "UTF8".3238lb # [ 14.868380] postgresql-pre-start[719]: The default text search configuration will be set to "english".3239lb # [ 14.870814] postgresql-pre-start[719]: Data page checksums are enabled.3240lb # [ 14.871776] postgresql-pre-start[719]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3241worker2 # [ 14.861061] network-addresses-eth1-start[670]: adding address 2001:db8:1::4/64... done3242lb # [ 14.881098] postgresql-pre-start[719]: creating subdirectories ... ok3243lb # [ 14.884879] postgresql-pre-start[719]: selecting dynamic shared memory implementation ... posix3244worker2 # [ 14.904684] systemd[1]: Finished Address configuration of eth1.3245client # [ 14.979671] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs3246worker2 # [ 14.942228] dhcpcd[678]: dhcpcd-10.3.2 starting3247client # [ 14.999964] systemd[1]: Starting Virtual Console Setup...3248worker2 # [ 14.978286] dhcpcd[719]: dev: loaded udev3249client # [ 15.034247] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3250client # [ 15.038055] systemd[1]: Stopped Virtual Console Setup.3251client # [ 15.049868] systemd[1]: Starting Virtual Console Setup...3252worker2 # [ 15.078655] 8021q: 802.1Q VLAN Support v1.83253worker2 # [ 15.079080] 8021q: adding VLAN 0 to HW filter on device eth13254worker2 # [ 15.087923] systemd[1]: Finished Extra networking commands..3255worker2 # [ 15.093104] systemd[1]: Reached target Network.3256client # [ 15.179504] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.3257worker2 # [ 15.133245] systemd[1]: Starting Permit User Sessions...3258lb # [ 15.174711] postgresql-pre-start[719]: selecting default "max_connections" ... 1003259client # [ 15.231311] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.3260client # [ 15.242810] systemd[1]: Started backdoor.service.3261worker2 # [ 15.282448] cfg80211: Loading compiled-in X.509 certificates for regulatory database3262worker2 # [ 15.274698] systemd[1]: Finished Permit User Sessions.3263worker2 # [ 15.296863] systemd[1]: Started Getty on tty1.3264worker2 # [ 15.297702] systemd[1]: Reached target Login Prompts.3265client # [ 15.387464] 8021q: 802.1Q VLAN Support v1.83266client # connecting to host...3267worker2 # [ 15.367103] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3268worker2 # [ 15.367661] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3269worker2 # [ 15.377264] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23270worker2 # [ 15.377662] cfg80211: failed to load regulatory.db3271lb # [ 15.385710] postgresql-pre-start[719]: selecting default "shared_buffers" ... 128MB3272client: Guest shell says: b'Spawning backdoor root shell...\n'3273client # [ 15.438935] (udev-worker)[386]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3274client # [ 15.444678] (udev-worker)[386]: Network interface NamePolicy= disabled on kernel command line.3275client: connected to guest root shell3276client: (connecting took 16.02 seconds)3277client: (finished: waiting for the VM to finish booting, in 16.02 seconds)3278client # [ 15.686634] cfg80211: Loading compiled-in X.509 certificates for regulatory database3279client # [ 15.710473] (udev-worker)[395]: Network interface NamePolicy= disabled on kernel command line.3280client # [ 15.806163] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3281client # [ 15.807012] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3282client # [ 15.818679] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23283client # [ 15.819160] cfg80211: failed to load regulatory.db3284worker2 # [ 15.803384] 8021q: adding VLAN 0 to HW filter on device eth03285worker2 # [ 15.822247] dhcpcd[719]: eth0: waiting for carrier3286worker2 # [ 15.826401] dhcpcd[719]: libudev: received NULL device3287worker2 # [ 15.827460] dhcpcd[719]: libudev: received NULL device3288worker2 # [ 15.848120] dhcpcd[719]: eth0: carrier acquired3289worker2 # [ 15.921952] dhcpcd[719]: DUID 00:01:00:01:32:42:50:35:52:54:00:12:34:563290worker2 # [ 15.924496] dhcpcd[719]: eth0: IAID 00:12:34:563291worker2 # [ 15.925211] dhcpcd[719]: eth0: adding address fe80::5054:ff:fe12:34563292worker2 # [ 16.072826] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33293client # [ 16.114386] systemd[1]: Condition check resulted in Virtio network device being skipped.3294client # [ 16.115739] systemd[1]: Starting Address configuration of eth1...3295client # [ 16.340298] 8021q: adding VLAN 0 to HW filter on device eth13296client # [ 16.346207] 8021q: adding VLAN 0 to HW filter on device eth03297client # [ 16.334119] dhcpcd[530]: eth0: waiting for carrier3298client # [ 16.336725] dhcpcd[530]: eth0: carrier acquired3299client # [ 16.356197] network-addresses-eth1-start[613]: adding address 192.168.1.1/24... done3300client # [ 16.361095] dhcpcd[530]: DUID 00:01:00:01:32:42:50:35:52:54:00:12:34:563301client # [ 16.365733] dhcpcd[530]: eth0: IAID 00:12:34:563302client # [ 16.367852] dhcpcd[530]: eth0: adding address fe80::5054:ff:fe12:34563303client # [ 16.395915] network-addresses-eth1-start[613]: adding address 2001:db8:1::1/64... done3304client # [ 16.423880] systemd[1]: Finished Address configuration of eth1.3305client # [ 16.479858] systemd-vconsole-setup[587]: Configuration of first virtual console was skipped, ignoring remaining ones.3306client # [ 16.492426] systemd[1]: Finished Virtual Console Setup.3307worker1 # [ 16.469614] dhcpcd[622]: eth0: soliciting an IPv6 router3308worker1 # [ 16.472146] dhcpcd[622]: eth0: Router Advertisement from fe80::23309worker1 # [ 16.476395] dhcpcd[622]: eth0: adding address fec0::5054:ff:fe12:3456/643310worker1 # [ 16.478424] dhcpcd[622]: eth0: adding route to fec0::/643311worker1 # [ 16.479905] dhcpcd[622]: eth0: adding default route via fe80::23312worker1 # [ 16.518548] dhcpcd[622]: eth0: soliciting a DHCP lease3313worker1 # [ 16.524756] dhcpcd[622]: eth0: offered 10.0.2.15 from 10.0.2.23314worker1 # [ 16.536433] dhcpcd[622]: eth0: probing address 10.0.2.15/243315lb # [ 16.641959] dhcpcd[691]: eth0: soliciting a DHCP lease3316lb # [ 16.645171] dhcpcd[691]: eth0: offered 10.0.2.15 from 10.0.2.23317lb # [ 16.648343] dhcpcd[691]: eth0: probing address 10.0.2.15/243318client # [ 16.835604] systemd-logind[425]: Watching system buttons on /dev/input/event0 (gpio-keys)3319client # [ 16.905031] dhcpcd[530]: eth0: soliciting a DHCP lease3320client # [ 16.906255] dhcpcd[530]: eth0: offered 10.0.2.15 from 10.0.2.23321client # [ 16.931426] dhcpcd[530]: eth0: probing address 10.0.2.15/243322worker2 # [ 16.879814] dhcpcd[719]: eth0: soliciting a DHCP lease3323worker2 # [ 16.895427] dhcpcd[719]: eth0: offered 10.0.2.15 from 10.0.2.23324worker2 # [ 16.920530] dhcpcd[719]: eth0: probing address 10.0.2.15/243325worker1 # [ 17.053025] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3326lb # [ 17.131095] dhcpcd[691]: eth0: soliciting an IPv6 router3327lb # [ 17.137967] dhcpcd[691]: eth0: Router Advertisement from fe80::23328worker1 # [ 17.135422] systemd[1]: Stopped Virtual Console Setup.3329lb # [ 17.158745] dhcpcd[691]: eth0: adding address fec0::5054:ff:fe12:3456/643330lb # [ 17.160581] dhcpcd[691]: eth0: adding route to fec0::/643331lb # [ 17.161827] dhcpcd[691]: eth0: adding default route via fe80::23332worker1 # [ 17.166628] systemd[1]: Stopping Virtual Console Setup...3333client # [ 17.234239] mousedev: PS/2 mouse device common for all mice3334worker1 # [ 17.221845] systemd[1]: Starting Virtual Console Setup...3335worker2 # [ 17.209288] systemd[1]: Starting Virtual Console Setup...3336worker1 # [ 17.331486] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3337worker2 # [ 17.317531] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3338worker2 # [ 17.331879] systemd[1]: Stopped Virtual Console Setup.3339worker2 # [ 17.367522] systemd[1]: Starting Virtual Console Setup...3340worker1 # [ 17.409830] systemd[1]: Stopped Virtual Console Setup.3341worker1 # [ 17.457166] systemd[1]: Starting Virtual Console Setup...3342client: (finished: waiting for unit network-addresses-eth1.service, in 18.08 seconds)3343client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3344worker1 # [ 17.586946] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3345worker2 # [ 17.703602] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3346client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.26 seconds)3347lb: waiting for unit network-addresses-eth1.service3348lb: waiting for the VM to finish booting3349lb: Guest shell says: b'Spawning backdoor root shell...\n'3350lb: connected to guest root shell3351lb: (connecting took 0.00 seconds)3352lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3353worker2 # [ 17.818514] dhcpcd[719]: eth0: soliciting an IPv6 router3354worker2 # [ 17.829825] dhcpcd[719]: eth0: Router Advertisement from fe80::23355worker2 # [ 17.839585] dhcpcd[719]: eth0: adding address fec0::5054:ff:fe12:3456/643356worker2 # [ 17.854723] dhcpcd[719]: eth0: adding route to fec0::/643357worker2 # [ 17.857041] systemd-logind[595]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3358worker2 # [ 17.859384] dhcpcd[719]: eth0: adding default route via fe80::23359worker1 # [ 17.919298] systemd-logind[501]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3360client # [ 17.989409] systemd-logind[425]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3361lb: (finished: waiting for unit network-addresses-eth1.service, in 0.17 seconds)3362lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3363lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.08 seconds)3364worker1: waiting for unit network-addresses-eth1.service3365worker1: waiting for the VM to finish booting3366worker1: Guest shell says: b'Spawning backdoor root shell...\n'3367worker1: connected to guest root shell3368worker1: (connecting took 0.00 seconds)3369worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3370client # [ 18.139655] dhcpcd[530]: eth0: soliciting an IPv6 router3371client # [ 18.142244] dhcpcd[530]: eth0: Router Advertisement from fe80::23372client # [ 18.143195] dhcpcd[530]: eth0: adding address fec0::5054:ff:fe12:3456/643373client # [ 18.144647] dhcpcd[530]: eth0: adding route to fec0::/643374client # [ 18.145477] dhcpcd[530]: eth0: adding default route via fe80::23375worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3376worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3377worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3378worker2: waiting for unit network-addresses-eth1.service3379worker2: waiting for the VM to finish booting3380worker2: Guest shell says: b'Spawning backdoor root shell...\n'3381worker2: connected to guest root shell3382worker2: (connecting took 0.00 seconds)3383worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3384worker1 # [ 18.182223] systemd-vconsole-setup[714]: Configuration of first virtual console was skipped, ignoring remaining ones.3385lb # [ 18.191476] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33386worker1 # [ 18.192691] systemd[1]: Finished Virtual Console Setup.3387worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.13 seconds)3388worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3389worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3390lb: waiting for unit niks3.service3391worker2 # [ 18.393721] systemd-vconsole-setup[770]: Configuration of first virtual console was skipped, ignoring remaining ones.3392worker2 # [ 18.400641] systemd[1]: Finished Virtual Console Setup.3393lb # [ 18.790197] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3394lb # [ 18.804390] systemd[1]: Starting Virtual Console Setup...3395lb # [ 18.871108] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3396lb # [ 18.876704] systemd[1]: Stopped Virtual Console Setup.3397lb # [ 18.942793] systemd[1]: Starting Virtual Console Setup...3398lb # [ 19.142555] systemd-logind[532]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3399client # [ 19.455208] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3400client # [ 19.467072] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3401client # [ 19.472286] systemd[1]: Stopped Virtual Console Setup.3402client # [ 19.473231] systemd[1]: Stopping Virtual Console Setup...3403client # [ 19.477965] systemd[1]: Starting Virtual Console Setup...3404client # [ 19.510284] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3405client # [ 19.516236] systemd[1]: Stopped Virtual Console Setup.3406client # [ 19.527422] systemd[1]: Starting Virtual Console Setup...3407client # [ 19.560283] systemd-logind[425]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3408lb # [ 19.745415] systemd-vconsole-setup[777]: Configuration of first virtual console was skipped, ignoring remaining ones.3409lb # [ 19.765049] systemd[1]: Finished Virtual Console Setup.3410client # [ 19.943067] systemd-vconsole-setup[670]: Configuration of first virtual console was skipped, ignoring remaining ones.3411client # [ 19.957777] systemd[1]: Finished Virtual Console Setup.3412lb # [ 20.657316] postgresql-pre-start[719]: selecting default time zone ... UTC3413lb # [ 20.665643] postgresql-pre-start[719]: creating configuration files ... ok3414lb # [ 21.095006] dhcpcd[691]: eth0: leased 10.0.2.15 for 86400 seconds3415lb # [ 21.101564] dhcpcd[691]: eth0: adding route to 10.0.2.0/243416lb # [ 21.102436] dhcpcd[691]: eth0: adding default route via 10.0.2.23417lb # [ 21.538930] postgresql-pre-start[719]: running bootstrap script ... ok3418lb # [ 21.574079] systemd[1]: Started DHCP Client.3419lb # [ 21.578565] systemd[1]: Reached target Network is Online.3420lb # [ 21.586606] systemd[1]: Started Envoy reverse proxy.3421lb # [ 21.597344] systemd[1]: Started mock-oidc.service.3422lb # [ 21.762428] mock-oidc-server[860]: Mock OIDC Server running3423lb # [ 21.765843] mock-oidc-server[860]: OIDC Address: 192.168.1.2:80803424lb # [ 21.769092] mock-oidc-server[860]: Issue Address: 0.0.0.0:80813425lb # [ 21.770574] mock-oidc-server[860]: Issuer: http://192.168.1.2:8080/oidc3426lb # [ 21.772524] mock-oidc-server[860]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3427lb # [ 21.774262] mock-oidc-server[860]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3428lb # [ 21.775844] mock-oidc-server[860]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3429worker2 # [ 21.870606] dhcpcd[719]: eth0: leased 10.0.2.15 for 86400 seconds3430worker2 # [ 21.870807] dhcpcd[719]: eth0: adding route to 10.0.2.0/243431worker2 # [ 21.870897] dhcpcd[719]: eth0: adding default route via 10.0.2.23432worker2 # [ 22.061357] systemd[1]: Started DHCP Client.3433worker2 # [ 22.064941] systemd[1]: Reached target Multi-User System.3434worker2 # [ 22.067003] systemd[1]: Startup finished in 1.164s (kernel) + 5.603s (initrd) + 15.298s (userspace) = 22.066s.3435client # [ 22.263025] dhcpcd[530]: eth0: leased 10.0.2.15 for 86400 seconds3436client # [ 22.263224] dhcpcd[530]: eth0: adding route to 10.0.2.0/243437client # [ 22.263284] dhcpcd[530]: eth0: adding default route via 10.0.2.23438worker1 # [ 22.257052] dhcpcd[622]: eth0: leased 10.0.2.15 for 86400 seconds3439worker1 # [ 22.257595] dhcpcd[622]: eth0: adding route to 10.0.2.0/243440worker1 # [ 22.257741] dhcpcd[622]: eth0: adding default route via 10.0.2.23441client # [ 22.403468] systemd[1]: Started DHCP Client.3442client # [ 22.406052] systemd[1]: Reached target Multi-User System.3443client # [ 22.407445] systemd[1]: Startup finished in 1.155s (kernel) + 4.764s (initrd) + 16.486s (userspace) = 22.407s.3444worker1 # [ 22.444411] systemd[1]: Started DHCP Client.3445worker1 # [ 22.447096] systemd[1]: Reached target Multi-User System.3446worker1 # [ 22.448628] systemd[1]: Startup finished in 1.188s (kernel) + 4.828s (initrd) + 16.430s (userspace) = 22.446s.3447lb # [ 22.739833] postgresql-pre-start[719]: performing post-bootstrap initialization ... ok3448lb # [ 22.797837] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3449lb # [ 22.799830] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:469] statically linked extensions:3450lb # [ 22.805690] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3451lb # [ 22.824699] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3452lb # [ 22.831724] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3453lb # [ 22.838429] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3454lb # [ 22.840892] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3455lb # [ 22.843207] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3456lb # [ 22.846886] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3457lb # [ 22.849593] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3458lb # [ 22.852533] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3459lb # [ 22.855177] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3460lb # [ 22.857552] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3461lb # [ 22.886193] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3462lb # [ 22.888853] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3463lb # [ 22.892839] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3464lb # [ 22.895772] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3465lb # [ 22.898578] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3466lb # [ 22.901336] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3467lb # [ 22.905097] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3468lb # [ 22.913388] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3469lb # [ 22.920852] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3470lb # [ 22.923451] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3471lb # [ 22.926265] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3472lb # [ 22.929282] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3473lb # [ 22.931453] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3474lb # [ 22.934164] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3475lb # [ 22.938705] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3476lb # [ 22.942283] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3477lb # [ 22.944297] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3478lb # [ 22.946764] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83479lb # [ 22.949259] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3480lb # [ 22.951564] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3481lb # [ 22.955172] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3482lb # [ 22.957851] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3483lb # [ 22.963412] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3484lb # [ 22.997675] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3485lb # [ 23.001048] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3486lb # [ 23.003860] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3487lb # [ 23.007443] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3488lb # [ 23.013239] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3489lb # [ 23.016841] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3490lb # [ 23.020063] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3491lb # [ 23.023155] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3492lb # [ 23.028437] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3493lb # [ 23.032624] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3494lb # [ 23.035215] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3495lb # [ 23.038150] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3496lb # [ 23.046803] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3497lb # [ 23.050022] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3498lb # [ 23.052920] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3499lb # [ 23.055655] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3500lb # [ 23.060197] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3501lb # [ 23.062947] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3502lb # [ 23.065631] envoy[859]: [2026-09-20 08:05:16.198][859][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3503lb # [ 23.071039] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23504lb # [ 23.074146] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3505lb # [ 23.077779] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3506lb # [ 23.079973] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3507lb # [ 23.082543] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3508lb # [ 23.086737] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3509lb # [ 23.090465] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3510lb # [ 23.092894] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3511lb # [ 23.096691] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3512lb # [ 23.098994] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3513lb # [ 23.108441] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3514lb # [ 23.111720] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3515lb # [ 23.118519] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3516lb # [ 23.121041] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13517lb # [ 23.124160] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3518lb # [ 23.126485] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3519lb # [ 23.129487] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3520lb # [ 23.133112] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23521lb # [ 23.135098] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3522lb # [ 23.137830] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3523lb # [ 23.144417] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3524lb # [ 23.148773] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3525lb # [ 23.152935] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3526lb # [ 23.155614] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3527lb # [ 23.161355] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3528lb # [ 23.163747] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3529lb # [ 23.166323] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3530lb # [ 23.169130] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3531lb # [ 23.172575] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3532lb # [ 23.176110] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3533lb # [ 23.178235] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3534lb # [ 23.181252] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3535lb # [ 23.196994] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3536lb # [ 23.199123] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3537lb # [ 23.206219] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3538lb # [ 23.211598] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3539lb # [ 23.217570] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3540lb # [ 23.225938] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3541lb # [ 23.228540] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3542lb # [ 23.233251] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3543lb # [ 23.237050] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3544lb # [ 23.240044] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3545lb # [ 23.242532] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3546lb # [ 23.245623] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23547lb # [ 23.247892] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3548lb # [ 23.260158] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3549lb # [ 23.262521] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3550lb # [ 23.265771] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3551lb # [ 23.268034] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3552lb # [ 23.271166] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3553lb # [ 23.274456] envoy[859]: [2026-09-20 08:05:16.199][859][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3554lb # [ 23.284885] envoy[859]: [2026-09-20 08:05:16.226][859][info][main] [source/server/server.cc:531] HTTP header map info:3555worker1 # [ 23.306715] systemd[1]: Starting Nix worker-protocol over gRPC...3556lb # [ 23.286681] envoy[859]: [2026-09-20 08:05:16.231][859][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3557lb # [ 23.304682] envoy[859]: [2026-09-20 08:05:16.231][859][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3558lb # [ 23.306769] envoy[859]: [2026-09-20 08:05:16.231][859][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3559lb # [ 23.321075] envoy[859]: [2026-09-20 08:05:16.231][859][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3560lb # [ 23.324434] envoy[859]: [2026-09-20 08:05:16.390][859][info][main] [source/server/server.cc:968] runtime: {}3561lb # [ 23.326913] envoy[859]: [2026-09-20 08:05:16.408][859][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3562lb # [ 23.333390] envoy[859]: [2026-09-20 08:05:16.409][859][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013563worker2 # [ 23.322397] systemd[1]: Starting Nix worker-protocol over gRPC...3564lb # [ 23.336387] envoy[859]: [2026-09-20 08:05:16.409][859][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013565lb # [ 23.341519] envoy[859]: [2026-09-20 08:05:16.415][859][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3566lb # [ 23.348414] envoy[859]: [2026-09-20 08:05:16.415][859][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3567lb # [ 23.350189] envoy[859]: [2026-09-20 08:05:16.415][859][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3568lb # [ 23.351892] envoy[859]: [2026-09-20 08:05:16.719][859][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3569lb # [ 23.354123] envoy[859]: [2026-09-20 08:05:16.748][859][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3570lb # [ 23.357676] envoy[859]: [2026-09-20 08:05:16.749][859][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3571lb # [ 23.361923] envoy[859]: [2026-09-20 08:05:16.749][859][info][main] [source/server/server.cc:1077] starting main dispatch loop3572lb # [ 23.459136] postgresql-pre-start[719]: syncing data to disk ... ok3573lb # [ 23.460332] postgresql-pre-start[719]: initdb: warning: enabling "trust" authentication for local connections3574lb # [ 23.461650] postgresql-pre-start[719]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3575lb # [ 23.463690] postgresql-pre-start[719]: Success. You can now start the database server using:3576lb # [ 23.465006] postgresql-pre-start[719]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3577worker1 # [ 23.567853] nix-grpc-daemon[787]: ts=2026-09-20T08:05:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3578worker1 # [ 23.580610] nix-grpc-daemon[787]: ts=2026-09-20T08:05:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13579worker1 # [ 23.627116] nix-grpc-daemon[787]: ts=2026-09-20T08:05:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3580worker2 # [ 23.607073] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3581worker2 # [ 23.620330] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13582worker1 # [ 23.644109] systemd[1]: Started Nix worker-protocol over gRPC.3583lb # [ 23.657431] envoy[859]: [2026-09-20 08:05:17.059][859][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3584worker1 # [ 23.665612] nix-grpc-daemon[787]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3585lb # [ 23.661350] envoy[859]: [2026-09-20 08:05:17.062][859][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3586lb # [ 23.663909] envoy[859]: [2026-09-20 08:05:17.062][859][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3587lb # [ 23.666304] envoy[859]: [2026-09-20 08:05:17.062][859][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3588worker2 # [ 23.664419] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3589worker2 # [ 23.676161] systemd[1]: Started Nix worker-protocol over gRPC.3590worker2 # [ 23.713792] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500513591worker2 # [ 23.722705] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3592worker1 # [ 23.866491] nix-grpc-daemon[787]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3593lb # [ 23.895737] postgres[895]: [895] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3594lb # [ 23.905309] postgres[895]: [895] LOG: listening on IPv6 address "::1", port 54323595lb # [ 23.908393] postgres[895]: [895] LOG: listening on IPv4 address "127.0.0.1", port 54323596lb # [ 23.919895] postgres[895]: [895] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3597worker2 # [ 23.924087] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500513598worker2 # [ 23.944079] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3599lb # [ 23.970147] postgres[906]: [906] LOG: database system was shut down at 2026-09-20 08:05:16 GMT3600lb # [ 23.984956] postgres[895]: [895] LOG: database system is ready to accept connections3601lb # [ 23.995361] systemd[1]: Started PostgreSQL Server.3602lb # [ 24.014749] systemd[1]: Starting PostgreSQL Setup Scripts...3603worker2 # [ 24.145287] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500513604worker2 # [ 24.156112] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3605worker1 # [ 24.266972] nix-grpc-daemon[787]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3606lb # [ 24.309131] postgresql-setup-start[917]: CREATE DATABASE3607worker2 # [ 24.357696] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500513608lb # [ 24.375053] postgresql-setup-start[922]: CREATE ROLE3609worker2 # [ 24.363818] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3610lb # [ 24.404778] postgresql-setup-start[924]: ALTER DATABASE3611lb # [ 24.413492] systemd[1]: Finished PostgreSQL Setup Scripts.3612lb # [ 24.415525] systemd[1]: Reached target PostgreSQL.3613worker2 # [ 24.565001] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500513614worker2 # [ 24.573080] nix-grpc-daemon[843]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3615worker2 # [ 24.775307] nix-grpc-daemon[843]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 24.779830] nix-grpc-daemon[843]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3617worker2 # [ 24.981104] nix-grpc-daemon[843]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513618worker2 # [ 24.988258] nix-grpc-daemon[843]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3619worker1 # [ 25.072626] nix-grpc-daemon[787]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513620worker1 # [ 25.073027] nix-grpc-daemon[787]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3621worker2 # [ 25.189969] nix-grpc-daemon[843]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513622worker2 # [ 25.197796] nix-grpc-daemon[843]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3623worker1 # [ 25.273634] nix-grpc-daemon[787]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 25.281366] nix-grpc-daemon[787]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3625worker2 # [ 25.399192] nix-grpc-daemon[843]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513626worker2 # [ 25.405654] nix-grpc-daemon[843]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3627worker1 # [ 25.482808] nix-grpc-daemon[787]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513628worker1 # [ 25.490255] nix-grpc-daemon[787]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3629worker2 # [ 25.606454] nix-grpc-daemon[843]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513630worker2 # [ 25.612999] nix-grpc-daemon[843]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3631worker1 # [ 25.691748] nix-grpc-daemon[787]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513632worker1 # [ 25.699791] nix-grpc-daemon[787]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3633worker2 # [ 25.816899] nix-grpc-daemon[843]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513634worker2 # [ 25.822671] nix-grpc-daemon[843]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3635worker1 # [ 25.901215] nix-grpc-daemon[787]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513636worker1 # [ 25.908982] nix-grpc-daemon[787]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3637worker2 # [ 26.023926] nix-grpc-daemon[843]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513638worker2 # [ 26.031941] nix-grpc-daemon[843]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3639worker1 # [ 26.112979] nix-grpc-daemon[787]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513640worker1 # [ 26.119081] nix-grpc-daemon[787]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3641worker2 # [ 26.233319] nix-grpc-daemon[843]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513642worker2 # [ 26.240651] nix-grpc-daemon[843]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3643worker1 # [ 26.320267] nix-grpc-daemon[787]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513644worker1 # [ 26.327846] nix-grpc-daemon[787]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3645worker2 # [ 26.441927] nix-grpc-daemon[843]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513646worker2 # [ 26.447471] nix-grpc-daemon[843]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3647worker1 # [ 26.529147] nix-grpc-daemon[787]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513648worker1 # [ 26.535205] nix-grpc-daemon[787]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3649worker2 # [ 26.648583] nix-grpc-daemon[843]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513650worker2 # [ 26.660719] nix-grpc-daemon[843]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3651worker1 # [ 26.737012] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513652worker1 # [ 26.745166] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3653worker2 # [ 26.864531] nix-grpc-daemon[843]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513654worker2 # [ 26.867202] nix-grpc-daemon[843]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3655worker1 # [ 26.946317] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513656worker1 # [ 26.950651] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3657worker2 # [ 27.066073] nix-grpc-daemon[843]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513658worker2 # [ 27.073987] nix-grpc-daemon[843]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3659worker1 # [ 27.154780] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513660worker1 # [ 27.160974] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3661worker2 # [ 27.275131] nix-grpc-daemon[843]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513662worker2 # [ 27.282583] nix-grpc-daemon[843]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3663worker1 # [ 27.361577] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513664worker1 # [ 27.367291] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3665worker2 # [ 27.484208] nix-grpc-daemon[843]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513666worker2 # [ 27.492122] nix-grpc-daemon[843]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3667worker1 # [ 27.569342] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513668worker1 # [ 27.576539] nix-grpc-daemon[787]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3669worker2 # [ 27.693481] nix-grpc-daemon[843]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513670worker2 # [ 27.701967] nix-grpc-daemon[843]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3671worker1 # [ 27.777486] nix-grpc-daemon[787]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513672worker1 # [ 27.782207] nix-grpc-daemon[787]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3673worker2 # [ 27.904159] nix-grpc-daemon[843]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513674worker2 # [ 27.909765] nix-grpc-daemon[843]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3675worker1 # [ 27.983183] nix-grpc-daemon[787]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513676worker1 # [ 27.988325] nix-grpc-daemon[787]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3677worker2 # [ 28.111164] nix-grpc-daemon[843]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513678worker2 # [ 28.119660] nix-grpc-daemon[843]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3679worker1 # [ 28.193235] nix-grpc-daemon[787]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 28.198690] nix-grpc-daemon[787]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3681worker2 # [ 28.321539] nix-grpc-daemon[843]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513682worker2 # [ 28.333090] nix-grpc-daemon[843]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3683worker1 # [ 28.395785] nix-grpc-daemon[787]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513684worker1 # [ 28.409393] nix-grpc-daemon[787]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3685worker2 # [ 28.534116] nix-grpc-daemon[843]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513686worker2 # [ 28.538401] nix-grpc-daemon[843]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3687worker1 # [ 28.610793] nix-grpc-daemon[787]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513688worker1 # [ 28.618942] nix-grpc-daemon[787]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3689worker2 # [ 28.739666] nix-grpc-daemon[843]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513690worker2 # [ 28.747888] nix-grpc-daemon[843]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3691worker1 # [ 28.820717] nix-grpc-daemon[787]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513692worker1 # [ 28.829083] nix-grpc-daemon[787]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3693worker2 # [ 28.949794] nix-grpc-daemon[843]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513694worker2 # [ 28.955989] nix-grpc-daemon[843]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3695worker1 # [ 29.030706] nix-grpc-daemon[787]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513696worker1 # [ 29.040606] nix-grpc-daemon[787]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3697worker2 # [ 29.157238] nix-grpc-daemon[843]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513698worker2 # [ 29.164199] nix-grpc-daemon[843]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3699worker1 # [ 29.242267] nix-grpc-daemon[787]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513700worker1 # [ 29.247438] nix-grpc-daemon[787]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3701worker2 # [ 29.365610] nix-grpc-daemon[843]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513702worker2 # [ 29.374095] nix-grpc-daemon[843]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3703lb # [ 29.404939] rustfs-bucket-start[974]: mb s3://farm3704lb # [ 29.414331] systemd[1]: Finished rustfs-bucket.service.3705lb # [ 29.423511] systemd[1]: Starting niks3 server...3706worker1 # [ 29.449243] nix-grpc-daemon[787]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513707worker1 # [ 29.457070] nix-grpc-daemon[787]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3708worker2 # [ 29.575450] nix-grpc-daemon[843]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513709worker2 # [ 29.583173] nix-grpc-daemon[843]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3710worker1 # [ 29.658636] nix-grpc-daemon[787]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513711worker1 # [ 29.668635] nix-grpc-daemon[787]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3712lb # [ 29.731431] postgres[989]: [989] ERROR: relation "goose_db_version" does not exist at character 363713lb # [ 29.733474] postgres[989]: [989] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3714lb # [ 29.776984] niks3-server[983]: 2026/09/20 08:05:23 OK 20241026095416_initial_model.sql (25.68ms)3715lb # [ 29.782210] niks3-server[983]: 2026/09/20 08:05:23 OK 20251210153512_drop_unused_gin_index.sql (5.47ms)3716lb # [ 29.790504] niks3-server[983]: 2026/09/20 08:05:23 OK 20251218171726_add_pins.sql (8.24ms)3717lb # [ 29.802345] niks3-server[983]: 2026/09/20 08:05:23 OK 20260628120000_add_object_size_and_stats.sql (11.74ms)3718worker2 # [ 29.785519] nix-grpc-daemon[843]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513719lb # [ 29.810783] niks3-server[983]: 2026/09/20 08:05:23 OK 20260905000000_add_claims.sql (8.37ms)3720worker2 # [ 29.795707] nix-grpc-daemon[843]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3721lb # [ 29.818268] niks3-server[983]: 2026/09/20 08:05:23 OK 20260920000000_drop_claims.sql (7.27ms)3722lb # [ 29.819686] niks3-server[983]: 2026/09/20 08:05:23 goose: successfully migrated database to version: 202609200000003723lb # [ 29.826689] niks3-server[983]: 2026/09/20 08:05:23 OK 1_commit_pending_closure.sql (8.4ms)3724lb # [ 29.830655] niks3-server[983]: 2026/09/20 08:05:23 OK 2_object_stats_trigger.sql (3.78ms)3725lb # [ 29.832174] niks3-server[983]: 2026/09/20 08:05:23 goose: up to current file version: 23726lb # [ 29.836959] niks3-server[983]: 2026/09/20 08:05:23 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3727worker1 # [ 29.870538] nix-grpc-daemon[787]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513728worker1 # [ 29.878443] nix-grpc-daemon[787]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3729lb # [ 29.909146] niks3-server[983]: 2026/09/20 08:05:23 INFO Read proxy enabled — serving cache objects from S33730lb # [ 29.910740] niks3-server[983]: 2026/09/20 08:05:23 INFO Using socket-activated listener address=0.0.0.0:57513731lb # [ 29.914419] systemd[1]: Started niks3 server.3732lb # [ 29.915238] niks3-server[983]: 2026/09/20 08:05:23 INFO systemd watchdog enabled interval=15s3733lb # [ 29.922368] niks3-server[983]: 2026/09/20 08:05:23 INFO Starting HTTP server address=0.0.0.0:57513734lb # [ 29.927661] systemd[1]: Reached target Multi-User System.3735lb # [ 29.931565] niks3-server[983]: 2026/09/20 08:05:23 INFO lead: acquired remote=192.168.1.4:448943736worker2 # [ 29.923341] nix-grpc-daemon[843]: ts=2026-09-20T08:05:23Z level=info event=scheduler_take_over3737lb # [ 29.935458] systemd[1]: Startup finished in 1.176s (kernel) + 5.487s (initrd) + 23.255s (userspace) = 29.919s.3738worker2 # [ 30.000979] nix-grpc-daemon[843]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513739worker2 # [ 30.003373] nix-grpc-daemon[843]: ts=2026-09-20T08:05:23Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03740worker1 # [ 30.079930] nix-grpc-daemon[787]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513741worker1 # [ 30.087042] nix-grpc-daemon[787]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3742lb: (finished: waiting for unit niks3.service, in 11.92 seconds)3743lb: waiting for TCP port 5751 on localhost3744worker2 # [ 30.270255] nix-grpc-daemon[843]: ts=2026-09-20T08:05:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03745worker1 # [ 30.290122] nix-grpc-daemon[787]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513746lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3747lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds)3748lb: waiting for unit envoy.service3749lb: (finished: waiting for unit envoy.service, in 0.09 seconds)3750lb: waiting for TCP port 50051 on localhost3751lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3752lb # [ 30.492847] envoy[859]: conn peer=[::1]:38756 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=43753lb: (finished: waiting for TCP port 50051 on localhost, in 0.06 seconds)3754lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3755??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3756 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283757lb: must succeed: curl -sf localhost:9901/clusters3758lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.15 seconds)3759lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.15 seconds)3760subtest: one node schedules and both builders hold a WorkerSession on it3761lb: must succeed: curl -sf localhost:9901/clusters3762lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3763worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3764worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.11 seconds)3765(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.17 seconds)3766subtest: balancer auth: client cert, bearer token, nothing, unknown CN3767worker1 # [ 31.341431] nix-grpc-daemon[787]: ts=2026-09-20T08:05:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:475263768worker1 # [ 31.359478] systemd[1]: Started Nix Daemon.3769worker1 # [ 31.668835] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)3770worker1 # [ 31.713360] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5)3771worker1 # [ 31.799463] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 2/5)3772worker1 # [ 31.896140] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 323 ms (attempt 3/5)3773worker1 # [ 32.227620] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 451 ms (attempt 4/5)3774worker1 # [ 32.690649] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3775worker2 # [ 32.709489] nix-grpc-daemon[843]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:343423776worker2 # [ 32.733117] systemd[1]: Started Nix Daemon.3777worker2 # [ 33.066509] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)3778worker2 # [ 33.099303] nix-grpc-daemon[843]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5)3779worker2 # [ 33.154621] nix-grpc-daemon[843]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 2/5)3780worker2 # [ 33.310594] nix-grpc-daemon[843]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 3/5)3781worker2 # [ 33.317369] nix-grpc-daemon[843]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 250 ms (attempt 4/5)3782worker2 # [ 33.569270] nix-grpc-daemon[843]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3783worker2 # [ 33.582753] nix-grpc-daemon[843]: ts=2026-09-20T08:05:26Z level=debug event=path_info_miss path=rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test error="error: path '/nix/store/rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test' is required, but there is no substituter that can build it"3784worker1 # [ 33.613172] nix-grpc-daemon[787]: ts=2026-09-20T08:05:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:475263785worker1 # [ 33.622194] nix-grpc-daemon[787]: ts=2026-09-20T08:05:27Z level=debug event=path_info_miss path=rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test error="error: path '/nix/store/rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test' is required, but there is no substituter that can build it"3786client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3787client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds)3788client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3789client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3790worker1 # [ 34.073668] nix-grpc-daemon[787]: ts=2026-09-20T08:05:27Z level=info event=oidc_jwks provider=mock keys=13791worker1 # [ 34.079579] nix-grpc-daemon[787]: ts=2026-09-20T08:05:27Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:475263792worker2 # [ 34.083253] nix-grpc-daemon[843]: ts=2026-09-20T08:05:27Z level=info event=oidc_jwks provider=mock keys=13793worker2 # [ 34.086166] nix-grpc-daemon[843]: ts=2026-09-20T08:05:27Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:343423794worker2 # [ 34.091354] nix-grpc-daemon[843]: ts=2026-09-20T08:05:27Z level=debug event=path_info_miss path=rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test error="error: path '/nix/store/rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test' is required, but there is no substituter that can build it"3795worker1 # [ 34.119809] nix-grpc-daemon[787]: ts=2026-09-20T08:05:27Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:475263796worker1 # [ 34.130462] nix-grpc-daemon[787]: ts=2026-09-20T08:05:27Z level=debug event=path_info_miss path=rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test error="error: path '/nix/store/rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test' is required, but there is no substituter that can build it"3797client: must succeed: rm -r /var/lib/nix-grpc-store3798client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3799worker1 # [ 36.452600] nix-grpc-daemon[787]: ts=2026-09-20T08:05:29Z level=info event=denied method=QueryMissing cn=- role=none3800worker1 # [ 36.727259] nix-grpc-daemon[787]: ts=2026-09-20T08:05:30Z level=info event=denied method=QueryMissing cn=stranger role=none3801(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.75 seconds)3802subtest: DAG build is scheduled across workers and lands in the cache3803client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&23804worker2 # [ 36.992714] nix-grpc-daemon[843]: ts=2026-09-20T08:05:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:343423805client # don't know how to build these paths:3806client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3807worker2 # [ 37.022961] nix-grpc-daemon[843]: ts=2026-09-20T08:05:30Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03808worker2 # [ 37.026960] nix-grpc-daemon[843]: ts=2026-09-20T08:05:30Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=13809worker2 # [ 37.071860] nix-grpc-daemon[843]: ts=2026-09-20T08:05:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343423810worker2 # [ 37.091500] nix-grpc-daemon[843]: ts=2026-09-20T08:05:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343423811client # copying 1 paths to 'lb:50051'...3812worker2 # [ 37.109345] nix-grpc-daemon[843]: ts=2026-09-20T08:05:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343423813client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3814worker2 # [ 37.131745] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)3815worker2 # [ 37.161763] nix-grpc-daemon[843]: ts=2026-09-20T08:05:30Z level=info event=niks3_push_started pid=9173816worker2 # [ 37.707313] nix-daemon[905]: accepted connection from pid 930, user nix-grpc-daemon (trusted)3817worker2 # [ 37.731221] nix-daemon[905]: reaped child process 933, status = succeeded3818worker2 # [ 37.937093] nix-daemon[905]: accepted connection from pid 935, user nix-grpc-daemon (trusted)3819worker2 # [ 37.963713] nix-daemon[905]: reaped child process 938, status = succeeded3820lb # [ 37.990506] niks3-server[983]: 2026/09/20 08:05:31 INFO Received uploads request method=POST path=/api/pending_closures3821worker2 # [ 37.998841] nix-grpc-daemon[917]: time=2026-09-20T08:05:31.414Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3822worker2 # [ 38.003617] nix-grpc-daemon[917]: time=2026-09-20T08:05:31.416Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3823lb # [ 38.050238] niks3-server[983]: 2026/09/20 08:05:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3824lb # [ 38.061489] niks3-server[983]: 2026/09/20 08:05:31 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3825lb # [ 38.084424] niks3-server[983]: 2026/09/20 08:05:31 INFO Signed narinfos id=1 count=13826worker2 # [ 38.075106] nix-grpc-daemon[917]: time=2026-09-20T08:05:31.490Z level=INFO msg="Uploading 1 narinfos"3827lb # [ 38.104332] niks3-server[983]: 2026/09/20 08:05:31 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3828lb # [ 38.114556] niks3-server[983]: 2026/09/20 08:05:31 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3829lb # [ 38.125659] niks3-server[983]: 2026/09/20 08:05:31 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3830lb # [ 38.131876] niks3-server[983]: 2026/09/20 08:05:31 INFO Completed upload id=13831worker2 # [ 38.120698] nix-grpc-daemon[917]: time=2026-09-20T08:05:31.536Z level=INFO msg="Upload complete. (627ms)"3832worker2 # [ 38.133375] nix-grpc-daemon[843]: ts=2026-09-20T08:05:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=1 paths=1 nar_bytes_in=5043833worker2 # [ 38.148662] nix-grpc-daemon[843]: ts=2026-09-20T08:05:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343423834worker2 # [ 38.163332] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)3835worker2 # [ 38.167090] nix-daemon[905]: reaped child process 915, status = succeeded3836client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3837client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3838worker2 # [ 38.180689] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)3839client # farm-a> LOG-farm-a-t13840worker2 # [ 39.018231] nix-daemon[905]: reaped child process 942, status = succeeded3841worker2 # [ 39.216942] nix-daemon[905]: accepted connection from pid 958, user nix-grpc-daemon (trusted)3842worker2 # [ 39.239405] nix-daemon[905]: reaped child process 961, status = succeeded3843lb # [ 39.266171] niks3-server[983]: 2026/09/20 08:05:32 INFO Received uploads request method=POST path=/api/pending_closures3844worker2 # [ 39.270300] nix-grpc-daemon[917]: time=2026-09-20T08:05:32.685Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3845worker2 # [ 39.272965] nix-grpc-daemon[917]: time=2026-09-20T08:05:32.687Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3846lb # [ 39.328404] niks3-server[983]: 2026/09/20 08:05:32 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3847lb # [ 39.342935] niks3-server[983]: 2026/09/20 08:05:32 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3848lb # [ 39.360660] niks3-server[983]: 2026/09/20 08:05:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3849worker2 # [ 39.356152] nix-grpc-daemon[917]: time=2026-09-20T08:05:32.770Z level=INFO msg="Uploading 1 narinfos"3850lb # [ 39.368651] niks3-server[983]: 2026/09/20 08:05:32 INFO Signed narinfos id=2 count=13851lb # [ 39.372340] niks3-server[983]: 2026/09/20 08:05:32 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3852lb # [ 39.389544] niks3-server[983]: 2026/09/20 08:05:32 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3853lb # [ 39.399392] niks3-server[983]: 2026/09/20 08:05:32 INFO Completed upload id=23854worker2 # [ 39.388295] nix-grpc-daemon[917]: time=2026-09-20T08:05:32.803Z level=INFO msg="Upload complete. (390ms)"3855lb # [ 39.403756] niks3-server[983]: 2026/09/20 08:05:32 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3856worker2 # [ 39.418034] nix-grpc-daemon[843]: ts=2026-09-20T08:05:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13857worker2 # [ 39.434964] nix-grpc-daemon[843]: ts=2026-09-20T08:05:32Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03858worker2 # [ 39.438609] nix-grpc-daemon[843]: ts=2026-09-20T08:05:32Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=13859worker2 # [ 39.442085] nix-daemon[905]: reaped child process 940, status = succeeded3860worker2 # [ 39.463256] nix-grpc-daemon[843]: ts=2026-09-20T08:05:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343423861worker2 # [ 39.482899] nix-grpc-daemon[843]: ts=2026-09-20T08:05:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343423862worker2 # [ 39.503472] nix-grpc-daemon[917]: time=2026-09-20T08:05:32.919Z level=INFO msg="All 1 paths already cached"3863client # copying 1 paths to 'lb:50051'...3864client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3865worker2 # [ 39.517104] nix-grpc-daemon[843]: ts=2026-09-20T08:05:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343423866worker2 # [ 39.537242] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)3867worker2 # [ 39.772319] nix-daemon[905]: accepted connection from pid 967, user nix-grpc-daemon (trusted)3868worker2 # [ 39.797804] nix-daemon[905]: reaped child process 970, status = succeeded3869worker2 # [ 39.988193] nix-daemon[905]: accepted connection from pid 972, user nix-grpc-daemon (trusted)3870worker2 # [ 40.010336] nix-daemon[905]: reaped child process 975, status = succeeded3871lb # [ 40.038635] niks3-server[983]: 2026/09/20 08:05:33 INFO Received uploads request method=POST path=/api/pending_closures3872worker2 # [ 40.042585] nix-grpc-daemon[917]: time=2026-09-20T08:05:33.457Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3873worker2 # [ 40.044314] nix-grpc-daemon[917]: time=2026-09-20T08:05:33.457Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3874lb # [ 40.082203] niks3-server[983]: 2026/09/20 08:05:33 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3875lb # [ 40.094006] niks3-server[983]: 2026/09/20 08:05:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3876worker2 # [ 40.089260] nix-grpc-daemon[917]: time=2026-09-20T08:05:33.504Z level=INFO msg="Uploading 1 narinfos"3877lb # [ 40.105620] niks3-server[983]: 2026/09/20 08:05:33 INFO Signed narinfos id=3 count=13878lb # [ 40.111660] niks3-server[983]: 2026/09/20 08:05:33 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3879lb # [ 40.122137] niks3-server[983]: 2026/09/20 08:05:33 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3880lb # [ 40.132621] niks3-server[983]: 2026/09/20 08:05:33 INFO Completed upload id=33881worker2 # [ 40.120264] nix-grpc-daemon[917]: time=2026-09-20T08:05:33.535Z level=INFO msg="Upload complete. (562ms)"3882lb # [ 40.135457] niks3-server[983]: 2026/09/20 08:05:33 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3883worker2 # [ 40.132557] nix-grpc-daemon[843]: ts=2026-09-20T08:05:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=0 paths=1 nar_bytes_in=6243884worker2 # [ 40.148464] nix-grpc-daemon[843]: ts=2026-09-20T08:05:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343423885worker2 # [ 40.156682] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)3886worker2 # [ 40.163124] nix-daemon[905]: reaped child process 965, status = succeeded3887client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3888client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3889worker2 # [ 40.178306] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)3890client # farm-b> LOG-farm-b-t13891worker2 # [ 41.027951] nix-daemon[905]: reaped child process 979, status = succeeded3892worker2 # [ 41.247121] nix-daemon[905]: accepted connection from pid 994, user nix-grpc-daemon (trusted)3893worker2 # [ 41.270350] nix-daemon[905]: reaped child process 997, status = succeeded3894lb # [ 41.300511] niks3-server[983]: 2026/09/20 08:05:34 INFO Received uploads request method=POST path=/api/pending_closures3895worker2 # [ 41.298193] nix-grpc-daemon[917]: time=2026-09-20T08:05:34.712Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3896worker2 # [ 41.299788] nix-grpc-daemon[917]: time=2026-09-20T08:05:34.712Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3897lb # [ 41.341014] niks3-server[983]: 2026/09/20 08:05:34 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3898lb # [ 41.346771] niks3-server[983]: 2026/09/20 08:05:34 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3899worker2 # [ 41.342921] nix-grpc-daemon[917]: time=2026-09-20T08:05:34.758Z level=INFO msg="Uploading 1 narinfos"3900lb # [ 41.356425] niks3-server[983]: 2026/09/20 08:05:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3901lb # [ 41.358366] niks3-server[983]: 2026/09/20 08:05:34 INFO Signed narinfos id=4 count=13902lb # [ 41.371005] niks3-server[983]: 2026/09/20 08:05:34 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3903lb # [ 41.377189] niks3-server[983]: 2026/09/20 08:05:34 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3904lb # [ 41.386735] niks3-server[983]: 2026/09/20 08:05:34 INFO Completed upload id=43905worker2 # [ 41.375348] nix-grpc-daemon[917]: time=2026-09-20T08:05:34.791Z level=INFO msg="Upload complete. (381ms)"3906lb # [ 41.388845] niks3-server[983]: 2026/09/20 08:05:34 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3907worker2 # [ 41.388732] nix-grpc-daemon[843]: ts=2026-09-20T08:05:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13908worker2 # [ 41.408477] nix-grpc-daemon[843]: ts=2026-09-20T08:05:34Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03909worker2 # [ 41.412221] nix-grpc-daemon[843]: ts=2026-09-20T08:05:34Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=13910worker2 # [ 41.416372] nix-daemon[905]: reaped child process 977, status = succeeded3911worker2 # [ 41.445206] nix-grpc-daemon[843]: ts=2026-09-20T08:05:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343423912worker2 # [ 41.457989] nix-grpc-daemon[843]: ts=2026-09-20T08:05:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343423913worker2 # [ 41.475763] nix-grpc-daemon[917]: time=2026-09-20T08:05:34.891Z level=INFO msg="All 2 paths already cached"3914client # copying 1 paths to 'lb:50051'...3915client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3916worker2 # [ 41.486088] nix-grpc-daemon[843]: ts=2026-09-20T08:05:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343423917worker2 # [ 41.500480] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)3918worker2 # [ 41.716173] nix-daemon[905]: accepted connection from pid 1003, user nix-grpc-daemon (trusted)3919worker2 # [ 41.741688] nix-daemon[905]: reaped child process 1006, status = succeeded3920worker2 # [ 41.939631] nix-daemon[905]: accepted connection from pid 1008, user nix-grpc-daemon (trusted)3921lb # [ 41.983756] niks3-server[983]: 2026/09/20 08:05:35 INFO Received uploads request method=POST path=/api/pending_closures3922worker2 # [ 41.976178] nix-daemon[905]: reaped child process 1011, status = succeeded3923worker2 # [ 41.991271] nix-grpc-daemon[917]: time=2026-09-20T08:05:35.406Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3924worker2 # [ 41.994590] nix-grpc-daemon[917]: time=2026-09-20T08:05:35.406Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3925lb # [ 42.031113] niks3-server[983]: 2026/09/20 08:05:35 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3926lb # [ 42.046394] niks3-server[983]: 2026/09/20 08:05:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3927worker2 # [ 42.040239] nix-grpc-daemon[917]: time=2026-09-20T08:05:35.455Z level=INFO msg="Uploading 1 narinfos"3928lb # [ 42.056549] niks3-server[983]: 2026/09/20 08:05:35 INFO Signed narinfos id=5 count=13929lb # [ 42.063844] niks3-server[983]: 2026/09/20 08:05:35 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3930lb # [ 42.077116] niks3-server[983]: 2026/09/20 08:05:35 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3931lb # [ 42.083480] niks3-server[983]: 2026/09/20 08:05:35 INFO Completed upload id=53932lb # [ 42.085756] niks3-server[983]: 2026/09/20 08:05:35 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3933worker2 # [ 42.074874] nix-grpc-daemon[917]: time=2026-09-20T08:05:35.486Z level=INFO msg="Upload complete. (556ms)"3934worker2 # [ 42.080259] nix-grpc-daemon[843]: ts=2026-09-20T08:05:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=0 paths=1 nar_bytes_in=7523935worker2 # [ 42.082587] nix-grpc-daemon[843]: ts=2026-09-20T08:05:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343423936worker2 # [ 42.095185] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)3937worker2 # [ 42.099547] nix-daemon[905]: reaped child process 1001, status = succeeded3938worker2 # [ 42.117483] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)3939client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3940client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3941lb # [ 43.318322] envoy[859]: conn peer=[2001:db8:1::1]:37956 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=23383942lb # [ 43.322187] envoy[859]: conn peer=[2001:db8:1::1]:37960 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=963943lb # [ 43.325385] envoy[859]: conn peer=[2001:db8:1::1]:37970 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=153944lb # [ 43.327958] envoy[859]: conn peer=[2001:db8:1::1]:37980 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=193945client # farm-top> LOG-farm-top-t13946worker2 # [ 43.575569] nix-daemon[905]: reaped child process 1016, status = succeeded3947worker2 # [ 43.760963] nix-daemon[905]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)3948worker2 # [ 43.786565] nix-daemon[905]: reaped child process 1034, status = succeeded3949lb # [ 43.809460] niks3-server[983]: 2026/09/20 08:05:37 INFO Received uploads request method=POST path=/api/pending_closures3950worker2 # [ 43.804650] nix-grpc-daemon[917]: time=2026-09-20T08:05:37.219Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3951worker2 # [ 43.808513] nix-grpc-daemon[917]: time=2026-09-20T08:05:37.222Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3952lb # [ 43.856350] niks3-server[983]: 2026/09/20 08:05:37 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3953lb # [ 43.866340] niks3-server[983]: 2026/09/20 08:05:37 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3954lb # [ 43.876463] niks3-server[983]: 2026/09/20 08:05:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3955lb # [ 43.881894] niks3-server[983]: 2026/09/20 08:05:37 INFO Signed narinfos id=6 count=13956worker2 # [ 43.870040] nix-grpc-daemon[917]: time=2026-09-20T08:05:37.285Z level=INFO msg="Uploading 1 narinfos"3957lb # [ 43.887070] niks3-server[983]: 2026/09/20 08:05:37 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3958lb # [ 43.897362] niks3-server[983]: 2026/09/20 08:05:37 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3959lb # [ 43.905841] niks3-server[983]: 2026/09/20 08:05:37 INFO Completed upload id=63960worker2 # [ 43.893601] nix-grpc-daemon[917]: time=2026-09-20T08:05:37.309Z level=INFO msg="Upload complete. (358ms)"3961lb # [ 43.909243] niks3-server[983]: 2026/09/20 08:05:37 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3962worker2 # [ 43.909316] nix-grpc-daemon[843]: ts=2026-09-20T08:05:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13963worker2 # [ 43.927004] nix-daemon[905]: reaped child process 1013, status = succeeded3964client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 7.22 seconds)3965client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath3966client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.23 seconds)3967client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3968client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.02 seconds)3969client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3970client # copying 3 paths...3971client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3972client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3973client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3974client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.33 seconds)3975(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.89 seconds)3976subtest: repeat is answered Cached by the scheduler without building3977worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3978worker1 # finding garbage collector roots...3979worker1 # deleting specified paths...3980worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3981worker1 # deleting unused links...3982worker1 # note: hard linking is currently saving 0.0 KiB3983worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)3984worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3985worker2 # finding garbage collector roots...3986worker2 # deleting specified paths...3987worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3988worker2 # deleting unused links...3989worker2 # note: hard linking is currently saving 0.0 KiB3990worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)3991client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&23992worker2 # [ 45.496195] nix-grpc-daemon[843]: ts=2026-09-20T08:05:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:343423993client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):3994client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3995worker2 # [ 45.529932] nix-grpc-daemon[843]: ts=2026-09-20T08:05:38Z level=debug event=want client=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=13996worker2 # [ 45.541866] nix-grpc-daemon[843]: ts=2026-09-20T08:05:38Z level=debug event=want client=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=13997worker2 # [ 45.553626] nix-grpc-daemon[843]: ts=2026-09-20T08:05:38Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=13998client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 0.37 seconds)3999client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath4000client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.31 seconds)4001lb: must succeed: curl -sf localhost:9901/clusters4002lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4003lb: must succeed: curl -sf localhost:9901/clusters4004lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4005worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4006worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.05 seconds)4007(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.58 seconds)4008subtest: two clients wanting the same drv build it once4009client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4010client # [ 46.302660] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4011client # Running as unit: dedup1.service; invocation ID: 78a419abcb2a41059c2562d828045d024012client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.06 seconds)4013client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4014worker1 # [ 46.527661] nix-grpc-daemon[787]: ts=2026-09-20T08:05:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:475264015client # [ 46.569480] nix[886]: don't know how to build these paths:4016client # [ 46.577803] nix[886]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4017worker2 # [ 46.537071] nix-grpc-daemon[843]: ts=2026-09-20T08:05:39Z level=debug event=want client=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04018worker1 # [ 46.563890] nix-grpc-daemon[787]: ts=2026-09-20T08:05:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475264019worker2 # [ 46.537893] nix-grpc-daemon[843]: ts=2026-09-20T08:05:39Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14020worker1 # [ 46.577671] nix-grpc-daemon[787]: ts=2026-09-20T08:05:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475264021client # [ 46.626431] nix[886]: copying 1 paths to 'lb:50051'...4022client # [ 46.628204] nix[886]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4023worker1 # [ 46.593210] nix-grpc-daemon[787]: ts=2026-09-20T08:05:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475264024worker1 # [ 46.602729] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4025worker1 # [ 46.622444] nix-grpc-daemon[787]: ts=2026-09-20T08:05:40Z level=info event=niks3_push_started pid=8704026worker1 # [ 47.198887] nix-daemon[844]: accepted connection from pid 883, user nix-grpc-daemon (trusted)4027worker1 # [ 47.226703] nix-daemon[844]: reaped child process 886, status = succeeded4028client # [ 47.422081] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4029client # Running as unit: dedup2.service; invocation ID: e3051d354aa046b8a5d0bbe9443a20cb4030client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4031worker1 # [ 47.432268] nix-daemon[844]: accepted connection from pid 888, user nix-grpc-daemon (trusted)4032worker1 # [ 47.493446] nix-daemon[844]: reaped child process 893, status = succeeded4033lb # [ 47.498628] niks3-server[983]: 2026/09/20 08:05:40 INFO Received uploads request method=POST path=/api/pending_closures4034worker1 # [ 47.525917] nix-grpc-daemon[870]: time=2026-09-20T08:05:40.914Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4035worker1 # [ 47.527897] nix-grpc-daemon[870]: time=2026-09-20T08:05:40.914Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4036lb # [ 47.551336] niks3-server[983]: 2026/09/20 08:05:40 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4037lb # [ 47.558619] niks3-server[983]: 2026/09/20 08:05:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4038worker1 # [ 47.574287] nix-grpc-daemon[870]: time=2026-09-20T08:05:40.964Z level=INFO msg="Uploading 1 narinfos"4039lb # [ 47.568474] niks3-server[983]: 2026/09/20 08:05:40 INFO Signed narinfos id=7 count=14040lb # [ 47.577716] niks3-server[983]: 2026/09/20 08:05:40 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4041lb # [ 47.590283] niks3-server[983]: 2026/09/20 08:05:40 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4042lb # [ 47.599262] niks3-server[983]: 2026/09/20 08:05:41 INFO Completed upload id=74043worker1 # [ 47.609900] nix-grpc-daemon[870]: time=2026-09-20T08:05:40.997Z level=INFO msg="Upload complete. (680ms)"4044lb # [ 47.602768] niks3-server[983]: 2026/09/20 08:05:41 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4045worker1 # [ 47.616883] nix-grpc-daemon[787]: ts=2026-09-20T08:05:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47526 duration_s=1 paths=1 nar_bytes_in=4324046worker1 # [ 47.624934] nix-grpc-daemon[787]: ts=2026-09-20T08:05:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475264047worker1 # [ 47.630845] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4048worker1 # [ 47.635747] nix-daemon[844]: reaped child process 868, status = succeeded4049worker1 # [ 47.646555] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4050client # [ 47.681372] nix[886]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4051client # [ 47.844134] nix[902]: don't know how to build these paths:4052client # [ 47.847176] nix[902]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4053worker2 # [ 47.787616] nix-grpc-daemon[843]: ts=2026-09-20T08:05:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:343424054worker2 # [ 47.807446] nix-grpc-daemon[843]: ts=2026-09-20T08:05:41Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04055worker1 # [ 47.836740] nix-grpc-daemon[787]: ts=2026-09-20T08:05:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475264056client # [ 47.882805] nix[902]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4057client: must succeed: sleep 24058client: (finished: must succeed: sleep 2, in 2.05 seconds)4059??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4060 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394061client: waiting for success: ! systemctl is-active dedup1 dedup24062??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4063 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394064worker1 # [ 52.280326] nix-daemon[844]: reaped child process 900, status = succeeded4065worker1 # [ 52.466521] nix-daemon[844]: accepted connection from pid 929, user nix-grpc-daemon (trusted)4066worker1 # [ 52.493374] nix-daemon[844]: reaped child process 932, status = succeeded4067lb # [ 52.497247] niks3-server[983]: 2026/09/20 08:05:45 INFO Received uploads request method=POST path=/api/pending_closures4068worker1 # [ 52.522701] nix-grpc-daemon[870]: time=2026-09-20T08:05:45.910Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4069worker1 # [ 52.526549] nix-grpc-daemon[870]: time=2026-09-20T08:05:45.910Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4070lb # [ 52.543214] niks3-server[983]: 2026/09/20 08:05:45 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4071lb # [ 52.554522] niks3-server[983]: 2026/09/20 08:05:45 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4072lb # [ 52.562515] niks3-server[983]: 2026/09/20 08:05:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4073worker1 # [ 52.577004] nix-grpc-daemon[870]: time=2026-09-20T08:05:45.966Z level=INFO msg="Uploading 1 narinfos"4074lb # [ 52.569955] niks3-server[983]: 2026/09/20 08:05:45 INFO Signed narinfos id=8 count=14075lb # [ 52.577957] niks3-server[983]: 2026/09/20 08:05:45 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4076lb # [ 52.587091] niks3-server[983]: 2026/09/20 08:05:45 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4077lb # [ 52.598453] niks3-server[983]: 2026/09/20 08:05:46 INFO Completed upload id=84078worker1 # [ 52.607061] nix-grpc-daemon[870]: time=2026-09-20T08:05:45.997Z level=INFO msg="Upload complete. (344ms)"4079lb # [ 52.603972] niks3-server[983]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4080worker1 # [ 52.613090] nix-grpc-daemon[787]: ts=2026-09-20T08:05:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47526 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14081worker1 # [ 52.625350] nix-grpc-daemon[787]: ts=2026-09-20T08:05:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47526 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14082worker1 # [ 52.629747] nix-daemon[844]: reaped child process 898, status = succeeded4083client # [ 52.700971] systemd[1]: dedup1.service: Deactivated successfully.4084client # [ 52.703780] systemd[1]: dedup1.service: Consumed 167ms CPU time over 6.401s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.4085client # [ 52.709694] systemd[1]: dedup2.service: Deactivated successfully.4086client # [ 52.711721] systemd[1]: dedup2.service: Consumed 228ms CPU time over 5.287s wall clock time, 31.1M memory peak, 7.6K incoming IP traffic, 6.4K outgoing IP traffic.4087lb # [ 53.318472] envoy[859]: conn peer=[2001:db8:1::1]:37994 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9410 tx=3822 ms=69474088lb # [ 53.324041] envoy[859]: conn peer=[2001:db8:1::1]:60260 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1162 tx=481 ms=764089lb # [ 53.329986] envoy[859]: conn peer=[2001:db8:1::1]:60270 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1369 ms=61114090lb # [ 53.335411] envoy[859]: conn peer=[2001:db8:1::1]:60276 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1086 ms=48364091client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4092client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4093client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.06 seconds)4094worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4095worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4096worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4097worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4098worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4099worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds)4100worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4101worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds)4102(finished: subtest: two clients wanting the same drv build it once, in 7.50 seconds)4103subtest: build hook: nix-daemon with builders = grpc://lb4104client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log4105client # [ 54.008374] systemd[1]: Started Nix Daemon.4106client # [ 54.207573] nix-daemon[945]: accepted connection from pid 942, user root (trusted)4107worker2 # [ 54.377745] nix-grpc-daemon[843]: ts=2026-09-20T08:05:47Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:343424108worker2 # [ 54.387479] nix-grpc-daemon[843]: ts=2026-09-20T08:05:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343424109worker2 # [ 54.408777] nix-grpc-daemon[843]: ts=2026-09-20T08:05:47Z level=debug event=want client=5 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04110worker2 # [ 54.412220] nix-grpc-daemon[843]: ts=2026-09-20T08:05:47Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14111worker2 # [ 54.416612] nix-grpc-daemon[843]: ts=2026-09-20T08:05:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343424112worker2 # [ 54.431543] nix-grpc-daemon[843]: ts=2026-09-20T08:05:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343424113worker2 # [ 54.447204] nix-grpc-daemon[843]: ts=2026-09-20T08:05:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343424114worker2 # [ 54.459231] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4115worker2 # [ 54.655710] nix-daemon[905]: accepted connection from pid 1097, user nix-grpc-daemon (trusted)4116worker2 # [ 54.683602] nix-daemon[905]: reaped child process 1100, status = succeeded4117worker2 # [ 54.879858] nix-daemon[905]: accepted connection from pid 1102, user nix-grpc-daemon (trusted)4118worker2 # [ 54.904336] nix-daemon[905]: reaped child process 1105, status = succeeded4119lb # [ 54.930020] niks3-server[983]: 2026/09/20 08:05:48 INFO Received uploads request method=POST path=/api/pending_closures4120worker2 # [ 54.931011] nix-grpc-daemon[917]: time=2026-09-20T08:05:48.345Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4121worker2 # [ 54.932730] nix-grpc-daemon[917]: time=2026-09-20T08:05:48.345Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4122lb # [ 54.969138] niks3-server[983]: 2026/09/20 08:05:48 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4123worker2 # [ 54.977668] nix-grpc-daemon[917]: time=2026-09-20T08:05:48.393Z level=INFO msg="Uploading 1 narinfos"4124lb # [ 54.991892] niks3-server[983]: 2026/09/20 08:05:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4125lb # [ 54.999893] niks3-server[983]: 2026/09/20 08:05:48 INFO Signed narinfos id=9 count=14126lb # [ 55.006239] niks3-server[983]: 2026/09/20 08:05:48 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4127lb # [ 55.015121] niks3-server[983]: 2026/09/20 08:05:48 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4128lb # [ 55.023851] niks3-server[983]: 2026/09/20 08:05:48 INFO Completed upload id=94129worker2 # [ 55.012579] nix-grpc-daemon[917]: time=2026-09-20T08:05:48.428Z level=INFO msg="Upload complete. (540ms)"4130lb # [ 55.026434] niks3-server[983]: 2026/09/20 08:05:48 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4131worker2 # [ 55.020460] nix-grpc-daemon[843]: ts=2026-09-20T08:05:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=0 paths=1 nar_bytes_in=5124132worker2 # [ 55.031968] nix-grpc-daemon[843]: ts=2026-09-20T08:05:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343424133worker2 # [ 55.037068] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4134worker2 # [ 55.042146] nix-daemon[905]: reaped child process 1095, status = succeeded4135worker2 # [ 55.056502] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4136worker2 # [ 56.710393] nix-daemon[905]: reaped child process 1109, status = succeeded4137worker2 # [ 56.899944] nix-daemon[905]: accepted connection from pid 1124, user nix-grpc-daemon (trusted)4138worker2 # [ 56.923351] nix-daemon[905]: reaped child process 1127, status = succeeded4139lb # [ 56.951048] niks3-server[983]: 2026/09/20 08:05:50 INFO Received uploads request method=POST path=/api/pending_closures4140worker2 # [ 56.956158] nix-grpc-daemon[917]: time=2026-09-20T08:05:50.368Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4141worker2 # [ 56.957811] nix-grpc-daemon[917]: time=2026-09-20T08:05:50.368Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4142lb # [ 57.008499] niks3-server[983]: 2026/09/20 08:05:50 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4143worker2 # [ 57.010497] nix-grpc-daemon[917]: time=2026-09-20T08:05:50.426Z level=INFO msg="Uploading 1 narinfos"4144lb # [ 57.023141] niks3-server[983]: 2026/09/20 08:05:50 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4145lb # [ 57.032651] niks3-server[983]: 2026/09/20 08:05:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4146lb # [ 57.039739] niks3-server[983]: 2026/09/20 08:05:50 INFO Signed narinfos id=10 count=14147lb # [ 57.048379] niks3-server[983]: 2026/09/20 08:05:50 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4148lb # [ 57.051578] niks3-server[983]: 2026/09/20 08:05:50 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4149lb # [ 57.056260] niks3-server[983]: 2026/09/20 08:05:50 INFO Completed upload id=104150worker2 # [ 57.044173] nix-grpc-daemon[917]: time=2026-09-20T08:05:50.459Z level=INFO msg="Upload complete. (375ms)"4151lb # [ 57.059480] niks3-server[983]: 2026/09/20 08:05:50 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4152worker2 # [ 57.054031] nix-grpc-daemon[843]: ts=2026-09-20T08:05:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=2 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=5 outputs=14153worker2 # [ 57.069292] nix-grpc-daemon[843]: ts=2026-09-20T08:05:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:343424154worker2 # [ 57.072797] nix-daemon[905]: reaped child process 1107, status = succeeded4155worker1 # [ 57.123922] nix-grpc-daemon[787]: ts=2026-09-20T08:05:50Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:475264156worker1 # [ 57.146743] nix-grpc-daemon[787]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4157worker1 # [ 57.160652] nix-grpc-daemon[787]: ts=2026-09-20T08:05:50Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47526 duration_s=0 paths=1 nar_bytes_out=1284158worker2 # [ 57.415386] nix-grpc-daemon[843]: ts=2026-09-20T08:05:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:343424159worker1 # [ 57.441522] nix-grpc-daemon[787]: ts=2026-09-20T08:05:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475264160worker1 # [ 57.453447] nix-grpc-daemon[870]: time=2026-09-20T08:05:50.842Z level=INFO msg="All 1 paths already cached"4161worker2 # [ 57.455657] nix-grpc-daemon[843]: ts=2026-09-20T08:05:50Z level=debug event=want client=6 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04162worker2 # [ 57.464967] nix-grpc-daemon[843]: ts=2026-09-20T08:05:50Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14163worker2 # [ 57.477361] nix-grpc-daemon[843]: ts=2026-09-20T08:05:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343424164worker2 # [ 57.487479] nix-grpc-daemon[843]: ts=2026-09-20T08:05:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343424165worker2 # [ 57.503028] nix-grpc-daemon[917]: time=2026-09-20T08:05:50.918Z level=INFO msg="All 1 paths already cached"4166worker2 # [ 57.513159] nix-grpc-daemon[843]: ts=2026-09-20T08:05:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343424167worker2 # [ 57.526616] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4168worker2 # [ 57.772631] nix-daemon[905]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)4169worker2 # [ 57.799197] nix-daemon[905]: reaped child process 1136, status = succeeded4170worker2 # [ 57.997491] nix-daemon[905]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)4171worker2 # [ 58.021130] nix-daemon[905]: reaped child process 1141, status = succeeded4172lb # [ 58.049118] niks3-server[983]: 2026/09/20 08:05:51 INFO Received uploads request method=POST path=/api/pending_closures4173worker2 # [ 58.049084] nix-grpc-daemon[917]: time=2026-09-20T08:05:51.463Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4174worker2 # [ 58.050898] nix-grpc-daemon[917]: time=2026-09-20T08:05:51.464Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4175lb # [ 58.085524] niks3-server[983]: 2026/09/20 08:05:51 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4176lb # [ 58.106969] niks3-server[983]: 2026/09/20 08:05:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4177worker2 # [ 58.100822] nix-grpc-daemon[917]: time=2026-09-20T08:05:51.516Z level=INFO msg="Uploading 1 narinfos"4178lb # [ 58.119468] niks3-server[983]: 2026/09/20 08:05:51 INFO Signed narinfos id=11 count=14179lb # [ 58.125656] niks3-server[983]: 2026/09/20 08:05:51 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4180worker2 # [ 58.126746] nix-grpc-daemon[917]: time=2026-09-20T08:05:51.542Z level=INFO msg="Upload complete. (583ms)"4181lb # [ 58.140585] niks3-server[983]: 2026/09/20 08:05:51 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4182worker2 # [ 58.132801] nix-grpc-daemon[843]: ts=2026-09-20T08:05:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=0 paths=1 nar_bytes_in=6244183lb # [ 58.146164] niks3-server[983]: 2026/09/20 08:05:51 INFO Completed upload id=114184worker2 # [ 58.138399] nix-grpc-daemon[843]: ts=2026-09-20T08:05:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343424185lb # [ 58.149954] niks3-server[983]: 2026/09/20 08:05:51 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4186worker2 # [ 58.148331] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4187worker2 # [ 58.152464] nix-daemon[905]: reaped child process 1131, status = succeeded4188worker2 # [ 58.165562] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4189worker2 # [ 59.195938] nix-daemon[905]: reaped child process 1145, status = succeeded4190worker2 # [ 59.373975] nix-daemon[905]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)4191worker2 # [ 59.401342] nix-daemon[905]: reaped child process 1163, status = succeeded4192lb # [ 59.424917] niks3-server[983]: 2026/09/20 08:05:52 INFO Received uploads request method=POST path=/api/pending_closures4193worker2 # [ 59.426505] nix-grpc-daemon[917]: time=2026-09-20T08:05:52.841Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4194worker2 # [ 59.432487] nix-grpc-daemon[917]: time=2026-09-20T08:05:52.844Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4195lb # [ 59.470244] niks3-server[983]: 2026/09/20 08:05:52 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4196lb # [ 59.489161] niks3-server[983]: 2026/09/20 08:05:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4197worker2 # [ 59.484182] nix-grpc-daemon[917]: time=2026-09-20T08:05:52.899Z level=INFO msg="Uploading 1 narinfos"4198lb # [ 59.501991] niks3-server[983]: 2026/09/20 08:05:52 INFO Signed narinfos id=12 count=14199lb # [ 59.506663] niks3-server[983]: 2026/09/20 08:05:52 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4200lb # [ 59.513245] niks3-server[983]: 2026/09/20 08:05:52 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4201lb # [ 59.521169] niks3-server[983]: 2026/09/20 08:05:52 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4202lb # [ 59.525292] niks3-server[983]: 2026/09/20 08:05:52 INFO Completed upload id=124203worker2 # [ 59.513609] nix-grpc-daemon[917]: time=2026-09-20T08:05:52.929Z level=INFO msg="Upload complete. (334ms)"4204lb # [ 59.527725] niks3-server[983]: 2026/09/20 08:05:52 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4205worker2 # [ 59.520694] nix-grpc-daemon[843]: ts=2026-09-20T08:05:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=6 outputs=14206worker2 # [ 59.531148] nix-daemon[905]: reaped child process 1143, status = succeeded4207worker1 # [ 59.551530] nix-grpc-daemon[787]: ts=2026-09-20T08:05:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:475264208worker1 # [ 59.557163] nix-grpc-daemon[787]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4209worker1 # [ 59.597866] nix-grpc-daemon[787]: ts=2026-09-20T08:05:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:475264210worker1 # [ 59.601793] nix-grpc-daemon[787]: ts=2026-09-20T08:05:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47526 duration_s=0 paths=1 nar_bytes_out=1764211worker2 # [ 59.886968] nix-grpc-daemon[843]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:343424212worker1 # [ 59.912896] nix-grpc-daemon[787]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475264213worker1 # [ 59.924745] nix-grpc-daemon[870]: time=2026-09-20T08:05:53.314Z level=INFO msg="All 2 paths already cached"4214worker2 # [ 59.927932] nix-grpc-daemon[843]: ts=2026-09-20T08:05:53Z level=debug event=want client=7 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04215worker2 # [ 59.931128] nix-grpc-daemon[843]: ts=2026-09-20T08:05:53Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14216worker2 # [ 59.935873] nix-grpc-daemon[843]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343424217worker2 # [ 59.944303] nix-grpc-daemon[843]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343424218worker2 # [ 59.957887] nix-grpc-daemon[917]: time=2026-09-20T08:05:53.373Z level=INFO msg="All 2 paths already cached"4219worker2 # [ 59.966970] nix-grpc-daemon[843]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343424220worker2 # [ 59.976225] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4221worker2 # [ 60.206012] nix-daemon[905]: accepted connection from pid 1169, user nix-grpc-daemon (trusted)4222worker2 # [ 60.236267] nix-daemon[905]: reaped child process 1172, status = succeeded4223worker2 # [ 60.464376] nix-daemon[905]: accepted connection from pid 1174, user nix-grpc-daemon (trusted)4224worker2 # [ 60.488261] nix-daemon[905]: reaped child process 1177, status = succeeded4225lb # [ 60.516385] niks3-server[983]: 2026/09/20 08:05:53 INFO Received uploads request method=POST path=/api/pending_closures4226worker2 # [ 60.516583] nix-grpc-daemon[917]: time=2026-09-20T08:05:53.931Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4227worker2 # [ 60.518874] nix-grpc-daemon[917]: time=2026-09-20T08:05:53.934Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4228lb # [ 60.546259] niks3-server[983]: 2026/09/20 08:05:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4229lb # [ 60.551103] niks3-server[983]: 2026/09/20 08:05:53 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4230lb # [ 60.556349] niks3-server[983]: 2026/09/20 08:05:53 INFO Signed narinfos id=13 count=14231worker2 # [ 60.544506] nix-grpc-daemon[917]: time=2026-09-20T08:05:53.959Z level=INFO msg="Uploading 1 narinfos"4232lb # [ 60.559441] niks3-server[983]: 2026/09/20 08:05:53 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4233lb # [ 60.569059] niks3-server[983]: 2026/09/20 08:05:53 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4234lb # [ 60.574444] niks3-server[983]: 2026/09/20 08:05:53 INFO Completed upload id=134235worker2 # [ 60.562972] nix-grpc-daemon[917]: time=2026-09-20T08:05:53.978Z level=INFO msg="Upload complete. (576ms)"4236worker2 # [ 60.572692] nix-grpc-daemon[843]: ts=2026-09-20T08:05:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=0 paths=1 nar_bytes_in=7524237lb # [ 60.584484] niks3-server[983]: 2026/09/20 08:05:53 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4238worker2 # [ 60.580512] nix-grpc-daemon[843]: ts=2026-09-20T08:05:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343424239worker2 # [ 60.594290] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4240worker2 # [ 60.596553] nix-daemon[905]: reaped child process 1167, status = succeeded4241worker2 # [ 60.613312] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4242worker2 # [ 61.657132] nix-daemon[905]: reaped child process 1181, status = succeeded4243worker2 # [ 61.874763] nix-daemon[905]: accepted connection from pid 1196, user nix-grpc-daemon (trusted)4244worker2 # [ 61.897820] nix-daemon[905]: reaped child process 1199, status = succeeded4245lb # [ 61.926308] niks3-server[983]: 2026/09/20 08:05:55 INFO Received uploads request method=POST path=/api/pending_closures4246worker2 # [ 61.922369] nix-grpc-daemon[917]: time=2026-09-20T08:05:55.336Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4247worker2 # [ 61.923961] nix-grpc-daemon[917]: time=2026-09-20T08:05:55.336Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4248lb # [ 61.956112] niks3-server[983]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4249lb # [ 61.960233] niks3-server[983]: 2026/09/20 08:05:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4250worker2 # [ 61.953751] nix-grpc-daemon[917]: time=2026-09-20T08:05:55.369Z level=INFO msg="Uploading 1 narinfos"4251lb # [ 61.967208] niks3-server[983]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4252lb # [ 61.970634] niks3-server[983]: 2026/09/20 08:05:55 INFO Signed narinfos id=14 count=14253lb # [ 61.975689] niks3-server[983]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4254lb # [ 61.987724] niks3-server[983]: 2026/09/20 08:05:55 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4255lb # [ 61.992410] niks3-server[983]: 2026/09/20 08:05:55 INFO Completed upload id=144256worker2 # [ 61.982073] nix-grpc-daemon[917]: time=2026-09-20T08:05:55.397Z level=INFO msg="Upload complete. (357ms)"4257lb # [ 61.994758] niks3-server[983]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4258worker2 # [ 61.989278] nix-grpc-daemon[843]: ts=2026-09-20T08:05:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=7 outputs=14259worker2 # [ 61.996318] nix-grpc-daemon[843]: ts=2026-09-20T08:05:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:343424260worker2 # [ 62.002615] nix-daemon[905]: reaped child process 1179, status = succeeded4261worker1 # [ 62.043029] nix-grpc-daemon[787]: ts=2026-09-20T08:05:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:475264262worker1 # [ 62.052675] nix-grpc-daemon[787]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4263worker1 # [ 62.070148] nix-grpc-daemon[787]: ts=2026-09-20T08:05:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47526 duration_s=0 paths=1 nar_bytes_out=2324264client # [ 62.241192] nix-daemon[945]: reaped child process 947, status = succeeded4265client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.50 seconds)4266client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4267client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4268client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4269client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4270client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4271client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4272(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.64 seconds)4273subtest: an input only one worker has still reaches the builder4274client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4275client # this derivation will be built:4276client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4277client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4278client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.56 seconds)4279client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4280client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.22 seconds)4281worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4282lb # [ 63.319238] envoy[859]: conn peer=[2001:db8:1::1]:55162 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3430 tx=1661 ms=28244283lb # [ 63.323117] envoy[859]: conn peer=[2001:db8:1::1]:55166 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=1064284lb # [ 63.327135] envoy[859]: conn peer=[2001:db8:1::1]:55180 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3862 tx=1990 ms=22244285lb # [ 63.337569] envoy[859]: conn peer=[2001:db8:1::1]:55186 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=674286lb # [ 63.339609] envoy[859]: conn peer=[2001:db8:1::1]:55196 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2107 ms=22244287lb # [ 63.341995] envoy[859]: conn peer=[2001:db8:1::1]:57280 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=407 ms=964288worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds)4289worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4290worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.02 seconds)4291client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24292client # [ 63.728431] nix-daemon[945]: accepted connection from pid 1028, user root (trusted)4293client # this derivation will be built:4294client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4295client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4296worker1 # [ 63.956728] nix-grpc-daemon[787]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:475264297worker1 # [ 63.964589] nix-grpc-daemon[787]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475264298worker1 # [ 64.180425] nix-daemon[844]: accepted connection from pid 953, user nix-grpc-daemon (trusted)4299worker1 # [ 64.202778] nix-daemon[844]: reaped child process 956, status = succeeded4300lb # [ 64.207640] niks3-server[983]: 2026/09/20 08:05:57 INFO Received uploads request method=POST path=/api/pending_closures4301worker1 # [ 64.227171] nix-grpc-daemon[870]: time=2026-09-20T08:05:57.616Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4302worker1 # [ 64.229062] nix-grpc-daemon[870]: time=2026-09-20T08:05:57.616Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4303lb # [ 64.240498] niks3-server[983]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4304lb # [ 64.260245] niks3-server[983]: 2026/09/20 08:05:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4305worker1 # [ 64.274991] nix-grpc-daemon[870]: time=2026-09-20T08:05:57.664Z level=INFO msg="Uploading 1 narinfos"4306lb # [ 64.272043] niks3-server[983]: 2026/09/20 08:05:57 INFO Signed narinfos id=15 count=14307lb # [ 64.277583] niks3-server[983]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4308lb # [ 64.288857] niks3-server[983]: 2026/09/20 08:05:57 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4309lb # [ 64.296162] niks3-server[983]: 2026/09/20 08:05:57 INFO Completed upload id=154310worker1 # [ 64.303702] nix-grpc-daemon[870]: time=2026-09-20T08:05:57.694Z level=INFO msg="Upload complete. (333ms)"4311lb # [ 64.299633] niks3-server[983]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4312worker2 # [ 64.313596] nix-grpc-daemon[843]: ts=2026-09-20T08:05:57Z level=debug event=want client=8 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04313worker2 # [ 64.320951] nix-grpc-daemon[843]: ts=2026-09-20T08:05:57Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14314worker1 # [ 64.391026] nix-grpc-daemon[787]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475264315worker1 # [ 64.408188] nix-grpc-daemon[787]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475264316client # copying 2 paths to 'lb:50051'...4317client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4318worker1 # [ 64.435749] nix-grpc-daemon[787]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475264319client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4320worker1 # [ 64.452341] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4321worker1 # [ 64.666338] nix-daemon[844]: accepted connection from pid 960, user nix-grpc-daemon (trusted)4322worker1 # [ 64.692628] nix-daemon[844]: reaped child process 963, status = succeeded4323worker1 # [ 64.896266] nix-daemon[844]: accepted connection from pid 965, user nix-grpc-daemon (trusted)4324worker1 # [ 64.919210] nix-daemon[844]: reaped child process 968, status = succeeded4325lb # [ 64.922019] niks3-server[983]: 2026/09/20 08:05:58 INFO Received uploads request method=POST path=/api/pending_closures4326lb # [ 64.936433] niks3-server[983]: 2026/09/20 08:05:58 INFO Received uploads request method=POST path=/api/pending_closures4327worker1 # [ 64.956141] nix-grpc-daemon[870]: time=2026-09-20T08:05:58.345Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4328worker1 # [ 64.957945] nix-grpc-daemon[870]: time=2026-09-20T08:05:58.346Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4329worker1 # [ 64.959709] nix-grpc-daemon[870]: time=2026-09-20T08:05:58.346Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4330lb # [ 64.987708] niks3-server[983]: 2026/09/20 08:05:58 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4331lb # [ 65.004855] niks3-server[983]: 2026/09/20 08:05:58 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4332lb # [ 65.021584] niks3-server[983]: 2026/09/20 08:05:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4333lb # [ 65.026410] niks3-server[983]: 2026/09/20 08:05:58 INFO Signed narinfos id=16 count=14334lb # [ 65.032663] niks3-server[983]: 2026/09/20 08:05:58 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4335worker1 # [ 65.040659] nix-grpc-daemon[870]: time=2026-09-20T08:05:58.430Z level=INFO msg="Uploading 3 narinfos"4336lb # [ 65.035207] niks3-server[983]: 2026/09/20 08:05:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4337lb # [ 65.046094] niks3-server[983]: 2026/09/20 08:05:58 INFO Signed narinfos id=17 count=24338lb # [ 65.051972] niks3-server[983]: 2026/09/20 08:05:58 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4339lb # [ 65.067569] niks3-server[983]: 2026/09/20 08:05:58 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4340lb # [ 65.076690] niks3-server[983]: 2026/09/20 08:05:58 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4341lb # [ 65.081620] niks3-server[983]: 2026/09/20 08:05:58 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4342lb # [ 65.085657] niks3-server[983]: 2026/09/20 08:05:58 INFO Completed upload id=164343lb # [ 65.087254] niks3-server[983]: 2026/09/20 08:05:58 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4344lb # [ 65.089896] niks3-server[983]: 2026/09/20 08:05:58 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4345lb # [ 65.092635] niks3-server[983]: 2026/09/20 08:05:58 INFO Completed upload id=174346worker1 # [ 65.101376] nix-grpc-daemon[870]: time=2026-09-20T08:05:58.491Z level=INFO msg="Upload complete. (627ms)"4347worker1 # [ 65.110050] nix-grpc-daemon[787]: ts=2026-09-20T08:05:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47526 duration_s=0 paths=2 nar_bytes_in=9844348worker1 # [ 65.124271] nix-grpc-daemon[787]: ts=2026-09-20T08:05:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475264349worker1 # [ 65.130702] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4350worker1 # [ 65.136307] nix-daemon[844]: reaped child process 958, status = succeeded4351client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4352client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4353worker1 # [ 65.153251] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4354worker1 # [ 66.583834] nix-daemon[844]: reaped child process 972, status = succeeded4355worker1 # [ 66.749760] nix-daemon[844]: accepted connection from pid 987, user nix-grpc-daemon (trusted)4356worker1 # [ 66.774106] nix-daemon[844]: reaped child process 990, status = succeeded4357lb # [ 66.784879] niks3-server[983]: 2026/09/20 08:06:00 INFO Received uploads request method=POST path=/api/pending_closures4358worker1 # [ 66.908803] nix-grpc-daemon[870]: time=2026-09-20T08:06:00.298Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4359lb # [ 66.930148] niks3-server[983]: 2026/09/20 08:06:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4360worker1 # [ 66.949283] nix-grpc-daemon[870]: time=2026-09-20T08:06:00.339Z level=INFO msg="Uploading 1 narinfos"4361lb # [ 66.947446] niks3-server[983]: 2026/09/20 08:06:00 INFO Signed narinfos id=18 count=14362lb # [ 66.958025] niks3-server[983]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4363lb # [ 66.967075] niks3-server[983]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4364lb # [ 66.973147] niks3-server[983]: 2026/09/20 08:06:00 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4365worker1 # [ 66.988566] nix-grpc-daemon[870]: time=2026-09-20T08:06:00.379Z level=INFO msg="Upload complete. (420ms)"4366lb # [ 66.982202] niks3-server[983]: 2026/09/20 08:06:00 INFO Completed upload id=184367lb # [ 66.987198] niks3-server[983]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4368worker1 # [ 66.996411] nix-grpc-daemon[787]: ts=2026-09-20T08:06:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47526 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=8 outputs=14369worker1 # [ 67.007188] nix-daemon[844]: reaped child process 970, status = succeeded4370client # copying 1 paths...4371worker2 # [ 67.027094] nix-grpc-daemon[843]: ts=2026-09-20T08:06:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:343424372worker2 # [ 67.045914] nix-grpc-daemon[843]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4373client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4374worker2 # [ 67.107095] nix-grpc-daemon[843]: ts=2026-09-20T08:06:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:343424375worker2 # [ 67.115099] nix-grpc-daemon[843]: ts=2026-09-20T08:06:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=0 paths=1 nar_bytes_out=1204376client # [ 67.282283] nix-daemon[945]: reaped child process 1031, status = succeeded4377client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.83 seconds)4378client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24379client # [ 67.517504] nix-daemon[945]: accepted connection from pid 1050, user root (trusted)4380client # this derivation will be built:4381client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4382worker1 # [ 67.716105] nix-grpc-daemon[787]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:475264383worker1 # [ 67.723421] nix-grpc-daemon[787]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475264384client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4385worker1 # [ 67.731502] nix-grpc-daemon[870]: time=2026-09-20T08:06:01.122Z level=INFO msg="All 1 paths already cached"4386worker2 # [ 67.728212] nix-grpc-daemon[843]: ts=2026-09-20T08:06:01Z level=debug event=want client=9 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04387worker2 # [ 67.731060] nix-grpc-daemon[843]: ts=2026-09-20T08:06:01Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14388worker2 # [ 67.776770] nix-grpc-daemon[843]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343424389worker2 # [ 67.790747] nix-grpc-daemon[843]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343424390client # copying 1 paths to 'lb:50051'...4391worker2 # [ 67.820095] nix-grpc-daemon[843]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343424392client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4393worker2 # [ 67.837863] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4394worker2 # [ 67.861374] nix-grpc-daemon[843]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 1/5)4395worker2 # [ 67.957475] nix-grpc-daemon[843]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 114 ms (attempt 2/5)4396worker2 # [ 68.080991] nix-grpc-daemon[843]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 144 ms (attempt 3/5)4397worker2 # [ 68.233464] nix-grpc-daemon[843]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 405 ms (attempt 4/5)4398worker2 # [ 68.647604] nix-grpc-daemon[843]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4399worker2 # [ 68.656216] nix-grpc-daemon[843]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4400worker2 # [ 68.930441] nix-daemon[905]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)4401worker2 # [ 68.954824] nix-daemon[905]: reaped child process 1218, status = succeeded4402worker2 # [ 69.161623] nix-daemon[905]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)4403worker2 # [ 69.185744] nix-daemon[905]: reaped child process 1223, status = succeeded4404lb # [ 69.207421] niks3-server[983]: 2026/09/20 08:06:02 INFO Received uploads request method=POST path=/api/pending_closures4405worker2 # [ 69.206826] nix-grpc-daemon[917]: time=2026-09-20T08:06:02.621Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4406worker2 # [ 69.208577] nix-grpc-daemon[917]: time=2026-09-20T08:06:02.621Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4407lb # [ 69.252064] niks3-server[983]: 2026/09/20 08:06:02 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4408lb # [ 69.267008] niks3-server[983]: 2026/09/20 08:06:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4409worker2 # [ 69.260109] nix-grpc-daemon[917]: time=2026-09-20T08:06:02.675Z level=INFO msg="Uploading 1 narinfos"4410lb # [ 69.275414] niks3-server[983]: 2026/09/20 08:06:02 INFO Signed narinfos id=19 count=14411lb # [ 69.282173] niks3-server[983]: 2026/09/20 08:06:02 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4412lb # [ 69.296221] niks3-server[983]: 2026/09/20 08:06:02 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4413lb # [ 69.308840] niks3-server[983]: 2026/09/20 08:06:02 INFO Completed upload id=194414worker2 # [ 69.298048] nix-grpc-daemon[917]: time=2026-09-20T08:06:02.713Z level=INFO msg="Upload complete. (605ms)"4415lb # [ 69.312492] niks3-server[983]: 2026/09/20 08:06:02 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4416worker2 # [ 69.310545] nix-grpc-daemon[843]: ts=2026-09-20T08:06:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=1 paths=1 nar_bytes_in=5684417worker2 # [ 69.324699] nix-grpc-daemon[843]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343424418worker2 # [ 69.340475] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4419worker2 # [ 69.346831] nix-daemon[905]: reaped child process 1209, status = succeeded4420worker2 # [ 69.363722] nix-grpc-daemon[843]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4421client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4422client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4423worker2 # [ 69.378988] nix-daemon[905]: accepted connection from pid 843, user nix-grpc-daemon (trusted)4424worker2 # [ 70.412820] nix-daemon[905]: reaped child process 1228, status = succeeded4425worker2 # [ 70.602164] nix-daemon[905]: accepted connection from pid 1243, user nix-grpc-daemon (trusted)4426worker2 # [ 70.626887] nix-daemon[905]: reaped child process 1246, status = succeeded4427lb # [ 70.651784] niks3-server[983]: 2026/09/20 08:06:04 INFO Received uploads request method=POST path=/api/pending_closures4428worker2 # [ 70.648787] nix-grpc-daemon[917]: time=2026-09-20T08:06:04.064Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4429lb # [ 70.691533] niks3-server[983]: 2026/09/20 08:06:04 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4430worker2 # [ 70.689993] nix-grpc-daemon[917]: time=2026-09-20T08:06:04.105Z level=INFO msg="Uploading 1 narinfos"4431lb # [ 70.703234] niks3-server[983]: 2026/09/20 08:06:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4432lb # [ 70.713251] niks3-server[983]: 2026/09/20 08:06:04 INFO Signed narinfos id=20 count=14433lb # [ 70.718057] niks3-server[983]: 2026/09/20 08:06:04 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4434worker2 # [ 70.717276] nix-grpc-daemon[917]: time=2026-09-20T08:06:04.133Z level=INFO msg="Upload complete. (322ms)"4435lb # [ 70.728957] niks3-server[983]: 2026/09/20 08:06:04 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4436lb # [ 70.731661] niks3-server[983]: 2026/09/20 08:06:04 INFO Completed upload id=204437lb # [ 70.737810] niks3-server[983]: 2026/09/20 08:06:04 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4438worker2 # [ 70.724000] nix-grpc-daemon[843]: ts=2026-09-20T08:06:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=9 outputs=14439worker2 # [ 70.736896] nix-daemon[905]: reaped child process 1225, status = succeeded4440client # copying 1 paths...4441worker2 # [ 70.773215] nix-grpc-daemon[843]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:343424442client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4443worker2 # [ 70.798633] nix-grpc-daemon[843]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:343424444worker2 # [ 70.802530] nix-grpc-daemon[843]: ts=2026-09-20T08:06:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=0 paths=1 nar_bytes_out=1204445client # [ 70.961881] nix-daemon[945]: reaped child process 1053, status = succeeded4446client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.68 seconds)4447client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24448client # [ 71.180172] nix-daemon[945]: accepted connection from pid 1072, user root (trusted)4449client # this derivation will be built:4450client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4451worker2 # [ 71.356044] nix-grpc-daemon[843]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:343424452client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4453worker1 # [ 71.387441] nix-grpc-daemon[787]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475264454worker1 # [ 71.402329] nix-grpc-daemon[870]: time=2026-09-20T08:06:04.790Z level=INFO msg="All 1 paths already cached"4455worker2 # [ 71.400423] nix-grpc-daemon[843]: ts=2026-09-20T08:06:04Z level=debug event=want client=10 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04456worker1 # [ 71.432299] nix-grpc-daemon[787]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475264457worker2 # [ 71.407967] nix-grpc-daemon[843]: ts=2026-09-20T08:06:04Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14458worker1 # [ 71.444829] nix-grpc-daemon[787]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475264459worker1 # [ 71.462225] nix-grpc-daemon[870]: time=2026-09-20T08:06:04.852Z level=INFO msg="All 1 paths already cached"4460client # copying 1 paths to 'lb:50051'...4461client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4462worker1 # [ 71.475175] nix-grpc-daemon[787]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475264463worker1 # [ 71.493099] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4464worker1 # [ 71.714925] nix-daemon[844]: accepted connection from pid 994, user nix-grpc-daemon (trusted)4465worker1 # [ 71.737392] nix-daemon[844]: reaped child process 997, status = succeeded4466worker1 # [ 71.933434] nix-daemon[844]: accepted connection from pid 999, user nix-grpc-daemon (trusted)4467worker1 # [ 71.954921] nix-daemon[844]: reaped child process 1002, status = succeeded4468lb # [ 71.962653] niks3-server[983]: 2026/09/20 08:06:05 INFO Received uploads request method=POST path=/api/pending_closures4469worker1 # [ 71.980847] nix-grpc-daemon[870]: time=2026-09-20T08:06:05.370Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4470worker1 # [ 71.982460] nix-grpc-daemon[870]: time=2026-09-20T08:06:05.371Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4471lb # [ 71.998918] niks3-server[983]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4472worker1 # [ 72.024473] nix-grpc-daemon[870]: time=2026-09-20T08:06:05.414Z level=INFO msg="Uploading 1 narinfos"4473lb # [ 72.018927] niks3-server[983]: 2026/09/20 08:06:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4474lb # [ 72.027078] niks3-server[983]: 2026/09/20 08:06:05 INFO Signed narinfos id=21 count=14475lb # [ 72.031889] niks3-server[983]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4476worker1 # [ 72.050047] nix-grpc-daemon[870]: time=2026-09-20T08:06:05.440Z level=INFO msg="Upload complete. (537ms)"4477lb # [ 72.041778] niks3-server[983]: 2026/09/20 08:06:05 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4478lb # [ 72.046528] niks3-server[983]: 2026/09/20 08:06:05 INFO Completed upload id=214479lb # [ 72.049942] niks3-server[983]: 2026/09/20 08:06:05 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4480worker1 # [ 72.059258] nix-grpc-daemon[787]: ts=2026-09-20T08:06:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47526 duration_s=0 paths=1 nar_bytes_in=5684481worker1 # [ 72.068416] nix-grpc-daemon[787]: ts=2026-09-20T08:06:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475264482worker1 # [ 72.083664] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4483worker1 # [ 72.086078] nix-daemon[844]: reaped child process 992, status = succeeded4484client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4485worker1 # [ 72.102019] nix-daemon[844]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4486client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4487lb # [ 73.318844] envoy[859]: conn peer=[2001:db8:1::1]:57282 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3851 tx=1878 ms=32364488lb # [ 73.324278] envoy[859]: conn peer=[2001:db8:1::1]:57286 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=754489lb # [ 73.329382] envoy[859]: conn peer=[2001:db8:1::1]:57294 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3730 tx=1823 ms=31584490lb # [ 73.334355] envoy[859]: conn peer=[2001:db8:1::1]:45834 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=634491worker1 # [ 73.534342] nix-daemon[844]: reaped child process 1006, status = succeeded4492worker1 # [ 73.719736] nix-daemon[844]: accepted connection from pid 1021, user nix-grpc-daemon (trusted)4493worker1 # [ 73.743157] nix-daemon[844]: reaped child process 1024, status = succeeded4494lb # [ 73.751845] niks3-server[983]: 2026/09/20 08:06:07 INFO Received uploads request method=POST path=/api/pending_closures4495worker1 # [ 73.774449] nix-grpc-daemon[870]: time=2026-09-20T08:06:07.162Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4496lb # [ 73.792901] niks3-server[983]: 2026/09/20 08:06:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4497worker1 # [ 73.809237] nix-grpc-daemon[870]: time=2026-09-20T08:06:07.199Z level=INFO msg="Uploading 1 narinfos"4498lb # [ 73.803552] niks3-server[983]: 2026/09/20 08:06:07 INFO Signed narinfos id=22 count=14499lb # [ 73.811767] niks3-server[983]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4500lb # [ 73.821071] niks3-server[983]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4501lb # [ 73.829858] niks3-server[983]: 2026/09/20 08:06:07 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4502worker1 # [ 73.843244] nix-grpc-daemon[870]: time=2026-09-20T08:06:07.233Z level=INFO msg="Upload complete. (325ms)"4503lb # [ 73.835747] niks3-server[983]: 2026/09/20 08:06:07 INFO Completed upload id=224504lb # [ 73.839197] niks3-server[983]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4505worker1 # [ 73.852996] nix-grpc-daemon[787]: ts=2026-09-20T08:06:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47526 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=10 outputs=14506worker1 # [ 73.865860] nix-daemon[844]: reaped child process 1004, status = succeeded4507client # copying 1 paths...4508worker1 # [ 73.898267] nix-grpc-daemon[787]: ts=2026-09-20T08:06:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:475264509client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4510worker2 # [ 73.905425] nix-grpc-daemon[843]: ts=2026-09-20T08:06:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:343424511worker2 # [ 73.922291] nix-grpc-daemon[843]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4512worker2 # [ 73.943607] nix-grpc-daemon[843]: ts=2026-09-20T08:06:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34342 duration_s=0 paths=1 nar_bytes_out=1204513client # [ 74.111923] nix-daemon[945]: reaped child process 1075, status = succeeded4514client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.15 seconds)4515(finished: subtest: an input only one worker has still reaches the builder, in 11.74 seconds)4516subtest: upload whose reference the worker lacks is completed from the cache4517client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4518client # this derivation will be built:4519client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4520client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4521client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.66 seconds)4522client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4523client # this derivation will be built:4524client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4525client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4526client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.55 seconds)4527client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4528client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.22 seconds)4529worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4530worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.27 seconds)4531worker2 # [ 75.865158] systemd[1]: Stopping Nix worker-protocol over gRPC...4532worker2 # [ 76.712237] nix-grpc-daemon[843]: ts=2026-09-20T08:06:10Z level=info event=signal_exit4533worker2 # [ 76.957615] nix-grpc-daemon[843]: ts=2026-09-20T08:06:10Z level=info event=scheduler_yield4534worker1 # [ 76.984810] nix-grpc-daemon[787]: ts=2026-09-20T08:06:10Z level=info event=scheduler_restarting addr=lb:500514535worker2 # [ 76.964794] nix-grpc-daemon[843]: ts=2026-09-20T08:06:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:432984536worker2 # [ 76.971076] nix-grpc-daemon[843]: ts=2026-09-20T08:06:10Z level=info event=worker_gone addr=192.168.1.3:500514537lb # [ 76.977706] niks3-server[983]: 2026/09/20 08:06:10 INFO lead: released remote=192.168.1.4:448944538worker2 # [ 76.975569] nix-grpc-daemon[843]: ts=2026-09-20T08:06:10Z level=info event=scheduler_restarting addr=lb:500514539worker2 # [ 76.982705] nix-grpc-daemon[843]: ts=2026-09-20T08:06:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:432984540worker2 # [ 76.987813] nix-grpc-daemon[843]: ts=2026-09-20T08:06:10Z level=info event=worker_gone addr=192.168.1.4:500514541worker1 # [ 77.184626] nix-grpc-daemon[787]: ts=2026-09-20T08:06:10Z level=info event=scheduler_connected addr=lb:500514542worker2 # [ 77.171641] nix-grpc-daemon[843]: ts=2026-09-20T08:06:10Z level=info event=scheduler_connected addr=lb:500514543worker1 # [ 77.193273] nix-grpc-daemon[787]: ts=2026-09-20T08:06:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4544worker2 # [ 77.191703] nix-grpc-daemon[843]: ts=2026-09-20T08:06:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4545worker1 # [ 77.394974] nix-grpc-daemon[787]: ts=2026-09-20T08:06:10Z level=info event=scheduler_connected addr=lb:500514546worker1 # [ 77.403396] nix-grpc-daemon[787]: ts=2026-09-20T08:06:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4547worker2 # [ 77.392565] nix-grpc-daemon[843]: ts=2026-09-20T08:06:10Z level=info event=scheduler_connected addr=lb:500514548worker2 # [ 77.397056] nix-grpc-daemon[843]: ts=2026-09-20T08:06:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4549worker1 # [ 77.605102] nix-grpc-daemon[787]: ts=2026-09-20T08:06:10Z level=info event=scheduler_connected addr=lb:500514550worker1 # [ 77.614394] nix-grpc-daemon[787]: ts=2026-09-20T08:06:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4551worker2 # [ 77.598861] nix-grpc-daemon[843]: ts=2026-09-20T08:06:11Z level=info event=scheduler_connected addr=lb:500514552worker2 # [ 77.608418] nix-grpc-daemon[843]: ts=2026-09-20T08:06:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4553worker1 # [ 77.815992] nix-grpc-daemon[787]: ts=2026-09-20T08:06:11Z level=info event=scheduler_connected addr=lb:500514554worker1 # [ 77.824839] nix-grpc-daemon[787]: ts=2026-09-20T08:06:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4555worker2 # [ 77.813370] nix-grpc-daemon[843]: ts=2026-09-20T08:06:11Z level=info event=scheduler_connected addr=lb:500514556worker2 # [ 77.819856] nix-grpc-daemon[843]: ts=2026-09-20T08:06:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4557worker2 # [ 77.963355] nix-grpc-daemon[843]: ts=2026-09-20T08:06:11Z level=info event=scheduler_restarting4558worker2 # [ 78.003757] nix-daemon[905]: reaped child process 907, status = succeeded4559worker1 # [ 78.028969] nix-grpc-daemon[787]: ts=2026-09-20T08:06:11Z level=info event=scheduler_connected addr=lb:500514560worker1 # [ 78.034786] nix-grpc-daemon[787]: ts=2026-09-20T08:06:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4561worker2 # [ 78.044436] nix-grpc-daemon[843]: ts=2026-09-20T08:06:11Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4562worker1 # [ 78.235850] nix-grpc-daemon[787]: ts=2026-09-20T08:06:11Z level=info event=scheduler_connected addr=lb:500514563worker2 # [ 78.219332] nix-grpc-daemon[843]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4564worker2 # [ 78.224399] nix-grpc-daemon[843]: E0000 00:00:1789891571.634661 886 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4565worker2 # [ 78.839812] nix-grpc-daemon[843]: E0000 00:00:1789891572.254081 886 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4566worker2 # [ 78.846796] nix-grpc-daemon[843]: E0000 00:00:1789891572.254323 886 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4567worker1 # [ 79.764507] nix-grpc-daemon[787]: ts=2026-09-20T08:06:13Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4568worker2 # [ 79.766041] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4569worker2 # [ 79.773658] systemd[1]: Stopped Nix worker-protocol over gRPC.4570worker2 # [ 79.779875] systemd[1]: nix-grpc-daemon.service: Consumed 3.635s CPU time over 56.444s wall clock time, 59.2M memory peak, 78.6K incoming IP traffic, 151.5K outgoing IP traffic.4571worker2 # [ 79.795886] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4572worker2 # [ 79.799258] systemd[1]: Closed Nix worker-protocol over gRPC.4573worker2 # [ 79.806005] systemd[1]: nix-grpc-daemon.socket: Consumed 806us CPU time over 1min 6.024s wall clock time, 256K memory peak, 101.2K incoming IP traffic, 83.2K outgoing IP traffic.4574lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4575lb: must succeed: curl -sf localhost:9901/clusters4576lb # [ 79.926967] niks3-server[983]: 2026/09/20 08:06:13 INFO lead: acquired remote=192.168.1.3:418384577worker1 # [ 79.935227] nix-grpc-daemon[787]: ts=2026-09-20T08:06:13Z level=info event=scheduler_take_over4578lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4579lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.11 seconds)4580client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24581worker1 # [ 79.965174] nix-grpc-daemon[787]: ts=2026-09-20T08:06:13Z level=info event=scheduler_connected addr=lb:500514582worker1 # [ 79.972073] nix-grpc-daemon[787]: ts=2026-09-20T08:06:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04583worker1 # [ 80.186533] nix-grpc-daemon[787]: ts=2026-09-20T08:06:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:475264584worker1 # [ 80.193227] nix-grpc-daemon[787]: ts=2026-09-20T08:06:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:475264585client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4586client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.28 seconds)4587worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4588worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4589worker2 # [ 80.322543] systemd[1]: Listening on Nix worker-protocol over gRPC.4590worker1 # [ 80.406937] systemd[1]: Stopping Nix worker-protocol over gRPC...4591worker1 # [ 80.661033] nix-grpc-daemon[787]: ts=2026-09-20T08:06:14Z level=info event=signal_exit4592worker2 # [ 80.749443] systemd[1]: Starting Nix worker-protocol over gRPC...4593worker1 # [ 80.931067] nix-grpc-daemon[787]: ts=2026-09-20T08:06:14Z level=info event=scheduler_yield4594lb # [ 80.924959] niks3-server[983]: 2026/09/20 08:06:14 INFO lead: released remote=192.168.1.3:418384595worker1 # [ 80.936818] nix-grpc-daemon[787]: ts=2026-09-20T08:06:14Z level=info event=scheduler_restarting addr=lb:500514596worker1 # [ 80.945231] nix-grpc-daemon[787]: ts=2026-09-20T08:06:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:429544597worker1 # [ 80.950193] nix-grpc-daemon[787]: ts=2026-09-20T08:06:14Z level=info event=worker_gone addr=192.168.1.3:500514598worker2 # [ 80.954364] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4599worker2 # [ 80.956600] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14600worker2 # [ 80.976464] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4601worker2 # [ 80.984418] systemd[1]: Started Nix worker-protocol over gRPC.4602worker2 # [ 80.986273] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:14Z level=info event=scheduler_take_over4603lb # [ 81.000533] niks3-server[983]: 2026/09/20 08:06:14 INFO lead: acquired remote=192.168.1.4:333424604worker2 # [ 80.999310] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:14Z level=info event=scheduler_connected addr=lb:500514605worker2 # [ 81.003889] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04606worker1 # [ 81.137408] nix-grpc-daemon[787]: ts=2026-09-20T08:06:14Z level=info event=scheduler_connected addr=lb:500514607worker1 # [ 81.144887] nix-grpc-daemon[787]: ts=2026-09-20T08:06:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4608worker1 # [ 81.345952] nix-grpc-daemon[787]: ts=2026-09-20T08:06:14Z level=info event=scheduler_connected addr=lb:500514609worker2 # [ 81.328781] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04610worker2 # [ 81.928759] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:523424611worker2 # [ 81.934109] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:15Z level=info event=worker_gone addr=192.168.1.3:500514612worker1 # [ 81.958263] nix-grpc-daemon[787]: ts=2026-09-20T08:06:15Z level=info event=scheduler_restarting4613worker1 # [ 81.977294] nix-grpc-daemon[787]: ts=2026-09-20T08:06:15Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4614worker1 # [ 82.007765] nix-daemon[844]: reaped child process 846, status = succeeded4615worker1 # [ 82.811444] nix-grpc-daemon[787]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4616worker1 # [ 82.816395] nix-grpc-daemon[787]: E0000 00:00:1789891576.201581 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4617worker1 # [ 82.823324] nix-grpc-daemon[787]: E0000 00:00:1789891576.201884 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4618lb # [ 83.321874] envoy[859]: conn peer=[2001:db8:1::1]:45846 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=964619lb # [ 83.326984] envoy[859]: conn peer=[2001:db8:1::1]:45838 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=1802 ms=26464620lb # [ 83.332133] envoy[859]: conn peer=[2001:db8:1::4]:47728 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6272 tx=1953 ms=543234621lb # [ 83.337538] envoy[859]: conn peer=[2001:db8:1::1]:45854 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=254622lb # [ 83.342576] envoy[859]: conn peer=192.168.1.3:58340 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5749 tx=1769 ms=574324623worker1 # [ 83.699708] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4624worker1 # [ 83.702123] systemd[1]: Stopped Nix worker-protocol over gRPC.4625worker1 # [ 83.703687] systemd[1]: nix-grpc-daemon.service: Consumed 2.098s CPU time over 1min 389ms wall clock time, 48.5M memory peak, 47.8K incoming IP traffic, 82.3K outgoing IP traffic.4626worker1 # [ 83.715184] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4627worker1 # [ 83.722647] systemd[1]: Closed Nix worker-protocol over gRPC.4628worker1 # [ 83.724671] systemd[1]: nix-grpc-daemon.socket: Consumed 837us CPU time over 1min 11.636s wall clock time, 256K memory peak, 78.7K incoming IP traffic, 69.6K outgoing IP traffic.4629lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4630lb: must succeed: curl -sf localhost:9901/clusters4631lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4632lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4633client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24634worker2 # [ 84.073476] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523544635worker2 # [ 84.091313] nix-daemon[905]: accepted connection from pid 1270, user nix-grpc-daemon (trusted)4636worker2 # [ 84.117856] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 1/5)4637worker2 # [ 84.190282] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 101 ms (attempt 2/5)4638worker2 # [ 84.299628] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 3/5)4639worker2 # [ 84.348378] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 555 ms (attempt 4/5)4640worker2 # [ 84.904123] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4641client # copying 2 paths...4642client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4643worker2 # [ 84.933144] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:523544644client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4645worker2 # [ 84.947128] nix-daemon[905]: accepted connection from pid 1270, user nix-grpc-daemon (trusted)4646worker2 # [ 84.973601] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:18Z level=info event=niks3_push_started pid=13264647worker2 # [ 85.404062] nix-daemon[905]: accepted connection from pid 1339, user nix-grpc-daemon (trusted)4648worker2 # [ 85.425622] nix-daemon[905]: reaped child process 1342, status = succeeded4649lb # [ 85.455719] niks3-server[983]: 2026/09/20 08:06:18 INFO Received uploads request method=POST path=/api/pending_closures4650lb # [ 85.467817] niks3-server[983]: 2026/09/20 08:06:18 INFO Received uploads request method=POST path=/api/pending_closures4651worker2 # [ 85.468591] nix-grpc-daemon[1326]: time=2026-09-20T08:06:18.882Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4652worker2 # [ 85.472508] nix-grpc-daemon[1326]: time=2026-09-20T08:06:18.882Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4653worker2 # [ 85.474475] nix-grpc-daemon[1326]: time=2026-09-20T08:06:18.882Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4654lb # [ 85.529275] niks3-server[983]: 2026/09/20 08:06:18 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4655lb # [ 85.548574] niks3-server[983]: 2026/09/20 08:06:18 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4656lb # [ 85.562654] niks3-server[983]: 2026/09/20 08:06:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4657worker2 # [ 85.559070] nix-grpc-daemon[1326]: time=2026-09-20T08:06:18.973Z level=INFO msg="Uploading 3 narinfos"4658lb # [ 85.579051] niks3-server[983]: 2026/09/20 08:06:18 INFO Signed narinfos id=23 count=14659lb # [ 85.587006] niks3-server[983]: 2026/09/20 08:06:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4660lb # [ 85.600106] niks3-server[983]: 2026/09/20 08:06:18 INFO Signed narinfos id=24 count=24661lb # [ 85.613351] niks3-server[983]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4662lb # [ 85.624221] niks3-server[983]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4663lb # [ 85.630209] niks3-server[983]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4664lb # [ 85.644871] niks3-server[983]: 2026/09/20 08:06:19 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4665lb # [ 85.650962] niks3-server[983]: 2026/09/20 08:06:19 INFO Completed upload id=244666lb # [ 85.654920] niks3-server[983]: 2026/09/20 08:06:19 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4667lb # [ 85.658376] niks3-server[983]: 2026/09/20 08:06:19 INFO Completed upload id=234668worker2 # [ 85.646479] nix-grpc-daemon[1326]: time=2026-09-20T08:06:19.062Z level=INFO msg="Upload complete. (435ms)"4669lb # [ 85.660341] niks3-server[983]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4670lb # [ 85.663491] niks3-server[983]: 2026/09/20 08:06:19 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4671worker2 # [ 85.657101] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52354 duration_s=0 paths=2 nar_bytes_in=3124672worker2 # [ 85.667055] nix-daemon[905]: reaped child process 1324, status = succeeded4673client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.88 seconds)4674worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4675worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4676worker1 # [ 85.843445] systemd[1]: Listening on Nix worker-protocol over gRPC.4677worker1 # [ 85.855682] systemd[1]: Starting Nix worker-protocol over gRPC...4678worker1 # [ 86.073559] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4679worker1 # [ 86.077323] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14680worker1 # [ 86.086578] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4681worker1 # [ 86.098035] systemd[1]: Started Nix worker-protocol over gRPC.4682lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4683lb: must succeed: curl -sf localhost:9901/clusters4684worker1 # [ 86.119007] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:19Z level=info event=scheduler_connected addr=lb:500514685worker2 # [ 86.101957] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04686lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4687lb: must succeed: curl -sf localhost:9901/clusters4688lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4689lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.20 seconds)4690(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 13.21 seconds)4691subtest: scheduler down: the other node takes the lock and keeps it4692lb: must succeed: curl -sf localhost:9901/clusters4693lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4694lb: must succeed: curl -sf localhost:9901/clusters4695lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4696lb: must succeed: curl -sf localhost:9901/clusters4697lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4698lb: must succeed: curl -sf localhost:9901/clusters4699lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4700worker2 # [ 87.590368] systemd[1]: Stopping Nix worker-protocol over gRPC...4701worker2 # [ 87.976255] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:21Z level=info event=signal_exit4702worker2 # [ 88.187672] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:21Z level=info event=scheduler_yield4703lb # [ 88.209515] niks3-server[983]: 2026/09/20 08:06:21 INFO lead: released remote=192.168.1.4:333424704worker1 # [ 88.221900] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:21Z level=info event=scheduler_restarting addr=lb:500514705worker2 # [ 88.204570] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:523424706worker2 # [ 88.213613] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:21Z level=info event=worker_gone addr=192.168.1.3:500514707worker2 # [ 88.218162] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:21Z level=info event=scheduler_restarting addr=lb:500514708worker2 # [ 88.222413] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:523424709worker2 # [ 88.227147] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:21Z level=info event=worker_gone addr=192.168.1.4:500514710worker1 # [ 88.422035] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:21Z level=info event=scheduler_connected addr=lb:500514711worker2 # [ 88.412966] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:21Z level=info event=scheduler_connected addr=lb:500514712worker1 # [ 88.434991] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4713worker2 # [ 88.435083] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4714worker1 # [ 88.636532] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514715worker1 # [ 88.644691] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4716worker2 # [ 88.636050] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514717worker2 # [ 88.641634] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4718worker1 # [ 88.846114] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514719worker1 # [ 88.853885] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4720worker2 # [ 88.842911] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514721worker2 # [ 88.850791] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4722worker1 # [ 89.055324] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514723worker1 # [ 89.062767] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4724worker2 # [ 89.055266] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514725worker2 # [ 89.059829] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4726worker2 # [ 89.194490] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:22Z level=info event=scheduler_restarting4727worker2 # [ 89.227573] nix-daemon[905]: reaped child process 1319, status = succeeded4728worker1 # [ 89.266391] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514729worker1 # [ 89.272271] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4730worker2 # [ 89.269556] nix-grpc-daemon[1270]: ts=2026-09-20T08:06:22Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4731worker1 # [ 89.473453] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514732worker2 # [ 89.456697] nix-grpc-daemon[1270]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4733worker2 # [ 89.461572] nix-grpc-daemon[1270]: E0000 00:00:1789891582.872065 1313 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4734worker2 # [ 90.003695] nix-grpc-daemon[1270]: E0000 00:00:1789891583.419150 1313 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4735worker2 # [ 90.013401] nix-grpc-daemon[1270]: E0000 00:00:1789891583.429001 1313 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4736worker1 # [ 90.997972] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4737worker2 # [ 90.993389] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4738worker2 # [ 90.996884] systemd[1]: Stopped Nix worker-protocol over gRPC.4739worker2 # [ 90.998141] systemd[1]: nix-grpc-daemon.service: Consumed 489ms CPU time over 10.242s wall clock time, 31M memory peak, 17.6K incoming IP traffic, 21.7K outgoing IP traffic.4740worker2 # [ 91.005742] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4741worker2 # [ 91.008633] systemd[1]: Closed Nix worker-protocol over gRPC.4742worker2 # [ 91.009804] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 10.696s wall clock time, 256K memory peak, 26.6K incoming IP traffic, 21K outgoing IP traffic.4743worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4744lb # [ 91.092500] niks3-server[983]: 2026/09/20 08:06:24 INFO lead: acquired remote=192.168.1.3:543044745worker1 # [ 91.101424] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:24Z level=info event=scheduler_take_over4746worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.10 seconds)4747worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4748worker1 # [ 91.197807] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:24Z level=info event=scheduler_connected addr=lb:500514749worker1 # [ 91.202564] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:24Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04750worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4751client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&24752worker1 # [ 91.495158] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:502324753worker1 # [ 91.511683] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4754client # don't know how to build these paths:4755client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4756client # scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting4757worker1 # [ 92.058953] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:25Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04758worker1 # [ 92.064760] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:25Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14759worker1 # [ 92.104309] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:502324760worker1 # [ 92.122352] nix-grpc-daemon[1047]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5)4761worker1 # [ 92.156685] nix-grpc-daemon[1047]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 2/5)4762worker1 # [ 92.188374] nix-grpc-daemon[1047]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 108 ms (attempt 3/5)4763worker1 # [ 92.305138] nix-grpc-daemon[1047]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 4/5)4764worker1 # [ 92.400574] nix-grpc-daemon[1047]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4765worker1 # [ 92.430630] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:502324766client # copying 1 paths to 'lb:50051'...4767client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4768worker1 # [ 92.455897] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:502324769worker1 # [ 92.474478] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4770worker1 # [ 92.508102] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:25Z level=info event=niks3_push_started pid=11164771worker1 # [ 92.940101] nix-daemon[844]: accepted connection from pid 1129, user nix-grpc-daemon (trusted)4772worker1 # [ 92.960689] nix-daemon[844]: reaped child process 1132, status = succeeded4773worker1 # [ 93.163424] nix-daemon[844]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)4774worker1 # [ 93.184900] nix-daemon[844]: reaped child process 1137, status = succeeded4775lb # [ 93.190698] niks3-server[983]: 2026/09/20 08:06:26 INFO Received uploads request method=POST path=/api/pending_closures4776worker1 # [ 93.218755] nix-grpc-daemon[1116]: time=2026-09-20T08:06:26.607Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4777worker1 # [ 93.220819] nix-grpc-daemon[1116]: time=2026-09-20T08:06:26.607Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4778lb # [ 93.258033] niks3-server[983]: 2026/09/20 08:06:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4779lb # [ 93.266745] niks3-server[983]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4780lb # [ 93.283305] niks3-server[983]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4781lb # [ 93.290510] niks3-server[983]: 2026/09/20 08:06:26 INFO Signed narinfos id=25 count=14782worker1 # [ 93.300059] nix-grpc-daemon[1116]: time=2026-09-20T08:06:26.689Z level=INFO msg="Uploading 1 narinfos"4783lb # [ 93.303540] niks3-server[983]: 2026/09/20 08:06:26 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4784lb # [ 93.318968] niks3-server[983]: 2026/09/20 08:06:26 INFO Completed upload id=254785worker1 # [ 93.328036] nix-grpc-daemon[1116]: time=2026-09-20T08:06:26.718Z level=INFO msg="Upload complete. (583ms)"4786lb # [ 93.325551] envoy[859]: conn peer=[2001:db8:1::1]:33200 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1009 tx=305 ms=15994787lb # [ 93.333690] envoy[859]: conn peer=[2001:db8:1::4]:51884 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1003 tx=362 ms=82714788worker1 # [ 93.336981] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50232 duration_s=0 paths=1 nar_bytes_in=5204789lb # [ 93.338236] niks3-server[983]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4790worker1 # [ 93.349079] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:502324791worker1 # [ 93.360201] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4792worker1 # [ 93.366036] nix-daemon[844]: reaped child process 1114, status = succeeded4793client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4794client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4795worker1 # [ 93.380779] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4796client # farm-a> LOG-farm-a-on-standby4797worker1 # [ 94.222362] nix-daemon[844]: reaped child process 1141, status = succeeded4798worker1 # [ 94.439387] nix-daemon[844]: accepted connection from pid 1156, user nix-grpc-daemon (trusted)4799worker1 # [ 94.464565] nix-daemon[844]: reaped child process 1159, status = succeeded4800lb # [ 94.470823] niks3-server[983]: 2026/09/20 08:06:27 INFO Received uploads request method=POST path=/api/pending_closures4801worker1 # [ 94.497289] nix-grpc-daemon[1116]: time=2026-09-20T08:06:27.887Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4802worker1 # [ 94.504585] nix-grpc-daemon[1116]: time=2026-09-20T08:06:27.889Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4803lb # [ 94.539906] niks3-server[983]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4804lb # [ 94.549062] niks3-server[983]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4805lb # [ 94.559660] niks3-server[983]: 2026/09/20 08:06:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4806lb # [ 94.565712] niks3-server[983]: 2026/09/20 08:06:27 INFO Signed narinfos id=26 count=14807worker1 # [ 94.574375] nix-grpc-daemon[1116]: time=2026-09-20T08:06:27.963Z level=INFO msg="Uploading 1 narinfos"4808lb # [ 94.568806] niks3-server[983]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4809lb # [ 94.583520] niks3-server[983]: 2026/09/20 08:06:27 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4810lb # [ 94.591527] niks3-server[983]: 2026/09/20 08:06:27 INFO Completed upload id=264811worker1 # [ 94.598048] nix-grpc-daemon[1116]: time=2026-09-20T08:06:27.988Z level=INFO msg="Upload complete. (401ms)"4812lb # [ 94.594250] niks3-server[983]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4813worker1 # [ 94.629022] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50232 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14814worker1 # [ 94.643450] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:28Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04815worker1 # [ 94.647081] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:28Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14816worker1 # [ 94.651068] nix-daemon[844]: reaped child process 1139, status = succeeded4817worker1 # [ 94.671522] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:502324818worker1 # [ 94.691882] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:502324819worker1 # [ 94.711553] nix-grpc-daemon[1116]: time=2026-09-20T08:06:28.101Z level=INFO msg="All 1 paths already cached"4820client # copying 1 paths to 'lb:50051'...4821client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4822worker1 # [ 94.723573] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:502324823worker1 # [ 94.740284] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4824worker1 # [ 94.977214] nix-daemon[844]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)4825worker1 # [ 95.000834] nix-daemon[844]: reaped child process 1168, status = succeeded4826worker1 # [ 95.194019] nix-daemon[844]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)4827worker1 # [ 95.218460] nix-daemon[844]: reaped child process 1173, status = succeeded4828lb # [ 95.220332] niks3-server[983]: 2026/09/20 08:06:28 INFO Received uploads request method=POST path=/api/pending_closures4829worker1 # [ 95.241151] nix-grpc-daemon[1116]: time=2026-09-20T08:06:28.631Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4830worker1 # [ 95.242771] nix-grpc-daemon[1116]: time=2026-09-20T08:06:28.631Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4831lb # [ 95.260704] niks3-server[983]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4832worker1 # [ 95.284039] nix-grpc-daemon[1116]: time=2026-09-20T08:06:28.674Z level=INFO msg="Uploading 1 narinfos"4833lb # [ 95.279419] niks3-server[983]: 2026/09/20 08:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4834lb # [ 95.290148] niks3-server[983]: 2026/09/20 08:06:28 INFO Signed narinfos id=27 count=14835lb # [ 95.295737] niks3-server[983]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4836lb # [ 95.304415] niks3-server[983]: 2026/09/20 08:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4837lb # [ 95.312971] niks3-server[983]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4838lb # [ 95.319383] niks3-server[983]: 2026/09/20 08:06:28 INFO Completed upload id=274839worker1 # [ 95.327988] nix-grpc-daemon[1116]: time=2026-09-20T08:06:28.718Z level=INFO msg="Upload complete. (567ms)"4840worker1 # [ 95.340524] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50232 duration_s=0 paths=1 nar_bytes_in=6404841worker1 # [ 95.360793] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:502324842worker1 # [ 95.371449] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4843worker1 # [ 95.378058] nix-daemon[844]: reaped child process 1163, status = succeeded4844client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4845client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4846worker1 # [ 95.397081] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4847worker1 # [ 96.423997] nix-daemon[844]: reaped child process 1177, status = succeeded4848client # farm-b> LOG-farm-b-on-standby4849worker1 # [ 96.607574] nix-daemon[844]: accepted connection from pid 1192, user nix-grpc-daemon (trusted)4850worker1 # [ 96.632183] nix-daemon[844]: reaped child process 1195, status = succeeded4851lb # [ 96.637594] niks3-server[983]: 2026/09/20 08:06:30 INFO Received uploads request method=POST path=/api/pending_closures4852worker1 # [ 96.660620] nix-grpc-daemon[1116]: time=2026-09-20T08:06:30.050Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4853worker1 # [ 96.663299] nix-grpc-daemon[1116]: time=2026-09-20T08:06:30.052Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4854lb # [ 96.690122] niks3-server[983]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4855lb # [ 96.705112] niks3-server[983]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4856lb # [ 96.722133] niks3-server[983]: 2026/09/20 08:06:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4857worker1 # [ 96.735712] nix-grpc-daemon[1116]: time=2026-09-20T08:06:30.125Z level=INFO msg="Uploading 1 narinfos"4858lb # [ 96.731867] niks3-server[983]: 2026/09/20 08:06:30 INFO Signed narinfos id=28 count=14859lb # [ 96.737520] niks3-server[983]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4860lb # [ 96.747750] niks3-server[983]: 2026/09/20 08:06:30 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4861lb # [ 96.756754] niks3-server[983]: 2026/09/20 08:06:30 INFO Completed upload id=284862worker1 # [ 96.764728] nix-grpc-daemon[1116]: time=2026-09-20T08:06:30.155Z level=INFO msg="Upload complete. (354ms)"4863lb # [ 96.759496] niks3-server[983]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4864worker1 # [ 96.788915] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50232 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14865worker1 # [ 96.804380] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:30Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04866worker1 # [ 96.813550] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:30Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=14867worker1 # [ 96.818151] nix-daemon[844]: reaped child process 1175, status = succeeded4868worker1 # [ 96.833934] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:502324869worker1 # [ 96.850068] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:502324870worker1 # [ 96.867192] nix-grpc-daemon[1116]: time=2026-09-20T08:06:30.257Z level=INFO msg="All 2 paths already cached"4871client # copying 1 paths to 'lb:50051'...4872client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4873worker1 # [ 96.881492] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:502324874worker1 # [ 96.897567] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4875worker1 # [ 97.136245] nix-daemon[844]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4876worker1 # [ 97.158028] nix-daemon[844]: reaped child process 1204, status = succeeded4877worker1 # [ 97.368004] nix-daemon[844]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4878worker1 # [ 97.389171] nix-daemon[844]: reaped child process 1209, status = succeeded4879lb # [ 97.394447] niks3-server[983]: 2026/09/20 08:06:30 INFO Received uploads request method=POST path=/api/pending_closures4880worker1 # [ 97.415271] nix-grpc-daemon[1116]: time=2026-09-20T08:06:30.805Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4881worker1 # [ 97.417366] nix-grpc-daemon[1116]: time=2026-09-20T08:06:30.805Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4882lb # [ 97.436345] niks3-server[983]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst4883lb # [ 97.452479] niks3-server[983]: 2026/09/20 08:06:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4884worker1 # [ 97.468420] nix-grpc-daemon[1116]: time=2026-09-20T08:06:30.858Z level=INFO msg="Uploading 1 narinfos"4885lb # [ 97.463474] niks3-server[983]: 2026/09/20 08:06:30 INFO Signed narinfos id=29 count=14886lb # [ 97.471596] niks3-server[983]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls4887lb # [ 97.485354] niks3-server[983]: 2026/09/20 08:06:30 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4888lb # [ 97.495539] niks3-server[983]: 2026/09/20 08:06:30 INFO Completed upload id=294889worker1 # [ 97.504747] nix-grpc-daemon[1116]: time=2026-09-20T08:06:30.895Z level=INFO msg="Upload complete. (588ms)"4890lb # [ 97.500430] niks3-server[983]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo4891worker1 # [ 97.516106] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50232 duration_s=0 paths=1 nar_bytes_in=7684892worker1 # [ 97.529081] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:502324893worker1 # [ 97.549373] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4894worker1 # [ 97.553057] nix-daemon[844]: reaped child process 1199, status = succeeded4895client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...4896client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4897worker1 # [ 97.570641] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4898client # farm-top> LOG-farm-top-on-standby4899worker1 # [ 98.402735] nix-daemon[844]: reaped child process 1213, status = succeeded4900worker1 # [ 98.589169] nix-daemon[844]: accepted connection from pid 1228, user nix-grpc-daemon (trusted)4901worker1 # [ 98.614443] nix-daemon[844]: reaped child process 1231, status = succeeded4902lb # [ 98.623154] niks3-server[983]: 2026/09/20 08:06:32 INFO Received uploads request method=POST path=/api/pending_closures4903worker1 # [ 98.644539] nix-grpc-daemon[1116]: time=2026-09-20T08:06:32.033Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4904worker1 # [ 98.646168] nix-grpc-daemon[1116]: time=2026-09-20T08:06:32.034Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"4905lb # [ 98.678400] niks3-server[983]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst4906worker1 # [ 98.700800] nix-grpc-daemon[1116]: time=2026-09-20T08:06:32.090Z level=INFO msg="Uploading 1 narinfos"4907lb # [ 98.691896] niks3-server[983]: 2026/09/20 08:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4908lb # [ 98.703015] niks3-server[983]: 2026/09/20 08:06:32 INFO Signed narinfos id=30 count=14909lb # [ 98.708874] niks3-server[983]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls4910lb # [ 98.718889] niks3-server[983]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4911lb # [ 98.730513] niks3-server[983]: 2026/09/20 08:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4912lb # [ 98.736462] niks3-server[983]: 2026/09/20 08:06:32 INFO Completed upload id=304913worker1 # [ 98.745210] nix-grpc-daemon[1116]: time=2026-09-20T08:06:32.135Z level=INFO msg="Upload complete. (361ms)"4914lb # [ 98.739223] niks3-server[983]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo4915worker1 # [ 98.761512] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50232 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=14916worker1 # [ 98.781249] nix-daemon[844]: reaped child process 1211, status = succeeded4917client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&2, in 7.58 seconds)4918client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath4919client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath, in 0.25 seconds)4920worker2 # [ 99.145209] systemd[1]: Listening on Nix worker-protocol over gRPC.4921worker2 # [ 99.153752] systemd[1]: Starting Nix worker-protocol over gRPC...4922worker2 # [ 99.378416] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:32Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4923worker2 # [ 99.381447] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:32Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14924worker2 # [ 99.390261] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:32Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4925worker2 # [ 99.400282] systemd[1]: Started Nix worker-protocol over gRPC.4926lb: must succeed: curl -sf localhost:9901/clusters4927worker2 # [ 99.419723] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:32Z level=info event=scheduler_connected addr=lb:500514928worker1 # [ 99.443741] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04929lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4930worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4931worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4932lb: must succeed: curl -sf localhost:9901/clusters4933lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4934lb: must succeed: curl -sf localhost:9901/clusters4935lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4936worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4937worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)4938(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.57 seconds)4939subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise4940client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs4941client # [ 99.987459] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.4942client # Running as unit: rs.service; invocation ID: 94767d63c3214d569beb5160ac2d6cd74943client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds)4944client # [ 100.265606] nix[1175]: don't know how to build these paths:4945client # [ 100.268130] nix[1175]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv4946worker1 # [ 100.230524] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:502324947worker1 # [ 100.247184] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:33Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=04948worker1 # [ 100.254887] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:33Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=14949worker1 # [ 100.294523] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:502324950worker1 # [ 100.314829] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:502324951client # [ 100.368264] nix[1175]: copying 1 paths to 'lb:50051'...4952client # [ 100.370428] nix[1175]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...4953worker1 # [ 100.335304] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:502324954worker1 # [ 100.353254] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4955worker1 # [ 100.578438] nix-daemon[844]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)4956worker1 # [ 100.600692] nix-daemon[844]: reaped child process 1249, status = succeeded4957worker1 # [ 100.788414] nix-daemon[844]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)4958worker1 # [ 100.812309] nix-daemon[844]: reaped child process 1254, status = succeeded4959lb # [ 100.818477] niks3-server[983]: 2026/09/20 08:06:34 INFO Received uploads request method=POST path=/api/pending_closures4960worker1 # [ 100.840439] nix-grpc-daemon[1116]: time=2026-09-20T08:06:34.230Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4961worker1 # [ 100.842022] nix-grpc-daemon[1116]: time=2026-09-20T08:06:34.230Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"4962lb # [ 100.862132] niks3-server[983]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst4963lb # [ 100.882158] niks3-server[983]: 2026/09/20 08:06:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4964worker1 # [ 100.898524] nix-grpc-daemon[1116]: time=2026-09-20T08:06:34.288Z level=INFO msg="Uploading 1 narinfos"4965lb # [ 100.894338] niks3-server[983]: 2026/09/20 08:06:34 INFO Signed narinfos id=31 count=14966lb # [ 100.900758] niks3-server[983]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls4967lb # [ 100.917395] niks3-server[983]: 2026/09/20 08:06:34 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete4968worker1 # [ 100.932348] nix-grpc-daemon[1116]: time=2026-09-20T08:06:34.322Z level=INFO msg="Upload complete. (559ms)"4969lb # [ 100.926004] niks3-server[983]: 2026/09/20 08:06:34 INFO Completed upload id=314970lb # [ 100.930258] niks3-server[983]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo4971worker1 # [ 100.944986] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50232 duration_s=0 paths=1 nar_bytes_in=4164972worker1 # [ 100.956516] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:502324973worker1 # [ 100.971253] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4974worker1 # [ 100.977928] nix-daemon[844]: reaped child process 1244, status = succeeded4975client # [ 101.026375] nix[1175]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...4976worker1 # [ 100.997003] nix-daemon[844]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4977lb: must succeed: curl -sf localhost:9901/clusters4978lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4979lb: must succeed: curl -sf localhost:9901/clusters4980lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4981lb: must succeed: curl -sf localhost:9901/clusters4982lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4983lb: must succeed: curl -sf localhost:9901/clusters4984lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4985worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true4986worker2 # [ 103.061467] systemd-journald[273]: Received client request to rotate journal, rotating.4987worker2 # [ 103.074941] systemd-journald[273]: Vacuuming done, freed 0B of archived journals from /var/log/journal/5309f74fea6848f5aad8a50fdb38ba1c.4988worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds)4989worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service4990worker1 # [ 103.144808] systemd[1]: Stopping Nix worker-protocol over gRPC...4991worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)4992??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.4993 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5734994client: must succeed: sleep 5.04995lb # [ 103.323601] envoy[859]: conn peer=[2001:db8:1::1]:60206 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9652 tx=3952 ms=72834996worker1 # [ 104.101701] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:37Z level=info event=draining4997client: (finished: must succeed: sleep 5.0, in 5.05 seconds)4998worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='4999worker1 # [ 108.692633] nix-daemon[844]: reaped child process 1258, status = succeeded5000worker1 # [ 108.874084] nix-daemon[844]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5001worker1 # [ 108.898283] nix-daemon[844]: reaped child process 1301, status = succeeded5002lb # [ 108.905143] niks3-server[983]: 2026/09/20 08:06:42 INFO Received uploads request method=POST path=/api/pending_closures5003worker1 # [ 108.935908] nix-grpc-daemon[1116]: time=2026-09-20T08:06:42.322Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5004worker1 # [ 108.937828] nix-grpc-daemon[1116]: time=2026-09-20T08:06:42.322Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5005lb # [ 108.981847] niks3-server[983]: 2026/09/20 08:06:42 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5006lb # [ 108.994753] niks3-server[983]: 2026/09/20 08:06:42 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5007lb # [ 109.008146] niks3-server[983]: 2026/09/20 08:06:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5008worker1 # [ 109.022727] nix-grpc-daemon[1116]: time=2026-09-20T08:06:42.412Z level=INFO msg="Uploading 1 narinfos"5009lb # [ 109.017985] niks3-server[983]: 2026/09/20 08:06:42 INFO Signed narinfos id=32 count=15010lb # [ 109.022460] niks3-server[983]: 2026/09/20 08:06:42 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5011lb # [ 109.034557] niks3-server[983]: 2026/09/20 08:06:42 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5012lb # [ 109.046746] niks3-server[983]: 2026/09/20 08:06:42 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5013lb # [ 109.053436] niks3-server[983]: 2026/09/20 08:06:42 INFO Completed upload id=325014worker1 # [ 109.062285] nix-grpc-daemon[1116]: time=2026-09-20T08:06:42.452Z level=INFO msg="Upload complete. (419ms)"5015worker1 # [ 109.081551] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50232 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15016worker1 # [ 109.104866] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:42Z level=info event=signal_exit5017worker1 # [ 109.108693] nix-daemon[844]: reaped child process 1256, status = succeeded5018client # [ 109.165419] systemd[1]: rs.service: Deactivated successfully.5019client # [ 109.170626] systemd[1]: rs.service: Consumed 192ms CPU time over 9.182s wall clock time, 38.9M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.5020worker1 # [ 109.326172] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:42Z level=info event=scheduler_yield5021lb # [ 109.320270] niks3-server[983]: 2026/09/20 08:06:42 INFO lead: released remote=192.168.1.3:543045022worker1 # [ 109.336163] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:42Z level=info event=scheduler_restarting addr=lb:500515023worker2 # [ 109.317995] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:42Z level=info event=scheduler_restarting addr=lb:500515024worker1 # [ 109.343015] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:371665025worker1 # [ 109.348156] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:42Z level=info event=worker_gone addr=192.168.1.4:500515026worker1 # [ 109.352459] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:371665027worker1 # [ 109.357212] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:42Z level=info event=worker_gone addr=192.168.1.3:500515028lb # [ 109.413866] niks3-server[983]: 2026/09/20 08:06:42 INFO lead: acquired remote=192.168.1.4:406565029worker2 # [ 109.407203] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:42Z level=info event=scheduler_take_over5030worker1 # [ 109.538124] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:42Z level=info event=scheduler_connected addr=lb:500515031worker2 # [ 109.525620] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:42Z level=info event=scheduler_connected addr=lb:500515032worker1 # [ 109.549349] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5033worker2 # [ 109.538924] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5034worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.15 seconds)5035client: waiting for success: ! systemctl is-active rs5036worker1 # [ 109.751138] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:43Z level=info event=scheduler_connected addr=lb:500515037worker2 # [ 109.740205] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:43Z level=info event=scheduler_connected addr=lb:500515038worker1 # [ 109.763817] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5039worker2 # [ 109.755475] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5040client: (finished: waiting for success: ! systemctl is-active rs, in 0.08 seconds)5041client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5042client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5043client: must fail: journalctl -u rs | grep -q 'reconnecting'5044client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5045lb: must succeed: curl -sf localhost:9901/clusters5046worker1 # [ 109.965415] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:43Z level=info event=scheduler_connected addr=lb:500515047worker2 # [ 109.957339] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:43Z level=info event=scheduler_connected addr=lb:500515048worker1 # [ 109.989209] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5049worker2 # [ 109.969621] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05050lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5051worker1 # [ 110.192930] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:43Z level=info event=scheduler_connected addr=lb:500515052worker1 # [ 110.201837] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5053worker1 # [ 110.332204] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:43Z level=info event=scheduler_restarting5054worker1 # [ 110.374130] nix-daemon[844]: reaped child process 1107, status = succeeded5055worker1 # [ 110.428814] nix-grpc-daemon[1047]: ts=2026-09-20T08:06:43Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5056worker1 # [ 110.772006] nix-grpc-daemon[1047]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5057worker1 # [ 110.777671] nix-grpc-daemon[1047]: E0000 00:00:1789891604.161441 1090 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5058worker1 # [ 110.784937] nix-grpc-daemon[1047]: E0000 00:00:1789891604.162426 1090 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5059lb: must succeed: curl -sf localhost:9901/clusters5060lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)5061worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5062worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.13 seconds)5063worker1 # [ 111.689993] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5064worker1 # [ 111.696387] systemd[1]: Stopped Nix worker-protocol over gRPC.5065worker1 # [ 111.699192] systemd[1]: nix-grpc-daemon.service: Consumed 2.142s CPU time over 25.834s wall clock time, 34.2M memory peak, 44.7K incoming IP traffic, 82.4K outgoing IP traffic.5066worker1 # [ 111.727913] systemd[1]: Starting Nix worker-protocol over gRPC...5067worker1 # [ 111.965574] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5068worker1 # [ 111.968818] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15069worker1 # [ 111.977990] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5070worker1 # [ 111.979782] systemd[1]: Started Nix worker-protocol over gRPC.5071worker1 # [ 112.000832] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:45Z level=info event=scheduler_connected addr=lb:500515072worker2 # [ 111.985943] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:45Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05073lb: must succeed: curl -sf localhost:9901/clusters5074lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5075worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5076worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)5077(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.56 seconds)5078subtest: scheduler restart mid-build: build finishes, no double build5079client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5080client # [ 112.559207] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5081client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.11 seconds)5082worker1 # [ 112.808777] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:419345083worker1 # [ 112.816827] nix-daemon[844]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5084client # Running as unit: mid.service; invocation ID: 5ceedab18ace4fafbcbd5c76701adfbf5085client # [ 112.861924] nix[1211]: don't know how to build these paths:5086client # [ 112.864125] nix[1211]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5087worker2 # [ 112.824846] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:46Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05088worker2 # [ 112.825186] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:46Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15089worker2 # [ 112.892167] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331445090worker2 # [ 112.911828] nix-daemon[905]: accepted connection from pid 1363, user nix-grpc-daemon (trusted)5091worker2 # [ 112.940451] nix-grpc-daemon[1363]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5)5092worker2 # [ 113.023005] nix-grpc-daemon[1363]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 2/5)5093worker2 # [ 113.104524] nix-grpc-daemon[1363]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 3/5)5094worker2 # [ 113.120000] nix-grpc-daemon[1363]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 220 ms (attempt 4/5)5095lb # [ 113.321970] envoy[859]: conn peer=[2001:db8:1::1]:60218 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1345 ms=88655096lb # [ 113.324400] envoy[859]: conn peer=[2001:db8:1::3]:40442 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2810 tx=1072 ms=243025097worker2 # [ 113.348412] nix-grpc-daemon[1363]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5098worker2 # [ 113.368179] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:331445099client # [ 113.432768] nix[1211]: copying 1 paths to 'lb:50051'...5100client # [ 113.438852] nix[1211]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5101worker2 # [ 113.384231] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:331445102worker2 # [ 113.402775] nix-daemon[905]: accepted connection from pid 1363, user nix-grpc-daemon (trusted)5103worker2 # [ 113.436239] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:46Z level=info event=niks3_push_started pid=14815104worker2 # [ 113.892413] nix-daemon[905]: accepted connection from pid 1494, user nix-grpc-daemon (trusted)5105worker2 # [ 113.932259] nix-daemon[905]: reaped child process 1501, status = succeeded5106worker2 # [ 114.127321] nix-daemon[905]: accepted connection from pid 1503, user nix-grpc-daemon (trusted)5107worker2 # [ 114.150666] nix-daemon[905]: reaped child process 1506, status = succeeded5108lb # [ 114.178294] niks3-server[983]: 2026/09/20 08:06:47 INFO Received uploads request method=POST path=/api/pending_closures5109worker2 # [ 114.177978] nix-grpc-daemon[1481]: time=2026-09-20T08:06:47.593Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5110worker2 # [ 114.181684] nix-grpc-daemon[1481]: time=2026-09-20T08:06:47.595Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5111lb # [ 114.214121] niks3-server[983]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5112lb # [ 114.219292] niks3-server[983]: 2026/09/20 08:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5113worker2 # [ 114.210941] nix-grpc-daemon[1481]: time=2026-09-20T08:06:47.626Z level=INFO msg="Uploading 1 narinfos"5114lb # [ 114.222540] niks3-server[983]: 2026/09/20 08:06:47 INFO Signed narinfos id=33 count=15115lb # [ 114.229060] niks3-server[983]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5116lb # [ 114.237869] niks3-server[983]: 2026/09/20 08:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5117lb # [ 114.246251] niks3-server[983]: 2026/09/20 08:06:47 INFO Completed upload id=335118lb # [ 114.248345] niks3-server[983]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5119worker2 # [ 114.234752] nix-grpc-daemon[1481]: time=2026-09-20T08:06:47.650Z level=INFO msg="Upload complete. (562ms)"5120worker2 # [ 114.240755] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33144 duration_s=0 paths=1 nar_bytes_in=4245121worker2 # [ 114.249831] nix-grpc-daemon[1363]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:331445122worker2 # [ 114.255032] nix-daemon[905]: accepted connection from pid 1363, user nix-grpc-daemon (trusted)5123worker2 # [ 114.258354] nix-daemon[905]: reaped child process 1479, status = succeeded5124worker2 # [ 114.268785] nix-daemon[905]: accepted connection from pid 1363, user nix-grpc-daemon (trusted)5125client # [ 114.322712] nix[1211]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5126lb: must succeed: curl -sf localhost:9901/clusters5127lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5128lb: must succeed: curl -sf localhost:9901/clusters5129lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5130worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5131worker2 # [ 116.652257] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1363 (nix-grpc-daemon) on client request.5132worker2 # [ 116.653971] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5133lb # [ 116.672999] niks3-server[983]: 2026/09/20 08:06:50 INFO lead: released remote=192.168.1.4:406565134client # [ 116.715363] nix[1211]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5135worker1 # [ 116.680896] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5136client # [ 116.722358] nix[1211]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5137worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.09 seconds)5138client: must succeed: sleep 5.05139worker2 # [ 116.692675] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5140worker2 # [ 116.694295] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5141worker2 # [ 116.695524] systemd[1]: nix-grpc-daemon.service: Consumed 688ms CPU time over 17.537s wall clock time, 31.3M memory peak, 13.4K incoming IP traffic, 19.5K outgoing IP traffic.5142worker2 # [ 116.716325] nix-daemon[905]: reaped child process 1474, status = succeeded5143worker2 # [ 116.717502] nix-daemon[905]: reaped child process 1508, status = succeeded5144worker2 # [ 116.728244] nix-daemon[1510]: unexpected Nix daemon error: error: interrupted by the user5145worker2 # [ 116.732618] nix-daemon[905]: reaped child process 1510, status = failed with exit code 15146worker1 # [ 116.890261] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:50Z level=info event=scheduler_connected addr=lb:500515147worker2 # [ 116.874559] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5148worker2 # [ 116.887374] systemd[1]: Starting Nix worker-protocol over gRPC...5149lb # [ 116.981767] niks3-server[983]: 2026/09/20 08:06:50 INFO lead: acquired remote=192.168.1.3:426905150worker1 # [ 116.990728] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:50Z level=info event=scheduler_take_over5151worker2 # [ 117.097423] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5152worker2 # [ 117.099955] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15153worker2 # [ 117.108070] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5154worker2 # [ 117.109846] systemd[1]: Started Nix worker-protocol over gRPC.5155worker2 # [ 117.137661] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:50Z level=info event=scheduler_connected addr=lb:500515156worker2 # [ 117.141048] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5157worker1 # [ 117.160296] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5158client # [ 117.222980] nix[1211]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting5159worker1 # [ 117.361636] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:50Z level=info event=scheduler_connected addr=lb:500515160worker2 # [ 117.342189] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:50Z level=info event=scheduler_connected addr=lb:500515161worker2 # [ 117.349653] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5162worker1 # [ 117.382242] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:50Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05163worker2 # [ 117.550602] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:50Z level=info event=scheduler_connected addr=lb:500515164worker1 # [ 117.573561] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:50Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05165client # [ 118.229421] nix[1211]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting5166worker1 # [ 120.208637] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:53Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05167worker1 # [ 120.214453] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:53Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15168worker1 # [ 120.253712] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419345169worker1 # [ 120.274302] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 1/5)5170worker1 # [ 120.306383] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 2/5)5171worker1 # [ 120.353207] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 3/5)5172worker1 # [ 120.526259] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 214 ms (attempt 4/5)5173worker1 # [ 120.740728] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5174worker1 # [ 120.756728] nix-grpc-daemon[1308]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5175worker1 # [ 120.783511] nix-daemon[844]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5176worker1 # [ 120.792062] nix-daemon[844]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5177client # [ 120.827874] nix[1211]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5178client: (finished: must succeed: sleep 5.0, in 5.07 seconds)5179client: waiting for success: ! systemctl is-active mid5180worker1 # [ 122.221022] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:55Z level=info event=niks3_push_started pid=14115181worker1 # [ 122.258838] nix-daemon[844]: reaped child process 1387, status = succeeded5182worker1 # [ 122.627124] nix-daemon[844]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5183worker1 # [ 122.645431] nix-daemon[844]: reaped child process 1427, status = succeeded5184lb # [ 122.653352] niks3-server[983]: 2026/09/20 08:06:56 INFO Received uploads request method=POST path=/api/pending_closures5185worker1 # [ 122.674301] nix-grpc-daemon[1411]: time=2026-09-20T08:06:56.062Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5186worker1 # [ 122.675829] nix-grpc-daemon[1411]: time=2026-09-20T08:06:56.062Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5187lb # [ 122.708603] niks3-server[983]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5188lb # [ 122.721161] niks3-server[983]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5189lb # [ 122.732332] niks3-server[983]: 2026/09/20 08:06:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5190lb # [ 122.740930] niks3-server[983]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5191lb # [ 122.749744] niks3-server[983]: 2026/09/20 08:06:56 INFO Signed narinfos id=34 count=15192worker1 # [ 122.760173] nix-grpc-daemon[1411]: time=2026-09-20T08:06:56.149Z level=INFO msg="Uploading 1 narinfos"5193lb # [ 122.762098] niks3-server[983]: 2026/09/20 08:06:56 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5194lb # [ 122.776765] niks3-server[983]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5195lb # [ 122.787545] niks3-server[983]: 2026/09/20 08:06:56 INFO Completed upload id=345196worker1 # [ 122.796478] nix-grpc-daemon[1411]: time=2026-09-20T08:06:56.186Z level=INFO msg="Upload complete. (346ms)"5197worker1 # [ 122.812857] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41934 duration_s=2 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15198worker1 # [ 122.831755] nix-daemon[844]: reaped child process 1385, status = succeeded5199client # [ 122.889154] systemd[1]: mid.service: Deactivated successfully.5200client # [ 122.893579] systemd[1]: mid.service: Consumed 214ms CPU time over 10.334s wall clock time, 37M memory peak, 10K incoming IP traffic, 11.6K outgoing IP traffic.5201client: (finished: waiting for success: ! systemctl is-active mid, in 1.15 seconds)5202client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5203client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5204(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.86 seconds)5205subtest: interrupting the client stops the build on the worker5206client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5207lb # [ 123.322248] envoy[859]: conn peer=[2001:db8:1::4]:52042 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=916 tx=417 ms=172515208lb # [ 123.324760] envoy[859]: conn peer=[2001:db8:1::1]:45100 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4245 tx=1813 ms=100215209client # [ 123.373454] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5210client # Running as unit: intr.service; invocation ID: 2bf6a19929f74b15a0d6c229eda9a47c5211client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5212worker2 # [ 123.551101] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:395325213worker2 # [ 123.565696] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5214client # [ 123.638639] nix[1247]: don't know how to build these paths:5215client # [ 123.641198] nix[1247]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5216worker1 # [ 123.622199] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:57Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05217worker1 # [ 123.628378] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:57Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15218worker2 # [ 123.648679] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395325219worker2 # [ 123.667102] nix-grpc-daemon[1546]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 1/5)5220worker2 # [ 123.739137] nix-grpc-daemon[1546]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 63 ms (attempt 2/5)5221worker2 # [ 123.802743] nix-grpc-daemon[1546]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 116 ms (attempt 3/5)5222worker2 # [ 123.926504] nix-grpc-daemon[1546]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 543 ms (attempt 4/5)5223worker2 # [ 124.475335] nix-grpc-daemon[1546]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5224worker2 # [ 124.498823] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:395325225client # [ 124.568188] nix[1247]: copying 1 paths to 'lb:50051'...5226client # [ 124.572692] nix[1247]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5227worker2 # [ 124.519139] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:395325228worker2 # [ 124.534621] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5229worker2 # [ 124.563994] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:57Z level=info event=niks3_push_started pid=16145230worker2 # [ 124.988362] nix-daemon[905]: accepted connection from pid 1631, user nix-grpc-daemon (trusted)5231worker2 # [ 125.008290] nix-daemon[905]: reaped child process 1634, status = succeeded5232worker2 # [ 125.193164] nix-daemon[905]: accepted connection from pid 1636, user nix-grpc-daemon (trusted)5233worker2 # [ 125.214520] nix-daemon[905]: reaped child process 1639, status = succeeded5234lb # [ 125.239853] niks3-server[983]: 2026/09/20 08:06:58 INFO Received uploads request method=POST path=/api/pending_closures5235worker2 # [ 125.242994] nix-grpc-daemon[1614]: time=2026-09-20T08:06:58.656Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5236worker2 # [ 125.244917] nix-grpc-daemon[1614]: time=2026-09-20T08:06:58.656Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5237lb # [ 125.285061] niks3-server[983]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5238lb # [ 125.295880] niks3-server[983]: 2026/09/20 08:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5239worker2 # [ 125.290447] nix-grpc-daemon[1614]: time=2026-09-20T08:06:58.705Z level=INFO msg="Uploading 1 narinfos"5240lb # [ 125.308570] niks3-server[983]: 2026/09/20 08:06:58 INFO Signed narinfos id=35 count=15241lb # [ 125.315840] niks3-server[983]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5242lb # [ 125.326282] niks3-server[983]: 2026/09/20 08:06:58 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5243lb # [ 125.333391] niks3-server[983]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5244lb # [ 125.339043] niks3-server[983]: 2026/09/20 08:06:58 INFO Completed upload id=355245worker2 # [ 125.327382] nix-grpc-daemon[1614]: time=2026-09-20T08:06:58.743Z level=INFO msg="Upload complete. (522ms)"5246worker2 # [ 125.332379] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=0 paths=1 nar_bytes_in=4245247worker2 # [ 125.341982] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395325248worker2 # [ 125.345905] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5249worker2 # [ 125.349527] nix-daemon[905]: reaped child process 1612, status = succeeded5250worker2 # [ 125.360454] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5251client # [ 125.413270] nix[1247]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5252client: must succeed: systemctl kill -s INT intr5253client # [ 125.959541] systemd[1]: intr.service: Sent signal SIGINT to main process 1247 (nix) on client request.5254worker2 # [ 125.912511] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:59Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5255client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds)5256client # [ 125.970117] nix[1247]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5257client # [ 125.974996] nix[1247]: [mutex.cc : 2506] RAW: thread should hold at least a read lock on Mutex 0xe799dd1fc7b85258client # [ 125.995907] systemd-coredump[1261]: Process 1247 (nix) of user 0 terminated abnormally with signal 6/ABRT, processing...5259client # [ 126.016827] systemd[1]: Created slice Slice /system/systemd-coredump.5260client # [ 126.024954] systemd[1]: Started Process Core Dump (PID 1261/UID 0).5261worker2 # [ 125.983959] nix-daemon[905]: reaped child process 1641, status = succeeded5262worker2 # [ 125.988712] nix-daemon[1643]: unexpected Nix daemon error: error: interrupted by the user5263worker2 # [ 125.996743] nix-daemon[905]: reaped child process 1643, status = failed with exit code 15264(finished: subtest: interrupting the client stops the build on the worker, in 2.77 seconds)5265subtest: a deploy mid-build drains: the build finishes, the new generation takes over5266client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5267client # [ 126.162205] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5268client # Running as unit: sw.service; invocation ID: 76babe66cb5248379dd7f5ed7f784e385269client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.08 seconds)5270client # [ 126.571964] nix[1268]: don't know how to build these paths:5271worker2 # [ 126.514019] nix-grpc-daemon[1546]: ts=2026-09-20T08:06:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:395325272client # [ 126.574669] nix[1268]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5273worker1 # [ 126.552499] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:59Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05274worker1 # [ 126.558085] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:59Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15275worker1 # [ 126.608441] nix-grpc-daemon[1308]: ts=2026-09-20T08:06:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419345276worker1 # [ 126.626828] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:419345277client # [ 126.677271] nix[1268]: copying 1 paths to 'lb:50051'...5278client # [ 126.681474] nix[1268]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5279worker1 # [ 126.643329] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:419345280worker1 # [ 126.665537] nix-daemon[844]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5281worker1 # [ 126.894305] nix-daemon[844]: accepted connection from pid 1455, user nix-grpc-daemon (trusted)5282worker1 # [ 126.916615] nix-daemon[844]: reaped child process 1458, status = succeeded5283worker1 # [ 127.099203] nix-daemon[844]: accepted connection from pid 1460, user nix-grpc-daemon (trusted)5284worker1 # [ 127.117956] nix-daemon[844]: reaped child process 1463, status = succeeded5285lb # [ 127.124855] niks3-server[983]: 2026/09/20 08:07:00 INFO Received uploads request method=POST path=/api/pending_closures5286worker1 # [ 127.144404] nix-grpc-daemon[1411]: time=2026-09-20T08:07:00.534Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5287worker1 # [ 127.146026] nix-grpc-daemon[1411]: time=2026-09-20T08:07:00.534Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5288lb # [ 127.161161] niks3-server[983]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5289worker1 # [ 127.182087] nix-grpc-daemon[1411]: time=2026-09-20T08:07:00.572Z level=INFO msg="Uploading 1 narinfos"5290lb # [ 127.175966] niks3-server[983]: 2026/09/20 08:07:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5291lb # [ 127.187116] niks3-server[983]: 2026/09/20 08:07:00 INFO Signed narinfos id=36 count=15292lb # [ 127.193442] niks3-server[983]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5293lb # [ 127.202296] niks3-server[983]: 2026/09/20 08:07:00 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5294lb # [ 127.209990] niks3-server[983]: 2026/09/20 08:07:00 INFO Completed upload id=365295worker1 # [ 127.218671] nix-grpc-daemon[1411]: time=2026-09-20T08:07:00.609Z level=INFO msg="Upload complete. (533ms)"5296lb # [ 127.213044] niks3-server[983]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5297worker1 # [ 127.228763] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41934 duration_s=0 paths=1 nar_bytes_in=4165298worker1 # [ 127.242197] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419345299worker1 # [ 127.249183] nix-daemon[844]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5300worker1 # [ 127.254211] nix-daemon[844]: reaped child process 1453, status = succeeded5301client # [ 127.298507] nix[1268]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5302worker1 # [ 127.267893] nix-daemon[844]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5303client # [ 128.598512] systemd-coredump[1262]: Cannot store coredump of 1247 (nix): No space left on device5304client # [ 128.749256] systemd-coredump[1262]: Process 1247 (nix) of user 0 terminated abnormally without generating a coredump.5305client # [ 128.765781] systemd[1]: systemd-coredump@0-1-1261_1262-0.service: Deactivated successfully.5306client # [ 128.767341] systemd[1]: systemd-coredump@0-1-1261_1262-0.service: Consumed 2.037s CPU time over 2.738s wall clock time, 968.7M memory peak, 926.3M written to disk.5307client # [ 128.786425] systemd[1]: intr.service: Main process exited, code=dumped, status=6/ABRT5308client # [ 128.789639] systemd[1]: intr.service: Failed with result 'core-dump'.5309client # [ 128.790923] systemd[1]: intr.service: Consumed 337ms CPU time over 5.415s wall clock time, 39.3M memory peak, 4K written to disk, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5310worker1: must succeed: systemctl reload nix-grpc-daemon.service5311worker1 # [ 128.841477] systemd[1]: Reloading Nix worker-protocol over gRPC...5312worker1 # [ 128.892385] systemd[1]: Reloaded Nix worker-protocol over gRPC.5313worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5314worker1: must succeed: pgrep -f 'read -t [9]0 x'5315worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5316client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&25317worker1 # [ 128.990317] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:02Z level=info event=draining5318worker2 # [ 129.213481] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:395325319client # don't know how to build these paths:5320client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5321worker1 # [ 129.253432] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:02Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05322worker1 # [ 129.255514] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:02Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15323worker2 # [ 129.282567] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395325324worker2 # [ 129.299117] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:395325325client # copying 1 paths to 'lb:50051'...5326client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5327worker2 # [ 129.316890] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:395325328worker2 # [ 129.333399] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5329worker2 # [ 129.556132] nix-daemon[905]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)5330worker2 # [ 129.575051] nix-daemon[905]: reaped child process 1688, status = succeeded5331worker2 # [ 129.756773] nix-daemon[905]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)5332worker2 # [ 129.776607] nix-daemon[905]: reaped child process 1693, status = succeeded5333lb # [ 129.801699] niks3-server[983]: 2026/09/20 08:07:03 INFO Received uploads request method=POST path=/api/pending_closures5334worker2 # [ 129.800822] nix-grpc-daemon[1614]: time=2026-09-20T08:07:03.215Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5335worker2 # [ 129.802396] nix-grpc-daemon[1614]: time=2026-09-20T08:07:03.215Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5336lb # [ 129.836617] niks3-server[983]: 2026/09/20 08:07:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5337worker2 # [ 129.834143] nix-grpc-daemon[1614]: time=2026-09-20T08:07:03.249Z level=INFO msg="Uploading 1 narinfos"5338lb # [ 129.853825] niks3-server[983]: 2026/09/20 08:07:03 INFO Signed narinfos id=37 count=15339lb # [ 129.863710] niks3-server[983]: 2026/09/20 08:07:03 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5340lb # [ 129.875151] niks3-server[983]: 2026/09/20 08:07:03 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5341lb # [ 129.887538] niks3-server[983]: 2026/09/20 08:07:03 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5342lb # [ 129.894502] niks3-server[983]: 2026/09/20 08:07:03 INFO Completed upload id=375343worker2 # [ 129.881716] nix-grpc-daemon[1614]: time=2026-09-20T08:07:03.297Z level=INFO msg="Upload complete. (529ms)"5344lb # [ 129.897228] niks3-server[983]: 2026/09/20 08:07:03 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5345worker2 # [ 129.890799] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=0 paths=1 nar_bytes_in=5285346worker2 # [ 129.904462] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395325347worker2 # [ 129.915065] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5348worker2 # [ 129.921822] nix-daemon[905]: reaped child process 1683, status = succeeded5349client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5350client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5351worker2 # [ 129.937588] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5352client # farm-a> LOG-farm-a-during-drain5353worker2 # [ 131.798390] nix-daemon[905]: reaped child process 1697, status = succeeded5354worker2 # [ 132.000151] nix-daemon[905]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)5355worker2 # [ 132.020509] nix-daemon[905]: reaped child process 1715, status = succeeded5356lb # [ 132.046262] niks3-server[983]: 2026/09/20 08:07:05 INFO Received uploads request method=POST path=/api/pending_closures5357worker2 # [ 132.048541] nix-grpc-daemon[1614]: time=2026-09-20T08:07:05.460Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5358worker2 # [ 132.050281] nix-grpc-daemon[1614]: time=2026-09-20T08:07:05.460Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5359lb # [ 132.088373] niks3-server[983]: 2026/09/20 08:07:05 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5360lb # [ 132.100979] niks3-server[983]: 2026/09/20 08:07:05 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5361lb # [ 132.113095] niks3-server[983]: 2026/09/20 08:07:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5362worker2 # [ 132.107782] nix-grpc-daemon[1614]: time=2026-09-20T08:07:05.522Z level=INFO msg="Uploading 1 narinfos"5363lb # [ 132.119706] niks3-server[983]: 2026/09/20 08:07:05 INFO Signed narinfos id=38 count=15364lb # [ 132.125733] niks3-server[983]: 2026/09/20 08:07:05 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5365lb # [ 132.138950] niks3-server[983]: 2026/09/20 08:07:05 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5366lb # [ 132.145543] niks3-server[983]: 2026/09/20 08:07:05 INFO Completed upload id=385367worker2 # [ 132.133524] nix-grpc-daemon[1614]: time=2026-09-20T08:07:05.549Z level=INFO msg="Upload complete. (382ms)"5368lb # [ 132.148691] niks3-server[983]: 2026/09/20 08:07:05 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5369worker1 # [ 132.168113] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:05Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05370worker1 # [ 132.170089] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:05Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15371worker2 # [ 132.145274] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=2 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15372worker2 # [ 132.168996] nix-daemon[905]: reaped child process 1695, status = succeeded5373worker2 # [ 132.201490] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395325374worker2 # [ 132.216607] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:395325375worker2 # [ 132.231025] nix-grpc-daemon[1614]: time=2026-09-20T08:07:05.646Z level=INFO msg="All 1 paths already cached"5376client # copying 1 paths to 'lb:50051'...5377client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5378worker2 # [ 132.240542] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:395325379worker2 # [ 132.255010] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5380worker2 # [ 132.463850] nix-daemon[905]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)5381worker2 # [ 132.486420] nix-daemon[905]: reaped child process 1722, status = succeeded5382worker2 # [ 132.658988] nix-daemon[905]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5383worker2 # [ 132.678700] nix-daemon[905]: reaped child process 1727, status = succeeded5384lb # [ 132.698032] niks3-server[983]: 2026/09/20 08:07:06 INFO Received uploads request method=POST path=/api/pending_closures5385worker2 # [ 132.696148] nix-grpc-daemon[1614]: time=2026-09-20T08:07:06.111Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5386worker2 # [ 132.698399] nix-grpc-daemon[1614]: time=2026-09-20T08:07:06.113Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5387lb # [ 132.730554] niks3-server[983]: 2026/09/20 08:07:06 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5388worker2 # [ 132.732436] nix-grpc-daemon[1614]: time=2026-09-20T08:07:06.147Z level=INFO msg="Uploading 1 narinfos"5389lb # [ 132.748226] niks3-server[983]: 2026/09/20 08:07:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5390lb # [ 132.758498] niks3-server[983]: 2026/09/20 08:07:06 INFO Signed narinfos id=39 count=15391lb # [ 132.764266] niks3-server[983]: 2026/09/20 08:07:06 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5392lb # [ 132.773104] niks3-server[983]: 2026/09/20 08:07:06 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5393worker2 # [ 132.766358] nix-grpc-daemon[1614]: time=2026-09-20T08:07:06.182Z level=INFO msg="Upload complete. (495ms)"5394lb # [ 132.778209] niks3-server[983]: 2026/09/20 08:07:06 INFO Completed upload id=395395lb # [ 132.782120] niks3-server[983]: 2026/09/20 08:07:06 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5396worker2 # [ 132.772388] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=0 paths=1 nar_bytes_in=6405397worker2 # [ 132.782021] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395325398worker2 # [ 132.791865] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5399worker2 # [ 132.798371] nix-daemon[905]: reaped child process 1717, status = succeeded5400client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5401client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5402worker2 # [ 132.811410] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5403lb # [ 133.322146] envoy[859]: conn peer=[2001:db8:1::1]:37616 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554536:system_library:OPENSSL_internal:Connection_reset_by_peer:TLS_error_end" rx=2931 tx=818 ms=51695404client # farm-b> LOG-farm-b-during-drain5405worker2 # [ 134.038751] nix-daemon[905]: reaped child process 1731, status = succeeded5406worker2 # [ 134.213813] nix-daemon[905]: accepted connection from pid 1746, user nix-grpc-daemon (trusted)5407worker2 # [ 134.236002] nix-daemon[905]: reaped child process 1749, status = succeeded5408lb # [ 134.263695] niks3-server[983]: 2026/09/20 08:07:07 INFO Received uploads request method=POST path=/api/pending_closures5409worker2 # [ 134.263822] nix-grpc-daemon[1614]: time=2026-09-20T08:07:07.678Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5410worker2 # [ 134.265658] nix-grpc-daemon[1614]: time=2026-09-20T08:07:07.678Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5411lb # [ 134.310696] niks3-server[983]: 2026/09/20 08:07:07 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5412worker2 # [ 134.309754] nix-grpc-daemon[1614]: time=2026-09-20T08:07:07.725Z level=INFO msg="Uploading 1 narinfos"5413lb # [ 134.325114] niks3-server[983]: 2026/09/20 08:07:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5414lb # [ 134.332957] niks3-server[983]: 2026/09/20 08:07:07 INFO Signed narinfos id=40 count=15415lb # [ 134.337202] niks3-server[983]: 2026/09/20 08:07:07 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5416lb # [ 134.343554] niks3-server[983]: 2026/09/20 08:07:07 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5417worker2 # [ 134.336038] nix-grpc-daemon[1614]: time=2026-09-20T08:07:07.751Z level=INFO msg="Upload complete. (314ms)"5418lb # [ 134.348568] niks3-server[983]: 2026/09/20 08:07:07 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5419lb # [ 134.353158] niks3-server[983]: 2026/09/20 08:07:07 INFO Completed upload id=405420lb # [ 134.355781] niks3-server[983]: 2026/09/20 08:07:07 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5421worker2 # [ 134.345195] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15422worker1 # [ 134.370180] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:07Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05423worker1 # [ 134.372284] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:07Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15424worker2 # [ 134.357176] nix-daemon[905]: reaped child process 1729, status = succeeded5425worker2 # [ 134.400639] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395325426worker2 # [ 134.413376] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:395325427worker2 # [ 134.424765] nix-grpc-daemon[1614]: time=2026-09-20T08:07:07.840Z level=INFO msg="All 2 paths already cached"5428client # copying 1 paths to 'lb:50051'...5429client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5430worker2 # [ 134.433823] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:395325431worker2 # [ 134.445438] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5432worker2 # [ 134.647216] nix-daemon[905]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)5433worker2 # [ 134.669336] nix-daemon[905]: reaped child process 1756, status = succeeded5434worker2 # [ 134.846281] nix-daemon[905]: accepted connection from pid 1758, user nix-grpc-daemon (trusted)5435worker2 # [ 134.866287] nix-daemon[905]: reaped child process 1761, status = succeeded5436lb # [ 134.889894] niks3-server[983]: 2026/09/20 08:07:08 INFO Received uploads request method=POST path=/api/pending_closures5437worker2 # [ 134.887826] nix-grpc-daemon[1614]: time=2026-09-20T08:07:08.303Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5438worker2 # [ 134.889619] nix-grpc-daemon[1614]: time=2026-09-20T08:07:08.303Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5439lb # [ 134.921522] niks3-server[983]: 2026/09/20 08:07:08 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5440lb # [ 134.934064] niks3-server[983]: 2026/09/20 08:07:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5441worker2 # [ 134.931164] nix-grpc-daemon[1614]: time=2026-09-20T08:07:08.346Z level=INFO msg="Uploading 1 narinfos"5442lb # [ 134.942904] niks3-server[983]: 2026/09/20 08:07:08 INFO Signed narinfos id=41 count=15443lb # [ 134.949477] niks3-server[983]: 2026/09/20 08:07:08 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5444lb # [ 134.964243] niks3-server[983]: 2026/09/20 08:07:08 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5445lb # [ 134.973542] niks3-server[983]: 2026/09/20 08:07:08 INFO Completed upload id=415446worker2 # [ 134.961951] nix-grpc-daemon[1614]: time=2026-09-20T08:07:08.377Z level=INFO msg="Upload complete. (503ms)"5447lb # [ 134.978710] niks3-server[983]: 2026/09/20 08:07:08 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5448worker2 # [ 134.973552] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=0 paths=1 nar_bytes_in=7685449worker2 # [ 134.984298] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395325450worker2 # [ 134.991909] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5451worker2 # [ 134.998272] nix-daemon[905]: reaped child process 1751, status = succeeded5452client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5453worker2 # [ 135.010544] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5454client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5455client # farm-top> LOG-farm-top-during-drain5456worker2 # [ 136.047436] nix-daemon[905]: reaped child process 1765, status = succeeded5457worker2 # [ 136.228442] nix-daemon[905]: accepted connection from pid 1780, user nix-grpc-daemon (trusted)5458worker2 # [ 136.249629] nix-daemon[905]: reaped child process 1783, status = succeeded5459lb # [ 136.275544] niks3-server[983]: 2026/09/20 08:07:09 INFO Received uploads request method=POST path=/api/pending_closures5460worker2 # [ 136.274219] nix-grpc-daemon[1614]: time=2026-09-20T08:07:09.687Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5461worker2 # [ 136.275806] nix-grpc-daemon[1614]: time=2026-09-20T08:07:09.687Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5462lb # [ 136.311284] niks3-server[983]: 2026/09/20 08:07:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5463lb # [ 136.316843] niks3-server[983]: 2026/09/20 08:07:09 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5464lb # [ 136.334201] niks3-server[983]: 2026/09/20 08:07:09 INFO Signed narinfos id=42 count=15465worker2 # [ 136.323357] nix-grpc-daemon[1614]: time=2026-09-20T08:07:09.738Z level=INFO msg="Uploading 1 narinfos"5466lb # [ 136.341665] niks3-server[983]: 2026/09/20 08:07:09 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5467lb # [ 136.349868] niks3-server[983]: 2026/09/20 08:07:09 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5468lb # [ 136.356347] niks3-server[983]: 2026/09/20 08:07:09 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5469lb # [ 136.360690] niks3-server[983]: 2026/09/20 08:07:09 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5470lb # [ 136.366093] niks3-server[983]: 2026/09/20 08:07:09 INFO Completed upload id=425471worker2 # [ 136.354630] nix-grpc-daemon[1614]: time=2026-09-20T08:07:09.770Z level=INFO msg="Upload complete. (327ms)"5472worker2 # [ 136.369272] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15473worker2 # [ 136.382820] nix-daemon[905]: reaped child process 1763, status = succeeded5474client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&2, in 7.48 seconds)5475client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath5476client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath, in 0.25 seconds)5477worker1: must succeed: pkill -f 'read -t [9]0 x'5478worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5479client: waiting for success: ! systemctl is-active sw5480worker1 # [ 136.921912] nix-daemon[844]: reaped child process 1467, status = succeeded5481worker1 # [ 137.127551] nix-daemon[844]: accepted connection from pid 1513, user nix-grpc-daemon (trusted)5482worker1 # [ 137.147812] nix-daemon[844]: reaped child process 1516, status = succeeded5483lb # [ 137.154324] niks3-server[983]: 2026/09/20 08:07:10 INFO Received uploads request method=POST path=/api/pending_closures5484worker1 # [ 137.177753] nix-grpc-daemon[1411]: time=2026-09-20T08:07:10.567Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5485worker1 # [ 137.179493] nix-grpc-daemon[1411]: time=2026-09-20T08:07:10.567Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5486lb # [ 137.215095] niks3-server[983]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5487worker1 # [ 137.233742] nix-grpc-daemon[1411]: time=2026-09-20T08:07:10.623Z level=INFO msg="Uploading 1 narinfos"5488lb # [ 137.225906] niks3-server[983]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5489lb # [ 137.237454] niks3-server[983]: 2026/09/20 08:07:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5490lb # [ 137.244773] niks3-server[983]: 2026/09/20 08:07:10 INFO Signed narinfos id=43 count=15491lb # [ 137.247158] niks3-server[983]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5492lb # [ 137.255311] niks3-server[983]: 2026/09/20 08:07:10 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5493lb # [ 137.262916] niks3-server[983]: 2026/09/20 08:07:10 INFO Completed upload id=435494worker1 # [ 137.271545] nix-grpc-daemon[1411]: time=2026-09-20T08:07:10.662Z level=INFO msg="Upload complete. (383ms)"5495lb # [ 137.265492] niks3-server[983]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5496worker1 # [ 137.285438] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41934 duration_s=10 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15497worker1 # [ 137.304671] nix-daemon[844]: reaped child process 1465, status = succeeded5498client # [ 137.359243] systemd[1]: sw.service: Deactivated successfully.5499client # [ 137.364138] systemd[1]: sw.service: Consumed 196ms CPU time over 11.197s wall clock time, 41.1M memory peak, 4K written to disk, 8.4K incoming IP traffic, 8.8K outgoing IP traffic.5500client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds)5501client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5502client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)5503worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5504worker1 # [ 137.992625] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:11Z level=info event=signal_exit5505worker1 # [ 138.219396] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:11Z level=info event=scheduler_yield5506lb # [ 138.213397] niks3-server[983]: 2026/09/20 08:07:11 INFO lead: released remote=192.168.1.3:426905507worker2 # [ 138.204897] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:11Z level=info event=scheduler_restarting addr=lb:500515508worker1 # [ 138.230486] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:419405509worker1 # [ 138.237129] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:11Z level=info event=worker_gone addr=192.168.1.4:500515510worker1 # [ 138.242825] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:11Z level=info event=scheduler_restarting addr=lb:500515511worker1 # [ 138.247074] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:419405512worker1 # [ 138.251610] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:11Z level=info event=worker_gone addr=192.168.1.3:500515513worker2 # [ 138.404975] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:11Z level=info event=scheduler_connected addr=lb:500515514worker2 # [ 138.410074] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5515worker1 # [ 138.441178] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:11Z level=info event=scheduler_connected addr=lb:500515516worker1 # [ 138.445808] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5517worker2 # [ 138.611225] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:12Z level=info event=scheduler_connected addr=lb:500515518worker2 # [ 138.617402] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5519worker1 # [ 138.642285] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:12Z level=info event=scheduler_connected addr=lb:500515520worker1 # [ 138.649101] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5521worker2 # [ 138.818140] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:12Z level=info event=scheduler_connected addr=lb:500515522worker2 # [ 138.826631] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5523worker1 # [ 138.850053] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:12Z level=info event=scheduler_connected addr=lb:500515524worker1 # [ 138.855882] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5525worker2 # [ 139.027787] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:12Z level=info event=scheduler_connected addr=lb:500515526worker2 # [ 139.033760] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5527worker1 # [ 139.056866] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:12Z level=info event=scheduler_connected addr=lb:500515528worker1 # [ 139.062498] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5529worker1 # [ 139.225553] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:12Z level=info event=scheduler_restarting5530worker1 # [ 139.252846] nix-daemon[844]: reaped child process 1361, status = succeeded5531worker1 # [ 139.256278] nix-grpc-daemon[1308]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5532worker1 # [ 139.257781] nix-grpc-daemon[1308]: E0000 00:00:1789891632.646768 1351 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5533worker2 # [ 139.235985] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:12Z level=info event=scheduler_connected addr=lb:500515534worker1 # [ 139.270793] nix-grpc-daemon[1308]: ts=2026-09-20T08:07:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5535worker1 # [ 139.723269] nix-grpc-daemon[1308]: E0000 00:00:1789891633.112379 1351 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5536worker1 # [ 139.743439] nix-grpc-daemon[1308]: E0000 00:00:1789891633.133848 1351 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5537worker2 # [ 139.991777] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:13Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5538worker1 # [ 140.033861] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5539worker1 # [ 140.040590] systemd[1]: nix-grpc-daemon.service: Consumed 1.018s CPU time over 28.310s wall clock time, 32M memory peak, 24.5K incoming IP traffic, 33.1K outgoing IP traffic.5540worker1 # [ 140.067674] systemd[1]: Starting Nix worker-protocol over gRPC...5541worker2 # [ 140.192786] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:13Z level=info event=scheduler_connected addr=lb:500515542worker2 # [ 140.200262] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5543worker1 # [ 140.259183] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5544worker1 # [ 140.262101] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15545worker1 # [ 140.270433] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5546lb # [ 140.271053] niks3-server[983]: 2026/09/20 08:07:13 INFO lead: acquired remote=192.168.1.3:559365547worker1 # [ 140.280106] systemd[1]: Started Nix worker-protocol over gRPC.5548worker1 # [ 140.281829] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:13Z level=info event=scheduler_take_over5549worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.35 seconds)5550lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5551lb: must succeed: curl -sf localhost:9901/clusters5552worker1 # [ 140.293292] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:13Z level=info event=scheduler_connected addr=lb:500515553worker1 # [ 140.308637] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05554lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5555worker2 # [ 140.404495] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:13Z level=info event=scheduler_connected addr=lb:500515556worker2 # [ 140.409623] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5557worker2 # [ 140.605747] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:14Z level=info event=scheduler_connected addr=lb:500515558worker1 # [ 140.629569] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05559lb: must succeed: curl -sf localhost:9901/clusters5560lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5561lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds)5562lb: must succeed: curl -sf localhost:9901/clusters5563lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5564worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5565worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5566(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.55 seconds)5567subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5568client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15569worker1 # [ 141.875381] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:450365570worker1 # [ 141.891163] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5571worker1 # [ 141.925242] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:15Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05572worker1 # [ 141.932526] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:15Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15573worker1 # [ 141.938584] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:15Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05574worker1 # [ 141.943676] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:15Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05575worker1 # [ 141.974749] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365576worker1 # [ 141.993174] nix-grpc-daemon[1530]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 1/5)5577worker1 # [ 142.031747] nix-grpc-daemon[1530]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 2/5)5578worker1 # [ 142.052365] nix-grpc-daemon[1530]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 372 ms (attempt 3/5)5579worker1 # [ 142.432182] nix-grpc-daemon[1530]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 563 ms (attempt 4/5)5580worker1 # [ 142.997705] nix-grpc-daemon[1530]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5581worker1 # [ 143.020410] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:450365582worker1 # [ 143.038560] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:450365583worker1 # [ 143.055508] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5584worker1 # [ 143.084065] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:16Z level=info event=niks3_push_started pid=15935585lb # [ 143.324969] envoy[859]: conn peer=[2001:db8:1::1]:37626 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9538 tx=3802 ms=71745586lb # [ 143.328164] envoy[859]: conn peer=[2001:db8:1::1]:37622 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2939 tx=1350 ms=107875587lb # [ 143.330959] envoy[859]: conn peer=[2001:db8:1::3]:41200 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1696 tx=721 ms=272735588worker1 # [ 143.491912] nix-daemon[844]: accepted connection from pid 1606, user nix-grpc-daemon (trusted)5589worker1 # [ 143.514503] nix-daemon[844]: reaped child process 1609, status = succeeded5590worker1 # [ 143.699883] nix-daemon[844]: accepted connection from pid 1611, user nix-grpc-daemon (trusted)5591worker1 # [ 143.721534] nix-daemon[844]: reaped child process 1614, status = succeeded5592lb # [ 143.725788] niks3-server[983]: 2026/09/20 08:07:17 INFO Received uploads request method=POST path=/api/pending_closures5593worker1 # [ 143.746635] nix-grpc-daemon[1593]: time=2026-09-20T08:07:17.135Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5594worker1 # [ 143.748570] nix-grpc-daemon[1593]: time=2026-09-20T08:07:17.135Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5595lb # [ 143.769295] niks3-server[983]: 2026/09/20 08:07:17 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5596worker1 # [ 143.785897] nix-grpc-daemon[1593]: time=2026-09-20T08:07:17.175Z level=INFO msg="Uploading 1 narinfos"5597lb # [ 143.776751] niks3-server[983]: 2026/09/20 08:07:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5598lb # [ 143.783529] niks3-server[983]: 2026/09/20 08:07:17 INFO Signed narinfos id=44 count=15599lb # [ 143.797889] niks3-server[983]: 2026/09/20 08:07:17 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5600worker1 # [ 143.816500] nix-grpc-daemon[1593]: time=2026-09-20T08:07:17.206Z level=INFO msg="Upload complete. (505ms)"5601lb # [ 143.808401] niks3-server[983]: 2026/09/20 08:07:17 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5602lb # [ 143.816061] niks3-server[983]: 2026/09/20 08:07:17 INFO Completed upload id=445603worker1 # [ 143.824176] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=0 paths=1 nar_bytes_in=5125604lb # [ 143.819379] niks3-server[983]: 2026/09/20 08:07:17 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5605worker1 # [ 143.839722] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365606worker1 # [ 143.846416] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5607worker1 # [ 143.851506] nix-daemon[844]: reaped child process 1591, status = succeeded5608worker1 # [ 143.862971] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5609worker1 # [ 145.513681] nix-daemon[844]: reaped child process 1618, status = succeeded5610worker1 # [ 145.700883] nix-daemon[844]: accepted connection from pid 1633, user nix-grpc-daemon (trusted)5611worker1 # [ 145.722316] nix-daemon[844]: reaped child process 1636, status = succeeded5612lb # [ 145.730401] niks3-server[983]: 2026/09/20 08:07:19 INFO Received uploads request method=POST path=/api/pending_closures5613worker1 # [ 145.748538] nix-grpc-daemon[1593]: time=2026-09-20T08:07:19.137Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5614worker1 # [ 145.750541] nix-grpc-daemon[1593]: time=2026-09-20T08:07:19.137Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5615lb # [ 145.778136] niks3-server[983]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5616worker1 # [ 145.803797] nix-grpc-daemon[1593]: time=2026-09-20T08:07:19.192Z level=INFO msg="Uploading 1 narinfos"5617lb # [ 145.797673] niks3-server[983]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5618lb # [ 145.808096] niks3-server[983]: 2026/09/20 08:07:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5619lb # [ 145.813205] niks3-server[983]: 2026/09/20 08:07:19 INFO Signed narinfos id=45 count=15620lb # [ 145.820698] niks3-server[983]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5621lb # [ 145.824411] niks3-server[983]: 2026/09/20 08:07:19 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5622lb # [ 145.828861] niks3-server[983]: 2026/09/20 08:07:19 INFO Completed upload id=455623worker1 # [ 145.837160] nix-grpc-daemon[1593]: time=2026-09-20T08:07:19.227Z level=INFO msg="Upload complete. (358ms)"5624lb # [ 145.831875] niks3-server[983]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5625worker1 # [ 145.858442] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=2 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=15626worker1 # [ 145.876466] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:19Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15627worker1 # [ 145.883213] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:19Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05628worker1 # [ 145.888086] nix-daemon[844]: reaped child process 1616, status = succeeded5629worker1 # [ 145.896848] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365630worker1 # [ 145.912753] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:450365631worker1 # [ 145.928660] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:450365632worker1 # [ 145.941615] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5633worker1 # [ 146.141137] nix-daemon[844]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)5634worker1 # [ 146.163009] nix-daemon[844]: reaped child process 1645, status = succeeded5635worker1 # [ 146.345160] nix-daemon[844]: accepted connection from pid 1647, user nix-grpc-daemon (trusted)5636worker1 # [ 146.366791] nix-daemon[844]: reaped child process 1650, status = succeeded5637lb # [ 146.370278] niks3-server[983]: 2026/09/20 08:07:19 INFO Received uploads request method=POST path=/api/pending_closures5638worker1 # [ 146.390025] nix-grpc-daemon[1593]: time=2026-09-20T08:07:19.780Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5639worker1 # [ 146.391605] nix-grpc-daemon[1593]: time=2026-09-20T08:07:19.780Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5640lb # [ 146.403681] niks3-server[983]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5641lb # [ 146.420474] niks3-server[983]: 2026/09/20 08:07:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5642worker1 # [ 146.436638] nix-grpc-daemon[1593]: time=2026-09-20T08:07:19.826Z level=INFO msg="Uploading 1 narinfos"5643lb # [ 146.427890] niks3-server[983]: 2026/09/20 08:07:19 INFO Signed narinfos id=46 count=15644lb # [ 146.435374] niks3-server[983]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5645lb # [ 146.454315] niks3-server[983]: 2026/09/20 08:07:19 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5646lb # [ 146.462861] niks3-server[983]: 2026/09/20 08:07:19 INFO Completed upload id=465647worker1 # [ 146.471637] nix-grpc-daemon[1593]: time=2026-09-20T08:07:19.862Z level=INFO msg="Upload complete. (515ms)"5648lb # [ 146.467223] niks3-server[983]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5649worker1 # [ 146.480405] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=0 paths=1 nar_bytes_in=5125650worker1 # [ 146.492975] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365651worker1 # [ 146.504509] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5652worker1 # [ 146.515771] nix-daemon[844]: reaped child process 1640, status = succeeded5653worker1 # [ 146.524257] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5654worker1 # [ 147.573451] nix-daemon[844]: reaped child process 1654, status = succeeded5655worker1 # [ 147.734038] nix-daemon[844]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)5656worker1 # [ 147.755823] nix-daemon[844]: reaped child process 1672, status = succeeded5657lb # [ 147.761481] niks3-server[983]: 2026/09/20 08:07:21 INFO Received uploads request method=POST path=/api/pending_closures5658worker1 # [ 147.780794] nix-grpc-daemon[1593]: time=2026-09-20T08:07:21.170Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5659worker1 # [ 147.783908] nix-grpc-daemon[1593]: time=2026-09-20T08:07:21.173Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5660lb # [ 147.799220] niks3-server[983]: 2026/09/20 08:07:21 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5661lb # [ 147.820856] niks3-server[983]: 2026/09/20 08:07:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5662worker1 # [ 147.835882] nix-grpc-daemon[1593]: time=2026-09-20T08:07:21.225Z level=INFO msg="Uploading 1 narinfos"5663lb # [ 147.830611] niks3-server[983]: 2026/09/20 08:07:21 INFO Signed narinfos id=47 count=15664lb # [ 147.837433] niks3-server[983]: 2026/09/20 08:07:21 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5665lb # [ 147.853561] niks3-server[983]: 2026/09/20 08:07:21 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5666worker1 # [ 147.869127] nix-grpc-daemon[1593]: time=2026-09-20T08:07:21.259Z level=INFO msg="Upload complete. (334ms)"5667lb # [ 147.865283] niks3-server[983]: 2026/09/20 08:07:21 INFO Completed upload id=475668lb # [ 147.868187] niks3-server[983]: 2026/09/20 08:07:21 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5669worker1 # [ 147.888258] nix-grpc-daemon[1593]: time=2026-09-20T08:07:21.265Z level=WARN msg="Failed to register uploaded object" key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls error="server returned 404: object is not pending upload\n"5670worker1 # [ 147.909959] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=15671worker1 # [ 147.920615] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:21Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15672worker1 # [ 147.925780] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365673worker1 # [ 147.930561] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:21Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05674worker1 # [ 147.933937] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:450365675worker1 # [ 147.939374] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:450365676worker1 # [ 147.949011] nix-daemon[844]: reaped child process 1652, status = succeeded5677worker1 # [ 147.950759] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5678worker1 # [ 148.155190] nix-daemon[844]: accepted connection from pid 1678, user nix-grpc-daemon (trusted)5679worker1 # [ 148.178217] nix-daemon[844]: reaped child process 1681, status = succeeded5680worker1 # [ 148.363036] nix-daemon[844]: accepted connection from pid 1683, user nix-grpc-daemon (trusted)5681worker1 # [ 148.385705] nix-daemon[844]: reaped child process 1686, status = succeeded5682lb # [ 148.389276] niks3-server[983]: 2026/09/20 08:07:21 INFO Received uploads request method=POST path=/api/pending_closures5683worker1 # [ 148.405904] nix-grpc-daemon[1593]: time=2026-09-20T08:07:21.796Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5684worker1 # [ 148.407492] nix-grpc-daemon[1593]: time=2026-09-20T08:07:21.796Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5685lb # [ 148.421235] niks3-server[983]: 2026/09/20 08:07:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5686worker1 # [ 148.434077] nix-grpc-daemon[1593]: time=2026-09-20T08:07:21.824Z level=INFO msg="Uploading 1 narinfos"5687lb # [ 148.429221] niks3-server[983]: 2026/09/20 08:07:21 INFO Signed narinfos id=48 count=15688lb # [ 148.432709] niks3-server[983]: 2026/09/20 08:07:21 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5689lb # [ 148.435052] niks3-server[983]: 2026/09/20 08:07:21 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5690lb # [ 148.441650] niks3-server[983]: 2026/09/20 08:07:21 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5691lb # [ 148.452596] niks3-server[983]: 2026/09/20 08:07:21 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5692lb # [ 148.458020] niks3-server[983]: 2026/09/20 08:07:21 INFO Completed upload id=485693worker1 # [ 148.466600] nix-grpc-daemon[1593]: time=2026-09-20T08:07:21.857Z level=INFO msg="Upload complete. (505ms)"5694worker1 # [ 148.472284] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=0 paths=1 nar_bytes_in=5125695worker1 # [ 148.481081] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365696worker1 # [ 148.496237] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5697worker1 # [ 148.498747] nix-daemon[844]: reaped child process 1676, status = succeeded5698worker1 # [ 148.512249] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5699worker1 # [ 149.971543] nix-daemon[844]: reaped child process 1690, status = succeeded5700worker1 # [ 150.195480] nix-daemon[844]: accepted connection from pid 1705, user nix-grpc-daemon (trusted)5701worker1 # [ 150.215989] nix-daemon[844]: reaped child process 1708, status = succeeded5702lb # [ 150.231069] niks3-server[983]: 2026/09/20 08:07:23 INFO Received uploads request method=POST path=/api/pending_closures5703worker1 # [ 150.253113] nix-grpc-daemon[1593]: time=2026-09-20T08:07:23.641Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5704worker1 # [ 150.254746] nix-grpc-daemon[1593]: time=2026-09-20T08:07:23.642Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5705lb # [ 150.294165] niks3-server[983]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5706lb # [ 150.304952] niks3-server[983]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5707lb # [ 150.318503] niks3-server[983]: 2026/09/20 08:07:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5708lb # [ 150.325672] niks3-server[983]: 2026/09/20 08:07:23 INFO Signed narinfos id=49 count=15709worker1 # [ 150.336112] nix-grpc-daemon[1593]: time=2026-09-20T08:07:23.724Z level=INFO msg="Uploading 1 narinfos"5710lb # [ 150.331119] niks3-server[983]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5711lb # [ 150.345790] niks3-server[983]: 2026/09/20 08:07:23 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5712worker1 # [ 150.359596] nix-grpc-daemon[1593]: time=2026-09-20T08:07:23.750Z level=INFO msg="Upload complete. (434ms)"5713lb # [ 150.353879] niks3-server[983]: 2026/09/20 08:07:23 INFO Completed upload id=495714lb # [ 150.356646] niks3-server[983]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5715worker1 # [ 150.388839] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=15716worker1 # [ 150.404490] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:23Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15717worker1 # [ 150.416389] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365718worker1 # [ 150.428561] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:23Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05719worker1 # [ 150.432950] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:450365720worker1 # [ 150.446354] nix-daemon[844]: reaped child process 1688, status = succeeded5721worker1 # [ 150.453781] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5722worker1 # [ 150.458699] nix-grpc-daemon[1593]: time=2026-09-20T08:07:23.817Z level=INFO msg="All 1 paths already cached"5723worker1 # [ 150.463000] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:450365724worker1 # [ 150.676052] nix-daemon[844]: accepted connection from pid 1714, user nix-grpc-daemon (trusted)5725worker1 # [ 150.699713] nix-daemon[844]: reaped child process 1717, status = succeeded5726worker1 # [ 150.899446] nix-daemon[844]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)5727worker1 # [ 150.922751] nix-daemon[844]: reaped child process 1722, status = succeeded5728lb # [ 150.928221] niks3-server[983]: 2026/09/20 08:07:24 INFO Received uploads request method=POST path=/api/pending_closures5729worker1 # [ 150.949623] nix-grpc-daemon[1593]: time=2026-09-20T08:07:24.339Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5730worker1 # [ 150.951205] nix-grpc-daemon[1593]: time=2026-09-20T08:07:24.339Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5731lb # [ 150.982742] niks3-server[983]: 2026/09/20 08:07:24 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5732lb # [ 150.996618] niks3-server[983]: 2026/09/20 08:07:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5733worker1 # [ 151.012376] nix-grpc-daemon[1593]: time=2026-09-20T08:07:24.402Z level=INFO msg="Uploading 1 narinfos"5734lb # [ 151.003864] niks3-server[983]: 2026/09/20 08:07:24 INFO Signed narinfos id=50 count=15735lb # [ 151.009270] niks3-server[983]: 2026/09/20 08:07:24 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5736lb # [ 151.024519] niks3-server[983]: 2026/09/20 08:07:24 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5737lb # [ 151.035377] niks3-server[983]: 2026/09/20 08:07:24 INFO Completed upload id=505738worker1 # [ 151.041759] nix-grpc-daemon[1593]: time=2026-09-20T08:07:24.432Z level=INFO msg="Upload complete. (573ms)"5739lb # [ 151.038805] niks3-server[983]: 2026/09/20 08:07:24 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5740worker1 # [ 151.058298] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=0 paths=1 nar_bytes_in=6245741worker1 # [ 151.075781] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365742worker1 # [ 151.089545] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5743worker1 # [ 151.095563] nix-daemon[844]: reaped child process 1712, status = succeeded5744worker1 # [ 151.109416] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5745worker1 # [ 152.355037] nix-daemon[844]: reaped child process 1726, status = succeeded5746worker1 # [ 152.574627] nix-daemon[844]: accepted connection from pid 1741, user nix-grpc-daemon (trusted)5747worker1 # [ 152.596985] nix-daemon[844]: reaped child process 1744, status = succeeded5748lb # [ 152.603547] niks3-server[983]: 2026/09/20 08:07:26 INFO Received uploads request method=POST path=/api/pending_closures5749worker1 # [ 152.627853] nix-grpc-daemon[1593]: time=2026-09-20T08:07:26.015Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5750worker1 # [ 152.629658] nix-grpc-daemon[1593]: time=2026-09-20T08:07:26.015Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5751lb # [ 152.670655] niks3-server[983]: 2026/09/20 08:07:26 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5752lb # [ 152.687403] niks3-server[983]: 2026/09/20 08:07:26 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5753worker1 # [ 152.703081] nix-grpc-daemon[1593]: time=2026-09-20T08:07:26.093Z level=INFO msg="Uploading 1 narinfos"5754lb # [ 152.699602] niks3-server[983]: 2026/09/20 08:07:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5755lb # [ 152.707875] niks3-server[983]: 2026/09/20 08:07:26 INFO Signed narinfos id=51 count=15756lb # [ 152.714192] niks3-server[983]: 2026/09/20 08:07:26 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5757lb # [ 152.723796] niks3-server[983]: 2026/09/20 08:07:26 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5758lb # [ 152.729493] niks3-server[983]: 2026/09/20 08:07:26 INFO Completed upload id=515759worker1 # [ 152.737179] nix-grpc-daemon[1593]: time=2026-09-20T08:07:26.127Z level=INFO msg="Upload complete. (410ms)"5760lb # [ 152.732535] niks3-server[983]: 2026/09/20 08:07:26 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5761worker1 # [ 152.765926] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=15762worker1 # [ 152.784947] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:26Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15763worker1 # [ 152.805075] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365764worker1 # [ 152.809173] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:26Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05765worker1 # [ 152.815148] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:450365766worker1 # [ 152.818628] nix-daemon[844]: reaped child process 1724, status = succeeded5767worker1 # [ 152.829831] nix-grpc-daemon[1593]: time=2026-09-20T08:07:26.220Z level=INFO msg="All 1 paths already cached"5768worker1 # [ 152.843272] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:450365769worker1 # [ 152.863730] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5770worker1 # [ 153.120177] nix-daemon[844]: accepted connection from pid 1750, user nix-grpc-daemon (trusted)5771worker1 # [ 153.141774] nix-daemon[844]: reaped child process 1753, status = succeeded5772worker1 # [ 153.339783] nix-daemon[844]: accepted connection from pid 1755, user nix-grpc-daemon (trusted)5773worker1 # [ 153.362900] nix-daemon[844]: reaped child process 1758, status = succeeded5774lb # [ 153.369387] niks3-server[983]: 2026/09/20 08:07:26 INFO Received uploads request method=POST path=/api/pending_closures5775worker1 # [ 153.389394] nix-grpc-daemon[1593]: time=2026-09-20T08:07:26.779Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5776worker1 # [ 153.390975] nix-grpc-daemon[1593]: time=2026-09-20T08:07:26.779Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5777lb # [ 153.414330] niks3-server[983]: 2026/09/20 08:07:26 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5778worker1 # [ 153.433241] nix-grpc-daemon[1593]: time=2026-09-20T08:07:26.823Z level=INFO msg="Uploading 1 narinfos"5779lb # [ 153.427248] niks3-server[983]: 2026/09/20 08:07:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5780lb # [ 153.439959] niks3-server[983]: 2026/09/20 08:07:26 INFO Signed narinfos id=52 count=15781lb # [ 153.442948] niks3-server[983]: 2026/09/20 08:07:26 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5782lb # [ 153.456224] niks3-server[983]: 2026/09/20 08:07:26 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5783lb # [ 153.465731] niks3-server[983]: 2026/09/20 08:07:26 INFO Completed upload id=525784lb # [ 153.469013] niks3-server[983]: 2026/09/20 08:07:26 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5785worker1 # [ 153.473823] nix-grpc-daemon[1593]: time=2026-09-20T08:07:26.864Z level=INFO msg="Upload complete. (587ms)"5786worker1 # [ 153.484614] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=0 paths=1 nar_bytes_in=6245787worker1 # [ 153.501109] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365788worker1 # [ 153.516205] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5789worker1 # [ 153.524593] nix-daemon[844]: reaped child process 1748, status = succeeded5790worker1 # [ 153.542939] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5791worker1 # [ 155.182322] nix-daemon[844]: reaped child process 1762, status = succeeded5792worker1 # [ 155.372558] nix-daemon[844]: accepted connection from pid 1777, user nix-grpc-daemon (trusted)5793worker1 # [ 155.394845] nix-daemon[844]: reaped child process 1780, status = succeeded5794lb # [ 155.402424] niks3-server[983]: 2026/09/20 08:07:28 INFO Received uploads request method=POST path=/api/pending_closures5795worker1 # [ 155.425976] nix-grpc-daemon[1593]: time=2026-09-20T08:07:28.811Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5796worker1 # [ 155.427611] nix-grpc-daemon[1593]: time=2026-09-20T08:07:28.811Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5797lb # [ 155.467722] niks3-server[983]: 2026/09/20 08:07:28 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5798worker1 # [ 155.490450] nix-grpc-daemon[1593]: time=2026-09-20T08:07:28.880Z level=INFO msg="Uploading 1 narinfos"5799lb # [ 155.481963] niks3-server[983]: 2026/09/20 08:07:28 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5800lb # [ 155.491042] niks3-server[983]: 2026/09/20 08:07:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5801lb # [ 155.500437] niks3-server[983]: 2026/09/20 08:07:28 INFO Signed narinfos id=53 count=15802lb # [ 155.505750] niks3-server[983]: 2026/09/20 08:07:28 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5803worker1 # [ 155.522860] nix-grpc-daemon[1593]: time=2026-09-20T08:07:28.913Z level=INFO msg="Upload complete. (365ms)"5804lb # [ 155.516479] niks3-server[983]: 2026/09/20 08:07:28 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5805lb # [ 155.522633] niks3-server[983]: 2026/09/20 08:07:28 INFO Completed upload id=535806lb # [ 155.526563] niks3-server[983]: 2026/09/20 08:07:28 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5807worker1 # [ 155.546758] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=2 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=15808worker1 # [ 155.564464] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:28Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15809worker1 # [ 155.576336] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365810worker1 # [ 155.579827] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:28Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05811worker1 # [ 155.585617] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:450365812worker1 # [ 155.589101] nix-daemon[844]: reaped child process 1760, status = succeeded5813worker1 # [ 155.591648] nix-grpc-daemon[1593]: time=2026-09-20T08:07:28.982Z level=INFO msg="All 1 paths already cached"5814worker1 # [ 155.603246] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:450365815worker1 # [ 155.615794] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5816worker1 # [ 155.843882] nix-daemon[844]: accepted connection from pid 1786, user nix-grpc-daemon (trusted)5817worker1 # [ 155.866747] nix-daemon[844]: reaped child process 1789, status = succeeded5818worker1 # [ 156.065530] nix-daemon[844]: accepted connection from pid 1791, user nix-grpc-daemon (trusted)5819worker1 # [ 156.087914] nix-daemon[844]: reaped child process 1794, status = succeeded5820lb # [ 156.092993] niks3-server[983]: 2026/09/20 08:07:29 INFO Received uploads request method=POST path=/api/pending_closures5821worker1 # [ 156.113572] nix-grpc-daemon[1593]: time=2026-09-20T08:07:29.503Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5822worker1 # [ 156.115180] nix-grpc-daemon[1593]: time=2026-09-20T08:07:29.503Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5823lb # [ 156.140528] niks3-server[983]: 2026/09/20 08:07:29 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5824lb # [ 156.155600] niks3-server[983]: 2026/09/20 08:07:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5825worker1 # [ 156.172710] nix-grpc-daemon[1593]: time=2026-09-20T08:07:29.562Z level=INFO msg="Uploading 1 narinfos"5826lb # [ 156.163969] niks3-server[983]: 2026/09/20 08:07:29 INFO Signed narinfos id=54 count=15827lb # [ 156.172875] niks3-server[983]: 2026/09/20 08:07:29 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5828lb # [ 156.184245] niks3-server[983]: 2026/09/20 08:07:29 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5829lb # [ 156.195375] niks3-server[983]: 2026/09/20 08:07:29 INFO Completed upload id=545830worker1 # [ 156.202095] nix-grpc-daemon[1593]: time=2026-09-20T08:07:29.592Z level=INFO msg="Upload complete. (568ms)"5831lb # [ 156.198574] niks3-server[983]: 2026/09/20 08:07:29 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5832worker1 # [ 156.218134] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=0 paths=1 nar_bytes_in=6245833worker1 # [ 156.228945] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365834worker1 # [ 156.247845] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5835worker1 # [ 156.254589] nix-daemon[844]: reaped child process 1784, status = succeeded5836worker1 # [ 156.274726] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5837worker1 # [ 157.311512] nix-daemon[844]: reaped child process 1798, status = succeeded5838worker1 # [ 157.513668] nix-daemon[844]: accepted connection from pid 1813, user nix-grpc-daemon (trusted)5839worker1 # [ 157.536791] nix-daemon[844]: reaped child process 1816, status = succeeded5840lb # [ 157.543083] niks3-server[983]: 2026/09/20 08:07:30 INFO Received uploads request method=POST path=/api/pending_closures5841worker1 # [ 157.565852] nix-grpc-daemon[1593]: time=2026-09-20T08:07:30.954Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5842worker1 # [ 157.567438] nix-grpc-daemon[1593]: time=2026-09-20T08:07:30.954Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5843lb # [ 157.599666] niks3-server[983]: 2026/09/20 08:07:31 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5844worker1 # [ 157.621925] nix-grpc-daemon[1593]: time=2026-09-20T08:07:31.012Z level=INFO msg="Uploading 1 narinfos"5845lb # [ 157.616073] niks3-server[983]: 2026/09/20 08:07:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5846lb # [ 157.619084] niks3-server[983]: 2026/09/20 08:07:31 INFO Signed narinfos id=55 count=15847lb # [ 157.630958] niks3-server[983]: 2026/09/20 08:07:31 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5848lb # [ 157.641816] niks3-server[983]: 2026/09/20 08:07:31 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5849worker1 # [ 157.656828] nix-grpc-daemon[1593]: time=2026-09-20T08:07:31.047Z level=INFO msg="Upload complete. (367ms)"5850lb # [ 157.650117] niks3-server[983]: 2026/09/20 08:07:31 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5851lb # [ 157.656777] niks3-server[983]: 2026/09/20 08:07:31 INFO Completed upload id=555852worker1 # [ 157.664841] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=15853lb # [ 157.659313] niks3-server[983]: 2026/09/20 08:07:31 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5854worker1 # [ 157.673392] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:31Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15855worker1 # [ 157.680673] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365856worker1 # [ 157.684740] nix-daemon[844]: reaped child process 1796, status = succeeded5857worker1 # [ 157.686673] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:31Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05858worker1 # [ 157.698967] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:450365859worker1 # [ 157.714402] nix-grpc-daemon[1593]: time=2026-09-20T08:07:31.104Z level=INFO msg="All 2 paths already cached"5860worker1 # [ 157.723005] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:450365861worker1 # [ 157.734821] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5862worker1 # [ 157.949642] nix-daemon[844]: accepted connection from pid 1822, user nix-grpc-daemon (trusted)5863worker1 # [ 157.972113] nix-daemon[844]: reaped child process 1825, status = succeeded5864worker1 # [ 158.184772] nix-daemon[844]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)5865worker1 # [ 158.208199] nix-daemon[844]: reaped child process 1830, status = succeeded5866lb # [ 158.211195] niks3-server[983]: 2026/09/20 08:07:31 INFO Received uploads request method=POST path=/api/pending_closures5867worker1 # [ 158.231551] nix-grpc-daemon[1593]: time=2026-09-20T08:07:31.622Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5868worker1 # [ 158.234980] nix-grpc-daemon[1593]: time=2026-09-20T08:07:31.623Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5869lb # [ 158.260166] niks3-server[983]: 2026/09/20 08:07:31 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5870worker1 # [ 158.286818] nix-grpc-daemon[1593]: time=2026-09-20T08:07:31.677Z level=INFO msg="Uploading 1 narinfos"5871lb # [ 158.278231] niks3-server[983]: 2026/09/20 08:07:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5872lb # [ 158.288108] niks3-server[983]: 2026/09/20 08:07:31 INFO Signed narinfos id=56 count=15873lb # [ 158.294727] niks3-server[983]: 2026/09/20 08:07:31 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5874lb # [ 158.305307] niks3-server[983]: 2026/09/20 08:07:31 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5875lb # [ 158.313351] niks3-server[983]: 2026/09/20 08:07:31 INFO Completed upload id=565876worker1 # [ 158.322057] nix-grpc-daemon[1593]: time=2026-09-20T08:07:31.712Z level=INFO msg="Upload complete. (573ms)"5877lb # [ 158.316502] niks3-server[983]: 2026/09/20 08:07:31 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5878worker1 # [ 158.332522] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=0 paths=1 nar_bytes_in=7525879worker1 # [ 158.352547] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365880worker1 # [ 158.365126] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5881worker1 # [ 158.371545] nix-daemon[844]: reaped child process 1820, status = succeeded5882worker1 # [ 158.391267] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5883worker1 # [ 159.631163] nix-daemon[844]: reaped child process 1834, status = succeeded5884worker1 # [ 159.831197] nix-daemon[844]: accepted connection from pid 1849, user nix-grpc-daemon (trusted)5885worker1 # [ 159.855013] nix-daemon[844]: reaped child process 1852, status = succeeded5886lb # [ 159.863034] niks3-server[983]: 2026/09/20 08:07:33 INFO Received uploads request method=POST path=/api/pending_closures5887worker1 # [ 159.909657] nix-grpc-daemon[1593]: time=2026-09-20T08:07:33.299Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5888worker1 # [ 159.917943] nix-grpc-daemon[1593]: time=2026-09-20T08:07:33.299Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5889worker1 # [ 159.970613] nix-grpc-daemon[1593]: time=2026-09-20T08:07:33.360Z level=INFO msg="Uploading 1 narinfos"5890lb # [ 159.951689] niks3-server[983]: 2026/09/20 08:07:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5891lb # [ 159.969002] niks3-server[983]: 2026/09/20 08:07:33 INFO Signed narinfos id=57 count=15892lb # [ 159.979471] niks3-server[983]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5893lb # [ 159.994066] niks3-server[983]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5894worker1 # [ 160.014217] nix-grpc-daemon[1593]: time=2026-09-20T08:07:33.404Z level=INFO msg="Upload complete. (405ms)"5895lb # [ 160.007073] niks3-server[983]: 2026/09/20 08:07:33 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5896lb # [ 160.014064] niks3-server[983]: 2026/09/20 08:07:33 INFO Completed upload id=575897lb # [ 160.018576] niks3-server[983]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5898lb # [ 160.024962] niks3-server[983]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo5899worker1 # [ 160.037670] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=15900worker1 # [ 160.052363] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:33Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=15901worker1 # [ 160.071163] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365902worker1 # [ 160.079607] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:450365903worker1 # [ 160.085001] nix-daemon[844]: reaped child process 1832, status = succeeded5904worker1 # [ 160.095282] nix-grpc-daemon[1593]: time=2026-09-20T08:07:33.485Z level=INFO msg="All 2 paths already cached"5905worker1 # [ 160.107118] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:450365906worker1 # [ 160.122515] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5907worker1 # [ 160.355022] nix-daemon[844]: accepted connection from pid 1856, user nix-grpc-daemon (trusted)5908worker1 # [ 160.380361] nix-daemon[844]: reaped child process 1859, status = succeeded5909worker1 # [ 160.580382] nix-daemon[844]: accepted connection from pid 1861, user nix-grpc-daemon (trusted)5910worker1 # [ 160.601912] nix-daemon[844]: reaped child process 1864, status = succeeded5911lb # [ 160.605218] niks3-server[983]: 2026/09/20 08:07:34 INFO Received uploads request method=POST path=/api/pending_closures5912worker1 # [ 160.627210] nix-grpc-daemon[1593]: time=2026-09-20T08:07:34.017Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5913worker1 # [ 160.629071] nix-grpc-daemon[1593]: time=2026-09-20T08:07:34.017Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"5914lb # [ 160.660784] niks3-server[983]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst5915worker1 # [ 160.685703] nix-grpc-daemon[1593]: time=2026-09-20T08:07:34.076Z level=INFO msg="Uploading 1 narinfos"5916lb # [ 160.677259] niks3-server[983]: 2026/09/20 08:07:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5917lb # [ 160.687234] niks3-server[983]: 2026/09/20 08:07:34 INFO Signed narinfos id=58 count=15918lb # [ 160.699109] niks3-server[983]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls5919lb # [ 160.708218] niks3-server[983]: 2026/09/20 08:07:34 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5920lb # [ 160.721151] niks3-server[983]: 2026/09/20 08:07:34 INFO Completed upload id=585921worker1 # [ 160.728712] nix-grpc-daemon[1593]: time=2026-09-20T08:07:34.119Z level=INFO msg="Upload complete. (589ms)"5922lb # [ 160.724461] niks3-server[983]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo5923worker1 # [ 160.740577] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=0 paths=1 nar_bytes_in=7525924worker1 # [ 160.757742] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365925worker1 # [ 160.775678] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5926worker1 # [ 160.781728] nix-daemon[844]: reaped child process 1854, status = succeeded5927worker1 # [ 160.798144] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5928worker1 # [ 161.627149] nix-daemon[844]: reaped child process 1868, status = succeeded5929worker1 # [ 161.839518] nix-daemon[844]: accepted connection from pid 1883, user nix-grpc-daemon (trusted)5930worker1 # [ 161.864273] nix-daemon[844]: reaped child process 1886, status = succeeded5931lb # [ 161.867067] niks3-server[983]: 2026/09/20 08:07:35 INFO Received uploads request method=POST path=/api/pending_closures5932worker1 # [ 161.889568] nix-grpc-daemon[1593]: time=2026-09-20T08:07:35.278Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5933worker1 # [ 161.891141] nix-grpc-daemon[1593]: time=2026-09-20T08:07:35.278Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"5934lb # [ 161.919676] niks3-server[983]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv5935lb # [ 161.930954] niks3-server[983]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst5936worker1 # [ 161.952934] nix-grpc-daemon[1593]: time=2026-09-20T08:07:35.343Z level=INFO msg="Uploading 1 narinfos"5937lb # [ 161.945098] niks3-server[983]: 2026/09/20 08:07:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5938lb # [ 161.953964] niks3-server[983]: 2026/09/20 08:07:35 INFO Signed narinfos id=59 count=15939lb # [ 161.960226] niks3-server[983]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls5940lb # [ 161.972558] niks3-server[983]: 2026/09/20 08:07:35 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5941lb # [ 161.982053] niks3-server[983]: 2026/09/20 08:07:35 INFO Completed upload id=595942worker1 # [ 161.990577] nix-grpc-daemon[1593]: time=2026-09-20T08:07:35.381Z level=INFO msg="Upload complete. (380ms)"5943lb # [ 161.985285] niks3-server[983]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo5944worker1 # [ 162.001217] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=15945worker1 # [ 162.010668] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:35Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=15946worker1 # [ 162.013094] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365947worker1 # [ 162.016392] nix-daemon[844]: reaped child process 1866, status = succeeded5948worker1 # [ 162.025576] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:450365949worker1 # [ 162.036490] nix-grpc-daemon[1593]: time=2026-09-20T08:07:35.427Z level=INFO msg="All 2 paths already cached"5950worker1 # [ 162.044662] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:450365951worker1 # [ 162.052827] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5952worker1 # [ 162.264979] nix-daemon[844]: accepted connection from pid 1890, user nix-grpc-daemon (trusted)5953worker1 # [ 162.288746] nix-daemon[844]: reaped child process 1893, status = succeeded5954worker1 # [ 162.489222] nix-daemon[844]: accepted connection from pid 1895, user nix-grpc-daemon (trusted)5955worker1 # [ 162.511021] nix-daemon[844]: reaped child process 1898, status = succeeded5956lb # [ 162.518314] niks3-server[983]: 2026/09/20 08:07:35 INFO Received uploads request method=POST path=/api/pending_closures5957worker1 # [ 162.543029] nix-grpc-daemon[1593]: time=2026-09-20T08:07:35.933Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5958worker1 # [ 162.544751] nix-grpc-daemon[1593]: time=2026-09-20T08:07:35.933Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"5959lb # [ 162.557805] niks3-server[983]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst5960lb # [ 162.578229] niks3-server[983]: 2026/09/20 08:07:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign5961worker1 # [ 162.594549] nix-grpc-daemon[1593]: time=2026-09-20T08:07:35.984Z level=INFO msg="Uploading 1 narinfos"5962lb # [ 162.589126] niks3-server[983]: 2026/09/20 08:07:35 INFO Signed narinfos id=60 count=15963lb # [ 162.596179] niks3-server[983]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls5964lb # [ 162.608169] niks3-server[983]: 2026/09/20 08:07:36 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete5965lb # [ 162.620253] niks3-server[983]: 2026/09/20 08:07:36 INFO Completed upload id=605966worker1 # [ 162.626122] nix-grpc-daemon[1593]: time=2026-09-20T08:07:36.016Z level=INFO msg="Upload complete. (558ms)"5967lb # [ 162.625052] niks3-server[983]: 2026/09/20 08:07:36 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo5968worker1 # [ 162.636670] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=0 paths=1 nar_bytes_in=7525969worker1 # [ 162.656804] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:450365970worker1 # [ 162.666277] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5971worker1 # [ 162.673282] nix-daemon[844]: reaped child process 1888, status = succeeded5972worker1 # [ 162.693058] nix-daemon[844]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5973worker1 # [ 164.144370] nix-daemon[844]: reaped child process 1902, status = succeeded5974worker1 # [ 164.374164] nix-daemon[844]: accepted connection from pid 1917, user nix-grpc-daemon (trusted)5975worker1 # [ 164.395990] nix-daemon[844]: reaped child process 1920, status = succeeded5976lb # [ 164.402349] niks3-server[983]: 2026/09/20 08:07:37 INFO Received uploads request method=POST path=/api/pending_closures5977worker1 # [ 164.428545] nix-grpc-daemon[1593]: time=2026-09-20T08:07:37.817Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5978worker1 # [ 164.430132] nix-grpc-daemon[1593]: time=2026-09-20T08:07:37.817Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"5979lb # [ 164.459296] niks3-server[983]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst5980worker1 # [ 164.487275] nix-grpc-daemon[1593]: time=2026-09-20T08:07:37.877Z level=INFO msg="Uploading 1 narinfos"5981lb # [ 164.479121] niks3-server[983]: 2026/09/20 08:07:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign5982lb # [ 164.489106] niks3-server[983]: 2026/09/20 08:07:37 INFO Signed narinfos id=61 count=15983lb # [ 164.495601] niks3-server[983]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls5984lb # [ 164.504743] niks3-server[983]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv5985lb # [ 164.512798] niks3-server[983]: 2026/09/20 08:07:37 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete5986lb # [ 164.523472] niks3-server[983]: 2026/09/20 08:07:37 INFO Completed upload id=615987worker1 # [ 164.532273] nix-grpc-daemon[1593]: time=2026-09-20T08:07:37.922Z level=INFO msg="Upload complete. (424ms)"5988lb # [ 164.526380] niks3-server[983]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo5989worker1 # [ 164.549573] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45036 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=15990worker1 # [ 164.572320] nix-daemon[844]: reaped child process 1900, status = succeeded5991client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 23.03 seconds)5992worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'5993worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.10 seconds)5994client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&15995worker2 # [ 165.051645] nix-grpc-daemon[1546]: ts=2026-09-20T08:07:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:395325996worker1 # [ 165.091653] nix-grpc-daemon[1530]: ts=2026-09-20T08:07:38Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=05997lb # [ 173.325888] envoy[859]: conn peer=[2001:db8:1::1]:34286 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26858 tx=10842 ms=226995998client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 120.41 seconds)5999(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 143.54 seconds)6000subtest: low disk drains a worker and builds go to the other6001worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6002worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.17 seconds)6003worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6004worker1 # [ 286.342228] nix-grpc-daemon[1530]: ts=2026-09-20T08:09:39Z level=info event=unhealthy reason=min_free6005worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.05 seconds)6006client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&26007worker1 # [ 286.630703] nix-grpc-daemon[1530]: ts=2026-09-20T08:09:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:450366008client # don't know how to build these paths:6009client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6010worker1 # [ 286.652140] nix-grpc-daemon[1530]: ts=2026-09-20T08:09:40Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06011worker1 # [ 286.658005] nix-grpc-daemon[1530]: ts=2026-09-20T08:09:40Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16012worker2 # [ 286.687729] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395326013worker2 # [ 286.723498] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:395326014client # copying 1 paths to 'lb:50051'...6015worker2 # [ 286.740123] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:395326016client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6017worker2 # [ 286.763928] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6018worker2 # [ 286.999911] nix-daemon[905]: accepted connection from pid 1789, user nix-grpc-daemon (trusted)6019worker2 # [ 287.022374] nix-daemon[905]: reaped child process 1792, status = succeeded6020worker2 # [ 287.189037] nix-daemon[905]: accepted connection from pid 1794, user nix-grpc-daemon (trusted)6021worker2 # [ 287.208806] nix-daemon[905]: reaped child process 1797, status = succeeded6022lb # [ 287.234461] niks3-server[983]: 2026/09/20 08:09:40 INFO Received uploads request method=POST path=/api/pending_closures6023worker2 # [ 287.237150] nix-grpc-daemon[1614]: time=2026-09-20T08:09:40.651Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6024worker2 # [ 287.238763] nix-grpc-daemon[1614]: time=2026-09-20T08:09:40.651Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6025lb # [ 287.281854] niks3-server[983]: 2026/09/20 08:09:40 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6026worker2 # [ 287.288053] nix-grpc-daemon[1614]: time=2026-09-20T08:09:40.703Z level=INFO msg="Uploading 1 narinfos"6027lb # [ 287.294415] niks3-server[983]: 2026/09/20 08:09:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6028lb # [ 287.304870] niks3-server[983]: 2026/09/20 08:09:40 INFO Signed narinfos id=62 count=16029lb # [ 287.307524] niks3-server[983]: 2026/09/20 08:09:40 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6030lb # [ 287.320488] niks3-server[983]: 2026/09/20 08:09:40 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6031lb # [ 287.330196] niks3-server[983]: 2026/09/20 08:09:40 INFO Completed upload id=626032worker2 # [ 287.318592] nix-grpc-daemon[1614]: time=2026-09-20T08:09:40.734Z level=INFO msg="Upload complete. (530ms)"6033lb # [ 287.332976] niks3-server[983]: 2026/09/20 08:09:40 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6034worker2 # [ 287.329382] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=0 paths=1 nar_bytes_in=5126035worker2 # [ 287.348728] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395326036worker2 # [ 287.352654] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6037worker2 # [ 287.358716] nix-daemon[905]: reaped child process 1787, status = succeeded6038client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6039worker2 # [ 287.369278] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6040client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6041client # farm-a> LOG-farm-a-drain6042worker2 # [ 288.795640] nix-daemon[905]: reaped child process 1801, status = succeeded6043worker2 # [ 288.956972] nix-daemon[905]: accepted connection from pid 1816, user nix-grpc-daemon (trusted)6044worker2 # [ 288.974454] nix-daemon[905]: reaped child process 1819, status = succeeded6045lb # [ 288.997995] niks3-server[983]: 2026/09/20 08:09:42 INFO Received uploads request method=POST path=/api/pending_closures6046worker2 # [ 288.996385] nix-grpc-daemon[1614]: time=2026-09-20T08:09:42.411Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6047worker2 # [ 288.997894] nix-grpc-daemon[1614]: time=2026-09-20T08:09:42.411Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6048lb # [ 289.037917] niks3-server[983]: 2026/09/20 08:09:42 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6049lb # [ 289.050903] niks3-server[983]: 2026/09/20 08:09:42 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6050lb # [ 289.062843] niks3-server[983]: 2026/09/20 08:09:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6051worker2 # [ 289.057013] nix-grpc-daemon[1614]: time=2026-09-20T08:09:42.472Z level=INFO msg="Uploading 1 narinfos"6052lb # [ 289.069959] niks3-server[983]: 2026/09/20 08:09:42 INFO Signed narinfos id=63 count=16053lb # [ 289.075200] niks3-server[983]: 2026/09/20 08:09:42 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6054lb # [ 289.086875] niks3-server[983]: 2026/09/20 08:09:42 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6055lb # [ 289.092477] niks3-server[983]: 2026/09/20 08:09:42 INFO Completed upload id=636056worker2 # [ 289.080823] nix-grpc-daemon[1614]: time=2026-09-20T08:09:42.496Z level=INFO msg="Upload complete. (298ms)"6057lb # [ 289.095563] niks3-server[983]: 2026/09/20 08:09:42 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6058worker1 # [ 289.119144] nix-grpc-daemon[1530]: ts=2026-09-20T08:09:42Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06059worker2 # [ 289.093102] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=16060worker1 # [ 289.124929] nix-grpc-daemon[1530]: ts=2026-09-20T08:09:42Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16061worker2 # [ 289.110079] nix-daemon[905]: reaped child process 1799, status = succeeded6062worker2 # [ 289.146895] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395326063worker2 # [ 289.162062] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:395326064worker2 # [ 289.176929] nix-grpc-daemon[1614]: time=2026-09-20T08:09:42.592Z level=INFO msg="All 1 paths already cached"6065client # copying 1 paths to 'lb:50051'...6066client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6067worker2 # [ 289.187046] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:395326068worker2 # [ 289.200308] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6069worker2 # [ 289.408518] nix-daemon[905]: accepted connection from pid 1823, user nix-grpc-daemon (trusted)6070worker2 # [ 289.425763] nix-daemon[905]: reaped child process 1826, status = succeeded6071worker2 # [ 289.600558] nix-daemon[905]: accepted connection from pid 1828, user nix-grpc-daemon (trusted)6072worker2 # [ 289.616297] nix-daemon[905]: reaped child process 1831, status = succeeded6073lb # [ 289.641422] niks3-server[983]: 2026/09/20 08:09:43 INFO Received uploads request method=POST path=/api/pending_closures6074worker2 # [ 289.638011] nix-grpc-daemon[1614]: time=2026-09-20T08:09:43.053Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6075worker2 # [ 289.639519] nix-grpc-daemon[1614]: time=2026-09-20T08:09:43.053Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6076lb # [ 289.667559] niks3-server[983]: 2026/09/20 08:09:43 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6077worker2 # [ 289.669005] nix-grpc-daemon[1614]: time=2026-09-20T08:09:43.084Z level=INFO msg="Uploading 1 narinfos"6078lb # [ 289.684616] niks3-server[983]: 2026/09/20 08:09:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6079lb # [ 289.695218] niks3-server[983]: 2026/09/20 08:09:43 INFO Signed narinfos id=64 count=16080worker2 # [ 289.693701] nix-grpc-daemon[1614]: time=2026-09-20T08:09:43.109Z level=INFO msg="Upload complete. (473ms)"6081lb # [ 289.706298] niks3-server[983]: 2026/09/20 08:09:43 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6082worker2 # [ 289.699960] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=0 paths=1 nar_bytes_in=6326083lb # [ 289.712007] niks3-server[983]: 2026/09/20 08:09:43 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6084lb # [ 289.717263] niks3-server[983]: 2026/09/20 08:09:43 INFO Completed upload id=646085lb # [ 289.720093] niks3-server[983]: 2026/09/20 08:09:43 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6086worker2 # [ 289.711087] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395326087worker2 # [ 289.717280] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6088worker2 # [ 289.721384] nix-daemon[905]: reaped child process 1821, status = succeeded6089client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6090worker2 # [ 289.732616] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6091client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6092client # farm-b> LOG-farm-b-drain6093worker2 # [ 290.763624] nix-daemon[905]: reaped child process 1835, status = succeeded6094worker2 # [ 290.920430] nix-daemon[905]: accepted connection from pid 1850, user nix-grpc-daemon (trusted)6095worker2 # [ 290.937304] nix-daemon[905]: reaped child process 1853, status = succeeded6096lb # [ 290.963479] niks3-server[983]: 2026/09/20 08:09:44 INFO Received uploads request method=POST path=/api/pending_closures6097worker2 # [ 290.961665] nix-grpc-daemon[1614]: time=2026-09-20T08:09:44.376Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6098worker2 # [ 290.963175] nix-grpc-daemon[1614]: time=2026-09-20T08:09:44.376Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6099lb # [ 290.997043] niks3-server[983]: 2026/09/20 08:09:44 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6100lb # [ 291.012491] niks3-server[983]: 2026/09/20 08:09:44 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6101worker2 # [ 291.012044] nix-grpc-daemon[1614]: time=2026-09-20T08:09:44.427Z level=INFO msg="Uploading 1 narinfos"6102lb # [ 291.023848] niks3-server[983]: 2026/09/20 08:09:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6103lb # [ 291.029703] niks3-server[983]: 2026/09/20 08:09:44 INFO Signed narinfos id=65 count=16104lb # [ 291.035943] niks3-server[983]: 2026/09/20 08:09:44 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6105lb # [ 291.045541] niks3-server[983]: 2026/09/20 08:09:44 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6106lb # [ 291.052484] niks3-server[983]: 2026/09/20 08:09:44 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6107lb # [ 291.057751] niks3-server[983]: 2026/09/20 08:09:44 INFO Completed upload id=656108worker2 # [ 291.046212] nix-grpc-daemon[1614]: time=2026-09-20T08:09:44.461Z level=INFO msg="Upload complete. (301ms)"6109worker2 # [ 291.057166] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=16110worker1 # [ 291.082563] nix-grpc-daemon[1530]: ts=2026-09-20T08:09:44Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06111worker1 # [ 291.088808] nix-grpc-daemon[1530]: ts=2026-09-20T08:09:44Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16112worker2 # [ 291.078354] nix-daemon[905]: reaped child process 1833, status = succeeded6113worker2 # [ 291.108507] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395326114worker2 # [ 291.123644] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:395326115worker2 # [ 291.138748] nix-grpc-daemon[1614]: time=2026-09-20T08:09:44.554Z level=INFO msg="All 2 paths already cached"6116client # copying 1 paths to 'lb:50051'...6117client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6118worker2 # [ 291.149147] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:395326119worker2 # [ 291.164149] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6120worker2 # [ 291.366134] nix-daemon[905]: accepted connection from pid 1857, user nix-grpc-daemon (trusted)6121worker2 # [ 291.383749] nix-daemon[905]: reaped child process 1860, status = succeeded6122worker2 # [ 291.557679] nix-daemon[905]: accepted connection from pid 1862, user nix-grpc-daemon (trusted)6123worker2 # [ 291.574841] nix-daemon[905]: reaped child process 1865, status = succeeded6124lb # [ 291.597551] niks3-server[983]: 2026/09/20 08:09:44 INFO Received uploads request method=POST path=/api/pending_closures6125worker2 # [ 291.594940] nix-grpc-daemon[1614]: time=2026-09-20T08:09:45.010Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6126worker2 # [ 291.596583] nix-grpc-daemon[1614]: time=2026-09-20T08:09:45.010Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6127lb # [ 291.627525] niks3-server[983]: 2026/09/20 08:09:45 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6128lb # [ 291.639874] niks3-server[983]: 2026/09/20 08:09:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6129worker2 # [ 291.635284] nix-grpc-daemon[1614]: time=2026-09-20T08:09:45.050Z level=INFO msg="Uploading 1 narinfos"6130lb # [ 291.647224] niks3-server[983]: 2026/09/20 08:09:45 INFO Signed narinfos id=66 count=16131lb # [ 291.655224] niks3-server[983]: 2026/09/20 08:09:45 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6132lb # [ 291.665735] niks3-server[983]: 2026/09/20 08:09:45 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6133lb # [ 291.670321] niks3-server[983]: 2026/09/20 08:09:45 INFO Completed upload id=666134worker2 # [ 291.658619] nix-grpc-daemon[1614]: time=2026-09-20T08:09:45.074Z level=INFO msg="Upload complete. (477ms)"6135lb # [ 291.672940] niks3-server[983]: 2026/09/20 08:09:45 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6136worker2 # [ 291.667828] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=0 paths=1 nar_bytes_in=7606137worker2 # [ 291.678574] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:395326138worker2 # [ 291.685318] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6139worker2 # [ 291.690113] nix-daemon[905]: reaped child process 1855, status = succeeded6140client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6141worker2 # [ 291.704195] nix-daemon[905]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)6142client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6143client # farm-top> LOG-farm-top-drain6144worker2 # [ 293.150324] nix-daemon[905]: reaped child process 1869, status = succeeded6145lb # [ 293.328686] envoy[859]: conn peer=[2001:db8:1::1]:41090 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=727 tx=457 ms=1200636146worker2 # [ 293.326370] nix-daemon[905]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6147worker2 # [ 293.346502] nix-daemon[905]: reaped child process 1887, status = succeeded6148lb # [ 293.373775] niks3-server[983]: 2026/09/20 08:09:46 INFO Received uploads request method=POST path=/api/pending_closures6149worker2 # [ 293.372491] nix-grpc-daemon[1614]: time=2026-09-20T08:09:46.784Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6150worker2 # [ 293.374291] nix-grpc-daemon[1614]: time=2026-09-20T08:09:46.784Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6151lb # [ 293.421231] niks3-server[983]: 2026/09/20 08:09:46 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6152worker2 # [ 293.422799] nix-grpc-daemon[1614]: time=2026-09-20T08:09:46.837Z level=INFO msg="Uploading 1 narinfos"6153lb # [ 293.434286] niks3-server[983]: 2026/09/20 08:09:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6154lb # [ 293.439198] niks3-server[983]: 2026/09/20 08:09:46 INFO Signed narinfos id=67 count=16155lb # [ 293.448244] niks3-server[983]: 2026/09/20 08:09:46 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6156lb # [ 293.457262] niks3-server[983]: 2026/09/20 08:09:46 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6157lb # [ 293.468603] niks3-server[983]: 2026/09/20 08:09:46 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6158lb # [ 293.473565] niks3-server[983]: 2026/09/20 08:09:46 INFO Completed upload id=676159worker2 # [ 293.461280] nix-grpc-daemon[1614]: time=2026-09-20T08:09:46.877Z level=INFO msg="Upload complete. (346ms)"6160lb # [ 293.476764] niks3-server[983]: 2026/09/20 08:09:46 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6161worker2 # [ 293.473174] nix-grpc-daemon[1546]: ts=2026-09-20T08:09:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39532 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=16162worker2 # [ 293.493807] nix-daemon[905]: reaped child process 1867, status = succeeded6163client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&2, in 7.18 seconds)6164client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath6165client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath, in 0.24 seconds)6166worker1: must succeed: rm /nix/.rw-store/fill6167worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6168worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6169worker1 # [ 294.346611] nix-grpc-daemon[1530]: ts=2026-09-20T08:09:47Z level=info event=healthy reason=min_free6170worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6171(finished: subtest: low disk drains a worker and builds go to the other, in 10.00 seconds)6172(finished: run the VM test script, in 296.39 seconds)6173test script finished in 296.69s6174cleanup6175kill QemuMachine (pid 48)6176client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6177kill QemuMachine (pid 50)6178lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6179kill QemuMachine (pid 51)6180worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6181kill QemuMachine (pid 52)6182worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6183(finished: cleanup, in 1.60 seconds)6184additionally exposed symbols:6185 client, lb, worker1, worker2,6186 vlan1,6187 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh