vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #296
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13worker1 # Disk image does not exist, creating the virtualisation disk image...14client # Disk image does not exist, creating the virtualisation disk image...15lb # Formatting '/build/vm-state-lb/tmp.qRaWgoTdiW', fmt=raw size=107374182416worker2 # Disk image does not exist, creating the virtualisation disk image...17client: QEMU running (pid 49)18worker1 # Formatting '/build/vm-state-worker1/tmp.VXhQFNn1gI', fmt=raw size=107374182419lb # mke2fs 1.47.4 (6-Mar-2025)20lb: QEMU running (pid 50)21client # Formatting '/build/vm-state-client/tmp.kb9skQxsYY', fmt=raw size=107374182422worker1 # mke2fs 1.47.4 (6-Mar-2025)23lb # Discarding device blocks: 0/262144 done24worker1: QEMU running (pid 52)25worker2: QEMU running (pid 51)26worker2 # Formatting '/build/vm-state-worker2/tmp.FS7GxiR3Em', fmt=raw size=107374182427client # mke2fs 1.47.4 (6-Mar-2025)28lb # Creating filesystem with 262144 4k blocks and 65536 inodes29worker1 # Discarding device blocks: 0/262144 done30worker2 # mke2fs 1.47.4 (6-Mar-2025)31client # Discarding device blocks: 0/262144 done32worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes33worker2 # Discarding device blocks: 0/262144 done34client # Creating filesystem with 262144 4k blocks and 65536 inodes35worker1 # Filesystem UUID: c1dc8905-8cfe-4aa6-8852-ea41dc9af50036worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes37client # Filesystem UUID: 6168434f-bec8-47f8-80c0-e05c7309778938worker1 # Superblock backups stored on blocks:39worker2 # Filesystem UUID: 369f14fb-cf66-41d5-a1f8-88258478b81540client # Superblock backups stored on blocks:41worker1 # 32768, 98304, 163840, 22937642worker2 # Superblock backups stored on blocks:43client # 32768, 98304, 163840, 22937644worker1 # 45worker2 # 32768, 98304, 163840, 22937646client # 47worker1 # Allocating group tables: 0/8 done48worker2 # 49client # Allocating group tables: 0/8 done50worker1 # Writing inode tables: 0/8 done51worker2 # Allocating group tables: 0/8 done52client # Writing inode tables: 0/8 done53worker1 # Creating journal (8192 blocks): done54worker2 # Writing inode tables: 0/8 done55client # Creating journal (8192 blocks): done56worker1 # Writing superblocks and filesystem accounting information: 0/8 done57worker2 # Creating journal (8192 blocks): done58client # Writing superblocks and filesystem accounting information: 0/8 done59worker1 # 60worker2 # Writing superblocks and filesystem accounting information: 0/8 done61client # 62worker1 # Virtualisation disk image created.63worker2 # 64client # Virtualisation disk image created.65(finished: start all VMs, in 0.49 seconds)66lb # Filesystem UUID: 9a57ef1b-408c-4962-b48d-44df454811a867client: waiting for unit network-addresses-eth1.service68lb # Superblock backups stored on blocks:69client: waiting for the VM to finish booting70lb # 32768, 98304, 163840, 22937671worker2 # Virtualisation disk image created.72lb # 73lb # Allocating group tables: 0/8 done74lb # Writing inode tables: 0/8 done75lb # Creating journal (8192 blocks): done76lb # Writing superblocks and filesystem accounting information: 0/8 done77lb # 78lb # Virtualisation disk image created.79worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker2 # [ 0.000000] KASLR enabled82worker2 # [ 0.000000] random: crng init done83worker2 # [ 0.000000] Machine model: linux,dummy-virt84worker2 # [ 0.000000] efi: UEFI not found.85worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88worker2 # [ 0.000000] Zone ranges:89worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90worker2 # [ 0.000000] DMA32 empty91worker2 # [ 0.000000] Normal empty92worker2 # [ 0.000000] Device empty93worker2 # [ 0.000000] Movable zone start for each node94worker2 # [ 0.000000] Early memory node ranges95worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098worker2 # [ 0.000000] psci: probing for conduit method from DT.99worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.100worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101worker2 # [ 0.000000] psci: Trusted OS migration not required102worker2 # [ 0.000000] psci: SMC Calling Convention v1.1103worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105worker2 # [ 0.000000] Detected PIPT I-cache on CPU0106worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface108worker2 # [ 0.000000] CPU features: detected: Spectre-v4109worker2 # [ 0.000000] CPU features: detected: Spectre-BHB110worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112worker2 # [ 0.000000] alternatives: applying boot alternatives113worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1d3l1q1rzfvh0f7kbcwmr9fszyp0b0dz-nixos-system-worker2-test/init regInfo=/nix/store/ff87zia02lc2pva4ypygaxx75p990h0m-closure-info/registration console=ttyAMA0,115200n8 console=tty0114worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ff87zia02lc2pva4ypygaxx75p990h0m-closure-info/registration", will be passed to user space.115worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119worker2 # [ 0.000000] software IO TLB: area num 1.120worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122worker2 # [ 0.000000] Fallback order for Node 0: 0123worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124worker2 # [ 0.000000] Policy zone: DMA125worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127worker2 # [ 0.000000] allocated 3145728 bytes of page_ext128worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups130worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.131worker2 # [ 0.000000] rcu: RCU event tracing is enabled.132client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]133worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.134worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.135client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026136worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.137client # [ 0.000000] KASLR enabled138client # [ 0.000000] random: crng init done139worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.140client # [ 0.000000] Machine model: linux,dummy-virt141client # [ 0.000000] efi: UEFI not found.142worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.143client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT144worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1145client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]146worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.147client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]148client # [ 0.000000] Zone ranges:149worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.150client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]151client # [ 0.000000] DMA32 empty152client # [ 0.000000] Normal empty153worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.154client # [ 0.000000] Device empty155worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0156client # [ 0.000000] Movable zone start for each node157worker2 # [ 0.000000] GICv3: 256 SPIs implemented158client # [ 0.000000] Early memory node ranges159worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented160client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]161worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq162worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI163client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]164worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0165client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000166client # [ 0.000000] psci: probing for conduit method from DT.167worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000168client # [ 0.000000] psci: PSCIv1.3 detected in firmware.169worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]170client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs171client # [ 0.000000] psci: Trusted OS migration not required172worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)173client # [ 0.000000] psci: SMC Calling Convention v1.1174worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)175client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)176worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000177client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296178worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000179client # [ 0.000000] Detected PIPT I-cache on CPU0180worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.181client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)182client # [ 0.000000] CPU features: detected: GICv3 CPU interface183worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns184client # [ 0.000000] CPU features: detected: Spectre-v4185client # [ 0.000000] CPU features: detected: Spectre-BHB186worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).187client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38188worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns189client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23190worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]191client # [ 0.000000] alternatives: applying boot alternatives192worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns193lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]194worker2 # [ 0.000035] arm-pv: using stolen time PV195worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026196worker1 # [ 0.000000] KASLR enabled197worker2 # [ 0.000658] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)198worker1 # [ 0.000000] random: crng init done199lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026200lb # [ 0.000000] KASLR enabled201worker1 # [ 0.000000] Machine model: linux,dummy-virt202worker2 # [ 0.000832] Console: colour dummy device 80x25203lb # [ 0.000000] random: crng init done204worker1 # [ 0.000000] efi: UEFI not found.205worker2 # [ 0.000840] printk: legacy console [tty0] enabled206lb # [ 0.000000] Machine model: linux,dummy-virt207client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test/init regInfo=/nix/store/bs9wr4dhg08lmmqzzj6b672rzvy73rhp-closure-info/registration console=ttyAMA0,115200n8 console=tty0208worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT209lb # [ 0.000000] efi: UEFI not found.210worker2 # [ 0.001027] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)211worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]212lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT213worker2 # [ 0.001034] pid_max: default: 32768 minimum: 301214lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]215worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]216worker2 # [ 0.001104] LSM: initializing lsm=capability,landlock,yama,bpf,ima217worker1 # [ 0.000000] Zone ranges:218client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/bs9wr4dhg08lmmqzzj6b672rzvy73rhp-closure-info/registration", will be passed to user space.219worker2 # [ 0.001284] landlock: Up and running.220lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]221worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]222lb # [ 0.000000] Zone ranges:223worker2 # [ 0.001287] Yama: becoming mindful.224worker1 # [ 0.000000] DMA32 empty225client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes226worker2 # [ 0.001937] LSM support for eBPF active227worker1 # [ 0.000000] Normal empty228lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]229worker1 # [ 0.000000] Device empty230lb # [ 0.000000] DMA32 empty231client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)232worker2 # [ 0.002095] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)233lb # [ 0.000000] Normal empty234worker1 # [ 0.000000] Movable zone start for each node235lb # [ 0.000000] Device empty236worker1 # [ 0.000000] Early memory node ranges237client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)238worker2 # [ 0.002129] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)239lb # [ 0.000000] Movable zone start for each node240lb # [ 0.000000] Early memory node ranges241worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]242client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB243worker2 # [ 0.003258] cacheinfo: Unable to detect cache hierarchy for CPU 0244lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]245worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]246client # [ 0.000000] software IO TLB: area num 1.247worker2 # [ 0.004019] rcu: Hierarchical SRCU implementation.248worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000249client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB250lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]251worker2 # [ 0.004023] rcu: Max phase no-delay instances is 1000.252worker1 # [ 0.000000] psci: probing for conduit method from DT.253worker2 # [ 0.005243] fsl-mc MSI: its@8080000 domain created254lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000255client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)256worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.257worker2 # [ 0.005334] EFI services will not be available.258lb # [ 0.000000] psci: probing for conduit method from DT.259client # [ 0.000000] Fallback order for Node 0: 0260worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs261worker2 # [ 0.005457] smp: Bringing up secondary CPUs ...262lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.263worker2 # [ 0.005465] smp: Brought up 1 node, 1 CPU264client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216265worker1 # [ 0.000000] psci: Trusted OS migration not required266lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs267client # [ 0.000000] Policy zone: DMA268worker1 # [ 0.000000] psci: SMC Calling Convention v1.1269worker2 # [ 0.005469] SMP: Total of 1 processors activated.270lb # [ 0.000000] psci: Trusted OS migration not required271worker2 # [ 0.005474] CPU: All CPU(s) started at EL1272client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off273lb # [ 0.000000] psci: SMC Calling Convention v1.1274worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)275worker2 # [ 0.005484] CPU features: detected: Branch Target Identification276client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1277lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)278worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296279worker2 # [ 0.005489] CPU features: detected: ARMv8.4 Translation Table Level280client # [ 0.000000] allocated 3145728 bytes of page_ext281worker1 # [ 0.000000] Detected PIPT I-cache on CPU0282client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages283lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296284worker2 # [ 0.005492] CPU features: detected: Instruction cache invalidation not required for I/D coherence285lb # [ 0.000000] Detected PIPT I-cache on CPU0286client # [ 0.000000] ftrace: allocated 294 pages with 4 groups287worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)288client # [ 0.000000] rcu: Hierarchical RCU implementation.289worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface290worker2 # [ 0.005496] CPU features: detected: Data cache clean to the PoU not required for I/D coherence291lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)292client # [ 0.000000] rcu: RCU event tracing is enabled.293worker1 # [ 0.000000] CPU features: detected: Spectre-v4294lb # [ 0.000000] CPU features: detected: GICv3 CPU interface295worker2 # [ 0.005499] CPU features: detected: Common not Private translations296worker1 # [ 0.000000] CPU features: detected: Spectre-BHB297client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.298lb # [ 0.000000] CPU features: detected: Spectre-v4299worker2 # [ 0.005503] CPU features: detected: CRC32 instructions300client # [ 0.000000] Trampoline variant of Tasks RCU enabled.301worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38302lb # [ 0.000000] CPU features: detected: Spectre-BHB303client # [ 0.000000] Rude variant of Tasks RCU enabled.304worker2 # [ 0.005505] CPU features: detected: Data cache clean to Point of Deep Persistence305worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23306lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38307client # [ 0.000000] Tracing variant of Tasks RCU enabled.308worker1 # [ 0.000000] alternatives: applying boot alternatives309worker2 # [ 0.005509] CPU features: detected: Data cache clean to Point of Persistence310lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23311client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.312worker2 # [ 0.005513] CPU features: detected: Data independent timing control (DIT)313lb # [ 0.000000] alternatives: applying boot alternatives314worker2 # [ 0.005516] CPU features: detected: E0PD315client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1316worker2 # [ 0.005518] CPU features: detected: Enhanced Counter Virtualization317client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.318worker2 # [ 0.005521] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)319client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.320worker2 # [ 0.005524] CPU features: detected: Enhanced Virtualization Traps321worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j8hg5v2mna41b2rmqffhgiw2p9n7fx0y-nixos-system-worker1-test/init regInfo=/nix/store/jsp8jrhhk8b4cd1nrwsv3w1mv7c8x67x-closure-info/registration console=ttyAMA0,115200n8 console=tty0322worker2 # [ 0.005527] CPU features: detected: Fine Grained Traps323client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.324lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/14bqwb8zl951hxla1qpmchqzwfgwlqnx-nixos-system-lb-test/init regInfo=/nix/store/hxsww7q411z4rrmrw9s7nvsxa10s5ypn-closure-info/registration console=ttyAMA0,115200n8 console=tty0325client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0326worker2 # [ 0.005531] CPU features: detected: Generic authentication (architected QARMA5 algorithm)327worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/jsp8jrhhk8b4cd1nrwsv3w1mv7c8x67x-closure-info/registration", will be passed to user space.328client # [ 0.000000] GICv3: 256 SPIs implemented329worker2 # [ 0.005535] CPU features: detected: RCpc load-acquire (LDAPR)330client # [ 0.000000] GICv3: 0 Extended SPIs implemented331worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes332lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/hxsww7q411z4rrmrw9s7nvsxa10s5ypn-closure-info/registration", will be passed to user space.333worker2 # [ 0.005538] CPU features: detected: LSE atomic instructions334client # [ 0.000000] Root IRQ handler: gic_handle_irq335worker2 # [ 0.005541] CPU features: detected: Privileged Access Never336client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI337worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)338worker2 # [ 0.005544] CPU features: detected: PMUv3339client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0340lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes341worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)342worker2 # [ 0.005547] CPU features: detected: RAS Extension Support343client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000344lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)345client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]346worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB347worker2 # [ 0.005549] CPU features: detected: RASv1p1 Extension Support348lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)349worker1 # [ 0.000000] software IO TLB: area num 1.350client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)351worker2 # [ 0.005552] CPU features: detected: Random Number Generator352lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB353worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB354lb # [ 0.000000] software IO TLB: area num 1.355worker2 # [ 0.005554] CPU features: detected: Speculation barrier (SB)356client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)357worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)358lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB359worker2 # [ 0.005558] CPU features: detected: Stage-2 Force Write-Back360client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000361worker1 # [ 0.000000] Fallback order for Node 0: 0362worker2 # [ 0.005560] CPU features: detected: TLB range maintenance instructions363lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)364client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000365lb # [ 0.000000] Fallback order for Node 0: 0366worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216367worker2 # [ 0.005564] CPU features: detected: Speculative Store Bypassing Safe (SSBS)368worker1 # [ 0.000000] Policy zone: DMA369client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.370lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216371worker2 # [ 0.005603] alternatives: applying system-wide alternatives372worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off373lb # [ 0.000000] Policy zone: DMA374worker2 # [ 0.008627] CPU features: detected: BBM Level 2 without TLB conflict abort375worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1376client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns377lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off378worker1 # [ 0.000000] allocated 3145728 bytes of page_ext379client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).380lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1381worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages382worker2 # [ 0.008769] Memory: 1406548K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)383lb # [ 0.000000] allocated 3145728 bytes of page_ext384worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups385worker2 # [ 0.009143] devtmpfs: initialized386client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns387lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages388worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.389lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups390worker2 # [ 0.010938] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)391worker1 # [ 0.000000] rcu: RCU event tracing is enabled.392client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns393lb # [ 0.000000] rcu: Hierarchical RCU implementation.394client # [ 0.000033] arm-pv: using stolen time PV395worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.396worker2 # [ 0.010961] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).397lb # [ 0.000000] rcu: RCU event tracing is enabled.398worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.399worker2 # [ 0.011146] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL400client # [ 0.000525] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)401lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.402worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.403worker2 # [ 0.011150] 0 pages in range for non-PLT usage404client # [ 0.000670] Console: colour dummy device 80x25405lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.406worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.407worker2 # [ 0.011151] 508288 pages in range for PLT usage408client # [ 0.000678] printk: legacy console [tty0] enabled409lb # [ 0.000000] Rude variant of Tasks RCU enabled.410worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.411lb # [ 0.000000] Tracing variant of Tasks RCU enabled.412worker2 # [ 0.011267] pinctrl core: initialized pinctrl subsystem413worker2 # [ 0.012055] DMI not present or invalid.414client # [ 0.000873] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)415worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1416lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.417client # [ 0.000879] pid_max: default: 32768 minimum: 301418worker2 # [ 0.015892] NET: Registered PF_NETLINK/PF_ROUTE protocol family419lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1420client # [ 0.000948] LSM: initializing lsm=capability,landlock,yama,bpf,ima421worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.422worker2 # [ 0.018174] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations423client # [ 0.001098] landlock: Up and running.424client # [ 0.001100] Yama: becoming mindful.425lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.426worker2 # [ 0.018363] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations427worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.428client # [ 0.001632] LSM support for eBPF active429worker2 # [ 0.018564] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations430worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.431lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.432client # [ 0.001786] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)433worker2 # [ 0.018587] audit: initializing netlink subsys (disabled)434worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0435client # [ 0.001824] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)436lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.437worker1 # [ 0.000000] GICv3: 256 SPIs implemented438worker2 # [ 0.019226] thermal_sys: Registered thermal governor 'fair_share'439lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0440worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented441client # [ 0.002998] cacheinfo: Unable to detect cache hierarchy for CPU 0442worker2 # [ 0.019228] thermal_sys: Registered thermal governor 'bang_bang'443lb # [ 0.000000] GICv3: 256 SPIs implemented444worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq445client # [ 0.003733] rcu: Hierarchical SRCU implementation.446worker2 # [ 0.019232] thermal_sys: Registered thermal governor 'step_wise'447lb # [ 0.000000] GICv3: 0 Extended SPIs implemented448worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI449client # [ 0.003738] rcu: Max phase no-delay instances is 1000.450lb # [ 0.000000] Root IRQ handler: gic_handle_irq451worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0452worker2 # [ 0.019237] thermal_sys: Registered thermal governor 'user_space'453client # [ 0.004925] fsl-mc MSI: its@8080000 domain created454lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI455client # [ 0.005013] EFI services will not be available.456worker2 # [ 0.019240] thermal_sys: Registered thermal governor 'power_allocator'457worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000458lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0459client # [ 0.005079] smp: Bringing up secondary CPUs ...460worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]461client # [ 0.005087] smp: Brought up 1 node, 1 CPU462worker2 # [ 0.019266] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1463lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000464worker2 # [ 0.019275] cpuidle: using governor ladder465client # [ 0.005090] SMP: Total of 1 processors activated.466worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)467lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]468worker2 # [ 0.019281] cpuidle: using governor menu469client # [ 0.005096] CPU: All CPU(s) started at EL1470client # [ 0.005107] CPU features: detected: Branch Target Identification471lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)472worker2 # [ 0.019477] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.473worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)474worker2 # [ 0.019493] ASID allocator initialised with 65536 entries475client # [ 0.005112] CPU features: detected: ARMv8.4 Translation Table Level476worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000477lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)478worker2 # [ 0.020763] Serial: AMBA PL011 UART driver479worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000480client # [ 0.005115] CPU features: detected: Instruction cache invalidation not required for I/D coherence481lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000482worker2 # [ 0.026151] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1483worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.484lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000485worker2 # [ 0.026323] printk: console [ttyAMA0] enabled486client # [ 0.005118] CPU features: detected: Data cache clean to the PoU not required for I/D coherence487lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.488client # [ 0.005122] CPU features: detected: Common not Private translations489worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns490client # [ 0.005125] CPU features: detected: CRC32 instructions491worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).492lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns493client # [ 0.005128] CPU features: detected: Data cache clean to Point of Deep Persistence494lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).495worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns496client # [ 0.005131] CPU features: detected: Data cache clean to Point of Persistence497worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns498client # [ 0.005134] CPU features: detected: Data independent timing control (DIT)499lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns500worker1 # [ 0.000029] arm-pv: using stolen time PV501client # [ 0.005137] CPU features: detected: E0PD502lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns503client # [ 0.005140] CPU features: detected: Enhanced Counter Virtualization504lb # [ 0.000029] arm-pv: using stolen time PV505worker1 # [ 0.000389] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)506worker1 # [ 0.000552] Console: colour dummy device 80x25507client # [ 0.005143] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)508worker1 # [ 0.000559] printk: legacy console [tty0] enabled509lb # [ 0.000403] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)510client # [ 0.005146] CPU features: detected: Enhanced Virtualization Traps511lb # [ 0.000574] Console: colour dummy device 80x25512client # [ 0.005149] CPU features: detected: Fine Grained Traps513lb # [ 0.000582] printk: legacy console [tty0] enabled514worker1 # [ 0.000778] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)515worker1 # [ 0.000785] pid_max: default: 32768 minimum: 301516client # [ 0.005152] CPU features: detected: Generic authentication (architected QARMA5 algorithm)517lb # [ 0.000777] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)518client # [ 0.005157] CPU features: detected: RCpc load-acquire (LDAPR)519worker1 # [ 0.000852] LSM: initializing lsm=capability,landlock,yama,bpf,ima520worker1 # [ 0.000989] landlock: Up and running.521lb # [ 0.000783] pid_max: default: 32768 minimum: 301522worker2 # [ 0.148749] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages523client # [ 0.005160] CPU features: detected: LSE atomic instructions524worker1 # [ 0.000992] Yama: becoming mindful.525worker2 # [ 0.148767] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page526lb # [ 0.000857] LSM: initializing lsm=capability,landlock,yama,bpf,ima527worker1 # [ 0.001437] LSM support for eBPF active528client # [ 0.005163] CPU features: detected: Privileged Access Never529lb # [ 0.001032] landlock: Up and running.530client # [ 0.005166] CPU features: detected: PMUv3531worker2 # [ 0.148773] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages532lb # [ 0.001035] Yama: becoming mindful.533worker1 # [ 0.001579] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)534client # [ 0.005169] CPU features: detected: RAS Extension Support535lb # [ 0.001507] LSM support for eBPF active536worker2 # [ 0.148778] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page537worker1 # [ 0.001612] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)538client # [ 0.005171] CPU features: detected: RASv1p1 Extension Support539lb # [ 0.001644] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)540worker2 # [ 0.148782] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages541client # [ 0.005174] CPU features: detected: Random Number Generator542worker1 # [ 0.002730] cacheinfo: Unable to detect cache hierarchy for CPU 0543worker1 # [ 0.003439] rcu: Hierarchical SRCU implementation.544lb # [ 0.001676] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)545worker2 # [ 0.148786] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page546client # [ 0.005177] CPU features: detected: Speculation barrier (SB)547worker1 # [ 0.003442] rcu: Max phase no-delay instances is 1000.548lb # [ 0.002787] cacheinfo: Unable to detect cache hierarchy for CPU 0549worker2 # [ 0.148791] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages550client # [ 0.005180] CPU features: detected: Stage-2 Force Write-Back551worker1 # [ 0.004620] fsl-mc MSI: its@8080000 domain created552lb # [ 0.003503] rcu: Hierarchical SRCU implementation.553worker2 # [ 0.148795] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page554client # [ 0.005183] CPU features: detected: TLB range maintenance instructions555worker1 # [ 0.004707] EFI services will not be available.556lb # [ 0.003507] rcu: Max phase no-delay instances is 1000.557worker1 # [ 0.004775] smp: Bringing up secondary CPUs ...558client # [ 0.005188] CPU features: detected: Speculative Store Bypassing Safe (SSBS)559lb # [ 0.004703] fsl-mc MSI: its@8080000 domain created560worker1 # [ 0.004783] smp: Brought up 1 node, 1 CPU561lb # [ 0.004801] EFI services will not be available.562client # [ 0.005226] alternatives: applying system-wide alternatives563worker1 # [ 0.004786] SMP: Total of 1 processors activated.564lb # [ 0.004868] smp: Bringing up secondary CPUs ...565worker1 # [ 0.004791] CPU: All CPU(s) started at EL1566client # [ 0.008147] CPU features: detected: BBM Level 2 without TLB conflict abort567worker2 # [ 0.155973] fbcon: Taking over console568lb # [ 0.004876] smp: Brought up 1 node, 1 CPU569worker2 # [ 0.155988] ACPI: Interpreter disabled.570worker1 # [ 0.004802] CPU features: detected: Branch Target Identification571lb # [ 0.004879] SMP: Total of 1 processors activated.572worker2 # [ 0.157839] iommu: Default domain type: Translated573lb # [ 0.004884] CPU: All CPU(s) started at EL1574worker1 # [ 0.004806] CPU features: detected: ARMv8.4 Translation Table Level575client # [ 0.008312] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)576worker2 # [ 0.157848] iommu: DMA domain TLB invalidation policy: strict mode577lb # [ 0.004894] CPU features: detected: Branch Target Identification578client # [ 0.008704] devtmpfs: initialized579worker1 # [ 0.004810] CPU features: detected: Instruction cache invalidation not required for I/D coherence580lb # [ 0.004900] CPU features: detected: ARMv8.4 Translation Table Level581worker2 # [ 0.159495] SCSI subsystem initialized582client # [ 0.010474] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)583worker1 # [ 0.004813] CPU features: detected: Data cache clean to the PoU not required for I/D coherence584lb # [ 0.004903] CPU features: detected: Instruction cache invalidation not required for I/D coherence585client # [ 0.010496] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).586worker1 # [ 0.004817] CPU features: detected: Common not Private translations587client # [ 0.010681] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL588lb # [ 0.004906] CPU features: detected: Data cache clean to the PoU not required for I/D coherence589worker1 # [ 0.004820] CPU features: detected: CRC32 instructions590lb # [ 0.004910] CPU features: detected: Common not Private translations591worker1 # [ 0.004823] CPU features: detected: Data cache clean to Point of Deep Persistence592lb # [ 0.004913] CPU features: detected: CRC32 instructions593worker1 # [ 0.004826] CPU features: detected: Data cache clean to Point of Persistence594lb # [ 0.004916] CPU features: detected: Data cache clean to Point of Deep Persistence595worker1 # [ 0.004830] CPU features: detected: Data independent timing control (DIT)596worker1 # [ 0.004833] CPU features: detected: E0PD597lb # [ 0.004920] CPU features: detected: Data cache clean to Point of Persistence598worker1 # [ 0.004835] CPU features: detected: Enhanced Counter Virtualization599lb # [ 0.004923] CPU features: detected: Data independent timing control (DIT)600worker2 # [ 0.164994] usbcore: registered new interface driver usbfs601lb # [ 0.004926] CPU features: detected: E0PD602worker1 # [ 0.004838] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)603worker2 # [ 0.165039] usbcore: registered new interface driver hub604lb # [ 0.004928] CPU features: detected: Enhanced Counter Virtualization605worker1 # [ 0.004841] CPU features: detected: Enhanced Virtualization Traps606worker2 # [ 0.165059] usbcore: registered new device driver usb607worker1 # [ 0.004844] CPU features: detected: Fine Grained Traps608worker2 # [ 0.165326] pps_core: LinuxPPS API ver. 1 registered609worker1 # [ 0.004848] CPU features: detected: Generic authentication (architected QARMA5 algorithm)610worker2 # [ 0.165332] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>611worker2 # [ 0.165343] PTP clock support registered612worker1 # [ 0.004853] CPU features: detected: RCpc load-acquire (LDAPR)613worker2 # [ 0.165398] EDAC MC: Ver: 3.0.0614worker1 # [ 0.004856] CPU features: detected: LSE atomic instructions615client # [ 0.010686] 0 pages in range for non-PLT usage616worker2 # [ 0.169961] scmi_core: SCMI protocol bus registered617client # [ 0.010687] 508288 pages in range for PLT usage618worker1 # [ 0.004858] CPU features: detected: Privileged Access Never619worker1 # [ 0.004861] CPU features: detected: PMUv3620client # [ 0.010793] pinctrl core: initialized pinctrl subsystem621worker2 # [ 0.170909] FPGA manager framework622client # [ 0.011556] DMI not present or invalid.623worker1 # [ 0.004864] CPU features: detected: RAS Extension Support624worker2 # [ 0.171818] vgaarb: loaded625client # [ 0.014941] NET: Registered PF_NETLINK/PF_ROUTE protocol family626worker1 # [ 0.004866] CPU features: detected: RASv1p1 Extension Support627worker2 # [ 0.172438] clocksource: Switched to clocksource arch_sys_counter628worker1 # [ 0.004869] CPU features: detected: Random Number Generator629client # [ 0.017176] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations630worker1 # [ 0.004871] CPU features: detected: Speculation barrier (SB)631client # [ 0.017349] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations632worker1 # [ 0.004874] CPU features: detected: Stage-2 Force Write-Back633client # [ 0.017541] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations634worker1 # [ 0.004877] CPU features: detected: TLB range maintenance instructions635client # [ 0.017561] audit: initializing netlink subsys (disabled)636lb # [ 0.004931] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)637worker1 # [ 0.004882] CPU features: detected: Speculative Store Bypassing Safe (SSBS)638client # [ 0.018147] thermal_sys: Registered thermal governor 'fair_share'639worker2 # [ 0.176008] VFS: Disk quotas dquot_6.6.0640lb # [ 0.004935] CPU features: detected: Enhanced Virtualization Traps641worker1 # [ 0.004918] alternatives: applying system-wide alternatives642client # [ 0.018149] thermal_sys: Registered thermal governor 'bang_bang'643lb # [ 0.004938] CPU features: detected: Fine Grained Traps644worker2 # [ 0.176049] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)645worker1 # [ 0.007835] CPU features: detected: BBM Level 2 without TLB conflict abort646client # [ 0.018152] thermal_sys: Registered thermal governor 'step_wise'647lb # [ 0.004941] CPU features: detected: Generic authentication (architected QARMA5 algorithm)648client # [ 0.018157] thermal_sys: Registered thermal governor 'user_space'649lb # [ 0.004946] CPU features: detected: RCpc load-acquire (LDAPR)650client # [ 0.018160] thermal_sys: Registered thermal governor 'power_allocator'651worker1 # [ 0.008050] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)652lb # [ 0.004949] CPU features: detected: LSE atomic instructions653worker1 # [ 0.008408] devtmpfs: initialized654lb # [ 0.004952] CPU features: detected: Privileged Access Never655worker2 # [ 0.179667] netfs: FS-Cache loaded656client # [ 0.018191] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1657lb # [ 0.004954] CPU features: detected: PMUv3658worker2 # [ 0.179793] pnp: PnP ACPI: disabled659worker1 # [ 0.010170] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)660client # [ 0.018199] cpuidle: using governor ladder661client # [ 0.018204] cpuidle: using governor menu662lb # [ 0.004957] CPU features: detected: RAS Extension Support663worker1 # [ 0.010192] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).664lb # [ 0.004960] CPU features: detected: RASv1p1 Extension Support665client # [ 0.018382] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.666worker1 # [ 0.010369] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL667lb # [ 0.004962] CPU features: detected: Random Number Generator668client # [ 0.018398] ASID allocator initialised with 65536 entries669worker1 # [ 0.010373] 0 pages in range for non-PLT usage670client # [ 0.019549] Serial: AMBA PL011 UART driver671lb # [ 0.004965] CPU features: detected: Speculation barrier (SB)672worker1 # [ 0.010374] 508288 pages in range for PLT usage673lb # [ 0.004968] CPU features: detected: Stage-2 Force Write-Back674worker1 # [ 0.010479] pinctrl core: initialized pinctrl subsystem675client # [ 0.024649] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1676worker1 # [ 0.011263] DMI not present or invalid.677client # [ 0.024801] printk: console [ttyAMA0] enabled678lb # [ 0.004971] CPU features: detected: TLB range maintenance instructions679worker2 # [ 0.183680] NET: Registered PF_INET protocol family680worker1 # [ 0.014569] NET: Registered PF_NETLINK/PF_ROUTE protocol family681lb # [ 0.004975] CPU features: detected: Speculative Store Bypassing Safe (SSBS)682worker2 # [ 0.183944] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)683client # [ 0.144611] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages684lb # [ 0.005011] alternatives: applying system-wide alternatives685client # [ 0.144630] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page686lb # [ 0.007934] CPU features: detected: BBM Level 2 without TLB conflict abort687client # [ 0.144635] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages688client # [ 0.144640] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page689lb # [ 0.008150] Memory: 1406572K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)690client # [ 0.144644] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages691lb # [ 0.008507] devtmpfs: initialized692client # [ 0.144648] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page693lb # [ 0.010298] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)694client # [ 0.144653] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages695lb # [ 0.010320] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).696client # [ 0.144657] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page697lb # [ 0.010501] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL698lb # [ 0.010505] 0 pages in range for non-PLT usage699lb # [ 0.010506] 508288 pages in range for PLT usage700lb # [ 0.010609] pinctrl core: initialized pinctrl subsystem701client # [ 0.152016] fbcon: Taking over console702lb # [ 0.011331] DMI not present or invalid.703worker1 # [ 0.016795] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations704client # [ 0.152030] ACPI: Interpreter disabled.705lb # [ 0.014706] NET: Registered PF_NETLINK/PF_ROUTE protocol family706client # [ 0.153823] iommu: Default domain type: Translated707worker1 # [ 0.016975] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations708lb # [ 0.016912] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations709client # [ 0.153832] iommu: DMA domain TLB invalidation policy: strict mode710worker1 # [ 0.017167] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations711lb # [ 0.017084] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations712client # [ 0.155477] SCSI subsystem initialized713worker1 # [ 0.017187] audit: initializing netlink subsys (disabled)714worker1 # [ 0.017734] thermal_sys: Registered thermal governor 'fair_share'715lb # [ 0.017280] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations716lb # [ 0.017300] audit: initializing netlink subsys (disabled)717worker1 # [ 0.017736] thermal_sys: Registered thermal governor 'bang_bang'718lb # [ 0.017882] thermal_sys: Registered thermal governor 'fair_share'719worker1 # [ 0.017739] thermal_sys: Registered thermal governor 'step_wise'720lb # [ 0.017884] thermal_sys: Registered thermal governor 'bang_bang'721worker1 # [ 0.017745] thermal_sys: Registered thermal governor 'user_space'722lb # [ 0.017888] thermal_sys: Registered thermal governor 'step_wise'723worker1 # [ 0.017747] thermal_sys: Registered thermal governor 'power_allocator'724lb # [ 0.017893] thermal_sys: Registered thermal governor 'user_space'725worker1 # [ 0.017786] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1726lb # [ 0.017896] thermal_sys: Registered thermal governor 'power_allocator'727worker1 # [ 0.017796] cpuidle: using governor ladder728worker1 # [ 0.017801] cpuidle: using governor menu729lb # [ 0.017920] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1730worker1 # [ 0.017995] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.731lb # [ 0.017928] cpuidle: using governor ladder732lb # [ 0.017934] cpuidle: using governor menu733worker1 # [ 0.018010] ASID allocator initialised with 65536 entries734worker1 # [ 0.019291] Serial: AMBA PL011 UART driver735lb # [ 0.018132] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.736client # [ 0.162941] usbcore: registered new interface driver usbfs737lb # [ 0.018170] ASID allocator initialised with 65536 entries738worker1 # [ 0.024373] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1739client # [ 0.162973] usbcore: registered new interface driver hub740lb # [ 0.019346] Serial: AMBA PL011 UART driver741worker1 # [ 0.024489] printk: console [ttyAMA0] enabled742client # [ 0.162990] usbcore: registered new device driver usb743client # [ 0.163271] pps_core: LinuxPPS API ver. 1 registered744lb # [ 0.024621] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1745worker1 # [ 0.144426] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages746lb # [ 0.024768] printk: console [ttyAMA0] enabled747client # [ 0.163276] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>748worker1 # [ 0.144443] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page749client # [ 0.163286] PTP clock support registered750client # [ 0.163341] EDAC MC: Ver: 3.0.0751lb # [ 0.145417] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages752worker1 # [ 0.144448] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages753client # [ 0.167844] scmi_core: SCMI protocol bus registered754lb # [ 0.145436] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page755worker1 # [ 0.144452] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page756lb # [ 0.145441] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages757worker1 # [ 0.144456] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages758client # [ 0.168784] FPGA manager framework759client # [ 0.169687] vgaarb: loaded760lb # [ 0.145445] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page761worker1 # [ 0.144461] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page762lb # [ 0.145449] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages763worker1 # [ 0.144465] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages764client # [ 0.170296] clocksource: Switched to clocksource arch_sys_counter765lb # [ 0.145454] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page766worker1 # [ 0.144469] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page767client # [ 0.170893] VFS: Disk quotas dquot_6.6.0768lb # [ 0.145458] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages769client # [ 0.170918] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)770lb # [ 0.145462] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page771client # [ 0.173223] netfs: FS-Cache loaded772client # [ 0.173335] pnp: PnP ACPI: disabled773worker1 # [ 0.151779] fbcon: Taking over console774worker1 # [ 0.151792] ACPI: Interpreter disabled.775worker1 # [ 0.153664] iommu: Default domain type: Translated776lb # [ 0.152781] fbcon: Taking over console777worker1 # [ 0.153672] iommu: DMA domain TLB invalidation policy: strict mode778lb # [ 0.152794] ACPI: Interpreter disabled.779worker1 # [ 0.155339] SCSI subsystem initialized780worker2 # [ 0.212588] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)781worker2 # [ 0.212629] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)782lb # [ 0.160724] iommu: Default domain type: Translated783client # [ 0.179358] NET: Registered PF_INET protocol family784worker2 # [ 0.212655] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)785lb # [ 0.160733] iommu: DMA domain TLB invalidation policy: strict mode786client # [ 0.179625] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)787worker2 # [ 0.212728] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)788worker1 # [ 0.161825] usbcore: registered new interface driver usbfs789lb # [ 0.162367] SCSI subsystem initialized790worker1 # [ 0.161857] usbcore: registered new interface driver hub791worker2 # [ 0.212871] TCP: Hash tables configured (established 16384 bind 16384)792worker1 # [ 0.161875] usbcore: registered new device driver usb793worker2 # [ 0.212945] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)794lb # [ 0.163021] usbcore: registered new interface driver usbfs795worker1 # [ 0.162142] pps_core: LinuxPPS API ver. 1 registered796worker2 # [ 0.212980] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)797lb # [ 0.163053] usbcore: registered new interface driver hub798worker1 # [ 0.162148] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>799lb # [ 0.163071] usbcore: registered new device driver usb800worker2 # [ 0.213016] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)801worker1 # [ 0.162158] PTP clock support registered802lb # [ 0.163340] pps_core: LinuxPPS API ver. 1 registered803worker1 # [ 0.162207] EDAC MC: Ver: 3.0.0804worker2 # [ 0.213115] NET: Registered PF_UNIX/PF_LOCAL protocol family805worker2 # [ 0.213157] NET: Registered PF_XDP protocol family806lb # [ 0.163346] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>807worker1 # [ 0.166705] scmi_core: SCMI protocol bus registered808worker2 # [ 0.213174] PCI: CLS 0 bytes, default 64809lb # [ 0.163364] PTP clock support registered810lb # [ 0.163418] EDAC MC: Ver: 3.0.0811worker2 # [ 0.213384] Trying to unpack rootfs image as initramfs...812worker1 # [ 0.167654] FPGA manager framework813worker1 # [ 0.168602] vgaarb: loaded814lb # [ 0.167914] scmi_core: SCMI protocol bus registered815worker1 # [ 0.169225] clocksource: Switched to clocksource arch_sys_counter816lb # [ 0.168891] FPGA manager framework817lb # [ 0.169801] vgaarb: loaded818worker2 # [ 0.230023] kvm [1]: HYP mode not available819lb # [ 0.170432] clocksource: Switched to clocksource arch_sys_counter820worker1 # [ 0.171652] VFS: Disk quotas dquot_6.6.0821worker1 # [ 0.171681] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)822lb # [ 0.172568] VFS: Disk quotas dquot_6.6.0823lb # [ 0.172603] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)824worker1 # [ 0.175236] netfs: FS-Cache loaded825worker1 # [ 0.175352] pnp: PnP ACPI: disabled826lb # [ 0.176275] netfs: FS-Cache loaded827lb # [ 0.176397] pnp: PnP ACPI: disabled828worker1 # [ 0.179150] NET: Registered PF_INET protocol family829worker1 # [ 0.179417] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)830lb # [ 0.180225] NET: Registered PF_INET protocol family831lb # [ 0.180488] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832client # [ 0.207954] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833client # [ 0.207992] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834client # [ 0.208018] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835client # [ 0.208091] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836client # [ 0.208233] TCP: Hash tables configured (established 16384 bind 16384)837client # [ 0.208309] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838client # [ 0.208341] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839client # [ 0.208375] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840client # [ 0.208470] NET: Registered PF_UNIX/PF_LOCAL protocol family841client # [ 0.208521] NET: Registered PF_XDP protocol family842client # [ 0.208538] PCI: CLS 0 bytes, default 64843client # [ 0.208778] Trying to unpack rootfs image as initramfs...844client # [ 0.223850] kvm [1]: HYP mode not available845worker1 # [ 0.208191] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846worker1 # [ 0.208236] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847lb # [ 0.209121] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)848worker1 # [ 0.208261] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)849lb # [ 0.209166] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)850worker1 # [ 0.208330] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)851worker1 # [ 0.208473] TCP: Hash tables configured (established 16384 bind 16384)852lb # [ 0.209194] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)853lb # [ 0.209267] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)854worker1 # [ 0.208549] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)855worker1 # [ 0.208584] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)856lb # [ 0.209410] TCP: Hash tables configured (established 16384 bind 16384)857worker1 # [ 0.208629] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)858lb # [ 0.209492] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)859worker1 # [ 0.208714] NET: Registered PF_UNIX/PF_LOCAL protocol family860lb # [ 0.209528] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)861worker1 # [ 0.208742] NET: Registered PF_XDP protocol family862lb # [ 0.209563] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)863worker1 # [ 0.208759] PCI: CLS 0 bytes, default 64864lb # [ 0.209666] NET: Registered PF_UNIX/PF_LOCAL protocol family865worker1 # [ 0.208982] Trying to unpack rootfs image as initramfs...866lb # [ 0.209718] NET: Registered PF_XDP protocol family867lb # [ 0.209735] PCI: CLS 0 bytes, default 64868lb # [ 0.209960] Trying to unpack rootfs image as initramfs...869worker1 # [ 0.226984] kvm [1]: HYP mode not available870lb # [ 0.228210] kvm [1]: HYP mode not available871worker2 # [ 0.314789] Initialise system trusted keyrings872worker2 # [ 0.315575] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker2 # [ 0.324807] squashfs: version 4.0 (2009/01/31) Phillip Lougher874worker2 # [ 0.324895] 9p: Installing v9fs 9p2000 file system support875worker2 # [ 0.344798] Key type asymmetric registered876worker2 # [ 0.344819] Asymmetric key parser 'x509' registered877worker2 # [ 0.344880] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878worker2 # [ 0.347025] io scheduler mq-deadline registered879worker2 # [ 0.347035] io scheduler kyber registered880client # [ 0.314855] Initialise system trusted keyrings881client # [ 0.315576] workingset: timestamp_bits=42 max_order=19 bucket_order=0882client # [ 0.316840] squashfs: version 4.0 (2009/01/31) Phillip Lougher883client # [ 0.317609] 9p: Installing v9fs 9p2000 file system support884worker2 # [ 0.360588] pl061_gpio 9030000.pl061: PL061 GPIO chip registered885worker2 # [ 0.361235] ledtrig-cpu: registered to indicate activity on CPUs886worker2 # [ 0.361596] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:887worker2 # [ 0.361612] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000888worker2 # [ 0.361625] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000889worker2 # [ 0.361633] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000890worker2 # [ 0.361654] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits891lb # [ 0.312962] Initialise system trusted keyrings892worker2 # [ 0.361679] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]893lb # [ 0.313705] workingset: timestamp_bits=42 max_order=19 bucket_order=0894worker2 # [ 0.361753] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00895worker2 # [ 0.361762] pci_bus 0000:00: root bus resource [bus 00-ff]896lb # [ 0.315074] squashfs: version 4.0 (2009/01/31) Phillip Lougher897worker2 # [ 0.361767] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]898client # [ 0.338186] Key type asymmetric registered899worker2 # [ 0.361772] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]900client # [ 0.338209] Asymmetric key parser 'x509' registered901worker1 # [ 0.317745] Initialise system trusted keyrings902worker2 # [ 0.361777] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]903client # [ 0.338273] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)904worker1 # [ 0.318455] workingset: timestamp_bits=42 max_order=19 bucket_order=0905lb # [ 0.315858] 9p: Installing v9fs 9p2000 file system support906worker2 # [ 0.361853] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint907worker1 # [ 0.319696] squashfs: version 4.0 (2009/01/31) Phillip Lougher908worker2 # [ 0.362281] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint909worker2 # [ 0.362464] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]910worker1 # [ 0.320462] 9p: Installing v9fs 9p2000 file system support911worker2 # [ 0.362481] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]912worker2 # [ 0.362510] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]913worker2 # [ 0.362526] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]914worker2 # [ 0.362979] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint915worker2 # [ 0.363161] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]916client # [ 0.346350] io scheduler mq-deadline registered917worker2 # [ 0.363177] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]918client # [ 0.346368] io scheduler kyber registered919worker2 # [ 0.363206] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]920worker2 # [ 0.363649] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint921worker2 # [ 0.363828] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]922worker2 # [ 0.363844] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]923worker2 # [ 0.363873] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]924worker2 # [ 0.364338] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint925client # [ 0.351362] pl061_gpio 9030000.pl061: PL061 GPIO chip registered926worker2 # [ 0.364541] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]927worker2 # [ 0.364557] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]928worker2 # [ 0.364589] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]929worker2 # [ 0.365048] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint930worker2 # [ 0.365228] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]931worker2 # [ 0.365244] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]932worker2 # [ 0.365273] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]933worker2 # [ 0.365723] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint934worker2 # [ 0.365903] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]935worker2 # [ 0.365919] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]936worker2 # [ 0.365948] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]937worker2 # [ 0.366423] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint938worker2 # [ 0.366603] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]939worker1 # [ 0.341076] Key type asymmetric registered940worker2 # [ 0.366619] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]941worker1 # [ 0.341097] Asymmetric key parser 'x509' registered942worker2 # [ 0.366648] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]943worker1 # [ 0.341166] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)944worker2 # [ 0.366664] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]945worker2 # [ 0.367111] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint946lb # [ 0.343766] Key type asymmetric registered947worker2 # [ 0.367295] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]948lb # [ 0.343791] Asymmetric key parser 'x509' registered949client # [ 0.358335] ledtrig-cpu: registered to indicate activity on CPUs950worker2 # [ 0.367324] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]951lb # [ 0.343856] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)952client # [ 0.358774] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:953worker2 # [ 0.367767] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint954lb # [ 0.345934] io scheduler mq-deadline registered955lb # [ 0.345945] io scheduler kyber registered956worker2 # [ 0.367951] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]957client # [ 0.358793] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000958worker2 # [ 0.367980] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]959client # [ 0.358805] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000960worker2 # [ 0.368374] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint961client # [ 0.358813] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000962worker1 # [ 0.349276] io scheduler mq-deadline registered963worker1 # [ 0.349294] io scheduler kyber registered964client # [ 0.358833] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits965client # [ 0.358857] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]966client # [ 0.358936] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00967client # [ 0.358946] pci_bus 0000:00: root bus resource [bus 00-ff]968client # [ 0.358952] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]969client # [ 0.358957] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]970client # [ 0.358962] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]971client # [ 0.359035] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint972client # [ 0.359465] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint973client # [ 0.359649] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]974worker1 # [ 0.357346] pl061_gpio 9030000.pl061: PL061 GPIO chip registered975client # [ 0.359665] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]976worker2 # [ 0.416587] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]977client # [ 0.359693] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]978worker2 # [ 0.416863] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint979client # [ 0.359721] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]980worker2 # [ 0.417123] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]981client # [ 0.360175] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint982worker1 # [ 0.358757] ledtrig-cpu: registered to indicate activity on CPUs983worker2 # [ 0.417141] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]984client # [ 0.360358] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]985worker1 # [ 0.359135] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:986worker2 # [ 0.417171] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]987client # [ 0.360374] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]988worker1 # [ 0.359151] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000989worker2 # [ 0.417639] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint990client # [ 0.360403] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]991worker2 # [ 0.417821] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]992client # [ 0.360845] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint993worker1 # [ 0.359163] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000994worker2 # [ 0.417837] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]995client # [ 0.361026] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]996worker1 # [ 0.359171] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000997worker2 # [ 0.417867] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]998client # [ 0.361041] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]999worker2 # [ 0.418453] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1000worker1 # [ 0.359192] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1001client # [ 0.361070] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1002lb # [ 0.359152] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1003worker2 # [ 0.418465] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1004client # [ 0.361513] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1005worker1 # [ 0.359215] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1006lb # [ 0.359732] ledtrig-cpu: registered to indicate activity on CPUs1007client # [ 0.361693] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1008worker2 # [ 0.418471] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1009worker1 # [ 0.359287] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001010client # [ 0.361708] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1011lb # [ 0.360089] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1012worker1 # [ 0.359297] pci_bus 0000:00: root bus resource [bus 00-ff]1013worker2 # [ 0.418516] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1014client # [ 0.361739] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1015worker1 # [ 0.359303] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1016lb # [ 0.360106] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001017worker2 # [ 0.418564] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1018client # [ 0.362188] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1019worker1 # [ 0.359308] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1020lb # [ 0.360118] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001021client # [ 0.362389] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1022worker2 # [ 0.418610] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1023worker1 # [ 0.359313] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1024client # [ 0.362405] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1025lb # [ 0.360126] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001026worker2 # [ 0.418657] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1027worker1 # [ 0.359372] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1028client # [ 0.362434] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1029lb # [ 0.360146] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1030worker2 # [ 0.418703] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1031worker1 # [ 0.359802] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1032client # [ 0.362885] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1033worker1 # [ 0.359988] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1034lb # [ 0.360167] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1035worker2 # [ 0.418751] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1036client # [ 0.363066] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1037worker1 # [ 0.360004] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1038lb # [ 0.360237] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001039client # [ 0.363081] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1040worker2 # [ 0.418799] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1041worker1 # [ 0.360033] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1042lb # [ 0.360246] pci_bus 0000:00: root bus resource [bus 00-ff]1043client # [ 0.363110] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1044worker2 # [ 0.418847] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1045worker1 # [ 0.360049] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1046lb # [ 0.360252] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1047client # [ 0.363570] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1048worker2 # [ 0.418896] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1049lb # [ 0.360257] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1050worker1 # [ 0.360502] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1051client # [ 0.363757] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1052worker1 # [ 0.360686] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1053lb # [ 0.360262] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1054worker2 # [ 0.418956] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1055client # [ 0.363773] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1056worker1 # [ 0.360701] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1057worker2 # [ 0.419001] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1058client # [ 0.363802] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1059lb # [ 0.360355] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1060worker1 # [ 0.360730] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1061client # [ 0.363818] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1062worker2 # [ 0.419022] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1063lb # [ 0.360797] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1064worker1 # [ 0.361175] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1065worker2 # [ 0.419043] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1066lb # [ 0.360987] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1067client # [ 0.364266] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1068worker2 # [ 0.419065] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1069client # [ 0.364452] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1070lb # [ 0.361004] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1071client # [ 0.364480] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1072worker2 # [ 0.419088] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1073lb # [ 0.361034] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1074lb # [ 0.361050] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1075worker2 # [ 0.419110] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1076client # [ 0.364926] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1077worker2 # [ 0.419132] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1078client # [ 0.365110] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1079lb # [ 0.361508] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1080lb # [ 0.361692] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1081worker2 # [ 0.419153] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1082client # [ 0.365139] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1083lb # [ 0.361708] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1084worker2 # [ 0.419175] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1085client # [ 0.365521] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1086lb # [ 0.361738] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1087worker2 # [ 0.419197] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1088client # [ 0.365701] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1089worker2 # [ 0.419220] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1090lb # [ 0.362202] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1091client # [ 0.365943] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1092lb # [ 0.362386] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1093client # [ 0.366204] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1094worker2 # [ 0.419242] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1095lb # [ 0.362402] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1096client # [ 0.366221] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1097worker2 # [ 0.419264] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1098lb # [ 0.362453] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1099client # [ 0.366250] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1100worker2 # [ 0.419285] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1101worker2 # [ 0.419307] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1102lb # [ 0.362914] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1103lb # [ 0.363099] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1104worker2 # [ 0.419328] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1105lb # [ 0.363115] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1106worker2 # [ 0.419349] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1107worker2 # [ 0.419371] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1108lb # [ 0.363147] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1109worker2 # [ 0.419392] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1110lb # [ 0.363615] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1111worker2 # [ 0.419414] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1112worker1 # [ 0.385379] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1113lb # [ 0.363799] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1114worker2 # [ 0.419437] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1115worker1 # [ 0.385402] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1116lb # [ 0.363815] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1117worker2 # [ 0.419466] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1118worker1 # [ 0.385439] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1119lb # [ 0.363845] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1120worker2 # [ 0.419475] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1121worker1 # [ 0.385913] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1122lb # [ 0.364296] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1123worker2 # [ 0.419480] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1124worker1 # [ 0.386096] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1125lb # [ 0.364480] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1126worker1 # [ 0.386112] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1127lb # [ 0.364496] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1128client # [ 0.414765] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1129worker1 # [ 0.386143] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1130lb # [ 0.364525] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131client # [ 0.414958] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1132worker1 # [ 0.386596] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1133client # [ 0.414974] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1134lb # [ 0.364984] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1135worker1 # [ 0.386785] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1136lb # [ 0.365170] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1137client # [ 0.415003] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1138worker1 # [ 0.386801] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1139lb # [ 0.365186] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1140client # [ 0.415577] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1141worker1 # [ 0.386830] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1142lb # [ 0.365216] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1143client # [ 0.415589] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1144lb # [ 0.365232] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1145worker1 # [ 0.387280] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1146client # [ 0.415594] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1147worker1 # [ 0.387463] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1148lb # [ 0.365723] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1149worker1 # [ 0.387479] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1150client # [ 0.415639] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1151lb # [ 0.365913] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1152worker1 # [ 0.387507] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1153client # [ 0.415685] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1154lb # [ 0.365943] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1155worker1 # [ 0.387989] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1156worker2 # [ 0.464708] pci 0000:00:0a.0: enabling device (0000 -> 0002)1157client # [ 0.415741] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1158lb # [ 0.366401] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1159worker1 # [ 0.388173] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1160client # [ 0.415787] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1161worker1 # [ 0.388188] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1162worker1 # [ 0.388218] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1163client # [ 0.415833] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1164worker1 # [ 0.388233] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1165client # [ 0.415879] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1166worker1 # [ 0.388694] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1167client # [ 0.415926] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1168worker1 # [ 0.388881] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1169client # [ 0.415973] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1170worker1 # [ 0.388910] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1171client # [ 0.416020] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1172worker1 # [ 0.389374] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1173client # [ 0.416110] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1174worker1 # [ 0.389561] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1175client # [ 0.416157] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1176worker1 # [ 0.389590] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1177client # [ 0.416177] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1178worker1 # [ 0.389988] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1179client # [ 0.416198] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1180worker1 # [ 0.390172] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1181client # [ 0.416219] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1182worker1 # [ 0.390418] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1183client # [ 0.416242] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1184worker1 # [ 0.390692] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1185client # [ 0.416263] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1186worker1 # [ 0.390709] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1187lb # [ 0.410617] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1188client # [ 0.416285] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1189worker1 # [ 0.390738] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1190lb # [ 0.410656] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1191client # [ 0.416306] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1192worker1 # [ 0.391196] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1193client # [ 0.416327] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1194worker1 # [ 0.391384] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1195lb # [ 0.411069] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1196client # [ 0.416349] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1197worker1 # [ 0.391400] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1198lb # [ 0.411253] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1199client # [ 0.416372] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1200worker1 # [ 0.391429] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1201lb # [ 0.411505] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1202client # [ 0.416394] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1203lb # [ 0.411767] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1204worker1 # [ 0.391984] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1205client # [ 0.416415] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1206lb # [ 0.411784] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1207worker1 # [ 0.391994] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1208client # [ 0.416436] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1209lb # [ 0.411814] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1210worker1 # [ 0.392000] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1211client # [ 0.416457] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1212lb # [ 0.412284] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1213client # [ 0.416478] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1214worker1 # [ 0.392043] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1215lb # [ 0.412467] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1216client # [ 0.416499] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1217worker1 # [ 0.392089] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1218lb # [ 0.412483] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1219client # [ 0.416520] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1220lb # [ 0.412512] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1221worker1 # [ 0.392135] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1222client # [ 0.416541] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1223lb # [ 0.413086] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1224client # [ 0.416562] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1225worker2 # [ 0.485308] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1226worker1 # [ 0.392181] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1227client # [ 0.416583] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1228worker2 # [ 0.487383] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1229lb # [ 0.413097] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1230worker1 # [ 0.392227] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1231client # [ 0.416609] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1232lb # [ 0.413103] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1233worker1 # [ 0.392273] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1234client # [ 0.416619] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1235lb # [ 0.413146] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1236client # [ 0.416623] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1237worker1 # [ 0.392319] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1238client # [ 0.417770] pci 0000:00:0a.0: enabling device (0000 -> 0002)1239lb # [ 0.413193] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1240worker1 # [ 0.392365] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1241lb # [ 0.413239] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1242worker1 # [ 0.392410] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1243lb # [ 0.413286] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1244worker1 # [ 0.392481] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1245lb # [ 0.413332] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1246worker1 # [ 0.392526] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1247worker1 # [ 0.392547] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1248lb # [ 0.413380] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1249worker1 # [ 0.392568] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1250lb # [ 0.413428] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1251worker1 # [ 0.392589] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1252lb # [ 0.413474] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1253worker1 # [ 0.392613] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1254lb # [ 0.413521] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1255worker1 # [ 0.392634] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1256lb # [ 0.413581] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1257worker1 # [ 0.392656] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1258worker2 # [ 0.498447] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1259lb # [ 0.413626] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1260worker1 # [ 0.392677] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1261lb # [ 0.413648] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1262worker1 # [ 0.392699] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1263lb # [ 0.413669] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1264worker1 # [ 0.392721] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1265lb # [ 0.413692] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1266worker1 # [ 0.392743] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1267lb # [ 0.413715] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1268worker1 # [ 0.392765] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1269worker1 # [ 0.392786] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1270lb # [ 0.413738] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1271worker1 # [ 0.392807] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1272lb # [ 0.413760] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1273worker1 # [ 0.392828] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1274lb # [ 0.413782] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1275worker1 # [ 0.392849] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1276lb # [ 0.413804] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1277worker1 # [ 0.392870] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1278lb # [ 0.413826] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1279worker1 # [ 0.392891] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1280lb # [ 0.413849] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1281worker1 # [ 0.392912] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1282worker2 # [ 0.504463] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1283lb # [ 0.413871] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1284worker1 # [ 0.392934] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1285worker2 # [ 0.506459] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1286lb # [ 0.413893] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1287worker1 # [ 0.392955] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1288lb # [ 0.413915] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1289worker1 # [ 0.392981] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1290lb # [ 0.413936] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1291worker1 # [ 0.392990] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1292lb # [ 0.413958] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1293worker1 # [ 0.392994] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1294lb # [ 0.413979] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1295lb # [ 0.414001] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1296lb # [ 0.414023] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1297lb # [ 0.414045] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1298lb # [ 0.414067] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1299lb # [ 0.414094] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1300lb # [ 0.414104] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1301lb # [ 0.414108] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1302client # [ 0.477584] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1303lb # [ 0.415292] pci 0000:00:0a.0: enabling device (0000 -> 0002)1304worker1 # [ 0.458193] pci 0000:00:0a.0: enabling device (0000 -> 0002)1305worker2 # [ 0.516609] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1306worker2 # [ 0.518673] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1307worker2 # [ 0.520714] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1308client # [ 0.483586] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1309worker2 # [ 0.522728] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1310client # [ 0.485516] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1311worker2 # [ 0.532597] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1312worker2 # [ 0.534941] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1313client # [ 0.495732] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1314client # [ 0.497631] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1315lb # [ 0.480915] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1316worker1 # [ 0.483552] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1317client # [ 0.509031] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1318worker2 # [ 0.553335] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1319client # [ 0.512364] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1320worker2 # [ 0.556027] msm_serial: driver initialized1321worker2 # [ 0.556186] SuperH (H)SCI(F) driver initialized1322worker2 # [ 0.556240] STM32 USART driver initialized1323worker1 # [ 0.493476] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1324worker1 # [ 0.497040] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1325lb # [ 0.495067] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1326worker1 # [ 0.499076] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1327lb # [ 0.497042] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1328worker1 # [ 0.500974] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1329lb # [ 0.499126] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1330lb # [ 0.501254] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1331client # [ 0.522484] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1332client # [ 0.524595] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1333client # [ 0.526439] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1334client # [ 0.528619] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1335worker1 # [ 0.511374] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1336lb # [ 0.511541] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1337lb # [ 0.514004] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1338lb # [ 0.525626] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1339client # [ 0.547557] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1340client # [ 0.550072] msm_serial: driver initialized1341worker2 # [ 0.589354] loop: module loaded1342worker1 # [ 0.521414] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1343client # [ 0.550208] SuperH (H)SCI(F) driver initialized1344worker2 # [ 0.589536] virtio_blk virtio5: 1/0/0 default/read/poll queues1345client # [ 0.550261] STM32 USART driver initialized1346worker1 # [ 0.525513] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1347worker2 # [ 0.590238] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1348worker1 # [ 0.527797] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1349lb # [ 0.528707] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1350worker1 # [ 0.537409] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1351worker1 # [ 0.540481] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1352lb # [ 0.538607] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1353lb # [ 0.540832] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1354worker2 # [ 0.601044] megasas: 07.734.00.00-rc11355worker2 # [ 0.601808] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1356worker2 # [ 0.603747] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001357worker2 # [ 0.603773] Intel/Sharp Extended Query Table at 0x00311358worker2 # [ 0.605442] Using buffer write method1359worker2 # [ 0.605506] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1360lb # [ 0.551609] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1361worker2 # [ 0.607248] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001362worker2 # [ 0.607303] Intel/Sharp Extended Query Table at 0x00311363lb # [ 0.554138] msm_serial: driver initialized1364lb # [ 0.554308] SuperH (H)SCI(F) driver initialized1365lb # [ 0.554362] STM32 USART driver initialized1366worker1 # [ 0.558419] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1367worker2 # [ 0.621033] Using buffer write method1368worker2 # [ 0.621060] Concatenating MTD devices:1369worker2 # [ 0.621064] (0): "0.flash"1370worker2 # [ 0.621068] (1): "0.flash"1371worker2 # [ 0.621071] into device "0.flash"1372worker1 # [ 0.560871] msm_serial: driver initialized1373worker1 # [ 0.561024] SuperH (H)SCI(F) driver initialized1374worker1 # [ 0.561075] STM32 USART driver initialized1375client # [ 0.583470] loop: module loaded1376client # [ 0.583635] virtio_blk virtio5: 1/0/0 default/read/poll queues1377client # [ 0.584318] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1378client # [ 0.590872] megasas: 07.734.00.00-rc11379client # [ 0.591571] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1380client # [ 0.603480] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001381client # [ 0.603511] Intel/Sharp Extended Query Table at 0x00311382client # [ 0.605687] Using buffer write method1383client # [ 0.605753] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1384lb # [ 0.587620] loop: module loaded1385lb # [ 0.587810] virtio_blk virtio5: 1/0/0 default/read/poll queues1386lb # [ 0.588494] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1387worker1 # [ 0.594127] loop: module loaded1388worker1 # [ 0.594302] virtio_blk virtio5: 1/0/0 default/read/poll queues1389worker1 # [ 0.595017] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1390client # [ 0.615353] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001391client # [ 0.615386] Intel/Sharp Extended Query Table at 0x00311392lb # [ 0.595030] megasas: 07.734.00.00-rc11393lb # [ 0.595716] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1394lb # [ 0.597983] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001395lb # [ 0.598008] Intel/Sharp Extended Query Table at 0x00311396client # [ 0.626339] Using buffer write method1397client # [ 0.626365] Concatenating MTD devices:1398client # [ 0.626369] (0): "0.flash"1399client # [ 0.626373] (1): "0.flash"1400client # [ 0.626376] into device "0.flash"1401worker1 # [ 0.601815] megasas: 07.734.00.00-rc11402worker1 # [ 0.602513] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1403lb # [ 0.607482] Using buffer write method1404worker1 # [ 0.604716] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001405lb # [ 0.607553] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1406worker1 # [ 0.604743] Intel/Sharp Extended Query Table at 0x00311407worker1 # [ 0.606310] Using buffer write method1408lb # [ 0.610429] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001409worker1 # [ 0.606375] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1410worker1 # [ 0.608057] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001411worker1 # [ 0.608087] Intel/Sharp Extended Query Table at 0x00311412worker1 # [ 0.617400] Using buffer write method1413worker1 # [ 0.617424] Concatenating MTD devices:1414worker1 # [ 0.617428] (0): "0.flash"1415worker1 # [ 0.617432] (1): "0.flash"1416worker1 # [ 0.617436] into device "0.flash"1417lb # [ 0.618492] Intel/Sharp Extended Query Table at 0x00311418lb # [ 0.619973] Using buffer write method1419lb # [ 0.620001] Concatenating MTD devices:1420lb # [ 0.620006] (0): "0.flash"1421lb # [ 0.620010] (1): "0.flash"1422lb # [ 0.620013] into device "0.flash"1423worker2 # [ 0.847197] Freeing initrd memory: 26148K1424worker2 # [ 0.853208] tun: Universal TUN/TAP device driver, 1.61425worker2 # [ 0.857010] thunder_xcv, ver 1.01426worker2 # [ 0.857051] thunder_bgx, ver 1.01427worker2 # [ 0.857073] nicpf, ver 1.01428worker2 # [ 0.857621] e1000: Intel(R) PRO/1000 Network Driver1429worker2 # [ 0.857628] e1000: Copyright (c) 1999-2006 Intel Corporation.1430worker2 # [ 0.857652] e1000e: Intel(R) PRO/1000 Network Driver1431worker2 # [ 0.857660] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432worker2 # [ 0.857692] igb: Intel(R) Gigabit Ethernet Network Driver1433worker2 # [ 0.857697] igb: Copyright (c) 2007-2014 Intel Corporation.1434worker2 # [ 0.857720] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435worker2 # [ 0.857725] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436worker2 # [ 0.857862] sky2: driver version 1.301437worker2 # [ 0.859453] usbcore: registered new interface driver usb-storage1438worker2 # [ 0.859575] usbcore: registered new interface driver usbserial_generic1439worker2 # [ 0.859590] usbserial: USB Serial support registered for generic1440worker2 # [ 0.860251] hv_vmbus: registering driver hyperv_keyboard1441worker2 # [ 0.861142] ehci-pci 0000:00:0a.0: EHCI Host Controller1442worker2 # [ 0.861172] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11443worker2 # [ 0.861436] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001444worker2 # [ 0.873756] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001445worker2 # [ 0.874094] hub 1-0:1.0: USB hub found1446worker2 # [ 0.874125] hub 1-0:1.0: 6 ports detected1447worker2 # [ 0.876946] rtc-pl031 9010000.pl031: registered as rtc01448worker2 # [ 0.876980] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:35 UTC (1789901435)1449worker2 # [ 0.877278] i2c_dev: i2c /dev entries driver1450worker2 # [ 0.882200] sdhci: Secure Digital Host Controller Interface driver1451worker2 # [ 0.882210] sdhci: Copyright(c) Pierre Ossman1452worker2 # [ 0.882477] Synopsys Designware Multimedia Card Interface Driver1453client # [ 0.845942] Freeing initrd memory: 26160K1454worker2 # [ 0.882848] sdhci-pltfm: SDHCI platform and OF driver helper1455worker2 # [ 0.887312] hid: raw HID events driver (C) Jiri Kosina1456worker2 # [ 0.887570] usbcore: registered new interface driver usbhid1457worker2 # [ 0.887576] usbhid: USB HID core driver1458client # [ 0.851937] tun: Universal TUN/TAP device driver, 1.61459worker2 # [ 0.890502] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1460worker2 # [ 0.892011] drop_monitor: Initializing network drop monitor service1461worker2 # [ 0.892164] NET: Registered PF_INET6 protocol family1462worker2 # [ 0.895267] Segment Routing with IPv61463worker2 # [ 0.895285] In-situ OAM (IOAM) with IPv61464worker2 # [ 0.895315] NET: Registered PF_PACKET protocol family1465client # [ 0.855616] thunder_xcv, ver 1.01466client # [ 0.855658] thunder_bgx, ver 1.01467client # [ 0.855679] nicpf, ver 1.01468worker2 # [ 0.897173] 9pnet: Installing 9P2000 support1469client # [ 0.856231] e1000: Intel(R) PRO/1000 Network Driver1470worker2 # [ 0.899335] Key type dns_resolver registered1471client # [ 0.856238] e1000: Copyright (c) 1999-2006 Intel Corporation.1472client # [ 0.856261] e1000e: Intel(R) PRO/1000 Network Driver1473client # [ 0.856269] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1474client # [ 0.856297] igb: Intel(R) Gigabit Ethernet Network Driver1475client # [ 0.856302] igb: Copyright (c) 2007-2014 Intel Corporation.1476client # [ 0.856324] igbvf: Intel(R) Gigabit Virtual Function Network Driver1477client # [ 0.856330] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1478client # [ 0.856460] sky2: driver version 1.301479client # [ 0.858020] usbcore: registered new interface driver usb-storage1480client # [ 0.858140] usbcore: registered new interface driver usbserial_generic1481client # [ 0.858154] usbserial: USB Serial support registered for generic1482worker2 # [ 0.906380] registered taskstats version 11483worker2 # [ 0.906544] Loading compiled-in X.509 certificates1484client # [ 0.859000] ehci-pci 0000:00:0a.0: EHCI Host Controller1485worker1 # [ 0.848272] Freeing initrd memory: 26148K1486client # [ 0.859025] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11487client # [ 0.859288] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001488lb # [ 0.849398] Freeing initrd memory: 26140K1489client # [ 0.871019] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001490client # [ 0.871346] hub 1-0:1.0: USB hub found1491client # [ 0.871365] hub 1-0:1.0: 6 ports detected1492client # [ 0.873892] hv_vmbus: registering driver hyperv_keyboard1493worker2 # [ 0.915292] Demotion targets for Node 0: null1494worker1 # [ 0.854341] tun: Universal TUN/TAP device driver, 1.61495worker2 # [ 0.915394] Key type .fscrypt registered1496client # [ 0.875361] rtc-pl031 9010000.pl031: registered as rtc01497worker2 # [ 0.915401] Key type fscrypt-provisioning registered1498worker2 # [ 0.915492] ima: No TPM chip found, activating TPM-bypass!1499lb # [ 0.855488] tun: Universal TUN/TAP device driver, 1.61500client # [ 0.875388] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:36 UTC (1789901436)1501worker2 # [ 0.915511] ima: Allocated hash algorithm: sha11502client # [ 0.875687] i2c_dev: i2c /dev entries driver1503worker2 # [ 0.915531] ima: No architecture policies found1504worker2 # [ 0.919697] input: gpio-keys as /devices/platform/gpio-keys/input/input01505client # [ 0.880601] sdhci: Secure Digital Host Controller Interface driver1506client # [ 0.880614] sdhci: Copyright(c) Pierre Ossman1507worker1 # [ 0.858012] thunder_xcv, ver 1.01508client # [ 0.880875] Synopsys Designware Multimedia Card Interface Driver1509worker1 # [ 0.858058] thunder_bgx, ver 1.01510worker1 # [ 0.858079] nicpf, ver 1.01511client # [ 0.881245] sdhci-pltfm: SDHCI platform and OF driver helper1512worker1 # [ 0.858639] e1000: Intel(R) PRO/1000 Network Driver1513lb # [ 0.859258] thunder_xcv, ver 1.01514lb # [ 0.859302] thunder_bgx, ver 1.01515worker1 # [ 0.858646] e1000: Copyright (c) 1999-2006 Intel Corporation.1516lb # [ 0.859324] nicpf, ver 1.01517worker1 # [ 0.858675] e1000e: Intel(R) PRO/1000 Network Driver1518lb # [ 0.859874] e1000: Intel(R) PRO/1000 Network Driver1519client # [ 0.885566] hid: raw HID events driver (C) Jiri Kosina1520worker1 # [ 0.858683] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1521lb # [ 0.859882] e1000: Copyright (c) 1999-2006 Intel Corporation.1522client # [ 0.885822] usbcore: registered new interface driver usbhid1523worker1 # [ 0.858711] igb: Intel(R) Gigabit Ethernet Network Driver1524client # [ 0.885829] usbhid: USB HID core driver1525lb # [ 0.859907] e1000e: Intel(R) PRO/1000 Network Driver1526worker1 # [ 0.858716] igb: Copyright (c) 2007-2014 Intel Corporation.1527lb # [ 0.859916] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1528worker1 # [ 0.858738] igbvf: Intel(R) Gigabit Virtual Function Network Driver1529lb # [ 0.859944] igb: Intel(R) Gigabit Ethernet Network Driver1530worker1 # [ 0.858744] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1531lb # [ 0.859950] igb: Copyright (c) 2007-2014 Intel Corporation.1532worker1 # [ 0.858873] sky2: driver version 1.301533lb # [ 0.859973] igbvf: Intel(R) Gigabit Virtual Function Network Driver1534worker1 # [ 0.860441] usbcore: registered new interface driver usb-storage1535client # [ 0.888636] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1536lb # [ 0.859979] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1537worker1 # [ 0.860530] usbcore: registered new interface driver usbserial_generic1538lb # [ 0.860116] sky2: driver version 1.301539client # [ 0.890140] drop_monitor: Initializing network drop monitor service1540worker1 # [ 0.860544] usbserial: USB Serial support registered for generic1541lb # [ 0.861736] usbcore: registered new interface driver usb-storage1542client # [ 0.892093] NET: Registered PF_INET6 protocol family1543worker1 # [ 0.861118] hv_vmbus: registering driver hyperv_keyboard1544lb # [ 0.861822] usbcore: registered new interface driver usbserial_generic1545client # [ 0.893253] Segment Routing with IPv61546worker1 # [ 0.861940] ehci-pci 0000:00:0a.0: EHCI Host Controller1547lb # [ 0.861836] usbserial: USB Serial support registered for generic1548client # [ 0.893272] In-situ OAM (IOAM) with IPv61549worker1 # [ 0.861964] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11550lb # [ 0.863189] ehci-pci 0000:00:0a.0: EHCI Host Controller1551client # [ 0.893325] NET: Registered PF_PACKET protocol family1552worker1 # [ 0.862286] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001553lb # [ 0.863220] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11554lb # [ 0.863490] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001555worker1 # [ 0.874402] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001556worker1 # [ 0.874744] hub 1-0:1.0: USB hub found1557worker1 # [ 0.874763] hub 1-0:1.0: 6 ports detected1558lb # [ 0.874952] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001559lb # [ 0.875296] hub 1-0:1.0: USB hub found1560lb # [ 0.875312] hub 1-0:1.0: 6 ports detected1561client # [ 0.895121] 9pnet: Installing 9P2000 support1562client # [ 0.897149] Key type dns_resolver registered1563worker2 # [ 0.937525] clk: Disabling unused clocks1564lb # [ 0.877404] hv_vmbus: registering driver hyperv_keyboard1565worker1 # [ 0.877550] rtc-pl031 9010000.pl031: registered as rtc01566worker2 # [ 0.937553] PM: genpd: Disabling unused power domains1567worker1 # [ 0.877578] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:36 UTC (1789901436)1568worker1 # [ 0.877880] i2c_dev: i2c /dev entries driver1569lb # [ 0.878946] rtc-pl031 9010000.pl031: registered as rtc01570worker2 # [ 0.941791] Freeing unused kernel memory: 4736K1571worker2 # [ 0.941970] Run /init as init process1572lb # [ 0.878971] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:36 UTC (1789901436)1573lb # [ 0.879273] i2c_dev: i2c /dev entries driver1574worker1 # [ 0.882729] sdhci: Secure Digital Host Controller Interface driver1575client # [ 0.903703] registered taskstats version 11576worker1 # [ 0.882738] sdhci: Copyright(c) Pierre Ossman1577client # [ 0.903919] Loading compiled-in X.509 certificates1578worker1 # [ 0.883005] Synopsys Designware Multimedia Card Interface Driver1579lb # [ 0.884194] sdhci: Secure Digital Host Controller Interface driver1580worker1 # [ 0.883366] sdhci-pltfm: SDHCI platform and OF driver helper1581lb # [ 0.884204] sdhci: Copyright(c) Pierre Ossman1582worker1 # [ 0.884969] hid: raw HID events driver (C) Jiri Kosina1583lb # [ 0.884475] Synopsys Designware Multimedia Card Interface Driver1584worker1 # [ 0.885201] usbcore: registered new interface driver usbhid1585lb # [ 0.884850] sdhci-pltfm: SDHCI platform and OF driver helper1586worker1 # [ 0.885207] usbhid: USB HID core driver1587lb # [ 0.889253] hid: raw HID events driver (C) Jiri Kosina1588client # [ 0.912280] Demotion targets for Node 0: null1589lb # [ 0.889508] usbcore: registered new interface driver usbhid1590lb # [ 0.889515] usbhid: USB HID core driver1591client # [ 0.912389] Key type .fscrypt registered1592client # [ 0.912394] Key type fscrypt-provisioning registered1593worker1 # [ 0.890769] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1594client # [ 0.912481] ima: No TPM chip found, activating TPM-bypass!1595client # [ 0.912499] ima: Allocated hash algorithm: sha11596worker1 # [ 0.892303] drop_monitor: Initializing network drop monitor service1597client # [ 0.912519] ima: No architecture policies found1598worker1 # [ 0.892480] NET: Registered PF_INET6 protocol family1599lb # [ 0.892399] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1600worker1 # [ 0.895520] Segment Routing with IPv61601client # [ 0.916501] input: gpio-keys as /devices/platform/gpio-keys/input/input01602worker1 # [ 0.895540] In-situ OAM (IOAM) with IPv61603lb # [ 0.893916] drop_monitor: Initializing network drop monitor service1604worker1 # [ 0.895569] NET: Registered PF_PACKET protocol family1605lb # [ 0.894056] NET: Registered PF_INET6 protocol family1606worker1 # [ 0.897181] 9pnet: Installing 9P2000 support1607worker2 # [ 0.958697] systemd[1]: Successfully made /usr/ read-only.1608lb # [ 0.897158] Segment Routing with IPv61609lb # [ 0.897176] In-situ OAM (IOAM) with IPv61610lb # [ 0.897212] NET: Registered PF_PACKET protocol family1611worker1 # [ 0.900008] Key type dns_resolver registered1612lb # [ 0.899072] 9pnet: Installing 9P2000 support1613lb # [ 0.901215] Key type dns_resolver registered1614worker1 # [ 0.906358] registered taskstats version 11615worker1 # [ 0.906518] Loading compiled-in X.509 certificates1616lb # [ 0.908000] registered taskstats version 11617lb # [ 0.908147] Loading compiled-in X.509 certificates1618client # [ 0.933987] clk: Disabling unused clocks1619client # [ 0.934019] PM: genpd: Disabling unused power domains1620worker1 # [ 0.915232] Demotion targets for Node 0: null1621worker1 # [ 0.915345] Key type .fscrypt registered1622worker1 # [ 0.915351] Key type fscrypt-provisioning registered1623client # [ 0.938256] Freeing unused kernel memory: 4736K1624worker1 # [ 0.915441] ima: No TPM chip found, activating TPM-bypass!1625lb # [ 0.916702] Demotion targets for Node 0: null1626worker1 # [ 0.915460] ima: Allocated hash algorithm: sha11627client # [ 0.939037] Run /init as init process1628lb # [ 0.916812] Key type .fscrypt registered1629worker1 # [ 0.915480] ima: No architecture policies found1630lb # [ 0.916820] Key type fscrypt-provisioning registered1631lb # [ 0.916911] ima: No TPM chip found, activating TPM-bypass!1632worker1 # [ 0.919617] input: gpio-keys as /devices/platform/gpio-keys/input/input01633lb # [ 0.916931] ima: Allocated hash algorithm: sha11634lb # [ 0.916954] ima: No architecture policies found1635lb # [ 0.921043] input: gpio-keys as /devices/platform/gpio-keys/input/input01636client # [ 0.952491] systemd[1]: Successfully made /usr/ read-only.1637worker1 # [ 0.937789] clk: Disabling unused clocks1638worker1 # [ 0.937815] PM: genpd: Disabling unused power domains1639worker1 # [ 0.942033] Freeing unused kernel memory: 4736K1640lb # [ 0.941853] clk: Disabling unused clocks1641worker1 # [ 0.942226] Run /init as init process1642lb # [ 0.941881] PM: genpd: Disabling unused power domains1643lb # [ 0.946111] Freeing unused kernel memory: 4736K1644lb # [ 0.946336] Run /init as init process1645worker1 # [ 0.959408] systemd[1]: Successfully made /usr/ read-only.1646lb # [ 0.960725] systemd[1]: Successfully made /usr/ read-only.1647worker2 # [ 1.120511] usb 1-1: new high-speed USB device number 2 using ehci-pci1648client # [ 1.118380] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.121300] usb 1-1: new high-speed USB device number 2 using ehci-pci1650lb # [ 1.122512] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker2 # [ 1.272723] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652worker2 # [ 1.293624] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653worker2 # [ 1.305649] systemd[1]: Detected virtualization qemu.1654worker2 # [ 1.307629] systemd[1]: Detected architecture arm64.1655worker2 # [ 1.309615] systemd[1]: Running in initrd.1656worker2 # [ 1.312297] systemd[1]: Initializing machine ID from random generator.1657client # [ 1.270643] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11658worker2 # [ 1.315281] systemd[1]: Hostname set to <worker2>.1659client # [ 1.287297] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1660worker1 # [ 1.273590] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661client # [ 1.299268] systemd[1]: Detected virtualization qemu.1662lb # [ 1.274810] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11663client # [ 1.301265] systemd[1]: Detected architecture arm64.1664client # [ 1.303207] systemd[1]: Running in initrd.1665client # [ 1.305765] systemd[1]: Initializing machine ID from random generator.1666client # [ 1.308602] systemd[1]: Hostname set to <client>.1667worker2 # [ 1.360757] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01668worker1 # [ 1.294230] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1669lb # [ 1.295564] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1670worker1 # [ 1.306268] systemd[1]: Detected virtualization qemu.1671lb # [ 1.307660] systemd[1]: Detected virtualization qemu.1672worker1 # [ 1.308268] systemd[1]: Detected architecture arm64.1673worker1 # [ 1.310230] systemd[1]: Running in initrd.1674lb # [ 1.309637] systemd[1]: Detected architecture arm64.1675lb # [ 1.311595] systemd[1]: Running in initrd.1676worker1 # [ 1.312791] systemd[1]: Initializing machine ID from random generator.1677lb # [ 1.314111] systemd[1]: Initializing machine ID from random generator.1678worker1 # [ 1.315709] systemd[1]: Hostname set to <worker1>.1679lb # [ 1.317135] systemd[1]: Hostname set to <lb>.1680client # [ 1.358545] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681lb # [ 1.362726] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682worker1 # [ 1.365553] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker2 # [ 1.480486] usb 1-2: new high-speed USB device number 3 using ehci-pci1684client # [ 1.478352] usb 1-2: new high-speed USB device number 3 using ehci-pci1685lb # [ 1.482515] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker1 # [ 1.485313] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker2 # [ 1.619186] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688client # [ 1.599474] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689worker2 # [ 1.645355] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690worker2 # [ 1.650600] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691client # [ 1.633674] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21692worker1 # [ 1.616708] systemd[1]: bpf-restrict-fs: LSM BPF program attached1693client # [ 1.638060] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01694lb # [ 1.618706] systemd[1]: bpf-restrict-fs: LSM BPF program attached1695lb # [ 1.643059] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696worker1 # [ 1.645915] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21697lb # [ 1.648215] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01698worker1 # [ 1.651056] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01699worker2 # [ 1.734675] systemd[1]: Queued start job for default target Initrd Default Target.1700worker2 # [ 1.742768] systemd[1]: Created slice Slice /system/modprobe.1701worker2 # [ 1.743940] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1702worker2 # [ 1.745368] systemd[1]: Expecting device /dev/disk/by-label/nixos...1703worker2 # [ 1.746422] systemd[1]: Reached target Path Units.1704worker2 # [ 1.747233] systemd[1]: Reached target Slice Units.1705client # [ 1.706779] systemd[1]: Queued start job for default target Initrd Default Target.1706worker2 # [ 1.748073] systemd[1]: Reached target Swaps.1707worker2 # [ 1.748890] systemd[1]: Reached target Timer Units.1708worker2 # [ 1.749876] systemd[1]: Listening on D-Bus System Message Bus Socket.1709worker2 # [ 1.751166] systemd[1]: Listening on Journal Socket (/dev/log).1710worker2 # [ 1.752297] systemd[1]: Listening on Journal Sockets.1711worker2 # [ 1.753361] systemd[1]: Listening on udev Control Socket.1712worker2 # [ 1.753487] systemd[1]: Listening on udev Kernel Socket.1713worker2 # [ 1.753511] systemd[1]: Reached target Socket Units.1714client # [ 1.716749] systemd[1]: Created slice Slice /system/modprobe.1715worker2 # [ 1.757633] systemd[1]: Starting Create List of Static Device Nodes...1716client # [ 1.717911] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1717client # [ 1.719287] systemd[1]: Expecting device /dev/disk/by-label/nixos...1718client # [ 1.719322] systemd[1]: Reached target Path Units.1719client # [ 1.719342] systemd[1]: Reached target Slice Units.1720client # [ 1.719361] systemd[1]: Reached target Swaps.1721client # [ 1.719383] systemd[1]: Reached target Timer Units.1722client # [ 1.719562] systemd[1]: Listening on D-Bus System Message Bus Socket.1723client # [ 1.719737] systemd[1]: Listening on Journal Socket (/dev/log).1724client # [ 1.719878] systemd[1]: Listening on Journal Sockets.1725worker2 # [ 1.767844] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1726client # [ 1.720010] systemd[1]: Listening on udev Control Socket.1727client # [ 1.720113] systemd[1]: Listening on udev Kernel Socket.1728client # [ 1.720134] systemd[1]: Reached target Socket Units.1729worker2 # [ 1.769188] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1730client # [ 1.731004] systemd[1]: Starting Create List of Static Device Nodes...1731client # [ 1.738454] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1732client # [ 1.739665] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1733worker2 # [ 1.781937] systemd[1]: Mounting Kernel Configuration File System...1734client # [ 1.745899] systemd[1]: Mounting Kernel Configuration File System...1735lb # [ 1.729858] systemd[1]: Queued start job for default target Initrd Default Target.1736worker1 # [ 1.731118] systemd[1]: Queued start job for default target Initrd Default Target.1737worker1 # [ 1.740226] systemd[1]: Created slice Slice /system/modprobe.1738client # [ 1.762637] systemd[1]: Starting Journal Service...1739worker1 # [ 1.741479] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1740lb # [ 1.742063] systemd[1]: Created slice Slice /system/modprobe.1741worker1 # [ 1.742802] systemd[1]: Expecting device /dev/disk/by-label/nixos...1742worker2 # [ 1.804575] systemd[1]: Starting Journal Service...1743worker1 # [ 1.743861] systemd[1]: Reached target Path Units.1744worker1 # [ 1.744661] systemd[1]: Reached target Slice Units.1745worker1 # [ 1.745516] systemd[1]: Reached target Swaps.1746worker1 # [ 1.746252] systemd[1]: Reached target Timer Units.1747lb # [ 1.743413] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1748worker2 # [ 1.808647] systemd[1]: Starting Load Kernel Modules...1749lb # [ 1.743457] systemd[1]: Expecting device /dev/disk/by-label/nixos...1750worker1 # [ 1.747266] systemd[1]: Listening on D-Bus System Message Bus Socket.1751lb # [ 1.743488] systemd[1]: Reached target Path Units.1752worker2 # [ 1.809518] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1753worker1 # [ 1.748452] systemd[1]: Listening on Journal Socket (/dev/log).1754lb # [ 1.743510] systemd[1]: Reached target Slice Units.1755worker1 # [ 1.749591] systemd[1]: Listening on Journal Sockets.1756lb # [ 1.743530] systemd[1]: Reached target Swaps.1757lb # [ 1.743549] systemd[1]: Reached target Timer Units.1758worker1 # [ 1.750597] systemd[1]: Listening on udev Control Socket.1759lb # [ 1.743729] systemd[1]: Listening on D-Bus System Message Bus Socket.1760worker1 # [ 1.751726] systemd[1]: Listening on udev Kernel Socket.1761worker2 # [ 1.813664] systemd[1]: Starting Coldplug All udev Devices...1762lb # [ 1.743879] systemd[1]: Listening on Journal Socket (/dev/log).1763worker1 # [ 1.752643] systemd[1]: Reached target Socket Units.1764lb # [ 1.744019] systemd[1]: Listening on Journal Sockets.1765lb # [ 1.744154] systemd[1]: Listening on udev Control Socket.1766lb # [ 1.744270] systemd[1]: Listening on udev Kernel Socket.1767lb # [ 1.744294] systemd[1]: Reached target Socket Units.1768worker1 # [ 1.755098] systemd[1]: Starting Create List of Static Device Nodes...1769lb # [ 1.756499] systemd[1]: Starting Create List of Static Device Nodes...1770worker2 # [ 1.824655] systemd[1]: Finished Create List of Static Device Nodes.1771lb # [ 1.763285] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1772worker2 # [ 1.826503] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1773lb # [ 1.764400] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1774client # [ 1.786707] systemd[1]: Starting Load Kernel Modules...1775worker1 # [ 1.765401] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1776client # [ 1.786818] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1777worker1 # [ 1.765489] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1778worker1 # [ 1.769841] systemd[1]: Mounting Kernel Configuration File System...1779lb # [ 1.774619] systemd[1]: Mounting Kernel Configuration File System...1780worker2 # [ 1.836669] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1781client # [ 1.798509] systemd[1]: Starting Coldplug All udev Devices...1782worker1 # [ 1.781188] systemd[1]: Starting Journal Service...1783lb # [ 1.783375] systemd[1]: Starting Journal Service...1784client # [ 1.816300] systemd-journald[73]: Collecting audit messages is disabled.1785worker2 # [ 1.861050] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1786worker2 # [ 1.862746] systemd[1]: Mounted Kernel Configuration File System.1787worker1 # [ 1.801888] systemd[1]: Starting Load Kernel Modules...1788worker1 # [ 1.802998] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1789client # [ 1.826874] systemd[1]: Finished Create List of Static Device Nodes.1790client # [ 1.827661] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1791client # [ 1.827948] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1792client # [ 1.828170] systemd[1]: Mounted Kernel Configuration File System.1793lb # [ 1.810915] systemd[1]: Starting Load Kernel Modules...1794lb # [ 1.811772] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1795client # [ 1.834660] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1796worker2 # [ 1.874198] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1797worker1 # [ 1.817738] systemd[1]: Starting Coldplug All udev Devices...1798worker2 # [ 1.884630] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1799worker2 # [ 1.888812] systemd[1]: Starting Create Static Device Nodes in /dev...1800worker1 # [ 1.832821] systemd-journald[73]: Collecting audit messages is disabled.1801lb # [ 1.832946] systemd-journald[73]: Collecting audit messages is disabled.1802worker2 # [ 1.892718] systemd-journald[73]: Collecting audit messages is disabled.1803worker1 # [ 1.834047] systemd[1]: Finished Create List of Static Device Nodes.1804worker1 # [ 1.834977] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1805client # [ 1.859154] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1806worker2 # [ 1.900516] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1807worker1 # [ 1.845806] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1808worker1 # [ 1.846233] systemd[1]: Mounted Kernel Configuration File System.1809worker2 # [ 1.911020] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01810worker2 # [ 1.911262] [drm] features: -virgl +edid -resource_blob -host_visible1811worker2 # [ 1.911272] [drm] features: -context_init1812worker2 # [ 1.911990] [drm] number of scanouts: 11813lb # [ 1.850652] systemd[1]: Starting Coldplug All udev Devices...1814worker2 # [ 1.912009] [drm] number of cap sets: 01815client # [ 1.874410] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1816lb # [ 1.853018] systemd[1]: Finished Create List of Static Device Nodes.1817lb # [ 1.853839] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1818lb # [ 1.854169] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1819lb # [ 1.854396] systemd[1]: Mounted Kernel Configuration File System.1820worker1 # [ 1.861620] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1821client # [ 1.886151] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01822client # [ 1.893014] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1823client # [ 1.895533] systemd[1]: Starting Create Static Device Nodes in /dev...1824lb # [ 1.873167] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1825worker2 # [ 1.928797] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1826worker2 # [ 1.928815] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01827lb # [ 1.875302] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1828client # [ 1.902587] [drm] features: -virgl +edid -resource_blob -host_visible1829client # [ 1.902604] [drm] features: -context_init1830client # [ 1.903365] [drm] number of scanouts: 11831client # [ 1.903384] [drm] number of cap sets: 01832worker1 # [ 1.887862] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1833lb # [ 1.890491] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1834client # [ 1.910618] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1835client # [ 1.910633] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01836worker1 # [ 1.897898] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1837worker2 # [ 1.960127] systemd[1]: Finished Create Static Device Nodes in /dev.1838worker1 # [ 1.900339] systemd[1]: Starting Create Static Device Nodes in /dev...1839worker2 # [ 1.960322] systemd[1]: Reached target Preparation for Local File Systems.1840worker2 # [ 1.960347] systemd[1]: Reached target Local File Systems.1841worker1 # [ 1.904488] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1842lb # [ 1.908470] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01843lb # [ 1.908708] [drm] features: -virgl +edid -resource_blob -host_visible1844lb # [ 1.908717] [drm] features: -context_init1845lb # [ 1.909436] [drm] number of scanouts: 11846lb # [ 1.909456] [drm] number of cap sets: 01847worker2 # [ 1.972894] systemd[1]: Starting Rule-based Manager for Device Events and Files...1848client # [ 1.930689] Console: switching to colour frame buffer device 160x501849worker1 # [ 1.913203] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01850lb # [ 1.918767] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1851lb # [ 1.918789] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01852worker2 # [ 1.985878] Console: switching to colour frame buffer device 160x501853worker1 # [ 1.925498] [drm] features: -virgl +edid -resource_blob -host_visible1854lb # [ 1.924889] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1855worker1 # [ 1.925516] [drm] features: -context_init1856worker2 # [ 1.986566] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1857worker1 # [ 1.926267] [drm] number of scanouts: 11858worker1 # [ 1.926286] [drm] number of cap sets: 01859worker2 # [ 1.993008] systemd[1]: Finished Load Kernel Modules.1860worker2 # [ 1.996095] systemd[1]: Starting Apply Kernel Variables...1861worker1 # [ 1.933565] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1862worker1 # [ 1.933583] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01863lb # [ 1.934920] systemd[1]: Starting Create Static Device Nodes in /dev...1864client # [ 1.963289] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1865client # [ 1.966599] systemd[1]: Finished Create Static Device Nodes in /dev.1866client # [ 1.966964] systemd[1]: Reached target Preparation for Local File Systems.1867client # [ 1.966996] systemd[1]: Reached target Local File Systems.1868worker1 # [ 1.949864] systemd[1]: Finished Create Static Device Nodes in /dev.1869worker1 # [ 1.950206] systemd[1]: Reached target Preparation for Local File Systems.1870client # [ 1.972647] systemd[1]: Starting Rule-based Manager for Device Events and Files...1871worker1 # [ 1.950234] systemd[1]: Reached target Local File Systems.1872worker1 # [ 1.958008] systemd[1]: Starting Rule-based Manager for Device Events and Files...1873client # [ 1.986527] systemd[1]: Finished Load Kernel Modules.1874lb # [ 1.958967] Console: switching to colour frame buffer device 160x501875lb # [ 1.965729] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1876client # [ 1.990637] systemd[1]: Starting Apply Kernel Variables...1877worker1 # [ 1.972226] Console: switching to colour frame buffer device 160x501878worker1 # [ 1.978838] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1879client # [ 2.002496] systemd[1]: Started Journal Service.1880client # [ 1.992298] systemd-modules-load[75]: Inserted module 'dm_mod'1881lb # [ 1.983074] systemd[1]: Finished Create Static Device Nodes in /dev.1882client # [ 1.993519] systemd-modules-load[75]: Module 'virtio_balloon' is built in1883lb # [ 1.983455] systemd[1]: Reached target Preparation for Local File Systems.1884lb # [ 1.983492] systemd[1]: Reached target Local File Systems.1885client # [ 1.996295] systemd-modules-load[75]: Module 'virtio_console' is built in1886lb # [ 1.991731] systemd[1]: Starting Rule-based Manager for Device Events and Files...1887client # [ 2.001349] systemd-modules-load[75]: Inserted module 'virtio_gpu'1888worker2 # [ 2.057196] systemd[1]: Finished Apply Kernel Variables.1889client # [ 2.004341] systemd-modules-load[75]: Module 'virtio_rng' is built in1890client # [ 2.008259] systemd[1]: Starting Create System Files and Directories...1891worker2 # [ 2.049532] systemd-modules-load[74]: Inserted module 'dm_mod'1892worker2 # [ 2.067142] systemd[1]: Started Journal Service.1893lb # [ 2.006675] systemd[1]: Finished Load Kernel Modules.1894worker1 # [ 2.009923] systemd[1]: Finished Load Kernel Modules.1895lb # [ 2.010790] systemd[1]: Starting Apply Kernel Variables...1896worker2 # [ 2.064275] systemd-modules-load[74]: Module 'virtio_balloon' is built in1897worker2 # [ 2.065433] systemd-modules-load[74]: Module 'virtio_console' is built in1898worker2 # [ 2.068268] systemd-modules-load[74]: Inserted module 'virtio_gpu'1899worker2 # [ 2.069272] systemd-modules-load[74]: Module 'virtio_rng' is built in1900worker1 # [ 2.021586] systemd[1]: Starting Apply Kernel Variables...1901lb # [ 2.026316] systemd[1]: Started Journal Service.1902worker2 # [ 2.076594] systemd-udevd[80]: Using default interface naming scheme 'v261'.1903worker2 # [ 2.079687] systemd[1]: Starting Create System Files and Directories...1904worker1 # [ 2.023263] systemd-modules-load[74]: Inserted module 'dm_mod'1905lb # [ 2.028097] systemd-modules-load[75]: Inserted module 'dm_mod'1906worker1 # [ 2.041752] systemd[1]: Started Journal Service.1907client # [ 2.052884] systemd[1]: Finished Apply Kernel Variables.1908worker1 # [ 2.031726] systemd-modules-load[74]: Module 'virtio_balloon' is built in1909lb # [ 2.036459] systemd-modules-load[75]: Module 'virtio_balloon' is built in1910lb # [ 2.037572] systemd-modules-load[75]: Module 'virtio_console' is built in1911lb # [ 2.038643] systemd-modules-load[75]: Inserted module 'virtio_gpu'1912lb # [ 2.039605] systemd-modules-load[75]: Module 'virtio_rng' is built in1913client # [ 2.063063] systemd[1]: Finished Create System Files and Directories.1914lb # [ 2.048451] systemd[1]: Starting Create System Files and Directories...1915client # [ 2.072487] systemd-udevd[80]: Using default interface naming scheme 'v261'.1916worker1 # [ 2.048481] systemd-modules-load[74]: Module 'virtio_console' is built in1917worker1 # [ 2.049690] systemd-modules-load[74]: Inserted module 'virtio_gpu'1918worker1 # [ 2.050683] systemd-modules-load[74]: Module 'virtio_rng' is built in1919lb # [ 2.053527] systemd[1]: Finished Apply Kernel Variables.1920worker2 # [ 2.116871] systemd[1]: Finished Create System Files and Directories.1921worker2 # [ 2.118436] systemd[1]: Started Rule-based Manager for Device Events and Files.1922worker1 # [ 2.067414] systemd[1]: Starting Create System Files and Directories...1923worker1 # [ 2.072674] systemd-udevd[79]: Using default interface naming scheme 'v261'.1924client # [ 2.102099] systemd[1]: Started Rule-based Manager for Device Events and Files.1925worker1 # [ 2.081636] systemd[1]: Finished Apply Kernel Variables.1926worker1 # [ 2.083116] systemd[1]: Finished Create System Files and Directories.1927lb # [ 2.085706] systemd[1]: Finished Create System Files and Directories.1928lb # [ 2.093482] systemd-udevd[80]: Using default interface naming scheme 'v261'.1929worker1 # [ 2.105101] systemd[1]: Started Rule-based Manager for Device Events and Files.1930worker2 # [ 2.180134] systemd[1]: Starting Virtual Console Setup...1931lb # [ 2.121766] systemd[1]: Started Rule-based Manager for Device Events and Files.1932client # [ 2.164030] systemd[1]: Starting Virtual Console Setup...1933worker1 # [ 2.159120] systemd[1]: Starting Virtual Console Setup...1934worker2 # [ 2.224457] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1935worker2 # [ 2.227907] systemd[1]: Finished Virtual Console Setup.1936lb # [ 2.184118] systemd[1]: Starting Virtual Console Setup...1937client # [ 2.208468] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1938client # [ 2.211987] systemd[1]: Finished Virtual Console Setup.1939worker1 # [ 2.204433] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1940worker1 # [ 2.207747] systemd[1]: Finished Virtual Console Setup.1941lb # [ 2.233172] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942lb # [ 2.235808] systemd[1]: Finished Virtual Console Setup.1943worker2 # [ 2.810047] systemd[1]: Finished Coldplug All udev Devices.1944worker2 # [ 2.811064] systemd[1]: Reached target System Initialization.1945worker2 # [ 2.812429] systemd[1]: Reached target Basic System.1946client # [ 2.781438] systemd[1]: Finished Coldplug All udev Devices.1947client # [ 2.782440] systemd[1]: Reached target System Initialization.1948client # [ 2.783775] systemd[1]: Reached target Basic System.1949lb # [ 2.814519] systemd[1]: Finished Coldplug All udev Devices.1950lb # [ 2.820366] systemd[1]: Reached target System Initialization.1951lb # [ 2.821222] systemd[1]: Reached target Basic System.1952worker1 # [ 2.823231] systemd[1]: Finished Coldplug All udev Devices.1953worker1 # [ 2.829420] systemd[1]: Reached target System Initialization.1954worker1 # [ 2.830505] systemd[1]: Reached target Basic System.1955worker2 # [ 2.967176] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1956client # [ 2.940406] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1957worker2 # [ 2.990221] (udev-worker)[107]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958worker2 # [ 2.996263] (udev-worker)[107]: Network interface NamePolicy= disabled on kernel command line.1959lb # [ 2.943238] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1960client # [ 2.968513] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1961client # [ 2.971759] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1962worker1 # [ 2.955732] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1963lb # [ 2.987027] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1964lb # [ 2.992257] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1965worker1 # [ 2.993535] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1966worker1 # [ 2.997973] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1967client # [ 3.025148] systemd[1]: Found device /dev/disk/by-label/nixos.1968client # [ 3.027962] systemd[1]: Reached target Initrd Root Device.1969client # [ 3.031865] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1970worker2 # [ 3.078871] systemd[1]: Found device /dev/disk/by-label/nixos.1971worker2 # [ 3.080139] systemd[1]: Reached target Initrd Root Device.1972worker2 # [ 3.084080] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1973worker1 # [ 3.049847] systemd[1]: Found device /dev/disk/by-label/nixos.1974worker1 # [ 3.051914] systemd[1]: Reached target Initrd Root Device.1975worker1 # [ 3.056093] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1976lb # [ 3.060235] systemd[1]: Found device /dev/disk/by-label/nixos.1977client # [ 3.083765] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1978client # [ 3.088747] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1979lb # [ 3.067768] systemd[1]: Reached target Initrd Root Device.1980worker2 # [ 3.128839] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1981worker2 # [ 3.135781] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1982lb # [ 3.076082] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1983client # [ 3.098334] systemd[1]: Mounting /sysroot...1984worker2 # [ 3.140157] systemd[1]: Mounting /sysroot...1985client # [ 3.143042] EXT4-fs (vda): mounted filesystem 6168434f-bec8-47f8-80c0-e05c73097789 r/w with ordered data mode. Quota mode: none.1986worker1 # [ 3.109837] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1987client # [ 3.134844] systemd[1]: Mounted /sysroot.1988client # [ 3.135558] systemd[1]: Reached target Initrd Root File System.1989client # [ 3.137729] systemd[1]: Starting Mountpoints Configured in the Real Root...1990worker2 # [ 3.191546] EXT4-fs (vda): mounted filesystem 369f14fb-cf66-41d5-a1f8-88258478b815 r/w with ordered data mode. Quota mode: none.1991worker1 # [ 3.115227] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1992worker2 # [ 3.181673] systemd[1]: Mounted /sysroot.1993lb # [ 3.122705] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1994worker2 # [ 3.183813] systemd[1]: Reached target Initrd Root File System.1995worker1 # [ 3.125510] systemd[1]: Mounting /sysroot...1996lb # [ 3.130792] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1997lb # [ 3.132354] systemd[1]: Mounting /sysroot...1998worker2 # [ 3.187557] systemd[1]: Starting Mountpoints Configured in the Real Root...1999client # [ 3.163523] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload.2000client # [ 3.169506] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)...
loading 1,390 hidden lines…
3391lb # [ 15.513619] systemd[1]: Stopped Virtual Console Setup.3392lb # [ 15.518860] systemd[1]: Starting Virtual Console Setup...3393lb # [ 15.714907] postgresql-pre-start[687]: selecting default time zone ... UTC3394lb # [ 15.719597] postgresql-pre-start[687]: creating configuration files ... ok3395lb # [ 15.817147] dhcpcd[660]: eth0: soliciting an IPv6 router3396lb # [ 15.819215] dhcpcd[660]: eth0: Router Advertisement from fe80::23397lb # [ 15.821639] dhcpcd[660]: eth0: adding address fec0::5054:ff:fe12:3456/643398lb # [ 15.824126] dhcpcd[660]: eth0: adding route to fec0::/643399lb # [ 15.828273] dhcpcd[660]: eth0: adding default route via fe80::23400lb # [ 15.954490] systemd-vconsole-setup[789]: Configuration of first virtual console was skipped, ignoring remaining ones.3401lb # [ 15.962622] systemd[1]: Finished Virtual Console Setup.3402lb # [ 16.082103] postgresql-pre-start[687]: running bootstrap script ... ok3403lb # [ 16.695318] postgresql-pre-start[687]: performing post-bootstrap initialization ... ok3404lb # [ 16.846353] postgresql-pre-start[687]: syncing data to disk ... ok3405lb # [ 16.848603] postgresql-pre-start[687]: initdb: warning: enabling "trust" authentication for local connections3406lb # [ 16.850033] postgresql-pre-start[687]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3407lb # [ 16.852305] postgresql-pre-start[687]: Success. You can now start the database server using:3408lb # [ 16.853480] postgresql-pre-start[687]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3409lb # [ 16.979608] postgres[808]: [808] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3410lb # [ 16.983908] postgres[808]: [808] LOG: listening on IPv6 address "::1", port 54323411lb # [ 16.985253] postgres[808]: [808] LOG: listening on IPv4 address "127.0.0.1", port 54323412lb # [ 16.988323] postgres[808]: [808] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3413lb # [ 17.007839] postgres[820]: [820] LOG: database system was shut down at 2026-09-20 10:50:52 GMT3414lb # [ 17.013939] postgres[808]: [808] LOG: database system is ready to accept connections3415lb # [ 17.021434] systemd[1]: Started PostgreSQL Server.3416lb # [ 17.032385] systemd[1]: Starting PostgreSQL Setup Scripts...3417lb # [ 17.296952] postgresql-setup-start[837]: CREATE DATABASE3418lb # [ 17.348893] postgresql-setup-start[842]: CREATE ROLE3419lb # [ 17.375135] postgresql-setup-start[844]: ALTER DATABASE3420lb # [ 17.383020] systemd[1]: Finished PostgreSQL Setup Scripts.3421lb # [ 17.384647] systemd[1]: Reached target PostgreSQL.3422worker2 # [ 18.163119] dhcpcd[642]: eth0: leased 10.0.2.15 for 86400 seconds3423worker2 # [ 18.166612] dhcpcd[642]: eth0: adding route to 10.0.2.0/243424worker2 # [ 18.169999] dhcpcd[642]: eth0: adding default route via 10.0.2.23425worker2 # [ 18.332312] systemd[1]: Started DHCP Client.3426worker2 # [ 18.334472] systemd[1]: Reached target Multi-User System.3427worker2 # [ 18.335470] systemd[1]: Startup finished in 930ms (kernel) + 5.485s (initrd) + 11.918s (userspace) = 18.334s.3428client # [ 19.223715] dhcpcd[541]: eth0: leased 10.0.2.15 for 86400 seconds3429client # [ 19.227082] dhcpcd[541]: eth0: adding route to 10.0.2.0/243430client # [ 19.230245] dhcpcd[541]: eth0: adding default route via 10.0.2.23431client # [ 19.395610] systemd[1]: Started DHCP Client.3432client # [ 19.397966] systemd[1]: Reached target Multi-User System.3433client # [ 19.399162] systemd[1]: Startup finished in 928ms (kernel) + 5.429s (initrd) + 13.040s (userspace) = 19.398s.3434lb # [ 19.750352] dhcpcd[660]: eth0: leased 10.0.2.15 for 86400 seconds3435lb # [ 19.753533] dhcpcd[660]: eth0: adding route to 10.0.2.0/243436lb # [ 19.753701] dhcpcd[660]: eth0: adding default route via 10.0.2.23437lb # [ 19.908647] systemd[1]: Started DHCP Client.3438lb # [ 19.914176] systemd[1]: Reached target Network is Online.3439lb # [ 19.916964] systemd[1]: Started Envoy reverse proxy.3440lb # [ 19.925446] systemd[1]: Started mock-oidc.service.3441lb # [ 20.037642] mock-oidc-server[926]: Mock OIDC Server running3442lb # [ 20.038857] mock-oidc-server[926]: OIDC Address: 192.168.1.2:80803443lb # [ 20.040545] mock-oidc-server[926]: Issue Address: 0.0.0.0:80813444lb # [ 20.041885] mock-oidc-server[926]: Issuer: http://192.168.1.2:8080/oidc3445lb # [ 20.043379] mock-oidc-server[926]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3446lb # [ 20.045498] mock-oidc-server[926]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3447lb # [ 20.047286] mock-oidc-server[926]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3448worker1 # [ 20.089392] dhcpcd[642]: eth0: leased 10.0.2.15 for 86400 seconds3449worker1 # [ 20.093214] dhcpcd[642]: eth0: adding route to 10.0.2.0/243450worker1 # [ 20.095553] dhcpcd[642]: eth0: adding default route via 10.0.2.23451worker1 # [ 20.267840] systemd[1]: Started DHCP Client.3452worker1 # [ 20.270260] systemd[1]: Reached target Multi-User System.3453worker1 # [ 20.271133] systemd[1]: Startup finished in 929ms (kernel) + 5.466s (initrd) + 13.874s (userspace) = 20.269s.3454lb # [ 20.614496] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3455lb # [ 20.616598] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:469] statically linked extensions:3456lb # [ 20.618308] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3457lb # [ 20.620814] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3458lb # [ 20.637971] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3459lb # [ 20.642929] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3460lb # [ 20.646613] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3461lb # [ 20.651446] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3462lb # [ 20.653843] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83463lb # [ 20.655785] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3464lb # [ 20.659089] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3465lb # [ 20.691356] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3466lb # [ 20.694475] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3467lb # [ 20.702682] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3468lb # [ 20.705025] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3469lb # [ 20.707095] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3470lb # [ 20.712063] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3471lb # [ 20.715021] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3472lb # [ 20.718603] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3473lb # [ 20.722686] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3474lb # [ 20.731753] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3475lb # [ 20.734673] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3476lb # [ 20.736732] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3477lb # [ 20.742670] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3478lb # [ 20.744853] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3479lb # [ 20.749742] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3480lb # [ 20.752289] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3481lb # [ 20.755073] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3482lb # [ 20.758188] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3483lb # [ 20.760138] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3484lb # [ 20.762809] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3485lb # [ 20.766104] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3486lb # [ 20.769907] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3487lb # [ 20.777370] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3488lb # [ 20.785625] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3489lb # [ 20.787497] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3490lb # [ 20.793008] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3491lb # [ 20.795446] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3492lb # [ 20.799117] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23493lb # [ 20.801080] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3494lb # [ 20.808630] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3495lb # [ 20.811726] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3496lb # [ 20.814743] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3497lb # [ 20.817341] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3498lb # [ 20.820119] envoy[925]: [2026-09-20 10:50:56.248][925][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3499lb # [ 20.822974] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3500lb # [ 20.825060] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3501lb # [ 20.829914] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3502lb # [ 20.839004] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3503lb # [ 20.841813] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3504lb # [ 20.843745] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3505lb # [ 20.846976] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3506lb # [ 20.849733] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3507lb # [ 20.854280] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3508lb # [ 20.856483] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3509lb # [ 20.858216] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3510lb # [ 20.861947] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3511lb # [ 20.864204] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3512lb # [ 20.866677] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3513lb # [ 20.868737] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3514lb # [ 20.871405] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3515lb # [ 20.876591] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3516lb # [ 20.878559] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3517lb # [ 20.880644] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3518lb # [ 20.885999] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3519lb # [ 20.888817] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3520lb # [ 20.890634] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3521lb # [ 20.892981] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3522lb # [ 20.895604] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3523lb # [ 20.897761] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3524lb # [ 20.899933] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3525lb # [ 20.904401] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3526lb # [ 20.906386] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3527lb # [ 20.908903] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3528lb # [ 20.910724] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3529lb # [ 20.913618] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3530lb # [ 20.919482] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3531lb # [ 20.923486] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3532lb # [ 20.925579] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3533lb # [ 20.929275] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3534lb # [ 20.934428] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3535lb # [ 20.936652] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3536lb # [ 20.938737] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3537lb # [ 20.953454] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23538lb # [ 20.955261] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3539lb # [ 20.958338] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3540lb # [ 20.960889] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3541lb # [ 20.962806] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23542lb # [ 20.965545] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13543lb # [ 20.967809] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3544lb # [ 20.970363] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3545lb # [ 20.973606] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3546lb # [ 20.976563] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3547lb # [ 20.978828] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3548lb # [ 20.981630] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3549lb # [ 20.984815] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3550lb # [ 20.986564] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3551lb # [ 20.990391] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3552lb # [ 20.992715] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3553lb # [ 20.994918] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3554lb # [ 20.997544] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3555lb # [ 21.009076] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3556lb # [ 21.010878] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3557lb # [ 21.013827] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3558lb # [ 21.015876] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3559lb # [ 21.018108] envoy[925]: [2026-09-20 10:50:56.249][925][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3560lb # [ 21.020269] envoy[925]: [2026-09-20 10:50:56.270][925][info][main] [source/server/server.cc:531] HTTP header map info:3561lb # [ 21.021905] envoy[925]: [2026-09-20 10:50:56.272][925][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3562lb # [ 21.038121] envoy[925]: [2026-09-20 10:50:56.272][925][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3563lb # [ 21.039954] envoy[925]: [2026-09-20 10:50:56.272][925][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3564lb # [ 21.049576] envoy[925]: [2026-09-20 10:50:56.272][925][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3565lb # [ 21.051628] envoy[925]: [2026-09-20 10:50:56.521][925][info][main] [source/server/server.cc:968] runtime: {}3566lb # [ 21.053401] envoy[925]: [2026-09-20 10:50:56.539][925][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3567lb # [ 21.055241] envoy[925]: [2026-09-20 10:50:56.539][925][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013568lb # [ 21.057326] envoy[925]: [2026-09-20 10:50:56.539][925][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013569lb # [ 21.058953] envoy[925]: [2026-09-20 10:50:56.548][925][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3570lb # [ 21.060908] envoy[925]: [2026-09-20 10:50:56.548][925][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3571lb # [ 21.062663] envoy[925]: [2026-09-20 10:50:56.548][925][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3572lb # [ 21.085196] envoy[925]: [2026-09-20 10:50:56.719][925][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3573lb # [ 21.095091] envoy[925]: [2026-09-20 10:50:56.730][925][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3574worker1 # [ 21.092530] systemd[1]: Starting Nix worker-protocol over gRPC...3575lb # [ 21.098008] envoy[925]: [2026-09-20 10:50:56.733][925][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3576lb # [ 21.101493] envoy[925]: [2026-09-20 10:50:56.733][925][info][main] [source/server/server.cc:1077] starting main dispatch loop3577worker2 # [ 21.160755] systemd[1]: Starting Nix worker-protocol over gRPC...3578worker1 # [ 21.351072] nix-grpc-daemon[772]: ts=2026-09-20T10:50:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3579worker2 # [ 21.413638] nix-grpc-daemon[773]: ts=2026-09-20T10:50:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3580worker2 # [ 21.425456] nix-grpc-daemon[773]: ts=2026-09-20T10:50:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13581worker1 # [ 21.363163] nix-grpc-daemon[772]: ts=2026-09-20T10:50:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13582worker1 # [ 21.407996] nix-grpc-daemon[772]: ts=2026-09-20T10:50:57Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3583worker2 # [ 21.470650] nix-grpc-daemon[773]: ts=2026-09-20T10:50:56Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3584worker2 # [ 21.476947] systemd[1]: Started Nix worker-protocol over gRPC.3585worker1 # [ 21.415767] systemd[1]: Started Nix worker-protocol over gRPC.3586lb # [ 21.458592] envoy[925]: [2026-09-20 10:50:57.092][925][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3587lb # [ 21.477243] envoy[925]: [2026-09-20 10:50:57.092][925][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3588lb # [ 21.489661] envoy[925]: [2026-09-20 10:50:57.093][925][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3589lb # [ 21.504436] envoy[925]: [2026-09-20 10:50:57.093][925][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3590worker1 # [ 21.509447] nix-grpc-daemon[772]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500513591worker2 # [ 21.571661] nix-grpc-daemon[773]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500513592worker2 # [ 21.580812] nix-grpc-daemon[773]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3593worker1 # [ 21.520310] nix-grpc-daemon[772]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3594worker2 # [ 21.782437] nix-grpc-daemon[773]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500513595worker1 # [ 21.722455] nix-grpc-daemon[772]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500513596worker2 # [ 21.788545] nix-grpc-daemon[773]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3597worker1 # [ 21.727880] nix-grpc-daemon[772]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3598worker1 # [ 21.924541] nix-grpc-daemon[772]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500513599worker2 # [ 21.989381] nix-grpc-daemon[773]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500513600worker1 # [ 21.928192] nix-grpc-daemon[772]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3601worker2 # [ 21.994017] nix-grpc-daemon[773]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3602worker1 # [ 22.129503] nix-grpc-daemon[772]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500513603worker2 # [ 22.197184] nix-grpc-daemon[773]: ts=2026-09-20T10:50:56Z level=info event=scheduler_connected addr=lb:500513604worker1 # [ 22.135346] nix-grpc-daemon[772]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3605worker2 # [ 22.201962] nix-grpc-daemon[773]: ts=2026-09-20T10:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3606worker2 # [ 22.398556] nix-grpc-daemon[773]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500513607worker1 # [ 22.336609] nix-grpc-daemon[772]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500513608worker1 # [ 22.342290] nix-grpc-daemon[772]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3609worker2 # [ 22.404765] nix-grpc-daemon[773]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3610worker2 # [ 22.606522] nix-grpc-daemon[773]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500513611worker1 # [ 22.546374] nix-grpc-daemon[772]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500513612worker2 # [ 22.610654] nix-grpc-daemon[773]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3613worker1 # [ 22.556694] nix-grpc-daemon[772]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3614worker2 # [ 22.811532] nix-grpc-daemon[773]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500513615worker1 # [ 22.747581] nix-grpc-daemon[772]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 22.814732] nix-grpc-daemon[773]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3617worker1 # [ 22.753690] nix-grpc-daemon[772]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3618worker2 # [ 23.016611] nix-grpc-daemon[773]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500513619worker1 # [ 22.955068] nix-grpc-daemon[772]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500513620worker2 # [ 23.022480] nix-grpc-daemon[773]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3621worker1 # [ 22.961652] nix-grpc-daemon[772]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3622worker2 # [ 23.223772] nix-grpc-daemon[773]: ts=2026-09-20T10:50:57Z level=info event=scheduler_connected addr=lb:500513623worker1 # [ 23.163043] nix-grpc-daemon[772]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500513624worker2 # [ 23.230018] nix-grpc-daemon[773]: ts=2026-09-20T10:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3625worker1 # [ 23.169582] nix-grpc-daemon[772]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3626worker2 # [ 23.431624] nix-grpc-daemon[773]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500513627worker1 # [ 23.371234] nix-grpc-daemon[772]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 23.437537] nix-grpc-daemon[773]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3629worker1 # [ 23.377525] nix-grpc-daemon[772]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3630worker2 # [ 23.641420] nix-grpc-daemon[773]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500513631worker1 # [ 23.580992] nix-grpc-daemon[772]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500513632worker2 # [ 23.645952] nix-grpc-daemon[773]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3633worker1 # [ 23.585404] nix-grpc-daemon[772]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3634worker2 # [ 23.842177] nix-grpc-daemon[773]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500513635worker1 # [ 23.781802] nix-grpc-daemon[772]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 23.849769] nix-grpc-daemon[773]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3637worker1 # [ 23.788615] nix-grpc-daemon[772]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3638worker2 # [ 24.051197] nix-grpc-daemon[773]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500513639worker1 # [ 23.989723] nix-grpc-daemon[772]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 24.057034] nix-grpc-daemon[773]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3641worker1 # [ 23.995717] nix-grpc-daemon[772]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3642worker2 # [ 24.258711] nix-grpc-daemon[773]: ts=2026-09-20T10:50:58Z level=info event=scheduler_connected addr=lb:500513643worker1 # [ 24.197044] nix-grpc-daemon[772]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 24.264709] nix-grpc-daemon[773]: ts=2026-09-20T10:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3645worker1 # [ 24.202479] nix-grpc-daemon[772]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3646worker1 # [ 24.399713] nix-grpc-daemon[772]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500513647worker2 # [ 24.465831] nix-grpc-daemon[773]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500513648worker1 # [ 24.405564] nix-grpc-daemon[772]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3649worker2 # [ 24.471548] nix-grpc-daemon[773]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3650worker1 # [ 24.609141] nix-grpc-daemon[772]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500513651worker2 # [ 24.676143] nix-grpc-daemon[773]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500513652worker1 # [ 24.613904] nix-grpc-daemon[772]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3653worker2 # [ 24.680570] nix-grpc-daemon[773]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3654worker1 # [ 24.810265] nix-grpc-daemon[772]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500513655worker2 # [ 24.876270] nix-grpc-daemon[773]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500513656worker1 # [ 24.816264] nix-grpc-daemon[772]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3657worker2 # [ 24.882215] nix-grpc-daemon[773]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3658worker1 # [ 25.017510] nix-grpc-daemon[772]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500513659worker2 # [ 25.083881] nix-grpc-daemon[773]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500513660worker1 # [ 25.023614] nix-grpc-daemon[772]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3661worker2 # [ 25.089503] nix-grpc-daemon[773]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3662worker2 # [ 25.286941] nix-grpc-daemon[773]: ts=2026-09-20T10:50:59Z level=info event=scheduler_connected addr=lb:500513663worker1 # [ 25.224991] nix-grpc-daemon[772]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500513664worker1 # [ 25.231010] nix-grpc-daemon[772]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3665worker2 # [ 25.293364] nix-grpc-daemon[773]: ts=2026-09-20T10:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3666worker1 # [ 25.432048] nix-grpc-daemon[772]: ts=2026-09-20T10:51:01Z level=info event=scheduler_connected addr=lb:500513667worker2 # [ 25.494743] nix-grpc-daemon[773]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500513668worker1 # [ 25.437687] nix-grpc-daemon[772]: ts=2026-09-20T10:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3669worker2 # [ 25.501111] nix-grpc-daemon[773]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3670worker1 # [ 25.641104] nix-grpc-daemon[772]: ts=2026-09-20T10:51:01Z level=info event=scheduler_connected addr=lb:500513671worker2 # [ 25.704596] nix-grpc-daemon[773]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500513672worker1 # [ 25.646216] nix-grpc-daemon[772]: ts=2026-09-20T10:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3673worker2 # [ 25.708891] nix-grpc-daemon[773]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3674worker2 # [ 25.905333] nix-grpc-daemon[773]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500513675worker1 # [ 25.847803] nix-grpc-daemon[772]: ts=2026-09-20T10:51:01Z level=info event=scheduler_connected addr=lb:500513676worker2 # [ 25.915506] nix-grpc-daemon[773]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3677worker1 # [ 25.856472] nix-grpc-daemon[772]: ts=2026-09-20T10:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3678worker2 # [ 26.112943] nix-grpc-daemon[773]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500513679worker1 # [ 26.051192] nix-grpc-daemon[772]: ts=2026-09-20T10:51:01Z level=info event=scheduler_connected addr=lb:500513680worker2 # [ 26.118727] nix-grpc-daemon[773]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3681worker1 # [ 26.057348] nix-grpc-daemon[772]: ts=2026-09-20T10:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3682worker2 # [ 26.320177] nix-grpc-daemon[773]: ts=2026-09-20T10:51:00Z level=info event=scheduler_connected addr=lb:500513683worker1 # [ 26.259089] nix-grpc-daemon[772]: ts=2026-09-20T10:51:01Z level=info event=scheduler_connected addr=lb:500513684worker2 # [ 26.325940] nix-grpc-daemon[773]: ts=2026-09-20T10:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3685worker1 # [ 26.265278] nix-grpc-daemon[772]: ts=2026-09-20T10:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3686worker2 # [ 26.527234] nix-grpc-daemon[773]: ts=2026-09-20T10:51:01Z level=info event=scheduler_connected addr=lb:500513687worker1 # [ 26.466062] nix-grpc-daemon[772]: ts=2026-09-20T10:51:02Z level=info event=scheduler_connected addr=lb:500513688worker2 # [ 26.533187] nix-grpc-daemon[773]: ts=2026-09-20T10:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3689worker1 # [ 26.472206] nix-grpc-daemon[772]: ts=2026-09-20T10:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3690worker2 # [ 26.736567] nix-grpc-daemon[773]: ts=2026-09-20T10:51:01Z level=info event=scheduler_connected addr=lb:500513691worker1 # [ 26.674723] nix-grpc-daemon[772]: ts=2026-09-20T10:51:02Z level=info event=scheduler_connected addr=lb:500513692worker2 # [ 26.742006] nix-grpc-daemon[773]: ts=2026-09-20T10:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3693worker1 # [ 26.680471] nix-grpc-daemon[772]: ts=2026-09-20T10:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3694worker2 # [ 26.943265] nix-grpc-daemon[773]: ts=2026-09-20T10:51:01Z level=info event=scheduler_connected addr=lb:500513695worker1 # [ 26.881759] nix-grpc-daemon[772]: ts=2026-09-20T10:51:02Z level=info event=scheduler_connected addr=lb:500513696worker2 # [ 26.949385] nix-grpc-daemon[773]: ts=2026-09-20T10:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3697worker1 # [ 26.887488] nix-grpc-daemon[772]: ts=2026-09-20T10:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3698worker2 # [ 27.150425] nix-grpc-daemon[773]: ts=2026-09-20T10:51:01Z level=info event=scheduler_connected addr=lb:500513699worker1 # [ 27.088973] nix-grpc-daemon[772]: ts=2026-09-20T10:51:02Z level=info event=scheduler_connected addr=lb:500513700worker2 # [ 27.156439] nix-grpc-daemon[773]: ts=2026-09-20T10:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3701worker1 # [ 27.095011] nix-grpc-daemon[772]: ts=2026-09-20T10:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3702worker2 # [ 27.357752] nix-grpc-daemon[773]: ts=2026-09-20T10:51:01Z level=info event=scheduler_connected addr=lb:500513703worker1 # [ 27.296410] nix-grpc-daemon[772]: ts=2026-09-20T10:51:02Z level=info event=scheduler_connected addr=lb:500513704worker2 # [ 27.363660] nix-grpc-daemon[773]: ts=2026-09-20T10:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3705worker1 # [ 27.302414] nix-grpc-daemon[772]: ts=2026-09-20T10:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3706worker2 # [ 27.564431] nix-grpc-daemon[773]: ts=2026-09-20T10:51:02Z level=info event=scheduler_connected addr=lb:500513707worker1 # [ 27.503622] nix-grpc-daemon[772]: ts=2026-09-20T10:51:03Z level=info event=scheduler_connected addr=lb:500513708worker2 # [ 27.570354] nix-grpc-daemon[773]: ts=2026-09-20T10:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3709worker1 # [ 27.509439] nix-grpc-daemon[772]: ts=2026-09-20T10:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3710worker2 # [ 27.773584] nix-grpc-daemon[773]: ts=2026-09-20T10:51:02Z level=info event=scheduler_connected addr=lb:500513711worker1 # [ 27.713070] nix-grpc-daemon[772]: ts=2026-09-20T10:51:03Z level=info event=scheduler_connected addr=lb:500513712worker1 # [ 27.717569] nix-grpc-daemon[772]: ts=2026-09-20T10:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3713worker2 # [ 27.779887] nix-grpc-daemon[773]: ts=2026-09-20T10:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3714worker1 # [ 27.914594] nix-grpc-daemon[772]: ts=2026-09-20T10:51:03Z level=info event=scheduler_connected addr=lb:500513715worker2 # [ 27.981089] nix-grpc-daemon[773]: ts=2026-09-20T10:51:02Z level=info event=scheduler_connected addr=lb:500513716worker1 # [ 27.920630] nix-grpc-daemon[772]: ts=2026-09-20T10:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3717worker2 # [ 27.986881] nix-grpc-daemon[773]: ts=2026-09-20T10:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3718worker1 # [ 28.121908] nix-grpc-daemon[772]: ts=2026-09-20T10:51:03Z level=info event=scheduler_connected addr=lb:500513719worker2 # [ 28.188362] nix-grpc-daemon[773]: ts=2026-09-20T10:51:02Z level=info event=scheduler_connected addr=lb:500513720worker1 # [ 28.127633] nix-grpc-daemon[772]: ts=2026-09-20T10:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3721worker2 # [ 28.193876] nix-grpc-daemon[773]: ts=2026-09-20T10:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3722worker1 # [ 28.330311] nix-grpc-daemon[772]: ts=2026-09-20T10:51:03Z level=info event=scheduler_connected addr=lb:500513723worker2 # [ 28.394978] nix-grpc-daemon[773]: ts=2026-09-20T10:51:03Z level=info event=scheduler_connected addr=lb:500513724worker1 # [ 28.336488] nix-grpc-daemon[772]: ts=2026-09-20T10:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3725worker2 # [ 28.400945] nix-grpc-daemon[773]: ts=2026-09-20T10:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3726worker1 # [ 28.533027] nix-grpc-daemon[772]: ts=2026-09-20T10:51:04Z level=info event=scheduler_connected addr=lb:500513727worker2 # [ 28.601797] nix-grpc-daemon[773]: ts=2026-09-20T10:51:03Z level=info event=scheduler_connected addr=lb:500513728worker1 # [ 28.538857] nix-grpc-daemon[772]: ts=2026-09-20T10:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3729worker2 # [ 28.607391] nix-grpc-daemon[773]: ts=2026-09-20T10:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3730worker1 # [ 28.742626] nix-grpc-daemon[772]: ts=2026-09-20T10:51:04Z level=info event=scheduler_connected addr=lb:500513731worker1 # [ 28.747329] nix-grpc-daemon[772]: ts=2026-09-20T10:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3732worker2 # [ 28.811192] nix-grpc-daemon[773]: ts=2026-09-20T10:51:03Z level=info event=scheduler_connected addr=lb:500513733worker2 # [ 28.815648] nix-grpc-daemon[773]: ts=2026-09-20T10:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3734worker1 # [ 28.943959] nix-grpc-daemon[772]: ts=2026-09-20T10:51:04Z level=info event=scheduler_connected addr=lb:500513735worker2 # [ 29.011669] nix-grpc-daemon[773]: ts=2026-09-20T10:51:03Z level=info event=scheduler_connected addr=lb:500513736worker1 # [ 28.949934] nix-grpc-daemon[772]: ts=2026-09-20T10:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3737worker2 # [ 29.017285] nix-grpc-daemon[773]: ts=2026-09-20T10:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3738worker1 # [ 29.151700] nix-grpc-daemon[772]: ts=2026-09-20T10:51:04Z level=info event=scheduler_connected addr=lb:500513739worker2 # [ 29.218633] nix-grpc-daemon[773]: ts=2026-09-20T10:51:03Z level=info event=scheduler_connected addr=lb:500513740worker1 # [ 29.160781] nix-grpc-daemon[772]: ts=2026-09-20T10:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3741worker2 # [ 29.225290] nix-grpc-daemon[773]: ts=2026-09-20T10:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3742worker2 # [ 29.421290] nix-grpc-daemon[773]: ts=2026-09-20T10:51:04Z level=info event=scheduler_connected addr=lb:500513743worker1 # [ 29.361714] nix-grpc-daemon[772]: ts=2026-09-20T10:51:05Z level=info event=scheduler_connected addr=lb:500513744worker2 # [ 29.427232] nix-grpc-daemon[773]: ts=2026-09-20T10:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3745worker1 # [ 29.367605] nix-grpc-daemon[772]: ts=2026-09-20T10:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3746worker2 # [ 29.628157] nix-grpc-daemon[773]: ts=2026-09-20T10:51:04Z level=info event=scheduler_connected addr=lb:500513747worker1 # [ 29.568774] nix-grpc-daemon[772]: ts=2026-09-20T10:51:05Z level=info event=scheduler_connected addr=lb:500513748worker2 # [ 29.633761] nix-grpc-daemon[773]: ts=2026-09-20T10:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3749worker1 # [ 29.574042] nix-grpc-daemon[772]: ts=2026-09-20T10:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3750worker1 # [ 29.773310] nix-grpc-daemon[772]: ts=2026-09-20T10:51:05Z level=info event=scheduler_connected addr=lb:500513751worker2 # [ 29.837739] nix-grpc-daemon[773]: ts=2026-09-20T10:51:04Z level=info event=scheduler_connected addr=lb:500513752worker1 # [ 29.778388] nix-grpc-daemon[772]: ts=2026-09-20T10:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3753worker2 # [ 29.842079] nix-grpc-daemon[773]: ts=2026-09-20T10:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3754worker2 # [ 30.038085] nix-grpc-daemon[773]: ts=2026-09-20T10:51:04Z level=info event=scheduler_connected addr=lb:500513755worker1 # [ 29.979627] nix-grpc-daemon[772]: ts=2026-09-20T10:51:05Z level=info event=scheduler_connected addr=lb:500513756worker2 # [ 30.044500] nix-grpc-daemon[773]: ts=2026-09-20T10:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3757worker1 # [ 29.985606] nix-grpc-daemon[772]: ts=2026-09-20T10:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3758worker2 # [ 30.245425] nix-grpc-daemon[773]: ts=2026-09-20T10:51:04Z level=info event=scheduler_connected addr=lb:500513759worker1 # [ 30.186692] nix-grpc-daemon[772]: ts=2026-09-20T10:51:05Z level=info event=scheduler_connected addr=lb:500513760worker2 # [ 30.251544] nix-grpc-daemon[773]: ts=2026-09-20T10:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3761worker1 # [ 30.192684] nix-grpc-daemon[772]: ts=2026-09-20T10:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3762worker2 # [ 30.452731] nix-grpc-daemon[773]: ts=2026-09-20T10:51:05Z level=info event=scheduler_connected addr=lb:500513763worker1 # [ 30.395026] nix-grpc-daemon[772]: ts=2026-09-20T10:51:06Z level=info event=scheduler_connected addr=lb:500513764worker2 # [ 30.458518] nix-grpc-daemon[773]: ts=2026-09-20T10:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3765worker1 # [ 30.399735] nix-grpc-daemon[772]: ts=2026-09-20T10:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3766worker1 # [ 30.596492] nix-grpc-daemon[772]: ts=2026-09-20T10:51:06Z level=info event=scheduler_connected addr=lb:500513767worker2 # [ 30.659535] nix-grpc-daemon[773]: ts=2026-09-20T10:51:05Z level=info event=scheduler_connected addr=lb:500513768worker1 # [ 30.602485] nix-grpc-daemon[772]: ts=2026-09-20T10:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3769worker2 # [ 30.665617] nix-grpc-daemon[773]: ts=2026-09-20T10:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3770worker1 # [ 30.807324] nix-grpc-daemon[772]: ts=2026-09-20T10:51:06Z level=info event=scheduler_connected addr=lb:500513771worker2 # [ 30.869899] nix-grpc-daemon[773]: ts=2026-09-20T10:51:05Z level=info event=scheduler_connected addr=lb:500513772worker1 # [ 30.812067] nix-grpc-daemon[772]: ts=2026-09-20T10:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3773worker2 # [ 30.874375] nix-grpc-daemon[773]: ts=2026-09-20T10:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3774worker1 # [ 31.008849] nix-grpc-daemon[772]: ts=2026-09-20T10:51:06Z level=info event=scheduler_connected addr=lb:500513775worker2 # [ 31.071376] nix-grpc-daemon[773]: ts=2026-09-20T10:51:05Z level=info event=scheduler_connected addr=lb:500513776worker1 # [ 31.014849] nix-grpc-daemon[772]: ts=2026-09-20T10:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3777worker2 # [ 31.077409] nix-grpc-daemon[773]: ts=2026-09-20T10:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3778worker2 # [ 31.278361] nix-grpc-daemon[773]: ts=2026-09-20T10:51:05Z level=info event=scheduler_connected addr=lb:500513779worker1 # [ 31.216036] nix-grpc-daemon[772]: ts=2026-09-20T10:51:06Z level=info event=scheduler_connected addr=lb:500513780worker2 # [ 31.284399] nix-grpc-daemon[773]: ts=2026-09-20T10:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3781worker1 # [ 31.222167] nix-grpc-daemon[772]: ts=2026-09-20T10:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3782worker2 # [ 31.485813] nix-grpc-daemon[773]: ts=2026-09-20T10:51:06Z level=info event=scheduler_connected addr=lb:500513783worker1 # [ 31.423748] nix-grpc-daemon[772]: ts=2026-09-20T10:51:07Z level=info event=scheduler_connected addr=lb:500513784worker2 # [ 31.492339] nix-grpc-daemon[773]: ts=2026-09-20T10:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3785worker1 # [ 31.430298] nix-grpc-daemon[772]: ts=2026-09-20T10:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3786lb # [ 31.618085] rustfs-bucket-start[1035]: mb s3://farm3787lb # [ 31.630529] systemd[1]: Finished rustfs-bucket.service.3788worker2 # [ 31.693332] nix-grpc-daemon[773]: ts=2026-09-20T10:51:06Z level=info event=scheduler_connected addr=lb:500513789worker1 # [ 31.632551] nix-grpc-daemon[772]: ts=2026-09-20T10:51:07Z level=info event=scheduler_connected addr=lb:500513790worker1 # [ 31.637083] nix-grpc-daemon[772]: ts=2026-09-20T10:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3791worker2 # [ 31.699212] nix-grpc-daemon[773]: ts=2026-09-20T10:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3792lb # [ 31.649216] systemd[1]: Starting niks3 server...3793worker1 # [ 31.836567] nix-grpc-daemon[772]: ts=2026-09-20T10:51:07Z level=info event=scheduler_connected addr=lb:500513794worker2 # [ 31.903424] nix-grpc-daemon[773]: ts=2026-09-20T10:51:06Z level=info event=scheduler_connected addr=lb:500513795worker1 # [ 31.842274] nix-grpc-daemon[772]: ts=2026-09-20T10:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3796worker2 # [ 31.908277] nix-grpc-daemon[773]: ts=2026-09-20T10:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3797lb # [ 31.919770] postgres[1055]: [1055] ERROR: relation "goose_db_version" does not exist at character 363798lb # [ 31.922817] postgres[1055]: [1055] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3799lb # [ 31.959637] niks3-server[1044]: 2026/09/20 10:51:07 OK 20241026095416_initial_model.sql (20.7ms)3800lb # [ 31.963633] niks3-server[1044]: 2026/09/20 10:51:07 OK 20251210153512_drop_unused_gin_index.sql (2.27ms)3801lb # [ 31.970080] niks3-server[1044]: 2026/09/20 10:51:07 OK 20251218171726_add_pins.sql (4.75ms)3802lb # [ 31.975507] niks3-server[1044]: 2026/09/20 10:51:07 OK 20260628120000_add_object_size_and_stats.sql (5.45ms)3803lb # [ 31.981014] niks3-server[1044]: 2026/09/20 10:51:07 OK 20260905000000_add_claims.sql (3.93ms)3804lb # [ 31.986214] niks3-server[1044]: 2026/09/20 10:51:07 OK 20260920000000_drop_claims.sql (5.08ms)3805lb # [ 31.987554] niks3-server[1044]: 2026/09/20 10:51:07 goose: successfully migrated database to version: 202609200000003806lb # [ 31.993533] niks3-server[1044]: 2026/09/20 10:51:07 OK 1_commit_pending_closure.sql (7.29ms)3807lb # [ 31.996471] niks3-server[1044]: 2026/09/20 10:51:07 OK 2_object_stats_trigger.sql (2.78ms)3808lb # [ 31.997941] niks3-server[1044]: 2026/09/20 10:51:07 goose: up to current file version: 23809lb # [ 32.002517] niks3-server[1044]: 2026/09/20 10:51:07 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3810worker1 # [ 32.038348] nix-grpc-daemon[772]: ts=2026-09-20T10:51:07Z level=info event=scheduler_connected addr=lb:500513811worker2 # [ 32.104532] nix-grpc-daemon[773]: ts=2026-09-20T10:51:06Z level=info event=scheduler_connected addr=lb:500513812worker1 # [ 32.044256] nix-grpc-daemon[772]: ts=2026-09-20T10:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3813lb # [ 32.053132] niks3-server[1044]: 2026/09/20 10:51:07 INFO Read proxy enabled — serving cache objects from S33814worker2 # [ 32.110312] nix-grpc-daemon[773]: ts=2026-09-20T10:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3815lb # [ 32.054597] niks3-server[1044]: 2026/09/20 10:51:07 INFO Using socket-activated listener address=0.0.0.0:57513816lb # [ 32.057575] niks3-server[1044]: 2026/09/20 10:51:07 INFO systemd watchdog enabled interval=15s3817lb # [ 32.065826] niks3-server[1044]: 2026/09/20 10:51:07 INFO Starting HTTP server address=0.0.0.0:57513818lb # [ 32.067145] systemd[1]: Started niks3 server.3819lb # [ 32.072117] systemd[1]: Reached target Multi-User System.3820lb # [ 32.074393] niks3-server[1044]: 2026/09/20 10:51:07 INFO lead: acquired remote=192.168.1.3:467863821lb # [ 32.077316] systemd[1]: Startup finished in 936ms (kernel) + 4.683s (initrd) + 26.443s (userspace) = 32.063s.3822worker1 # [ 32.073101] nix-grpc-daemon[772]: ts=2026-09-20T10:51:07Z level=info event=scheduler_take_over3823worker1 # [ 32.245751] nix-grpc-daemon[772]: ts=2026-09-20T10:51:07Z level=info event=scheduler_connected addr=lb:500513824worker2 # [ 32.311851] nix-grpc-daemon[773]: ts=2026-09-20T10:51:06Z level=info event=scheduler_connected addr=lb:500513825worker1 # [ 32.252590] nix-grpc-daemon[772]: ts=2026-09-20T10:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3826worker2 # [ 32.318057] nix-grpc-daemon[773]: ts=2026-09-20T10:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3827worker1 # [ 32.453441] nix-grpc-daemon[772]: ts=2026-09-20T10:51:08Z level=info event=scheduler_connected addr=lb:500513828worker2 # [ 32.520760] nix-grpc-daemon[773]: ts=2026-09-20T10:51:07Z level=info event=scheduler_connected addr=lb:500513829worker1 # [ 32.459380] nix-grpc-daemon[772]: ts=2026-09-20T10:51:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3830worker2 # [ 32.533879] nix-grpc-daemon[773]: ts=2026-09-20T10:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3831worker1 # [ 32.660104] nix-grpc-daemon[772]: ts=2026-09-20T10:51:08Z level=info event=scheduler_connected addr=lb:500513832worker2 # [ 32.722242] nix-grpc-daemon[773]: ts=2026-09-20T10:51:07Z level=info event=scheduler_connected addr=lb:500513833worker1 # [ 32.681786] nix-grpc-daemon[772]: ts=2026-09-20T10:51:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03834worker1 # [ 32.686358] nix-grpc-daemon[772]: ts=2026-09-20T10:51:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03835lb: (finished: waiting for unit niks3.service, in 18.29 seconds)3836lb: waiting for TCP port 5751 on localhost3837lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3838lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds)3839lb: waiting for unit envoy.service3840lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3841lb: waiting for TCP port 50051 on localhost3842lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3843lb # [ 33.153312] envoy[925]: conn peer=[::1]:36936 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33844lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3845lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3846??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3847 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283848lb: must succeed: curl -sf localhost:9901/clusters3849lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3850lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)3851subtest: one node schedules and both builders hold a WorkerSession on it3852lb: must succeed: curl -sf localhost:9901/clusters3853lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3854worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics3855worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.11 seconds)3856(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.17 seconds)3857subtest: balancer auth: client cert, bearer token, nothing, unknown CN3858worker2 # [ 34.133437] nix-grpc-daemon[773]: ts=2026-09-20T10:51:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:488963859worker2 # [ 34.151472] systemd[1]: Started Nix Daemon.3860worker2 # [ 34.540626] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3861worker2 # [ 34.591644] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 1/5)3862worker2 # [ 34.627814] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 112 ms (attempt 2/5)3863worker2 # [ 34.748103] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 259 ms (attempt 3/5)3864worker2 # [ 35.015098] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 697 ms (attempt 4/5)3865worker2 # [ 35.725954] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3866worker1 # [ 35.711591] nix-grpc-daemon[772]: ts=2026-09-20T10:51:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:346763867worker1 # [ 35.730656] systemd[1]: Started Nix Daemon.3868worker1 # [ 36.101308] nix-daemon[833]: accepted connection from pid 772, user nix-grpc-daemon (trusted)3869worker1 # [ 36.130129] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5)3870worker1 # [ 36.133687] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5)3871worker1 # [ 36.218894] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 3/5)3872worker1 # [ 36.282698] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 388 ms (attempt 4/5)3873worker1 # [ 36.680887] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3874worker1 # [ 36.696121] nix-grpc-daemon[772]: ts=2026-09-20T10:51:12Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3875worker2 # [ 36.786395] nix-grpc-daemon[773]: ts=2026-09-20T10:51:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:488963876worker2 # [ 36.800255] nix-grpc-daemon[773]: ts=2026-09-20T10:51:11Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3877client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3878client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds)3879client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3880client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3881worker2 # [ 37.263214] nix-grpc-daemon[773]: ts=2026-09-20T10:51:11Z level=info event=oidc_jwks provider=mock keys=13882worker2 # [ 37.269042] nix-grpc-daemon[773]: ts=2026-09-20T10:51:11Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:488963883worker1 # [ 37.233665] nix-grpc-daemon[772]: ts=2026-09-20T10:51:12Z level=info event=oidc_jwks provider=mock keys=13884worker1 # [ 37.238542] nix-grpc-daemon[772]: ts=2026-09-20T10:51:12Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:346763885worker1 # [ 37.247432] nix-grpc-daemon[772]: ts=2026-09-20T10:51:12Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3886worker1 # [ 37.262778] nix-grpc-daemon[772]: ts=2026-09-20T10:51:12Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:346763887worker1 # [ 37.271270] nix-grpc-daemon[772]: ts=2026-09-20T10:51:12Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3888client: must succeed: rm -r /var/lib/nix-grpc-store3889client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds)3890worker2 # [ 37.639471] nix-grpc-daemon[773]: ts=2026-09-20T10:51:12Z level=info event=denied method=QueryMissing cn=- role=none3891worker2 # [ 37.886093] nix-grpc-daemon[773]: ts=2026-09-20T10:51:12Z level=info event=denied method=QueryMissing cn=stranger role=none3892(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.22 seconds)3893subtest: DAG build is scheduled across workers and lands in the cache3894client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23895worker1 # [ 38.066862] nix-grpc-daemon[772]: ts=2026-09-20T10:51:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346763896client # don't know how to build these paths:3897client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3898worker1 # [ 38.082766] nix-grpc-daemon[772]: ts=2026-09-20T10:51:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346763899worker1 # [ 38.121859] nix-grpc-daemon[772]: ts=2026-09-20T10:51:13Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03900worker1 # [ 38.128097] nix-grpc-daemon[772]: ts=2026-09-20T10:51:13Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=13901worker2 # [ 38.242164] nix-grpc-daemon[773]: ts=2026-09-20T10:51:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488963902worker2 # [ 38.263571] nix-grpc-daemon[773]: ts=2026-09-20T10:51:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488963903client # copying 1 paths to 'lb:50051'...3904worker2 # [ 38.282041] nix-grpc-daemon[773]: ts=2026-09-20T10:51:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488963905client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3906worker2 # [ 38.313269] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3907worker2 # [ 38.348674] nix-grpc-daemon[773]: ts=2026-09-20T10:51:12Z level=info event=niks3_push_started pid=8413908worker2 # [ 38.825210] nix-daemon[831]: accepted connection from pid 854, user nix-grpc-daemon (trusted)3909worker2 # [ 38.844151] nix-daemon[831]: reaped child process 857, status = succeeded3910worker2 # [ 39.023132] nix-daemon[831]: accepted connection from pid 859, user nix-grpc-daemon (trusted)3911worker2 # [ 39.040479] nix-daemon[831]: reaped child process 862, status = succeeded3912lb # [ 38.993549] niks3-server[1044]: 2026/09/20 10:51:14 INFO Received uploads request method=POST path=/api/pending_closures3913worker2 # [ 39.081241] nix-grpc-daemon[841]: time=2026-09-20T10:51:13.718Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3914worker2 # [ 39.082840] nix-grpc-daemon[841]: time=2026-09-20T10:51:13.718Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3915lb # [ 39.064734] niks3-server[1044]: 2026/09/20 10:51:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3916lb # [ 39.087745] niks3-server[1044]: 2026/09/20 10:51:14 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3917lb # [ 39.110391] niks3-server[1044]: 2026/09/20 10:51:14 INFO Signed narinfos id=1 count=13918worker2 # [ 39.174589] nix-grpc-daemon[841]: time=2026-09-20T10:51:13.813Z level=INFO msg="Uploading 1 narinfos"3919lb # [ 39.128209] niks3-server[1044]: 2026/09/20 10:51:14 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3920lb # [ 39.136627] niks3-server[1044]: 2026/09/20 10:51:14 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3921lb # [ 39.145023] niks3-server[1044]: 2026/09/20 10:51:14 INFO Completed upload id=13922worker2 # [ 39.208190] nix-grpc-daemon[841]: time=2026-09-20T10:51:13.844Z level=INFO msg="Upload complete. (567ms)"3923worker2 # [ 39.210571] nix-grpc-daemon[773]: ts=2026-09-20T10:51:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=0 paths=1 nar_bytes_in=5043924lb # [ 39.152337] niks3-server[1044]: 2026/09/20 10:51:14 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3925worker2 # [ 39.223311] nix-grpc-daemon[773]: ts=2026-09-20T10:51:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488963926worker2 # [ 39.235411] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3927worker2 # [ 39.239900] nix-daemon[831]: reaped child process 839, status = succeeded3928worker2 # [ 39.252468] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3929client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3930client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3931client # farm-a> LOG-farm-a-t13932worker2 # [ 40.903220] nix-daemon[831]: reaped child process 866, status = succeeded3933worker2 # [ 41.077763] nix-daemon[831]: accepted connection from pid 882, user nix-grpc-daemon (trusted)3934worker2 # [ 41.098293] nix-daemon[831]: reaped child process 885, status = succeeded3935lb # [ 41.053321] niks3-server[1044]: 2026/09/20 10:51:16 INFO Received uploads request method=POST path=/api/pending_closures3936worker2 # [ 41.132831] nix-grpc-daemon[841]: time=2026-09-20T10:51:15.769Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3937worker2 # [ 41.136526] nix-grpc-daemon[841]: time=2026-09-20T10:51:15.769Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3938lb # [ 41.087281] envoy[925]: conn peer=[2001:db8:1::1]:41482 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=27363939lb # [ 41.098659] envoy[925]: conn peer=[2001:db8:1::1]:41488 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=361 ms=993940lb # [ 41.115276] envoy[925]: conn peer=[2001:db8:1::1]:41494 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=133941lb # [ 41.119839] envoy[925]: conn peer=[2001:db8:1::1]:41508 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=133942lb # [ 41.132732] niks3-server[1044]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3943lb # [ 41.146563] niks3-server[1044]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3944lb # [ 41.156955] niks3-server[1044]: 2026/09/20 10:51:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3945lb # [ 41.163660] niks3-server[1044]: 2026/09/20 10:51:16 INFO Signed narinfos id=2 count=13946worker2 # [ 41.224174] nix-grpc-daemon[841]: time=2026-09-20T10:51:15.861Z level=INFO msg="Uploading 1 narinfos"3947lb # [ 41.166985] niks3-server[1044]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3948lb # [ 41.178380] niks3-server[1044]: 2026/09/20 10:51:16 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3949lb # [ 41.188813] niks3-server[1044]: 2026/09/20 10:51:16 INFO Completed upload id=23950worker2 # [ 41.248575] nix-grpc-daemon[841]: time=2026-09-20T10:51:15.887Z level=INFO msg="Upload complete. (380ms)"3951lb # [ 41.191294] niks3-server[1044]: 2026/09/20 10:51:16 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3952worker2 # [ 41.261289] nix-grpc-daemon[773]: ts=2026-09-20T10:51:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13953worker1 # [ 41.211186] nix-grpc-daemon[772]: ts=2026-09-20T10:51:16Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03954worker2 # [ 41.282316] nix-daemon[831]: reaped child process 864, status = succeeded3955worker1 # [ 41.217537] nix-grpc-daemon[772]: ts=2026-09-20T10:51:16Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=13956worker2 # [ 41.320798] nix-grpc-daemon[773]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488963957worker2 # [ 41.337630] nix-grpc-daemon[773]: ts=2026-09-20T10:51:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488963958worker2 # [ 41.353707] nix-grpc-daemon[841]: time=2026-09-20T10:51:15.993Z level=INFO msg="All 1 paths already cached"3959client # copying 1 paths to 'lb:50051'...3960worker2 # [ 41.364134] nix-grpc-daemon[773]: ts=2026-09-20T10:51:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488963961client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3962worker2 # [ 41.386613] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3963worker2 # [ 41.595789] nix-daemon[831]: accepted connection from pid 889, user nix-grpc-daemon (trusted)3964worker2 # [ 41.617155] nix-daemon[831]: reaped child process 892, status = succeeded3965worker2 # [ 41.792657] nix-daemon[831]: accepted connection from pid 894, user nix-grpc-daemon (trusted)3966worker2 # [ 41.810974] nix-daemon[831]: reaped child process 897, status = succeeded3967lb # [ 41.762442] niks3-server[1044]: 2026/09/20 10:51:17 INFO Received uploads request method=POST path=/api/pending_closures3968worker2 # [ 41.832152] nix-grpc-daemon[841]: time=2026-09-20T10:51:16.471Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3969worker2 # [ 41.834306] nix-grpc-daemon[841]: time=2026-09-20T10:51:16.473Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3970lb # [ 41.797381] niks3-server[1044]: 2026/09/20 10:51:17 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3971worker2 # [ 41.867438] nix-grpc-daemon[841]: time=2026-09-20T10:51:16.506Z level=INFO msg="Uploading 1 narinfos"3972lb # [ 41.812983] niks3-server[1044]: 2026/09/20 10:51:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3973lb # [ 41.823633] niks3-server[1044]: 2026/09/20 10:51:17 INFO Signed narinfos id=3 count=13974worker2 # [ 41.893253] nix-grpc-daemon[841]: time=2026-09-20T10:51:16.532Z level=INFO msg="Upload complete. (488ms)"3975lb # [ 41.827609] niks3-server[1044]: 2026/09/20 10:51:17 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3976lb # [ 41.837729] niks3-server[1044]: 2026/09/20 10:51:17 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3977worker2 # [ 41.900118] nix-grpc-daemon[773]: ts=2026-09-20T10:51:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=0 paths=1 nar_bytes_in=6243978lb # [ 41.842133] niks3-server[1044]: 2026/09/20 10:51:17 INFO Completed upload id=33979lb # [ 41.844318] niks3-server[1044]: 2026/09/20 10:51:17 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3980worker2 # [ 41.908633] nix-grpc-daemon[773]: ts=2026-09-20T10:51:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488963981worker2 # [ 41.921503] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3982worker2 # [ 41.924954] nix-daemon[831]: reaped child process 887, status = succeeded3983client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3984client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3985worker2 # [ 41.938660] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3986client # farm-b> LOG-farm-b-t13987worker2 # [ 42.765289] nix-daemon[831]: reaped child process 901, status = succeeded3988worker2 # [ 42.930663] nix-daemon[831]: accepted connection from pid 917, user nix-grpc-daemon (trusted)3989worker2 # [ 42.948802] nix-daemon[831]: reaped child process 920, status = succeeded3990lb # [ 42.905258] niks3-server[1044]: 2026/09/20 10:51:18 INFO Received uploads request method=POST path=/api/pending_closures3991worker2 # [ 42.976975] nix-grpc-daemon[841]: time=2026-09-20T10:51:17.615Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3992worker2 # [ 42.978528] nix-grpc-daemon[841]: time=2026-09-20T10:51:17.615Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3993lb # [ 42.939852] niks3-server[1044]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3994lb # [ 42.957842] niks3-server[1044]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3995worker2 # [ 43.030887] nix-grpc-daemon[841]: time=2026-09-20T10:51:17.669Z level=INFO msg="Uploading 1 narinfos"3996lb # [ 42.973281] niks3-server[1044]: 2026/09/20 10:51:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3997lb # [ 42.982141] niks3-server[1044]: 2026/09/20 10:51:18 INFO Signed narinfos id=4 count=13998lb # [ 42.989486] niks3-server[1044]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3999lb # [ 42.998493] niks3-server[1044]: 2026/09/20 10:51:18 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4000lb # [ 43.001588] niks3-server[1044]: 2026/09/20 10:51:18 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo4001lb # [ 43.005003] niks3-server[1044]: 2026/09/20 10:51:18 INFO Completed upload id=44002worker2 # [ 43.065018] nix-grpc-daemon[841]: time=2026-09-20T10:51:17.704Z level=INFO msg="Upload complete. (316ms)"4003worker2 # [ 43.077258] nix-grpc-daemon[773]: ts=2026-09-20T10:51:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=14004worker1 # [ 43.020442] nix-grpc-daemon[772]: ts=2026-09-20T10:51:18Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=04005worker1 # [ 43.025976] nix-grpc-daemon[772]: ts=2026-09-20T10:51:18Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=14006worker2 # [ 43.097915] nix-daemon[831]: reaped child process 899, status = succeeded4007worker2 # [ 43.134360] nix-grpc-daemon[773]: ts=2026-09-20T10:51:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964008worker2 # [ 43.150452] nix-grpc-daemon[773]: ts=2026-09-20T10:51:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488964009worker2 # [ 43.165612] nix-grpc-daemon[841]: time=2026-09-20T10:51:17.804Z level=INFO msg="All 2 paths already cached"4010client # copying 1 paths to 'lb:50051'...4011worker2 # [ 43.176608] nix-grpc-daemon[773]: ts=2026-09-20T10:51:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488964012client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4013worker2 # [ 43.200185] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4014worker2 # [ 43.412130] nix-daemon[831]: accepted connection from pid 924, user nix-grpc-daemon (trusted)4015worker2 # [ 43.432350] nix-daemon[831]: reaped child process 927, status = succeeded4016worker2 # [ 43.605194] nix-daemon[831]: accepted connection from pid 929, user nix-grpc-daemon (trusted)4017worker2 # [ 43.626665] nix-daemon[831]: reaped child process 932, status = succeeded4018lb # [ 43.578407] niks3-server[1044]: 2026/09/20 10:51:19 INFO Received uploads request method=POST path=/api/pending_closures4019worker2 # [ 43.649568] nix-grpc-daemon[841]: time=2026-09-20T10:51:18.288Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4020worker2 # [ 43.651078] nix-grpc-daemon[841]: time=2026-09-20T10:51:18.288Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4021lb # [ 43.610830] niks3-server[1044]: 2026/09/20 10:51:19 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4022lb # [ 43.626812] niks3-server[1044]: 2026/09/20 10:51:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4023worker2 # [ 43.693066] nix-grpc-daemon[841]: time=2026-09-20T10:51:18.332Z level=INFO msg="Uploading 1 narinfos"4024lb # [ 43.638904] niks3-server[1044]: 2026/09/20 10:51:19 INFO Signed narinfos id=5 count=14025lb # [ 43.644998] niks3-server[1044]: 2026/09/20 10:51:19 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4026lb # [ 43.654540] niks3-server[1044]: 2026/09/20 10:51:19 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4027lb # [ 43.659229] niks3-server[1044]: 2026/09/20 10:51:19 INFO Completed upload id=54028worker2 # [ 43.718752] nix-grpc-daemon[841]: time=2026-09-20T10:51:18.358Z level=INFO msg="Upload complete. (501ms)"4029lb # [ 43.662023] niks3-server[1044]: 2026/09/20 10:51:19 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4030worker2 # [ 43.728382] nix-grpc-daemon[773]: ts=2026-09-20T10:51:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=0 paths=1 nar_bytes_in=7524031worker2 # [ 43.743178] nix-grpc-daemon[773]: ts=2026-09-20T10:51:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964032worker2 # [ 43.749963] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4033worker2 # [ 43.755052] nix-daemon[831]: reaped child process 922, status = succeeded4034client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4035worker2 # [ 43.768244] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4036client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4037client # farm-top> LOG-farm-top-t14038worker2 # [ 45.622880] nix-daemon[831]: reaped child process 936, status = succeeded4039worker2 # [ 45.802484] nix-daemon[831]: accepted connection from pid 951, user nix-grpc-daemon (trusted)4040worker2 # [ 45.831896] nix-daemon[831]: reaped child process 954, status = succeeded4041lb # [ 45.782719] niks3-server[1044]: 2026/09/20 10:51:21 INFO Received uploads request method=POST path=/api/pending_closures4042worker2 # [ 45.855478] nix-grpc-daemon[841]: time=2026-09-20T10:51:20.493Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4043worker2 # [ 45.858803] nix-grpc-daemon[841]: time=2026-09-20T10:51:20.493Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4044lb # [ 45.819683] niks3-server[1044]: 2026/09/20 10:51:21 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4045lb # [ 45.835911] niks3-server[1044]: 2026/09/20 10:51:21 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4046lb # [ 45.850688] niks3-server[1044]: 2026/09/20 10:51:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4047worker2 # [ 45.916849] nix-grpc-daemon[841]: time=2026-09-20T10:51:20.555Z level=INFO msg="Uploading 1 narinfos"4048lb # [ 45.860860] niks3-server[1044]: 2026/09/20 10:51:21 INFO Signed narinfos id=6 count=14049lb # [ 45.863152] niks3-server[1044]: 2026/09/20 10:51:21 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4050lb # [ 45.876260] niks3-server[1044]: 2026/09/20 10:51:21 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4051worker2 # [ 45.944780] nix-grpc-daemon[841]: time=2026-09-20T10:51:20.584Z level=INFO msg="Upload complete. (361ms)"4052lb # [ 45.884643] niks3-server[1044]: 2026/09/20 10:51:21 INFO Completed upload id=64053lb # [ 45.890358] niks3-server[1044]: 2026/09/20 10:51:21 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4054worker2 # [ 45.950355] nix-grpc-daemon[773]: ts=2026-09-20T10:51:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14055worker2 # [ 45.962082] nix-daemon[831]: reaped child process 934, status = succeeded4056client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 8.10 seconds)4057client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4058client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds)4059client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4060client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4061client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4062client # copying 3 paths...4063client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4064client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4065client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4066client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)4067(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.79 seconds)4068subtest: repeat is answered Cached by the scheduler without building4069worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4070worker1 # finding garbage collector roots...4071worker1 # deleting specified paths...4072worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4073worker1 # deleting unused links...4074worker1 # note: hard linking is currently saving 0.0 KiB4075worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds)4076worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4077worker2 # finding garbage collector roots...4078worker2 # deleting specified paths...4079worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4080worker2 # deleting unused links...4081worker2 # note: hard linking is currently saving 0.0 KiB4082worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)4083client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24084client # don't know how to build these paths:4085client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4086worker1 # [ 47.467921] nix-grpc-daemon[772]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346764087worker1 # [ 47.476576] nix-grpc-daemon[772]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346764088worker1 # [ 47.514326] nix-grpc-daemon[772]: ts=2026-09-20T10:51:23Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14089client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.35 seconds)4090client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4091client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.22 seconds)4092lb: must succeed: curl -sf localhost:9901/clusters4093lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4094lb: must succeed: curl -sf localhost:9901/clusters4095lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4096worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4097worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4098(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.45 seconds)4099subtest: inputs already in the cache are not sent to the scheduler4100lb: must succeed: curl -sf localhost:9901/clusters4101lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4102lb: must succeed: curl -sf localhost:9901/clusters4103lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4104worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4105worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4106client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24107worker2 # [ 48.599312] nix-grpc-daemon[773]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:488964108client # don't know how to build these paths:4109client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4110worker1 # [ 48.548949] nix-grpc-daemon[772]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346764111worker1 # [ 48.566875] nix-grpc-daemon[772]: ts=2026-09-20T10:51:24Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04112worker1 # [ 48.572925] nix-grpc-daemon[772]: ts=2026-09-20T10:51:24Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=14113worker2 # [ 48.676963] nix-grpc-daemon[773]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964114worker2 # [ 48.693011] nix-grpc-daemon[773]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488964115worker2 # [ 48.710364] nix-grpc-daemon[841]: time=2026-09-20T10:51:23.348Z level=INFO msg="All 2 paths already cached"4116client # copying 1 paths to 'lb:50051'...4117client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4118worker2 # [ 48.720792] nix-grpc-daemon[773]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488964119worker2 # [ 48.736958] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4120worker2 # [ 48.944224] nix-daemon[831]: accepted connection from pid 972, user nix-grpc-daemon (trusted)4121worker2 # [ 48.962585] nix-daemon[831]: reaped child process 975, status = succeeded4122worker2 # [ 49.140088] nix-daemon[831]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4123worker2 # [ 49.157588] nix-daemon[831]: reaped child process 980, status = succeeded4124lb # [ 49.111333] niks3-server[1044]: 2026/09/20 10:51:24 INFO Received uploads request method=POST path=/api/pending_closures4125worker2 # [ 49.180917] nix-grpc-daemon[841]: time=2026-09-20T10:51:23.820Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4126worker2 # [ 49.182613] nix-grpc-daemon[841]: time=2026-09-20T10:51:23.820Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4127lb # [ 49.140224] niks3-server[1044]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4128worker2 # [ 49.213525] nix-grpc-daemon[841]: time=2026-09-20T10:51:23.852Z level=INFO msg="Uploading 1 narinfos"4129lb # [ 49.155375] niks3-server[1044]: 2026/09/20 10:51:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4130lb # [ 49.164874] niks3-server[1044]: 2026/09/20 10:51:24 INFO Signed narinfos id=7 count=14131lb # [ 49.175701] niks3-server[1044]: 2026/09/20 10:51:24 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4132worker2 # [ 49.240684] nix-grpc-daemon[841]: time=2026-09-20T10:51:23.880Z level=INFO msg="Upload complete. (486ms)"4133lb # [ 49.181506] niks3-server[1044]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4134lb # [ 49.186096] niks3-server[1044]: 2026/09/20 10:51:24 INFO Completed upload id=74135lb # [ 49.189158] niks3-server[1044]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4136worker2 # [ 49.248115] nix-grpc-daemon[773]: ts=2026-09-20T10:51:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=0 paths=1 nar_bytes_in=7524137worker2 # [ 49.256549] nix-grpc-daemon[773]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964138worker2 # [ 49.268329] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4139worker2 # [ 49.273929] nix-daemon[831]: reaped child process 970, status = succeeded4140client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4141worker2 # [ 49.286294] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4142client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4143client # farm-top> LOG-farm-top-t1b4144worker2 # [ 50.925165] nix-daemon[831]: reaped child process 984, status = succeeded4145worker2 # [ 51.101959] nix-daemon[831]: accepted connection from pid 999, user nix-grpc-daemon (trusted)4146worker2 # [ 51.123005] nix-daemon[831]: reaped child process 1002, status = succeeded4147lb # [ 51.078101] niks3-server[1044]: 2026/09/20 10:51:26 INFO Received uploads request method=POST path=/api/pending_closures4148lb # [ 51.086459] envoy[925]: conn peer=[2001:db8:1::1]:41514 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9536 tx=3868 ms=78564149worker2 # [ 51.156394] nix-grpc-daemon[841]: time=2026-09-20T10:51:25.792Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4150worker2 # [ 51.158057] nix-grpc-daemon[841]: time=2026-09-20T10:51:25.792Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4151lb # [ 51.091850] envoy[925]: conn peer=[2001:db8:1::1]:39542 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=734152lb # [ 51.124890] niks3-server[1044]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4153lb # [ 51.140192] niks3-server[1044]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4154lb # [ 51.153427] niks3-server[1044]: 2026/09/20 10:51:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4155lb # [ 51.159787] niks3-server[1044]: 2026/09/20 10:51:26 INFO Signed narinfos id=8 count=14156worker2 # [ 51.218292] nix-grpc-daemon[841]: time=2026-09-20T10:51:25.857Z level=INFO msg="Uploading 1 narinfos"4157lb # [ 51.165944] niks3-server[1044]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4158lb # [ 51.173336] niks3-server[1044]: 2026/09/20 10:51:26 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4159lb # [ 51.181769] niks3-server[1044]: 2026/09/20 10:51:26 INFO Completed upload id=84160lb # [ 51.184974] niks3-server[1044]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4161worker2 # [ 51.241615] nix-grpc-daemon[841]: time=2026-09-20T10:51:25.880Z level=INFO msg="Upload complete. (343ms)"4162worker2 # [ 51.253260] nix-grpc-daemon[773]: ts=2026-09-20T10:51:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14163worker2 # [ 51.271947] nix-daemon[831]: reaped child process 982, status = succeeded4164client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.94 seconds)4165client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4166client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds)4167lb: must succeed: curl -sf localhost:9901/clusters4168lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4169lb: must succeed: curl -sf localhost:9901/clusters4170lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4171worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4172worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4173(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.59 seconds)4174subtest: two clients wanting the same drv build it once4175client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4176client # [ 51.785125] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4177client # Running as unit: dedup1.service; invocation ID: dd8059b110c7433795a14d2751651f904178client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4179client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4180worker1 # [ 52.003319] nix-grpc-daemon[772]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346764181client # [ 52.035414] nix[880]: don't know how to build these paths:4182client # [ 52.037328] nix[880]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4183worker1 # [ 52.024171] nix-grpc-daemon[772]: ts=2026-09-20T10:51:27Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04184worker1 # [ 52.030699] nix-grpc-daemon[772]: ts=2026-09-20T10:51:27Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14185worker1 # [ 52.040172] nix-grpc-daemon[772]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346764186worker1 # [ 52.058894] nix-grpc-daemon[772]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346764187client # [ 52.098571] nix[880]: copying 1 paths to 'lb:50051'...4188client # [ 52.100914] nix[880]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4189worker1 # [ 52.074843] nix-grpc-daemon[772]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346764190worker1 # [ 52.091026] nix-daemon[833]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4191worker1 # [ 52.116883] nix-grpc-daemon[772]: ts=2026-09-20T10:51:27Z level=info event=niks3_push_started pid=8844192worker1 # [ 52.578502] nix-daemon[833]: accepted connection from pid 897, user nix-grpc-daemon (trusted)4193worker1 # [ 52.598260] nix-daemon[833]: reaped child process 900, status = succeeded4194worker1 # [ 52.775241] nix-daemon[833]: accepted connection from pid 902, user nix-grpc-daemon (trusted)4195worker1 # [ 52.793217] nix-daemon[833]: reaped child process 905, status = succeeded4196lb # [ 52.807922] niks3-server[1044]: 2026/09/20 10:51:28 INFO Received uploads request method=POST path=/api/pending_closures4197worker1 # [ 52.816710] nix-grpc-daemon[884]: time=2026-09-20T10:51:28.455Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4198worker1 # [ 52.818987] nix-grpc-daemon[884]: time=2026-09-20T10:51:28.458Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4199lb # [ 52.844304] niks3-server[1044]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4200lb # [ 52.857813] niks3-server[1044]: 2026/09/20 10:51:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4201worker1 # [ 52.862657] nix-grpc-daemon[884]: time=2026-09-20T10:51:28.501Z level=INFO msg="Uploading 1 narinfos"4202lb # [ 52.866876] niks3-server[1044]: 2026/09/20 10:51:28 INFO Signed narinfos id=9 count=14203lb # [ 52.875874] niks3-server[1044]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4204lb # [ 52.887789] niks3-server[1044]: 2026/09/20 10:51:28 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4205client # [ 52.898447] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4206worker1 # [ 52.892523] nix-grpc-daemon[884]: time=2026-09-20T10:51:28.532Z level=INFO msg="Upload complete. (503ms)"4207lb # [ 52.896217] niks3-server[1044]: 2026/09/20 10:51:28 INFO Completed upload id=94208lb # [ 52.899946] niks3-server[1044]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4209worker1 # [ 52.900123] nix-grpc-daemon[772]: ts=2026-09-20T10:51:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34676 duration_s=0 paths=1 nar_bytes_in=4324210client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4211worker1 # [ 52.911344] nix-grpc-daemon[772]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346764212worker1 # [ 52.918915] nix-daemon[833]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4213worker1 # [ 52.924603] nix-daemon[833]: reaped child process 882, status = succeeded4214client # Running as unit: dedup2.service; invocation ID: 2f24b01126c7440589ff8d39d130fc6d4215worker1 # [ 52.940434] nix-daemon[833]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4216client # [ 52.962450] nix[880]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4217client # [ 53.250260] nix[896]: don't know how to build these paths:4218client # [ 53.251386] nix[896]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4219worker2 # [ 53.287103] nix-grpc-daemon[773]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:488964220worker1 # [ 53.237422] nix-grpc-daemon[772]: ts=2026-09-20T10:51:28Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04221worker1 # [ 53.250122] nix-grpc-daemon[772]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346764222client # [ 53.281571] nix[896]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4223client: must succeed: sleep 24224client: (finished: must succeed: sleep 2, in 2.06 seconds)4225??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4226 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394227client: waiting for success: ! systemctl is-active dedup1 dedup24228??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4229 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394230worker1 # [ 56.602510] nix-daemon[833]: reaped child process 912, status = succeeded4231worker1 # [ 56.789339] nix-daemon[833]: accepted connection from pid 940, user nix-grpc-daemon (trusted)4232worker1 # [ 56.808420] nix-daemon[833]: reaped child process 943, status = succeeded4233lb # [ 56.822749] niks3-server[1044]: 2026/09/20 10:51:32 INFO Received uploads request method=POST path=/api/pending_closures4234worker1 # [ 56.832479] nix-grpc-daemon[884]: time=2026-09-20T10:51:32.471Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4235worker1 # [ 56.834150] nix-grpc-daemon[884]: time=2026-09-20T10:51:32.471Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4236lb # [ 56.871132] niks3-server[1044]: 2026/09/20 10:51:32 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4237lb # [ 56.883777] niks3-server[1044]: 2026/09/20 10:51:32 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4238lb # [ 56.896255] niks3-server[1044]: 2026/09/20 10:51:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4239worker1 # [ 56.900123] nix-grpc-daemon[884]: time=2026-09-20T10:51:32.538Z level=INFO msg="Uploading 1 narinfos"4240lb # [ 56.903116] niks3-server[1044]: 2026/09/20 10:51:32 INFO Signed narinfos id=10 count=14241lb # [ 56.907331] niks3-server[1044]: 2026/09/20 10:51:32 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4242lb # [ 56.921181] niks3-server[1044]: 2026/09/20 10:51:32 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4243lb # [ 56.928820] niks3-server[1044]: 2026/09/20 10:51:32 INFO Completed upload id=104244worker1 # [ 56.925727] nix-grpc-daemon[884]: time=2026-09-20T10:51:32.565Z level=INFO msg="Upload complete. (363ms)"4245lb # [ 56.932503] niks3-server[1044]: 2026/09/20 10:51:32 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4246worker1 # [ 56.940797] nix-grpc-daemon[772]: ts=2026-09-20T10:51:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34676 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14247worker1 # [ 56.959513] nix-grpc-daemon[772]: ts=2026-09-20T10:51:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34676 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14248worker1 # [ 56.966738] nix-daemon[833]: reaped child process 909, status = succeeded4249client # [ 57.025377] systemd[1]: dedup2.service: Deactivated successfully.4250client # [ 57.029650] systemd[1]: dedup2.service: Consumed 194ms CPU time over 4.127s wall clock time, 31M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic.4251client # [ 57.040700] systemd[1]: dedup1.service: Deactivated successfully.4252client # [ 57.042652] systemd[1]: dedup1.service: Consumed 152ms CPU time over 5.252s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.4253client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4254client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4255client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4256worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4257worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4258worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4259worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4260worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4261worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4262worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4263worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4264(finished: subtest: two clients wanting the same drv build it once, in 6.30 seconds)4265subtest: build hook: nix-daemon with builders = grpc://lb4266client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4267client # [ 58.239549] systemd[1]: Started Nix Daemon.4268client # [ 58.430865] nix-daemon[938]: accepted connection from pid 935, user root (trusted)4269worker1 # [ 58.613769] nix-grpc-daemon[772]: ts=2026-09-20T10:51:34Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:346764270worker1 # [ 58.620761] nix-grpc-daemon[772]: ts=2026-09-20T10:51:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346764271worker1 # [ 58.635272] nix-grpc-daemon[772]: ts=2026-09-20T10:51:34Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04272worker1 # [ 58.641168] nix-grpc-daemon[772]: ts=2026-09-20T10:51:34Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14273worker2 # [ 58.746237] nix-grpc-daemon[773]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964274worker2 # [ 58.763382] nix-grpc-daemon[773]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488964275worker2 # [ 58.779334] nix-grpc-daemon[773]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488964276worker2 # [ 58.798171] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4277worker2 # [ 59.018759] nix-daemon[831]: accepted connection from pid 1027, user nix-grpc-daemon (trusted)4278worker2 # [ 59.039990] nix-daemon[831]: reaped child process 1030, status = succeeded4279worker2 # [ 59.217867] nix-daemon[831]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)4280worker2 # [ 59.236122] nix-daemon[831]: reaped child process 1035, status = succeeded4281lb # [ 59.187973] niks3-server[1044]: 2026/09/20 10:51:34 INFO Received uploads request method=POST path=/api/pending_closures4282worker2 # [ 59.257454] nix-grpc-daemon[841]: time=2026-09-20T10:51:33.896Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4283worker2 # [ 59.258954] nix-grpc-daemon[841]: time=2026-09-20T10:51:33.896Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4284lb # [ 59.215264] niks3-server[1044]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4285worker2 # [ 59.288785] nix-grpc-daemon[841]: time=2026-09-20T10:51:33.927Z level=INFO msg="Uploading 1 narinfos"4286lb # [ 59.233123] niks3-server[1044]: 2026/09/20 10:51:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4287lb # [ 59.243002] niks3-server[1044]: 2026/09/20 10:51:34 INFO Signed narinfos id=11 count=14288lb # [ 59.252533] niks3-server[1044]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4289lb # [ 59.256239] niks3-server[1044]: 2026/09/20 10:51:34 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4290lb # [ 59.260327] niks3-server[1044]: 2026/09/20 10:51:34 INFO Completed upload id=114291worker2 # [ 59.320261] nix-grpc-daemon[841]: time=2026-09-20T10:51:33.959Z level=INFO msg="Upload complete. (504ms)"4292lb # [ 59.263051] niks3-server[1044]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4293worker2 # [ 59.330866] nix-grpc-daemon[773]: ts=2026-09-20T10:51:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=0 paths=1 nar_bytes_in=5124294worker2 # [ 59.342221] nix-grpc-daemon[773]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964295worker2 # [ 59.347937] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4296worker2 # [ 59.353095] nix-daemon[831]: reaped child process 1025, status = succeeded4297worker2 # [ 59.366100] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4298worker2 # [ 60.807071] nix-daemon[831]: reaped child process 1039, status = succeeded4299worker2 # [ 60.993805] nix-daemon[831]: accepted connection from pid 1054, user nix-grpc-daemon (trusted)4300worker2 # [ 61.011851] nix-daemon[831]: reaped child process 1057, status = succeeded4301lb # [ 60.966070] niks3-server[1044]: 2026/09/20 10:51:36 INFO Received uploads request method=POST path=/api/pending_closures4302worker2 # [ 61.036434] nix-grpc-daemon[841]: time=2026-09-20T10:51:35.672Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4303worker2 # [ 61.037997] nix-grpc-daemon[841]: time=2026-09-20T10:51:35.672Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4304lb # [ 60.999893] niks3-server[1044]: 2026/09/20 10:51:36 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4305lb # [ 61.017669] niks3-server[1044]: 2026/09/20 10:51:36 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4306lb # [ 61.027279] niks3-server[1044]: 2026/09/20 10:51:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4307worker2 # [ 61.093415] nix-grpc-daemon[841]: time=2026-09-20T10:51:35.732Z level=INFO msg="Uploading 1 narinfos"4308lb # [ 61.037214] niks3-server[1044]: 2026/09/20 10:51:36 INFO Signed narinfos id=12 count=14309lb # [ 61.039920] niks3-server[1044]: 2026/09/20 10:51:36 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4310lb # [ 61.050307] niks3-server[1044]: 2026/09/20 10:51:36 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4311lb # [ 61.057666] niks3-server[1044]: 2026/09/20 10:51:36 INFO Completed upload id=124312worker2 # [ 61.117331] nix-grpc-daemon[841]: time=2026-09-20T10:51:35.756Z level=INFO msg="Upload complete. (340ms)"4313lb # [ 61.060299] niks3-server[1044]: 2026/09/20 10:51:36 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4314worker2 # [ 61.129196] nix-grpc-daemon[773]: ts=2026-09-20T10:51:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14315worker1 # [ 61.070772] nix-grpc-daemon[772]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:346764316worker2 # [ 61.147412] nix-daemon[831]: reaped child process 1037, status = succeeded4317lb # [ 61.086175] envoy[925]: conn peer=[2001:db8:1::1]:39544 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4159 tx=1724 ms=26654318worker1 # [ 61.087450] nix-grpc-daemon[772]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4319lb # [ 61.091510] envoy[925]: conn peer=[2001:db8:1::1]:43558 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=37374320lb # [ 61.096552] envoy[925]: conn peer=[2001:db8:1::1]:43550 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1372 ms=49564321worker2 # [ 61.200131] nix-grpc-daemon[773]: ts=2026-09-20T10:51:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:488964322worker2 # [ 61.207986] nix-grpc-daemon[773]: ts=2026-09-20T10:51:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=0 paths=1 nar_bytes_out=1284323worker1 # [ 61.405391] nix-grpc-daemon[772]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:346764324worker1 # [ 61.413378] nix-grpc-daemon[772]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346764325worker1 # [ 61.421193] nix-grpc-daemon[884]: time=2026-09-20T10:51:37.058Z level=INFO msg="All 1 paths already cached"4326worker1 # [ 61.433147] nix-grpc-daemon[772]: ts=2026-09-20T10:51:37Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04327worker1 # [ 61.440148] nix-grpc-daemon[772]: ts=2026-09-20T10:51:37Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14328worker2 # [ 61.505567] nix-grpc-daemon[773]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964329worker2 # [ 61.521017] nix-grpc-daemon[773]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488964330worker2 # [ 61.535386] nix-grpc-daemon[841]: time=2026-09-20T10:51:36.174Z level=INFO msg="All 1 paths already cached"4331worker2 # [ 61.544980] nix-grpc-daemon[773]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488964332worker2 # [ 61.558793] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4333worker2 # [ 61.770982] nix-daemon[831]: accepted connection from pid 1061, user nix-grpc-daemon (trusted)4334worker2 # [ 61.790000] nix-daemon[831]: reaped child process 1064, status = succeeded4335worker2 # [ 61.968075] nix-daemon[831]: accepted connection from pid 1066, user nix-grpc-daemon (trusted)4336worker2 # [ 61.985776] nix-daemon[831]: reaped child process 1069, status = succeeded4337lb # [ 61.938434] niks3-server[1044]: 2026/09/20 10:51:37 INFO Received uploads request method=POST path=/api/pending_closures4338worker2 # [ 62.008824] nix-grpc-daemon[841]: time=2026-09-20T10:51:36.647Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4339worker2 # [ 62.010322] nix-grpc-daemon[841]: time=2026-09-20T10:51:36.647Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4340worker2 # [ 62.033078] nix-grpc-daemon[841]: time=2026-09-20T10:51:36.672Z level=INFO msg="Uploading 1 narinfos"4341lb # [ 61.973221] niks3-server[1044]: 2026/09/20 10:51:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4342lb # [ 61.987289] niks3-server[1044]: 2026/09/20 10:51:37 INFO Signed narinfos id=13 count=14343lb # [ 61.994697] niks3-server[1044]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4344lb # [ 62.000248] niks3-server[1044]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4345lb # [ 62.007808] niks3-server[1044]: 2026/09/20 10:51:37 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4346lb # [ 62.012858] niks3-server[1044]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4347lb # [ 62.017010] niks3-server[1044]: 2026/09/20 10:51:37 INFO Completed upload id=134348worker2 # [ 62.077900] nix-grpc-daemon[841]: time=2026-09-20T10:51:36.716Z level=INFO msg="Upload complete. (500ms)"4349worker2 # [ 62.087551] nix-grpc-daemon[773]: ts=2026-09-20T10:51:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=0 paths=1 nar_bytes_in=6244350worker2 # [ 62.099886] nix-grpc-daemon[773]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964351worker2 # [ 62.108890] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4352worker2 # [ 62.111670] nix-daemon[831]: reaped child process 1059, status = succeeded4353worker2 # [ 62.124086] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4354worker2 # [ 63.149070] nix-daemon[831]: reaped child process 1073, status = succeeded4355worker2 # [ 63.307737] nix-daemon[831]: accepted connection from pid 1088, user nix-grpc-daemon (trusted)4356worker2 # [ 63.325368] nix-daemon[831]: reaped child process 1091, status = succeeded4357lb # [ 63.279933] niks3-server[1044]: 2026/09/20 10:51:38 INFO Received uploads request method=POST path=/api/pending_closures4358worker2 # [ 63.351862] nix-grpc-daemon[841]: time=2026-09-20T10:51:37.989Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4359worker2 # [ 63.353532] nix-grpc-daemon[841]: time=2026-09-20T10:51:37.989Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4360lb # [ 63.322847] niks3-server[1044]: 2026/09/20 10:51:38 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4361worker2 # [ 63.396351] nix-grpc-daemon[841]: time=2026-09-20T10:51:38.035Z level=INFO msg="Uploading 1 narinfos"4362lb # [ 63.335956] niks3-server[1044]: 2026/09/20 10:51:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4363lb # [ 63.342895] niks3-server[1044]: 2026/09/20 10:51:38 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4364lb # [ 63.352608] niks3-server[1044]: 2026/09/20 10:51:38 INFO Signed narinfos id=14 count=14365worker2 # [ 63.418432] nix-grpc-daemon[841]: time=2026-09-20T10:51:38.057Z level=INFO msg="Upload complete. (281ms)"4366lb # [ 63.361074] niks3-server[1044]: 2026/09/20 10:51:38 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4367lb # [ 63.367014] niks3-server[1044]: 2026/09/20 10:51:38 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4368worker2 # [ 63.429174] nix-grpc-daemon[773]: ts=2026-09-20T10:51:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14369lb # [ 63.372641] niks3-server[1044]: 2026/09/20 10:51:38 INFO Completed upload id=144370lb # [ 63.376140] niks3-server[1044]: 2026/09/20 10:51:39 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4371worker2 # [ 63.443649] nix-grpc-daemon[773]: ts=2026-09-20T10:51:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:488964372worker2 # [ 63.447438] nix-daemon[831]: reaped child process 1071, status = succeeded4373worker2 # [ 63.464146] nix-grpc-daemon[773]: ts=2026-09-20T10:51:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:488964374worker2 # [ 63.468244] nix-grpc-daemon[773]: ts=2026-09-20T10:51:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=0 paths=1 nar_bytes_out=1764375worker2 # [ 63.776321] nix-grpc-daemon[773]: ts=2026-09-20T10:51:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:488964376worker2 # [ 63.784157] nix-grpc-daemon[773]: ts=2026-09-20T10:51:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488964377worker2 # [ 63.790901] nix-grpc-daemon[841]: time=2026-09-20T10:51:38.429Z level=INFO msg="All 2 paths already cached"4378worker1 # [ 63.745008] nix-grpc-daemon[772]: ts=2026-09-20T10:51:39Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04379worker2 # [ 63.810265] nix-grpc-daemon[773]: ts=2026-09-20T10:51:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964380worker1 # [ 63.745439] nix-grpc-daemon[772]: ts=2026-09-20T10:51:39Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14381worker2 # [ 63.827166] nix-grpc-daemon[773]: ts=2026-09-20T10:51:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488964382worker2 # [ 63.842517] nix-grpc-daemon[841]: time=2026-09-20T10:51:38.481Z level=INFO msg="All 2 paths already cached"4383worker2 # [ 63.852789] nix-grpc-daemon[773]: ts=2026-09-20T10:51:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488964384worker2 # [ 63.867175] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4385worker2 # [ 64.071547] nix-daemon[831]: accepted connection from pid 1095, user nix-grpc-daemon (trusted)4386worker2 # [ 64.091357] nix-daemon[831]: reaped child process 1098, status = succeeded4387worker2 # [ 64.269309] nix-daemon[831]: accepted connection from pid 1100, user nix-grpc-daemon (trusted)4388worker2 # [ 64.287826] nix-daemon[831]: reaped child process 1103, status = succeeded4389lb # [ 64.242121] niks3-server[1044]: 2026/09/20 10:51:39 INFO Received uploads request method=POST path=/api/pending_closures4390worker2 # [ 64.314852] nix-grpc-daemon[841]: time=2026-09-20T10:51:38.953Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4391worker2 # [ 64.316463] nix-grpc-daemon[841]: time=2026-09-20T10:51:38.953Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4392lb # [ 64.276866] niks3-server[1044]: 2026/09/20 10:51:39 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4393worker2 # [ 64.347484] nix-grpc-daemon[841]: time=2026-09-20T10:51:38.986Z level=INFO msg="Uploading 1 narinfos"4394lb # [ 64.295088] niks3-server[1044]: 2026/09/20 10:51:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4395lb # [ 64.304890] niks3-server[1044]: 2026/09/20 10:51:39 INFO Signed narinfos id=15 count=14396worker2 # [ 64.370386] nix-grpc-daemon[841]: time=2026-09-20T10:51:39.008Z level=INFO msg="Upload complete. (484ms)"4397lb # [ 64.312652] niks3-server[1044]: 2026/09/20 10:51:39 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4398lb # [ 64.317131] niks3-server[1044]: 2026/09/20 10:51:39 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4399lb # [ 64.321889] niks3-server[1044]: 2026/09/20 10:51:39 INFO Completed upload id=154400lb # [ 64.324135] niks3-server[1044]: 2026/09/20 10:51:39 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4401worker2 # [ 64.380159] nix-grpc-daemon[773]: ts=2026-09-20T10:51:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=0 paths=1 nar_bytes_in=7524402worker2 # [ 64.390911] nix-grpc-daemon[773]: ts=2026-09-20T10:51:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964403worker2 # [ 64.397579] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4404worker2 # [ 64.402563] nix-daemon[831]: reaped child process 1093, status = succeeded4405worker2 # [ 64.415447] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4406worker2 # [ 65.245586] nix-daemon[831]: reaped child process 1107, status = succeeded4407worker2 # [ 65.414569] nix-daemon[831]: accepted connection from pid 1122, user nix-grpc-daemon (trusted)4408worker2 # [ 65.434644] nix-daemon[831]: reaped child process 1125, status = succeeded4409lb # [ 65.387529] niks3-server[1044]: 2026/09/20 10:51:41 INFO Received uploads request method=POST path=/api/pending_closures4410worker2 # [ 65.460458] nix-grpc-daemon[841]: time=2026-09-20T10:51:40.096Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4411worker2 # [ 65.462171] nix-grpc-daemon[841]: time=2026-09-20T10:51:40.096Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4412lb # [ 65.425036] niks3-server[1044]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4413lb # [ 65.441415] niks3-server[1044]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4414lb # [ 65.451412] niks3-server[1044]: 2026/09/20 10:51:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4415worker2 # [ 65.517531] nix-grpc-daemon[841]: time=2026-09-20T10:51:40.156Z level=INFO msg="Uploading 1 narinfos"4416lb # [ 65.461821] niks3-server[1044]: 2026/09/20 10:51:41 INFO Signed narinfos id=16 count=14417lb # [ 65.467574] niks3-server[1044]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4418lb # [ 65.475408] niks3-server[1044]: 2026/09/20 10:51:41 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4419lb # [ 65.484432] niks3-server[1044]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4420lb # [ 65.491526] niks3-server[1044]: 2026/09/20 10:51:41 INFO Completed upload id=164421worker2 # [ 65.551817] nix-grpc-daemon[841]: time=2026-09-20T10:51:40.191Z level=INFO msg="Upload complete. (327ms)"4422worker1 # [ 65.503584] nix-grpc-daemon[772]: ts=2026-09-20T10:51:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:346764423worker2 # [ 65.565154] nix-grpc-daemon[773]: ts=2026-09-20T10:51:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14424worker2 # [ 65.581811] nix-daemon[831]: reaped child process 1105, status = succeeded4425worker1 # [ 65.523564] nix-grpc-daemon[772]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4426worker1 # [ 65.540571] nix-grpc-daemon[772]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4427worker1 # [ 65.582330] nix-grpc-daemon[772]: ts=2026-09-20T10:51:41Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:346764428worker1 # [ 65.589367] nix-grpc-daemon[772]: ts=2026-09-20T10:51:41Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34676 duration_s=0 paths=1 nar_bytes_out=2324429client # [ 65.747642] nix-daemon[938]: reaped child process 940, status = succeeded4430client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.75 seconds)4431client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4432client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4433client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4434client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4435client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4436client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4437(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.88 seconds)4438subtest: an input only one worker has still reaches the builder4439client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4440client # this derivation will be built:4441client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4442client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4443client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.45 seconds)4444client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4445client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds)4446worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4447worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds)4448worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4449worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4450client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24451client # [ 67.055165] nix-daemon[938]: accepted connection from pid 1021, user root (trusted)4452client # this derivation will be built:4453client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4454worker2 # [ 67.292927] nix-grpc-daemon[773]: ts=2026-09-20T10:51:41Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:488964455client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4456worker1 # [ 67.235899] nix-grpc-daemon[772]: ts=2026-09-20T10:51:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346764457worker1 # [ 67.456383] nix-daemon[833]: accepted connection from pid 968, user nix-grpc-daemon (trusted)4458worker1 # [ 67.474279] nix-daemon[833]: reaped child process 971, status = succeeded4459lb # [ 67.490200] niks3-server[1044]: 2026/09/20 10:51:43 INFO Received uploads request method=POST path=/api/pending_closures4460worker1 # [ 67.501100] nix-grpc-daemon[884]: time=2026-09-20T10:51:43.140Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4461worker1 # [ 67.503093] nix-grpc-daemon[884]: time=2026-09-20T10:51:43.142Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4462lb # [ 67.529232] niks3-server[1044]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4463lb # [ 67.538928] niks3-server[1044]: 2026/09/20 10:51:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4464worker1 # [ 67.543710] nix-grpc-daemon[884]: time=2026-09-20T10:51:43.182Z level=INFO msg="Uploading 1 narinfos"4465lb # [ 67.550560] niks3-server[1044]: 2026/09/20 10:51:43 INFO Signed narinfos id=17 count=14466lb # [ 67.556156] niks3-server[1044]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4467lb # [ 67.563307] niks3-server[1044]: 2026/09/20 10:51:43 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4468worker1 # [ 67.566546] nix-grpc-daemon[884]: time=2026-09-20T10:51:43.206Z level=INFO msg="Upload complete. (324ms)"4469lb # [ 67.570404] niks3-server[1044]: 2026/09/20 10:51:43 INFO Completed upload id=174470lb # [ 67.574404] niks3-server[1044]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4471worker1 # [ 67.594914] nix-grpc-daemon[772]: ts=2026-09-20T10:51:43Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04472worker1 # [ 67.602734] nix-grpc-daemon[772]: ts=2026-09-20T10:51:43Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14473worker1 # [ 67.644000] nix-grpc-daemon[772]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346764474worker1 # [ 67.660259] nix-grpc-daemon[772]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346764475client # copying 2 paths to 'lb:50051'...4476client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4477worker1 # [ 67.679419] nix-grpc-daemon[772]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346764478client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4479worker1 # [ 67.695908] nix-daemon[833]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4480worker1 # [ 67.905259] nix-daemon[833]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4481worker1 # [ 67.924396] nix-daemon[833]: reaped child process 980, status = succeeded4482worker1 # [ 68.098128] nix-daemon[833]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4483worker1 # [ 68.115705] nix-daemon[833]: reaped child process 985, status = succeeded4484lb # [ 68.129355] niks3-server[1044]: 2026/09/20 10:51:43 INFO Received uploads request method=POST path=/api/pending_closures4485lb # [ 68.139366] niks3-server[1044]: 2026/09/20 10:51:43 INFO Received uploads request method=POST path=/api/pending_closures4486worker1 # [ 68.146289] nix-grpc-daemon[884]: time=2026-09-20T10:51:43.785Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4487worker1 # [ 68.147864] nix-grpc-daemon[884]: time=2026-09-20T10:51:43.785Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4488worker1 # [ 68.149782] nix-grpc-daemon[884]: time=2026-09-20T10:51:43.785Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4489lb # [ 68.170577] niks3-server[1044]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4490lb # [ 68.186382] niks3-server[1044]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4491lb # [ 68.198902] niks3-server[1044]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4492lb # [ 68.207046] niks3-server[1044]: 2026/09/20 10:51:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4493lb # [ 68.212795] niks3-server[1044]: 2026/09/20 10:51:43 INFO Signed narinfos id=18 count=14494lb # [ 68.216316] niks3-server[1044]: 2026/09/20 10:51:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4495worker1 # [ 68.215562] nix-grpc-daemon[884]: time=2026-09-20T10:51:43.853Z level=INFO msg="Uploading 3 narinfos"4496lb # [ 68.220680] niks3-server[1044]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4497lb # [ 68.223641] niks3-server[1044]: 2026/09/20 10:51:43 INFO Signed narinfos id=19 count=24498lb # [ 68.236390] niks3-server[1044]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4499lb # [ 68.249484] niks3-server[1044]: 2026/09/20 10:51:43 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4500lb # [ 68.254206] niks3-server[1044]: 2026/09/20 10:51:43 INFO Completed upload id=184501lb # [ 68.259847] niks3-server[1044]: 2026/09/20 10:51:43 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4502lb # [ 68.263739] niks3-server[1044]: 2026/09/20 10:51:43 INFO Completed upload id=194503worker1 # [ 68.261785] nix-grpc-daemon[884]: time=2026-09-20T10:51:43.901Z level=INFO msg="Upload complete. (546ms)"4504lb # [ 68.266260] niks3-server[1044]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4505lb # [ 68.270338] niks3-server[1044]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4506worker1 # [ 68.273943] nix-grpc-daemon[772]: ts=2026-09-20T10:51:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34676 duration_s=0 paths=2 nar_bytes_in=9844507worker1 # [ 68.288380] nix-grpc-daemon[772]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346764508worker1 # [ 68.302308] nix-daemon[833]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4509worker1 # [ 68.305860] nix-daemon[833]: reaped child process 975, status = succeeded4510client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4511worker1 # [ 68.318963] nix-daemon[833]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4512client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4513worker1 # [ 69.976694] nix-daemon[833]: reaped child process 989, status = succeeded4514worker1 # [ 70.161289] nix-daemon[833]: accepted connection from pid 1004, user nix-grpc-daemon (trusted)4515worker1 # [ 70.181575] nix-daemon[833]: reaped child process 1007, status = succeeded4516lb # [ 70.199363] niks3-server[1044]: 2026/09/20 10:51:45 INFO Received uploads request method=POST path=/api/pending_closures4517worker1 # [ 70.209097] nix-grpc-daemon[884]: time=2026-09-20T10:51:45.847Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4518lb # [ 70.234926] niks3-server[1044]: 2026/09/20 10:51:45 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4519lb # [ 70.247507] niks3-server[1044]: 2026/09/20 10:51:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4520worker1 # [ 70.252424] nix-grpc-daemon[884]: time=2026-09-20T10:51:45.891Z level=INFO msg="Uploading 1 narinfos"4521lb # [ 70.260172] niks3-server[1044]: 2026/09/20 10:51:45 INFO Signed narinfos id=20 count=14522lb # [ 70.263542] niks3-server[1044]: 2026/09/20 10:51:45 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4523lb # [ 70.276320] niks3-server[1044]: 2026/09/20 10:51:45 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4524lb # [ 70.287571] niks3-server[1044]: 2026/09/20 10:51:45 INFO Completed upload id=204525worker1 # [ 70.286276] nix-grpc-daemon[884]: time=2026-09-20T10:51:45.925Z level=INFO msg="Upload complete. (350ms)"4526lb # [ 70.291122] niks3-server[1044]: 2026/09/20 10:51:45 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4527client # copying 1 paths...4528worker1 # [ 70.301334] nix-grpc-daemon[772]: ts=2026-09-20T10:51:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34676 duration_s=2 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14529worker2 # [ 70.369210] nix-grpc-daemon[773]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:488964530worker1 # [ 70.320463] nix-daemon[833]: reaped child process 987, status = succeeded4531worker2 # [ 70.387599] nix-grpc-daemon[773]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4532client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4533worker1 # [ 70.380992] nix-grpc-daemon[772]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:346764534worker1 # [ 70.388480] nix-grpc-daemon[772]: ts=2026-09-20T10:51:46Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34676 duration_s=0 paths=1 nar_bytes_out=1204535client # [ 70.504992] nix-daemon[938]: reaped child process 1024, status = succeeded4536client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.69 seconds)4537client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24538client # [ 70.733748] nix-daemon[938]: accepted connection from pid 1043, user root (trusted)4539client # this derivation will be built:4540client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4541worker2 # [ 70.979809] nix-grpc-daemon[773]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:488964542client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4543worker2 # [ 70.988669] nix-grpc-daemon[773]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488964544worker1 # [ 70.949462] nix-grpc-daemon[772]: ts=2026-09-20T10:51:46Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04545worker1 # [ 70.956583] nix-grpc-daemon[772]: ts=2026-09-20T10:51:46Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14546worker2 # [ 71.022123] nix-grpc-daemon[773]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964547worker2 # [ 71.039462] nix-grpc-daemon[773]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488964548client # copying 1 paths to 'lb:50051'...4549client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4550worker2 # [ 71.064135] nix-grpc-daemon[773]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488964551worker2 # [ 71.081055] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4552worker2 # [ 71.107828] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 1/5)4553lb # [ 71.085646] envoy[925]: conn peer=[2001:db8:1::1]:43562 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3402 tx=1776 ms=25514554lb # [ 71.090836] envoy[925]: conn peer=[2001:db8:1::1]:52464 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=314555lb # [ 71.095865] envoy[925]: conn peer=[2001:db8:1::1]:52466 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3845 tx=1861 ms=20584556lb # [ 71.101035] envoy[925]: conn peer=[2001:db8:1::1]:52478 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=654557lb # [ 71.105851] envoy[925]: conn peer=[2001:db8:1::1]:52482 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4313 tx=2200 ms=19334558lb # [ 71.111958] envoy[925]: conn peer=[2001:db8:1::1]:52488 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=704559lb # [ 71.117811] envoy[925]: conn peer=[2001:db8:1::1]:52510 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=304560lb # [ 71.122705] envoy[925]: conn peer=[2001:db8:1::1]:52496 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3836 tx=1875 ms=31774561worker2 # [ 71.200283] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 2/5)4562worker2 # [ 71.214959] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 147 ms (attempt 3/5)4563worker2 # [ 71.371176] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 670 ms (attempt 4/5)4564worker2 # [ 72.050441] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4565worker2 # [ 72.059080] nix-grpc-daemon[773]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4566worker2 # [ 72.321381] nix-daemon[831]: accepted connection from pid 1137, user nix-grpc-daemon (trusted)4567worker2 # [ 72.342287] nix-daemon[831]: reaped child process 1140, status = succeeded4568worker2 # [ 72.528593] nix-daemon[831]: accepted connection from pid 1142, user nix-grpc-daemon (trusted)4569worker2 # [ 72.549564] nix-daemon[831]: reaped child process 1145, status = succeeded4570lb # [ 72.506651] niks3-server[1044]: 2026/09/20 10:51:48 INFO Received uploads request method=POST path=/api/pending_closures4571worker2 # [ 72.579710] nix-grpc-daemon[841]: time=2026-09-20T10:51:47.218Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4572worker2 # [ 72.581422] nix-grpc-daemon[841]: time=2026-09-20T10:51:47.218Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4573lb # [ 72.544090] niks3-server[1044]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4574worker2 # [ 72.619054] nix-grpc-daemon[841]: time=2026-09-20T10:51:47.258Z level=INFO msg="Uploading 1 narinfos"4575lb # [ 72.558977] niks3-server[1044]: 2026/09/20 10:51:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4576lb # [ 72.569593] niks3-server[1044]: 2026/09/20 10:51:48 INFO Signed narinfos id=21 count=14577lb # [ 72.576424] niks3-server[1044]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4578lb # [ 72.586494] niks3-server[1044]: 2026/09/20 10:51:48 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4579lb # [ 72.596439] niks3-server[1044]: 2026/09/20 10:51:48 INFO Completed upload id=214580worker2 # [ 72.656669] nix-grpc-daemon[841]: time=2026-09-20T10:51:47.295Z level=INFO msg="Upload complete. (558ms)"4581lb # [ 72.599412] niks3-server[1044]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4582worker2 # [ 72.670013] nix-grpc-daemon[773]: ts=2026-09-20T10:51:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=1 paths=1 nar_bytes_in=5684583worker2 # [ 72.683856] nix-grpc-daemon[773]: ts=2026-09-20T10:51:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488964584worker2 # [ 72.698437] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4585worker2 # [ 72.705376] nix-daemon[831]: reaped child process 1131, status = succeeded4586worker2 # [ 72.716546] nix-grpc-daemon[773]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4587worker2 # [ 72.738020] nix-daemon[831]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4588client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4589client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4590worker2 # [ 73.991879] nix-daemon[831]: reaped child process 1150, status = succeeded4591worker2 # [ 74.179616] nix-daemon[831]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)4592worker2 # [ 74.200480] nix-daemon[831]: reaped child process 1168, status = succeeded4593lb # [ 74.153884] niks3-server[1044]: 2026/09/20 10:51:49 INFO Received uploads request method=POST path=/api/pending_closures4594worker2 # [ 74.227070] nix-grpc-daemon[841]: time=2026-09-20T10:51:48.864Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4595lb # [ 74.191284] niks3-server[1044]: 2026/09/20 10:51:49 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4596lb # [ 74.204614] niks3-server[1044]: 2026/09/20 10:51:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4597worker2 # [ 74.270545] nix-grpc-daemon[841]: time=2026-09-20T10:51:48.909Z level=INFO msg="Uploading 1 narinfos"4598lb # [ 74.216735] niks3-server[1044]: 2026/09/20 10:51:49 INFO Signed narinfos id=22 count=14599lb # [ 74.224110] niks3-server[1044]: 2026/09/20 10:51:49 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4600lb # [ 74.236408] niks3-server[1044]: 2026/09/20 10:51:49 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4601worker2 # [ 74.296681] nix-grpc-daemon[841]: time=2026-09-20T10:51:48.935Z level=INFO msg="Upload complete. (338ms)"4602lb # [ 74.240573] niks3-server[1044]: 2026/09/20 10:51:49 INFO Completed upload id=224603lb # [ 74.244292] niks3-server[1044]: 2026/09/20 10:51:49 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4604worker2 # [ 74.309331] nix-grpc-daemon[773]: ts=2026-09-20T10:51:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14605worker2 # [ 74.328408] nix-daemon[831]: reaped child process 1147, status = succeeded4606client # copying 1 paths...4607worker2 # [ 74.354287] nix-grpc-daemon[773]: ts=2026-09-20T10:51:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:488964608client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4609worker2 # [ 74.388057] nix-grpc-daemon[773]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:488964610worker2 # [ 74.393487] nix-grpc-daemon[773]: ts=2026-09-20T10:51:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=0 paths=1 nar_bytes_out=1204611client # [ 74.479056] nix-daemon[938]: reaped child process 1046, status = succeeded4612client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.97 seconds)4613client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24614client # [ 74.704374] nix-daemon[938]: accepted connection from pid 1065, user root (trusted)4615client # this derivation will be built:4616client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4617worker2 # [ 74.952678] nix-grpc-daemon[773]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:488964618client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4619worker2 # [ 74.960897] nix-grpc-daemon[773]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488964620worker2 # [ 74.967882] nix-grpc-daemon[841]: time=2026-09-20T10:51:49.606Z level=INFO msg="All 1 paths already cached"4621worker1 # [ 74.923851] nix-grpc-daemon[772]: ts=2026-09-20T10:51:50Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04622worker1 # [ 74.933684] nix-grpc-daemon[772]: ts=2026-09-20T10:51:50Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14623worker1 # [ 74.942312] nix-grpc-daemon[772]: ts=2026-09-20T10:51:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346764624worker1 # [ 74.954921] nix-grpc-daemon[772]: ts=2026-09-20T10:51:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346764625client # copying 1 paths to 'lb:50051'...4626worker1 # [ 74.973180] nix-grpc-daemon[884]: time=2026-09-20T10:51:50.610Z level=INFO msg="All 1 paths already cached"4627client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4628worker1 # [ 74.980165] nix-grpc-daemon[772]: ts=2026-09-20T10:51:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346764629worker1 # [ 74.997135] nix-daemon[833]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4630worker1 # [ 75.211149] nix-daemon[833]: accepted connection from pid 1015, user nix-grpc-daemon (trusted)4631worker1 # [ 75.233673] nix-daemon[833]: reaped child process 1018, status = succeeded4632worker1 # [ 75.414494] nix-daemon[833]: accepted connection from pid 1020, user nix-grpc-daemon (trusted)4633worker1 # [ 75.433542] nix-daemon[833]: reaped child process 1023, status = succeeded4634lb # [ 75.450236] niks3-server[1044]: 2026/09/20 10:51:51 INFO Received uploads request method=POST path=/api/pending_closures4635worker1 # [ 75.457647] nix-grpc-daemon[884]: time=2026-09-20T10:51:51.096Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4636worker1 # [ 75.459205] nix-grpc-daemon[884]: time=2026-09-20T10:51:51.096Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4637lb # [ 75.480067] niks3-server[1044]: 2026/09/20 10:51:51 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4638lb # [ 75.496402] niks3-server[1044]: 2026/09/20 10:51:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4639worker1 # [ 75.500274] nix-grpc-daemon[884]: time=2026-09-20T10:51:51.139Z level=INFO msg="Uploading 1 narinfos"4640lb # [ 75.508380] niks3-server[1044]: 2026/09/20 10:51:51 INFO Signed narinfos id=23 count=14641lb # [ 75.514714] niks3-server[1044]: 2026/09/20 10:51:51 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4642lb # [ 75.520416] niks3-server[1044]: 2026/09/20 10:51:51 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4643lb # [ 75.529681] niks3-server[1044]: 2026/09/20 10:51:51 INFO Completed upload id=234644worker1 # [ 75.527795] nix-grpc-daemon[884]: time=2026-09-20T10:51:51.167Z level=INFO msg="Upload complete. (512ms)"4645lb # [ 75.532916] niks3-server[1044]: 2026/09/20 10:51:51 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4646worker1 # [ 75.536378] nix-grpc-daemon[772]: ts=2026-09-20T10:51:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34676 duration_s=0 paths=1 nar_bytes_in=5684647worker1 # [ 75.548826] nix-grpc-daemon[772]: ts=2026-09-20T10:51:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346764648worker1 # [ 75.560467] nix-daemon[833]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4649worker1 # [ 75.565987] nix-daemon[833]: reaped child process 1013, status = succeeded4650client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4651worker1 # [ 75.582139] nix-daemon[833]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4652client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4653worker1 # [ 76.408455] nix-daemon[833]: reaped child process 1027, status = succeeded4654worker1 # [ 76.575578] nix-daemon[833]: accepted connection from pid 1042, user nix-grpc-daemon (trusted)4655worker1 # [ 76.595269] nix-daemon[833]: reaped child process 1045, status = succeeded4656lb # [ 76.611228] niks3-server[1044]: 2026/09/20 10:51:52 INFO Received uploads request method=POST path=/api/pending_closures4657worker1 # [ 76.623846] nix-grpc-daemon[884]: time=2026-09-20T10:51:52.261Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4658lb # [ 76.652629] niks3-server[1044]: 2026/09/20 10:51:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4659worker1 # [ 76.659829] nix-grpc-daemon[884]: time=2026-09-20T10:51:52.299Z level=INFO msg="Uploading 1 narinfos"4660lb # [ 76.665983] niks3-server[1044]: 2026/09/20 10:51:52 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4661lb # [ 76.675240] niks3-server[1044]: 2026/09/20 10:51:52 INFO Signed narinfos id=24 count=14662lb # [ 76.678758] niks3-server[1044]: 2026/09/20 10:51:52 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4663worker1 # [ 76.683231] nix-grpc-daemon[884]: time=2026-09-20T10:51:52.322Z level=INFO msg="Upload complete. (289ms)"4664lb # [ 76.687292] niks3-server[1044]: 2026/09/20 10:51:52 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4665lb # [ 76.692248] niks3-server[1044]: 2026/09/20 10:51:52 INFO Completed upload id=244666lb # [ 76.694603] niks3-server[1044]: 2026/09/20 10:51:52 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4667worker1 # [ 76.692958] nix-grpc-daemon[772]: ts=2026-09-20T10:51:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34676 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14668worker1 # [ 76.707334] nix-daemon[833]: reaped child process 1025, status = succeeded4669client # copying 1 paths...4670worker1 # [ 76.739681] nix-grpc-daemon[772]: ts=2026-09-20T10:51:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:346764671client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4672worker2 # [ 76.840659] nix-grpc-daemon[773]: ts=2026-09-20T10:51:51Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:488964673worker2 # [ 76.856131] nix-grpc-daemon[773]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4674worker2 # [ 76.875532] nix-grpc-daemon[773]: ts=2026-09-20T10:51:51Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48896 duration_s=0 paths=1 nar_bytes_out=1204675client # [ 76.966655] nix-daemon[938]: reaped child process 1068, status = succeeded4676client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.49 seconds)4677(finished: subtest: an input only one worker has still reaches the builder, in 11.09 seconds)4678subtest: upload whose reference the worker lacks is completed from the cache4679client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4680client # this derivation will be built:4681client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4682client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4683client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.47 seconds)4684client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4685client # this derivation will be built:4686client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4687client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4688client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.46 seconds)4689client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4690client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds)4691worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4692worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.27 seconds)4693worker2 # [ 78.506625] systemd[1]: Stopping Nix worker-protocol over gRPC...4694worker2 # [ 78.517874] nix-grpc-daemon[773]: ts=2026-09-20T10:51:53Z level=info event=signal_exit4695worker2 # [ 79.765681] nix-grpc-daemon[773]: ts=2026-09-20T10:51:54Z level=info event=scheduler_restarting4696worker1 # [ 79.717225] nix-grpc-daemon[772]: ts=2026-09-20T10:51:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:346724697worker1 # [ 79.722372] nix-grpc-daemon[772]: ts=2026-09-20T10:51:55Z level=info event=worker_gone addr=192.168.1.4:500514698worker2 # [ 79.818329] nix-grpc-daemon[773]: ts=2026-09-20T10:51:54Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4699worker2 # [ 79.837720] nix-daemon[831]: reaped child process 833, status = succeeded4700worker2 # [ 80.110311] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4701worker2 # [ 80.117176] systemd[1]: Stopped Nix worker-protocol over gRPC.4702worker2 # [ 80.119739] systemd[1]: nix-grpc-daemon.service: Consumed 3.651s CPU time over 58.957s wall clock time, 61.6M memory peak, 84.1K incoming IP traffic, 153K outgoing IP traffic.4703worker2 # [ 80.138798] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4704worker2 # [ 80.144804] systemd[1]: Closed Nix worker-protocol over gRPC.4705worker2 # [ 80.147555] systemd[1]: nix-grpc-daemon.socket: Consumed 597us CPU time over 1min 8.664s wall clock time, 256K memory peak, 74.3K incoming IP traffic, 62.8K outgoing IP traffic.4706lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4707lb: must succeed: curl -sf localhost:9901/clusters4708lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4709lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4710client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24711worker1 # [ 80.429656] nix-grpc-daemon[772]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346764712worker1 # [ 80.436271] nix-grpc-daemon[772]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:346764713client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4714client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.30 seconds)4715worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4716worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4717worker2 # [ 80.642117] systemd[1]: Listening on Nix worker-protocol over gRPC.4718worker2 # [ 80.699548] systemd[1]: Starting Nix worker-protocol over gRPC...4719worker1 # [ 80.662585] systemd[1]: Stopping Nix worker-protocol over gRPC...4720worker2 # [ 80.909356] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4721worker2 # [ 80.911901] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14722worker2 # [ 80.920446] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4723worker2 # [ 80.922218] systemd[1]: Started Nix worker-protocol over gRPC.4724worker2 # [ 80.965959] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:55Z level=info event=scheduler_connected addr=lb:500514725worker1 # [ 80.907254] nix-grpc-daemon[772]: ts=2026-09-20T10:51:56Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04726lb # [ 81.083358] envoy[925]: conn peer=[2001:db8:1::1]:55656 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3710 tx=1803 ms=34664727lb # [ 81.088590] envoy[925]: conn peer=[2001:db8:1::1]:55668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=674728lb # [ 81.093622] envoy[925]: conn peer=[2001:db8:1::1]:55680 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1779 ms=19814729lb # [ 81.098607] envoy[925]: conn peer=[2001:db8:1::1]:55692 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1014730lb # [ 81.103393] envoy[925]: conn peer=[2001:db8:1::4]:36408 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9024 tx=2641 ms=582324731lb # [ 81.108660] envoy[925]: conn peer=[2001:db8:1::1]:55694 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=523 ms=284732worker1 # [ 81.449107] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=signal_exit4733worker1 # [ 81.706427] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=scheduler_yield4734worker2 # [ 81.778734] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:56Z level=info event=scheduler_restarting addr=lb:500514735worker1 # [ 81.718562] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:346724736lb # [ 81.720623] niks3-server[1044]: 2026/09/20 10:51:57 INFO lead: released remote=192.168.1.3:467864737worker1 # [ 81.727065] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=worker_gone addr=192.168.1.4:500514738worker1 # [ 81.731265] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=scheduler_restarting addr=lb:500514739worker1 # [ 81.735290] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:346724740worker1 # [ 81.739815] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=worker_gone addr=192.168.1.3:500514741worker2 # [ 81.981825] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:56Z level=info event=scheduler_connected addr=lb:500514742worker2 # [ 81.986276] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4743worker1 # [ 81.928475] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=scheduler_connected addr=lb:500514744worker1 # [ 81.932651] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4745worker2 # [ 82.182466] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:56Z level=info event=scheduler_connected addr=lb:500514746worker2 # [ 82.187869] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4747worker1 # [ 82.129002] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=scheduler_connected addr=lb:500514748worker1 # [ 82.134537] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4749worker2 # [ 82.388735] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:57Z level=info event=scheduler_connected addr=lb:500514750worker2 # [ 82.394160] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4751worker1 # [ 82.335367] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=scheduler_connected addr=lb:500514752worker1 # [ 82.340907] nix-grpc-daemon[772]: ts=2026-09-20T10:51:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4753worker2 # [ 82.595118] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:57Z level=info event=scheduler_connected addr=lb:500514754worker2 # [ 82.600609] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4755worker1 # [ 82.541784] nix-grpc-daemon[772]: ts=2026-09-20T10:51:58Z level=info event=scheduler_connected addr=lb:500514756worker1 # [ 82.547179] nix-grpc-daemon[772]: ts=2026-09-20T10:51:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4757worker1 # [ 82.712065] nix-grpc-daemon[772]: ts=2026-09-20T10:51:58Z level=info event=scheduler_restarting4758worker2 # [ 82.801504] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:57Z level=info event=scheduler_connected addr=lb:500514759worker2 # [ 82.807098] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4760worker1 # [ 82.769929] nix-daemon[833]: reaped child process 836, status = succeeded4761worker1 # [ 82.774541] nix-grpc-daemon[772]: ts=2026-09-20T10:51:58Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4762worker2 # [ 83.009315] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:57Z level=info event=scheduler_connected addr=lb:500514763worker2 # [ 83.014120] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4764worker2 # [ 83.215013] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:57Z level=info event=scheduler_connected addr=lb:500514765worker2 # [ 83.220254] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4766worker2 # [ 83.420872] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:58Z level=info event=scheduler_connected addr=lb:500514767worker2 # [ 83.426197] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4768worker2 # [ 83.626987] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:58Z level=info event=scheduler_connected addr=lb:500514769worker2 # [ 83.632462] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4770worker1 # [ 83.585243] nix-grpc-daemon[772]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4771worker1 # [ 83.589796] nix-grpc-daemon[772]: E0000 00:00:1789901519.223336 815 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4772worker1 # [ 83.613266] nix-grpc-daemon[772]: E0000 00:00:1789901519.252653 815 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4773worker2 # [ 83.833411] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:58Z level=info event=scheduler_connected addr=lb:500514774worker2 # [ 83.838760] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4775worker1 # [ 83.965706] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4776worker1 # [ 83.973401] systemd[1]: Stopped Nix worker-protocol over gRPC.4777worker2 # [ 84.041346] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:58Z level=info event=scheduler_connected addr=lb:500514778worker1 # [ 83.975969] systemd[1]: nix-grpc-daemon.service: Consumed 2.127s CPU time over 1min 2.872s wall clock time, 54.9M memory peak, 58.6K incoming IP traffic, 107.2K outgoing IP traffic.4779worker2 # [ 84.046173] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4780worker1 # [ 83.998935] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4781worker1 # [ 84.003270] systemd[1]: Closed Nix worker-protocol over gRPC.4782worker1 # [ 84.006210] systemd[1]: nix-grpc-daemon.socket: Consumed 580us CPU time over 1min 12.476s wall clock time, 256K memory peak, 79K incoming IP traffic, 69.6K outgoing IP traffic.4783lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4784lb: must succeed: curl -sf localhost:9901/clusters4785lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4786lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4787client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24788worker2 # [ 84.247208] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:58Z level=info event=scheduler_connected addr=lb:500514789worker2 # [ 84.252865] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4790worker2 # [ 84.406568] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508344791worker2 # [ 84.421725] nix-daemon[831]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)4792worker2 # [ 84.447808] nix-grpc-daemon[1190]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 1/5)4793worker2 # [ 84.456721] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=info event=scheduler_connected addr=lb:500514794worker2 # [ 84.461846] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4795worker2 # [ 84.503708] nix-grpc-daemon[1190]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 2/5)4796worker2 # [ 84.543384] nix-grpc-daemon[1190]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 117 ms (attempt 3/5)4797worker2 # [ 84.662763] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=info event=scheduler_connected addr=lb:500514798worker2 # [ 84.668556] nix-grpc-daemon[1190]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 200 ms (attempt 4/5)4799worker2 # [ 84.675737] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4800worker2 # [ 84.871648] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=info event=scheduler_connected addr=lb:500514801worker2 # [ 84.878031] nix-grpc-daemon[1190]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4802worker2 # [ 84.885886] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4803client # copying 2 paths...4804client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4805worker2 # [ 84.907916] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508344806client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4807worker2 # [ 84.926405] nix-daemon[831]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)4808worker2 # [ 84.959185] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=info event=niks3_push_started pid=12464809worker2 # [ 85.072987] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=info event=scheduler_connected addr=lb:500514810worker2 # [ 85.075142] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4811worker2 # [ 85.276151] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=info event=scheduler_connected addr=lb:500514812worker2 # [ 85.278448] nix-grpc-daemon[1190]: ts=2026-09-20T10:51:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4813worker2 # [ 85.363761] nix-daemon[831]: accepted connection from pid 1259, user nix-grpc-daemon (trusted)4814worker2 # [ 85.382232] nix-daemon[831]: reaped child process 1262, status = succeeded4815lb # [ 85.338636] niks3-server[1044]: 2026/09/20 10:52:00 INFO Received uploads request method=POST path=/api/pending_closures4816lb # [ 85.349101] niks3-server[1044]: 2026/09/20 10:52:00 INFO Received uploads request method=POST path=/api/pending_closures4817worker2 # [ 85.420513] nix-grpc-daemon[1246]: time=2026-09-20T10:52:00.058Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4818worker2 # [ 85.422057] nix-grpc-daemon[1246]: time=2026-09-20T10:52:00.058Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4819worker2 # [ 85.423782] nix-grpc-daemon[1246]: time=2026-09-20T10:52:00.058Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4820lb # [ 85.402065] niks3-server[1044]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4821worker2 # [ 85.479003] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:00Z level=info event=scheduler_connected addr=lb:500514822lb # [ 85.417479] niks3-server[1044]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4823worker2 # [ 85.484457] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4824lb # [ 85.427282] niks3-server[1044]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4825lb # [ 85.434835] niks3-server[1044]: 2026/09/20 10:52:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4826worker2 # [ 85.496157] nix-grpc-daemon[1246]: time=2026-09-20T10:52:00.134Z level=INFO msg="Uploading 3 narinfos"4827lb # [ 85.439528] niks3-server[1044]: 2026/09/20 10:52:01 INFO Signed narinfos id=26 count=24828lb # [ 85.445505] niks3-server[1044]: 2026/09/20 10:52:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4829lb # [ 85.452312] niks3-server[1044]: 2026/09/20 10:52:01 INFO Signed narinfos id=25 count=14830lb # [ 85.456858] niks3-server[1044]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4831lb # [ 85.471956] niks3-server[1044]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4832lb # [ 85.477140] niks3-server[1044]: 2026/09/20 10:52:01 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4833lb # [ 85.482505] niks3-server[1044]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4834lb # [ 85.486612] niks3-server[1044]: 2026/09/20 10:52:01 INFO Completed upload id=254835lb # [ 85.490011] niks3-server[1044]: 2026/09/20 10:52:01 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4836lb # [ 85.493030] niks3-server[1044]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4837lb # [ 85.495359] niks3-server[1044]: 2026/09/20 10:52:01 INFO Completed upload id=264838worker2 # [ 85.553542] nix-grpc-daemon[1246]: time=2026-09-20T10:52:00.192Z level=INFO msg="Upload complete. (365ms)"4839worker2 # [ 85.564710] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50834 duration_s=0 paths=2 nar_bytes_in=3124840worker2 # [ 85.583052] nix-daemon[831]: reaped child process 1244, status = succeeded4841client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.45 seconds)4842worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4843worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4844worker2 # [ 85.685797] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:00Z level=info event=scheduler_connected addr=lb:500514845worker2 # [ 85.691451] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4846worker1 # [ 85.669100] systemd[1]: Listening on Nix worker-protocol over gRPC.4847worker1 # [ 85.676317] systemd[1]: Starting Nix worker-protocol over gRPC...4848worker2 # [ 85.892499] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:00Z level=info event=scheduler_connected addr=lb:500514849worker2 # [ 85.898400] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4850lb # [ 85.877131] niks3-server[1044]: 2026/09/20 10:52:01 INFO lead: acquired remote=192.168.1.4:535984851worker2 # [ 85.937682] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:00Z level=info event=scheduler_take_over4852worker1 # [ 85.879059] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4853worker1 # [ 85.881825] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14854worker1 # [ 85.889982] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4855worker1 # [ 85.891870] systemd[1]: Started Nix worker-protocol over gRPC.4856lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4857lb: must succeed: curl -sf localhost:9901/clusters4858worker1 # [ 85.933865] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:01Z level=info event=scheduler_connected addr=lb:500514859worker2 # [ 86.005700] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:00Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04860lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4861lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4862(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.05 seconds)4863subtest: scheduler down: the other node takes the lock and keeps it4864lb: must succeed: curl -sf localhost:9901/clusters4865worker2 # [ 86.101709] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:00Z level=info event=scheduler_connected addr=lb:500514866worker2 # [ 86.106023] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:00Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04867lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4868lb: must succeed: curl -sf localhost:9901/clusters4869lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4870lb: must succeed: curl -sf localhost:9901/clusters4871lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4872lb: must succeed: curl -sf localhost:9901/clusters4873lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4874worker2 # [ 86.338611] systemd[1]: Stopping Nix worker-protocol over gRPC...4875worker2 # [ 86.932512] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:01Z level=info event=signal_exit4876worker2 # [ 87.145525] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:01Z level=info event=scheduler_yield4877lb # [ 87.093248] niks3-server[1044]: 2026/09/20 10:52:02 INFO lead: released remote=192.168.1.4:535984878worker2 # [ 87.155530] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:01Z level=info event=scheduler_restarting addr=lb:500514879worker2 # [ 87.161730] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:508464880worker1 # [ 87.101601] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:02Z level=info event=scheduler_restarting addr=lb:500514881worker2 # [ 87.168466] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:01Z level=info event=worker_gone addr=192.168.1.4:500514882worker2 # [ 87.172563] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:508464883worker2 # [ 87.176974] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:01Z level=info event=worker_gone addr=192.168.1.3:500514884worker2 # [ 87.356941] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:01Z level=info event=scheduler_connected addr=lb:500514885worker1 # [ 87.301208] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:02Z level=info event=scheduler_connected addr=lb:500514886worker1 # [ 87.316689] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4887worker2 # [ 87.378956] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4888worker1 # [ 87.517699] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:03Z level=info event=scheduler_connected addr=lb:500514889worker2 # [ 87.580139] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:02Z level=info event=scheduler_connected addr=lb:500514890worker1 # [ 87.525426] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4891worker2 # [ 87.587822] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4892worker1 # [ 87.726517] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:03Z level=info event=scheduler_connected addr=lb:500514893worker2 # [ 87.788955] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:02Z level=info event=scheduler_connected addr=lb:500514894worker2 # [ 87.796419] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4895worker1 # [ 87.734652] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4896worker1 # [ 87.935904] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:03Z level=info event=scheduler_connected addr=lb:500514897worker2 # [ 87.997404] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:02Z level=info event=scheduler_connected addr=lb:500514898worker2 # [ 88.003236] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4899worker1 # [ 87.941382] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4900worker2 # [ 88.155902] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:02Z level=info event=scheduler_restarting4901worker2 # [ 88.182497] nix-daemon[831]: reaped child process 1239, status = succeeded4902worker1 # [ 88.144379] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:03Z level=info event=scheduler_connected addr=lb:500514903worker1 # [ 88.148718] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4904worker2 # [ 88.221770] nix-grpc-daemon[1190]: ts=2026-09-20T10:52:02Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4905worker1 # [ 88.345434] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:03Z level=info event=scheduler_connected addr=lb:500514906worker1 # [ 88.350819] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4907worker1 # [ 88.551873] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:04Z level=info event=scheduler_connected addr=lb:500514908worker1 # [ 88.557395] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4909worker1 # [ 88.758352] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:04Z level=info event=scheduler_connected addr=lb:500514910worker1 # [ 88.763812] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4911worker2 # [ 88.967299] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4912worker2 # [ 88.971376] systemd[1]: Stopped Nix worker-protocol over gRPC.4913worker2 # [ 88.977219] systemd[1]: nix-grpc-daemon.service: Consumed 534ms CPU time over 8.264s wall clock time, 33.3M memory peak, 21.6K incoming IP traffic, 29.9K outgoing IP traffic.4914worker2 # [ 88.990562] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4915worker2 # [ 88.993376] systemd[1]: Closed Nix worker-protocol over gRPC.4916worker2 # [ 88.995089] systemd[1]: nix-grpc-daemon.socket: Consumed 911us CPU time over 8.359s wall clock time, 256K memory peak, 24.4K incoming IP traffic, 20.1K outgoing IP traffic.4917worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4918worker1 # [ 88.964918] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:04Z level=info event=scheduler_connected addr=lb:500514919worker1 # [ 88.978092] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4920worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.10 seconds)4921worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4922worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)4923worker1 # [ 89.172813] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:04Z level=info event=scheduler_connected addr=lb:500514924worker1 # [ 89.177175] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4925worker1 # [ 89.378010] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:05Z level=info event=scheduler_connected addr=lb:500514926worker1 # [ 89.383228] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4927worker1 # [ 89.584129] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:05Z level=info event=scheduler_connected addr=lb:500514928worker1 # [ 89.589242] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4929worker1 # [ 89.790065] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:05Z level=info event=scheduler_connected addr=lb:500514930worker1 # [ 89.795300] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4931worker1 # [ 89.996044] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:05Z level=info event=scheduler_connected addr=lb:500514932worker1 # [ 90.001335] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4933worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4934worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4935worker1 # [ 90.203447] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:05Z level=info event=scheduler_connected addr=lb:500514936worker1 # [ 90.207213] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4937worker1 # [ 90.404546] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:06Z level=info event=scheduler_connected addr=lb:500514938worker1 # [ 90.409957] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4939worker1 # [ 90.610733] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:06Z level=info event=scheduler_connected addr=lb:500514940worker1 # [ 90.616214] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4941worker1 # [ 90.817222] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:06Z level=info event=scheduler_connected addr=lb:500514942worker1 # [ 90.822987] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4943lb # [ 90.905725] niks3-server[1044]: 2026/09/20 10:52:06 INFO lead: acquired remote=192.168.1.3:504984944worker1 # [ 90.903237] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:06Z level=info event=scheduler_take_over4945worker1 # [ 91.023663] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:06Z level=info event=scheduler_connected addr=lb:500514946worker1 # [ 91.042607] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04947lb # [ 91.087287] envoy[925]: conn peer=[2001:db8:1::3]:37160 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8946 tx=2411 ms=612784948lb # [ 91.092673] envoy[925]: conn peer=[2001:db8:1::1]:58186 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=281 ms=11734949lb # [ 91.097512] envoy[925]: conn peer=[2001:db8:1::4]:48746 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3789 tx=1125 ms=72474950worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4951worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4952client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24953worker1 # [ 91.501368] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:540224954worker1 # [ 91.517507] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4955client # don't know how to build these paths:4956client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4957worker1 # [ 91.539429] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540224958worker1 # [ 91.557095] nix-grpc-daemon[1068]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5)4959worker1 # [ 91.624368] nix-grpc-daemon[1068]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 2/5)4960worker1 # [ 91.758067] nix-grpc-daemon[1068]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 259 ms (attempt 3/5)4961worker1 # [ 92.017546] nix-grpc-daemon[1068]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 668 ms (attempt 4/5)4962worker1 # [ 92.695388] nix-grpc-daemon[1068]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4963worker1 # [ 92.734926] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:08Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04964worker1 # [ 92.742592] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:08Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14965worker1 # [ 92.783041] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540224966worker1 # [ 92.801005] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540224967client # copying 1 paths to 'lb:50051'...4968worker1 # [ 92.816139] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540224969client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4970worker1 # [ 92.834624] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4971worker1 # [ 92.862574] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:08Z level=info event=niks3_push_started pid=11414972worker1 # [ 93.252079] nix-daemon[833]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)4973worker1 # [ 93.272321] nix-daemon[833]: reaped child process 1157, status = succeeded4974worker1 # [ 93.448119] nix-daemon[833]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)4975worker1 # [ 93.465467] nix-daemon[833]: reaped child process 1162, status = succeeded4976lb # [ 93.482086] niks3-server[1044]: 2026/09/20 10:52:09 INFO Received uploads request method=POST path=/api/pending_closures4977worker1 # [ 93.495638] nix-grpc-daemon[1141]: time=2026-09-20T10:52:09.133Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4978worker1 # [ 93.497644] nix-grpc-daemon[1141]: time=2026-09-20T10:52:09.133Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4979lb # [ 93.539589] niks3-server[1044]: 2026/09/20 10:52:09 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4980worker1 # [ 93.547591] nix-grpc-daemon[1141]: time=2026-09-20T10:52:09.186Z level=INFO msg="Uploading 1 narinfos"4981lb # [ 93.552644] niks3-server[1044]: 2026/09/20 10:52:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4982lb # [ 93.565926] niks3-server[1044]: 2026/09/20 10:52:09 INFO Signed narinfos id=27 count=14983lb # [ 93.576306] niks3-server[1044]: 2026/09/20 10:52:09 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4984lb # [ 93.579849] niks3-server[1044]: 2026/09/20 10:52:09 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4985lb # [ 93.585778] niks3-server[1044]: 2026/09/20 10:52:09 INFO Completed upload id=274986worker1 # [ 93.583854] nix-grpc-daemon[1141]: time=2026-09-20T10:52:09.223Z level=INFO msg="Upload complete. (501ms)"4987lb # [ 93.588952] niks3-server[1044]: 2026/09/20 10:52:09 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4988worker1 # [ 93.592324] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54022 duration_s=0 paths=1 nar_bytes_in=5204989worker1 # [ 93.610943] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540224990worker1 # [ 93.618195] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4991worker1 # [ 93.623846] nix-daemon[833]: reaped child process 1139, status = succeeded4992client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4993client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4994worker1 # [ 93.640154] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4995client # farm-a> LOG-farm-a-on-standby4996worker1 # [ 95.271168] nix-daemon[833]: reaped child process 1166, status = succeeded4997worker1 # [ 95.431854] nix-daemon[833]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)4998worker1 # [ 95.451690] nix-daemon[833]: reaped child process 1184, status = succeeded4999lb # [ 95.466238] niks3-server[1044]: 2026/09/20 10:52:11 INFO Received uploads request method=POST path=/api/pending_closures5000worker1 # [ 95.476461] nix-grpc-daemon[1141]: time=2026-09-20T10:52:11.113Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5001worker1 # [ 95.477965] nix-grpc-daemon[1141]: time=2026-09-20T10:52:11.113Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5002lb # [ 95.505666] niks3-server[1044]: 2026/09/20 10:52:11 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5003lb # [ 95.524504] niks3-server[1044]: 2026/09/20 10:52:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5004worker1 # [ 95.527933] nix-grpc-daemon[1141]: time=2026-09-20T10:52:11.166Z level=INFO msg="Uploading 1 narinfos"5005lb # [ 95.534141] niks3-server[1044]: 2026/09/20 10:52:11 INFO Signed narinfos id=28 count=15006lb # [ 95.540403] niks3-server[1044]: 2026/09/20 10:52:11 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5007lb # [ 95.546562] niks3-server[1044]: 2026/09/20 10:52:11 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5008worker1 # [ 95.550391] nix-grpc-daemon[1141]: time=2026-09-20T10:52:11.189Z level=INFO msg="Upload complete. (298ms)"5009lb # [ 95.554314] niks3-server[1044]: 2026/09/20 10:52:11 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5010lb # [ 95.559262] niks3-server[1044]: 2026/09/20 10:52:11 INFO Completed upload id=285011lb # [ 95.561689] niks3-server[1044]: 2026/09/20 10:52:11 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5012worker1 # [ 95.568541] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54022 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15013worker1 # [ 95.580362] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:11Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05014worker1 # [ 95.583331] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:11Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15015worker1 # [ 95.586705] nix-daemon[833]: reaped child process 1164, status = succeeded5016worker1 # [ 95.611108] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540225017worker1 # [ 95.625677] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540225018worker1 # [ 95.638931] nix-grpc-daemon[1141]: time=2026-09-20T10:52:11.278Z level=INFO msg="All 1 paths already cached"5019client # copying 1 paths to 'lb:50051'...5020worker1 # [ 95.648921] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540225021client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5022worker1 # [ 95.665900] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)5023worker1 # [ 95.860545] nix-daemon[833]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)5024worker1 # [ 95.880804] nix-daemon[833]: reaped child process 1193, status = succeeded5025worker1 # [ 96.053287] nix-daemon[833]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5026worker1 # [ 96.072640] nix-daemon[833]: reaped child process 1198, status = succeeded5027lb # [ 96.086019] niks3-server[1044]: 2026/09/20 10:52:11 INFO Received uploads request method=POST path=/api/pending_closures5028worker1 # [ 96.092855] nix-grpc-daemon[1141]: time=2026-09-20T10:52:11.731Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5029worker1 # [ 96.094331] nix-grpc-daemon[1141]: time=2026-09-20T10:52:11.731Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5030worker1 # [ 96.124315] nix-grpc-daemon[1141]: time=2026-09-20T10:52:11.763Z level=INFO msg="Uploading 1 narinfos"5031lb # [ 96.115899] niks3-server[1044]: 2026/09/20 10:52:11 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5032lb # [ 96.132180] niks3-server[1044]: 2026/09/20 10:52:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5033lb # [ 96.142639] niks3-server[1044]: 2026/09/20 10:52:11 INFO Signed narinfos id=29 count=15034worker1 # [ 96.151037] nix-grpc-daemon[1141]: time=2026-09-20T10:52:11.790Z level=INFO msg="Upload complete. (469ms)"5035lb # [ 96.153967] niks3-server[1044]: 2026/09/20 10:52:11 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5036worker1 # [ 96.156218] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54022 duration_s=0 paths=1 nar_bytes_in=6405037lb # [ 96.159806] niks3-server[1044]: 2026/09/20 10:52:11 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5038lb # [ 96.165317] niks3-server[1044]: 2026/09/20 10:52:11 INFO Completed upload id=295039lb # [ 96.167848] niks3-server[1044]: 2026/09/20 10:52:11 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5040worker1 # [ 96.169666] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540225041worker1 # [ 96.175426] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)5042worker1 # [ 96.180397] nix-daemon[833]: reaped child process 1188, status = succeeded5043client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5044worker1 # [ 96.192716] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)5045client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5046client # farm-b> LOG-farm-b-on-standby5047worker1 # [ 97.238473] nix-daemon[833]: reaped child process 1202, status = succeeded5048worker1 # [ 97.423469] nix-daemon[833]: accepted connection from pid 1217, user nix-grpc-daemon (trusted)5049worker1 # [ 97.442267] nix-daemon[833]: reaped child process 1220, status = succeeded5050lb # [ 97.458484] niks3-server[1044]: 2026/09/20 10:52:13 INFO Received uploads request method=POST path=/api/pending_closures5051worker1 # [ 97.469259] nix-grpc-daemon[1141]: time=2026-09-20T10:52:13.107Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5052worker1 # [ 97.470739] nix-grpc-daemon[1141]: time=2026-09-20T10:52:13.107Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5053lb # [ 97.498602] niks3-server[1044]: 2026/09/20 10:52:13 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5054lb # [ 97.516684] niks3-server[1044]: 2026/09/20 10:52:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5055worker1 # [ 97.523639] nix-grpc-daemon[1141]: time=2026-09-20T10:52:13.162Z level=INFO msg="Uploading 1 narinfos"5056lb # [ 97.528007] niks3-server[1044]: 2026/09/20 10:52:13 INFO Signed narinfos id=30 count=15057lb # [ 97.530179] niks3-server[1044]: 2026/09/20 10:52:13 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5058lb # [ 97.540401] niks3-server[1044]: 2026/09/20 10:52:13 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5059lb # [ 97.545435] niks3-server[1044]: 2026/09/20 10:52:13 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5060lb # [ 97.555968] niks3-server[1044]: 2026/09/20 10:52:13 INFO Completed upload id=305061worker1 # [ 97.553951] nix-grpc-daemon[1141]: time=2026-09-20T10:52:13.193Z level=INFO msg="Upload complete. (351ms)"5062lb # [ 97.558317] niks3-server[1044]: 2026/09/20 10:52:13 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5063worker1 # [ 97.571942] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54022 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15064worker1 # [ 97.588543] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:13Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05065worker1 # [ 97.593396] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:13Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15066worker1 # [ 97.597583] nix-daemon[833]: reaped child process 1200, status = succeeded5067worker1 # [ 97.615316] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540225068worker1 # [ 97.631331] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540225069worker1 # [ 97.646779] nix-grpc-daemon[1141]: time=2026-09-20T10:52:13.286Z level=INFO msg="All 2 paths already cached"5070client # copying 1 paths to 'lb:50051'...5071client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5072worker1 # [ 97.657358] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540225073worker1 # [ 97.671263] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)5074worker1 # [ 97.866825] nix-daemon[833]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5075worker1 # [ 97.887523] nix-daemon[833]: reaped child process 1229, status = succeeded5076worker1 # [ 98.060304] nix-daemon[833]: accepted connection from pid 1231, user nix-grpc-daemon (trusted)5077worker1 # [ 98.077962] nix-daemon[833]: reaped child process 1234, status = succeeded5078lb # [ 98.093212] niks3-server[1044]: 2026/09/20 10:52:13 INFO Received uploads request method=POST path=/api/pending_closures5079worker1 # [ 98.103742] nix-grpc-daemon[1141]: time=2026-09-20T10:52:13.742Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5080worker1 # [ 98.105447] nix-grpc-daemon[1141]: time=2026-09-20T10:52:13.742Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5081lb # [ 98.128104] niks3-server[1044]: 2026/09/20 10:52:13 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5082worker1 # [ 98.140408] nix-grpc-daemon[1141]: time=2026-09-20T10:52:13.779Z level=INFO msg="Uploading 1 narinfos"5083lb # [ 98.145158] niks3-server[1044]: 2026/09/20 10:52:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5084lb # [ 98.154734] niks3-server[1044]: 2026/09/20 10:52:13 INFO Signed narinfos id=31 count=15085lb # [ 98.159857] niks3-server[1044]: 2026/09/20 10:52:13 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5086worker1 # [ 98.166342] nix-grpc-daemon[1141]: time=2026-09-20T10:52:13.805Z level=INFO msg="Upload complete. (479ms)"5087lb # [ 98.170053] niks3-server[1044]: 2026/09/20 10:52:13 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5088lb # [ 98.175332] niks3-server[1044]: 2026/09/20 10:52:13 INFO Completed upload id=315089lb # [ 98.178641] niks3-server[1044]: 2026/09/20 10:52:13 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5090worker1 # [ 98.172236] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54022 duration_s=0 paths=1 nar_bytes_in=7685091worker1 # [ 98.186746] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540225092worker1 # [ 98.193825] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)5093worker1 # [ 98.198887] nix-daemon[833]: reaped child process 1224, status = succeeded5094client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5095worker1 # [ 98.210206] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)5096client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5097client # farm-top> LOG-farm-top-on-standby5098worker1 # [ 99.042740] nix-daemon[833]: reaped child process 1238, status = succeeded5099worker1 # [ 99.207304] nix-daemon[833]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5100worker1 # [ 99.227088] nix-daemon[833]: reaped child process 1256, status = succeeded5101lb # [ 99.242579] niks3-server[1044]: 2026/09/20 10:52:14 INFO Received uploads request method=POST path=/api/pending_closures5102worker1 # [ 99.252430] nix-grpc-daemon[1141]: time=2026-09-20T10:52:14.890Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5103worker1 # [ 99.254091] nix-grpc-daemon[1141]: time=2026-09-20T10:52:14.890Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5104lb # [ 99.280630] niks3-server[1044]: 2026/09/20 10:52:14 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5105lb # [ 99.292496] niks3-server[1044]: 2026/09/20 10:52:14 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5106lb # [ 99.303269] niks3-server[1044]: 2026/09/20 10:52:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5107lb # [ 99.309356] niks3-server[1044]: 2026/09/20 10:52:14 INFO Signed narinfos id=32 count=15108worker1 # [ 99.307611] nix-grpc-daemon[1141]: time=2026-09-20T10:52:14.946Z level=INFO msg="Uploading 1 narinfos"5109lb # [ 99.313835] niks3-server[1044]: 2026/09/20 10:52:14 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5110lb # [ 99.325642] niks3-server[1044]: 2026/09/20 10:52:14 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5111lb # [ 99.333232] niks3-server[1044]: 2026/09/20 10:52:14 INFO Completed upload id=325112worker1 # [ 99.331250] nix-grpc-daemon[1141]: time=2026-09-20T10:52:14.970Z level=INFO msg="Upload complete. (309ms)"5113lb # [ 99.336188] niks3-server[1044]: 2026/09/20 10:52:14 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5114worker1 # [ 99.345289] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54022 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15115worker1 # [ 99.362280] nix-daemon[833]: reaped child process 1236, status = succeeded5116client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.14 seconds)5117client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5118client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5119worker2 # [ 99.748555] systemd[1]: Listening on Nix worker-protocol over gRPC.5120worker2 # [ 99.751201] systemd[1]: Starting Nix worker-protocol over gRPC...5121worker2 # [ 99.933101] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5122worker2 # [ 99.936366] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15123worker2 # [ 99.946532] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5124worker2 # [ 99.951322] systemd[1]: Started Nix worker-protocol over gRPC.5125lb: must succeed: curl -sf localhost:9901/clusters5126worker2 # [ 99.992315] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:14Z level=info event=scheduler_connected addr=lb:500515127worker1 # [ 99.933271] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:15Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05128lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)5129worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5130worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5131lb: must succeed: curl -sf localhost:9901/clusters5132lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5133lb: must succeed: curl -sf localhost:9901/clusters5134lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5135worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5136worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5137(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.29 seconds)5138subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5139client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5140client # [ 100.395508] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5141client # Running as unit: rs.service; invocation ID: e4a093e10db441a4bda3295cd30590035142client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5143worker1 # [ 100.611722] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:540225144client # [ 100.643068] nix[1168]: don't know how to build these paths:5145client # [ 100.644065] nix[1168]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5146worker1 # [ 100.631326] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:16Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05147worker1 # [ 100.638589] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:16Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15148worker1 # [ 100.677852] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540225149worker1 # [ 100.694828] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540225150client # [ 100.731025] nix[1168]: copying 1 paths to 'lb:50051'...5151client # [ 100.736356] nix[1168]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5152worker1 # [ 100.712116] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540225153worker1 # [ 100.727157] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)5154worker1 # [ 100.931817] nix-daemon[833]: accepted connection from pid 1269, user nix-grpc-daemon (trusted)5155worker1 # [ 100.951245] nix-daemon[833]: reaped child process 1272, status = succeeded5156lb # [ 101.085173] envoy[925]: conn peer=[2001:db8:1::1]:58490 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9593 tx=3894 ms=78605157worker1 # [ 101.126384] nix-daemon[833]: accepted connection from pid 1274, user nix-grpc-daemon (trusted)5158worker1 # [ 101.144727] nix-daemon[833]: reaped child process 1277, status = succeeded5159lb # [ 101.158800] niks3-server[1044]: 2026/09/20 10:52:16 INFO Received uploads request method=POST path=/api/pending_closures5160worker1 # [ 101.166580] nix-grpc-daemon[1141]: time=2026-09-20T10:52:16.805Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5161worker1 # [ 101.168112] nix-grpc-daemon[1141]: time=2026-09-20T10:52:16.805Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5162lb # [ 101.185279] niks3-server[1044]: 2026/09/20 10:52:16 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5163worker1 # [ 101.196712] nix-grpc-daemon[1141]: time=2026-09-20T10:52:16.836Z level=INFO msg="Uploading 1 narinfos"5164lb # [ 101.202420] niks3-server[1044]: 2026/09/20 10:52:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5165lb # [ 101.212948] niks3-server[1044]: 2026/09/20 10:52:16 INFO Signed narinfos id=33 count=15166lb # [ 101.215663] niks3-server[1044]: 2026/09/20 10:52:16 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5167lb # [ 101.222573] niks3-server[1044]: 2026/09/20 10:52:16 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5168worker1 # [ 101.227078] nix-grpc-daemon[1141]: time=2026-09-20T10:52:16.866Z level=INFO msg="Upload complete. (483ms)"5169lb # [ 101.229868] niks3-server[1044]: 2026/09/20 10:52:16 INFO Completed upload id=335170lb # [ 101.232337] niks3-server[1044]: 2026/09/20 10:52:16 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5171worker1 # [ 101.236227] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54022 duration_s=0 paths=1 nar_bytes_in=4165172worker1 # [ 101.245778] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540225173worker1 # [ 101.252418] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)5174worker1 # [ 101.257035] nix-daemon[833]: reaped child process 1267, status = succeeded5175client # [ 101.290863] nix[1168]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5176worker1 # [ 101.270011] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)5177lb: must succeed: curl -sf localhost:9901/clusters5178lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5179lb: must succeed: curl -sf localhost:9901/clusters5180lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5181lb: must succeed: curl -sf localhost:9901/clusters5182lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5183lb: must succeed: curl -sf localhost:9901/clusters5184lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5185worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5186worker2 # [ 103.382069] systemd-journald[273]: Received client request to rotate journal, rotating.5187worker2 # [ 103.406407] systemd-journald[273]: Vacuuming done, freed 0B of archived journals from /var/log/journal/da3fbd5d11274571a1f665c1ec7a2c81.5188worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5189worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5190worker1 # [ 103.399263] systemd[1]: Stopping Nix worker-protocol over gRPC...5191worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5192??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5193 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735194client: must succeed: sleep 5.05195worker1 # [ 103.905654] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:19Z level=info event=draining5196client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5197worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5198worker1 # [ 108.918978] nix-daemon[833]: reaped child process 1281, status = succeeded5199worker1 # [ 109.101323] nix-daemon[833]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5200worker1 # [ 109.121196] nix-daemon[833]: reaped child process 1324, status = succeeded5201lb # [ 109.138361] niks3-server[1044]: 2026/09/20 10:52:24 INFO Received uploads request method=POST path=/api/pending_closures5202worker1 # [ 109.147072] nix-grpc-daemon[1141]: time=2026-09-20T10:52:24.783Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5203worker1 # [ 109.148780] nix-grpc-daemon[1141]: time=2026-09-20T10:52:24.783Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5204lb # [ 109.179753] niks3-server[1044]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5205worker1 # [ 109.190195] nix-grpc-daemon[1141]: time=2026-09-20T10:52:24.829Z level=INFO msg="Uploading 1 narinfos"5206lb # [ 109.193067] niks3-server[1044]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5207lb # [ 109.202054] niks3-server[1044]: 2026/09/20 10:52:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5208lb # [ 109.208234] niks3-server[1044]: 2026/09/20 10:52:24 INFO Signed narinfos id=34 count=15209worker1 # [ 109.212769] nix-grpc-daemon[1141]: time=2026-09-20T10:52:24.852Z level=INFO msg="Upload complete. (327ms)"5210lb # [ 109.215364] niks3-server[1044]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5211lb # [ 109.218750] niks3-server[1044]: 2026/09/20 10:52:24 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5212lb # [ 109.223894] niks3-server[1044]: 2026/09/20 10:52:24 INFO Completed upload id=345213lb # [ 109.226208] niks3-server[1044]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5214worker1 # [ 109.225059] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54022 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15215worker1 # [ 109.239104] nix-daemon[833]: reaped child process 1279, status = succeeded5216client # [ 109.295598] systemd[1]: rs.service: Deactivated successfully.5217client # [ 109.300212] systemd[1]: rs.service: Consumed 158ms CPU time over 8.903s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5218worker1 # [ 109.906690] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:25Z level=info event=signal_exit5219worker1 # [ 110.127168] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:25Z level=info event=scheduler_yield5220lb # [ 110.132248] niks3-server[1044]: 2026/09/20 10:52:25 INFO lead: released remote=192.168.1.3:504985221worker2 # [ 110.196415] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:24Z level=info event=scheduler_restarting addr=lb:500515222worker1 # [ 110.141456] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:540065223worker1 # [ 110.148419] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:25Z level=info event=worker_gone addr=192.168.1.4:500515224worker1 # [ 110.152596] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:25Z level=info event=scheduler_restarting addr=lb:500515225worker1 # [ 110.156563] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:540065226worker1 # [ 110.160892] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:25Z level=info event=worker_gone addr=192.168.1.3:500515227worker2 # [ 110.396479] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:25Z level=info event=scheduler_connected addr=lb:500515228worker2 # [ 110.402003] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5229worker1 # [ 110.349785] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:25Z level=info event=scheduler_connected addr=lb:500515230worker1 # [ 110.353975] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5231worker2 # [ 110.602822] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:25Z level=info event=scheduler_connected addr=lb:500515232worker2 # [ 110.608254] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5233worker1 # [ 110.550087] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:26Z level=info event=scheduler_connected addr=lb:500515234worker1 # [ 110.555314] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5235worker2 # [ 110.809413] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:25Z level=info event=scheduler_connected addr=lb:500515236worker2 # [ 110.815139] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5237worker1 # [ 110.756116] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:26Z level=info event=scheduler_connected addr=lb:500515238worker1 # [ 110.761455] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5239worker2 # [ 111.016136] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:25Z level=info event=scheduler_connected addr=lb:500515240worker2 # [ 111.023145] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5241worker1 # [ 110.962242] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:26Z level=info event=scheduler_connected addr=lb:500515242worker1 # [ 110.967331] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5243worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.21 seconds)5244client: waiting for success: ! systemctl is-active rs5245client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5246client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5247lb # [ 111.086112] envoy[925]: conn peer=[2001:db8:1::1]:58496 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1349 ms=86305248client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5249client: must fail: journalctl -u rs | grep -q 'reconnecting'5250worker1 # [ 111.132957] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:26Z level=info event=scheduler_restarting5251client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5252lb: must succeed: curl -sf localhost:9901/clusters5253worker2 # [ 111.224775] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:25Z level=info event=scheduler_connected addr=lb:500515254worker1 # [ 111.164461] nix-daemon[833]: reaped child process 1132, status = succeeded5255worker2 # [ 111.230267] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5256worker1 # [ 111.190500] nix-grpc-daemon[1068]: ts=2026-09-20T10:52:26Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5257lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5258worker2 # [ 111.431116] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:26Z level=info event=scheduler_connected addr=lb:500515259worker2 # [ 111.436597] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5260worker2 # [ 111.637543] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:26Z level=info event=scheduler_connected addr=lb:500515261worker2 # [ 111.642983] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5262worker2 # [ 111.843878] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:26Z level=info event=scheduler_connected addr=lb:500515263worker2 # [ 111.849304] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5264worker2 # [ 112.049937] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:26Z level=info event=scheduler_connected addr=lb:500515265worker2 # [ 112.055236] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5266worker1 # [ 112.032573] nix-grpc-daemon[1068]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5267worker1 # [ 112.032815] nix-grpc-daemon[1068]: E0000 00:00:1789901547.670779 1111 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5268worker1 # [ 112.044512] nix-grpc-daemon[1068]: E0000 00:00:1789901547.683917 1111 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5269worker1 # [ 112.145284] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5270worker1 # [ 112.151091] systemd[1]: Stopped Nix worker-protocol over gRPC.5271worker1 # [ 112.156787] systemd[1]: nix-grpc-daemon.service: Consumed 1.814s CPU time over 26.466s wall clock time, 36M memory peak, 47.7K incoming IP traffic, 90.4K outgoing IP traffic.5272worker1 # [ 112.169857] systemd[1]: Starting Nix worker-protocol over gRPC...5273worker2 # [ 112.257666] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:26Z level=info event=scheduler_connected addr=lb:500515274worker2 # [ 112.261780] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5275lb: must succeed: curl -sf localhost:9901/clusters5276lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5277worker1 # [ 112.364668] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5278worker1 # [ 112.367815] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15279worker1 # [ 112.375637] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5280worker1 # [ 112.379495] systemd[1]: Started Nix worker-protocol over gRPC.5281lb # [ 112.387572] niks3-server[1044]: 2026/09/20 10:52:28 INFO lead: acquired remote=192.168.1.3:603385282worker1 # [ 112.389681] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=scheduler_take_over5283worker2 # [ 112.458283] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:27Z level=info event=scheduler_connected addr=lb:500515284worker2 # [ 112.463416] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5285worker1 # [ 112.412742] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=scheduler_connected addr=lb:500515286worker1 # [ 112.414478] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5287worker2 # [ 112.664257] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:27Z level=info event=scheduler_connected addr=lb:500515288worker2 # [ 112.669244] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5289worker1 # [ 112.615827] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=scheduler_connected addr=lb:500515290worker1 # [ 112.621032] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5291worker2 # [ 112.870077] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:27Z level=info event=scheduler_connected addr=lb:500515292worker2 # [ 112.875287] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5293worker1 # [ 112.821722] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=scheduler_connected addr=lb:500515294worker1 # [ 112.826937] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5295worker2 # [ 113.076218] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:27Z level=info event=scheduler_connected addr=lb:500515296worker2 # [ 113.081156] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5297worker1 # [ 113.027754] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=scheduler_connected addr=lb:500515298worker1 # [ 113.033041] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5299worker2 # [ 113.283777] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:27Z level=info event=scheduler_connected addr=lb:500515300worker1 # [ 113.225406] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05301worker1 # [ 113.233682] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=scheduler_connected addr=lb:500515302worker1 # [ 113.238790] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05303lb: must succeed: curl -sf localhost:9901/clusters5304lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5305worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5306worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5307(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.18 seconds)5308subtest: scheduler restart mid-build: build finishes, no double build5309client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5310client # [ 113.573722] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5311client # Running as unit: mid.service; invocation ID: ef12f15ba5104dcbbf5132f4fa1e6cfc5312client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5313worker1 # [ 113.803852] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:509145314worker1 # [ 113.821301] nix-daemon[833]: accepted connection from pid 1331, user nix-grpc-daemon (trusted)5315client # [ 113.863540] nix[1204]: don't know how to build these paths:5316client # [ 113.864902] nix[1204]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5317worker1 # [ 113.855423] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:29Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05318worker1 # [ 113.862430] nix-grpc-daemon[1331]: ts=2026-09-20T10:52:29Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15319worker2 # [ 113.989447] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592525320worker2 # [ 114.005744] nix-daemon[831]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5321worker2 # [ 114.033169] nix-grpc-daemon[1283]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5)5322worker2 # [ 114.095394] nix-grpc-daemon[1283]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 2/5)5323worker2 # [ 114.243652] nix-grpc-daemon[1283]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 309 ms (attempt 3/5)5324worker2 # [ 114.554181] nix-grpc-daemon[1283]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 4/5)5325worker2 # [ 114.611710] nix-grpc-daemon[1283]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5326worker2 # [ 114.634301] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592525327client # [ 114.612191] nix[1204]: copying 1 paths to 'lb:50051'...5328worker2 # [ 114.650915] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592525329client # [ 114.612550] nix[1204]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5330worker2 # [ 114.663831] nix-daemon[831]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5331worker2 # [ 114.697278] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:29Z level=info event=niks3_push_started pid=13935332worker2 # [ 115.108326] nix-daemon[831]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5333worker2 # [ 115.126041] nix-daemon[831]: reaped child process 1413, status = succeeded5334worker2 # [ 115.304099] nix-daemon[831]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5335worker2 # [ 115.323706] nix-daemon[831]: reaped child process 1418, status = succeeded5336lb # [ 115.276702] niks3-server[1044]: 2026/09/20 10:52:30 INFO Received uploads request method=POST path=/api/pending_closures5337worker2 # [ 115.351859] nix-grpc-daemon[1393]: time=2026-09-20T10:52:29.987Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5338worker2 # [ 115.354812] nix-grpc-daemon[1393]: time=2026-09-20T10:52:29.987Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5339lb # [ 115.320391] niks3-server[1044]: 2026/09/20 10:52:30 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5340lb # [ 115.336712] niks3-server[1044]: 2026/09/20 10:52:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5341worker2 # [ 115.409275] nix-grpc-daemon[1393]: time=2026-09-20T10:52:30.047Z level=INFO msg="Uploading 1 narinfos"5342lb # [ 115.349942] niks3-server[1044]: 2026/09/20 10:52:30 INFO Signed narinfos id=35 count=15343lb # [ 115.373109] niks3-server[1044]: 2026/09/20 10:52:31 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5344worker2 # [ 115.439522] nix-grpc-daemon[1393]: time=2026-09-20T10:52:30.078Z level=INFO msg="Upload complete. (517ms)"5345lb # [ 115.381890] niks3-server[1044]: 2026/09/20 10:52:31 INFO Completed upload id=355346worker2 # [ 115.450137] nix-grpc-daemon[1393]: time=2026-09-20T10:52:30.078Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n"5347worker2 # [ 115.467916] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59252 duration_s=0 paths=1 nar_bytes_in=4245348worker2 # [ 115.472324] nix-grpc-daemon[1393]: time=2026-09-20T10:52:30.085Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls error="server returned 404: object is not pending upload\n"5349worker2 # [ 115.477142] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592525350worker2 # [ 115.486022] nix-daemon[831]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5351worker2 # [ 115.488302] nix-daemon[831]: reaped child process 1391, status = succeeded5352client # [ 115.459847] nix[1204]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5353worker2 # [ 115.500602] nix-daemon[831]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5354lb: must succeed: curl -sf localhost:9901/clusters5355lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5356lb: must succeed: curl -sf localhost:9901/clusters5357lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5358worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5359worker1 # [ 117.597429] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1331 (nix-grpc-daemon) on client request.5360lb # [ 117.619836] niks3-server[1044]: 2026/09/20 10:52:33 INFO lead: released remote=192.168.1.3:603385361worker1 # [ 117.614546] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5362worker2 # [ 117.697227] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:32Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5363client # [ 117.660666] nix[1204]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5364worker1 # [ 117.652711] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5365worker1 # [ 117.663036] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5366worker1 # [ 117.676866] nix-daemon[833]: reaped child process 1387, status = succeeded5367worker1 # [ 117.678560] systemd[1]: nix-grpc-daemon.service: Consumed 201ms CPU time over 5.478s wall clock time, 14.1M memory peak, 8K incoming IP traffic, 9.2K outgoing IP traffic.5368worker1 # [ 117.694270] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.5369worker1 # [ 117.698390] systemd[1]: Starting Nix worker-protocol over gRPC...5370worker2 # [ 117.897426] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:32Z level=info event=scheduler_connected addr=lb:500515371worker1 # [ 117.881261] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5372worker1 # [ 117.883934] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15373worker1 # [ 117.894022] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5374worker1 # [ 117.895786] systemd[1]: Started Nix worker-protocol over gRPC.5375worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.38 seconds)5376lb # [ 117.911669] niks3-server[1044]: 2026/09/20 10:52:33 INFO lead: acquired remote=192.168.1.3:603645377client: must succeed: sleep 5.05378worker1 # [ 117.912975] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:33Z level=info event=scheduler_take_over5379worker1 # [ 117.924251] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:33Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=15380worker1 # [ 117.944620] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:33Z level=info event=scheduler_connected addr=lb:500515381worker1 # [ 117.946658] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:33Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05382lb # [ 121.087956] envoy[925]: conn peer=[2001:db8:1::3]:54748 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4430 tx=1399 ms=252575383lb # [ 121.088485] envoy[925]: conn peer=[2001:db8:1::3]:41664 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=972 tx=385 ms=52295384client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5385client: waiting for success: ! systemctl is-active mid5386worker2 # [ 123.561342] nix-daemon[831]: reaped child process 1422, status = succeeded5387worker2 # [ 123.735990] nix-daemon[831]: accepted connection from pid 1458, user nix-grpc-daemon (trusted)5388worker2 # [ 123.753251] nix-daemon[831]: reaped child process 1461, status = succeeded5389lb # [ 123.707445] niks3-server[1044]: 2026/09/20 10:52:39 INFO Received uploads request method=POST path=/api/pending_closures5390worker2 # [ 123.780396] nix-grpc-daemon[1393]: time=2026-09-20T10:52:38.417Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5391worker2 # [ 123.781864] nix-grpc-daemon[1393]: time=2026-09-20T10:52:38.417Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5392lb # [ 123.753879] niks3-server[1044]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5393lb # [ 123.766595] niks3-server[1044]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5394lb # [ 123.775933] niks3-server[1044]: 2026/09/20 10:52:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5395worker2 # [ 123.842906] nix-grpc-daemon[1393]: time=2026-09-20T10:52:38.480Z level=INFO msg="Uploading 1 narinfos"5396lb # [ 123.785078] niks3-server[1044]: 2026/09/20 10:52:39 INFO Signed narinfos id=36 count=15397lb # [ 123.804515] niks3-server[1044]: 2026/09/20 10:52:39 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5398lb # [ 123.814739] niks3-server[1044]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5399lb # [ 123.828683] niks3-server[1044]: 2026/09/20 10:52:39 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5400lb # [ 123.839757] niks3-server[1044]: 2026/09/20 10:52:39 INFO Completed upload id=365401worker2 # [ 123.900251] nix-grpc-daemon[1393]: time=2026-09-20T10:52:38.539Z level=INFO msg="Upload complete. (380ms)"5402worker2 # [ 123.913119] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59252 duration_s=8 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15403worker2 # [ 123.930737] nix-daemon[831]: reaped child process 1420, status = succeeded5404client # [ 123.915987] systemd[1]: mid.service: Deactivated successfully.5405client # [ 123.920152] systemd[1]: mid.service: Consumed 170ms CPU time over 10.346s wall clock time, 37.2M memory peak, 9.1K incoming IP traffic, 9.4K outgoing IP traffic.5406client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5407client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5408client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)5409(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.00 seconds)5410subtest: interrupting the client stops the build on the worker5411client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5412client # [ 124.544747] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5413client # Running as unit: intr.service; invocation ID: 6d2220e46dbb4291892fe7b190cd1a2b5414client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5415client # [ 124.774487] nix[1240]: don't know how to build these paths:5416client # [ 124.775444] nix[1240]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5417worker2 # [ 124.811314] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592525418worker1 # [ 124.767921] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:40Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05419worker1 # [ 124.773363] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:40Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15420worker1 # [ 124.816121] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905421worker1 # [ 124.831272] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5422worker1 # [ 124.857379] nix-grpc-daemon[1415]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5)5423worker1 # [ 124.945768] nix-grpc-daemon[1415]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 2/5)5424worker1 # [ 124.961760] nix-grpc-daemon[1415]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 3/5)5425worker1 # [ 125.028264] nix-grpc-daemon[1415]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 371 ms (attempt 4/5)5426worker1 # [ 125.407483] nix-grpc-daemon[1415]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5427worker1 # [ 125.428934] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449905428client # [ 125.470452] nix[1240]: copying 1 paths to 'lb:50051'...5429worker1 # [ 125.445301] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449905430client # [ 125.473575] nix[1240]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5431worker1 # [ 125.464616] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5432worker1 # [ 125.494076] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:41Z level=info event=niks3_push_started pid=14855433worker1 # [ 125.896079] nix-daemon[833]: accepted connection from pid 1502, user nix-grpc-daemon (trusted)5434worker1 # [ 125.913827] nix-daemon[833]: reaped child process 1505, status = succeeded5435worker1 # [ 126.090531] nix-daemon[833]: accepted connection from pid 1507, user nix-grpc-daemon (trusted)5436worker1 # [ 126.107877] nix-daemon[833]: reaped child process 1510, status = succeeded5437lb # [ 126.125866] niks3-server[1044]: 2026/09/20 10:52:41 INFO Received uploads request method=POST path=/api/pending_closures5438worker1 # [ 126.139050] nix-grpc-daemon[1485]: time=2026-09-20T10:52:41.776Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5439worker1 # [ 126.140755] nix-grpc-daemon[1485]: time=2026-09-20T10:52:41.777Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5440lb # [ 126.168884] niks3-server[1044]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5441worker1 # [ 126.180672] nix-grpc-daemon[1485]: time=2026-09-20T10:52:41.819Z level=INFO msg="Uploading 1 narinfos"5442lb # [ 126.182266] niks3-server[1044]: 2026/09/20 10:52:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5443lb # [ 126.190384] niks3-server[1044]: 2026/09/20 10:52:41 INFO Signed narinfos id=37 count=15444lb # [ 126.203003] niks3-server[1044]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5445lb # [ 126.213957] niks3-server[1044]: 2026/09/20 10:52:41 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5446lb # [ 126.221270] niks3-server[1044]: 2026/09/20 10:52:41 INFO Completed upload id=375447worker1 # [ 126.219324] nix-grpc-daemon[1485]: time=2026-09-20T10:52:41.858Z level=INFO msg="Upload complete. (498ms)"5448lb # [ 126.224640] niks3-server[1044]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5449worker1 # [ 126.229051] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=4245450worker1 # [ 126.244504] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905451worker1 # [ 126.251279] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5452worker1 # [ 126.256896] nix-daemon[833]: reaped child process 1483, status = succeeded5453client # [ 126.291827] nix[1240]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5454worker1 # [ 126.270626] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5455client: must succeed: systemctl kill -s INT intr5456client # [ 128.225129] systemd[1]: intr.service: Sent signal SIGINT to main process 1240 (nix) on client request.5457worker1 # [ 128.211252] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:43Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5458client # [ 128.237149] nix[1240]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5459client # [ 128.246065] nix[1240]: error: interrupted by the user5460client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5461client # [ 128.282573] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5462client # [ 128.285898] systemd[1]: intr.service: Failed with result 'exit-code'.5463client # [ 128.288142] systemd[1]: intr.service: Consumed 150ms CPU time over 3.736s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.5464worker1 # [ 128.305374] nix-daemon[833]: reaped child process 1512, status = succeeded5465worker1 # [ 128.308453] nix-daemon[1514]: unexpected Nix daemon error: error: interrupted by the user5466worker1 # [ 128.315671] nix-daemon[833]: reaped child process 1514, status = failed with exit code 15467(finished: subtest: interrupting the client stops the build on the worker, in 3.90 seconds)5468subtest: a deploy mid-build drains: the build finishes, the new generation takes over5469client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5470client # [ 128.470997] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5471client # Running as unit: sw.service; invocation ID: a3f06c46c2a1409f8f8704115b4c0e505472client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5473client # [ 128.709872] nix[1261]: don't know how to build these paths:5474client # [ 128.710913] nix[1261]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5475worker1 # [ 128.683864] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:449905476worker1 # [ 128.700175] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:44Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05477worker1 # [ 128.706122] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:44Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15478worker2 # [ 128.819172] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592525479worker2 # [ 128.836765] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592525480client # [ 128.813493] nix[1261]: copying 1 paths to 'lb:50051'...5481worker2 # [ 128.853069] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592525482client # [ 128.816980] nix[1261]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5483worker2 # [ 128.867221] nix-daemon[831]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5484worker2 # [ 129.066405] nix-daemon[831]: accepted connection from pid 1489, user nix-grpc-daemon (trusted)5485worker2 # [ 129.084933] nix-daemon[831]: reaped child process 1492, status = succeeded5486worker2 # [ 129.261786] nix-daemon[831]: accepted connection from pid 1494, user nix-grpc-daemon (trusted)5487worker2 # [ 129.279441] nix-daemon[831]: reaped child process 1497, status = succeeded5488lb # [ 129.231861] niks3-server[1044]: 2026/09/20 10:52:44 INFO Received uploads request method=POST path=/api/pending_closures5489worker2 # [ 129.309955] nix-grpc-daemon[1393]: time=2026-09-20T10:52:43.948Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5490worker2 # [ 129.311438] nix-grpc-daemon[1393]: time=2026-09-20T10:52:43.948Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5491lb # [ 129.271593] niks3-server[1044]: 2026/09/20 10:52:44 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5492lb # [ 129.282895] niks3-server[1044]: 2026/09/20 10:52:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5493worker2 # [ 129.349014] nix-grpc-daemon[1393]: time=2026-09-20T10:52:43.987Z level=INFO msg="Uploading 1 narinfos"5494lb # [ 129.293124] niks3-server[1044]: 2026/09/20 10:52:44 INFO Signed narinfos id=38 count=15495lb # [ 129.295421] niks3-server[1044]: 2026/09/20 10:52:44 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5496lb # [ 129.305155] niks3-server[1044]: 2026/09/20 10:52:44 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5497lb # [ 129.312720] niks3-server[1044]: 2026/09/20 10:52:44 INFO Completed upload id=385498worker2 # [ 129.372972] nix-grpc-daemon[1393]: time=2026-09-20T10:52:44.012Z level=INFO msg="Upload complete. (496ms)"5499lb # [ 129.315371] niks3-server[1044]: 2026/09/20 10:52:44 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5500worker2 # [ 129.380280] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59252 duration_s=0 paths=1 nar_bytes_in=4165501worker2 # [ 129.395432] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592525502worker2 # [ 129.401994] nix-daemon[831]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5503worker2 # [ 129.406838] nix-daemon[831]: reaped child process 1487, status = succeeded5504client # [ 129.378837] nix[1261]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5505worker2 # [ 129.418674] nix-daemon[831]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5506lb # [ 131.090924] envoy[925]: conn peer=[2001:db8:1::1]:35174 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3052 tx=1417 ms=100645507worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25508lb # [ 131.096251] envoy[925]: conn peer=[2001:db8:1::1]:60244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2931 tx=754 ms=34865509worker2 # Checking switch inhibitors... done5510worker2 # [ 131.973150] nixos[1532]: switching to system configuration /nix/store/gc2nh9hcwdf96y2b4sabb3shz4qv2p0r-nixos-system-worker2-test5511worker2 # [ 131.975306] systemd[1]: Stopped target Remote File Systems.5512worker2 # activating the configuration...5513worker2 # [ 131.977847] systemd[1]: Stopped target Local File Systems.5514worker2 # setting up /etc...5515worker2 # [ 132.769181] systemd[1]: Reload requested from client PID 1532 ('.switch-to-conf') (unit backdoor.service)...5516worker2 # [ 132.770895] systemd[1]: Reloading...5517worker2 # [ 133.675556] systemd[1]: Reloading finished in 901 ms.5518worker2 # restarting sysinit-reactivation.target5519worker2 # [ 133.753375] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5520worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service[ 133.908132] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5521worker2 # [ 133.909257] systemd[1]: Reached target Reactivate sysinit units.5522worker2 # 5523worker2 # [ 133.913193] systemd[1]: Reloading D-Bus System Message Bus...5524worker2 # [ 133.923670] dbus-broker-launch[499]: Caught SIGHUP, trigger reload.5525worker2 # [ 133.928452] systemd[1]: Reloading Nix worker-protocol over gRPC...5526worker2 # [ 133.950427] dbus-broker-launch[499]: Looking up NSS user entry for 'systemd-timesync'...5527worker2 # [ 133.960228] dbus-broker-launch[499]: NSS returned no entry for 'systemd-timesync'5528worker2 # [ 133.961352] dbus-broker-launch[499]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5529worker2 # [ 133.979036] systemd[1]: Reloaded Nix worker-protocol over gRPC.5530worker2 # [ 134.002643] systemd[1]: Reloaded D-Bus System Message Bus.5531worker2 # [ 134.008058] systemd[1]: Reached target Local File Systems.5532worker2 # [ 134.008821] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5533worker2 # [ 134.015194] systemd[1]: Starting Create SUID/SGID Wrappers...5534worker2 # [ 134.021573] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5535worker2 # [ 134.022835] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675536worker2 # [ 134.036067] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5537worker2 # [ 134.037620] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5538worker2 # [ 134.038826] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5539worker2 # [ 134.039964] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5540worker2 # [ 134.048108] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5541worker2 # [ 134.050117] systemd[1]: Reached target Remote File Systems.5542worker2 # [ 134.529161] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5543worker2 # [ 134.536901] systemd[1]: Finished Create SUID/SGID Wrappers.5544worker2 # [ 134.539507] systemd[1]: Starting linger-users.service...5545worker2 # [ 134.597310] systemd[1]: linger-users.service: Deactivated successfully.5546worker2 # [ 134.598349] systemd[1]: Finished linger-users.service.5547worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5548worker2 # [ 134.856518] nixos[1532]: finished switching to system configuration /nix/store/gc2nh9hcwdf96y2b4sabb3shz4qv2p0r-nixos-system-worker2-test5549worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.71 seconds)5550worker2: must succeed: pgrep -f 'read -t [9]0 x'5551worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5552client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25553worker2 # [ 134.965196] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:49Z level=info event=draining5554worker1 # [ 135.123917] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:449905555client # don't know how to build these paths:5556client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5557worker1 # [ 135.133231] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449905558worker1 # [ 135.159047] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:50Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05559worker1 # [ 135.165930] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:50Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15560worker1 # [ 135.211296] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905561worker1 # [ 135.226855] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449905562client # copying 1 paths to 'lb:50051'...5563worker1 # [ 135.243491] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449905564client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5565worker1 # [ 135.266866] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5566worker1 # [ 135.476884] nix-daemon[833]: accepted connection from pid 1564, user nix-grpc-daemon (trusted)5567worker1 # [ 135.497108] nix-daemon[833]: reaped child process 1567, status = succeeded5568worker1 # [ 135.670414] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5569worker1 # [ 135.689823] nix-daemon[833]: reaped child process 1572, status = succeeded5570lb # [ 135.706175] niks3-server[1044]: 2026/09/20 10:52:51 INFO Received uploads request method=POST path=/api/pending_closures5571worker1 # [ 135.715899] nix-grpc-daemon[1485]: time=2026-09-20T10:52:51.354Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5572worker1 # [ 135.717544] nix-grpc-daemon[1485]: time=2026-09-20T10:52:51.354Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5573lb # [ 135.737097] niks3-server[1044]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5574lb # [ 135.752110] niks3-server[1044]: 2026/09/20 10:52:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5575worker1 # [ 135.755769] nix-grpc-daemon[1485]: time=2026-09-20T10:52:51.394Z level=INFO msg="Uploading 1 narinfos"5576lb # [ 135.764316] niks3-server[1044]: 2026/09/20 10:52:51 INFO Signed narinfos id=39 count=15577lb # [ 135.770600] niks3-server[1044]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5578lb # [ 135.779469] niks3-server[1044]: 2026/09/20 10:52:51 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5579lb # [ 135.784322] niks3-server[1044]: 2026/09/20 10:52:51 INFO Completed upload id=395580worker1 # [ 135.781651] nix-grpc-daemon[1485]: time=2026-09-20T10:52:51.421Z level=INFO msg="Upload complete. (497ms)"5581lb # [ 135.787184] niks3-server[1044]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5582worker1 # [ 135.788357] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=5285583worker1 # [ 135.803618] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905584worker1 # [ 135.811426] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5585worker1 # [ 135.816925] nix-daemon[833]: reaped child process 1562, status = succeeded5586client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5587worker1 # [ 135.828183] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5588client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5589worker1 # [ 137.251407] nix-daemon[833]: reaped child process 1576, status = succeeded5590client # farm-a> LOG-farm-a-during-drain5591worker1 # [ 137.410694] nix-daemon[833]: accepted connection from pid 1591, user nix-grpc-daemon (trusted)5592worker1 # [ 137.430501] nix-daemon[833]: reaped child process 1594, status = succeeded5593lb # [ 137.446333] niks3-server[1044]: 2026/09/20 10:52:53 INFO Received uploads request method=POST path=/api/pending_closures5594worker1 # [ 137.456438] nix-grpc-daemon[1485]: time=2026-09-20T10:52:53.094Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5595worker1 # [ 137.457953] nix-grpc-daemon[1485]: time=2026-09-20T10:52:53.094Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5596lb # [ 137.487474] niks3-server[1044]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5597lb # [ 137.505072] niks3-server[1044]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5598lb # [ 137.513870] niks3-server[1044]: 2026/09/20 10:52:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5599worker1 # [ 137.518148] nix-grpc-daemon[1485]: time=2026-09-20T10:52:53.156Z level=INFO msg="Uploading 1 narinfos"5600lb # [ 137.520326] niks3-server[1044]: 2026/09/20 10:52:53 INFO Signed narinfos id=40 count=15601lb # [ 137.524727] niks3-server[1044]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5602lb # [ 137.533758] niks3-server[1044]: 2026/09/20 10:52:53 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5603lb # [ 137.544139] niks3-server[1044]: 2026/09/20 10:52:53 INFO Completed upload id=405604worker1 # [ 137.542066] nix-grpc-daemon[1485]: time=2026-09-20T10:52:53.181Z level=INFO msg="Upload complete. (301ms)"5605lb # [ 137.546834] niks3-server[1044]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5606worker1 # [ 137.554583] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=15607worker1 # [ 137.572452] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:53Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05608worker1 # [ 137.576471] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:53Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15609worker1 # [ 137.580438] nix-daemon[833]: reaped child process 1574, status = succeeded5610worker1 # [ 137.610753] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905611worker1 # [ 137.627637] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449905612worker1 # [ 137.643496] nix-grpc-daemon[1485]: time=2026-09-20T10:52:53.282Z level=INFO msg="All 1 paths already cached"5613client # copying 1 paths to 'lb:50051'...5614worker1 # [ 137.659926] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449905615client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5616worker1 # [ 137.683099] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5617worker1 # [ 137.889632] nix-daemon[833]: accepted connection from pid 1600, user nix-grpc-daemon (trusted)5618worker1 # [ 137.907877] nix-daemon[833]: reaped child process 1603, status = succeeded5619worker1 # [ 138.082440] nix-daemon[833]: accepted connection from pid 1605, user nix-grpc-daemon (trusted)5620worker1 # [ 138.099362] nix-daemon[833]: reaped child process 1608, status = succeeded5621lb # [ 138.112781] niks3-server[1044]: 2026/09/20 10:52:53 INFO Received uploads request method=POST path=/api/pending_closures5622worker1 # [ 138.120151] nix-grpc-daemon[1485]: time=2026-09-20T10:52:53.759Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5623worker1 # [ 138.121607] nix-grpc-daemon[1485]: time=2026-09-20T10:52:53.759Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5624lb # [ 138.147233] niks3-server[1044]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5625worker1 # [ 138.161107] nix-grpc-daemon[1485]: time=2026-09-20T10:52:53.800Z level=INFO msg="Uploading 1 narinfos"5626lb # [ 138.166204] niks3-server[1044]: 2026/09/20 10:52:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5627lb # [ 138.181263] niks3-server[1044]: 2026/09/20 10:52:53 INFO Signed narinfos id=41 count=15628lb # [ 138.192992] niks3-server[1044]: 2026/09/20 10:52:53 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5629lb # [ 138.204482] niks3-server[1044]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5630lb # [ 138.212603] niks3-server[1044]: 2026/09/20 10:52:53 INFO Completed upload id=415631worker1 # [ 138.209907] nix-grpc-daemon[1485]: time=2026-09-20T10:52:53.849Z level=INFO msg="Upload complete. (509ms)"5632lb # [ 138.214777] niks3-server[1044]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5633worker1 # [ 138.224611] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=6405634worker1 # [ 138.238063] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905635worker1 # [ 138.247490] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5636worker1 # [ 138.255954] nix-daemon[833]: reaped child process 1598, status = succeeded5637client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5638client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5639worker1 # [ 138.263840] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5640worker1 # [ 139.081215] nix-daemon[833]: reaped child process 1612, status = succeeded5641client # farm-b> LOG-farm-b-during-drain5642worker1 # [ 139.251321] nix-daemon[833]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5643worker1 # [ 139.275742] nix-daemon[833]: reaped child process 1630, status = succeeded5644lb # [ 139.289443] niks3-server[1044]: 2026/09/20 10:52:54 INFO Received uploads request method=POST path=/api/pending_closures5645worker1 # [ 139.297938] nix-grpc-daemon[1485]: time=2026-09-20T10:52:54.937Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5646worker1 # [ 139.300307] nix-grpc-daemon[1485]: time=2026-09-20T10:52:54.939Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5647lb # [ 139.329588] niks3-server[1044]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5648lb # [ 139.347819] niks3-server[1044]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5649worker1 # [ 139.351883] nix-grpc-daemon[1485]: time=2026-09-20T10:52:54.990Z level=INFO msg="Uploading 1 narinfos"5650lb # [ 139.357053] niks3-server[1044]: 2026/09/20 10:52:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5651lb # [ 139.364909] niks3-server[1044]: 2026/09/20 10:52:54 INFO Signed narinfos id=42 count=15652lb # [ 139.366921] niks3-server[1044]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5653lb # [ 139.374447] niks3-server[1044]: 2026/09/20 10:52:55 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5654lb # [ 139.380226] niks3-server[1044]: 2026/09/20 10:52:55 INFO Completed upload id=425655worker1 # [ 139.378304] nix-grpc-daemon[1485]: time=2026-09-20T10:52:55.017Z level=INFO msg="Upload complete. (306ms)"5656lb # [ 139.382362] niks3-server[1044]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5657worker1 # [ 139.394569] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=15658worker1 # [ 139.410871] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:55Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05659worker1 # [ 139.414659] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:55Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15660worker1 # [ 139.418156] nix-daemon[833]: reaped child process 1610, status = succeeded5661worker1 # [ 139.438456] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905662worker1 # [ 139.454411] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449905663worker1 # [ 139.470380] nix-grpc-daemon[1485]: time=2026-09-20T10:52:55.109Z level=INFO msg="All 2 paths already cached"5664client # copying 1 paths to 'lb:50051'...5665worker1 # [ 139.481208] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449905666client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5667worker1 # [ 139.505146] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5668worker1 # [ 139.713521] nix-daemon[833]: accepted connection from pid 1636, user nix-grpc-daemon (trusted)5669worker1 # [ 139.733571] nix-daemon[833]: reaped child process 1639, status = succeeded5670worker1 # [ 139.910656] nix-daemon[833]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)5671worker1 # [ 139.929749] nix-daemon[833]: reaped child process 1644, status = succeeded5672lb # [ 139.943084] niks3-server[1044]: 2026/09/20 10:52:55 INFO Received uploads request method=POST path=/api/pending_closures5673worker1 # [ 139.952136] nix-grpc-daemon[1485]: time=2026-09-20T10:52:55.591Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5674worker1 # [ 139.954219] nix-grpc-daemon[1485]: time=2026-09-20T10:52:55.593Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5675lb # [ 139.973635] niks3-server[1044]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5676lb # [ 139.987650] niks3-server[1044]: 2026/09/20 10:52:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5677worker1 # [ 139.992210] nix-grpc-daemon[1485]: time=2026-09-20T10:52:55.631Z level=INFO msg="Uploading 1 narinfos"5678lb # [ 139.998370] niks3-server[1044]: 2026/09/20 10:52:55 INFO Signed narinfos id=43 count=15679lb # [ 140.004313] niks3-server[1044]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5680lb # [ 140.012686] niks3-server[1044]: 2026/09/20 10:52:55 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5681lb # [ 140.019027] niks3-server[1044]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5682lb # [ 140.024496] niks3-server[1044]: 2026/09/20 10:52:55 INFO Completed upload id=435683worker1 # [ 140.022465] nix-grpc-daemon[1485]: time=2026-09-20T10:52:55.662Z level=INFO msg="Upload complete. (498ms)"5684worker1 # [ 140.030692] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=7685685worker1 # [ 140.045585] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905686worker1 # [ 140.051561] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5687worker1 # [ 140.056724] nix-daemon[833]: reaped child process 1634, status = succeeded5688client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5689client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5690worker1 # [ 140.070758] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5691client # farm-top> LOG-farm-top-during-drain5692worker1 # [ 141.501695] nix-daemon[833]: reaped child process 1648, status = succeeded5693worker1 # [ 141.666383] nix-daemon[833]: accepted connection from pid 1663, user nix-grpc-daemon (trusted)5694worker1 # [ 141.685734] nix-daemon[833]: reaped child process 1666, status = succeeded5695lb # [ 141.703483] niks3-server[1044]: 2026/09/20 10:52:57 INFO Received uploads request method=POST path=/api/pending_closures5696worker1 # [ 141.713903] nix-grpc-daemon[1485]: time=2026-09-20T10:52:57.351Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5697worker1 # [ 141.715433] nix-grpc-daemon[1485]: time=2026-09-20T10:52:57.351Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5698lb # [ 141.735933] niks3-server[1044]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5699lb # [ 141.751737] niks3-server[1044]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5700lb # [ 141.764600] niks3-server[1044]: 2026/09/20 10:52:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5701worker1 # [ 141.769215] nix-grpc-daemon[1485]: time=2026-09-20T10:52:57.408Z level=INFO msg="Uploading 1 narinfos"5702lb # [ 141.775234] niks3-server[1044]: 2026/09/20 10:52:57 INFO Signed narinfos id=44 count=15703lb # [ 141.781461] niks3-server[1044]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5704lb # [ 141.790719] niks3-server[1044]: 2026/09/20 10:52:57 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5705lb # [ 141.797803] niks3-server[1044]: 2026/09/20 10:52:57 INFO Completed upload id=445706worker1 # [ 141.795810] nix-grpc-daemon[1485]: time=2026-09-20T10:52:57.435Z level=INFO msg="Upload complete. (314ms)"5707lb # [ 141.800444] niks3-server[1044]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5708worker1 # [ 141.809210] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=15709worker1 # [ 141.824919] nix-daemon[833]: reaped child process 1646, status = succeeded5710client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.99 seconds)5711client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5712client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds)5713worker2: must succeed: pkill -f 'read -t [9]0 x'5714worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5715client: waiting for success: ! systemctl is-active sw5716worker2 # [ 142.254722] nix-daemon[831]: reaped child process 1501, status = succeeded5717worker2 # [ 142.419108] nix-daemon[831]: accepted connection from pid 1672, user nix-grpc-daemon (trusted)5718worker2 # [ 142.438010] nix-daemon[831]: reaped child process 1675, status = succeeded5719lb # [ 142.390544] niks3-server[1044]: 2026/09/20 10:52:58 INFO Received uploads request method=POST path=/api/pending_closures5720worker2 # [ 142.460457] nix-grpc-daemon[1393]: time=2026-09-20T10:52:57.099Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5721worker2 # [ 142.462647] nix-grpc-daemon[1393]: time=2026-09-20T10:52:57.099Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5722lb # [ 142.427735] niks3-server[1044]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5723lb # [ 142.441382] niks3-server[1044]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5724worker2 # [ 142.510009] nix-grpc-daemon[1393]: time=2026-09-20T10:52:57.148Z level=INFO msg="Uploading 1 narinfos"5725lb # [ 142.453689] niks3-server[1044]: 2026/09/20 10:52:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5726lb # [ 142.461167] niks3-server[1044]: 2026/09/20 10:52:58 INFO Signed narinfos id=45 count=15727lb # [ 142.465936] niks3-server[1044]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5728worker2 # [ 142.530320] nix-grpc-daemon[1393]: time=2026-09-20T10:52:57.169Z level=INFO msg="Upload complete. (287ms)"5729lb # [ 142.470949] niks3-server[1044]: 2026/09/20 10:52:58 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5730lb # [ 142.475568] niks3-server[1044]: 2026/09/20 10:52:58 INFO Completed upload id=455731lb # [ 142.478805] niks3-server[1044]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5732worker2 # [ 142.539151] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59252 duration_s=13 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=15733worker2 # [ 142.553926] nix-daemon[831]: reaped child process 1499, status = succeeded5734client # [ 142.548993] systemd[1]: sw.service: Deactivated successfully.5735client # [ 142.553664] systemd[1]: sw.service: Consumed 156ms CPU time over 14.080s wall clock time, 37M memory peak, 8.3K incoming IP traffic, 8.7K outgoing IP traffic.5736worker2 # [ 142.967437] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:57Z level=info event=signal_exit5737client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5738client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5739client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5740worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5741worker2 # [ 144.213965] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:58Z level=info event=scheduler_restarting5742worker1 # [ 144.151333] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:509285743worker1 # [ 144.151694] nix-grpc-daemon[1415]: ts=2026-09-20T10:52:59Z level=info event=worker_gone addr=192.168.1.4:500515744worker2 # [ 144.243348] nix-grpc-daemon[1283]: ts=2026-09-20T10:52:58Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5745worker2 # [ 144.267062] nix-daemon[831]: reaped child process 1386, status = succeeded5746worker2 # [ 144.446914] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5747worker2 # [ 144.455506] systemd[1]: nix-grpc-daemon.service: Consumed 1.150s CPU time over 44.692s wall clock time, 33.7M memory peak, 28K incoming IP traffic, 40.8K outgoing IP traffic.5748worker2 # [ 144.470693] systemd[1]: Starting Nix worker-protocol over gRPC...5749worker2 # [ 144.676829] nix-grpc-daemon[1689]: ts=2026-09-20T10:52:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5750worker2 # [ 144.679424] nix-grpc-daemon[1689]: ts=2026-09-20T10:52:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15751worker2 # [ 144.687253] nix-grpc-daemon[1689]: ts=2026-09-20T10:52:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5752worker2 # [ 144.695484] systemd[1]: Started Nix worker-protocol over gRPC.5753worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.31 seconds)5754lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5755lb: must succeed: curl -sf localhost:9901/clusters5756worker2 # [ 144.732591] nix-grpc-daemon[1689]: ts=2026-09-20T10:52:59Z level=info event=scheduler_connected addr=lb:500515757worker1 # [ 144.672920] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:00Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05758lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5759lb: must succeed: curl -sf localhost:9901/clusters5760lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5761lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)5762lb: must succeed: curl -sf localhost:9901/clusters5763lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5764worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5765worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5766(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.59 seconds)5767subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5768client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15769worker1 # [ 146.220531] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:449905770worker2 # [ 146.290936] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366365771worker2 # [ 146.306636] nix-daemon[831]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)5772worker2 # [ 146.333712] nix-grpc-daemon[1689]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5)5773worker2 # [ 146.341830] nix-grpc-daemon[1689]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 120 ms (attempt 2/5)5774worker2 # [ 146.461825] nix-grpc-daemon[1689]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 368 ms (attempt 3/5)5775worker2 # [ 146.837473] nix-grpc-daemon[1689]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 730 ms (attempt 4/5)5776worker2 # [ 147.576987] nix-grpc-daemon[1689]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5777worker1 # [ 147.571442] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:03Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05778worker1 # [ 147.571830] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:03Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15779worker1 # [ 147.571953] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:03Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05780worker1 # [ 147.587919] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:03Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05781worker1 # [ 147.615598] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905782worker1 # [ 147.631937] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449905783worker1 # [ 147.647559] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449905784worker1 # [ 147.663363] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5785worker1 # [ 147.867768] nix-daemon[833]: accepted connection from pid 1675, user nix-grpc-daemon (trusted)5786worker1 # [ 147.888327] nix-daemon[833]: reaped child process 1678, status = succeeded5787worker1 # [ 148.063486] nix-daemon[833]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)5788worker1 # [ 148.081105] nix-daemon[833]: reaped child process 1683, status = succeeded5789lb # [ 148.096935] niks3-server[1044]: 2026/09/20 10:53:03 INFO Received uploads request method=POST path=/api/pending_closures5790worker1 # [ 148.104315] nix-grpc-daemon[1485]: time=2026-09-20T10:53:03.743Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5791worker1 # [ 148.105831] nix-grpc-daemon[1485]: time=2026-09-20T10:53:03.743Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5792lb # [ 148.124743] niks3-server[1044]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5793worker1 # [ 148.136664] nix-grpc-daemon[1485]: time=2026-09-20T10:53:03.776Z level=INFO msg="Uploading 1 narinfos"5794lb # [ 148.141326] niks3-server[1044]: 2026/09/20 10:53:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5795lb # [ 148.153375] niks3-server[1044]: 2026/09/20 10:53:03 INFO Signed narinfos id=46 count=15796lb # [ 148.158757] niks3-server[1044]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5797worker1 # [ 148.166411] nix-grpc-daemon[1485]: time=2026-09-20T10:53:03.805Z level=INFO msg="Upload complete. (486ms)"5798lb # [ 148.168564] niks3-server[1044]: 2026/09/20 10:53:03 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5799lb # [ 148.174523] niks3-server[1044]: 2026/09/20 10:53:03 INFO Completed upload id=465800worker1 # [ 148.176491] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=5125801lb # [ 148.179216] niks3-server[1044]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5802worker1 # [ 148.186253] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905803worker1 # [ 148.192861] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5804worker1 # [ 148.197541] nix-daemon[833]: reaped child process 1673, status = succeeded5805worker1 # [ 148.209721] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5806worker1 # [ 149.258529] nix-daemon[833]: reaped child process 1687, status = succeeded5807worker1 # [ 149.437265] nix-daemon[833]: accepted connection from pid 1702, user nix-grpc-daemon (trusted)5808worker1 # [ 149.455319] nix-daemon[833]: reaped child process 1705, status = succeeded5809lb # [ 149.471636] niks3-server[1044]: 2026/09/20 10:53:05 INFO Received uploads request method=POST path=/api/pending_closures5810worker1 # [ 149.480417] nix-grpc-daemon[1485]: time=2026-09-20T10:53:05.118Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5811worker1 # [ 149.482987] nix-grpc-daemon[1485]: time=2026-09-20T10:53:05.118Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5812lb # [ 149.518529] niks3-server[1044]: 2026/09/20 10:53:05 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5813worker1 # [ 149.526334] nix-grpc-daemon[1485]: time=2026-09-20T10:53:05.165Z level=INFO msg="Uploading 1 narinfos"5814lb # [ 149.530723] niks3-server[1044]: 2026/09/20 10:53:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5815lb # [ 149.539965] niks3-server[1044]: 2026/09/20 10:53:05 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5816lb # [ 149.547259] niks3-server[1044]: 2026/09/20 10:53:05 INFO Signed narinfos id=47 count=15817lb # [ 149.554824] niks3-server[1044]: 2026/09/20 10:53:05 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5818worker1 # [ 149.557239] nix-grpc-daemon[1485]: time=2026-09-20T10:53:05.196Z level=INFO msg="Upload complete. (337ms)"5819lb # [ 149.559851] niks3-server[1044]: 2026/09/20 10:53:05 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5820lb # [ 149.565884] niks3-server[1044]: 2026/09/20 10:53:05 INFO Completed upload id=475821lb # [ 149.570232] niks3-server[1044]: 2026/09/20 10:53:05 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5822worker1 # [ 149.573891] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=15823worker1 # [ 149.592318] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:05Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15824worker1 # [ 149.599611] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905825worker1 # [ 149.605478] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:05Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05826worker1 # [ 149.610467] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449905827worker1 # [ 149.615010] nix-daemon[833]: reaped child process 1685, status = succeeded5828worker1 # [ 149.618517] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449905829worker1 # [ 149.629593] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5830worker1 # [ 149.816950] nix-daemon[833]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)5831worker1 # [ 149.834552] nix-daemon[833]: reaped child process 1714, status = succeeded5832worker1 # [ 150.012058] nix-daemon[833]: accepted connection from pid 1716, user nix-grpc-daemon (trusted)5833worker1 # [ 150.028749] nix-daemon[833]: reaped child process 1719, status = succeeded5834lb # [ 150.044550] niks3-server[1044]: 2026/09/20 10:53:05 INFO Received uploads request method=POST path=/api/pending_closures5835worker1 # [ 150.052074] nix-grpc-daemon[1485]: time=2026-09-20T10:53:05.691Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5836worker1 # [ 150.053565] nix-grpc-daemon[1485]: time=2026-09-20T10:53:05.691Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5837lb # [ 150.077078] niks3-server[1044]: 2026/09/20 10:53:05 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5838worker1 # [ 150.087699] nix-grpc-daemon[1485]: time=2026-09-20T10:53:05.727Z level=INFO msg="Uploading 1 narinfos"5839lb # [ 150.092762] niks3-server[1044]: 2026/09/20 10:53:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5840lb # [ 150.105781] niks3-server[1044]: 2026/09/20 10:53:05 INFO Signed narinfos id=48 count=15841lb # [ 150.112521] niks3-server[1044]: 2026/09/20 10:53:05 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5842worker1 # [ 150.118433] nix-grpc-daemon[1485]: time=2026-09-20T10:53:05.757Z level=INFO msg="Upload complete. (480ms)"5843lb # [ 150.122551] niks3-server[1044]: 2026/09/20 10:53:05 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5844lb # [ 150.128757] niks3-server[1044]: 2026/09/20 10:53:05 INFO Completed upload id=485845worker1 # [ 150.126683] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=5125846lb # [ 150.132726] niks3-server[1044]: 2026/09/20 10:53:05 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5847worker1 # [ 150.139830] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905848worker1 # [ 150.146333] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5849worker1 # [ 150.151444] nix-daemon[833]: reaped child process 1709, status = succeeded5850worker1 # [ 150.165231] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5851lb # [ 151.092842] envoy[925]: conn peer=[2001:db8:1::1]:48032 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9625 tx=3860 ms=66995852lb # [ 151.098346] envoy[925]: conn peer=[2001:db8:1::1]:60260 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2909 tx=1335 ms=138115853lb # [ 151.103899] envoy[925]: conn peer=[2001:db8:1::4]:54378 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3035 tx=929 ms=442365854worker1 # [ 151.194598] nix-daemon[833]: reaped child process 1723, status = succeeded5855worker1 # [ 151.357041] nix-daemon[833]: accepted connection from pid 1738, user nix-grpc-daemon (trusted)5856worker1 # [ 151.377416] nix-daemon[833]: reaped child process 1741, status = succeeded5857lb # [ 151.394326] niks3-server[1044]: 2026/09/20 10:53:07 INFO Received uploads request method=POST path=/api/pending_closures5858worker1 # [ 151.404435] nix-grpc-daemon[1485]: time=2026-09-20T10:53:07.040Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5859worker1 # [ 151.405941] nix-grpc-daemon[1485]: time=2026-09-20T10:53:07.040Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5860lb # [ 151.425567] niks3-server[1044]: 2026/09/20 10:53:07 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5861lb # [ 151.442742] niks3-server[1044]: 2026/09/20 10:53:07 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5862lb # [ 151.452850] niks3-server[1044]: 2026/09/20 10:53:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5863worker1 # [ 151.456545] nix-grpc-daemon[1485]: time=2026-09-20T10:53:07.095Z level=INFO msg="Uploading 1 narinfos"5864lb # [ 151.462680] niks3-server[1044]: 2026/09/20 10:53:07 INFO Signed narinfos id=49 count=15865lb # [ 151.468705] niks3-server[1044]: 2026/09/20 10:53:07 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5866lb # [ 151.478140] niks3-server[1044]: 2026/09/20 10:53:07 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5867lb # [ 151.486548] niks3-server[1044]: 2026/09/20 10:53:07 INFO Completed upload id=495868worker1 # [ 151.484584] nix-grpc-daemon[1485]: time=2026-09-20T10:53:07.124Z level=INFO msg="Upload complete. (309ms)"5869lb # [ 151.489868] niks3-server[1044]: 2026/09/20 10:53:07 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5870worker1 # [ 151.500788] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=15871worker1 # [ 151.516414] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:07Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15872worker1 # [ 151.528391] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905873worker1 # [ 151.531967] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:07Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05874worker1 # [ 151.537054] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449905875worker1 # [ 151.541630] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449905876worker1 # [ 151.546618] nix-daemon[833]: reaped child process 1721, status = succeeded5877worker1 # [ 151.558944] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5878worker1 # [ 151.738903] nix-daemon[833]: accepted connection from pid 1747, user nix-grpc-daemon (trusted)5879worker1 # [ 151.756249] nix-daemon[833]: reaped child process 1750, status = succeeded5880worker1 # [ 151.926861] nix-daemon[833]: accepted connection from pid 1752, user nix-grpc-daemon (trusted)5881worker1 # [ 151.942128] nix-daemon[833]: reaped child process 1755, status = succeeded5882lb # [ 151.959904] niks3-server[1044]: 2026/09/20 10:53:07 INFO Received uploads request method=POST path=/api/pending_closures5883worker1 # [ 151.966511] nix-grpc-daemon[1485]: time=2026-09-20T10:53:07.605Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5884worker1 # [ 151.967963] nix-grpc-daemon[1485]: time=2026-09-20T10:53:07.605Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5885lb # [ 151.986175] niks3-server[1044]: 2026/09/20 10:53:07 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5886lb # [ 151.999064] niks3-server[1044]: 2026/09/20 10:53:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5887worker1 # [ 152.003051] nix-grpc-daemon[1485]: time=2026-09-20T10:53:07.642Z level=INFO msg="Uploading 1 narinfos"5888lb # [ 152.008303] niks3-server[1044]: 2026/09/20 10:53:07 INFO Signed narinfos id=50 count=15889lb # [ 152.016949] niks3-server[1044]: 2026/09/20 10:53:07 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5890lb # [ 152.025887] niks3-server[1044]: 2026/09/20 10:53:07 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5891lb # [ 152.032194] niks3-server[1044]: 2026/09/20 10:53:07 INFO Completed upload id=505892worker1 # [ 152.029514] nix-grpc-daemon[1485]: time=2026-09-20T10:53:07.669Z level=INFO msg="Upload complete. (465ms)"5893lb # [ 152.034702] niks3-server[1044]: 2026/09/20 10:53:07 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5894worker1 # [ 152.036252] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=5125895worker1 # [ 152.049539] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905896worker1 # [ 152.056478] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5897worker1 # [ 152.061090] nix-daemon[833]: reaped child process 1745, status = succeeded5898worker1 # [ 152.075127] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5899worker1 # [ 153.317556] nix-daemon[833]: reaped child process 1759, status = succeeded5900worker1 # [ 153.501594] nix-daemon[833]: accepted connection from pid 1774, user nix-grpc-daemon (trusted)5901worker1 # [ 153.518764] nix-daemon[833]: reaped child process 1777, status = succeeded5902lb # [ 153.533342] niks3-server[1044]: 2026/09/20 10:53:09 INFO Received uploads request method=POST path=/api/pending_closures5903worker1 # [ 153.542960] nix-grpc-daemon[1485]: time=2026-09-20T10:53:09.181Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5904worker1 # [ 153.544497] nix-grpc-daemon[1485]: time=2026-09-20T10:53:09.181Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5905lb # [ 153.565218] niks3-server[1044]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5906lb # [ 153.583583] niks3-server[1044]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5907lb # [ 153.592490] niks3-server[1044]: 2026/09/20 10:53:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5908worker1 # [ 153.596326] nix-grpc-daemon[1485]: time=2026-09-20T10:53:09.235Z level=INFO msg="Uploading 1 narinfos"5909lb # [ 153.598193] niks3-server[1044]: 2026/09/20 10:53:09 INFO Signed narinfos id=51 count=15910lb # [ 153.603354] niks3-server[1044]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5911lb # [ 153.612550] niks3-server[1044]: 2026/09/20 10:53:09 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5912worker1 # [ 153.616229] nix-grpc-daemon[1485]: time=2026-09-20T10:53:09.255Z level=INFO msg="Upload complete. (330ms)"5913lb # [ 153.619026] niks3-server[1044]: 2026/09/20 10:53:09 INFO Completed upload id=515914lb # [ 153.621830] niks3-server[1044]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5915worker1 # [ 153.629857] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=15916worker1 # [ 153.648641] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:09Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15917worker1 # [ 153.653012] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905918worker1 # [ 153.657685] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:09Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05919worker1 # [ 153.662435] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449905920worker1 # [ 153.666747] nix-grpc-daemon[1485]: time=2026-09-20T10:53:09.305Z level=INFO msg="All 1 paths already cached"5921worker1 # [ 153.669661] nix-daemon[833]: reaped child process 1757, status = succeeded5922worker1 # [ 153.673337] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449905923worker1 # [ 153.686781] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5924worker1 # [ 153.867050] nix-daemon[833]: accepted connection from pid 1783, user nix-grpc-daemon (trusted)5925worker1 # [ 153.884938] nix-daemon[833]: reaped child process 1786, status = succeeded5926worker1 # [ 154.057474] nix-daemon[833]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)5927worker1 # [ 154.074555] nix-daemon[833]: reaped child process 1791, status = succeeded5928lb # [ 154.087895] niks3-server[1044]: 2026/09/20 10:53:09 INFO Received uploads request method=POST path=/api/pending_closures5929worker1 # [ 154.095221] nix-grpc-daemon[1485]: time=2026-09-20T10:53:09.734Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5930worker1 # [ 154.096892] nix-grpc-daemon[1485]: time=2026-09-20T10:53:09.734Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5931lb # [ 154.117084] niks3-server[1044]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5932worker1 # [ 154.127746] nix-grpc-daemon[1485]: time=2026-09-20T10:53:09.767Z level=INFO msg="Uploading 1 narinfos"5933lb # [ 154.134732] niks3-server[1044]: 2026/09/20 10:53:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5934lb # [ 154.145654] niks3-server[1044]: 2026/09/20 10:53:09 INFO Signed narinfos id=52 count=15935lb # [ 154.155910] niks3-server[1044]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5936worker1 # [ 154.159930] nix-grpc-daemon[1485]: time=2026-09-20T10:53:09.799Z level=INFO msg="Upload complete. (467ms)"5937lb # [ 154.163024] niks3-server[1044]: 2026/09/20 10:53:09 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5938lb # [ 154.168803] niks3-server[1044]: 2026/09/20 10:53:09 INFO Completed upload id=525939worker1 # [ 154.168271] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=6245940lb # [ 154.172688] niks3-server[1044]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5941worker1 # [ 154.176810] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905942worker1 # [ 154.186885] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5943worker1 # [ 154.192818] nix-daemon[833]: reaped child process 1781, status = succeeded5944worker1 # [ 154.205318] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5945worker1 # [ 155.027083] nix-daemon[833]: reaped child process 1795, status = succeeded5946worker1 # [ 155.186392] nix-daemon[833]: accepted connection from pid 1810, user nix-grpc-daemon (trusted)5947worker1 # [ 155.204343] nix-daemon[833]: reaped child process 1813, status = succeeded5948lb # [ 155.218845] niks3-server[1044]: 2026/09/20 10:53:10 INFO Received uploads request method=POST path=/api/pending_closures5949worker1 # [ 155.228426] nix-grpc-daemon[1485]: time=2026-09-20T10:53:10.865Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5950worker1 # [ 155.229915] nix-grpc-daemon[1485]: time=2026-09-20T10:53:10.865Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5951lb # [ 155.258946] niks3-server[1044]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5952lb # [ 155.272614] niks3-server[1044]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5953worker1 # [ 155.283240] nix-grpc-daemon[1485]: time=2026-09-20T10:53:10.922Z level=INFO msg="Uploading 1 narinfos"5954lb # [ 155.286585] niks3-server[1044]: 2026/09/20 10:53:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5955lb # [ 155.293807] niks3-server[1044]: 2026/09/20 10:53:10 INFO Signed narinfos id=53 count=15956lb # [ 155.295973] niks3-server[1044]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5957lb # [ 155.301155] niks3-server[1044]: 2026/09/20 10:53:10 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5958worker1 # [ 155.305172] nix-grpc-daemon[1485]: time=2026-09-20T10:53:10.944Z level=INFO msg="Upload complete. (290ms)"5959lb # [ 155.307595] niks3-server[1044]: 2026/09/20 10:53:10 INFO Completed upload id=535960lb # [ 155.309943] niks3-server[1044]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5961worker1 # [ 155.316466] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=15962worker1 # [ 155.324561] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:10Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15963worker1 # [ 155.328000] nix-daemon[833]: reaped child process 1793, status = succeeded5964worker1 # [ 155.359164] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905965worker1 # [ 155.368561] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:11Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05966worker1 # [ 155.374173] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449905967worker1 # [ 155.382385] nix-grpc-daemon[1485]: time=2026-09-20T10:53:11.021Z level=INFO msg="All 1 paths already cached"5968worker1 # [ 155.389133] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449905969worker1 # [ 155.397308] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5970worker1 # [ 155.588501] nix-daemon[833]: accepted connection from pid 1819, user nix-grpc-daemon (trusted)5971worker1 # [ 155.607680] nix-daemon[833]: reaped child process 1822, status = succeeded5972worker1 # [ 155.784567] nix-daemon[833]: accepted connection from pid 1824, user nix-grpc-daemon (trusted)5973worker1 # [ 155.804322] nix-daemon[833]: reaped child process 1827, status = succeeded5974lb # [ 155.817826] niks3-server[1044]: 2026/09/20 10:53:11 INFO Received uploads request method=POST path=/api/pending_closures5975worker1 # [ 155.824230] nix-grpc-daemon[1485]: time=2026-09-20T10:53:11.463Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5976worker1 # [ 155.826231] nix-grpc-daemon[1485]: time=2026-09-20T10:53:11.465Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5977lb # [ 155.845386] niks3-server[1044]: 2026/09/20 10:53:11 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5978lb # [ 155.859667] niks3-server[1044]: 2026/09/20 10:53:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5979worker1 # [ 155.864604] nix-grpc-daemon[1485]: time=2026-09-20T10:53:11.503Z level=INFO msg="Uploading 1 narinfos"5980lb # [ 155.871338] niks3-server[1044]: 2026/09/20 10:53:11 INFO Signed narinfos id=54 count=15981lb # [ 155.879242] niks3-server[1044]: 2026/09/20 10:53:11 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5982worker1 # [ 155.887404] nix-grpc-daemon[1485]: time=2026-09-20T10:53:11.526Z level=INFO msg="Upload complete. (480ms)"5983lb # [ 155.890065] niks3-server[1044]: 2026/09/20 10:53:11 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5984lb # [ 155.895658] niks3-server[1044]: 2026/09/20 10:53:11 INFO Completed upload id=545985worker1 # [ 155.893319] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=6245986lb # [ 155.899117] niks3-server[1044]: 2026/09/20 10:53:11 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5987worker1 # [ 155.905911] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449905988worker1 # [ 155.911720] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5989worker1 # [ 155.916788] nix-daemon[833]: reaped child process 1817, status = succeeded5990worker1 # [ 155.930132] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5991worker1 # [ 156.974061] nix-daemon[833]: reaped child process 1831, status = succeeded5992worker1 # [ 157.157214] nix-daemon[833]: accepted connection from pid 1846, user nix-grpc-daemon (trusted)5993worker1 # [ 157.175860] nix-daemon[833]: reaped child process 1849, status = succeeded5994lb # [ 157.190325] niks3-server[1044]: 2026/09/20 10:53:12 INFO Received uploads request method=POST path=/api/pending_closures5995worker1 # [ 157.200938] nix-grpc-daemon[1485]: time=2026-09-20T10:53:12.839Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5996worker1 # [ 157.202579] nix-grpc-daemon[1485]: time=2026-09-20T10:53:12.839Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5997lb # [ 157.234070] niks3-server[1044]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5998worker1 # [ 157.243531] nix-grpc-daemon[1485]: time=2026-09-20T10:53:12.882Z level=INFO msg="Uploading 1 narinfos"5999lb # [ 157.246690] niks3-server[1044]: 2026/09/20 10:53:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6000lb # [ 157.254165] niks3-server[1044]: 2026/09/20 10:53:12 INFO Signed narinfos id=55 count=16001lb # [ 157.258219] niks3-server[1044]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6002lb # [ 157.265207] niks3-server[1044]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6003lb # [ 157.268091] niks3-server[1044]: 2026/09/20 10:53:12 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6004worker1 # [ 157.268783] nix-grpc-daemon[1485]: time=2026-09-20T10:53:12.908Z level=INFO msg="Upload complete. (328ms)"6005lb # [ 157.271254] niks3-server[1044]: 2026/09/20 10:53:12 INFO Completed upload id=556006lb # [ 157.274322] niks3-server[1044]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6007worker1 # [ 157.276669] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=16008worker1 # [ 157.284188] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:12Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16009worker1 # [ 157.287323] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449906010worker1 # [ 157.291641] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:12Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06011worker1 # [ 157.294816] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449906012worker1 # [ 157.297489] nix-daemon[833]: reaped child process 1829, status = succeeded6013worker1 # [ 157.300362] nix-grpc-daemon[1485]: time=2026-09-20T10:53:12.939Z level=INFO msg="All 1 paths already cached"6014worker1 # [ 157.305271] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449906015worker1 # [ 157.310931] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6016worker1 # [ 157.485140] nix-daemon[833]: accepted connection from pid 1855, user nix-grpc-daemon (trusted)6017worker1 # [ 157.502714] nix-daemon[833]: reaped child process 1858, status = succeeded6018worker1 # [ 157.676941] nix-daemon[833]: accepted connection from pid 1860, user nix-grpc-daemon (trusted)6019worker1 # [ 157.693924] nix-daemon[833]: reaped child process 1863, status = succeeded6020lb # [ 157.708518] niks3-server[1044]: 2026/09/20 10:53:13 INFO Received uploads request method=POST path=/api/pending_closures6021worker1 # [ 157.715496] nix-grpc-daemon[1485]: time=2026-09-20T10:53:13.354Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6022worker1 # [ 157.717126] nix-grpc-daemon[1485]: time=2026-09-20T10:53:13.354Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6023lb # [ 157.736184] niks3-server[1044]: 2026/09/20 10:53:13 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6024lb # [ 157.750506] niks3-server[1044]: 2026/09/20 10:53:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6025worker1 # [ 157.754580] nix-grpc-daemon[1485]: time=2026-09-20T10:53:13.393Z level=INFO msg="Uploading 1 narinfos"6026lb # [ 157.763807] niks3-server[1044]: 2026/09/20 10:53:13 INFO Signed narinfos id=56 count=16027lb # [ 157.769582] niks3-server[1044]: 2026/09/20 10:53:13 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6028worker1 # [ 157.775016] nix-grpc-daemon[1485]: time=2026-09-20T10:53:13.414Z level=INFO msg="Upload complete. (457ms)"6029lb # [ 157.778886] niks3-server[1044]: 2026/09/20 10:53:13 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6030worker1 # [ 157.780209] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=6246031lb # [ 157.784521] niks3-server[1044]: 2026/09/20 10:53:13 INFO Completed upload id=566032lb # [ 157.787969] niks3-server[1044]: 2026/09/20 10:53:13 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6033worker1 # [ 157.786928] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449906034worker1 # [ 157.796267] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6035worker1 # [ 157.800000] nix-daemon[833]: reaped child process 1853, status = succeeded6036worker1 # [ 157.809439] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6037worker1 # [ 159.430321] nix-daemon[833]: reaped child process 1867, status = succeeded6038worker1 # [ 159.591909] nix-daemon[833]: accepted connection from pid 1882, user nix-grpc-daemon (trusted)6039worker1 # [ 159.612283] nix-daemon[833]: reaped child process 1885, status = succeeded6040lb # [ 159.627217] niks3-server[1044]: 2026/09/20 10:53:15 INFO Received uploads request method=POST path=/api/pending_closures6041worker1 # [ 159.636658] nix-grpc-daemon[1485]: time=2026-09-20T10:53:15.275Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6042worker1 # [ 159.639918] nix-grpc-daemon[1485]: time=2026-09-20T10:53:15.277Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6043lb # [ 159.664166] niks3-server[1044]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6044lb # [ 159.678440] niks3-server[1044]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6045lb # [ 159.690442] niks3-server[1044]: 2026/09/20 10:53:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6046worker1 # [ 159.694720] nix-grpc-daemon[1485]: time=2026-09-20T10:53:15.333Z level=INFO msg="Uploading 1 narinfos"6047lb # [ 159.700160] niks3-server[1044]: 2026/09/20 10:53:15 INFO Signed narinfos id=57 count=16048lb # [ 159.702698] niks3-server[1044]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6049lb # [ 159.712248] niks3-server[1044]: 2026/09/20 10:53:15 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6050lb # [ 159.722001] niks3-server[1044]: 2026/09/20 10:53:15 INFO Completed upload id=576051worker1 # [ 159.719963] nix-grpc-daemon[1485]: time=2026-09-20T10:53:15.359Z level=INFO msg="Upload complete. (299ms)"6052lb # [ 159.724843] niks3-server[1044]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6053worker1 # [ 159.733327] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=16054worker1 # [ 159.748286] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:15Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16055worker1 # [ 159.756734] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449906056worker1 # [ 159.762409] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:15Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06057worker1 # [ 159.767679] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449906058worker1 # [ 159.772715] nix-daemon[833]: reaped child process 1865, status = succeeded6059worker1 # [ 159.774638] nix-grpc-daemon[1485]: time=2026-09-20T10:53:15.411Z level=INFO msg="All 2 paths already cached"6060worker1 # [ 159.778330] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449906061worker1 # [ 159.788357] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6062worker1 # [ 159.980668] nix-daemon[833]: accepted connection from pid 1891, user nix-grpc-daemon (trusted)6063worker1 # [ 160.000137] nix-daemon[833]: reaped child process 1894, status = succeeded6064worker1 # [ 160.175469] nix-daemon[833]: accepted connection from pid 1896, user nix-grpc-daemon (trusted)6065worker1 # [ 160.192273] nix-daemon[833]: reaped child process 1899, status = succeeded6066lb # [ 160.208943] niks3-server[1044]: 2026/09/20 10:53:15 INFO Received uploads request method=POST path=/api/pending_closures6067worker1 # [ 160.215840] nix-grpc-daemon[1485]: time=2026-09-20T10:53:15.855Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6068worker1 # [ 160.217565] nix-grpc-daemon[1485]: time=2026-09-20T10:53:15.855Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6069lb # [ 160.236364] niks3-server[1044]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6070worker1 # [ 160.246078] nix-grpc-daemon[1485]: time=2026-09-20T10:53:15.885Z level=INFO msg="Uploading 1 narinfos"6071lb # [ 160.252440] niks3-server[1044]: 2026/09/20 10:53:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6072lb # [ 160.263106] niks3-server[1044]: 2026/09/20 10:53:15 INFO Signed narinfos id=58 count=16073lb # [ 160.268620] niks3-server[1044]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6074lb # [ 160.278141] niks3-server[1044]: 2026/09/20 10:53:15 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6075worker1 # [ 160.281676] nix-grpc-daemon[1485]: time=2026-09-20T10:53:15.921Z level=INFO msg="Upload complete. (481ms)"6076lb # [ 160.284045] niks3-server[1044]: 2026/09/20 10:53:15 INFO Completed upload id=586077lb # [ 160.287248] niks3-server[1044]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6078worker1 # [ 160.288244] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=7526079worker1 # [ 160.302898] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449906080worker1 # [ 160.308869] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6081worker1 # [ 160.313929] nix-daemon[833]: reaped child process 1889, status = succeeded6082worker1 # [ 160.327656] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6083worker1 # [ 161.369679] nix-daemon[833]: reaped child process 1903, status = succeeded6084worker1 # [ 161.559432] nix-daemon[833]: accepted connection from pid 1918, user nix-grpc-daemon (trusted)6085worker1 # [ 161.580140] nix-daemon[833]: reaped child process 1921, status = succeeded6086lb # [ 161.598550] niks3-server[1044]: 2026/09/20 10:53:17 INFO Received uploads request method=POST path=/api/pending_closures6087worker1 # [ 161.606088] nix-grpc-daemon[1485]: time=2026-09-20T10:53:17.245Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6088worker1 # [ 161.608802] nix-grpc-daemon[1485]: time=2026-09-20T10:53:17.247Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6089lb # [ 161.630206] niks3-server[1044]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6090lb # [ 161.644562] niks3-server[1044]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6091lb # [ 161.657996] niks3-server[1044]: 2026/09/20 10:53:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6092worker1 # [ 161.661415] nix-grpc-daemon[1485]: time=2026-09-20T10:53:17.300Z level=INFO msg="Uploading 1 narinfos"6093lb # [ 161.668264] niks3-server[1044]: 2026/09/20 10:53:17 INFO Signed narinfos id=59 count=16094lb # [ 161.670957] niks3-server[1044]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6095lb # [ 161.682040] niks3-server[1044]: 2026/09/20 10:53:17 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6096lb # [ 161.689841] niks3-server[1044]: 2026/09/20 10:53:17 INFO Completed upload id=596097worker1 # [ 161.687363] nix-grpc-daemon[1485]: time=2026-09-20T10:53:17.326Z level=INFO msg="Upload complete. (346ms)"6098lb # [ 161.692113] niks3-server[1044]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6099worker1 # [ 161.704720] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=16100worker1 # [ 161.714770] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:17Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16101worker1 # [ 161.725256] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449906102worker1 # [ 161.730774] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449906103worker1 # [ 161.735458] nix-daemon[833]: reaped child process 1901, status = succeeded6104worker1 # [ 161.738805] nix-grpc-daemon[1485]: time=2026-09-20T10:53:17.378Z level=INFO msg="All 2 paths already cached"6105worker1 # [ 161.746244] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449906106worker1 # [ 161.757429] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6107worker1 # [ 161.949255] nix-daemon[833]: accepted connection from pid 1925, user nix-grpc-daemon (trusted)6108worker1 # [ 161.969542] nix-daemon[833]: reaped child process 1928, status = succeeded6109worker1 # [ 162.145670] nix-daemon[833]: accepted connection from pid 1930, user nix-grpc-daemon (trusted)6110worker1 # [ 162.163687] nix-daemon[833]: reaped child process 1933, status = succeeded6111lb # [ 162.181067] niks3-server[1044]: 2026/09/20 10:53:17 INFO Received uploads request method=POST path=/api/pending_closures6112worker1 # [ 162.188193] nix-grpc-daemon[1485]: time=2026-09-20T10:53:17.827Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6113worker1 # [ 162.190050] nix-grpc-daemon[1485]: time=2026-09-20T10:53:17.829Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6114lb # [ 162.215936] niks3-server[1044]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6115worker1 # [ 162.232518] nix-grpc-daemon[1485]: time=2026-09-20T10:53:17.871Z level=INFO msg="Uploading 1 narinfos"6116lb # [ 162.228121] niks3-server[1044]: 2026/09/20 10:53:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6117lb # [ 162.240386] niks3-server[1044]: 2026/09/20 10:53:17 INFO Signed narinfos id=60 count=16118lb # [ 162.243447] niks3-server[1044]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6119lb # [ 162.255405] niks3-server[1044]: 2026/09/20 10:53:17 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6120lb # [ 162.262805] niks3-server[1044]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6121lb # [ 162.267480] niks3-server[1044]: 2026/09/20 10:53:17 INFO Completed upload id=606122worker1 # [ 162.265531] nix-grpc-daemon[1485]: time=2026-09-20T10:53:17.905Z level=INFO msg="Upload complete. (495ms)"6123worker1 # [ 162.276529] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=7526124worker1 # [ 162.293249] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449906125worker1 # [ 162.299952] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6126worker1 # [ 162.307892] nix-daemon[833]: reaped child process 1923, status = succeeded6127worker1 # [ 162.320209] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6128worker1 # [ 163.152310] nix-daemon[833]: reaped child process 1937, status = succeeded6129worker1 # [ 163.317872] nix-daemon[833]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6130worker1 # [ 163.336329] nix-daemon[833]: reaped child process 1955, status = succeeded6131lb # [ 163.354194] niks3-server[1044]: 2026/09/20 10:53:18 INFO Received uploads request method=POST path=/api/pending_closures6132worker1 # [ 163.361676] nix-grpc-daemon[1485]: time=2026-09-20T10:53:18.999Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6133worker1 # [ 163.363324] nix-grpc-daemon[1485]: time=2026-09-20T10:53:18.999Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6134lb # [ 163.394386] niks3-server[1044]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6135worker1 # [ 163.409612] nix-grpc-daemon[1485]: time=2026-09-20T10:53:19.048Z level=INFO msg="Uploading 1 narinfos"6136lb # [ 163.411401] niks3-server[1044]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6137lb # [ 163.421671] niks3-server[1044]: 2026/09/20 10:53:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6138lb # [ 163.429206] niks3-server[1044]: 2026/09/20 10:53:19 INFO Signed narinfos id=61 count=16139lb # [ 163.437225] niks3-server[1044]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6140worker1 # [ 163.433413] nix-grpc-daemon[1485]: time=2026-09-20T10:53:19.072Z level=INFO msg="Upload complete. (303ms)"6141lb # [ 163.442751] niks3-server[1044]: 2026/09/20 10:53:19 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6142lb # [ 163.447519] niks3-server[1044]: 2026/09/20 10:53:19 INFO Completed upload id=616143worker1 # [ 163.446053] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=16144lb # [ 163.451253] niks3-server[1044]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6145worker1 # [ 163.460966] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:19Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16146worker1 # [ 163.467735] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449906147worker1 # [ 163.472349] nix-daemon[833]: reaped child process 1935, status = succeeded6148worker1 # [ 163.479467] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449906149worker1 # [ 163.491462] nix-grpc-daemon[1485]: time=2026-09-20T10:53:19.130Z level=INFO msg="All 2 paths already cached"6150worker1 # [ 163.499475] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:449906151worker1 # [ 163.511117] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6152worker1 # [ 163.704674] nix-daemon[833]: accepted connection from pid 1959, user nix-grpc-daemon (trusted)6153worker1 # [ 163.725499] nix-daemon[833]: reaped child process 1962, status = succeeded6154worker1 # [ 163.902442] nix-daemon[833]: accepted connection from pid 1964, user nix-grpc-daemon (trusted)6155worker1 # [ 163.919952] nix-daemon[833]: reaped child process 1967, status = succeeded6156lb # [ 163.933585] niks3-server[1044]: 2026/09/20 10:53:19 INFO Received uploads request method=POST path=/api/pending_closures6157worker1 # [ 163.940214] nix-grpc-daemon[1485]: time=2026-09-20T10:53:19.579Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6158worker1 # [ 163.943410] nix-grpc-daemon[1485]: time=2026-09-20T10:53:19.582Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6159lb # [ 163.963378] niks3-server[1044]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6160lb # [ 163.980336] niks3-server[1044]: 2026/09/20 10:53:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6161worker1 # [ 163.983605] nix-grpc-daemon[1485]: time=2026-09-20T10:53:19.622Z level=INFO msg="Uploading 1 narinfos"6162lb # [ 163.992391] niks3-server[1044]: 2026/09/20 10:53:19 INFO Signed narinfos id=62 count=16163lb # [ 163.999278] niks3-server[1044]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6164lb # [ 164.007315] niks3-server[1044]: 2026/09/20 10:53:19 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6165lb # [ 164.015221] niks3-server[1044]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6166lb # [ 164.020257] niks3-server[1044]: 2026/09/20 10:53:19 INFO Completed upload id=626167worker1 # [ 164.018220] nix-grpc-daemon[1485]: time=2026-09-20T10:53:19.657Z level=INFO msg="Upload complete. (494ms)"6168worker1 # [ 164.026905] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=0 paths=1 nar_bytes_in=7526169worker1 # [ 164.036859] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:449906170worker1 # [ 164.048395] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6171worker1 # [ 164.053442] nix-daemon[833]: reaped child process 1957, status = succeeded6172worker1 # [ 164.065683] nix-daemon[833]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6173worker1 # [ 165.511018] nix-daemon[833]: reaped child process 1971, status = succeeded6174worker1 # [ 165.687479] nix-daemon[833]: accepted connection from pid 1986, user nix-grpc-daemon (trusted)6175worker1 # [ 165.704492] nix-daemon[833]: reaped child process 1989, status = succeeded6176lb # [ 165.722086] niks3-server[1044]: 2026/09/20 10:53:21 INFO Received uploads request method=POST path=/api/pending_closures6177worker1 # [ 165.730465] nix-grpc-daemon[1485]: time=2026-09-20T10:53:21.368Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6178worker1 # [ 165.732359] nix-grpc-daemon[1485]: time=2026-09-20T10:53:21.368Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6179lb # [ 165.761821] niks3-server[1044]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6180lb # [ 165.770553] niks3-server[1044]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6181worker1 # [ 165.778027] nix-grpc-daemon[1485]: time=2026-09-20T10:53:21.417Z level=INFO msg="Uploading 1 narinfos"6182lb # [ 165.781551] niks3-server[1044]: 2026/09/20 10:53:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6183lb # [ 165.790616] niks3-server[1044]: 2026/09/20 10:53:21 INFO Signed narinfos id=63 count=16184lb # [ 165.796644] niks3-server[1044]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6185lb # [ 165.804201] niks3-server[1044]: 2026/09/20 10:53:21 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6186lb # [ 165.810444] niks3-server[1044]: 2026/09/20 10:53:21 INFO Completed upload id=636187worker1 # [ 165.807331] nix-grpc-daemon[1485]: time=2026-09-20T10:53:21.446Z level=INFO msg="Upload complete. (327ms)"6188lb # [ 165.813590] niks3-server[1044]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6189worker1 # [ 165.821200] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44990 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=16190worker1 # [ 165.838370] nix-daemon[833]: reaped child process 1969, status = succeeded6191client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.97 seconds)6192worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6193worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6194client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16195worker2 # [ 166.326836] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:366366196worker1 # [ 166.275166] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449906197worker1 # [ 166.300194] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:21Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06198lb # [ 171.095448] envoy[925]: conn peer=[2001:db8:1::1]:33658 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27062 tx=10626 ms=196616199client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.34 seconds)6200(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 50.39 seconds)6201subtest: low disk drains a worker and builds go to the other6202worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6203worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.16 seconds)6204worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6205worker1 # [ 197.952508] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:53Z level=info event=unhealthy reason=min_free6206worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds)6207client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26208worker1 # [ 198.896616] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:449906209client # don't know how to build these paths:6210client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6211worker1 # [ 198.906458] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:449906212worker1 # [ 198.935851] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:54Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06213worker1 # [ 198.941613] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:54Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16214worker2 # [ 199.050873] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366366215worker2 # [ 199.069335] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366366216client # copying 1 paths to 'lb:50051'...6217client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6218worker2 # [ 199.085557] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366366219worker2 # [ 199.104167] nix-daemon[831]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6220worker2 # [ 199.135329] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:53Z level=info event=niks3_push_started pid=17456221worker2 # [ 199.527961] nix-daemon[831]: accepted connection from pid 1758, user nix-grpc-daemon (trusted)6222worker2 # [ 199.544653] nix-daemon[831]: reaped child process 1761, status = succeeded6223worker2 # [ 199.722956] nix-daemon[831]: accepted connection from pid 1763, user nix-grpc-daemon (trusted)6224worker2 # [ 199.739734] nix-daemon[831]: reaped child process 1766, status = succeeded6225lb # [ 199.692639] niks3-server[1044]: 2026/09/20 10:53:55 INFO Received uploads request method=POST path=/api/pending_closures6226worker2 # [ 199.767113] nix-grpc-daemon[1745]: time=2026-09-20T10:53:54.404Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6227worker2 # [ 199.768939] nix-grpc-daemon[1745]: time=2026-09-20T10:53:54.404Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6228lb # [ 199.739314] niks3-server[1044]: 2026/09/20 10:53:55 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6229worker2 # [ 199.815049] nix-grpc-daemon[1745]: time=2026-09-20T10:53:54.453Z level=INFO msg="Uploading 1 narinfos"6230lb # [ 199.753638] niks3-server[1044]: 2026/09/20 10:53:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6231lb # [ 199.763454] niks3-server[1044]: 2026/09/20 10:53:55 INFO Signed narinfos id=64 count=16232lb # [ 199.770585] niks3-server[1044]: 2026/09/20 10:53:55 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6233lb # [ 199.783576] niks3-server[1044]: 2026/09/20 10:53:55 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6234lb # [ 199.790266] niks3-server[1044]: 2026/09/20 10:53:55 INFO Completed upload id=646235worker2 # [ 199.849983] nix-grpc-daemon[1745]: time=2026-09-20T10:53:54.489Z level=INFO msg="Upload complete. (494ms)"6236lb # [ 199.793753] niks3-server[1044]: 2026/09/20 10:53:55 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6237worker2 # [ 199.860364] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36636 duration_s=0 paths=1 nar_bytes_in=5126238worker2 # [ 199.877221] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366366239worker2 # [ 199.887792] nix-daemon[831]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6240worker2 # [ 199.890532] nix-daemon[831]: reaped child process 1743, status = succeeded6241client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6242client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6243worker2 # [ 199.909214] nix-daemon[831]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6244client # farm-a> LOG-farm-a-drain6245lb # [ 201.096654] envoy[925]: conn peer=[2001:db8:1::1]:44320 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=300676246worker2 # [ 201.358020] nix-daemon[831]: reaped child process 1770, status = succeeded6247worker2 # [ 201.545000] nix-daemon[831]: accepted connection from pid 1785, user nix-grpc-daemon (trusted)6248worker2 # [ 201.565128] nix-daemon[831]: reaped child process 1788, status = succeeded6249lb # [ 201.517083] niks3-server[1044]: 2026/09/20 10:53:57 INFO Received uploads request method=POST path=/api/pending_closures6250worker2 # [ 201.587092] nix-grpc-daemon[1745]: time=2026-09-20T10:53:56.226Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6251worker2 # [ 201.592788] nix-grpc-daemon[1745]: time=2026-09-20T10:53:56.228Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6252lb # [ 201.550330] niks3-server[1044]: 2026/09/20 10:53:57 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6253lb # [ 201.568653] niks3-server[1044]: 2026/09/20 10:53:57 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6254lb # [ 201.582572] niks3-server[1044]: 2026/09/20 10:53:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6255worker2 # [ 201.649858] nix-grpc-daemon[1745]: time=2026-09-20T10:53:56.287Z level=INFO msg="Uploading 1 narinfos"6256lb # [ 201.595302] niks3-server[1044]: 2026/09/20 10:53:57 INFO Signed narinfos id=65 count=16257lb # [ 201.601540] niks3-server[1044]: 2026/09/20 10:53:57 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6258lb # [ 201.609088] niks3-server[1044]: 2026/09/20 10:53:57 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6259lb # [ 201.616053] niks3-server[1044]: 2026/09/20 10:53:57 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6260lb # [ 201.620671] niks3-server[1044]: 2026/09/20 10:53:57 INFO Completed upload id=656261worker2 # [ 201.680980] nix-grpc-daemon[1745]: time=2026-09-20T10:53:56.320Z level=INFO msg="Upload complete. (359ms)"6262worker2 # [ 201.693157] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36636 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=16263worker1 # [ 201.635864] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:57Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06264worker1 # [ 201.641993] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:57Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16265worker2 # [ 201.713772] nix-daemon[831]: reaped child process 1768, status = succeeded6266worker2 # [ 201.747077] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366366267worker2 # [ 201.763053] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366366268worker2 # [ 201.778593] nix-grpc-daemon[1745]: time=2026-09-20T10:53:56.417Z level=INFO msg="All 1 paths already cached"6269client # copying 1 paths to 'lb:50051'...6270worker2 # [ 201.783957] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366366271client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6272worker2 # [ 201.802313] nix-daemon[831]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6273worker2 # [ 202.020643] nix-daemon[831]: accepted connection from pid 1792, user nix-grpc-daemon (trusted)6274worker2 # [ 202.040350] nix-daemon[831]: reaped child process 1795, status = succeeded6275worker2 # [ 202.212491] nix-daemon[831]: accepted connection from pid 1797, user nix-grpc-daemon (trusted)6276worker2 # [ 202.228384] nix-daemon[831]: reaped child process 1800, status = succeeded6277lb # [ 202.181687] niks3-server[1044]: 2026/09/20 10:53:57 INFO Received uploads request method=POST path=/api/pending_closures6278worker2 # [ 202.251200] nix-grpc-daemon[1745]: time=2026-09-20T10:53:56.890Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6279worker2 # [ 202.252832] nix-grpc-daemon[1745]: time=2026-09-20T10:53:56.890Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6280lb # [ 202.208838] niks3-server[1044]: 2026/09/20 10:53:57 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6281worker2 # [ 202.281622] nix-grpc-daemon[1745]: time=2026-09-20T10:53:56.920Z level=INFO msg="Uploading 1 narinfos"6282lb # [ 202.225739] niks3-server[1044]: 2026/09/20 10:53:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6283lb # [ 202.237316] niks3-server[1044]: 2026/09/20 10:53:57 INFO Signed narinfos id=66 count=16284worker2 # [ 202.309928] nix-grpc-daemon[1745]: time=2026-09-20T10:53:56.949Z level=INFO msg="Upload complete. (490ms)"6285lb # [ 202.250020] niks3-server[1044]: 2026/09/20 10:53:57 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6286worker2 # [ 202.315735] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36636 duration_s=0 paths=1 nar_bytes_in=6326287lb # [ 202.255844] niks3-server[1044]: 2026/09/20 10:53:57 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6288lb # [ 202.261391] niks3-server[1044]: 2026/09/20 10:53:57 INFO Completed upload id=666289worker2 # [ 202.324249] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366366290lb # [ 202.264104] niks3-server[1044]: 2026/09/20 10:53:57 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6291worker2 # [ 202.336586] nix-daemon[831]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6292worker2 # [ 202.339330] nix-daemon[831]: reaped child process 1790, status = succeeded6293client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6294worker2 # [ 202.349380] nix-daemon[831]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6295client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6296client # farm-b> LOG-farm-b-drain6297worker2 # [ 203.197446] nix-daemon[831]: reaped child process 1804, status = succeeded6298worker2 # [ 203.370737] nix-daemon[831]: accepted connection from pid 1819, user nix-grpc-daemon (trusted)6299worker2 # [ 203.388606] nix-daemon[831]: reaped child process 1822, status = succeeded6300lb # [ 203.340624] niks3-server[1044]: 2026/09/20 10:53:58 INFO Received uploads request method=POST path=/api/pending_closures6301worker2 # [ 203.410666] nix-grpc-daemon[1745]: time=2026-09-20T10:53:58.049Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6302worker2 # [ 203.412246] nix-grpc-daemon[1745]: time=2026-09-20T10:53:58.049Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6303lb # [ 203.374042] niks3-server[1044]: 2026/09/20 10:53:59 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6304lb # [ 203.388575] niks3-server[1044]: 2026/09/20 10:53:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6305worker2 # [ 203.456752] nix-grpc-daemon[1745]: time=2026-09-20T10:53:58.095Z level=INFO msg="Uploading 1 narinfos"6306lb # [ 203.401531] niks3-server[1044]: 2026/09/20 10:53:59 INFO Signed narinfos id=67 count=16307lb # [ 203.409618] niks3-server[1044]: 2026/09/20 10:53:59 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6308lb # [ 203.418634] niks3-server[1044]: 2026/09/20 10:53:59 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6309worker2 # [ 203.486925] nix-grpc-daemon[1745]: time=2026-09-20T10:53:58.126Z level=INFO msg="Upload complete. (326ms)"6310lb # [ 203.428343] niks3-server[1044]: 2026/09/20 10:53:59 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6311lb # [ 203.433791] niks3-server[1044]: 2026/09/20 10:53:59 INFO Completed upload id=676312lb # [ 203.436759] niks3-server[1044]: 2026/09/20 10:53:59 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6313worker2 # [ 203.501045] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36636 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=16314worker1 # [ 203.442837] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:59Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06315worker1 # [ 203.449030] nix-grpc-daemon[1415]: ts=2026-09-20T10:53:59Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16316worker2 # [ 203.515708] nix-daemon[831]: reaped child process 1802, status = succeeded6317worker2 # [ 203.548966] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366366318worker2 # [ 203.566801] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366366319worker2 # [ 203.581296] nix-grpc-daemon[1745]: time=2026-09-20T10:53:58.220Z level=INFO msg="All 2 paths already cached"6320client # copying 1 paths to 'lb:50051'...6321client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6322worker2 # [ 203.591463] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366366323worker2 # [ 203.605563] nix-daemon[831]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6324worker2 # [ 203.805488] nix-daemon[831]: accepted connection from pid 1826, user nix-grpc-daemon (trusted)6325worker2 # [ 203.825340] nix-daemon[831]: reaped child process 1829, status = succeeded6326worker2 # [ 203.998576] nix-daemon[831]: accepted connection from pid 1831, user nix-grpc-daemon (trusted)6327worker2 # [ 204.019258] nix-daemon[831]: reaped child process 1834, status = succeeded6328lb # [ 203.970845] niks3-server[1044]: 2026/09/20 10:53:59 INFO Received uploads request method=POST path=/api/pending_closures6329worker2 # [ 204.040215] nix-grpc-daemon[1745]: time=2026-09-20T10:53:58.679Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6330worker2 # [ 204.042158] nix-grpc-daemon[1745]: time=2026-09-20T10:53:58.681Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6331lb # [ 204.002566] niks3-server[1044]: 2026/09/20 10:53:59 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6332lb # [ 204.014419] niks3-server[1044]: 2026/09/20 10:53:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6333worker2 # [ 204.081006] nix-grpc-daemon[1745]: time=2026-09-20T10:53:58.720Z level=INFO msg="Uploading 1 narinfos"6334lb # [ 204.025707] niks3-server[1044]: 2026/09/20 10:53:59 INFO Signed narinfos id=68 count=16335lb # [ 204.031467] niks3-server[1044]: 2026/09/20 10:53:59 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6336lb # [ 204.038906] niks3-server[1044]: 2026/09/20 10:53:59 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6337lb # [ 204.045130] niks3-server[1044]: 2026/09/20 10:53:59 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6338lb # [ 204.049256] niks3-server[1044]: 2026/09/20 10:53:59 INFO Completed upload id=686339worker2 # [ 204.109469] nix-grpc-daemon[1745]: time=2026-09-20T10:53:58.748Z level=INFO msg="Upload complete. (487ms)"6340worker2 # [ 204.117335] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36636 duration_s=0 paths=1 nar_bytes_in=7606341worker2 # [ 204.131014] nix-grpc-daemon[1689]: ts=2026-09-20T10:53:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366366342worker2 # [ 204.137259] nix-daemon[831]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6343worker2 # [ 204.142001] nix-daemon[831]: reaped child process 1824, status = succeeded6344client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6345client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6346worker2 # [ 204.155858] nix-daemon[831]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6347client # farm-top> LOG-farm-top-drain6348worker2 # [ 205.790688] nix-daemon[831]: reaped child process 1838, status = succeeded6349worker2 # [ 205.954956] nix-daemon[831]: accepted connection from pid 1853, user nix-grpc-daemon (trusted)6350worker2 # [ 205.974346] nix-daemon[831]: reaped child process 1856, status = succeeded6351lb # [ 205.929675] niks3-server[1044]: 2026/09/20 10:54:01 INFO Received uploads request method=POST path=/api/pending_closures6352worker2 # [ 205.999506] nix-grpc-daemon[1745]: time=2026-09-20T10:54:00.637Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6353worker2 # [ 206.001164] nix-grpc-daemon[1745]: time=2026-09-20T10:54:00.637Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6354lb # [ 205.965317] niks3-server[1044]: 2026/09/20 10:54:01 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6355worker2 # [ 206.037573] nix-grpc-daemon[1745]: time=2026-09-20T10:54:00.676Z level=INFO msg="Uploading 1 narinfos"6356lb # [ 205.980335] niks3-server[1044]: 2026/09/20 10:54:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6357lb # [ 205.990667] niks3-server[1044]: 2026/09/20 10:54:01 INFO Signed narinfos id=69 count=16358lb # [ 205.996231] niks3-server[1044]: 2026/09/20 10:54:01 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6359lb # [ 206.003603] niks3-server[1044]: 2026/09/20 10:54:01 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6360worker2 # [ 206.063401] nix-grpc-daemon[1745]: time=2026-09-20T10:54:00.702Z level=INFO msg="Upload complete. (296ms)"6361lb # [ 206.006670] niks3-server[1044]: 2026/09/20 10:54:01 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6362lb # [ 206.010990] niks3-server[1044]: 2026/09/20 10:54:01 INFO Completed upload id=696363lb # [ 206.013188] niks3-server[1044]: 2026/09/20 10:54:01 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6364worker2 # [ 206.072848] nix-grpc-daemon[1689]: ts=2026-09-20T10:54:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36636 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=16365worker2 # [ 206.087222] nix-daemon[831]: reaped child process 1836, status = succeeded6366client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.42 seconds)6367client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6368client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds)6369worker1: must succeed: rm /nix/.rw-store/fill6370worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6371worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6372worker1 # [ 206.957423] nix-grpc-daemon[1415]: ts=2026-09-20T10:54:02Z level=info event=healthy reason=min_free6373worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.13 seconds)6374(finished: subtest: low disk drains a worker and builds go to the other, in 11.33 seconds)6375(finished: run the VM test script, in 208.60 seconds)6376test script finished in 208.88s6377cleanup6378kill QemuMachine (pid 49)6379client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6380kill QemuMachine (pid 50)6381lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6382kill QemuMachine (pid 52)6383worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6384kill QemuMachine (pid 51)6385worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6386(finished: cleanup, in 1.09 seconds)6387additionally exposed symbols:6388 client, lb, worker1, worker2,6389 vlan1,6390 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh