vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #250
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.01 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb # Formatting '/build/vm-state-lb/tmp.p4KfHYX04m', fmt=raw size=107374182414lb # mke2fs 1.47.4 (6-Mar-2025)15lb: QEMU running (pid 49)16lb # Discarding device blocks: 0/262144 done17worker2: QEMU running (pid 52)18client # Disk image does not exist, creating the virtualisation disk image...19worker1 # Disk image does not exist, creating the virtualisation disk image...20client: QEMU running (pid 50)21lb # Creating filesystem with 262144 4k blocks and 65536 inodes22worker1: QEMU running (pid 51)23worker2 # Disk image does not exist, creating the virtualisation disk image...24lb # Filesystem UUID: f7fe3c4d-9da3-4549-9cfa-007ef626cfd625client # Formatting '/build/vm-state-client/tmp.mzz9hoNptM', fmt=raw size=107374182426worker1 # Formatting '/build/vm-state-worker1/tmp.pRNeAnpSwi', fmt=raw size=107374182427worker2 # Formatting '/build/vm-state-worker2/tmp.bDgexGe3WL', fmt=raw size=107374182428client # mke2fs 1.47.4 (6-Mar-2025)29worker1 # mke2fs 1.47.4 (6-Mar-2025)30worker2 # mke2fs 1.47.4 (6-Mar-2025)31client # Discarding device blocks: 0/262144 done32worker1 # Discarding device blocks: 0/262144 done33worker2 # Discarding device blocks: 0/262144 done34client # Creating filesystem with 262144 4k blocks and 65536 inodes35worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes36worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes37client # Filesystem UUID: 33e3f831-3721-47ea-8cc4-681d9b647cda38worker1 # Filesystem UUID: 3f9e9baf-3367-4243-9cc0-9e47f0d8084939worker2 # Filesystem UUID: 9aefabf4-618d-4812-897d-9808e109419740client # Superblock backups stored on blocks:41worker1 # Superblock backups stored on blocks:42worker1 # 32768, 98304, 163840, 22937643client # 32768, 98304, 163840, 22937644(finished: start all VMs, in 0.53 seconds)45lb # Superblock backups stored on blocks:46worker2 # Superblock backups stored on blocks:47worker1 # 48worker1 # Allocating group tables: 0/8 done49worker2 # 32768, 98304, 163840, 22937650client: waiting for unit network-addresses-eth1.service51client # 52worker2 # 53client: waiting for the VM to finish booting54client # Allocating group tables: 0/8 done55worker2 # Allocating group tables: 0/8 done56worker1 # Writing inode tables: 0/8 done57lb # 32768, 98304, 163840, 22937658client # Writing inode tables: 0/8 done59worker2 # Writing inode tables: 0/8 done60worker1 # Creating journal (8192 blocks): done61lb # 62client # Creating journal (8192 blocks): done63worker2 # Creating journal (8192 blocks): done64worker1 # Writing superblocks and filesystem accounting information: 0/8 done65lb # Allocating group tables: 0/8 done66client # Writing superblocks and filesystem accounting information: 0/8 done67worker2 # Writing superblocks and filesystem accounting information: 0/8 done68worker1 # 69lb # Writing inode tables: 0/8 done70client # 71worker2 # 72worker1 # Virtualisation disk image created.73lb # Creating journal (8192 blocks): done74client # Virtualisation disk image created.75lb # Writing superblocks and filesystem accounting information: 0/8 done76worker2 # Virtualisation disk image created.77lb # 78lb # Virtualisation disk image created.79lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681lb # [ 0.000000] KASLR enabled82lb # [ 0.000000] random: crng init done83lb # [ 0.000000] Machine model: linux,dummy-virt84lb # [ 0.000000] efi: UEFI not found.85lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88lb # [ 0.000000] Zone ranges:89lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90lb # [ 0.000000] DMA32 empty91lb # [ 0.000000] Normal empty92lb # [ 0.000000] Device empty93lb # [ 0.000000] Movable zone start for each node94lb # [ 0.000000] Early memory node ranges95lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098lb # [ 0.000000] psci: probing for conduit method from DT.99lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.100lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101lb # [ 0.000000] psci: Trusted OS migration not required102lb # [ 0.000000] psci: SMC Calling Convention v1.1103lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105lb # [ 0.000000] Detected PIPT I-cache on CPU0106lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107lb # [ 0.000000] CPU features: detected: GICv3 CPU interface108lb # [ 0.000000] CPU features: detected: Spectre-v4109lb # [ 0.000000] CPU features: detected: Spectre-BHB110lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112lb # [ 0.000000] alternatives: applying boot alternatives113lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0114lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.115lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119lb # [ 0.000000] software IO TLB: area num 1.120lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122lb # [ 0.000000] Fallback order for Node 0: 0123lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124lb # [ 0.000000] Policy zone: DMA125worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]126lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off127lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1128lb # [ 0.000000] allocated 3145728 bytes of page_ext129worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026130worker2 # [ 0.000000] KASLR enabled131lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages132worker2 # [ 0.000000] random: crng init done133lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups134worker2 # [ 0.000000] Machine model: linux,dummy-virt135lb # [ 0.000000] rcu: Hierarchical RCU implementation.136worker2 # [ 0.000000] efi: UEFI not found.137lb # [ 0.000000] rcu: RCU event tracing is enabled.138worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT139lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.140worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]141lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.142worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]143lb # [ 0.000000] Rude variant of Tasks RCU enabled.144worker2 # [ 0.000000] Zone ranges:145lb # [ 0.000000] Tracing variant of Tasks RCU enabled.146worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]147worker2 # [ 0.000000] DMA32 empty148lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.149worker2 # [ 0.000000] Normal empty150worker2 # [ 0.000000] Device empty151lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1152worker2 # [ 0.000000] Movable zone start for each node153worker2 # [ 0.000000] Early memory node ranges154lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.155worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]156lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.157worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]158worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000159lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.160worker2 # [ 0.000000] psci: probing for conduit method from DT.161lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0162worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.163lb # [ 0.000000] GICv3: 256 SPIs implemented164lb # [ 0.000000] GICv3: 0 Extended SPIs implemented165worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs166lb # [ 0.000000] Root IRQ handler: gic_handle_irq167worker2 # [ 0.000000] psci: Trusted OS migration not required168worker2 # [ 0.000000] psci: SMC Calling Convention v1.1169lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI170lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0171worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)172lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000173lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]174worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296175worker2 # [ 0.000000] Detected PIPT I-cache on CPU0176lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)177worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)178worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface179lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)180worker2 # [ 0.000000] CPU features: detected: Spectre-v4181lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000182worker2 # [ 0.000000] CPU features: detected: Spectre-BHB183lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000184worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38185worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23186lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.187worker2 # [ 0.000000] alternatives: applying boot alternatives188lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns189lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).190worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]191lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns192worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026193worker1 # [ 0.000000] KASLR enabled194lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns195worker1 # [ 0.000000] random: crng init done196worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/653izmi0ka8dwac3kpqd66p1v4c6d633-nixos-system-worker2-test/init regInfo=/nix/store/a21z6nrlwrspnl4pf7fkqnw4r5z0paf2-closure-info/registration console=ttyAMA0,115200n8 console=tty0197lb # [ 0.000042] arm-pv: using stolen time PV198worker1 # [ 0.000000] Machine model: linux,dummy-virt199worker1 # [ 0.000000] efi: UEFI not found.200lb # [ 0.000788] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)201worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT202lb # [ 0.000971] Console: colour dummy device 80x25203worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/a21z6nrlwrspnl4pf7fkqnw4r5z0paf2-closure-info/registration", will be passed to user space.204worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]205lb # [ 0.000979] printk: legacy console [tty0] enabled206worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]207worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes208worker1 # [ 0.000000] Zone ranges:209lb # [ 0.001180] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)210worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)211worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]212lb # [ 0.001187] pid_max: default: 32768 minimum: 301213worker1 # [ 0.000000] DMA32 empty214worker1 # [ 0.000000] Normal empty215worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)216lb # [ 0.001259] LSM: initializing lsm=capability,landlock,yama,bpf,ima217worker1 # [ 0.000000] Device empty218lb # [ 0.001477] landlock: Up and running.219worker1 # [ 0.000000] Movable zone start for each node220worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB221lb # [ 0.001479] Yama: becoming mindful.222worker2 # [ 0.000000] software IO TLB: area num 1.223worker1 # [ 0.000000] Early memory node ranges224lb # [ 0.002251] LSM support for eBPF active225worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]226worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB227lb # [ 0.002419] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)228worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]229worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)230lb # [ 0.002459] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)231worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000232worker2 # [ 0.000000] Fallback order for Node 0: 0233worker1 # [ 0.000000] psci: probing for conduit method from DT.234lb # [ 0.003705] cacheinfo: Unable to detect cache hierarchy for CPU 0235worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216236worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.237lb # [ 0.004530] rcu: Hierarchical SRCU implementation.238worker2 # [ 0.000000] Policy zone: DMA239worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs240lb # [ 0.004534] rcu: Max phase no-delay instances is 1000.241worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off242worker1 # [ 0.000000] psci: Trusted OS migration not required243lb # [ 0.005817] fsl-mc MSI: its@8080000 domain created244worker1 # [ 0.000000] psci: SMC Calling Convention v1.1245worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1246lb # [ 0.005917] EFI services will not be available.247worker2 # [ 0.000000] allocated 3145728 bytes of page_ext248lb # [ 0.005987] smp: Bringing up secondary CPUs ...249worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)250worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages251lb # [ 0.006004] smp: Brought up 1 node, 1 CPU252lb # [ 0.006007] SMP: Total of 1 processors activated.253worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296254worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups255worker1 # [ 0.000000] Detected PIPT I-cache on CPU0256lb # [ 0.006012] CPU: All CPU(s) started at EL1257worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.258worker2 # [ 0.000000] rcu: RCU event tracing is enabled.259lb # [ 0.006024] CPU features: detected: Branch Target Identification260client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]261worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)262worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.263lb # [ 0.006029] CPU features: detected: ARMv8.4 Translation Table Level264worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface265worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.266worker1 # [ 0.000000] CPU features: detected: Spectre-v4267client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026268lb # [ 0.006032] CPU features: detected: Instruction cache invalidation not required for I/D coherence269worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.270worker1 # [ 0.000000] CPU features: detected: Spectre-BHB271client # [ 0.000000] KASLR enabled272client # [ 0.000000] random: crng init done273worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.274worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38275lb # [ 0.006036] CPU features: detected: Data cache clean to the PoU not required for I/D coherence276client # [ 0.000000] Machine model: linux,dummy-virt277worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.278client # [ 0.000000] efi: UEFI not found.279worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23280lb # [ 0.006039] CPU features: detected: Common not Private translations281worker1 # [ 0.000000] alternatives: applying boot alternatives282worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1283lb # [ 0.006042] CPU features: detected: CRC32 instructions284client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT285lb # [ 0.006045] CPU features: detected: Data cache clean to Point of Deep Persistence286client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]287worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.288client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]289lb # [ 0.006049] CPU features: detected: Data cache clean to Point of Persistence290client # [ 0.000000] Zone ranges:291worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.292lb # [ 0.006052] CPU features: detected: Data independent timing control (DIT)293client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]294lb # [ 0.006055] CPU features: detected: E0PD295client # [ 0.000000] DMA32 empty296worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.297client # [ 0.000000] Normal empty298worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bd8l1brw989alvvrp02daysj9ckfky9v-nixos-system-worker1-test/init regInfo=/nix/store/d8yni1hr6dr8cwacx46vd28l4c239im6-closure-info/registration console=ttyAMA0,115200n8 console=tty0299client # [ 0.000000] Device empty300lb # [ 0.006057] CPU features: detected: Enhanced Counter Virtualization301worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0302client # [ 0.000000] Movable zone start for each node303worker2 # [ 0.000000] GICv3: 256 SPIs implemented304client # [ 0.000000] Early memory node ranges305lb # [ 0.006060] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)306worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented307client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]308lb # [ 0.006064] CPU features: detected: Enhanced Virtualization Traps309worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq310worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/d8yni1hr6dr8cwacx46vd28l4c239im6-closure-info/registration", will be passed to user space.311worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI312lb # [ 0.006067] CPU features: detected: Fine Grained Traps313client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]314worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0315worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes316lb # [ 0.006070] CPU features: detected: Generic authentication (architected QARMA5 algorithm)317client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000318worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000319client # [ 0.000000] psci: probing for conduit method from DT.320lb # [ 0.006074] CPU features: detected: RCpc load-acquire (LDAPR)321worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)322worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]323client # [ 0.000000] psci: PSCIv1.3 detected in firmware.324lb # [ 0.006077] CPU features: detected: LSE atomic instructions325client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs326worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)327lb # [ 0.006080] CPU features: detected: Privileged Access Never328worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)329client # [ 0.000000] psci: Trusted OS migration not required330worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB331lb # [ 0.006083] CPU features: detected: PMUv3332client # [ 0.000000] psci: SMC Calling Convention v1.1333worker1 # [ 0.000000] software IO TLB: area num 1.334lb # [ 0.006085] CPU features: detected: RAS Extension Support335worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)336worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB337client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)338lb # [ 0.006088] CPU features: detected: RASv1p1 Extension Support339worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000340lb # [ 0.006091] CPU features: detected: Random Number Generator341client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296342worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)343worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000344worker1 # [ 0.000000] Fallback order for Node 0: 0345client # [ 0.000000] Detected PIPT I-cache on CPU0346lb # [ 0.006093] CPU features: detected: Speculation barrier (SB)347worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.348worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216349lb # [ 0.006096] CPU features: detected: Stage-2 Force Write-Back350client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)351worker1 # [ 0.000000] Policy zone: DMA352client # [ 0.000000] CPU features: detected: GICv3 CPU interface353lb # [ 0.006099] CPU features: detected: TLB range maintenance instructions354worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns355worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off356client # [ 0.000000] CPU features: detected: Spectre-v4357lb # [ 0.006104] CPU features: detected: Speculative Store Bypassing Safe (SSBS)358worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).359worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1360client # [ 0.000000] CPU features: detected: Spectre-BHB361lb # [ 0.006145] alternatives: applying system-wide alternatives362worker1 # [ 0.000000] allocated 3145728 bytes of page_ext363client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38364worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns365worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages366lb # [ 0.009221] CPU features: detected: BBM Level 2 without TLB conflict abort367client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23368worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups369client # [ 0.000000] alternatives: applying boot alternatives370worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns371worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.372worker2 # [ 0.000034] arm-pv: using stolen time PV373worker1 # [ 0.000000] rcu: RCU event tracing is enabled.374lb # [ 0.009444] Memory: 1406564K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)375lb # [ 0.009836] devtmpfs: initialized376worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.377worker2 # [ 0.000632] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)378worker2 # [ 0.000817] Console: colour dummy device 80x25379worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.380lb # [ 0.011689] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)381worker2 # [ 0.000825] printk: legacy console [tty0] enabled382worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.383lb # [ 0.011714] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).384worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.385client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test/init regInfo=/nix/store/5w5n39zm4lsx78izjimsskk5ypfszqda-closure-info/registration console=ttyAMA0,115200n8 console=tty0386worker2 # [ 0.001016] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)387lb # [ 0.011910] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL388worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.389lb # [ 0.011914] 0 pages in range for non-PLT usage390worker2 # [ 0.001023] pid_max: default: 32768 minimum: 301391worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1392lb # [ 0.011915] 508288 pages in range for PLT usage393worker2 # [ 0.001096] LSM: initializing lsm=capability,landlock,yama,bpf,ima394client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/5w5n39zm4lsx78izjimsskk5ypfszqda-closure-info/registration", will be passed to user space.395worker2 # [ 0.001281] landlock: Up and running.396lb # [ 0.012033] pinctrl core: initialized pinctrl subsystem397worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.398worker2 # [ 0.001283] Yama: becoming mindful.399lb # [ 0.012799] DMI not present or invalid.400worker2 # [ 0.001862] LSM support for eBPF active401lb # [ 0.016693] NET: Registered PF_NETLINK/PF_ROUTE protocol family402client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes403worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.404worker2 # [ 0.002011] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)405lb # [ 0.018995] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations406client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)407worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.408worker2 # [ 0.002222] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)409lb # [ 0.019190] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations410client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)411worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0412worker2 # [ 0.003368] cacheinfo: Unable to detect cache hierarchy for CPU 0413worker1 # [ 0.000000] GICv3: 256 SPIs implemented414lb # [ 0.019399] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations415worker2 # [ 0.004173] rcu: Hierarchical SRCU implementation.416client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB417worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented418client # [ 0.000000] software IO TLB: area num 1.419lb # [ 0.019423] audit: initializing netlink subsys (disabled)420worker2 # [ 0.004177] rcu: Max phase no-delay instances is 1000.421worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq422worker2 # [ 0.005339] fsl-mc MSI: its@8080000 domain created423client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB424worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI425lb # [ 0.020080] thermal_sys: Registered thermal governor 'fair_share'426worker2 # [ 0.005430] EFI services will not be available.427worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0428lb # [ 0.020082] thermal_sys: Registered thermal governor 'bang_bang'429client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)430worker2 # [ 0.005523] smp: Bringing up secondary CPUs ...431client # [ 0.000000] Fallback order for Node 0: 0432lb # [ 0.020086] thermal_sys: Registered thermal governor 'step_wise'433worker2 # [ 0.005532] smp: Brought up 1 node, 1 CPU434worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000435worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]436worker2 # [ 0.005535] SMP: Total of 1 processors activated.437client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216438lb # [ 0.020091] thermal_sys: Registered thermal governor 'user_space'439client # [ 0.000000] Policy zone: DMA440worker2 # [ 0.005541] CPU: All CPU(s) started at EL1441lb # [ 0.020094] thermal_sys: Registered thermal governor 'power_allocator'442worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)443worker2 # [ 0.005552] CPU features: detected: Branch Target Identification444client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off445lb # [ 0.020122] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1446worker2 # [ 0.005557] CPU features: detected: ARMv8.4 Translation Table Level447client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1448worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)449lb # [ 0.020131] cpuidle: using governor ladder450client # [ 0.000000] allocated 3145728 bytes of page_ext451worker2 # [ 0.005561] CPU features: detected: Instruction cache invalidation not required for I/D coherence452worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000453client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages454lb # [ 0.020137] cpuidle: using governor menu455worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000456lb # [ 0.020368] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.457client # [ 0.000000] ftrace: allocated 294 pages with 4 groups458worker2 # [ 0.005564] CPU features: detected: Data cache clean to the PoU not required for I/D coherence459lb # [ 0.020385] ASID allocator initialised with 65536 entries460client # [ 0.000000] rcu: Hierarchical RCU implementation.461worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.462worker2 # [ 0.005568] CPU features: detected: Common not Private translations463lb # [ 0.021694] Serial: AMBA PL011 UART driver464client # [ 0.000000] rcu: RCU event tracing is enabled.465worker2 # [ 0.005571] CPU features: detected: CRC32 instructions466lb # [ 0.027298] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1467client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.468worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns469lb # [ 0.027453] printk: console [ttyAMA0] enabled470worker2 # [ 0.005574] CPU features: detected: Data cache clean to Point of Deep Persistence471client # [ 0.000000] Trampoline variant of Tasks RCU enabled.472worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).473client # [ 0.000000] Rude variant of Tasks RCU enabled.474worker2 # [ 0.005578] CPU features: detected: Data cache clean to Point of Persistence475client # [ 0.000000] Tracing variant of Tasks RCU enabled.476worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns477worker2 # [ 0.005581] CPU features: detected: Data independent timing control (DIT)478client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.479worker2 # [ 0.005584] CPU features: detected: E0PD480worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns481worker1 # [ 0.000046] arm-pv: using stolen time PV482client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1483worker2 # [ 0.005587] CPU features: detected: Enhanced Counter Virtualization484worker2 # [ 0.005590] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)485client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.486worker1 # [ 0.000476] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)487worker2 # [ 0.005593] CPU features: detected: Enhanced Virtualization Traps488worker1 # [ 0.000640] Console: colour dummy device 80x25489client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.490worker2 # [ 0.005596] CPU features: detected: Fine Grained Traps491worker1 # [ 0.000648] printk: legacy console [tty0] enabled492worker2 # [ 0.005599] CPU features: detected: Generic authentication (architected QARMA5 algorithm)493client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.494worker1 # [ 0.000839] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)495client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0496worker2 # [ 0.005605] CPU features: detected: RCpc load-acquire (LDAPR)497worker1 # [ 0.000845] pid_max: default: 32768 minimum: 301498client # [ 0.000000] GICv3: 256 SPIs implemented499worker2 # [ 0.005608] CPU features: detected: LSE atomic instructions500worker1 # [ 0.000915] LSM: initializing lsm=capability,landlock,yama,bpf,ima501client # [ 0.000000] GICv3: 0 Extended SPIs implemented502worker2 # [ 0.005611] CPU features: detected: Privileged Access Never503worker1 # [ 0.001070] landlock: Up and running.504client # [ 0.000000] Root IRQ handler: gic_handle_irq505worker1 # [ 0.001072] Yama: becoming mindful.506worker2 # [ 0.005613] CPU features: detected: PMUv3507client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI508worker1 # [ 0.001538] LSM support for eBPF active509worker2 # [ 0.005616] CPU features: detected: RAS Extension Support510client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0511lb # [ 0.151069] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages512worker2 # [ 0.005619] CPU features: detected: RASv1p1 Extension Support513worker1 # [ 0.001690] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)514client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000515lb # [ 0.151087] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page516worker2 # [ 0.005621] CPU features: detected: Random Number Generator517client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]518worker1 # [ 0.001723] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)519lb # [ 0.151093] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages520worker2 # [ 0.005624] CPU features: detected: Speculation barrier (SB)521worker1 # [ 0.002928] cacheinfo: Unable to detect cache hierarchy for CPU 0522lb # [ 0.151097] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page523client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)524worker2 # [ 0.005627] CPU features: detected: Stage-2 Force Write-Back525worker1 # [ 0.003680] rcu: Hierarchical SRCU implementation.526worker1 # [ 0.003684] rcu: Max phase no-delay instances is 1000.527lb # [ 0.151102] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages528worker2 # [ 0.005630] CPU features: detected: TLB range maintenance instructions529client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)530worker1 # [ 0.004905] fsl-mc MSI: its@8080000 domain created531lb # [ 0.151106] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page532worker2 # [ 0.005635] CPU features: detected: Speculative Store Bypassing Safe (SSBS)533client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000534worker1 # [ 0.005000] EFI services will not be available.535lb # [ 0.151111] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages536worker2 # [ 0.005677] alternatives: applying system-wide alternatives537worker1 # [ 0.005074] smp: Bringing up secondary CPUs ...538client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000539worker1 # [ 0.005082] smp: Brought up 1 node, 1 CPU540lb # [ 0.151115] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page541worker2 # [ 0.008814] CPU features: detected: BBM Level 2 without TLB conflict abort542worker1 # [ 0.005085] SMP: Total of 1 processors activated.543client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.544worker1 # [ 0.005090] CPU: All CPU(s) started at EL1545worker1 # [ 0.005102] CPU features: detected: Branch Target Identification546client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns547worker2 # [ 0.009056] Memory: 1406776K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)548worker2 # [ 0.009470] devtmpfs: initialized549client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).550worker1 # [ 0.005107] CPU features: detected: ARMv8.4 Translation Table Level551lb # [ 0.158452] fbcon: Taking over console552lb # [ 0.158468] ACPI: Interpreter disabled.553worker2 # [ 0.011333] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)554worker1 # [ 0.005110] CPU features: detected: Instruction cache invalidation not required for I/D coherence555client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns556worker2 # [ 0.011357] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).557worker1 # [ 0.005114] CPU features: detected: Data cache clean to the PoU not required for I/D coherence558client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns559worker2 # [ 0.011543] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL560client # [ 0.000030] arm-pv: using stolen time PV561worker1 # [ 0.005117] CPU features: detected: Common not Private translations562worker1 # [ 0.005120] CPU features: detected: CRC32 instructions563client # [ 0.000390] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)564worker1 # [ 0.005123] CPU features: detected: Data cache clean to Point of Deep Persistence565client # [ 0.000564] Console: colour dummy device 80x25566client # [ 0.000571] printk: legacy console [tty0] enabled567worker1 # [ 0.005127] CPU features: detected: Data cache clean to Point of Persistence568worker1 # [ 0.005130] CPU features: detected: Data independent timing control (DIT)569client # [ 0.000762] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)570worker1 # [ 0.005133] CPU features: detected: E0PD571client # [ 0.000769] pid_max: default: 32768 minimum: 301572worker1 # [ 0.005135] CPU features: detected: Enhanced Counter Virtualization573client # [ 0.000848] LSM: initializing lsm=capability,landlock,yama,bpf,ima574client # [ 0.000978] landlock: Up and running.575worker1 # [ 0.005138] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)576client # [ 0.000980] Yama: becoming mindful.577lb # [ 0.167207] iommu: Default domain type: Translated578client # [ 0.001401] LSM support for eBPF active579worker1 # [ 0.005142] CPU features: detected: Enhanced Virtualization Traps580lb # [ 0.167217] iommu: DMA domain TLB invalidation policy: strict mode581worker1 # [ 0.005145] CPU features: detected: Fine Grained Traps582client # [ 0.001575] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)583lb # [ 0.167577] SCSI subsystem initialized584worker1 # [ 0.005148] CPU features: detected: Generic authentication (architected QARMA5 algorithm)585client # [ 0.001610] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)586worker1 # [ 0.005152] CPU features: detected: RCpc load-acquire (LDAPR)587worker2 # [ 0.011548] 0 pages in range for non-PLT usage588lb # [ 0.169591] usbcore: registered new interface driver usbfs589client # [ 0.002691] cacheinfo: Unable to detect cache hierarchy for CPU 0590worker1 # [ 0.005155] CPU features: detected: LSE atomic instructions591worker2 # [ 0.011549] 508288 pages in range for PLT usage592lb # [ 0.169626] usbcore: registered new interface driver hub593client # [ 0.003437] rcu: Hierarchical SRCU implementation.594worker2 # [ 0.011644] pinctrl core: initialized pinctrl subsystem595worker1 # [ 0.005158] CPU features: detected: Privileged Access Never596client # [ 0.003442] rcu: Max phase no-delay instances is 1000.597lb # [ 0.169644] usbcore: registered new device driver usb598worker2 # [ 0.012460] DMI not present or invalid.599worker1 # [ 0.005161] CPU features: detected: PMUv3600client # [ 0.004668] fsl-mc MSI: its@8080000 domain created601lb # [ 0.169931] pps_core: LinuxPPS API ver. 1 registered602worker2 # [ 0.015603] NET: Registered PF_NETLINK/PF_ROUTE protocol family603worker1 # [ 0.005163] CPU features: detected: RAS Extension Support604client # [ 0.004758] EFI services will not be available.605lb # [ 0.169936] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>606client # [ 0.004828] smp: Bringing up secondary CPUs ...607worker2 # [ 0.017908] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations608worker1 # [ 0.005166] CPU features: detected: RASv1p1 Extension Support609lb # [ 0.169947] PTP clock support registered610client # [ 0.004836] smp: Brought up 1 node, 1 CPU611lb # [ 0.169999] EDAC MC: Ver: 3.0.0612worker1 # [ 0.005169] CPU features: detected: Random Number Generator613client # [ 0.004839] SMP: Total of 1 processors activated.614worker2 # [ 0.018100] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations615client # [ 0.004845] CPU: All CPU(s) started at EL1616worker1 # [ 0.005171] CPU features: detected: Speculation barrier (SB)617lb # [ 0.174525] scmi_core: SCMI protocol bus registered618worker2 # [ 0.018301] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations619client # [ 0.004856] CPU features: detected: Branch Target Identification620worker1 # [ 0.005174] CPU features: detected: Stage-2 Force Write-Back621worker2 # [ 0.018325] audit: initializing netlink subsys (disabled)622lb # [ 0.175511] FPGA manager framework623worker1 # [ 0.005177] CPU features: detected: TLB range maintenance instructions624client # [ 0.004861] CPU features: detected: ARMv8.4 Translation Table Level625lb # [ 0.176491] vgaarb: loaded626worker2 # [ 0.018941] thermal_sys: Registered thermal governor 'fair_share'627worker1 # [ 0.005181] CPU features: detected: Speculative Store Bypassing Safe (SSBS)628worker2 # [ 0.018943] thermal_sys: Registered thermal governor 'bang_bang'629client # [ 0.004865] CPU features: detected: Instruction cache invalidation not required for I/D coherence630lb # [ 0.177118] clocksource: Switched to clocksource arch_sys_counter631worker1 # [ 0.005218] alternatives: applying system-wide alternatives632worker2 # [ 0.018946] thermal_sys: Registered thermal governor 'step_wise'633client # [ 0.004868] CPU features: detected: Data cache clean to the PoU not required for I/D coherence634worker1 # [ 0.008156] CPU features: detected: BBM Level 2 without TLB conflict abort635worker2 # [ 0.018951] thermal_sys: Registered thermal governor 'user_space'636client # [ 0.004872] CPU features: detected: Common not Private translations637worker2 # [ 0.018954] thermal_sys: Registered thermal governor 'power_allocator'638client # [ 0.004875] CPU features: detected: CRC32 instructions639worker1 # [ 0.008329] Memory: 1406536K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)640worker2 # [ 0.018979] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1641client # [ 0.004878] CPU features: detected: Data cache clean to Point of Deep Persistence642worker1 # [ 0.008698] devtmpfs: initialized643worker2 # [ 0.018988] cpuidle: using governor ladder644client # [ 0.004882] CPU features: detected: Data cache clean to Point of Persistence645worker2 # [ 0.018993] cpuidle: using governor menu646worker1 # [ 0.010533] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)647lb # [ 0.181700] VFS: Disk quotas dquot_6.6.0648client # [ 0.004885] CPU features: detected: Data independent timing control (DIT)649worker2 # [ 0.019221] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.650client # [ 0.004888] CPU features: detected: E0PD651worker2 # [ 0.019237] ASID allocator initialised with 65536 entries652lb # [ 0.181748] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)653worker2 # [ 0.020504] Serial: AMBA PL011 UART driver654client # [ 0.004891] CPU features: detected: Enhanced Counter Virtualization655lb # [ 0.183407] netfs: FS-Cache loaded656lb # [ 0.183540] pnp: PnP ACPI: disabled657client # [ 0.004894] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)658worker2 # [ 0.025739] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1659client # [ 0.004897] CPU features: detected: Enhanced Virtualization Traps660worker2 # [ 0.025904] printk: console [ttyAMA0] enabled661client # [ 0.004900] CPU features: detected: Fine Grained Traps662worker2 # [ 0.148368] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages663client # [ 0.004903] CPU features: detected: Generic authentication (architected QARMA5 algorithm)664worker2 # [ 0.148392] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page665client # [ 0.004908] CPU features: detected: RCpc load-acquire (LDAPR)666client # [ 0.004911] CPU features: detected: LSE atomic instructions667worker2 # [ 0.148397] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages668client # [ 0.004915] CPU features: detected: Privileged Access Never669worker2 # [ 0.148401] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page670client # [ 0.004917] CPU features: detected: PMUv3671lb # [ 0.187427] NET: Registered PF_INET protocol family672worker2 # [ 0.148405] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages673client # [ 0.004920] CPU features: detected: RAS Extension Support674worker2 # [ 0.148410] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page675lb # [ 0.187692] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)676worker1 # [ 0.010554] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).677client # [ 0.004923] CPU features: detected: RASv1p1 Extension Support678worker2 # [ 0.148414] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages679client # [ 0.004925] CPU features: detected: Random Number Generator680worker1 # [ 0.010724] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL681worker1 # [ 0.010728] 0 pages in range for non-PLT usage682worker2 # [ 0.148418] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page683client # [ 0.004928] CPU features: detected: Speculation barrier (SB)684worker1 # [ 0.010729] 508288 pages in range for PLT usage685client # [ 0.004931] CPU features: detected: Stage-2 Force Write-Back686worker1 # [ 0.010816] pinctrl core: initialized pinctrl subsystem687client # [ 0.004934] CPU features: detected: TLB range maintenance instructions688worker1 # [ 0.011562] DMI not present or invalid.689worker1 # [ 0.014828] NET: Registered PF_NETLINK/PF_ROUTE protocol family690client # [ 0.004939] CPU features: detected: Speculative Store Bypassing Safe (SSBS)691worker2 # [ 0.155955] fbcon: Taking over console692worker2 # [ 0.155970] ACPI: Interpreter disabled.693client # [ 0.004974] alternatives: applying system-wide alternatives694worker1 # [ 0.017147] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations695worker2 # [ 0.157857] iommu: Default domain type: Translated696client # [ 0.007947] CPU features: detected: BBM Level 2 without TLB conflict abort697worker1 # [ 0.017340] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations698worker2 # [ 0.157868] iommu: DMA domain TLB invalidation policy: strict mode699worker1 # [ 0.017537] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations700worker2 # [ 0.159633] SCSI subsystem initialized701client # [ 0.008185] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)702worker1 # [ 0.017562] audit: initializing netlink subsys (disabled)703client # [ 0.008594] devtmpfs: initialized704worker1 # [ 0.018101] thermal_sys: Registered thermal governor 'fair_share'705client # [ 0.010453] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)706worker1 # [ 0.018102] thermal_sys: Registered thermal governor 'bang_bang'707client # [ 0.010481] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).708worker1 # [ 0.018106] thermal_sys: Registered thermal governor 'step_wise'709worker1 # [ 0.018111] thermal_sys: Registered thermal governor 'user_space'710client # [ 0.010678] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL711worker1 # [ 0.018114] thermal_sys: Registered thermal governor 'power_allocator'712worker1 # [ 0.018137] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1713worker1 # [ 0.018146] cpuidle: using governor ladder714worker1 # [ 0.018151] cpuidle: using governor menu715worker1 # [ 0.018336] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.716worker1 # [ 0.018350] ASID allocator initialised with 65536 entries717worker1 # [ 0.019519] Serial: AMBA PL011 UART driver718worker2 # [ 0.167239] usbcore: registered new interface driver usbfs719worker1 # [ 0.024746] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1720worker2 # [ 0.167281] usbcore: registered new interface driver hub721worker1 # [ 0.024917] printk: console [ttyAMA0] enabled722worker2 # [ 0.167300] usbcore: registered new device driver usb723worker2 # [ 0.167590] pps_core: LinuxPPS API ver. 1 registered724worker1 # [ 0.145852] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages725worker2 # [ 0.167596] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>726worker1 # [ 0.145872] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page727worker2 # [ 0.167605] PTP clock support registered728client # [ 0.010682] 0 pages in range for non-PLT usage729worker2 # [ 0.167660] EDAC MC: Ver: 3.0.0730client # [ 0.010683] 508288 pages in range for PLT usage731worker1 # [ 0.145878] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages732client # [ 0.010795] pinctrl core: initialized pinctrl subsystem733worker2 # [ 0.172395] scmi_core: SCMI protocol bus registered734worker1 # [ 0.145882] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page735client # [ 0.011588] DMI not present or invalid.736worker1 # [ 0.145887] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages737client # [ 0.014697] NET: Registered PF_NETLINK/PF_ROUTE protocol family738worker2 # [ 0.173364] FPGA manager framework739worker2 # [ 0.174429] vgaarb: loaded740worker1 # [ 0.145891] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page741client # [ 0.017185] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations742worker1 # [ 0.145895] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages743client # [ 0.017394] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations744worker2 # [ 0.175076] clocksource: Switched to clocksource arch_sys_counter745worker1 # [ 0.145899] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page746client # [ 0.017592] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations747worker2 # [ 0.176536] VFS: Disk quotas dquot_6.6.0748client # [ 0.017615] audit: initializing netlink subsys (disabled)749worker2 # [ 0.176568] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)750client # [ 0.018169] thermal_sys: Registered thermal governor 'fair_share'751worker1 # [ 0.153463] fbcon: Taking over console752worker2 # [ 0.178172] netfs: FS-Cache loaded753worker1 # [ 0.153478] ACPI: Interpreter disabled.754worker2 # [ 0.178298] pnp: PnP ACPI: disabled755client # [ 0.018171] thermal_sys: Registered thermal governor 'bang_bang'756client # [ 0.018175] thermal_sys: Registered thermal governor 'step_wise'757worker1 # [ 0.155324] iommu: Default domain type: Translated758client # [ 0.018180] thermal_sys: Registered thermal governor 'user_space'759worker1 # [ 0.155333] iommu: DMA domain TLB invalidation policy: strict mode760client # [ 0.018183] thermal_sys: Registered thermal governor 'power_allocator'761worker1 # [ 0.157024] SCSI subsystem initialized762client # [ 0.018207] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1763client # [ 0.018215] cpuidle: using governor ladder764client # [ 0.018220] cpuidle: using governor menu765client # [ 0.018431] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.766client # [ 0.018447] ASID allocator initialised with 65536 entries767client # [ 0.019631] Serial: AMBA PL011 UART driver768client # [ 0.024851] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1769client # [ 0.024977] printk: console [ttyAMA0] enabled770worker1 # [ 0.162303] usbcore: registered new interface driver usbfs771worker2 # [ 0.184186] NET: Registered PF_INET protocol family772worker1 # [ 0.162335] usbcore: registered new interface driver hub773client # [ 0.146613] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages774worker2 # [ 0.184563] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)775worker1 # [ 0.162353] usbcore: registered new device driver usb776lb # [ 0.217796] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)777client # [ 0.146636] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page778worker1 # [ 0.162622] pps_core: LinuxPPS API ver. 1 registered779client # [ 0.146641] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages780lb # [ 0.217851] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)781worker1 # [ 0.162629] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>782client # [ 0.146646] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page783lb # [ 0.217884] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)784worker1 # [ 0.162638] PTP clock support registered785worker1 # [ 0.162684] EDAC MC: Ver: 3.0.0786client # [ 0.146650] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages787lb # [ 0.217967] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)788worker1 # [ 0.167178] scmi_core: SCMI protocol bus registered789client # [ 0.146654] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page790lb # [ 0.218111] TCP: Hash tables configured (established 16384 bind 16384)791client # [ 0.146659] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages792worker1 # [ 0.168152] FPGA manager framework793lb # [ 0.218200] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)794worker1 # [ 0.169104] vgaarb: loaded795client # [ 0.146663] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page796lb # [ 0.218245] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)797worker1 # [ 0.169738] clocksource: Switched to clocksource arch_sys_counter798lb # [ 0.218281] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)799lb # [ 0.218371] NET: Registered PF_UNIX/PF_LOCAL protocol family800client # [ 0.154255] fbcon: Taking over console801lb # [ 0.218411] NET: Registered PF_XDP protocol family802client # [ 0.154271] ACPI: Interpreter disabled.803lb # [ 0.218430] PCI: CLS 0 bytes, default 64804client # [ 0.156164] iommu: Default domain type: Translated805lb # [ 0.218692] Trying to unpack rootfs image as initramfs...806client # [ 0.156175] iommu: DMA domain TLB invalidation policy: strict mode807worker1 # [ 0.173706] VFS: Disk quotas dquot_6.6.0808client # [ 0.157919] SCSI subsystem initialized809worker1 # [ 0.173738] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)810worker1 # [ 0.177462] netfs: FS-Cache loaded811worker1 # [ 0.177581] pnp: PnP ACPI: disabled812lb # [ 0.234915] kvm [1]: HYP mode not available813worker1 # [ 0.181503] NET: Registered PF_INET protocol family814client # [ 0.165668] usbcore: registered new interface driver usbfs815client # [ 0.165693] usbcore: registered new interface driver hub816client # [ 0.165725] usbcore: registered new device driver usb817client # [ 0.166005] pps_core: LinuxPPS API ver. 1 registered818client # [ 0.166011] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>819worker1 # [ 0.182423] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)820client # [ 0.166022] PTP clock support registered821client # [ 0.166062] EDAC MC: Ver: 3.0.0822client # [ 0.170854] scmi_core: SCMI protocol bus registered823client # [ 0.171859] FPGA manager framework824client # [ 0.172850] vgaarb: loaded825client # [ 0.173498] clocksource: Switched to clocksource arch_sys_counter826client # [ 0.174894] VFS: Disk quotas dquot_6.6.0827client # [ 0.174926] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)828client # [ 0.176532] netfs: FS-Cache loaded829client # [ 0.176659] pnp: PnP ACPI: disabled830worker2 # [ 0.215327] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)831worker2 # [ 0.215383] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)832worker2 # [ 0.215418] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)833client # [ 0.182679] NET: Registered PF_INET protocol family834worker2 # [ 0.215504] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)835client # [ 0.182978] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)836worker2 # [ 0.215647] TCP: Hash tables configured (established 16384 bind 16384)837worker2 # [ 0.215740] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838worker2 # [ 0.215778] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839worker2 # [ 0.215817] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840worker2 # [ 0.215905] NET: Registered PF_UNIX/PF_LOCAL protocol family841worker2 # [ 0.215992] NET: Registered PF_XDP protocol family842worker2 # [ 0.216012] PCI: CLS 0 bytes, default 64843worker2 # [ 0.216271] Trying to unpack rootfs image as initramfs...844worker2 # [ 0.232914] kvm [1]: HYP mode not available845worker1 # [ 0.211247] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846worker1 # [ 0.211306] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847worker1 # [ 0.211339] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)848worker1 # [ 0.211426] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849worker1 # [ 0.211569] TCP: Hash tables configured (established 16384 bind 16384)850worker1 # [ 0.211658] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)851worker1 # [ 0.211695] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)852worker1 # [ 0.211730] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)853worker1 # [ 0.211822] NET: Registered PF_UNIX/PF_LOCAL protocol family854worker1 # [ 0.211845] NET: Registered PF_XDP protocol family855worker1 # [ 0.211864] PCI: CLS 0 bytes, default 64856worker1 # [ 0.212151] Trying to unpack rootfs image as initramfs...857client # [ 0.212920] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)858client # [ 0.212975] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)859client # [ 0.213009] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)860client # [ 0.213092] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)861worker1 # [ 0.227324] kvm [1]: HYP mode not available862client # [ 0.213240] TCP: Hash tables configured (established 16384 bind 16384)863client # [ 0.213329] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)864client # [ 0.213368] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)865client # [ 0.213406] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)866client # [ 0.213497] NET: Registered PF_UNIX/PF_LOCAL protocol family867client # [ 0.221583] NET: Registered PF_XDP protocol family868client # [ 0.221607] PCI: CLS 0 bytes, default 64869client # [ 0.221881] Trying to unpack rootfs image as initramfs...870client # [ 0.231314] kvm [1]: HYP mode not available871lb # [ 0.341750] Initialise system trusted keyrings872lb # [ 0.342503] workingset: timestamp_bits=42 max_order=19 bucket_order=0873lb # [ 0.343836] squashfs: version 4.0 (2009/01/31) Phillip Lougher874lb # [ 0.344631] 9p: Installing v9fs 9p2000 file system support875lb # [ 0.373452] Key type asymmetric registered876lb # [ 0.373481] Asymmetric key parser 'x509' registered877lb # [ 0.373564] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878lb # [ 0.375739] io scheduler mq-deadline registered879lb # [ 0.375750] io scheduler kyber registered880worker2 # [ 0.342043] Initialise system trusted keyrings881worker2 # [ 0.342815] workingset: timestamp_bits=42 max_order=19 bucket_order=0882worker2 # [ 0.344236] squashfs: version 4.0 (2009/01/31) Phillip Lougher883lb # [ 0.385274] pl061_gpio 9030000.pl061: PL061 GPIO chip registered884worker2 # [ 0.345038] 9p: Installing v9fs 9p2000 file system support885lb # [ 0.386722] ledtrig-cpu: registered to indicate activity on CPUs886lb # [ 0.387154] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:887lb # [ 0.387171] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000888worker1 # [ 0.330275] Initialise system trusted keyrings889lb # [ 0.387183] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000890worker1 # [ 0.331048] workingset: timestamp_bits=42 max_order=19 bucket_order=0891lb # [ 0.387190] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000892worker1 # [ 0.332407] squashfs: version 4.0 (2009/01/31) Phillip Lougher893lb # [ 0.387210] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits894worker1 # [ 0.333181] 9p: Installing v9fs 9p2000 file system support895lb # [ 0.387234] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]896lb # [ 0.387311] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00897lb # [ 0.387320] pci_bus 0000:00: root bus resource [bus 00-ff]898lb # [ 0.387326] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]899lb # [ 0.387331] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]900lb # [ 0.387336] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]901lb # [ 0.387399] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint902lb # [ 0.387844] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint903lb # [ 0.388037] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]904worker2 # [ 0.364993] Key type asymmetric registered905worker2 # [ 0.365019] Asymmetric key parser 'x509' registered906lb # [ 0.388053] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]907worker2 # [ 0.365094] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)908lb # [ 0.388082] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]909lb # [ 0.388098] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]910lb # [ 0.388569] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint911lb # [ 0.388770] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]912lb # [ 0.388786] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]913client # [ 0.329503] Initialise system trusted keyrings914lb # [ 0.388815] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915worker2 # [ 0.371129] io scheduler mq-deadline registered916client # [ 0.330299] workingset: timestamp_bits=42 max_order=19 bucket_order=0917worker2 # [ 0.371147] io scheduler kyber registered918lb # [ 0.408709] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint919client # [ 0.331697] squashfs: version 4.0 (2009/01/31) Phillip Lougher920lb # [ 0.408900] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]921lb # [ 0.408916] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]922client # [ 0.332468] 9p: Installing v9fs 9p2000 file system support923lb # [ 0.408946] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]924lb # [ 0.412585] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint925lb # [ 0.412770] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]926lb # [ 0.412786] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]927lb # [ 0.412818] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]928worker2 # [ 0.383254] pl061_gpio 9030000.pl061: PL061 GPIO chip registered929worker1 # [ 0.361937] Key type asymmetric registered930worker1 # [ 0.361967] Asymmetric key parser 'x509' registered931worker2 # [ 0.384766] ledtrig-cpu: registered to indicate activity on CPUs932worker1 # [ 0.362049] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)933worker2 # [ 0.385172] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:934lb # [ 0.421340] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint935worker1 # [ 0.364220] io scheduler mq-deadline registered936worker1 # [ 0.364230] io scheduler kyber registered937lb # [ 0.421562] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]938worker2 # [ 0.385191] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000939lb # [ 0.421578] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]940worker2 # [ 0.385204] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000941lb # [ 0.421608] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]942lb # [ 0.422082] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint943worker2 # [ 0.385228] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000944lb # [ 0.422263] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]945worker2 # [ 0.385256] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits946lb # [ 0.422279] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]947worker2 # [ 0.385280] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]948lb # [ 0.422308] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]949client # [ 0.353131] Key type asymmetric registered950worker2 # [ 0.385358] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00951client # [ 0.353159] Asymmetric key parser 'x509' registered952lb # [ 0.422794] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint953worker2 # [ 0.385366] pci_bus 0000:00: root bus resource [bus 00-ff]954lb # [ 0.422981] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]955client # [ 0.353249] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)956worker2 # [ 0.385373] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]957lb # [ 0.422996] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]958worker2 # [ 0.385378] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]959lb # [ 0.423025] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]960worker2 # [ 0.385383] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]961lb # [ 0.423040] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]962worker2 # [ 0.385447] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint963lb # [ 0.423503] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint964worker1 # [ 0.374055] pl061_gpio 9030000.pl061: PL061 GPIO chip registered965lb # [ 0.423691] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]966worker2 # [ 0.385888] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint967lb # [ 0.423721] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]968worker2 # [ 0.386079] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]969worker2 # [ 0.386095] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]970lb # [ 0.424180] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint971worker2 # [ 0.386124] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]972lb # [ 0.424371] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]973worker1 # [ 0.375431] ledtrig-cpu: registered to indicate activity on CPUs974client # [ 0.361599] io scheduler mq-deadline registered975worker2 # [ 0.386140] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]976lb # [ 0.424401] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]977client # [ 0.361623] io scheduler kyber registered978worker1 # [ 0.375821] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:979worker2 # [ 0.386606] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint980lb # [ 0.424794] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint981worker1 # [ 0.375839] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000982worker2 # [ 0.386794] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]983lb # [ 0.424977] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]984worker2 # [ 0.386809] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]985worker1 # [ 0.375851] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000986worker2 # [ 0.386839] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]987worker1 # [ 0.375860] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000988worker1 # [ 0.375895] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits989worker1 # [ 0.375921] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]990lb # [ 0.442281] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint991worker1 # [ 0.376032] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00992lb # [ 0.442570] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]993worker1 # [ 0.376041] pci_bus 0000:00: root bus resource [bus 00-ff]994lb # [ 0.442588] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]995worker1 # [ 0.376047] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]996lb # [ 0.442617] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]997worker1 # [ 0.376053] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]998lb # [ 0.443126] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint999worker1 # [ 0.376058] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1000lb # [ 0.443317] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1001lb # [ 0.443333] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1002worker1 # [ 0.376148] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1003lb # [ 0.443362] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1004worker1 # [ 0.376587] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1005lb # [ 0.443951] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1006worker1 # [ 0.376774] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1007worker1 # [ 0.376791] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1008lb # [ 0.443963] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1009worker2 # [ 0.411377] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1010worker2 # [ 0.411578] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1011worker1 # [ 0.376821] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1012lb # [ 0.443968] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1013worker2 # [ 0.411594] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1014worker1 # [ 0.376837] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1015lb # [ 0.444013] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1016worker2 # [ 0.411624] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1017worker1 # [ 0.377290] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1018lb # [ 0.444060] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1019worker2 # [ 0.412089] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1020worker1 # [ 0.377473] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1021worker2 # [ 0.412285] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1022worker1 # [ 0.377489] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1023lb # [ 0.444107] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1024worker2 # [ 0.412301] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1025worker1 # [ 0.377519] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1026lb # [ 0.444155] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1027worker2 # [ 0.412333] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1028lb # [ 0.444201] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1029worker2 # [ 0.412793] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1030lb # [ 0.444248] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1031client # [ 0.373673] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1032worker2 # [ 0.412975] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1033worker1 # [ 0.396713] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1034worker1 # [ 0.396899] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1035client # [ 0.374314] ledtrig-cpu: registered to indicate activity on CPUs1036worker2 # [ 0.412991] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1037lb # [ 0.444294] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1038worker1 # [ 0.396915] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1039worker2 # [ 0.413021] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1040client # [ 0.374703] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1041lb # [ 0.444341] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1042worker1 # [ 0.396945] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1043worker2 # [ 0.413530] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1044client # [ 0.374720] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001045lb # [ 0.444388] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1046worker1 # [ 0.397394] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1047worker2 # [ 0.413723] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1048worker1 # [ 0.397576] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1049client # [ 0.374733] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001050lb # [ 0.444456] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1051worker2 # [ 0.413738] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1052worker1 # [ 0.397591] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1053lb # [ 0.444505] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1054worker2 # [ 0.413769] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1055client # [ 0.374741] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001056worker1 # [ 0.397624] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1057lb # [ 0.444526] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1058worker2 # [ 0.414235] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1059client # [ 0.374762] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1060worker2 # [ 0.414423] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1061lb # [ 0.444548] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1062client # [ 0.374786] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1063worker2 # [ 0.414438] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1064lb # [ 0.444569] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1065client # [ 0.374864] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001066worker2 # [ 0.414467] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1067lb # [ 0.444594] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1068client # [ 0.374874] pci_bus 0000:00: root bus resource [bus 00-ff]1069worker2 # [ 0.414483] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1070lb # [ 0.444616] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1071client # [ 0.374880] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1072worker2 # [ 0.414955] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1073lb # [ 0.444637] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1074client # [ 0.374886] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1075lb # [ 0.444659] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1076client # [ 0.374891] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1077lb # [ 0.444681] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1078client # [ 0.375012] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1079lb # [ 0.444703] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1080client # [ 0.375456] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1081lb # [ 0.444726] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1082worker2 # [ 0.432202] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1083client # [ 0.375667] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1084lb # [ 0.444748] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1085worker2 # [ 0.432237] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1086client # [ 0.375684] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1087lb # [ 0.444769] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1088client # [ 0.375713] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1089worker2 # [ 0.432712] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1090lb # [ 0.444790] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1091worker2 # [ 0.432901] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1092client # [ 0.375729] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1093lb # [ 0.444812] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1094worker2 # [ 0.432931] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1095lb # [ 0.444833] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1096client # [ 0.376187] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1097lb # [ 0.444854] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1098client # [ 0.376376] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1099worker2 # [ 0.433323] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1100client # [ 0.376392] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1101lb # [ 0.444875] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1102worker2 # [ 0.433509] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1103lb # [ 0.444897] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1104client # [ 0.376421] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1105worker2 # [ 0.433755] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1106lb # [ 0.444918] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1107worker2 # [ 0.434044] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1108client # [ 0.376881] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1109lb # [ 0.444940] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1110worker1 # [ 0.410209] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1111client # [ 0.377069] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1112worker2 # [ 0.434061] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1113worker1 # [ 0.410415] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1114lb # [ 0.444966] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1115client # [ 0.377086] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1116worker2 # [ 0.434093] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1117worker1 # [ 0.410432] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1118lb # [ 0.444976] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1119client # [ 0.377116] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1120worker2 # [ 0.434575] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1121worker1 # [ 0.410462] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1122lb # [ 0.444981] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1123worker2 # [ 0.434762] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1124client # [ 0.377598] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1125worker1 # [ 0.410922] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1126client # [ 0.377784] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1127worker2 # [ 0.434778] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1128worker1 # [ 0.411105] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1129client # [ 0.377800] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1130worker2 # [ 0.434808] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131worker1 # [ 0.411121] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1132client # [ 0.377832] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1133worker1 # [ 0.411151] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1134client # [ 0.378297] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1135worker1 # [ 0.411605] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1136client # [ 0.378482] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1137worker1 # [ 0.411790] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1138client # [ 0.378498] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1139worker1 # [ 0.411806] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1140client # [ 0.378527] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1141worker1 # [ 0.411836] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1142client # [ 0.378986] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1143worker1 # [ 0.411852] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1144client # [ 0.379171] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1145worker1 # [ 0.412362] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1146client # [ 0.379187] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1147worker1 # [ 0.412554] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1148client # [ 0.379216] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1149worker1 # [ 0.412584] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1150client # [ 0.379676] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1151lb # [ 0.490329] pci 0000:00:0a.0: enabling device (0000 -> 0002)1152worker1 # [ 0.413038] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1153client # [ 0.379864] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1154worker2 # [ 0.451459] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1155worker1 # [ 0.413227] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1156client # [ 0.379879] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1157worker2 # [ 0.451479] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1158worker1 # [ 0.413256] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1159client # [ 0.379908] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1160worker2 # [ 0.451485] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1161client # [ 0.379924] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1162worker1 # [ 0.413647] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1163worker2 # [ 0.451533] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1164worker1 # [ 0.413844] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1165client # [ 0.380409] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1166worker2 # [ 0.451581] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1167client # [ 0.380599] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1168worker1 # [ 0.414096] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1169worker1 # [ 0.414375] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1170client # [ 0.380629] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1171worker2 # [ 0.451628] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1172worker1 # [ 0.414395] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1173client # [ 0.381084] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1174worker2 # [ 0.451674] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1175worker1 # [ 0.414425] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1176client # [ 0.381280] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1177worker2 # [ 0.451720] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1178worker1 # [ 0.414914] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1179client # [ 0.381310] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1180worker2 # [ 0.451767] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1181worker1 # [ 0.415099] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1182worker1 # [ 0.415116] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1183worker2 # [ 0.451814] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1184worker1 # [ 0.415146] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1185worker2 # [ 0.451860] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1186worker1 # [ 0.415722] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1187worker2 # [ 0.451907] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1188worker1 # [ 0.415734] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1189worker2 # [ 0.452010] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1190worker1 # [ 0.415739] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1191worker2 # [ 0.452064] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1192worker1 # [ 0.415784] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1193worker2 # [ 0.452086] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1194worker1 # [ 0.415834] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1195worker2 # [ 0.452107] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1196worker1 # [ 0.415883] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1197worker2 # [ 0.452138] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1198worker2 # [ 0.452163] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1199worker1 # [ 0.415932] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1200worker2 # [ 0.452184] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1201worker1 # [ 0.415979] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1202worker2 # [ 0.452206] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1203worker1 # [ 0.416036] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1204worker2 # [ 0.452228] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1205worker1 # [ 0.416085] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1206worker2 # [ 0.452249] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1207worker1 # [ 0.416134] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1208worker2 # [ 0.452271] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1209worker2 # [ 0.452296] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1210worker1 # [ 0.416181] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1211lb # [ 0.511443] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1212client # [ 0.429832] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1213worker2 # [ 0.452318] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1214worker1 # [ 0.416261] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1215client # [ 0.430044] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1216worker2 # [ 0.452339] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1217worker1 # [ 0.416307] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1218worker2 # [ 0.452361] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1219client # [ 0.430306] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1220worker1 # [ 0.416330] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1221client # [ 0.430653] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1222worker2 # [ 0.452387] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1223worker1 # [ 0.416352] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1224client # [ 0.430670] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1225worker2 # [ 0.452411] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1226worker1 # [ 0.416374] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1227worker2 # [ 0.452433] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1228client # [ 0.430700] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1229worker1 # [ 0.416400] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1230worker2 # [ 0.452455] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1231client # [ 0.431176] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1232worker1 # [ 0.416422] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1233worker2 # [ 0.452477] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1234client # [ 0.431369] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1235worker1 # [ 0.416444] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1236worker2 # [ 0.452499] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1237client # [ 0.431386] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1238worker2 # [ 0.452521] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1239worker1 # [ 0.416466] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1240client # [ 0.431415] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1241worker2 # [ 0.452548] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1242worker1 # [ 0.416489] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1243client # [ 0.432021] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1244worker2 # [ 0.452558] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1245worker1 # [ 0.416511] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1246client # [ 0.432032] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1247worker2 # [ 0.452562] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1248worker1 # [ 0.416536] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1249worker2 # [ 0.453754] pci 0000:00:0a.0: enabling device (0000 -> 0002)1250client # [ 0.432038] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1251worker1 # [ 0.416558] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1252client # [ 0.432089] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1253worker1 # [ 0.416580] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1254worker1 # [ 0.416602] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1255client # [ 0.432139] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1256lb # [ 0.521398] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1257worker1 # [ 0.416624] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1258client # [ 0.432187] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1259lb # [ 0.525059] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1260worker1 # [ 0.416646] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1261client # [ 0.432234] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1262worker1 # [ 0.416668] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1263worker1 # [ 0.416690] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1264client # [ 0.432282] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1265worker1 # [ 0.416712] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1266client # [ 0.432330] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1267worker1 # [ 0.416734] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1268client # [ 0.432379] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1269worker1 # [ 0.416756] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1270worker1 # [ 0.416785] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1271client # [ 0.432431] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1272worker1 # [ 0.416795] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1273client # [ 0.432479] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1274worker1 # [ 0.416800] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1275client # [ 0.432572] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1276client # [ 0.432619] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1277client # [ 0.432640] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1278client # [ 0.432662] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1279client # [ 0.432683] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1280client # [ 0.432709] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1281lb # [ 0.534532] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1282client # [ 0.432730] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1283client # [ 0.432752] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1284client # [ 0.432774] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1285worker1 # [ 0.478011] pci 0000:00:0a.0: enabling device (0000 -> 0002)1286client # [ 0.432796] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1287client # [ 0.432820] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1288client # [ 0.432842] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1289client # [ 0.432866] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1290client # [ 0.432889] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1291client # [ 0.432910] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1292client # [ 0.432934] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1293client # [ 0.432956] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1294client # [ 0.432977] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1295client # [ 0.432999] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1296worker2 # [ 0.510203] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1297client # [ 0.433021] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1298client # [ 0.433043] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1299client # [ 0.433065] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1300client # [ 0.433093] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1301client # [ 0.433102] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1302client # [ 0.433107] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1303client # [ 0.434288] pci 0000:00:0a.0: enabling device (0000 -> 0002)1304lb # [ 0.545744] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1305lb # [ 0.548195] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1306lb # [ 0.550414] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1307lb # [ 0.552673] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1308worker2 # [ 0.520580] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1309worker1 # [ 0.498815] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1310worker1 # [ 0.501021] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1311lb # [ 0.562985] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1312lb # [ 0.564877] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1313worker1 # [ 0.512325] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1314worker2 # [ 0.531331] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1315worker2 # [ 0.533860] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1316lb # [ 0.576400] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1317worker2 # [ 0.536086] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1318client # [ 0.499881] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1319worker2 # [ 0.538380] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1320worker1 # [ 0.518694] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1321client # [ 0.503036] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1322worker1 # [ 0.520840] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1323client # [ 0.505172] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1324worker2 # [ 0.548595] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1325worker2 # [ 0.550789] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1326lb # [ 0.594238] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1327client # [ 0.514998] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1328worker1 # [ 0.531268] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1329client # [ 0.517386] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1330lb # [ 0.596963] msm_serial: driver initialized1331worker1 # [ 0.533461] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1332worker2 # [ 0.561967] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1333lb # [ 0.597682] SuperH (H)SCI(F) driver initialized1334lb # [ 0.597750] STM32 USART driver initialized1335worker1 # [ 0.544626] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1336client # [ 0.528473] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1337worker2 # [ 0.568094] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1338worker2 # [ 0.570432] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1339client # [ 0.534892] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1340client # [ 0.537071] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1341worker1 # [ 0.554681] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1342worker1 # [ 0.559106] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1343worker1 # [ 0.561453] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1344worker2 # [ 0.588375] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1345worker2 # [ 0.591062] msm_serial: driver initialized1346client # [ 0.547420] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1347client # [ 0.549295] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1348worker2 # [ 0.591760] SuperH (H)SCI(F) driver initialized1349lb # [ 0.631259] loop: module loaded1350worker2 # [ 0.591818] STM32 USART driver initialized1351lb # [ 0.631461] virtio_blk virtio5: 1/0/0 default/read/poll queues1352lb # [ 0.632194] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1353client # [ 0.559611] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1354worker1 # [ 0.578953] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1355lb # [ 0.637840] megasas: 07.734.00.00-rc11356lb # [ 0.638552] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1357lb # [ 0.640841] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001358lb # [ 0.640866] Intel/Sharp Extended Query Table at 0x00311359client # [ 0.570978] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1360worker1 # [ 0.587089] msm_serial: driver initialized1361worker1 # [ 0.587237] SuperH (H)SCI(F) driver initialized1362worker1 # [ 0.587290] STM32 USART driver initialized1363lb # [ 0.650292] Using buffer write method1364lb # [ 0.650371] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1365client # [ 0.573750] msm_serial: driver initialized1366client # [ 0.573883] SuperH (H)SCI(F) driver initialized1367client # [ 0.573937] STM32 USART driver initialized1368worker2 # [ 0.625263] loop: module loaded1369lb # [ 0.661684] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001370worker2 # [ 0.625463] virtio_blk virtio5: 1/0/0 default/read/poll queues1371worker2 # [ 0.626237] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1372lb # [ 0.661738] Intel/Sharp Extended Query Table at 0x00311373lb # [ 0.663297] Using buffer write method1374lb # [ 0.663327] Concatenating MTD devices:1375lb # [ 0.663330] (0): "0.flash"1376lb # [ 0.663335] (1): "0.flash"1377lb # [ 0.663338] into device "0.flash"1378worker2 # [ 0.631766] megasas: 07.734.00.00-rc11379worker2 # [ 0.632580] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1380worker2 # [ 0.634523] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001381worker2 # [ 0.634544] Intel/Sharp Extended Query Table at 0x00311382worker1 # [ 0.616955] loop: module loaded1383worker1 # [ 0.617148] virtio_blk virtio5: 1/0/0 default/read/poll queues1384worker1 # [ 0.619068] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1385worker2 # [ 0.644755] Using buffer write method1386worker2 # [ 0.644843] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1387worker2 # [ 0.646452] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001388client # [ 0.608722] loop: module loaded1389worker2 # [ 0.646483] Intel/Sharp Extended Query Table at 0x00311390client # [ 0.608920] virtio_blk virtio5: 1/0/0 default/read/poll queues1391client # [ 0.610943] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1392worker2 # [ 0.657395] Using buffer write method1393worker2 # [ 0.657450] Concatenating MTD devices:1394worker2 # [ 0.657455] (0): "0.flash"1395worker2 # [ 0.657458] (1): "0.flash"1396worker2 # [ 0.657462] into device "0.flash"1397worker1 # [ 0.630494] megasas: 07.734.00.00-rc11398worker1 # [ 0.631213] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1399worker1 # [ 0.633926] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001400worker1 # [ 0.633953] Intel/Sharp Extended Query Table at 0x00311401worker1 # [ 0.635761] Using buffer write method1402worker1 # [ 0.635838] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1403worker1 # [ 0.637693] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001404worker1 # [ 0.637724] Intel/Sharp Extended Query Table at 0x00311405client # [ 0.622256] megasas: 07.734.00.00-rc11406client # [ 0.623000] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1407client # [ 0.625373] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001408client # [ 0.625436] Intel/Sharp Extended Query Table at 0x00311409client # [ 0.627125] Using buffer write method1410client # [ 0.627203] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1411client # [ 0.629005] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001412client # [ 0.629035] Intel/Sharp Extended Query Table at 0x00311413worker1 # [ 0.655816] Using buffer write method1414worker1 # [ 0.655895] Concatenating MTD devices:1415worker1 # [ 0.655899] (0): "0.flash"1416worker1 # [ 0.655904] (1): "0.flash"1417worker1 # [ 0.655907] into device "0.flash"1418client # [ 0.647647] Using buffer write method1419client # [ 0.647691] Concatenating MTD devices:1420client # [ 0.647695] (0): "0.flash"1421client # [ 0.647699] (1): "0.flash"1422client # [ 0.647702] into device "0.flash"1423lb # [ 0.924074] Freeing initrd memory: 26140K1424lb # [ 0.930164] tun: Universal TUN/TAP device driver, 1.61425lb # [ 0.934169] thunder_xcv, ver 1.01426lb # [ 0.934219] thunder_bgx, ver 1.01427lb # [ 0.934240] nicpf, ver 1.01428lb # [ 0.934796] e1000: Intel(R) PRO/1000 Network Driver1429lb # [ 0.934804] e1000: Copyright (c) 1999-2006 Intel Corporation.1430lb # [ 0.934828] e1000e: Intel(R) PRO/1000 Network Driver1431lb # [ 0.934837] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432lb # [ 0.934866] igb: Intel(R) Gigabit Ethernet Network Driver1433lb # [ 0.934871] igb: Copyright (c) 2007-2014 Intel Corporation.1434lb # [ 0.934900] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435lb # [ 0.934906] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436lb # [ 0.935041] sky2: driver version 1.301437lb # [ 0.936670] usbcore: registered new interface driver usb-storage1438lb # [ 0.936720] usbcore: registered new interface driver usbserial_generic1439lb # [ 0.936735] usbserial: USB Serial support registered for generic1440lb # [ 0.938034] ehci-pci 0000:00:0a.0: EHCI Host Controller1441lb # [ 0.938065] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11442lb # [ 0.938276] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001443lb # [ 0.950116] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001444lb # [ 0.950519] hub 1-0:1.0: USB hub found1445lb # [ 0.950540] hub 1-0:1.0: 6 ports detected1446lb # [ 0.952828] hv_vmbus: registering driver hyperv_keyboard1447lb # [ 0.954449] rtc-pl031 9010000.pl031: registered as rtc01448worker2 # [ 0.918838] Freeing initrd memory: 26148K1449lb # [ 0.954481] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:00:12 UTC (1789894812)1450lb # [ 0.954793] i2c_dev: i2c /dev entries driver1451lb # [ 0.959815] sdhci: Secure Digital Host Controller Interface driver1452lb # [ 0.959828] sdhci: Copyright(c) Pierre Ossman1453worker2 # [ 0.924886] tun: Universal TUN/TAP device driver, 1.61454lb # [ 0.960099] Synopsys Designware Multimedia Card Interface Driver1455lb # [ 0.960474] sdhci-pltfm: SDHCI platform and OF driver helper1456lb # [ 0.964971] hid: raw HID events driver (C) Jiri Kosina1457lb # [ 0.965944] usbcore: registered new interface driver usbhid1458lb # [ 0.965953] usbhid: USB HID core driver1459worker2 # [ 0.928653] thunder_xcv, ver 1.01460lb # [ 0.968217] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1461worker2 # [ 0.928699] thunder_bgx, ver 1.01462worker2 # [ 0.928723] nicpf, ver 1.01463worker2 # [ 0.929264] e1000: Intel(R) PRO/1000 Network Driver1464worker2 # [ 0.929272] e1000: Copyright (c) 1999-2006 Intel Corporation.1465lb # [ 0.970976] drop_monitor: Initializing network drop monitor service1466worker2 # [ 0.929297] e1000e: Intel(R) PRO/1000 Network Driver1467lb # [ 0.971176] NET: Registered PF_INET6 protocol family1468worker2 # [ 0.929306] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1469lb # [ 0.973385] Segment Routing with IPv61470worker2 # [ 0.929334] igb: Intel(R) Gigabit Ethernet Network Driver1471lb # [ 0.973407] In-situ OAM (IOAM) with IPv61472worker2 # [ 0.929340] igb: Copyright (c) 2007-2014 Intel Corporation.1473lb # [ 0.973438] NET: Registered PF_PACKET protocol family1474worker2 # [ 0.929363] igbvf: Intel(R) Gigabit Virtual Function Network Driver1475worker2 # [ 0.929368] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1476worker1 # [ 0.912951] Freeing initrd memory: 26148K1477worker2 # [ 0.929499] sky2: driver version 1.301478worker2 # [ 0.931079] usbcore: registered new interface driver usb-storage1479lb # [ 0.975072] 9pnet: Installing 9P2000 support1480worker2 # [ 0.931845] ehci-pci 0000:00:0a.0: EHCI Host Controller1481worker2 # [ 0.931872] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11482worker2 # [ 0.932164] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001483worker1 # [ 0.919024] tun: Universal TUN/TAP device driver, 1.61484lb # [ 0.977898] Key type dns_resolver registered1485worker2 # [ 0.942426] usbcore: registered new interface driver usbserial_generic1486worker2 # [ 0.942449] usbserial: USB Serial support registered for generic1487worker2 # [ 0.943127] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001488worker2 # [ 0.943510] hub 1-0:1.0: USB hub found1489worker2 # [ 0.943531] hub 1-0:1.0: 6 ports detected1490client # [ 0.907150] Freeing initrd memory: 26160K1491lb # [ 0.984135] registered taskstats version 11492worker2 # [ 0.947119] hv_vmbus: registering driver hyperv_keyboard1493lb # [ 0.984298] Loading compiled-in X.509 certificates1494worker2 # [ 0.948797] rtc-pl031 9010000.pl031: registered as rtc01495worker1 # [ 0.923027] thunder_xcv, ver 1.01496worker2 # [ 0.948827] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:00:12 UTC (1789894812)1497worker1 # [ 0.923122] thunder_bgx, ver 1.01498worker1 # [ 0.923146] nicpf, ver 1.01499worker2 # [ 0.949132] i2c_dev: i2c /dev entries driver1500worker1 # [ 0.923715] e1000: Intel(R) PRO/1000 Network Driver1501worker1 # [ 0.923723] e1000: Copyright (c) 1999-2006 Intel Corporation.1502worker1 # [ 0.923748] e1000e: Intel(R) PRO/1000 Network Driver1503client # [ 0.913161] tun: Universal TUN/TAP device driver, 1.61504worker1 # [ 0.923757] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1505worker1 # [ 0.923786] igb: Intel(R) Gigabit Ethernet Network Driver1506worker2 # [ 0.954083] sdhci: Secure Digital Host Controller Interface driver1507worker1 # [ 0.923791] igb: Copyright (c) 2007-2014 Intel Corporation.1508worker2 # [ 0.954095] sdhci: Copyright(c) Pierre Ossman1509lb # [ 0.992851] Demotion targets for Node 0: null1510worker1 # [ 0.923815] igbvf: Intel(R) Gigabit Virtual Function Network Driver1511lb # [ 0.992976] Key type .fscrypt registered1512worker2 # [ 0.954360] Synopsys Designware Multimedia Card Interface Driver1513worker1 # [ 0.923821] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1514lb # [ 0.992982] Key type fscrypt-provisioning registered1515worker2 # [ 0.954728] sdhci-pltfm: SDHCI platform and OF driver helper1516worker1 # [ 0.923952] sky2: driver version 1.301517lb # [ 0.993087] ima: No TPM chip found, activating TPM-bypass!1518client # [ 0.917053] thunder_xcv, ver 1.01519worker1 # [ 0.925510] usbcore: registered new interface driver usb-storage1520lb # [ 0.993106] ima: Allocated hash algorithm: sha11521client # [ 0.917102] thunder_bgx, ver 1.01522client # [ 0.917125] nicpf, ver 1.01523worker1 # [ 0.925620] usbcore: registered new interface driver usbserial_generic1524lb # [ 0.996096] ima: No architecture policies found1525worker1 # [ 0.925635] usbserial: USB Serial support registered for generic1526worker1 # [ 0.926560] ehci-pci 0000:00:0a.0: EHCI Host Controller1527lb # [ 0.997340] input: gpio-keys as /devices/platform/gpio-keys/input/input01528worker2 # [ 0.959105] hid: raw HID events driver (C) Jiri Kosina1529worker2 # [ 0.959349] usbcore: registered new interface driver usbhid1530worker1 # [ 0.926593] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11531worker2 # [ 0.959355] usbhid: USB HID core driver1532worker1 # [ 0.926791] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001533client # [ 0.918861] e1000: Intel(R) PRO/1000 Network Driver1534worker1 # [ 0.938452] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001535worker2 # [ 0.962228] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1536worker1 # [ 0.938818] hub 1-0:1.0: USB hub found1537client # [ 0.918874] e1000: Copyright (c) 1999-2006 Intel Corporation.1538worker1 # [ 0.938841] hub 1-0:1.0: 6 ports detected1539client # [ 0.918898] e1000e: Intel(R) PRO/1000 Network Driver1540client # [ 0.918908] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1541worker2 # [ 0.964888] drop_monitor: Initializing network drop monitor service1542worker1 # [ 0.941496] hv_vmbus: registering driver hyperv_keyboard1543worker2 # [ 0.965045] NET: Registered PF_INET6 protocol family1544client # [ 0.918938] igb: Intel(R) Gigabit Ethernet Network Driver1545client # [ 0.918943] igb: Copyright (c) 2007-2014 Intel Corporation.1546worker2 # [ 0.967001] Segment Routing with IPv61547worker2 # [ 0.967025] In-situ OAM (IOAM) with IPv61548client # [ 0.918970] igbvf: Intel(R) Gigabit Virtual Function Network Driver1549worker2 # [ 0.967070] NET: Registered PF_PACKET protocol family1550client # [ 0.918976] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1551worker1 # [ 0.943043] rtc-pl031 9010000.pl031: registered as rtc01552client # [ 0.919109] sky2: driver version 1.301553client # [ 0.920726] usbcore: registered new interface driver usb-storage1554worker1 # [ 0.943079] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:00:12 UTC (1789894812)1555worker1 # [ 0.943376] i2c_dev: i2c /dev entries driver1556client # [ 0.920776] usbcore: registered new interface driver usbserial_generic1557client # [ 0.920791] usbserial: USB Serial support registered for generic1558worker2 # [ 0.969046] 9pnet: Installing 9P2000 support1559client # [ 0.921379] hv_vmbus: registering driver hyperv_keyboard1560client # [ 0.922298] ehci-pci 0000:00:0a.0: EHCI Host Controller1561client # [ 0.922328] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11562client # [ 0.922567] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001563worker1 # [ 0.948332] sdhci: Secure Digital Host Controller Interface driver1564worker1 # [ 0.948347] sdhci: Copyright(c) Pierre Ossman1565client # [ 0.933878] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001566worker2 # [ 0.971734] Key type dns_resolver registered1567worker1 # [ 0.948604] Synopsys Designware Multimedia Card Interface Driver1568client # [ 0.934268] hub 1-0:1.0: USB hub found1569worker1 # [ 0.948961] sdhci-pltfm: SDHCI platform and OF driver helper1570client # [ 0.935415] hub 1-0:1.0: 6 ports detected1571worker1 # [ 0.953300] hid: raw HID events driver (C) Jiri Kosina1572client # [ 0.937150] rtc-pl031 9010000.pl031: registered as rtc01573worker1 # [ 0.953545] usbcore: registered new interface driver usbhid1574worker2 # [ 0.978134] registered taskstats version 11575worker1 # [ 0.953551] usbhid: USB HID core driver1576client # [ 0.937180] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:00:12 UTC (1789894812)1577worker2 # [ 0.978294] Loading compiled-in X.509 certificates1578client # [ 0.937481] i2c_dev: i2c /dev entries driver1579lb # [ 1.015242] clk: Disabling unused clocks1580lb # [ 1.015279] PM: genpd: Disabling unused power domains1581worker1 # [ 0.956448] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1582lb # [ 1.019591] Freeing unused kernel memory: 4736K1583lb # [ 1.019798] Run /init as init process1584worker1 # [ 0.959061] drop_monitor: Initializing network drop monitor service1585worker1 # [ 0.959215] NET: Registered PF_INET6 protocol family1586worker1 # [ 0.961217] Segment Routing with IPv61587worker1 # [ 0.961237] In-situ OAM (IOAM) with IPv61588client # [ 0.942369] sdhci: Secure Digital Host Controller Interface driver1589worker1 # [ 0.961271] NET: Registered PF_PACKET protocol family1590client # [ 0.942380] sdhci: Copyright(c) Pierre Ossman1591worker2 # [ 0.986815] Demotion targets for Node 0: null1592client # [ 0.942639] Synopsys Designware Multimedia Card Interface Driver1593worker2 # [ 0.986922] Key type .fscrypt registered1594client # [ 0.943004] sdhci-pltfm: SDHCI platform and OF driver helper1595worker2 # [ 0.986929] Key type fscrypt-provisioning registered1596client # [ 0.944679] hid: raw HID events driver (C) Jiri Kosina1597worker2 # [ 0.987020] ima: No TPM chip found, activating TPM-bypass!1598client # [ 0.944927] usbcore: registered new interface driver usbhid1599worker2 # [ 0.987039] ima: Allocated hash algorithm: sha11600worker1 # [ 0.963148] 9pnet: Installing 9P2000 support1601client # [ 0.944934] usbhid: USB HID core driver1602worker2 # [ 0.987060] ima: No architecture policies found1603worker1 # [ 0.965459] Key type dns_resolver registered1604worker2 # [ 0.991303] input: gpio-keys as /devices/platform/gpio-keys/input/input01605client # [ 0.950532] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1606client # [ 0.952031] drop_monitor: Initializing network drop monitor service1607client # [ 0.952186] NET: Registered PF_INET6 protocol family1608client # [ 0.955235] Segment Routing with IPv61609client # [ 0.955255] In-situ OAM (IOAM) with IPv61610client # [ 0.955305] NET: Registered PF_PACKET protocol family1611worker1 # [ 0.972405] registered taskstats version 11612client # [ 0.956939] 9pnet: Installing 9P2000 support1613lb # [ 1.035395] systemd[1]: Successfully made /usr/ read-only.1614worker1 # [ 0.972572] Loading compiled-in X.509 certificates1615client # [ 0.959837] Key type dns_resolver registered1616worker1 # [ 0.981085] Demotion targets for Node 0: null1617worker1 # [ 0.981197] Key type .fscrypt registered1618worker1 # [ 0.981204] Key type fscrypt-provisioning registered1619worker1 # [ 0.981299] ima: No TPM chip found, activating TPM-bypass!1620worker1 # [ 0.981319] ima: Allocated hash algorithm: sha11621worker1 # [ 0.981341] ima: No architecture policies found1622worker1 # [ 0.985695] input: gpio-keys as /devices/platform/gpio-keys/input/input01623client # [ 0.965966] registered taskstats version 11624worker2 # [ 1.008847] clk: Disabling unused clocks1625client # [ 0.966111] Loading compiled-in X.509 certificates1626worker2 # [ 1.008875] PM: genpd: Disabling unused power domains1627worker2 # [ 1.013181] Freeing unused kernel memory: 4736K1628worker2 # [ 1.013369] Run /init as init process1629client # [ 0.974551] Demotion targets for Node 0: null1630client # [ 0.974663] Key type .fscrypt registered1631client # [ 0.974669] Key type fscrypt-provisioning registered1632client # [ 0.974767] ima: No TPM chip found, activating TPM-bypass!1633client # [ 0.974787] ima: Allocated hash algorithm: sha11634client # [ 0.974808] ima: No architecture policies found1635client # [ 0.978838] input: gpio-keys as /devices/platform/gpio-keys/input/input01636worker2 # [ 1.029403] systemd[1]: Successfully made /usr/ read-only.1637worker1 # [ 1.003794] clk: Disabling unused clocks1638worker1 # [ 1.003828] PM: genpd: Disabling unused power domains1639worker1 # [ 1.008128] Freeing unused kernel memory: 4736K1640worker1 # [ 1.008320] Run /init as init process1641client # [ 0.996143] clk: Disabling unused clocks1642client # [ 0.996176] PM: genpd: Disabling unused power domains1643client # [ 1.000404] Freeing unused kernel memory: 4736K1644client # [ 1.000575] Run /init as init process1645worker1 # [ 1.024059] systemd[1]: Successfully made /usr/ read-only.1646client # [ 1.015904] systemd[1]: Successfully made /usr/ read-only.1647lb # [ 1.197173] usb 1-1: new high-speed USB device number 2 using ehci-pci1648worker2 # [ 1.191168] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.185818] usb 1-1: new high-speed USB device number 2 using ehci-pci1650client # [ 1.181588] usb 1-1: new high-speed USB device number 2 using ehci-pci1651lb # [ 1.349635] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652lb # [ 1.370022] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653lb # [ 1.375641] systemd[1]: Detected virtualization qemu.1654lb # [ 1.376576] systemd[1]: Detected architecture arm64.1655lb # [ 1.377555] systemd[1]: Running in initrd.1656lb # [ 1.378799] systemd[1]: Initializing machine ID from random generator.1657lb # [ 1.380056] systemd[1]: Hostname set to <lb>.1658worker2 # [ 1.343459] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659worker1 # [ 1.337593] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660worker2 # [ 1.364269] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1661worker2 # [ 1.376234] systemd[1]: Detected virtualization qemu.1662client # [ 1.333647] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11663worker2 # [ 1.378241] systemd[1]: Detected architecture arm64.1664worker2 # [ 1.380227] systemd[1]: Running in initrd.1665worker2 # [ 1.382756] systemd[1]: Initializing machine ID from random generator.1666worker2 # [ 1.385791] systemd[1]: Hostname set to <worker2>.1667worker1 # [ 1.358717] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1668worker1 # [ 1.365134] systemd[1]: Detected virtualization qemu.1669worker1 # [ 1.367315] systemd[1]: Detected architecture arm64.1670lb # [ 1.429329] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01671worker1 # [ 1.369333] systemd[1]: Running in initrd.1672worker1 # [ 1.371973] systemd[1]: Initializing machine ID from random generator.1673worker1 # [ 1.375060] systemd[1]: Hostname set to <worker1>.1674client # [ 1.350742] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1675client # [ 1.362987] systemd[1]: Detected virtualization qemu.1676client # [ 1.364994] systemd[1]: Detected architecture arm64.1677client # [ 1.366980] systemd[1]: Running in initrd.1678client # [ 1.369654] systemd[1]: Initializing machine ID from random generator.1679client # [ 1.372508] systemd[1]: Hostname set to <client>.1680worker2 # [ 1.431396] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681worker1 # [ 1.430063] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682client # [ 1.417856] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683lb # [ 1.549214] usb 1-2: new high-speed USB device number 3 using ehci-pci1684worker2 # [ 1.555125] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker1 # [ 1.549782] usb 1-2: new high-speed USB device number 3 using ehci-pci1686client # [ 1.541541] usb 1-2: new high-speed USB device number 3 using ehci-pci1687lb # [ 1.642874] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688lb # [ 1.708311] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21689lb # [ 1.711281] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01690worker2 # [ 1.690660] systemd[1]: bpf-restrict-fs: LSM BPF program attached1691lb # [ 1.737413] systemd[1]: Queued start job for default target Initrd Default Target.1692lb # [ 1.747862] systemd[1]: Created slice Slice /system/modprobe.1693lb # [ 1.749203] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1694worker1 # [ 1.687542] systemd[1]: bpf-restrict-fs: LSM BPF program attached1695lb # [ 1.750652] systemd[1]: Expecting device /dev/disk/by-label/nixos...1696lb # [ 1.751798] systemd[1]: Reached target Path Units.1697lb # [ 1.752645] systemd[1]: Reached target Slice Units.1698lb # [ 1.753649] systemd[1]: Reached target Swaps.1699worker2 # [ 1.713228] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21700lb # [ 1.754463] systemd[1]: Reached target Timer Units.1701lb # [ 1.755570] systemd[1]: Listening on D-Bus System Message Bus Socket.1702lb # [ 1.756912] systemd[1]: Listening on Journal Socket (/dev/log).1703lb # [ 1.758299] systemd[1]: Listening on Journal Sockets.1704client # [ 1.679067] systemd[1]: bpf-restrict-fs: LSM BPF program attached1705worker2 # [ 1.718373] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01706lb # [ 1.759391] systemd[1]: Listening on udev Control Socket.1707lb # [ 1.760508] systemd[1]: Listening on udev Kernel Socket.1708lb # [ 1.761558] systemd[1]: Reached target Socket Units.1709lb # [ 1.764174] systemd[1]: Starting Create List of Static Device Nodes...1710lb # [ 1.773328] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1711lb # [ 1.774459] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1712worker1 # [ 1.711011] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21713lb # [ 1.779937] systemd[1]: Mounting Kernel Configuration File System...1714worker1 # [ 1.718255] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01715client # [ 1.702353] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21716client # [ 1.708100] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01717lb # [ 1.793583] systemd[1]: Starting Journal Service...1718lb # [ 1.809353] systemd[1]: Starting Load Kernel Modules...1719lb # [ 1.810237] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1720lb # [ 1.821622] systemd[1]: Starting Coldplug All udev Devices...1721worker2 # [ 1.803844] systemd[1]: Queued start job for default target Initrd Default Target.1722lb # [ 1.845465] systemd[1]: Finished Create List of Static Device Nodes.1723lb # [ 1.846549] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1724lb # [ 1.846861] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1725worker2 # [ 1.813553] systemd[1]: Created slice Slice /system/modprobe.1726worker2 # [ 1.814782] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1727worker2 # [ 1.816209] systemd[1]: Expecting device /dev/disk/by-label/nixos...1728worker2 # [ 1.817249] systemd[1]: Reached target Path Units.1729worker2 # [ 1.818043] systemd[1]: Reached target Slice Units.1730worker2 # [ 1.818860] systemd[1]: Reached target Swaps.1731worker2 # [ 1.819803] systemd[1]: Reached target Timer Units.1732worker2 # [ 1.820833] systemd[1]: Listening on D-Bus System Message Bus Socket.1733lb # [ 1.857305] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1734worker2 # [ 1.822062] systemd[1]: Listening on Journal Socket (/dev/log).1735worker2 # [ 1.823197] systemd[1]: Listening on Journal Sockets.1736lb # [ 1.860895] systemd-journald[73]: Collecting audit messages is disabled.1737worker2 # [ 1.824211] systemd[1]: Listening on udev Control Socket.1738worker2 # [ 1.825281] systemd[1]: Listening on udev Kernel Socket.1739worker2 # [ 1.826187] systemd[1]: Reached target Socket Units.1740worker1 # [ 1.804041] systemd[1]: Queued start job for default target Initrd Default Target.1741worker2 # [ 1.828760] systemd[1]: Starting Create List of Static Device Nodes...1742worker1 # [ 1.811779] systemd[1]: Created slice Slice /system/modprobe.1743client # [ 1.795398] systemd[1]: Queued start job for default target Initrd Default Target.1744worker1 # [ 1.812774] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1745worker1 # [ 1.813838] systemd[1]: Expecting device /dev/disk/by-label/nixos...1746worker1 # [ 1.814663] systemd[1]: Reached target Path Units.1747worker1 # [ 1.815296] systemd[1]: Reached target Slice Units.1748worker2 # [ 1.839295] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1749worker1 # [ 1.815946] systemd[1]: Reached target Swaps.1750worker1 # [ 1.816560] systemd[1]: Reached target Timer Units.1751worker2 # [ 1.840503] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1752worker1 # [ 1.817487] systemd[1]: Listening on D-Bus System Message Bus Socket.1753worker1 # [ 1.818544] systemd[1]: Listening on Journal Socket (/dev/log).1754lb # [ 1.873870] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1755worker1 # [ 1.819434] systemd[1]: Listening on Journal Sockets.1756lb # [ 1.878759] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01757worker1 # [ 1.820220] systemd[1]: Listening on udev Control Socket.1758client # [ 1.804009] systemd[1]: Created slice Slice /system/modprobe.1759lb # [ 1.879017] [drm] features: -virgl +edid -resource_blob -host_visible1760worker1 # [ 1.821015] systemd[1]: Listening on udev Kernel Socket.1761lb # [ 1.879026] [drm] features: -context_init1762worker1 # [ 1.821705] systemd[1]: Reached target Socket Units.1763lb # [ 1.879789] [drm] number of scanouts: 11764lb # [ 1.879807] [drm] number of cap sets: 01765client # [ 1.805229] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1766client # [ 1.806669] systemd[1]: Expecting device /dev/disk/by-label/nixos...1767lb # [ 1.884528] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1768worker2 # [ 1.847973] systemd[1]: Mounting Kernel Configuration File System...1769client # [ 1.807738] systemd[1]: Reached target Path Units.1770worker1 # [ 1.823809] systemd[1]: Starting Create List of Static Device Nodes...1771client # [ 1.808541] systemd[1]: Reached target Slice Units.1772client # [ 1.809456] systemd[1]: Reached target Swaps.1773client # [ 1.810307] systemd[1]: Reached target Timer Units.1774client # [ 1.811359] systemd[1]: Listening on D-Bus System Message Bus Socket.1775client # [ 1.812598] systemd[1]: Listening on Journal Socket (/dev/log).1776client # [ 1.813761] systemd[1]: Listening on Journal Sockets.1777lb # [ 1.893543] systemd[1]: Mounted Kernel Configuration File System.1778client # [ 1.813907] systemd[1]: Listening on udev Control Socket.1779worker1 # [ 1.833428] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1780client # [ 1.814026] systemd[1]: Listening on udev Kernel Socket.1781client # [ 1.814050] systemd[1]: Reached target Socket Units.1782worker1 # [ 1.834531] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1783client # [ 1.819109] systemd[1]: Starting Create List of Static Device Nodes...1784lb # [ 1.897614] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1785lb # [ 1.897635] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01786client # [ 1.829702] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1787client # [ 1.830873] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1788worker1 # [ 1.847918] systemd[1]: Mounting Kernel Configuration File System...1789client # [ 1.834298] systemd[1]: Mounting Kernel Configuration File System...1790worker2 # [ 1.879458] systemd[1]: Starting Journal Service...1791worker2 # [ 1.881988] systemd[1]: Starting Load Kernel Modules...1792worker1 # [ 1.859465] systemd[1]: Starting Journal Service...1793worker2 # [ 1.882909] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1794client # [ 1.846146] systemd[1]: Starting Journal Service...1795worker2 # [ 1.893080] systemd[1]: Starting Coldplug All udev Devices...1796worker1 # [ 1.870848] systemd[1]: Starting Load Kernel Modules...1797worker1 # [ 1.871729] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1798lb # [ 1.933891] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1799client # [ 1.860146] systemd[1]: Starting Load Kernel Modules...1800client # [ 1.860266] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1801lb # [ 1.936231] Console: switching to colour frame buffer device 160x501802worker1 # [ 1.884037] systemd[1]: Starting Coldplug All udev Devices...1803lb # [ 1.944880] systemd[1]: Starting Create Static Device Nodes in /dev...1804worker1 # [ 1.894125] systemd[1]: Finished Create List of Static Device Nodes.1805worker2 # [ 1.915288] systemd[1]: Finished Create List of Static Device Nodes.1806worker2 # [ 1.916527] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1807worker2 # [ 1.916875] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1808worker1 # [ 1.896248] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1809worker2 # [ 1.917123] systemd[1]: Mounted Kernel Configuration File System.1810client # [ 1.886149] systemd[1]: Starting Coldplug All udev Devices...1811client # [ 1.892844] systemd-journald[73]: Collecting audit messages is disabled.1812lb # [ 1.969820] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1813client # [ 1.894637] systemd[1]: Finished Create List of Static Device Nodes.1814worker2 # [ 1.927466] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1815client # [ 1.898448] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1816worker1 # [ 1.920873] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1817lb # [ 1.982603] systemd[1]: Finished Create Static Device Nodes in /dev.1818lb # [ 1.982846] systemd[1]: Reached target Preparation for Local File Systems.1819worker1 # [ 1.925200] systemd-journald[73]: Collecting audit messages is disabled.1820lb # [ 1.982882] systemd[1]: Reached target Local File Systems.1821client # [ 1.909960] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1822lb # [ 1.989695] systemd[1]: Starting Rule-based Manager for Device Events and Files...1823worker1 # [ 1.932042] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1824worker2 # [ 1.960076] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1825worker2 # [ 1.962673] systemd[1]: Starting Create Static Device Nodes in /dev...1826worker1 # [ 1.938691] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1827worker1 # [ 1.942781] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1828lb # [ 2.005263] systemd[1]: Finished Load Kernel Modules.1829worker2 # [ 1.970871] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1830worker2 # [ 1.976749] systemd-journald[73]: Collecting audit messages is disabled.1831client # [ 1.937741] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1832worker1 # [ 1.958710] systemd[1]: Mounted Kernel Configuration File System.1833client # [ 1.938320] systemd[1]: Mounted Kernel Configuration File System.1834lb # [ 2.017627] systemd[1]: Starting Apply Kernel Variables...1835worker2 # [ 1.987563] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1836worker1 # [ 1.963659] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01837worker1 # [ 1.963949] [drm] features: -virgl +edid -resource_blob -host_visible1838worker1 # [ 1.963959] [drm] features: -context_init1839worker1 # [ 1.964732] [drm] number of scanouts: 11840worker1 # [ 1.964752] [drm] number of cap sets: 01841client # [ 1.954098] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1842worker2 # [ 2.002830] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01843client # [ 1.966157] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1844client # [ 1.968370] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1845worker1 # [ 1.978114] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1846worker1 # [ 1.978133] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01847worker2 # [ 2.011218] [drm] features: -virgl +edid -resource_blob -host_visible1848lb # [ 2.032418] systemd-modules-load[74]: Inserted module 'dm_mod'1849worker2 # [ 2.011243] [drm] features: -context_init1850worker2 # [ 2.012087] [drm] number of scanouts: 11851worker2 # [ 2.012131] [drm] number of cap sets: 01852lb # [ 2.050697] systemd[1]: Started Journal Service.1853lb # [ 2.040336] systemd-modules-load[74]: Module 'virtio_balloon' is built in1854client # [ 1.973966] systemd[1]: Starting Create Static Device Nodes in /dev...1855client # [ 1.981551] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01856lb # [ 2.044337] systemd-modules-load[74]: Module 'virtio_console' is built in1857client # [ 1.981781] [drm] features: -virgl +edid -resource_blob -host_visible1858client # [ 1.981791] [drm] features: -context_init1859client # [ 1.982496] [drm] number of scanouts: 11860client # [ 1.982514] [drm] number of cap sets: 01861worker2 # [ 2.020503] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1862worker2 # [ 2.020530] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01863worker2 # [ 2.029813] systemd[1]: Finished Create Static Device Nodes in /dev.1864worker2 # [ 2.030077] systemd[1]: Reached target Preparation for Local File Systems.1865lb # [ 2.052365] systemd-modules-load[74]: Inserted module 'virtio_gpu'1866worker2 # [ 2.030108] systemd[1]: Reached target Local File Systems.1867lb # [ 2.054396] systemd-modules-load[74]: Module 'virtio_rng' is built in1868lb # [ 2.061420] systemd[1]: Starting Create System Files and Directories...1869worker1 # [ 2.010047] Console: switching to colour frame buffer device 160x501870worker1 # [ 2.016911] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1871client # [ 1.997854] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1872client # [ 1.997875] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01873worker2 # [ 2.043293] systemd[1]: Starting Rule-based Manager for Device Events and Files...1874worker1 # [ 2.022461] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1875worker1 # [ 2.025876] systemd[1]: Starting Create Static Device Nodes in /dev...1876lb # [ 2.072152] systemd[1]: Finished Apply Kernel Variables.1877worker2 # [ 2.055487] Console: switching to colour frame buffer device 160x501878worker2 # [ 2.059613] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1879client # [ 2.025984] Console: switching to colour frame buffer device 160x501880worker1 # [ 2.054018] systemd[1]: Finished Load Kernel Modules.1881worker1 # [ 2.058187] systemd[1]: Starting Apply Kernel Variables...1882worker2 # [ 2.083525] systemd[1]: Finished Load Kernel Modules.1883lb # [ 2.108440] systemd-udevd[80]: Using default interface naming scheme 'v261'.1884lb # [ 2.110345] systemd[1]: Finished Create System Files and Directories.1885worker2 # [ 2.087604] systemd[1]: Starting Apply Kernel Variables...1886client # [ 2.050301] systemd[1]: Finished Create Static Device Nodes in /dev.1887client # [ 2.050491] systemd[1]: Reached target Preparation for Local File Systems.1888client # [ 2.050515] systemd[1]: Reached target Local File Systems.1889client # [ 2.054514] systemd[1]: Starting Rule-based Manager for Device Events and Files...1890client # [ 2.059129] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1891client # [ 2.070051] systemd[1]: Finished Load Kernel Modules.1892lb # [ 2.132676] systemd[1]: Started Rule-based Manager for Device Events and Files.1893worker1 # [ 2.090236] systemd[1]: Finished Create Static Device Nodes in /dev.1894worker1 # [ 2.090495] systemd[1]: Reached target Preparation for Local File Systems.1895worker1 # [ 2.090532] systemd[1]: Reached target Local File Systems.1896client # [ 2.077897] systemd[1]: Starting Apply Kernel Variables...1897worker1 # [ 2.098238] systemd[1]: Starting Rule-based Manager for Device Events and Files...1898client # [ 2.072529] systemd-modules-load[75]: Inserted module 'dm_mod'1899client # [ 2.073615] systemd-modules-load[75]: Module 'virtio_balloon' is built in1900client # [ 2.074777] systemd-modules-load[75]: Module 'virtio_console' is built in1901client # [ 2.075832] systemd-modules-load[75]: Inserted module 'virtio_gpu'1902client # [ 2.080422] systemd-modules-load[75]: Module 'virtio_rng' is built in1903client # [ 2.099515] systemd[1]: Started Journal Service.1904worker1 # [ 2.122601] systemd[1]: Finished Apply Kernel Variables.1905worker1 # [ 2.127646] systemd[1]: Started Journal Service.1906worker1 # [ 2.117298] systemd-modules-load[74]: Inserted module 'dm_mod'1907worker1 # [ 2.118578] systemd-modules-load[74]: Module 'virtio_balloon' is built in1908worker2 # [ 2.155868] systemd[1]: Finished Apply Kernel Variables.1909worker1 # [ 2.124347] systemd-modules-load[74]: Module 'virtio_console' is built in1910client # [ 2.106118] systemd[1]: Starting Create System Files and Directories...1911worker1 # [ 2.128345] systemd-modules-load[74]: Inserted module 'virtio_gpu'1912worker1 # [ 2.129498] systemd-modules-load[74]: Module 'virtio_rng' is built in1913worker2 # [ 2.165216] systemd[1]: Started Journal Service.1914lb # [ 2.192191] systemd[1]: Starting Virtual Console Setup...1915worker1 # [ 2.136377] systemd[1]: Starting Create System Files and Directories...1916worker2 # [ 2.156413] systemd-modules-load[74]: Inserted module 'dm_mod'1917worker2 # [ 2.157809] systemd-modules-load[74]: Module 'virtio_balloon' is built in1918worker2 # [ 2.164384] systemd-modules-load[74]: Module 'virtio_console' is built in1919worker2 # [ 2.168277] systemd-modules-load[74]: Inserted module 'virtio_gpu'1920worker2 # [ 2.170410] systemd-modules-load[74]: Module 'virtio_rng' is built in1921worker2 # [ 2.173562] systemd-udevd[80]: Using default interface naming scheme 'v261'.1922client # [ 2.137217] systemd[1]: Finished Apply Kernel Variables.1923worker2 # [ 2.180321] systemd[1]: Starting Create System Files and Directories...1924client # [ 2.149671] systemd-udevd[80]: Using default interface naming scheme 'v261'.1925client # [ 2.160288] systemd[1]: Finished Create System Files and Directories.1926lb # [ 2.240554] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1927worker1 # [ 2.184921] systemd[1]: Finished Create System Files and Directories.1928lb # [ 2.244106] systemd[1]: Finished Virtual Console Setup.1929worker1 # [ 2.194331] systemd-udevd[81]: Using default interface naming scheme 'v261'.1930worker2 # [ 2.214770] systemd[1]: Finished Create System Files and Directories.1931client # [ 2.182209] systemd[1]: Started Rule-based Manager for Device Events and Files.1932worker2 # [ 2.222143] systemd[1]: Started Rule-based Manager for Device Events and Files.1933worker1 # [ 2.222380] systemd[1]: Started Rule-based Manager for Device Events and Files.1934client # [ 2.240297] systemd[1]: Starting Virtual Console Setup...1935worker2 # [ 2.296600] systemd[1]: Starting Virtual Console Setup...1936worker1 # [ 2.282023] systemd[1]: Starting Virtual Console Setup...1937client # [ 2.292550] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1938client # [ 2.296151] systemd[1]: Finished Virtual Console Setup.1939worker2 # [ 2.348597] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940worker1 # [ 2.332525] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1941worker2 # [ 2.352341] systemd[1]: Finished Virtual Console Setup.1942worker1 # [ 2.336218] systemd[1]: Finished Virtual Console Setup.1943lb # [ 2.841329] systemd[1]: Finished Coldplug All udev Devices.1944lb # [ 2.842288] systemd[1]: Reached target System Initialization.1945lb # [ 2.843097] systemd[1]: Reached target Basic System.1946client # [ 2.893172] systemd[1]: Finished Coldplug All udev Devices.1947client # [ 2.894142] systemd[1]: Reached target System Initialization.1948client # [ 2.894951] systemd[1]: Reached target Basic System.1949worker1 # [ 2.917054] systemd[1]: Finished Coldplug All udev Devices.1950worker1 # [ 2.918029] systemd[1]: Reached target System Initialization.1951worker1 # [ 2.920087] systemd[1]: Reached target Basic System.1952lb # [ 2.980277] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1953worker2 # [ 2.942493] systemd[1]: Finished Coldplug All udev Devices.1954worker2 # [ 2.948161] systemd[1]: Reached target System Initialization.1955worker2 # [ 2.949032] systemd[1]: Reached target Basic System.1956lb # [ 3.015109] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1957lb # [ 3.021661] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1958lb # [ 3.104393] systemd[1]: Found device /dev/disk/by-label/nixos.1959lb # [ 3.110365] systemd[1]: Reached target Initrd Root Device.1960lb # [ 3.116117] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1961worker2 # [ 3.079851] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1962client # [ 3.053770] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1963worker1 # [ 3.080183] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1964worker2 # [ 3.108559] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1965client # [ 3.076527] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1966lb # [ 3.157045] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1967client # [ 3.080490] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1968worker1 # [ 3.102962] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1969worker2 # [ 3.125687] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1970lb # [ 3.165701] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1971worker1 # [ 3.107359] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1972lb # [ 3.172260] systemd[1]: Mounting /sysroot...1973lb # [ 3.222980] EXT4-fs (vda): mounted filesystem f7fe3c4d-9da3-4549-9cfa-007ef626cfd6 r/w with ordered data mode. Quota mode: none.1974lb # [ 3.211433] systemd[1]: Mounted /sysroot.1975lb # [ 3.214845] systemd[1]: Reached target Initrd Root File System.1976lb # [ 3.218927] systemd[1]: Starting Mountpoints Configured in the Real Root...1977worker2 # [ 3.189717] systemd[1]: Found device /dev/disk/by-label/nixos.1978client # [ 3.151412] systemd[1]: Found device /dev/disk/by-label/nixos.1979client # [ 3.154208] systemd[1]: Reached target Initrd Root Device.1980worker1 # [ 3.176686] systemd[1]: Found device /dev/disk/by-label/nixos.1981worker2 # [ 3.196392] systemd[1]: Reached target Initrd Root Device.1982client # [ 3.158990] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1983worker2 # [ 3.201389] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1984worker1 # [ 3.184516] systemd[1]: Reached target Initrd Root Device.1985worker1 # [ 3.190436] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1986lb # [ 3.248142] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload.1987lb # [ 3.254250] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)...1988lb # [ 3.259448] systemd[1]: Reloading...1989client # [ 3.209636] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1990client # [ 3.217287] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1991worker1 # [ 3.238614] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1992worker2 # [ 3.258069] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1993client # [ 3.220169] systemd[1]: Mounting /sysroot...1994worker1 # [ 3.246888] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1995worker2 # [ 3.266265] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1996worker2 # [ 3.268286] systemd[1]: Mounting /sysroot...1997worker1 # [ 3.249980] systemd[1]: Mounting /sysroot...1998client # [ 3.276061] EXT4-fs (vda): mounted filesystem 33e3f831-3721-47ea-8cc4-681d9b647cda r/w with ordered data mode. Quota mode: none.1999client # [ 3.263563] systemd[1]: Mounted /sysroot.2000client # [ 3.264703] systemd[1]: Reached target Initrd Root File System.
loading 1,306 hidden lines…
3307lb # [ 13.316419] postgresql-pre-start[700]: selecting dynamic shared memory implementation ... posix3308lb # [ 13.329467] systemd[1]: Finished Address configuration of eth1.3309lb: (finished: waiting for unit network-addresses-eth1.service, in 0.15 seconds)3310lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3311lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.10 seconds)3312worker1: waiting for unit network-addresses-eth1.service3313worker1: waiting for the VM to finish booting3314worker1: Guest shell says: b'Spawning backdoor root shell...\n'3315worker1: connected to guest root shell3316worker1: (connecting took 0.00 seconds)3317worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3318lb # [ 13.543121] postgresql-pre-start[700]: selecting default "max_connections" ... 1003319client # [ 13.532471] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33320lb # [ 13.589902] systemd-logind[518]: Watching system buttons on /dev/input/event0 (gpio-keys)3321worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3322worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3323worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.06 seconds)3324worker2: waiting for unit network-addresses-eth1.service3325worker2: waiting for the VM to finish booting3326worker2: Guest shell says: b'Spawning backdoor root shell...\n'3327worker2: connected to guest root shell3328worker2: (connecting took 0.00 seconds)3329worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3330worker1 # [ 13.659565] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33331lb # [ 13.720415] postgresql-pre-start[700]: selecting default "shared_buffers" ... 128MB3332worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3333worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3334worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.06 seconds)3335lb: waiting for unit niks3.service3336worker2 # [ 13.885525] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33337lb # [ 13.949499] mousedev: PS/2 mouse device common for all mice3338client # [ 13.866537] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3339client # [ 13.873260] systemd[1]: Starting Virtual Console Setup...3340client # [ 13.905673] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3341client # [ 13.906883] systemd[1]: Stopped Virtual Console Setup.3342client # [ 13.912592] systemd[1]: Starting Virtual Console Setup...3343worker1 # [ 13.952046] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3344client # [ 13.943363] systemd-logind[432]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3345worker1 # [ 13.969732] systemd[1]: Starting Virtual Console Setup...3346worker1 # [ 13.988252] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3347worker1 # [ 13.993574] systemd[1]: Stopped Virtual Console Setup.3348worker1 # [ 13.997754] systemd[1]: Starting Virtual Console Setup...3349lb # [ 14.055180] systemd-logind[518]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3350worker1 # [ 14.043389] systemd-logind[518]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3351worker2 # [ 14.181454] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3352worker2 # [ 14.196493] systemd[1]: Starting Virtual Console Setup...3353worker2 # [ 14.224215] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3354worker2 # [ 14.230831] systemd[1]: Stopped Virtual Console Setup.3355worker2 # [ 14.231937] systemd[1]: Starting Virtual Console Setup...3356client # [ 14.224036] dhcpcd[544]: eth0: soliciting a DHCP lease3357client # [ 14.228611] dhcpcd[544]: eth0: offered 10.0.2.15 from 10.0.2.23358client # [ 14.236203] dhcpcd[544]: eth0: probing address 10.0.2.15/243359worker2 # [ 14.282548] systemd-logind[510]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3360worker2 # [ 14.336456] dhcpcd[644]: eth0: soliciting a DHCP lease3361worker2 # [ 14.340481] dhcpcd[644]: eth0: offered 10.0.2.15 from 10.0.2.23362worker2 # [ 14.348226] dhcpcd[644]: eth0: probing address 10.0.2.15/243363client # [ 14.348657] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones.3364client # [ 14.352894] systemd[1]: Finished Virtual Console Setup.3365worker1 # [ 14.413902] systemd-vconsole-setup[710]: Configuration of first virtual console was skipped, ignoring remaining ones.3366worker1 # [ 14.416791] systemd[1]: Finished Virtual Console Setup.3367worker1 # [ 14.556472] dhcpcd[635]: eth0: soliciting a DHCP lease3368worker1 # [ 14.558314] dhcpcd[635]: eth0: offered 10.0.2.15 from 10.0.2.23369worker1 # [ 14.564280] dhcpcd[635]: eth0: probing address 10.0.2.15/243370worker2 # [ 14.657385] systemd-vconsole-setup[708]: Configuration of first virtual console was skipped, ignoring remaining ones.3371worker2 # [ 14.661887] systemd[1]: Finished Virtual Console Setup.3372worker1 # [ 14.720361] dhcpcd[635]: eth0: soliciting an IPv6 router3373worker1 # [ 14.724090] dhcpcd[635]: eth0: Router Advertisement from fe80::23374worker1 # [ 14.726702] dhcpcd[635]: eth0: adding address fec0::5054:ff:fe12:3456/643375worker1 # [ 14.729540] dhcpcd[635]: eth0: adding route to fec0::/643376worker1 # [ 14.731705] dhcpcd[635]: eth0: adding default route via fe80::23377client # [ 14.762311] dhcpcd[544]: eth0: soliciting an IPv6 router3378client # [ 14.766591] dhcpcd[544]: eth0: Router Advertisement from fe80::23379client # [ 14.769271] dhcpcd[544]: eth0: adding address fec0::5054:ff:fe12:3456/643380client # [ 14.772189] dhcpcd[544]: eth0: adding route to fec0::/643381client # [ 14.774435] dhcpcd[544]: eth0: adding default route via fe80::23382lb # [ 14.915458] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33383lb # [ 15.075994] dhcpcd[666]: eth0: soliciting a DHCP lease3384lb # [ 15.081527] dhcpcd[666]: eth0: offered 10.0.2.15 from 10.0.2.23385lb # [ 15.088303] dhcpcd[666]: eth0: probing address 10.0.2.15/243386lb # [ 15.394527] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3387lb # [ 15.402873] systemd[1]: Starting Virtual Console Setup...3388lb # [ 15.428320] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3389lb # [ 15.431686] systemd[1]: Stopped Virtual Console Setup.3390lb # [ 15.436204] systemd[1]: Starting Virtual Console Setup...3391lb # [ 15.511507] systemd-logind[518]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3392worker2 # [ 15.685195] dhcpcd[644]: eth0: soliciting an IPv6 router3393worker2 # [ 15.688693] dhcpcd[644]: eth0: Router Advertisement from fe80::23394worker2 # [ 15.691259] dhcpcd[644]: eth0: adding address fec0::5054:ff:fe12:3456/643395worker2 # [ 15.694308] dhcpcd[644]: eth0: adding route to fec0::/643396worker2 # [ 15.696589] dhcpcd[644]: eth0: adding default route via fe80::23397lb # [ 15.776187] dhcpcd[666]: eth0: soliciting an IPv6 router3398lb # [ 15.777778] dhcpcd[666]: eth0: Router Advertisement from fe80::23399lb # [ 15.779047] dhcpcd[666]: eth0: adding address fec0::5054:ff:fe12:3456/643400lb # [ 15.780519] dhcpcd[666]: eth0: adding route to fec0::/643401lb # [ 15.781581] dhcpcd[666]: eth0: adding default route via fe80::23402lb # [ 15.913863] systemd-vconsole-setup[774]: Configuration of first virtual console was skipped, ignoring remaining ones.3403lb # [ 15.918051] systemd[1]: Finished Virtual Console Setup.3404lb # [ 16.290959] postgresql-pre-start[700]: selecting default time zone ... UTC3405lb # [ 16.295045] postgresql-pre-start[700]: creating configuration files ... ok3406lb # [ 16.599894] postgresql-pre-start[700]: running bootstrap script ... ok3407lb # [ 17.205457] postgresql-pre-start[700]: performing post-bootstrap initialization ... ok3408lb # [ 17.374501] postgresql-pre-start[700]: syncing data to disk ... ok3409lb # [ 17.376684] postgresql-pre-start[700]: initdb: warning: enabling "trust" authentication for local connections3410lb # [ 17.378099] postgresql-pre-start[700]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3411lb # [ 17.380394] postgresql-pre-start[700]: Success. You can now start the database server using:3412lb # [ 17.381574] postgresql-pre-start[700]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3413lb # [ 17.517816] postgres[803]: [803] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3414lb # [ 17.521838] postgres[803]: [803] LOG: listening on IPv6 address "::1", port 54323415lb # [ 17.523192] postgres[803]: [803] LOG: listening on IPv4 address "127.0.0.1", port 54323416lb # [ 17.525378] postgres[803]: [803] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3417lb # [ 17.540513] postgres[817]: [817] LOG: database system was shut down at 2026-09-20 09:00:28 GMT3418lb # [ 17.547561] postgres[803]: [803] LOG: database system is ready to accept connections3419lb # [ 17.552939] systemd[1]: Started PostgreSQL Server.3420lb # [ 17.562680] systemd[1]: Starting PostgreSQL Setup Scripts...3421lb # [ 17.779678] postgresql-setup-start[828]: CREATE DATABASE3422lb # [ 17.830357] postgresql-setup-start[833]: CREATE ROLE3423lb # [ 17.857311] postgresql-setup-start[835]: ALTER DATABASE3424lb # [ 17.864727] systemd[1]: Finished PostgreSQL Setup Scripts.3425lb # [ 17.866541] systemd[1]: Reached target PostgreSQL.3426worker1 # [ 19.077055] dhcpcd[635]: eth0: leased 10.0.2.15 for 86400 seconds3427worker1 # [ 19.081132] dhcpcd[635]: eth0: adding route to 10.0.2.0/243428worker1 # [ 19.084493] dhcpcd[635]: eth0: adding default route via 10.0.2.23429worker2 # [ 19.291483] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds3430worker2 # [ 19.295159] dhcpcd[644]: eth0: adding route to 10.0.2.0/243431worker2 # [ 19.298794] dhcpcd[644]: eth0: adding default route via 10.0.2.23432worker1 # [ 19.288436] systemd[1]: Started DHCP Client.3433worker1 # [ 19.290130] systemd[1]: Reached target Multi-User System.3434worker1 # [ 19.290950] systemd[1]: Startup finished in 999ms (kernel) + 5.434s (initrd) + 12.855s (userspace) = 19.289s.3435worker2 # [ 19.474903] systemd[1]: Started DHCP Client.3436worker2 # [ 19.477454] systemd[1]: Reached target Multi-User System.3437worker2 # [ 19.478653] systemd[1]: Startup finished in 998ms (kernel) + 5.506s (initrd) + 12.971s (userspace) = 19.476s.3438client # [ 19.781015] dhcpcd[544]: eth0: leased 10.0.2.15 for 86400 seconds3439client # [ 19.784719] dhcpcd[544]: eth0: adding route to 10.0.2.0/243440client # [ 19.787149] dhcpcd[544]: eth0: adding default route via 10.0.2.23441lb # [ 19.908821] dhcpcd[666]: eth0: leased 10.0.2.15 for 86400 seconds3442lb # [ 19.912278] dhcpcd[666]: eth0: adding route to 10.0.2.0/243443lb # [ 19.914583] dhcpcd[666]: eth0: adding default route via 10.0.2.23444client # [ 19.946987] systemd[1]: Started DHCP Client.3445client # [ 19.950103] systemd[1]: Reached target Multi-User System.3446client # [ 19.951639] systemd[1]: Startup finished in 987ms (kernel) + 5.440s (initrd) + 13.523s (userspace) = 19.951s.3447lb # [ 20.069615] systemd[1]: Started DHCP Client.3448lb # [ 20.072518] systemd[1]: Reached target Network is Online.3449lb # [ 20.076850] systemd[1]: Started Envoy reverse proxy.3450lb # [ 20.081778] systemd[1]: Started mock-oidc.service.3451lb # [ 20.185206] mock-oidc-server[913]: Mock OIDC Server running3452lb # [ 20.186399] mock-oidc-server[913]: OIDC Address: 192.168.1.2:80803453lb # [ 20.187844] mock-oidc-server[913]: Issue Address: 0.0.0.0:80813454lb # [ 20.189585] mock-oidc-server[913]: Issuer: http://192.168.1.2:8080/oidc3455lb # [ 20.190902] mock-oidc-server[913]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3456lb # [ 20.192934] mock-oidc-server[913]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3457lb # [ 20.194477] mock-oidc-server[913]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3458lb # [ 20.800514] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3459lb # [ 20.802526] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:469] statically linked extensions:3460lb # [ 20.804186] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3461lb # [ 20.809946] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3462lb # [ 20.812169] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3463lb # [ 20.814139] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3464lb # [ 20.816789] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3465lb # [ 20.818524] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3466lb # [ 20.820998] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3467lb # [ 20.823353] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23468lb # [ 20.826088] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3469lb # [ 20.829025] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3470lb # [ 20.846545] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3471lb # [ 20.849796] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3472lb # [ 20.854384] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3473lb # [ 20.857413] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3474lb # [ 20.865257] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3475lb # [ 20.867496] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3476lb # [ 20.869518] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3477lb # [ 20.871902] envoy[912]: [2026-09-20 09:00:32.361][912][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3478lb # [ 20.876983] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3479lb # [ 20.879620] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3480lb # [ 20.883721] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3481lb # [ 20.886434] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3482lb # [ 20.894330] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3483lb # [ 20.898073] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3484lb # [ 20.900980] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23485lb # [ 20.902726] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3486lb # [ 20.908098] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3487lb # [ 20.910514] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3488lb # [ 20.911994] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3489lb # [ 20.917432] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3490lb # [ 20.920255] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3491lb # [ 20.923391] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3492lb # [ 20.926018] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3493lb # [ 20.928498] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3494lb # [ 20.931193] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3495lb # [ 20.933223] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3496lb # [ 20.936671] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3497lb # [ 20.941421] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3498lb # [ 20.944152] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3499lb # [ 20.946335] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3500lb # [ 20.948710] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3501lb # [ 20.951549] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3502lb # [ 20.953801] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3503lb # [ 20.956172] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3504lb # [ 20.970675] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3505lb # [ 21.001088] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3506lb # [ 21.003590] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3507lb # [ 21.005856] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3508lb # [ 21.009154] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3509lb # [ 21.010916] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3510lb # [ 21.013284] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3511lb # [ 21.015188] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3512lb # [ 21.017533] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3513lb # [ 21.019713] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3514lb # [ 21.021887] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3515lb # [ 21.024002] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3516lb # [ 21.031484] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3517lb # [ 21.034529] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3518lb # [ 21.041489] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3519lb # [ 21.044030] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3520lb # [ 21.047026] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3521lb # [ 21.050041] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3522lb # [ 21.051957] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3523lb # [ 21.055247] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3524lb # [ 21.058946] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3525lb # [ 21.061841] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3526lb # [ 21.063608] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3527lb # [ 21.067018] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3528lb # [ 21.069240] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3529lb # [ 21.071679] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3530lb # [ 21.076660] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3531lb # [ 21.078673] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3532lb # [ 21.081180] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3533lb # [ 21.087690] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3534lb # [ 21.089952] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3535lb # [ 21.091698] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3536lb # [ 21.094145] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3537lb # [ 21.098686] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3538lb # [ 21.101718] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3539lb # [ 21.107265] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3540lb # [ 21.109429] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3541lb # [ 21.111587] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3542lb # [ 21.114924] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3543lb # [ 21.122460] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3544lb # [ 21.125426] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3545lb # [ 21.127589] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3546lb # [ 21.132404] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3547lb # [ 21.146224] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3548lb # [ 21.149208] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3549lb # [ 21.151176] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3550lb # [ 21.156746] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83551lb # [ 21.158715] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3552lb # [ 21.160779] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3553lb # [ 21.165876] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23554lb # [ 21.168600] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3555lb # [ 21.171219] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3556lb # [ 21.180368] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3557lb # [ 21.184092] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3558lb # [ 21.185769] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13559lb # [ 21.188053] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3560lb # [ 21.189944] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3561lb # [ 21.192903] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3562lb # [ 21.198253] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3563lb # [ 21.201369] envoy[912]: [2026-09-20 09:00:32.362][912][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3564lb # [ 21.204930] envoy[912]: [2026-09-20 09:00:32.405][912][info][main] [source/server/server.cc:531] HTTP header map info:3565lb # [ 21.206566] envoy[912]: [2026-09-20 09:00:32.407][912][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3566lb # [ 21.222607] envoy[912]: [2026-09-20 09:00:32.407][912][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3567lb # [ 21.224570] envoy[912]: [2026-09-20 09:00:32.407][912][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3568lb # [ 21.233711] envoy[912]: [2026-09-20 09:00:32.407][912][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3569lb # [ 21.235662] envoy[912]: [2026-09-20 09:00:32.656][912][info][main] [source/server/server.cc:968] runtime: {}3570lb # [ 21.237158] envoy[912]: [2026-09-20 09:00:32.677][912][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3571lb # [ 21.239221] envoy[912]: [2026-09-20 09:00:32.677][912][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013572lb # [ 21.241194] envoy[912]: [2026-09-20 09:00:32.677][912][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013573lb # [ 21.242905] envoy[912]: [2026-09-20 09:00:32.690][912][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3574lb # [ 21.244861] envoy[912]: [2026-09-20 09:00:32.690][912][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3575lb # [ 21.246816] envoy[912]: [2026-09-20 09:00:32.690][912][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3576lb # [ 21.274370] envoy[912]: [2026-09-20 09:00:32.836][912][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3577lb # [ 21.284806] envoy[912]: [2026-09-20 09:00:32.847][912][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3578worker1 # [ 21.226695] systemd[1]: Starting Nix worker-protocol over gRPC...3579worker2 # [ 21.249524] systemd[1]: Starting Nix worker-protocol over gRPC...3580lb # [ 21.287627] envoy[912]: [2026-09-20 09:00:32.849][912][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3581lb # [ 21.291314] envoy[912]: [2026-09-20 09:00:32.849][912][info][main] [source/server/server.cc:1077] starting main dispatch loop3582worker1 # [ 21.486215] nix-grpc-daemon[775]: ts=2026-09-20T09:00:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3583worker2 # [ 21.507436] nix-grpc-daemon[773]: ts=2026-09-20T09:00:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3584worker1 # [ 21.498455] nix-grpc-daemon[775]: ts=2026-09-20T09:00:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13585worker2 # [ 21.519872] nix-grpc-daemon[773]: ts=2026-09-20T09:00:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13586worker1 # [ 21.546819] nix-grpc-daemon[775]: ts=2026-09-20T09:00:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3587worker2 # [ 21.565918] nix-grpc-daemon[773]: ts=2026-09-20T09:00:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3588worker1 # [ 21.551629] systemd[1]: Started Nix worker-protocol over gRPC.3589worker2 # [ 21.570720] systemd[1]: Started Nix worker-protocol over gRPC.3590lb # [ 21.649542] envoy[912]: [2026-09-20 09:00:33.211][912][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3591lb # [ 21.660945] envoy[912]: [2026-09-20 09:00:33.217][912][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3592lb # [ 21.680320] envoy[912]: [2026-09-20 09:00:33.217][912][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3593worker2 # [ 21.657253] nix-grpc-daemon[773]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500513594worker1 # [ 21.638537] nix-grpc-daemon[775]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500513595lb # [ 21.695441] envoy[912]: [2026-09-20 09:00:33.217][912][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3596worker2 # [ 21.685412] nix-grpc-daemon[773]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3597worker1 # [ 21.672241] nix-grpc-daemon[775]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3598worker2 # [ 21.886941] nix-grpc-daemon[773]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500513599worker1 # [ 21.873413] nix-grpc-daemon[775]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500513600worker2 # [ 21.894544] nix-grpc-daemon[773]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3601worker1 # [ 21.881254] nix-grpc-daemon[775]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3602worker2 # [ 22.095913] nix-grpc-daemon[773]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500513603worker1 # [ 22.082441] nix-grpc-daemon[775]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500513604worker2 # [ 22.103397] nix-grpc-daemon[773]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3605worker1 # [ 22.090057] nix-grpc-daemon[775]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3606worker2 # [ 22.305086] nix-grpc-daemon[773]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500513607worker1 # [ 22.291350] nix-grpc-daemon[775]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500513608worker2 # [ 22.312448] nix-grpc-daemon[773]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3609worker1 # [ 22.298885] nix-grpc-daemon[775]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3610worker2 # [ 22.516280] nix-grpc-daemon[773]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500513611worker2 # [ 22.521704] nix-grpc-daemon[773]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3612worker1 # [ 22.504692] nix-grpc-daemon[775]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500513613worker1 # [ 22.509827] nix-grpc-daemon[775]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3614worker1 # [ 22.705079] nix-grpc-daemon[775]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500513615worker2 # [ 22.723160] nix-grpc-daemon[773]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 22.730192] nix-grpc-daemon[773]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3617worker1 # [ 22.711542] nix-grpc-daemon[775]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3618worker2 # [ 22.931442] nix-grpc-daemon[773]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500513619worker1 # [ 22.912629] nix-grpc-daemon[775]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500513620worker2 # [ 22.938312] nix-grpc-daemon[773]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3621worker1 # [ 22.919604] nix-grpc-daemon[775]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3622worker1 # [ 23.120880] nix-grpc-daemon[775]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500513623worker2 # [ 23.139747] nix-grpc-daemon[773]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500513624worker2 # [ 23.146611] nix-grpc-daemon[773]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3625worker1 # [ 23.128117] nix-grpc-daemon[775]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3626worker1 # [ 23.328944] nix-grpc-daemon[775]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500513627worker2 # [ 23.347830] nix-grpc-daemon[773]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500513628worker1 # [ 23.332486] nix-grpc-daemon[775]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3629worker2 # [ 23.354924] nix-grpc-daemon[773]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3630worker1 # [ 23.535067] nix-grpc-daemon[775]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500513631worker2 # [ 23.557458] nix-grpc-daemon[773]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500513632worker1 # [ 23.541379] nix-grpc-daemon[775]: ts=2026-09-20T09:00:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3633worker2 # [ 23.562876] nix-grpc-daemon[773]: ts=2026-09-20T09:00:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3634worker1 # [ 23.741844] nix-grpc-daemon[775]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500513635worker2 # [ 23.763767] nix-grpc-daemon[773]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500513636worker1 # [ 23.748591] nix-grpc-daemon[775]: ts=2026-09-20T09:00:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3637worker2 # [ 23.769487] nix-grpc-daemon[773]: ts=2026-09-20T09:00:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3638worker1 # [ 23.949134] nix-grpc-daemon[775]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500513639worker2 # [ 23.970977] nix-grpc-daemon[773]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500513640worker1 # [ 23.955620] nix-grpc-daemon[775]: ts=2026-09-20T09:00:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3641worker2 # [ 23.976493] nix-grpc-daemon[773]: ts=2026-09-20T09:00:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3642worker1 # [ 24.156546] nix-grpc-daemon[775]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500513643worker2 # [ 24.177713] nix-grpc-daemon[773]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 24.183675] nix-grpc-daemon[773]: ts=2026-09-20T09:00:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3645worker1 # [ 24.165680] nix-grpc-daemon[775]: ts=2026-09-20T09:00:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3646worker2 # [ 24.385030] nix-grpc-daemon[773]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500513647worker1 # [ 24.366833] nix-grpc-daemon[775]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 24.391888] nix-grpc-daemon[773]: ts=2026-09-20T09:00:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3649worker1 # [ 24.373725] nix-grpc-daemon[775]: ts=2026-09-20T09:00:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3650worker2 # [ 24.594238] nix-grpc-daemon[773]: ts=2026-09-20T09:00:36Z level=info event=scheduler_connected addr=lb:500513651worker1 # [ 24.576109] nix-grpc-daemon[775]: ts=2026-09-20T09:00:36Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 24.601528] nix-grpc-daemon[773]: ts=2026-09-20T09:00:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3653worker1 # [ 24.582748] nix-grpc-daemon[775]: ts=2026-09-20T09:00:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3654worker1 # [ 24.784049] nix-grpc-daemon[775]: ts=2026-09-20T09:00:36Z level=info event=scheduler_connected addr=lb:500513655worker2 # [ 24.803062] nix-grpc-daemon[773]: ts=2026-09-20T09:00:36Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 24.810167] nix-grpc-daemon[773]: ts=2026-09-20T09:00:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3657worker1 # [ 24.791418] nix-grpc-daemon[775]: ts=2026-09-20T09:00:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3658worker1 # [ 24.992215] nix-grpc-daemon[775]: ts=2026-09-20T09:00:36Z level=info event=scheduler_connected addr=lb:500513659worker2 # [ 25.010831] nix-grpc-daemon[773]: ts=2026-09-20T09:00:36Z level=info event=scheduler_connected addr=lb:500513660worker1 # [ 24.998566] nix-grpc-daemon[775]: ts=2026-09-20T09:00:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3661worker2 # [ 25.018277] nix-grpc-daemon[773]: ts=2026-09-20T09:00:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3662worker1 # [ 25.199298] nix-grpc-daemon[775]: ts=2026-09-20T09:00:36Z level=info event=scheduler_connected addr=lb:500513663worker1 # [ 25.202224] nix-grpc-daemon[775]: ts=2026-09-20T09:00:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3664worker2 # [ 25.220786] nix-grpc-daemon[773]: ts=2026-09-20T09:00:36Z level=info event=scheduler_connected addr=lb:500513665worker2 # [ 25.226212] nix-grpc-daemon[773]: ts=2026-09-20T09:00:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3666worker1 # [ 25.402878] nix-grpc-daemon[775]: ts=2026-09-20T09:00:36Z level=info event=scheduler_connected addr=lb:500513667worker1 # [ 25.405889] nix-grpc-daemon[775]: ts=2026-09-20T09:00:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3668worker2 # [ 25.426819] nix-grpc-daemon[773]: ts=2026-09-20T09:00:36Z level=info event=scheduler_connected addr=lb:500513669worker2 # [ 25.432456] nix-grpc-daemon[773]: ts=2026-09-20T09:00:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3670worker1 # [ 25.608349] nix-grpc-daemon[775]: ts=2026-09-20T09:00:37Z level=info event=scheduler_connected addr=lb:500513671worker1 # [ 25.613513] nix-grpc-daemon[775]: ts=2026-09-20T09:00:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3672worker2 # [ 25.634467] nix-grpc-daemon[773]: ts=2026-09-20T09:00:37Z level=info event=scheduler_connected addr=lb:500513673worker2 # [ 25.641046] nix-grpc-daemon[773]: ts=2026-09-20T09:00:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3674worker1 # [ 25.814517] nix-grpc-daemon[775]: ts=2026-09-20T09:00:37Z level=info event=scheduler_connected addr=lb:500513675worker1 # [ 25.820514] nix-grpc-daemon[775]: ts=2026-09-20T09:00:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3676worker2 # [ 25.842258] nix-grpc-daemon[773]: ts=2026-09-20T09:00:37Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 25.848320] nix-grpc-daemon[773]: ts=2026-09-20T09:00:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3678worker1 # [ 26.021415] nix-grpc-daemon[775]: ts=2026-09-20T09:00:37Z level=info event=scheduler_connected addr=lb:500513679worker1 # [ 26.027324] nix-grpc-daemon[775]: ts=2026-09-20T09:00:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3680worker2 # [ 26.049433] nix-grpc-daemon[773]: ts=2026-09-20T09:00:37Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 26.054810] nix-grpc-daemon[773]: ts=2026-09-20T09:00:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3682worker1 # [ 26.228335] nix-grpc-daemon[775]: ts=2026-09-20T09:00:37Z level=info event=scheduler_connected addr=lb:500513683worker1 # [ 26.234135] nix-grpc-daemon[775]: ts=2026-09-20T09:00:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3684worker2 # [ 26.255524] nix-grpc-daemon[773]: ts=2026-09-20T09:00:37Z level=info event=scheduler_connected addr=lb:500513685worker2 # [ 26.261247] nix-grpc-daemon[773]: ts=2026-09-20T09:00:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3686worker1 # [ 26.435140] nix-grpc-daemon[775]: ts=2026-09-20T09:00:38Z level=info event=scheduler_connected addr=lb:500513687worker1 # [ 26.440963] nix-grpc-daemon[775]: ts=2026-09-20T09:00:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3688worker2 # [ 26.462578] nix-grpc-daemon[773]: ts=2026-09-20T09:00:38Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 26.468406] nix-grpc-daemon[773]: ts=2026-09-20T09:00:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3690worker1 # [ 26.643406] nix-grpc-daemon[775]: ts=2026-09-20T09:00:38Z level=info event=scheduler_connected addr=lb:500513691worker1 # [ 26.649189] nix-grpc-daemon[775]: ts=2026-09-20T09:00:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3692worker2 # [ 26.670736] nix-grpc-daemon[773]: ts=2026-09-20T09:00:38Z level=info event=scheduler_connected addr=lb:500513693worker2 # [ 26.676747] nix-grpc-daemon[773]: ts=2026-09-20T09:00:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3694worker1 # [ 26.849987] nix-grpc-daemon[775]: ts=2026-09-20T09:00:38Z level=info event=scheduler_connected addr=lb:500513695worker1 # [ 26.855648] nix-grpc-daemon[775]: ts=2026-09-20T09:00:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3696worker2 # [ 26.878164] nix-grpc-daemon[773]: ts=2026-09-20T09:00:38Z level=info event=scheduler_connected addr=lb:500513697worker2 # [ 26.883832] nix-grpc-daemon[773]: ts=2026-09-20T09:00:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3698worker1 # [ 27.056613] nix-grpc-daemon[775]: ts=2026-09-20T09:00:38Z level=info event=scheduler_connected addr=lb:500513699worker1 # [ 27.062270] nix-grpc-daemon[775]: ts=2026-09-20T09:00:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3700worker2 # [ 27.084584] nix-grpc-daemon[773]: ts=2026-09-20T09:00:38Z level=info event=scheduler_connected addr=lb:500513701worker2 # [ 27.090041] nix-grpc-daemon[773]: ts=2026-09-20T09:00:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3702worker1 # [ 27.263225] nix-grpc-daemon[775]: ts=2026-09-20T09:00:38Z level=info event=scheduler_connected addr=lb:500513703worker1 # [ 27.269550] nix-grpc-daemon[775]: ts=2026-09-20T09:00:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3704worker2 # [ 27.290987] nix-grpc-daemon[773]: ts=2026-09-20T09:00:38Z level=info event=scheduler_connected addr=lb:500513705worker2 # [ 27.297338] nix-grpc-daemon[773]: ts=2026-09-20T09:00:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3706worker1 # [ 27.470488] nix-grpc-daemon[775]: ts=2026-09-20T09:00:39Z level=info event=scheduler_connected addr=lb:500513707worker1 # [ 27.476343] nix-grpc-daemon[775]: ts=2026-09-20T09:00:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3708worker2 # [ 27.498409] nix-grpc-daemon[773]: ts=2026-09-20T09:00:39Z level=info event=scheduler_connected addr=lb:500513709worker2 # [ 27.504004] nix-grpc-daemon[773]: ts=2026-09-20T09:00:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3710worker1 # [ 27.678594] nix-grpc-daemon[775]: ts=2026-09-20T09:00:39Z level=info event=scheduler_connected addr=lb:500513711worker1 # [ 27.684126] nix-grpc-daemon[775]: ts=2026-09-20T09:00:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3712worker2 # [ 27.706810] nix-grpc-daemon[773]: ts=2026-09-20T09:00:39Z level=info event=scheduler_connected addr=lb:500513713worker2 # [ 27.712415] nix-grpc-daemon[773]: ts=2026-09-20T09:00:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3714worker1 # [ 27.885074] nix-grpc-daemon[775]: ts=2026-09-20T09:00:39Z level=info event=scheduler_connected addr=lb:500513715worker1 # [ 27.890851] nix-grpc-daemon[775]: ts=2026-09-20T09:00:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3716worker2 # [ 27.913106] nix-grpc-daemon[773]: ts=2026-09-20T09:00:39Z level=info event=scheduler_connected addr=lb:500513717worker2 # [ 27.918884] nix-grpc-daemon[773]: ts=2026-09-20T09:00:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3718worker1 # [ 28.091875] nix-grpc-daemon[775]: ts=2026-09-20T09:00:39Z level=info event=scheduler_connected addr=lb:500513719worker1 # [ 28.096517] nix-grpc-daemon[775]: ts=2026-09-20T09:00:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3720worker2 # [ 28.119730] nix-grpc-daemon[773]: ts=2026-09-20T09:00:39Z level=info event=scheduler_connected addr=lb:500513721worker2 # [ 28.125458] nix-grpc-daemon[773]: ts=2026-09-20T09:00:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3722worker1 # [ 28.298082] nix-grpc-daemon[775]: ts=2026-09-20T09:00:39Z level=info event=scheduler_connected addr=lb:500513723worker2 # [ 28.326096] nix-grpc-daemon[773]: ts=2026-09-20T09:00:39Z level=info event=scheduler_connected addr=lb:500513724worker1 # [ 28.306195] nix-grpc-daemon[775]: ts=2026-09-20T09:00:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3725worker2 # [ 28.335816] nix-grpc-daemon[773]: ts=2026-09-20T09:00:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3726worker1 # [ 28.507138] nix-grpc-daemon[775]: ts=2026-09-20T09:00:40Z level=info event=scheduler_connected addr=lb:500513727worker1 # [ 28.511097] nix-grpc-daemon[775]: ts=2026-09-20T09:00:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3728worker2 # [ 28.537000] nix-grpc-daemon[773]: ts=2026-09-20T09:00:40Z level=info event=scheduler_connected addr=lb:500513729worker2 # [ 28.542418] nix-grpc-daemon[773]: ts=2026-09-20T09:00:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3730worker1 # [ 28.714250] nix-grpc-daemon[775]: ts=2026-09-20T09:00:40Z level=info event=scheduler_connected addr=lb:500513731worker1 # [ 28.720007] nix-grpc-daemon[775]: ts=2026-09-20T09:00:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3732worker2 # [ 28.744838] nix-grpc-daemon[773]: ts=2026-09-20T09:00:40Z level=info event=scheduler_connected addr=lb:500513733worker2 # [ 28.750451] nix-grpc-daemon[773]: ts=2026-09-20T09:00:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3734worker1 # [ 28.920862] nix-grpc-daemon[775]: ts=2026-09-20T09:00:40Z level=info event=scheduler_connected addr=lb:500513735worker1 # [ 28.926968] nix-grpc-daemon[775]: ts=2026-09-20T09:00:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3736worker2 # [ 28.951549] nix-grpc-daemon[773]: ts=2026-09-20T09:00:40Z level=info event=scheduler_connected addr=lb:500513737worker2 # [ 28.957179] nix-grpc-daemon[773]: ts=2026-09-20T09:00:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3738worker1 # [ 29.128137] nix-grpc-daemon[775]: ts=2026-09-20T09:00:40Z level=info event=scheduler_connected addr=lb:500513739worker1 # [ 29.134061] nix-grpc-daemon[775]: ts=2026-09-20T09:00:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3740worker2 # [ 29.157783] nix-grpc-daemon[773]: ts=2026-09-20T09:00:40Z level=info event=scheduler_connected addr=lb:500513741worker2 # [ 29.163323] nix-grpc-daemon[773]: ts=2026-09-20T09:00:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3742worker1 # [ 29.335168] nix-grpc-daemon[775]: ts=2026-09-20T09:00:40Z level=info event=scheduler_connected addr=lb:500513743worker1 # [ 29.341007] nix-grpc-daemon[775]: ts=2026-09-20T09:00:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3744worker2 # [ 29.364252] nix-grpc-daemon[773]: ts=2026-09-20T09:00:40Z level=info event=scheduler_connected addr=lb:500513745worker2 # [ 29.369718] nix-grpc-daemon[773]: ts=2026-09-20T09:00:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3746worker1 # [ 29.542556] nix-grpc-daemon[775]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500513747worker1 # [ 29.549093] nix-grpc-daemon[775]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3748worker2 # [ 29.570563] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500513749worker2 # [ 29.579073] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3750lb # [ 29.691417] rustfs-bucket-start[1006]: mb s3://farm3751lb # [ 29.702008] systemd[1]: Finished rustfs-bucket.service.3752lb # [ 29.714077] systemd[1]: Starting niks3 server...3753worker1 # [ 29.751289] nix-grpc-daemon[775]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500513754worker1 # [ 29.757611] nix-grpc-daemon[775]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3755worker2 # [ 29.782424] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500513756worker2 # [ 29.787788] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3757lb # [ 29.955435] postgres[1029]: [1029] ERROR: relation "goose_db_version" does not exist at character 363758lb # [ 29.957461] postgres[1029]: [1029] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3759lb # [ 29.996814] niks3-server[1020]: 2026/09/20 09:00:41 OK 20241026095416_initial_model.sql (24.33ms)3760lb # [ 30.000736] niks3-server[1020]: 2026/09/20 09:00:41 OK 20251210153512_drop_unused_gin_index.sql (2.16ms)3761lb # [ 30.006937] niks3-server[1020]: 2026/09/20 09:00:41 OK 20251218171726_add_pins.sql (6.18ms)3762lb # [ 30.012342] niks3-server[1020]: 2026/09/20 09:00:41 OK 20260628120000_add_object_size_and_stats.sql (5.36ms)3763lb # [ 30.019596] niks3-server[1020]: 2026/09/20 09:00:41 OK 20260905000000_add_claims.sql (7.18ms)3764worker1 # [ 29.958871] nix-grpc-daemon[775]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500513765lb # [ 30.025036] niks3-server[1020]: 2026/09/20 09:00:41 OK 20260920000000_drop_claims.sql (5.27ms)3766lb # [ 30.026436] niks3-server[1020]: 2026/09/20 09:00:41 goose: successfully migrated database to version: 202609200000003767worker1 # [ 29.965013] nix-grpc-daemon[775]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3768worker2 # [ 29.988708] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500513769lb # [ 30.033632] niks3-server[1020]: 2026/09/20 09:00:41 OK 1_commit_pending_closure.sql (8.58ms)3770lb # [ 30.036965] niks3-server[1020]: 2026/09/20 09:00:41 OK 2_object_stats_trigger.sql (3.16ms)3771worker2 # [ 29.994132] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3772lb # [ 30.038323] niks3-server[1020]: 2026/09/20 09:00:41 goose: up to current file version: 23773lb # [ 30.042652] niks3-server[1020]: 2026/09/20 09:00:41 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3774lb # [ 30.093697] niks3-server[1020]: 2026/09/20 09:00:41 INFO Read proxy enabled — serving cache objects from S33775lb # [ 30.095491] niks3-server[1020]: 2026/09/20 09:00:41 INFO Using socket-activated listener address=0.0.0.0:57513776lb # [ 30.099637] niks3-server[1020]: 2026/09/20 09:00:41 INFO systemd watchdog enabled interval=15s3777lb # [ 30.103592] systemd[1]: Started niks3 server.3778lb # [ 30.105674] niks3-server[1020]: 2026/09/20 09:00:41 INFO Starting HTTP server address=0.0.0.0:57513779lb # [ 30.107666] systemd[1]: Reached target Multi-User System.3780lb # [ 30.108908] systemd[1]: Startup finished in 1.007s (kernel) + 5.399s (initrd) + 23.696s (userspace) = 30.103s.3781lb # [ 30.118782] niks3-server[1020]: 2026/09/20 09:00:41 INFO lead: acquired remote=192.168.1.4:367103782worker2 # [ 30.089130] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=scheduler_take_over3783worker1 # [ 30.165955] nix-grpc-daemon[775]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500513784worker2 # [ 30.188773] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03785worker2 # [ 30.196381] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500513786worker2 # [ 30.201840] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3787worker2 # [ 30.402853] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500513788worker2 # [ 30.408719] nix-grpc-daemon[773]: ts=2026-09-20T09:00:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03789lb: (finished: waiting for unit niks3.service, in 16.96 seconds)3790lb: waiting for TCP port 5751 on localhost3791lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3792lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)3793lb: waiting for unit envoy.service3794lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3795lb: waiting for TCP port 50051 on localhost3796lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3797lb # [ 30.971656] envoy[912]: conn peer=[::1]:44282 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33798lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3799lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3800??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3801 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283802lb: must succeed: curl -sf localhost:9901/clusters3803lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)3804lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)3805subtest: one node schedules and both builders hold a WorkerSession on it3806lb: must succeed: curl -sf localhost:9901/clusters3807lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3808worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3809worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)3810(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.15 seconds)3811subtest: balancer auth: client cert, bearer token, nothing, unknown CN3812worker1 # [ 31.767361] nix-grpc-daemon[775]: ts=2026-09-20T09:00:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:360023813worker1 # [ 31.787842] systemd[1]: Started Nix Daemon.3814worker1 # [ 32.137385] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3815worker1 # [ 32.188164] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5)3816worker1 # [ 32.210874] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 2/5)3817worker1 # [ 32.344727] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 179 ms (attempt 3/5)3818worker1 # [ 32.532147] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 678 ms (attempt 4/5)3819worker1 # [ 33.213798] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3820worker1 # [ 33.238758] nix-grpc-daemon[775]: ts=2026-09-20T09:00:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:360023821worker1 # [ 33.254190] nix-grpc-daemon[775]: ts=2026-09-20T09:00:44Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it"3822worker2 # [ 33.297351] nix-grpc-daemon[773]: ts=2026-09-20T09:00:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:458763823worker2 # [ 33.315598] systemd[1]: Started Nix Daemon.3824worker2 # [ 33.613755] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3825worker2 # [ 33.644247] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5)3826worker2 # [ 33.667446] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 2/5)3827worker2 # [ 33.748921] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 245 ms (attempt 3/5)3828worker2 # [ 33.994393] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 718 ms (attempt 4/5)3829worker2 # [ 34.723807] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3830worker2 # [ 34.739700] nix-grpc-daemon[773]: ts=2026-09-20T09:00:46Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it"3831client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3832client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)3833client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3834client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3835worker1 # [ 35.172844] nix-grpc-daemon[775]: ts=2026-09-20T09:00:46Z level=info event=oidc_jwks provider=mock keys=13836worker1 # [ 35.173218] nix-grpc-daemon[775]: ts=2026-09-20T09:00:46Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:360023837worker2 # [ 35.220291] nix-grpc-daemon[773]: ts=2026-09-20T09:00:46Z level=info event=oidc_jwks provider=mock keys=13838worker2 # [ 35.227907] nix-grpc-daemon[773]: ts=2026-09-20T09:00:46Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:458763839worker2 # [ 35.235917] nix-grpc-daemon[773]: ts=2026-09-20T09:00:46Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it"3840worker2 # [ 35.250316] nix-grpc-daemon[773]: ts=2026-09-20T09:00:46Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:458763841worker2 # [ 35.257975] nix-grpc-daemon[773]: ts=2026-09-20T09:00:46Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it"3842client: must succeed: rm -r /var/lib/nix-grpc-store3843client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3844worker1 # [ 37.560741] nix-grpc-daemon[775]: ts=2026-09-20T09:00:49Z level=info event=denied method=QueryMissing cn=- role=none3845worker1 # [ 37.807492] nix-grpc-daemon[775]: ts=2026-09-20T09:00:49Z level=info event=denied method=QueryMissing cn=stranger role=none3846(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 6.45 seconds)3847subtest: DAG build is scheduled across workers and lands in the cache3848client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23849worker1 # [ 38.050210] nix-grpc-daemon[775]: ts=2026-09-20T09:00:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:360023850client # don't know how to build these paths:3851client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3852worker1 # [ 38.064611] nix-grpc-daemon[775]: ts=2026-09-20T09:00:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360023853worker2 # [ 38.125228] nix-grpc-daemon[773]: ts=2026-09-20T09:00:49Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03854worker2 # [ 38.130519] nix-grpc-daemon[773]: ts=2026-09-20T09:00:49Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13855worker1 # [ 38.156462] nix-grpc-daemon[775]: ts=2026-09-20T09:00:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360023856worker1 # [ 38.178588] nix-grpc-daemon[775]: ts=2026-09-20T09:00:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360023857client # copying 1 paths to 'lb:50051'...3858worker1 # [ 38.195379] nix-grpc-daemon[775]: ts=2026-09-20T09:00:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:360023859client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3860worker1 # [ 38.221672] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3861worker1 # [ 38.259456] nix-grpc-daemon[775]: ts=2026-09-20T09:00:49Z level=info event=niks3_push_started pid=8433862worker1 # [ 38.729493] nix-daemon[832]: accepted connection from pid 856, user nix-grpc-daemon (trusted)3863worker1 # [ 38.748676] nix-daemon[832]: reaped child process 859, status = succeeded3864worker1 # [ 38.919443] nix-daemon[832]: accepted connection from pid 861, user nix-grpc-daemon (trusted)3865worker1 # [ 38.938658] nix-daemon[832]: reaped child process 864, status = succeeded3866lb # [ 39.010324] niks3-server[1020]: 2026/09/20 09:00:50 INFO Received uploads request method=POST path=/api/pending_closures3867worker1 # [ 38.979802] nix-grpc-daemon[843]: time=2026-09-20T09:00:50.548Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3868worker1 # [ 38.981767] nix-grpc-daemon[843]: time=2026-09-20T09:00:50.548Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3869lb # [ 39.086935] niks3-server[1020]: 2026/09/20 09:00:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3870lb # [ 39.093828] niks3-server[1020]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3871lb # [ 39.128002] niks3-server[1020]: 2026/09/20 09:00:50 INFO Signed narinfos id=1 count=13872worker1 # [ 39.073920] nix-grpc-daemon[843]: time=2026-09-20T09:00:50.643Z level=INFO msg="Uploading 1 narinfos"3873lb # [ 39.141096] niks3-server[1020]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3874lb # [ 39.146713] niks3-server[1020]: 2026/09/20 09:00:50 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3875lb # [ 39.159421] niks3-server[1020]: 2026/09/20 09:00:50 INFO Completed upload id=13876worker1 # [ 39.102033] nix-grpc-daemon[843]: time=2026-09-20T09:00:50.672Z level=INFO msg="Upload complete. (554ms)"3877lb # [ 39.168651] niks3-server[1020]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3878worker1 # [ 39.117172] nix-grpc-daemon[775]: ts=2026-09-20T09:00:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=0 paths=1 nar_bytes_in=5043879worker1 # [ 39.132537] nix-grpc-daemon[775]: ts=2026-09-20T09:00:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360023880worker1 # [ 39.144185] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3881worker1 # [ 39.150407] nix-daemon[832]: reaped child process 841, status = succeeded3882client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3883client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3884worker1 # [ 39.169882] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3885client # farm-a> LOG-farm-a-t13886worker1 # [ 40.229489] nix-daemon[832]: reaped child process 868, status = succeeded3887worker1 # [ 40.402503] nix-daemon[832]: accepted connection from pid 884, user nix-grpc-daemon (trusted)3888worker1 # [ 40.422657] nix-daemon[832]: reaped child process 887, status = succeeded3889lb # [ 40.493983] niks3-server[1020]: 2026/09/20 09:00:52 INFO Received uploads request method=POST path=/api/pending_closures3890worker1 # [ 40.452109] nix-grpc-daemon[843]: time=2026-09-20T09:00:52.020Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3891worker1 # [ 40.454678] nix-grpc-daemon[843]: time=2026-09-20T09:00:52.020Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3892lb # [ 40.550934] niks3-server[1020]: 2026/09/20 09:00:52 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3893lb # [ 40.562240] niks3-server[1020]: 2026/09/20 09:00:52 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3894worker1 # [ 40.510671] nix-grpc-daemon[843]: time=2026-09-20T09:00:52.081Z level=INFO msg="Uploading 1 narinfos"3895lb # [ 40.571494] niks3-server[1020]: 2026/09/20 09:00:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3896lb # [ 40.579030] niks3-server[1020]: 2026/09/20 09:00:52 INFO Signed narinfos id=2 count=13897lb # [ 40.584688] niks3-server[1020]: 2026/09/20 09:00:52 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3898lb # [ 40.590915] niks3-server[1020]: 2026/09/20 09:00:52 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3899lb # [ 40.603360] niks3-server[1020]: 2026/09/20 09:00:52 INFO Completed upload id=23900worker1 # [ 40.545660] nix-grpc-daemon[843]: time=2026-09-20T09:00:52.116Z level=INFO msg="Upload complete. (350ms)"3901lb # [ 40.606278] niks3-server[1020]: 2026/09/20 09:00:52 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3902worker1 # [ 40.557237] nix-grpc-daemon[775]: ts=2026-09-20T09:00:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13903worker2 # [ 40.591519] nix-grpc-daemon[773]: ts=2026-09-20T09:00:52Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03904worker1 # [ 40.578696] nix-daemon[832]: reaped child process 866, status = succeeded3905worker2 # [ 40.597927] nix-grpc-daemon[773]: ts=2026-09-20T09:00:52Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13906worker1 # [ 40.620639] nix-grpc-daemon[775]: ts=2026-09-20T09:00:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360023907worker1 # [ 40.636428] nix-grpc-daemon[775]: ts=2026-09-20T09:00:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360023908worker1 # [ 40.653755] nix-grpc-daemon[843]: time=2026-09-20T09:00:52.224Z level=INFO msg="All 1 paths already cached"3909client # copying 1 paths to 'lb:50051'...3910client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3911worker1 # [ 40.663862] nix-grpc-daemon[775]: ts=2026-09-20T09:00:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:360023912worker1 # [ 40.678755] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3913worker1 # [ 40.883970] nix-daemon[832]: accepted connection from pid 891, user nix-grpc-daemon (trusted)3914worker1 # [ 40.904141] nix-daemon[832]: reaped child process 894, status = succeeded3915worker1 # [ 41.075242] nix-daemon[832]: accepted connection from pid 896, user nix-grpc-daemon (trusted)3916worker1 # [ 41.092680] nix-daemon[832]: reaped child process 899, status = succeeded3917lb # [ 41.161871] niks3-server[1020]: 2026/09/20 09:00:52 INFO Received uploads request method=POST path=/api/pending_closures3918worker1 # [ 41.118632] nix-grpc-daemon[843]: time=2026-09-20T09:00:52.688Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3919worker1 # [ 41.120281] nix-grpc-daemon[843]: time=2026-09-20T09:00:52.688Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3920lb # [ 41.198404] niks3-server[1020]: 2026/09/20 09:00:52 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3921lb # [ 41.208535] niks3-server[1020]: 2026/09/20 09:00:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3922worker1 # [ 41.157490] nix-grpc-daemon[843]: time=2026-09-20T09:00:52.727Z level=INFO msg="Uploading 1 narinfos"3923lb # [ 41.220455] niks3-server[1020]: 2026/09/20 09:00:52 INFO Signed narinfos id=3 count=13924lb # [ 41.223132] niks3-server[1020]: 2026/09/20 09:00:52 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3925lb # [ 41.233997] niks3-server[1020]: 2026/09/20 09:00:52 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3926lb # [ 41.240592] niks3-server[1020]: 2026/09/20 09:00:52 INFO Completed upload id=33927worker1 # [ 41.182981] nix-grpc-daemon[843]: time=2026-09-20T09:00:52.753Z level=INFO msg="Upload complete. (487ms)"3928lb # [ 41.243157] niks3-server[1020]: 2026/09/20 09:00:52 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3929worker1 # [ 41.192529] nix-grpc-daemon[775]: ts=2026-09-20T09:00:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=0 paths=1 nar_bytes_in=6243930worker1 # [ 41.205581] nix-grpc-daemon[775]: ts=2026-09-20T09:00:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360023931worker1 # [ 41.212101] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3932worker1 # [ 41.217087] nix-daemon[832]: reaped child process 889, status = succeeded3933lb # [ 41.277256] envoy[912]: conn peer=[2001:db8:1::1]:47352 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=30063934lb # [ 41.282460] envoy[912]: conn peer=[2001:db8:1::1]:47354 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=973935client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3936worker1 # [ 41.231663] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3937lb # [ 41.288149] envoy[912]: conn peer=[2001:db8:1::1]:47358 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=133938client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3939lb # [ 41.292885] envoy[912]: conn peer=[2001:db8:1::1]:47366 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=123940client # farm-b> LOG-farm-b-t13941worker1 # [ 42.063723] nix-daemon[832]: reaped child process 903, status = succeeded3942worker1 # [ 42.235833] nix-daemon[832]: accepted connection from pid 918, user nix-grpc-daemon (trusted)3943worker1 # [ 42.255624] nix-daemon[832]: reaped child process 921, status = succeeded3944lb # [ 42.325821] niks3-server[1020]: 2026/09/20 09:00:53 INFO Received uploads request method=POST path=/api/pending_closures3945worker1 # [ 42.280276] nix-grpc-daemon[843]: time=2026-09-20T09:00:53.849Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3946worker1 # [ 42.281804] nix-grpc-daemon[843]: time=2026-09-20T09:00:53.849Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3947lb # [ 42.361436] niks3-server[1020]: 2026/09/20 09:00:53 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3948lb # [ 42.378039] niks3-server[1020]: 2026/09/20 09:00:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3949worker1 # [ 42.325286] nix-grpc-daemon[843]: time=2026-09-20T09:00:53.895Z level=INFO msg="Uploading 1 narinfos"3950lb # [ 42.390271] niks3-server[1020]: 2026/09/20 09:00:53 INFO Signed narinfos id=4 count=13951lb # [ 42.395510] niks3-server[1020]: 2026/09/20 09:00:53 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3952lb # [ 42.400068] niks3-server[1020]: 2026/09/20 09:00:53 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3953lb # [ 42.407156] niks3-server[1020]: 2026/09/20 09:00:53 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3954lb # [ 42.411342] niks3-server[1020]: 2026/09/20 09:00:53 INFO Completed upload id=43955worker1 # [ 42.353716] nix-grpc-daemon[843]: time=2026-09-20T09:00:53.924Z level=INFO msg="Upload complete. (312ms)"3956lb # [ 42.413759] niks3-server[1020]: 2026/09/20 09:00:53 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3957worker1 # [ 42.365066] nix-grpc-daemon[775]: ts=2026-09-20T09:00:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13958worker2 # [ 42.389330] nix-grpc-daemon[773]: ts=2026-09-20T09:00:53Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03959worker2 # [ 42.395591] nix-grpc-daemon[773]: ts=2026-09-20T09:00:53Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13960worker1 # [ 42.381853] nix-daemon[832]: reaped child process 901, status = succeeded3961worker1 # [ 42.428784] nix-grpc-daemon[775]: ts=2026-09-20T09:00:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360023962worker1 # [ 42.444311] nix-grpc-daemon[775]: ts=2026-09-20T09:00:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360023963worker1 # [ 42.460427] nix-grpc-daemon[843]: time=2026-09-20T09:00:54.030Z level=INFO msg="All 2 paths already cached"3964client # copying 1 paths to 'lb:50051'...3965worker1 # [ 42.471009] nix-grpc-daemon[775]: ts=2026-09-20T09:00:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:360023966client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3967worker1 # [ 42.496238] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3968worker1 # [ 42.714947] nix-daemon[832]: accepted connection from pid 925, user nix-grpc-daemon (trusted)3969worker1 # [ 42.733329] nix-daemon[832]: reaped child process 929, status = succeeded3970worker1 # [ 42.906683] nix-daemon[832]: accepted connection from pid 931, user nix-grpc-daemon (trusted)3971worker1 # [ 42.924314] nix-daemon[832]: reaped child process 934, status = succeeded3972lb # [ 42.992806] niks3-server[1020]: 2026/09/20 09:00:54 INFO Received uploads request method=POST path=/api/pending_closures3973worker1 # [ 42.947885] nix-grpc-daemon[843]: time=2026-09-20T09:00:54.518Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3974worker1 # [ 42.949586] nix-grpc-daemon[843]: time=2026-09-20T09:00:54.518Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3975worker1 # [ 42.994121] nix-grpc-daemon[843]: time=2026-09-20T09:00:54.564Z level=INFO msg="Uploading 1 narinfos"3976lb # [ 43.038437] niks3-server[1020]: 2026/09/20 09:00:54 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3977lb # [ 43.056495] niks3-server[1020]: 2026/09/20 09:00:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3978lb # [ 43.064758] niks3-server[1020]: 2026/09/20 09:00:54 INFO Signed narinfos id=5 count=13979lb # [ 43.075279] niks3-server[1020]: 2026/09/20 09:00:54 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3980worker1 # [ 43.023716] nix-grpc-daemon[843]: time=2026-09-20T09:00:54.594Z level=INFO msg="Upload complete. (502ms)"3981lb # [ 43.085801] niks3-server[1020]: 2026/09/20 09:00:54 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3982worker1 # [ 43.032274] nix-grpc-daemon[775]: ts=2026-09-20T09:00:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=0 paths=1 nar_bytes_in=7523983lb # [ 43.095664] niks3-server[1020]: 2026/09/20 09:00:54 INFO Completed upload id=53984lb # [ 43.099357] niks3-server[1020]: 2026/09/20 09:00:54 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3985worker1 # [ 43.047193] nix-grpc-daemon[775]: ts=2026-09-20T09:00:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360023986worker1 # [ 43.055228] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3987worker1 # [ 43.060875] nix-daemon[832]: reaped child process 923, status = succeeded3988client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3989worker1 # [ 43.075288] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3990client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3991client # farm-top> LOG-farm-top-t13992worker1 # [ 43.501918] nix-daemon[832]: reaped child process 938, status = succeeded3993worker1 # [ 43.664116] nix-daemon[832]: accepted connection from pid 953, user nix-grpc-daemon (trusted)3994worker1 # [ 43.681212] nix-daemon[832]: reaped child process 956, status = succeeded3995lb # [ 43.753901] niks3-server[1020]: 2026/09/20 09:00:55 INFO Received uploads request method=POST path=/api/pending_closures3996worker1 # [ 43.707716] nix-grpc-daemon[843]: time=2026-09-20T09:00:55.276Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3997worker1 # [ 43.709387] nix-grpc-daemon[843]: time=2026-09-20T09:00:55.276Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3998lb # [ 43.793664] niks3-server[1020]: 2026/09/20 09:00:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3999worker1 # [ 43.745820] nix-grpc-daemon[843]: time=2026-09-20T09:00:55.316Z level=INFO msg="Uploading 1 narinfos"4000lb # [ 43.810795] niks3-server[1020]: 2026/09/20 09:00:55 INFO Signed narinfos id=6 count=14001lb # [ 43.819145] niks3-server[1020]: 2026/09/20 09:00:55 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4002lb # [ 43.828597] niks3-server[1020]: 2026/09/20 09:00:55 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4003lb # [ 43.837354] niks3-server[1020]: 2026/09/20 09:00:55 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4004lb # [ 43.841833] niks3-server[1020]: 2026/09/20 09:00:55 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4005lb # [ 43.846667] niks3-server[1020]: 2026/09/20 09:00:55 INFO Completed upload id=64006lb # [ 43.849650] niks3-server[1020]: 2026/09/20 09:00:55 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4007worker1 # [ 43.788842] nix-grpc-daemon[843]: time=2026-09-20T09:00:55.359Z level=INFO msg="Upload complete. (304ms)"4008worker1 # [ 43.801268] nix-grpc-daemon[775]: ts=2026-09-20T09:00:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=0 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14009worker1 # [ 43.817401] nix-daemon[832]: reaped child process 936, status = succeeded4010client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 6.02 seconds)4011client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4012client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds)4013client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4014client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds)4015client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4016client # copying 3 paths...4017client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4018client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4019client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4020client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds)4021(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.69 seconds)4022subtest: repeat is answered Cached by the scheduler without building4023worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4024worker1 # finding garbage collector roots...4025worker1 # deleting specified paths...4026worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4027worker1 # deleting unused links...4028worker1 # note: hard linking is currently saving 0.0 KiB4029worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)4030worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4031worker2 # finding garbage collector roots...4032worker2 # deleting specified paths...4033worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4034worker2 # deleting unused links...4035worker2 # note: hard linking is currently saving 0.0 KiB4036worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds)4037client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24038client # don't know how to build these paths:4039client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4040worker2 # [ 45.365426] nix-grpc-daemon[773]: ts=2026-09-20T09:00:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:458764041worker2 # [ 45.374382] nix-grpc-daemon[773]: ts=2026-09-20T09:00:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:458764042worker2 # [ 45.399246] nix-grpc-daemon[773]: ts=2026-09-20T09:00:56Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14043client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.32 seconds)4044client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4045client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds)4046lb: must succeed: curl -sf localhost:9901/clusters4047lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4048lb: must succeed: curl -sf localhost:9901/clusters4049lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4050worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4051worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.08 seconds)4052(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.43 seconds)4053subtest: inputs already in the cache are not sent to the scheduler4054lb: must succeed: curl -sf localhost:9901/clusters4055lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4056lb: must succeed: curl -sf localhost:9901/clusters4057lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4058worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4059worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.08 seconds)4060client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24061client # don't know how to build these paths:4062client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4063worker2 # [ 46.425514] nix-grpc-daemon[773]: ts=2026-09-20T09:00:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:458764064worker2 # [ 46.432799] nix-grpc-daemon[773]: ts=2026-09-20T09:00:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:458764065worker2 # [ 46.446037] nix-grpc-daemon[773]: ts=2026-09-20T09:00:58Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04066worker2 # [ 46.451810] nix-grpc-daemon[773]: ts=2026-09-20T09:00:58Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14067worker1 # [ 46.475784] nix-grpc-daemon[775]: ts=2026-09-20T09:00:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360024068worker1 # [ 46.492286] nix-grpc-daemon[775]: ts=2026-09-20T09:00:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360024069client # copying 1 paths to 'lb:50051'...4070worker1 # [ 46.508982] nix-grpc-daemon[843]: time=2026-09-20T09:00:58.077Z level=INFO msg="All 2 paths already cached"4071client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4072worker1 # [ 46.514553] nix-grpc-daemon[775]: ts=2026-09-20T09:00:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:360024073worker1 # [ 46.529849] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4074worker1 # [ 46.737463] nix-daemon[832]: accepted connection from pid 974, user nix-grpc-daemon (trusted)4075worker1 # [ 46.758285] nix-daemon[832]: reaped child process 977, status = succeeded4076worker1 # [ 46.936427] nix-daemon[832]: accepted connection from pid 979, user nix-grpc-daemon (trusted)4077worker1 # [ 46.954254] nix-daemon[832]: reaped child process 982, status = succeeded4078lb # [ 47.025647] niks3-server[1020]: 2026/09/20 09:00:58 INFO Received uploads request method=POST path=/api/pending_closures4079worker1 # [ 46.976587] nix-grpc-daemon[843]: time=2026-09-20T09:00:58.546Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4080worker1 # [ 46.978122] nix-grpc-daemon[843]: time=2026-09-20T09:00:58.546Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4081worker1 # [ 47.011740] nix-grpc-daemon[843]: time=2026-09-20T09:00:58.582Z level=INFO msg="Uploading 1 narinfos"4082lb # [ 47.061897] niks3-server[1020]: 2026/09/20 09:00:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4083lb # [ 47.073847] niks3-server[1020]: 2026/09/20 09:00:58 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4084lb # [ 47.088830] niks3-server[1020]: 2026/09/20 09:00:58 INFO Signed narinfos id=7 count=14085lb # [ 47.091760] niks3-server[1020]: 2026/09/20 09:00:58 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4086worker1 # [ 47.040548] nix-grpc-daemon[843]: time=2026-09-20T09:00:58.611Z level=INFO msg="Upload complete. (491ms)"4087lb # [ 47.099139] niks3-server[1020]: 2026/09/20 09:00:58 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4088lb # [ 47.105121] niks3-server[1020]: 2026/09/20 09:00:58 INFO Completed upload id=74089worker1 # [ 47.046723] nix-grpc-daemon[775]: ts=2026-09-20T09:00:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=0 paths=1 nar_bytes_in=7524090lb # [ 47.108844] niks3-server[1020]: 2026/09/20 09:00:58 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4091worker1 # [ 47.058756] nix-grpc-daemon[775]: ts=2026-09-20T09:00:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360024092worker1 # [ 47.065526] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4093worker1 # [ 47.070244] nix-daemon[832]: reaped child process 972, status = succeeded4094client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4095client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4096worker1 # [ 47.083044] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4097worker1 # [ 48.504456] nix-daemon[832]: reaped child process 986, status = succeeded4098client # farm-top> LOG-farm-top-t1b4099worker1 # [ 48.665328] nix-daemon[832]: accepted connection from pid 1001, user nix-grpc-daemon (trusted)4100worker1 # [ 48.686112] nix-daemon[832]: reaped child process 1004, status = succeeded4101lb # [ 48.758196] niks3-server[1020]: 2026/09/20 09:01:00 INFO Received uploads request method=POST path=/api/pending_closures4102worker1 # [ 48.712364] nix-grpc-daemon[843]: time=2026-09-20T09:01:00.282Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4103worker1 # [ 48.717012] nix-grpc-daemon[843]: time=2026-09-20T09:01:00.284Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4104lb # [ 48.791734] niks3-server[1020]: 2026/09/20 09:01:00 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4105lb # [ 48.807302] niks3-server[1020]: 2026/09/20 09:01:00 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4106lb # [ 48.826205] niks3-server[1020]: 2026/09/20 09:01:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4107worker1 # [ 48.773293] nix-grpc-daemon[843]: time=2026-09-20T09:01:00.343Z level=INFO msg="Uploading 1 narinfos"4108lb # [ 48.835501] niks3-server[1020]: 2026/09/20 09:01:00 INFO Signed narinfos id=8 count=14109lb # [ 48.841320] niks3-server[1020]: 2026/09/20 09:01:00 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4110lb # [ 48.849469] niks3-server[1020]: 2026/09/20 09:01:00 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4111lb # [ 48.855106] niks3-server[1020]: 2026/09/20 09:01:00 INFO Completed upload id=84112lb # [ 48.857926] niks3-server[1020]: 2026/09/20 09:01:00 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4113worker1 # [ 48.797434] nix-grpc-daemon[843]: time=2026-09-20T09:01:00.367Z level=INFO msg="Upload complete. (304ms)"4114worker1 # [ 48.809327] nix-grpc-daemon[775]: ts=2026-09-20T09:01:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14115worker1 # [ 48.825022] nix-daemon[832]: reaped child process 984, status = succeeded4116client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.70 seconds)4117client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4118client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds)4119lb: must succeed: curl -sf localhost:9901/clusters4120lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4121lb: must succeed: curl -sf localhost:9901/clusters4122lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4123worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4124worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4125(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.33 seconds)4126subtest: two clients wanting the same drv build it once4127client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4128client # [ 49.335875] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4129client # Running as unit: dedup1.service; invocation ID: 7a903d9da0ef427b8ec2939b64a73a214130client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.09 seconds)4131client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4132client # [ 49.580955] nix[884]: don't know how to build these paths:4133client # [ 49.582544] nix[884]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4134worker1 # [ 49.598534] nix-grpc-daemon[775]: ts=2026-09-20T09:01:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:360024135worker2 # [ 49.633256] nix-grpc-daemon[773]: ts=2026-09-20T09:01:01Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04136worker2 # [ 49.639376] nix-grpc-daemon[773]: ts=2026-09-20T09:01:01Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14137worker2 # [ 49.685682] nix-grpc-daemon[773]: ts=2026-09-20T09:01:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:458764138worker2 # [ 49.704965] nix-grpc-daemon[773]: ts=2026-09-20T09:01:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:458764139client # [ 49.679412] nix[884]: copying 1 paths to 'lb:50051'...4140client # [ 49.684535] nix[884]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4141worker2 # [ 49.723965] nix-grpc-daemon[773]: ts=2026-09-20T09:01:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:458764142worker2 # [ 49.739125] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4143worker2 # [ 49.767281] nix-grpc-daemon[773]: ts=2026-09-20T09:01:01Z level=info event=niks3_push_started pid=8894144worker2 # [ 50.223644] nix-daemon[836]: accepted connection from pid 902, user nix-grpc-daemon (trusted)4145worker2 # [ 50.240819] nix-daemon[836]: reaped child process 905, status = succeeded4146worker2 # [ 50.417010] nix-daemon[836]: accepted connection from pid 907, user nix-grpc-daemon (trusted)4147worker2 # [ 50.432909] nix-daemon[836]: reaped child process 910, status = succeeded4148lb # [ 50.485997] niks3-server[1020]: 2026/09/20 09:01:02 INFO Received uploads request method=POST path=/api/pending_closures4149worker2 # [ 50.460139] nix-grpc-daemon[889]: time=2026-09-20T09:01:02.028Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4150worker2 # [ 50.461640] nix-grpc-daemon[889]: time=2026-09-20T09:01:02.028Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4151lb # [ 50.523785] niks3-server[1020]: 2026/09/20 09:01:02 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4152worker2 # [ 50.498407] nix-grpc-daemon[889]: time=2026-09-20T09:01:02.068Z level=INFO msg="Uploading 1 narinfos"4153lb # [ 50.536900] niks3-server[1020]: 2026/09/20 09:01:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4154client # [ 50.451836] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4155lb # [ 50.545088] niks3-server[1020]: 2026/09/20 09:01:02 INFO Signed narinfos id=9 count=14156lb # [ 50.554319] niks3-server[1020]: 2026/09/20 09:01:02 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4157client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4158lb # [ 50.564682] niks3-server[1020]: 2026/09/20 09:01:02 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4159lb # [ 50.576330] niks3-server[1020]: 2026/09/20 09:01:02 INFO Completed upload id=94160worker2 # [ 50.537427] nix-grpc-daemon[889]: time=2026-09-20T09:01:02.107Z level=INFO msg="Upload complete. (499ms)"4161lb # [ 50.579690] niks3-server[1020]: 2026/09/20 09:01:02 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4162worker2 # [ 50.544210] nix-grpc-daemon[773]: ts=2026-09-20T09:01:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=0 paths=1 nar_bytes_in=4324163worker2 # [ 50.559232] nix-grpc-daemon[773]: ts=2026-09-20T09:01:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:458764164worker2 # [ 50.567050] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4165worker2 # [ 50.572637] nix-daemon[836]: reaped child process 887, status = succeeded4166client # Running as unit: dedup2.service; invocation ID: 9fc4514b73f94622af50bc20900c912a4167client # [ 50.543353] nix[884]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4168worker2 # [ 50.586150] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4169worker1 # [ 50.805237] nix-grpc-daemon[775]: ts=2026-09-20T09:01:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:360024170client # [ 50.792846] nix[899]: don't know how to build these paths:4171client # [ 50.794765] nix[899]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4172worker2 # [ 50.844734] nix-grpc-daemon[773]: ts=2026-09-20T09:01:02Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04173worker2 # [ 50.857024] nix-grpc-daemon[773]: ts=2026-09-20T09:01:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:458764174client # [ 50.824992] nix[899]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4175lb # [ 51.271370] envoy[912]: conn peer=[2001:db8:1::1]:47370 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9493 tx=3844 ms=57794176lb # [ 51.276670] envoy[912]: conn peer=[2001:db8:1::1]:45466 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=564177lb # [ 51.281513] envoy[912]: conn peer=[2001:db8:1::1]:45474 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4142 tx=1710 ms=24154178client: must succeed: sleep 24179client: (finished: must succeed: sleep 2, in 2.07 seconds)4180??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4181 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394182client: waiting for success: ! systemctl is-active dedup1 dedup24183??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4184 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394185worker2 # [ 54.226809] nix-daemon[836]: reaped child process 914, status = succeeded4186worker2 # [ 54.404205] nix-daemon[836]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4187worker2 # [ 54.422437] nix-daemon[836]: reaped child process 948, status = succeeded4188lb # [ 54.473806] niks3-server[1020]: 2026/09/20 09:01:06 INFO Received uploads request method=POST path=/api/pending_closures4189worker2 # [ 54.445672] nix-grpc-daemon[889]: time=2026-09-20T09:01:06.015Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4190worker2 # [ 54.447913] nix-grpc-daemon[889]: time=2026-09-20T09:01:06.017Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4191lb # [ 54.522846] niks3-server[1020]: 2026/09/20 09:01:06 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4192lb # [ 54.535090] niks3-server[1020]: 2026/09/20 09:01:06 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4193lb # [ 54.545518] niks3-server[1020]: 2026/09/20 09:01:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4194lb # [ 54.551577] niks3-server[1020]: 2026/09/20 09:01:06 INFO Signed narinfos id=10 count=14195worker2 # [ 54.512254] nix-grpc-daemon[889]: time=2026-09-20T09:01:06.081Z level=INFO msg="Uploading 1 narinfos"4196lb # [ 54.554785] niks3-server[1020]: 2026/09/20 09:01:06 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4197lb # [ 54.567955] niks3-server[1020]: 2026/09/20 09:01:06 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4198lb # [ 54.575128] niks3-server[1020]: 2026/09/20 09:01:06 INFO Completed upload id=104199worker2 # [ 54.535736] nix-grpc-daemon[889]: time=2026-09-20T09:01:06.105Z level=INFO msg="Upload complete. (335ms)"4200lb # [ 54.578163] niks3-server[1020]: 2026/09/20 09:01:06 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4201worker2 # [ 54.553355] nix-grpc-daemon[773]: ts=2026-09-20T09:01:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14202worker2 # [ 54.564315] nix-grpc-daemon[773]: ts=2026-09-20T09:01:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14203worker2 # [ 54.573482] nix-daemon[836]: reaped child process 912, status = succeeded4204client # [ 54.566533] systemd[1]: dedup1.service: Deactivated successfully.4205client # [ 54.571028] systemd[1]: dedup1.service: Consumed 152ms CPU time over 5.235s wall clock time, 37.1M memory peak, 8.4K incoming IP traffic, 8.8K outgoing IP traffic.4206client # [ 54.582416] systemd[1]: dedup2.service: Deactivated successfully.4207client # [ 54.585238] systemd[1]: dedup2.service: Consumed 191ms CPU time over 4.127s wall clock time, 31M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic.4208client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4209client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4210client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4211worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4212worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4213worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4214worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4215worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4216worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.10 seconds)4217worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4218worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4219(finished: subtest: two clients wanting the same drv build it once, in 6.31 seconds)4220subtest: build hook: nix-daemon with builders = grpc://lb4221client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4222client # [ 55.791224] systemd[1]: Started Nix Daemon.4223client # [ 55.975808] nix-daemon[940]: accepted connection from pid 937, user root (trusted)4224worker2 # [ 56.216663] nix-grpc-daemon[773]: ts=2026-09-20T09:01:07Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:458764225worker1 # [ 56.204254] nix-grpc-daemon[775]: ts=2026-09-20T09:01:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360024226worker2 # [ 56.233933] nix-grpc-daemon[773]: ts=2026-09-20T09:01:07Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04227worker1 # [ 56.218090] nix-grpc-daemon[775]: ts=2026-09-20T09:01:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360024228worker2 # [ 56.240274] nix-grpc-daemon[773]: ts=2026-09-20T09:01:07Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14229worker1 # [ 56.233579] nix-grpc-daemon[775]: ts=2026-09-20T09:01:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360024230worker1 # [ 56.247728] nix-grpc-daemon[775]: ts=2026-09-20T09:01:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:360024231worker1 # [ 56.263254] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4232worker1 # [ 56.465888] nix-daemon[832]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)4233worker1 # [ 56.486315] nix-daemon[832]: reaped child process 1034, status = succeeded4234worker1 # [ 56.661996] nix-daemon[832]: accepted connection from pid 1036, user nix-grpc-daemon (trusted)4235worker1 # [ 56.681953] nix-daemon[832]: reaped child process 1039, status = succeeded4236lb # [ 56.754816] niks3-server[1020]: 2026/09/20 09:01:08 INFO Received uploads request method=POST path=/api/pending_closures4237worker1 # [ 56.704814] nix-grpc-daemon[843]: time=2026-09-20T09:01:08.274Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4238worker1 # [ 56.706365] nix-grpc-daemon[843]: time=2026-09-20T09:01:08.274Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4239lb # [ 56.779135] niks3-server[1020]: 2026/09/20 09:01:08 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4240lb # [ 56.794153] niks3-server[1020]: 2026/09/20 09:01:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4241worker1 # [ 56.742991] nix-grpc-daemon[843]: time=2026-09-20T09:01:08.313Z level=INFO msg="Uploading 1 narinfos"4242lb # [ 56.806736] niks3-server[1020]: 2026/09/20 09:01:08 INFO Signed narinfos id=11 count=14243lb # [ 56.814290] niks3-server[1020]: 2026/09/20 09:01:08 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4244worker1 # [ 56.767110] nix-grpc-daemon[843]: time=2026-09-20T09:01:08.337Z level=INFO msg="Upload complete. (486ms)"4245lb # [ 56.825487] niks3-server[1020]: 2026/09/20 09:01:08 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4246lb # [ 56.831627] niks3-server[1020]: 2026/09/20 09:01:08 INFO Completed upload id=114247worker1 # [ 56.773816] nix-grpc-daemon[775]: ts=2026-09-20T09:01:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=0 paths=1 nar_bytes_in=5124248lb # [ 56.835861] niks3-server[1020]: 2026/09/20 09:01:08 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4249worker1 # [ 56.787910] nix-grpc-daemon[775]: ts=2026-09-20T09:01:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360024250worker1 # [ 56.794026] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4251worker1 # [ 56.798924] nix-daemon[832]: reaped child process 1029, status = succeeded4252worker1 # [ 56.810324] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4253worker1 # [ 58.437104] nix-daemon[832]: reaped child process 1043, status = succeeded4254worker1 # [ 58.600197] nix-daemon[832]: accepted connection from pid 1058, user nix-grpc-daemon (trusted)4255worker1 # [ 58.619638] nix-daemon[832]: reaped child process 1061, status = succeeded4256lb # [ 58.690342] niks3-server[1020]: 2026/09/20 09:01:10 INFO Received uploads request method=POST path=/api/pending_closures4257worker1 # [ 58.642088] nix-grpc-daemon[843]: time=2026-09-20T09:01:10.212Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4258worker1 # [ 58.645393] nix-grpc-daemon[843]: time=2026-09-20T09:01:10.214Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4259lb # [ 58.731226] niks3-server[1020]: 2026/09/20 09:01:10 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4260lb # [ 58.743093] niks3-server[1020]: 2026/09/20 09:01:10 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4261lb # [ 58.752380] niks3-server[1020]: 2026/09/20 09:01:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4262worker1 # [ 58.700159] nix-grpc-daemon[843]: time=2026-09-20T09:01:10.270Z level=INFO msg="Uploading 1 narinfos"4263lb # [ 58.760651] niks3-server[1020]: 2026/09/20 09:01:10 INFO Signed narinfos id=12 count=14264lb # [ 58.765125] niks3-server[1020]: 2026/09/20 09:01:10 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4265lb # [ 58.771332] niks3-server[1020]: 2026/09/20 09:01:10 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4266lb # [ 58.777127] niks3-server[1020]: 2026/09/20 09:01:10 INFO Completed upload id=124267worker1 # [ 58.718913] nix-grpc-daemon[843]: time=2026-09-20T09:01:10.289Z level=INFO msg="Upload complete. (296ms)"4268lb # [ 58.779359] niks3-server[1020]: 2026/09/20 09:01:10 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4269worker1 # [ 58.729080] nix-grpc-daemon[775]: ts=2026-09-20T09:01:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14270worker2 # [ 58.755044] nix-grpc-daemon[773]: ts=2026-09-20T09:01:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:458764271worker1 # [ 58.746210] nix-daemon[832]: reaped child process 1041, status = succeeded4272worker2 # [ 58.766183] nix-grpc-daemon[773]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4273worker2 # [ 58.811841] nix-grpc-daemon[773]: ts=2026-09-20T09:01:10Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:458764274worker2 # [ 58.818671] nix-grpc-daemon[773]: ts=2026-09-20T09:01:10Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=0 paths=1 nar_bytes_out=1284275worker2 # [ 59.134417] nix-grpc-daemon[773]: ts=2026-09-20T09:01:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:458764276worker2 # [ 59.142851] nix-grpc-daemon[773]: ts=2026-09-20T09:01:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:458764277worker2 # [ 59.151053] nix-grpc-daemon[889]: time=2026-09-20T09:01:10.719Z level=INFO msg="All 1 paths already cached"4278worker2 # [ 59.163279] nix-grpc-daemon[773]: ts=2026-09-20T09:01:10Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04279worker2 # [ 59.169726] nix-grpc-daemon[773]: ts=2026-09-20T09:01:10Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14280worker1 # [ 59.154069] nix-grpc-daemon[775]: ts=2026-09-20T09:01:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360024281worker1 # [ 59.169924] nix-grpc-daemon[775]: ts=2026-09-20T09:01:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360024282worker1 # [ 59.184344] nix-grpc-daemon[843]: time=2026-09-20T09:01:10.754Z level=INFO msg="All 1 paths already cached"4283worker1 # [ 59.193383] nix-grpc-daemon[775]: ts=2026-09-20T09:01:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:360024284worker1 # [ 59.207085] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4285worker1 # [ 59.418997] nix-daemon[832]: accepted connection from pid 1065, user nix-grpc-daemon (trusted)4286worker1 # [ 59.437733] nix-daemon[832]: reaped child process 1068, status = succeeded4287worker1 # [ 59.614909] nix-daemon[832]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4288worker1 # [ 59.632409] nix-daemon[832]: reaped child process 1073, status = succeeded4289lb # [ 59.701846] niks3-server[1020]: 2026/09/20 09:01:11 INFO Received uploads request method=POST path=/api/pending_closures4290worker1 # [ 59.653846] nix-grpc-daemon[843]: time=2026-09-20T09:01:11.223Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4291worker1 # [ 59.655324] nix-grpc-daemon[843]: time=2026-09-20T09:01:11.223Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4292lb # [ 59.729318] niks3-server[1020]: 2026/09/20 09:01:11 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4293worker1 # [ 59.695440] nix-grpc-daemon[843]: time=2026-09-20T09:01:11.265Z level=INFO msg="Uploading 1 narinfos"4294lb # [ 59.747544] niks3-server[1020]: 2026/09/20 09:01:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4295lb # [ 59.761448] niks3-server[1020]: 2026/09/20 09:01:11 INFO Signed narinfos id=13 count=14296lb # [ 59.767306] niks3-server[1020]: 2026/09/20 09:01:11 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4297worker1 # [ 59.717552] nix-grpc-daemon[843]: time=2026-09-20T09:01:11.288Z level=INFO msg="Upload complete. (492ms)"4298lb # [ 59.776286] niks3-server[1020]: 2026/09/20 09:01:11 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4299lb # [ 59.781545] niks3-server[1020]: 2026/09/20 09:01:11 INFO Completed upload id=134300lb # [ 59.784756] niks3-server[1020]: 2026/09/20 09:01:11 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4301worker1 # [ 59.724245] nix-grpc-daemon[775]: ts=2026-09-20T09:01:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=0 paths=1 nar_bytes_in=6244302worker1 # [ 59.740372] nix-grpc-daemon[775]: ts=2026-09-20T09:01:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360024303worker1 # [ 59.747159] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4304worker1 # [ 59.750667] nix-daemon[832]: reaped child process 1063, status = succeeded4305worker1 # [ 59.763098] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4306worker1 # [ 60.605481] nix-daemon[832]: reaped child process 1077, status = succeeded4307worker1 # [ 60.785291] nix-daemon[832]: accepted connection from pid 1092, user nix-grpc-daemon (trusted)4308worker1 # [ 60.803148] nix-daemon[832]: reaped child process 1095, status = succeeded4309lb # [ 60.873354] niks3-server[1020]: 2026/09/20 09:01:12 INFO Received uploads request method=POST path=/api/pending_closures4310worker1 # [ 60.827325] nix-grpc-daemon[843]: time=2026-09-20T09:01:12.396Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4311worker1 # [ 60.829588] nix-grpc-daemon[843]: time=2026-09-20T09:01:12.396Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4312lb # [ 60.912637] niks3-server[1020]: 2026/09/20 09:01:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4313worker1 # [ 60.864422] nix-grpc-daemon[843]: time=2026-09-20T09:01:12.434Z level=INFO msg="Uploading 1 narinfos"4314lb # [ 60.928546] niks3-server[1020]: 2026/09/20 09:01:12 INFO Signed narinfos id=14 count=14315lb # [ 60.936453] niks3-server[1020]: 2026/09/20 09:01:12 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4316lb # [ 60.943316] niks3-server[1020]: 2026/09/20 09:01:12 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4317lb # [ 60.949802] niks3-server[1020]: 2026/09/20 09:01:12 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4318worker1 # [ 60.898119] nix-grpc-daemon[843]: time=2026-09-20T09:01:12.468Z level=INFO msg="Upload complete. (325ms)"4319lb # [ 60.957062] niks3-server[1020]: 2026/09/20 09:01:12 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4320lb # [ 60.962235] niks3-server[1020]: 2026/09/20 09:01:12 INFO Completed upload id=144321lb # [ 60.965104] niks3-server[1020]: 2026/09/20 09:01:12 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4322worker1 # [ 60.909285] nix-grpc-daemon[775]: ts=2026-09-20T09:01:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14323worker1 # [ 60.928799] nix-daemon[832]: reaped child process 1075, status = succeeded4324worker1 # [ 60.953963] nix-grpc-daemon[775]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:360024325worker2 # [ 61.002003] nix-grpc-daemon[773]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:458764326worker2 # [ 61.010129] nix-grpc-daemon[773]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4327worker2 # [ 61.027655] nix-grpc-daemon[773]: ts=2026-09-20T09:01:12Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=0 paths=1 nar_bytes_out=1764328lb # [ 61.272327] envoy[912]: conn peer=[2001:db8:1::1]:45490 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1374 ms=49464329lb # [ 61.277248] envoy[912]: conn peer=[2001:db8:1::1]:45502 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=37444330lb # [ 61.282100] envoy[912]: conn peer=[2001:db8:1::1]:56868 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3391 tx=1770 ms=26674331lb # [ 61.286977] envoy[912]: conn peer=[2001:db8:1::1]:56880 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=764332lb # [ 61.292213] envoy[912]: conn peer=[2001:db8:1::1]:56886 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3888 tx=1847 ms=19514333lb # [ 61.298081] envoy[912]: conn peer=[2001:db8:1::1]:57290 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=934334worker2 # [ 61.332534] nix-grpc-daemon[773]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:458764335worker1 # [ 61.323965] nix-grpc-daemon[775]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360024336worker1 # [ 61.335058] nix-grpc-daemon[843]: time=2026-09-20T09:01:12.905Z level=INFO msg="All 2 paths already cached"4337worker2 # [ 61.372902] nix-grpc-daemon[773]: ts=2026-09-20T09:01:12Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04338worker2 # [ 61.379254] nix-grpc-daemon[773]: ts=2026-09-20T09:01:12Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14339worker1 # [ 61.363656] nix-grpc-daemon[775]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360024340worker1 # [ 61.379279] nix-grpc-daemon[775]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360024341worker1 # [ 61.394011] nix-grpc-daemon[843]: time=2026-09-20T09:01:12.964Z level=INFO msg="All 2 paths already cached"4342worker1 # [ 61.400468] nix-grpc-daemon[775]: ts=2026-09-20T09:01:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:360024343worker1 # [ 61.415119] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4344worker1 # [ 61.620290] nix-daemon[832]: accepted connection from pid 1099, user nix-grpc-daemon (trusted)4345worker1 # [ 61.641686] nix-daemon[832]: reaped child process 1102, status = succeeded4346worker1 # [ 61.814611] nix-daemon[832]: accepted connection from pid 1104, user nix-grpc-daemon (trusted)4347worker1 # [ 61.833994] nix-daemon[832]: reaped child process 1107, status = succeeded4348lb # [ 61.903523] niks3-server[1020]: 2026/09/20 09:01:13 INFO Received uploads request method=POST path=/api/pending_closures4349worker1 # [ 62.056250] nix-grpc-daemon[843]: time=2026-09-20T09:01:13.625Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4350worker1 # [ 62.060868] nix-grpc-daemon[843]: time=2026-09-20T09:01:13.625Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4351worker1 # [ 62.091936] nix-grpc-daemon[843]: time=2026-09-20T09:01:13.662Z level=INFO msg="Uploading 1 narinfos"4352lb # [ 62.142286] niks3-server[1020]: 2026/09/20 09:01:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4353lb # [ 62.154621] niks3-server[1020]: 2026/09/20 09:01:13 INFO Signed narinfos id=15 count=14354lb # [ 62.162396] niks3-server[1020]: 2026/09/20 09:01:13 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4355lb # [ 62.177628] niks3-server[1020]: 2026/09/20 09:01:13 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4356lb # [ 62.183974] niks3-server[1020]: 2026/09/20 09:01:13 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4357lb # [ 62.188139] niks3-server[1020]: 2026/09/20 09:01:13 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4358lb # [ 62.192421] niks3-server[1020]: 2026/09/20 09:01:13 INFO Completed upload id=154359worker1 # [ 62.134724] nix-grpc-daemon[843]: time=2026-09-20T09:01:13.705Z level=INFO msg="Upload complete. (701ms)"4360worker1 # [ 62.146320] nix-grpc-daemon[775]: ts=2026-09-20T09:01:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=0 paths=1 nar_bytes_in=7524361worker1 # [ 62.164625] nix-grpc-daemon[775]: ts=2026-09-20T09:01:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360024362worker1 # [ 62.178735] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4363worker1 # [ 62.183594] nix-daemon[832]: reaped child process 1097, status = succeeded4364worker1 # [ 62.200408] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4365worker1 # [ 63.446107] nix-daemon[832]: reaped child process 1111, status = succeeded4366worker1 # [ 63.613455] nix-daemon[832]: accepted connection from pid 1126, user nix-grpc-daemon (trusted)4367worker1 # [ 63.633255] nix-daemon[832]: reaped child process 1129, status = succeeded4368lb # [ 63.705730] niks3-server[1020]: 2026/09/20 09:01:15 INFO Received uploads request method=POST path=/api/pending_closures4369worker1 # [ 63.660445] nix-grpc-daemon[843]: time=2026-09-20T09:01:15.229Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4370worker1 # [ 63.662129] nix-grpc-daemon[843]: time=2026-09-20T09:01:15.229Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4371lb # [ 63.748079] niks3-server[1020]: 2026/09/20 09:01:15 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4372lb # [ 63.765613] niks3-server[1020]: 2026/09/20 09:01:15 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4373lb # [ 63.780145] niks3-server[1020]: 2026/09/20 09:01:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4374worker1 # [ 63.728347] nix-grpc-daemon[843]: time=2026-09-20T09:01:15.298Z level=INFO msg="Uploading 1 narinfos"4375lb # [ 63.790685] niks3-server[1020]: 2026/09/20 09:01:15 INFO Signed narinfos id=16 count=14376lb # [ 63.795644] niks3-server[1020]: 2026/09/20 09:01:15 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4377lb # [ 63.802739] niks3-server[1020]: 2026/09/20 09:01:15 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4378lb # [ 63.810676] niks3-server[1020]: 2026/09/20 09:01:15 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4379lb # [ 63.814837] niks3-server[1020]: 2026/09/20 09:01:15 INFO Completed upload id=164380worker1 # [ 63.757245] nix-grpc-daemon[843]: time=2026-09-20T09:01:15.327Z level=INFO msg="Upload complete. (341ms)"4381worker1 # [ 63.769192] nix-grpc-daemon[775]: ts=2026-09-20T09:01:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14382worker2 # [ 63.791644] nix-grpc-daemon[773]: ts=2026-09-20T09:01:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:458764383worker2 # [ 63.804744] nix-grpc-daemon[773]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4384worker1 # [ 63.788547] nix-daemon[832]: reaped child process 1109, status = succeeded4385worker1 # [ 63.827581] nix-grpc-daemon[775]: ts=2026-09-20T09:01:15Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:360024386worker1 # [ 63.836157] nix-grpc-daemon[775]: ts=2026-09-20T09:01:15Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=0 paths=1 nar_bytes_out=2324387client # [ 63.908847] nix-daemon[940]: reaped child process 942, status = succeeded4388client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.36 seconds)4389client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4390client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4391client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4392client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4393client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4394client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4395(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.49 seconds)4396subtest: an input only one worker has still reaches the builder4397client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4398client # this derivation will be built:4399client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4400client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4401client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.69 seconds)4402client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4403client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.23 seconds)4404worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4405worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds)4406worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4407worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4408client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24409client # [ 65.488000] nix-daemon[940]: accepted connection from pid 1019, user root (trusted)4410client # this derivation will be built:4411client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4412worker1 # [ 65.755705] nix-grpc-daemon[775]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:360024413client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4414worker1 # [ 65.763343] nix-grpc-daemon[775]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360024415worker1 # [ 65.963958] nix-daemon[832]: accepted connection from pid 1136, user nix-grpc-daemon (trusted)4416worker1 # [ 65.981416] nix-daemon[832]: reaped child process 1139, status = succeeded4417lb # [ 66.053217] niks3-server[1020]: 2026/09/20 09:01:17 INFO Received uploads request method=POST path=/api/pending_closures4418worker1 # [ 66.005425] nix-grpc-daemon[843]: time=2026-09-20T09:01:17.575Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4419worker1 # [ 66.006952] nix-grpc-daemon[843]: time=2026-09-20T09:01:17.575Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4420lb # [ 66.082116] niks3-server[1020]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4421lb # [ 66.097100] niks3-server[1020]: 2026/09/20 09:01:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4422worker1 # [ 66.044790] nix-grpc-daemon[843]: time=2026-09-20T09:01:17.615Z level=INFO msg="Uploading 1 narinfos"4423lb # [ 66.109430] niks3-server[1020]: 2026/09/20 09:01:17 INFO Signed narinfos id=17 count=14424lb # [ 66.115904] niks3-server[1020]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4425worker1 # [ 66.066690] nix-grpc-daemon[843]: time=2026-09-20T09:01:17.637Z level=INFO msg="Upload complete. (304ms)"4426lb # [ 66.125155] niks3-server[1020]: 2026/09/20 09:01:17 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4427lb # [ 66.129947] niks3-server[1020]: 2026/09/20 09:01:17 INFO Completed upload id=174428lb # [ 66.132792] niks3-server[1020]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4429worker2 # [ 66.109753] nix-grpc-daemon[773]: ts=2026-09-20T09:01:17Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04430worker2 # [ 66.115579] nix-grpc-daemon[773]: ts=2026-09-20T09:01:17Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14431worker2 # [ 66.154990] nix-grpc-daemon[773]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:458764432worker2 # [ 66.170663] nix-grpc-daemon[773]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:458764433client # copying 2 paths to 'lb:50051'...4434client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4435worker2 # [ 66.189942] nix-grpc-daemon[773]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:458764436client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4437worker2 # [ 66.205133] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4438worker2 # [ 66.416380] nix-daemon[836]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4439worker2 # [ 66.434769] nix-daemon[836]: reaped child process 980, status = succeeded4440worker2 # [ 66.608675] nix-daemon[836]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4441worker2 # [ 66.625785] nix-daemon[836]: reaped child process 985, status = succeeded4442lb # [ 66.677791] niks3-server[1020]: 2026/09/20 09:01:18 INFO Received uploads request method=POST path=/api/pending_closures4443lb # [ 66.687456] niks3-server[1020]: 2026/09/20 09:01:18 INFO Received uploads request method=POST path=/api/pending_closures4444worker2 # [ 66.657813] nix-grpc-daemon[889]: time=2026-09-20T09:01:18.227Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4445worker2 # [ 66.659276] nix-grpc-daemon[889]: time=2026-09-20T09:01:18.227Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4446worker2 # [ 66.661148] nix-grpc-daemon[889]: time=2026-09-20T09:01:18.227Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4447lb # [ 66.717103] niks3-server[1020]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4448lb # [ 66.737781] niks3-server[1020]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4449lb # [ 66.753403] niks3-server[1020]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4450lb # [ 66.759005] niks3-server[1020]: 2026/09/20 09:01:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4451lb # [ 66.767618] niks3-server[1020]: 2026/09/20 09:01:18 INFO Signed narinfos id=18 count=14452worker2 # [ 66.727548] nix-grpc-daemon[889]: time=2026-09-20T09:01:18.296Z level=INFO msg="Uploading 3 narinfos"4453lb # [ 66.772286] niks3-server[1020]: 2026/09/20 09:01:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4454lb # [ 66.775490] niks3-server[1020]: 2026/09/20 09:01:18 INFO Signed narinfos id=19 count=24455lb # [ 66.784272] niks3-server[1020]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4456lb # [ 66.800425] niks3-server[1020]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4457lb # [ 66.809715] niks3-server[1020]: 2026/09/20 09:01:18 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4458lb # [ 66.813783] niks3-server[1020]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4459lb # [ 66.816503] niks3-server[1020]: 2026/09/20 09:01:18 INFO Completed upload id=184460lb # [ 66.818548] niks3-server[1020]: 2026/09/20 09:01:18 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4461worker2 # [ 66.779718] nix-grpc-daemon[889]: time=2026-09-20T09:01:18.349Z level=INFO msg="Upload complete. (554ms)"4462lb # [ 66.821514] niks3-server[1020]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4463lb # [ 66.824135] niks3-server[1020]: 2026/09/20 09:01:18 INFO Completed upload id=194464worker2 # [ 66.792342] nix-grpc-daemon[773]: ts=2026-09-20T09:01:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=0 paths=2 nar_bytes_in=9844465worker2 # [ 66.808550] nix-grpc-daemon[773]: ts=2026-09-20T09:01:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:458764466worker2 # [ 66.819911] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4467worker2 # [ 66.826879] nix-daemon[836]: reaped child process 975, status = succeeded4468worker2 # [ 66.845524] nix-grpc-daemon[773]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4469client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4470worker2 # [ 66.864343] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4471client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4472worker2 # [ 68.096826] nix-daemon[836]: reaped child process 990, status = succeeded4473worker2 # [ 68.266806] nix-daemon[836]: accepted connection from pid 1005, user nix-grpc-daemon (trusted)4474worker2 # [ 68.286032] nix-daemon[836]: reaped child process 1008, status = succeeded4475lb # [ 68.338131] niks3-server[1020]: 2026/09/20 09:01:19 INFO Received uploads request method=POST path=/api/pending_closures4476worker2 # [ 68.345775] nix-grpc-daemon[889]: time=2026-09-20T09:01:19.914Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4477lb # [ 68.406066] niks3-server[1020]: 2026/09/20 09:01:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4478worker2 # [ 68.375926] nix-grpc-daemon[889]: time=2026-09-20T09:01:19.945Z level=INFO msg="Uploading 1 narinfos"4479lb # [ 68.419862] niks3-server[1020]: 2026/09/20 09:01:19 INFO Signed narinfos id=20 count=14480lb # [ 68.429653] niks3-server[1020]: 2026/09/20 09:01:19 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4481lb # [ 68.438968] niks3-server[1020]: 2026/09/20 09:01:19 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4482lb # [ 68.449561] niks3-server[1020]: 2026/09/20 09:01:20 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4483lb # [ 68.455463] niks3-server[1020]: 2026/09/20 09:01:20 INFO Completed upload id=204484worker2 # [ 68.416649] nix-grpc-daemon[889]: time=2026-09-20T09:01:19.986Z level=INFO msg="Upload complete. (335ms)"4485lb # [ 68.460328] niks3-server[1020]: 2026/09/20 09:01:20 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4486worker2 # [ 68.432628] nix-grpc-daemon[773]: ts=2026-09-20T09:01:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14487worker2 # [ 68.450275] nix-daemon[836]: reaped child process 987, status = succeeded4488client # copying 1 paths...4489worker1 # [ 68.462959] nix-grpc-daemon[775]: ts=2026-09-20T09:01:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:360024490worker1 # [ 68.480870] nix-grpc-daemon[775]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4491client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4492worker2 # [ 68.552148] nix-grpc-daemon[773]: ts=2026-09-20T09:01:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:458764493worker2 # [ 68.559215] nix-grpc-daemon[773]: ts=2026-09-20T09:01:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=0 paths=1 nar_bytes_out=1204494client # [ 68.605403] nix-daemon[940]: reaped child process 1022, status = succeeded4495client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.36 seconds)4496client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24497client # [ 68.841248] nix-daemon[940]: accepted connection from pid 1039, user root (trusted)4498client # this derivation will be built:4499client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4500worker1 # [ 69.095637] nix-grpc-daemon[775]: ts=2026-09-20T09:01:20Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:360024501client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4502worker1 # [ 69.106784] nix-grpc-daemon[775]: ts=2026-09-20T09:01:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360024503worker1 # [ 69.122011] nix-grpc-daemon[843]: time=2026-09-20T09:01:20.691Z level=INFO msg="All 1 paths already cached"4504worker2 # [ 69.165717] nix-grpc-daemon[773]: ts=2026-09-20T09:01:20Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04505worker2 # [ 69.173028] nix-grpc-daemon[773]: ts=2026-09-20T09:01:20Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14506worker1 # [ 69.159206] nix-grpc-daemon[775]: ts=2026-09-20T09:01:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360024507worker1 # [ 69.179938] nix-grpc-daemon[775]: ts=2026-09-20T09:01:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:360024508client # copying 1 paths to 'lb:50051'...4509client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4510worker1 # [ 69.206740] nix-grpc-daemon[775]: ts=2026-09-20T09:01:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:360024511worker1 # [ 69.227452] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4512worker1 # [ 69.257480] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 1/5)4513worker1 # [ 69.294201] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 2/5)4514worker1 # [ 69.383185] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 289 ms (attempt 3/5)4515worker1 # [ 69.681840] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 597 ms (attempt 4/5)4516worker1 # [ 70.291395] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4517worker1 # [ 70.299053] nix-grpc-daemon[775]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4518worker1 # [ 70.577749] nix-daemon[832]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4519worker1 # [ 70.600446] nix-daemon[832]: reaped child process 1151, status = succeeded4520worker1 # [ 70.797820] nix-daemon[832]: accepted connection from pid 1153, user nix-grpc-daemon (trusted)4521worker1 # [ 70.821610] nix-daemon[832]: reaped child process 1156, status = succeeded4522lb # [ 70.895319] niks3-server[1020]: 2026/09/20 09:01:22 INFO Received uploads request method=POST path=/api/pending_closures4523worker1 # [ 70.848821] nix-grpc-daemon[843]: time=2026-09-20T09:01:22.418Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4524worker1 # [ 70.850379] nix-grpc-daemon[843]: time=2026-09-20T09:01:22.418Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4525lb # [ 70.927261] niks3-server[1020]: 2026/09/20 09:01:22 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4526lb # [ 70.942844] niks3-server[1020]: 2026/09/20 09:01:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4527worker1 # [ 70.890608] nix-grpc-daemon[843]: time=2026-09-20T09:01:22.460Z level=INFO msg="Uploading 1 narinfos"4528lb # [ 70.951493] niks3-server[1020]: 2026/09/20 09:01:22 INFO Signed narinfos id=21 count=14529lb # [ 70.960263] niks3-server[1020]: 2026/09/20 09:01:22 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4530lb # [ 70.970198] niks3-server[1020]: 2026/09/20 09:01:22 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4531lb # [ 70.976762] niks3-server[1020]: 2026/09/20 09:01:22 INFO Completed upload id=214532worker1 # [ 70.918432] nix-grpc-daemon[843]: time=2026-09-20T09:01:22.488Z level=INFO msg="Upload complete. (582ms)"4533lb # [ 70.979434] niks3-server[1020]: 2026/09/20 09:01:22 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4534worker1 # [ 70.929001] nix-grpc-daemon[775]: ts=2026-09-20T09:01:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=1 paths=1 nar_bytes_in=5684535worker1 # [ 70.940512] nix-grpc-daemon[775]: ts=2026-09-20T09:01:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:360024536worker1 # [ 70.951529] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4537worker1 # [ 70.957633] nix-daemon[832]: reaped child process 1142, status = succeeded4538client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4539worker1 # [ 70.971058] nix-daemon[832]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4540client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4541lb # [ 71.276403] envoy[912]: conn peer=[2001:db8:1::1]:57300 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4326 tx=2223 ms=25394542lb # [ 71.281733] envoy[912]: conn peer=[2001:db8:1::1]:57304 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=304543lb # [ 71.287608] envoy[912]: conn peer=[2001:db8:1::1]:57324 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=294544lb # [ 71.293526] envoy[912]: conn peer=[2001:db8:1::1]:57310 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3863 tx=1900 ms=28024545worker1 # [ 72.019067] nix-daemon[832]: reaped child process 1160, status = succeeded4546worker1 # [ 72.200482] nix-daemon[832]: accepted connection from pid 1175, user nix-grpc-daemon (trusted)4547worker1 # [ 72.217940] nix-daemon[832]: reaped child process 1178, status = succeeded4548lb # [ 72.289336] niks3-server[1020]: 2026/09/20 09:01:23 INFO Received uploads request method=POST path=/api/pending_closures4549worker1 # [ 72.242543] nix-grpc-daemon[843]: time=2026-09-20T09:01:23.811Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4550lb # [ 72.320353] niks3-server[1020]: 2026/09/20 09:01:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4551worker1 # [ 72.271311] nix-grpc-daemon[843]: time=2026-09-20T09:01:23.841Z level=INFO msg="Uploading 1 narinfos"4552lb # [ 72.334867] niks3-server[1020]: 2026/09/20 09:01:23 INFO Signed narinfos id=22 count=14553lb # [ 72.341358] niks3-server[1020]: 2026/09/20 09:01:23 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4554worker1 # [ 72.296480] nix-grpc-daemon[843]: time=2026-09-20T09:01:23.867Z level=INFO msg="Upload complete. (313ms)"4555lb # [ 72.354617] niks3-server[1020]: 2026/09/20 09:01:23 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4556lb # [ 72.360623] niks3-server[1020]: 2026/09/20 09:01:23 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4557lb # [ 72.365788] niks3-server[1020]: 2026/09/20 09:01:23 INFO Completed upload id=224558worker1 # [ 72.305991] nix-grpc-daemon[775]: ts=2026-09-20T09:01:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36002 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14559client # copying 1 paths...4560lb # [ 72.369231] niks3-server[1020]: 2026/09/20 09:01:23 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4561worker1 # [ 72.321744] nix-daemon[832]: reaped child process 1158, status = succeeded4562worker2 # [ 72.337610] nix-grpc-daemon[773]: ts=2026-09-20T09:01:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:458764563worker2 # [ 72.354712] nix-grpc-daemon[773]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4564client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4565worker2 # [ 72.404135] nix-grpc-daemon[773]: ts=2026-09-20T09:01:23Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:458764566worker2 # [ 72.409623] nix-grpc-daemon[773]: ts=2026-09-20T09:01:23Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=0 paths=1 nar_bytes_out=1204567client # [ 72.500758] nix-daemon[940]: reaped child process 1042, status = succeeded4568client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.89 seconds)4569client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24570client # [ 72.722482] nix-daemon[940]: accepted connection from pid 1060, user root (trusted)4571client # this derivation will be built:4572client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4573worker2 # [ 72.962572] nix-grpc-daemon[773]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:458764574client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4575worker2 # [ 72.970591] nix-grpc-daemon[773]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:458764576worker2 # [ 72.978484] nix-grpc-daemon[889]: time=2026-09-20T09:01:24.546Z level=INFO msg="All 1 paths already cached"4577worker2 # [ 72.990756] nix-grpc-daemon[773]: ts=2026-09-20T09:01:24Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04578worker2 # [ 72.998603] nix-grpc-daemon[773]: ts=2026-09-20T09:01:24Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14579worker2 # [ 73.008237] nix-grpc-daemon[773]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:458764580worker2 # [ 73.019370] nix-grpc-daemon[773]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:458764581worker2 # [ 73.034139] nix-grpc-daemon[889]: time=2026-09-20T09:01:24.604Z level=INFO msg="All 1 paths already cached"4582client # copying 1 paths to 'lb:50051'...4583client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4584worker2 # [ 73.043935] nix-grpc-daemon[773]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:458764585worker2 # [ 73.060448] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4586worker2 # [ 73.262071] nix-daemon[836]: accepted connection from pid 1017, user nix-grpc-daemon (trusted)4587worker2 # [ 73.283601] nix-daemon[836]: reaped child process 1020, status = succeeded4588worker2 # [ 73.456904] nix-daemon[836]: accepted connection from pid 1022, user nix-grpc-daemon (trusted)4589worker2 # [ 73.478238] nix-daemon[836]: reaped child process 1025, status = succeeded4590lb # [ 73.529380] niks3-server[1020]: 2026/09/20 09:01:25 INFO Received uploads request method=POST path=/api/pending_closures4591worker2 # [ 73.501019] nix-grpc-daemon[889]: time=2026-09-20T09:01:25.071Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4592worker2 # [ 73.503612] nix-grpc-daemon[889]: time=2026-09-20T09:01:25.073Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4593lb # [ 73.561972] niks3-server[1020]: 2026/09/20 09:01:25 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4594worker2 # [ 73.536901] nix-grpc-daemon[889]: time=2026-09-20T09:01:25.106Z level=INFO msg="Uploading 1 narinfos"4595lb # [ 73.578723] niks3-server[1020]: 2026/09/20 09:01:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4596lb # [ 73.590002] niks3-server[1020]: 2026/09/20 09:01:25 INFO Signed narinfos id=23 count=14597worker2 # [ 73.561062] nix-grpc-daemon[889]: time=2026-09-20T09:01:25.131Z level=INFO msg="Upload complete. (483ms)"4598lb # [ 73.600321] niks3-server[1020]: 2026/09/20 09:01:25 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4599lb # [ 73.605937] niks3-server[1020]: 2026/09/20 09:01:25 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4600lb # [ 73.610771] niks3-server[1020]: 2026/09/20 09:01:25 INFO Completed upload id=234601lb # [ 73.612846] niks3-server[1020]: 2026/09/20 09:01:25 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4602worker2 # [ 73.567975] nix-grpc-daemon[773]: ts=2026-09-20T09:01:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=0 paths=1 nar_bytes_in=5684603worker2 # [ 73.577575] nix-grpc-daemon[773]: ts=2026-09-20T09:01:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:458764604worker2 # [ 73.589488] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4605worker2 # [ 73.594386] nix-daemon[836]: reaped child process 1015, status = succeeded4606worker2 # [ 73.606689] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4607client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4608client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4609worker2 # [ 75.041269] nix-daemon[836]: reaped child process 1029, status = succeeded4610worker2 # [ 75.210885] nix-daemon[836]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4611worker2 # [ 75.227699] nix-daemon[836]: reaped child process 1047, status = succeeded4612lb # [ 75.279283] niks3-server[1020]: 2026/09/20 09:01:26 INFO Received uploads request method=POST path=/api/pending_closures4613worker2 # [ 75.252426] nix-grpc-daemon[889]: time=2026-09-20T09:01:26.821Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4614lb # [ 75.310251] niks3-server[1020]: 2026/09/20 09:01:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4615worker2 # [ 75.281017] nix-grpc-daemon[889]: time=2026-09-20T09:01:26.850Z level=INFO msg="Uploading 1 narinfos"4616lb # [ 75.323484] niks3-server[1020]: 2026/09/20 09:01:26 INFO Signed narinfos id=24 count=14617lb # [ 75.330691] niks3-server[1020]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4618lb # [ 75.343911] niks3-server[1020]: 2026/09/20 09:01:26 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4619lb # [ 75.347945] niks3-server[1020]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4620lb # [ 75.352776] niks3-server[1020]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4621lb # [ 75.356509] niks3-server[1020]: 2026/09/20 09:01:26 INFO Completed upload id=244622worker2 # [ 75.317649] nix-grpc-daemon[889]: time=2026-09-20T09:01:26.887Z level=INFO msg="Upload complete. (297ms)"4623worker2 # [ 75.329220] nix-grpc-daemon[773]: ts=2026-09-20T09:01:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14624worker2 # [ 75.345130] nix-daemon[836]: reaped child process 1027, status = succeeded4625client # copying 1 paths...4626worker2 # [ 75.373861] nix-grpc-daemon[773]: ts=2026-09-20T09:01:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:458764627client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4628worker2 # [ 75.403411] nix-grpc-daemon[773]: ts=2026-09-20T09:01:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:458764629worker2 # [ 75.408660] nix-grpc-daemon[773]: ts=2026-09-20T09:01:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45876 duration_s=0 paths=1 nar_bytes_out=1204630client # [ 75.497914] nix-daemon[940]: reaped child process 1063, status = succeeded4631client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.99 seconds)4632(finished: subtest: an input only one worker has still reaches the builder, in 11.45 seconds)4633subtest: upload whose reference the worker lacks is completed from the cache4634client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4635client # this derivation will be built:4636client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4637client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4638client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds)4639client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4640client # this derivation will be built:4641client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4642client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4643client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds)4644client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4645client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4646worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4647worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4648worker2 # [ 76.950728] systemd[1]: Stopping Nix worker-protocol over gRPC...4649worker2 # [ 77.603766] nix-grpc-daemon[773]: ts=2026-09-20T09:01:29Z level=info event=signal_exit4650worker2 # [ 77.849107] nix-grpc-daemon[773]: ts=2026-09-20T09:01:29Z level=info event=scheduler_yield4651worker2 # [ 77.859270] nix-grpc-daemon[773]: ts=2026-09-20T09:01:29Z level=info event=scheduler_restarting addr=lb:500514652lb # [ 77.898965] niks3-server[1020]: 2026/09/20 09:01:29 INFO lead: released remote=192.168.1.4:367104653worker2 # [ 77.864883] nix-grpc-daemon[773]: ts=2026-09-20T09:01:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:531324654worker1 # [ 77.848788] nix-grpc-daemon[775]: ts=2026-09-20T09:01:29Z level=info event=scheduler_restarting addr=lb:500514655worker2 # [ 77.871269] nix-grpc-daemon[773]: ts=2026-09-20T09:01:29Z level=info event=worker_gone addr=192.168.1.4:500514656worker2 # [ 77.875444] nix-grpc-daemon[773]: ts=2026-09-20T09:01:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:531324657worker2 # [ 77.879951] nix-grpc-daemon[773]: ts=2026-09-20T09:01:29Z level=info event=worker_gone addr=192.168.1.3:500514658worker2 # [ 78.060577] nix-grpc-daemon[773]: ts=2026-09-20T09:01:29Z level=info event=scheduler_connected addr=lb:500514659worker1 # [ 78.048436] nix-grpc-daemon[775]: ts=2026-09-20T09:01:29Z level=info event=scheduler_connected addr=lb:500514660worker2 # [ 78.066061] nix-grpc-daemon[773]: ts=2026-09-20T09:01:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4661worker1 # [ 78.069451] nix-grpc-daemon[775]: ts=2026-09-20T09:01:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4662worker2 # [ 78.266879] nix-grpc-daemon[773]: ts=2026-09-20T09:01:29Z level=info event=scheduler_connected addr=lb:500514663worker2 # [ 78.272519] nix-grpc-daemon[773]: ts=2026-09-20T09:01:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4664worker1 # [ 78.270329] nix-grpc-daemon[775]: ts=2026-09-20T09:01:29Z level=info event=scheduler_connected addr=lb:500514665worker1 # [ 78.275649] nix-grpc-daemon[775]: ts=2026-09-20T09:01:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4666worker2 # [ 78.473184] nix-grpc-daemon[773]: ts=2026-09-20T09:01:30Z level=info event=scheduler_connected addr=lb:500514667worker2 # [ 78.478723] nix-grpc-daemon[773]: ts=2026-09-20T09:01:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4668worker1 # [ 78.476490] nix-grpc-daemon[775]: ts=2026-09-20T09:01:30Z level=info event=scheduler_connected addr=lb:500514669worker1 # [ 78.481687] nix-grpc-daemon[775]: ts=2026-09-20T09:01:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4670worker2 # [ 78.680751] nix-grpc-daemon[773]: ts=2026-09-20T09:01:30Z level=info event=scheduler_connected addr=lb:500514671worker2 # [ 78.685908] nix-grpc-daemon[773]: ts=2026-09-20T09:01:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4672worker1 # [ 78.682386] nix-grpc-daemon[775]: ts=2026-09-20T09:01:30Z level=info event=scheduler_connected addr=lb:500514673worker1 # [ 78.687786] nix-grpc-daemon[775]: ts=2026-09-20T09:01:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4674worker2 # [ 78.854421] nix-grpc-daemon[773]: ts=2026-09-20T09:01:30Z level=info event=scheduler_restarting4675worker2 # [ 78.910808] nix-daemon[836]: reaped child process 838, status = succeeded4676worker1 # [ 78.890438] nix-grpc-daemon[775]: ts=2026-09-20T09:01:30Z level=info event=scheduler_connected addr=lb:500514677worker2 # [ 78.913698] nix-grpc-daemon[773]: ts=2026-09-20T09:01:30Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4678worker1 # [ 78.895671] nix-grpc-daemon[775]: ts=2026-09-20T09:01:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4679worker1 # [ 79.096792] nix-grpc-daemon[775]: ts=2026-09-20T09:01:30Z level=info event=scheduler_connected addr=lb:500514680worker2 # [ 79.118027] nix-grpc-daemon[773]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4681worker2 # [ 79.122763] nix-grpc-daemon[773]: E0000 00:00:1789894890.687889 816 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true4682worker1 # [ 79.631715] nix-grpc-daemon[775]: ts=2026-09-20T09:01:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4683worker2 # [ 79.673002] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4684worker2 # [ 79.676008] systemd[1]: Stopped Nix worker-protocol over gRPC.4685worker2 # [ 79.683445] systemd[1]: nix-grpc-daemon.service: Consumed 1.912s CPU time over 58.422s wall clock time, 54.9M memory peak, 53.8K incoming IP traffic, 97.3K outgoing IP traffic.4686worker2 # [ 79.700632] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4687worker2 # [ 79.703648] systemd[1]: Closed Nix worker-protocol over gRPC.4688worker2 # [ 79.706385] systemd[1]: nix-grpc-daemon.socket: Consumed 694us CPU time over 1min 7.980s wall clock time, 256K memory peak, 94.9K incoming IP traffic, 83K outgoing IP traffic.4689lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4690lb: must succeed: curl -sf localhost:9901/clusters4691lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4692lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4693client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24694worker1 # [ 79.832822] nix-grpc-daemon[775]: ts=2026-09-20T09:01:31Z level=info event=scheduler_connected addr=lb:500514695worker1 # [ 79.839936] nix-grpc-daemon[775]: ts=2026-09-20T09:01:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4696worker1 # [ 80.044205] nix-grpc-daemon[775]: ts=2026-09-20T09:01:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:360024697client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4698worker1 # [ 80.051679] nix-grpc-daemon[775]: ts=2026-09-20T09:01:31Z level=info event=scheduler_connected addr=lb:500514699lb # [ 80.110293] niks3-server[1020]: 2026/09/20 09:01:31 INFO lead: acquired remote=192.168.1.3:360164700worker1 # [ 80.056065] nix-grpc-daemon[775]: ts=2026-09-20T09:01:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4701worker1 # [ 80.063593] nix-grpc-daemon[775]: ts=2026-09-20T09:01:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:360024702worker1 # [ 80.068901] nix-grpc-daemon[775]: ts=2026-09-20T09:01:31Z level=info event=scheduler_take_over4703client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.30 seconds)4704worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4705worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4706worker2 # [ 80.211116] systemd[1]: Listening on Nix worker-protocol over gRPC.4707worker1 # [ 80.245227] nix-grpc-daemon[775]: ts=2026-09-20T09:01:31Z level=info event=scheduler_connected addr=lb:500514708worker1 # [ 80.253538] nix-grpc-daemon[775]: ts=2026-09-20T09:01:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04709worker1 # [ 80.286757] systemd[1]: Stopping Nix worker-protocol over gRPC...4710worker1 # [ 80.604581] nix-grpc-daemon[775]: ts=2026-09-20T09:01:32Z level=info event=signal_exit4711worker2 # [ 80.775847] systemd[1]: Starting Nix worker-protocol over gRPC...4712worker1 # [ 80.840188] nix-grpc-daemon[775]: ts=2026-09-20T09:01:32Z level=info event=scheduler_yield4713lb # [ 80.898220] niks3-server[1020]: 2026/09/20 09:01:32 INFO lead: released remote=192.168.1.3:360164714worker1 # [ 80.845230] nix-grpc-daemon[775]: ts=2026-09-20T09:01:32Z level=info event=scheduler_restarting addr=lb:500514715worker1 # [ 80.854718] nix-grpc-daemon[775]: ts=2026-09-20T09:01:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:545124716worker1 # [ 80.859399] nix-grpc-daemon[775]: ts=2026-09-20T09:01:32Z level=info event=worker_gone addr=192.168.1.3:500514717worker2 # [ 80.974274] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:32Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4718worker2 # [ 80.976773] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:32Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14719worker2 # [ 80.984111] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:32Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4720worker2 # [ 80.994953] systemd[1]: Started Nix worker-protocol over gRPC.4721worker2 # [ 80.996766] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:32Z level=info event=scheduler_take_over4722lb # [ 81.035903] niks3-server[1020]: 2026/09/20 09:01:32 INFO lead: acquired remote=192.168.1.4:426404723worker2 # [ 81.028392] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:32Z level=info event=scheduler_connected addr=lb:500514724worker2 # [ 81.032106] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04725worker2 # [ 81.066072] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:32Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04726worker1 # [ 81.047117] nix-grpc-daemon[775]: ts=2026-09-20T09:01:32Z level=info event=scheduler_connected addr=lb:500514727lb # [ 81.276575] envoy[912]: conn peer=[2001:db8:1::1]:57336 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3700 tx=1917 ms=33494728lb # [ 81.281851] envoy[912]: conn peer=[2001:db8:1::1]:43520 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=654729lb # [ 81.287738] envoy[912]: conn peer=[2001:db8:1::1]:43532 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3726 tx=1779 ms=24984730lb # [ 81.292744] envoy[912]: conn peer=[2001:db8:1::1]:43540 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=634731lb # [ 81.297345] envoy[912]: conn peer=[2001:db8:1::4]:33858 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7091 tx=2042 ms=572604732lb # [ 81.302308] envoy[912]: conn peer=[2001:db8:1::1]:43552 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=284733worker1 # [ 81.845659] nix-grpc-daemon[775]: ts=2026-09-20T09:01:33Z level=info event=scheduler_restarting4734worker2 # [ 81.874617] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:383684735worker2 # [ 81.875007] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:33Z level=info event=worker_gone addr=192.168.1.3:500514736worker1 # [ 81.880700] nix-grpc-daemon[775]: ts=2026-09-20T09:01:33Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4737worker1 # [ 81.905185] nix-daemon[832]: reaped child process 834, status = succeeded4738worker1 # [ 82.704672] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4739worker1 # [ 82.705004] nix-grpc-daemon[775]: E0000 00:00:1789894894.273835 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4740worker1 # [ 82.732834] nix-grpc-daemon[775]: E0000 00:00:1789894894.303204 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4741worker1 # [ 83.569709] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4742worker1 # [ 83.575820] systemd[1]: Stopped Nix worker-protocol over gRPC.4743worker1 # [ 83.579488] systemd[1]: nix-grpc-daemon.service: Consumed 3.698s CPU time over 1min 2.341s wall clock time, 58.3M memory peak, 88.1K incoming IP traffic, 159.3K outgoing IP traffic.4744worker1 # [ 83.597215] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4745worker1 # [ 83.599257] systemd[1]: Closed Nix worker-protocol over gRPC.4746worker1 # [ 83.601410] systemd[1]: nix-grpc-daemon.socket: Consumed 586us CPU time over 1min 12.115s wall clock time, 256K memory peak, 98.8K incoming IP traffic, 78.9K outgoing IP traffic.4747lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4748lb: must succeed: curl -sf localhost:9901/clusters4749lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4750lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4751client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24752worker2 # [ 83.966288] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:383704753worker2 # [ 83.981912] nix-daemon[836]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4754worker2 # [ 84.012248] nix-grpc-daemon[1068]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 1/5)4755worker2 # [ 84.074162] nix-grpc-daemon[1068]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 2/5)4756worker2 # [ 84.116733] nix-grpc-daemon[1068]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 3/5)4757worker2 # [ 84.280230] nix-grpc-daemon[1068]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 366 ms (attempt 4/5)4758worker2 # [ 84.654646] nix-grpc-daemon[1068]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4759client # copying 2 paths...4760client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4761worker2 # [ 84.681057] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:383704762client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4763worker2 # [ 84.699469] nix-daemon[836]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4764worker2 # [ 84.729380] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:36Z level=info event=niks3_push_started pid=11244765worker2 # [ 85.123028] nix-daemon[836]: accepted connection from pid 1137, user nix-grpc-daemon (trusted)4766worker2 # [ 85.141641] nix-daemon[836]: reaped child process 1140, status = succeeded4767lb # [ 85.194014] niks3-server[1020]: 2026/09/20 09:01:36 INFO Received uploads request method=POST path=/api/pending_closures4768lb # [ 85.204831] niks3-server[1020]: 2026/09/20 09:01:36 INFO Received uploads request method=POST path=/api/pending_closures4769worker2 # [ 85.176498] nix-grpc-daemon[1124]: time=2026-09-20T09:01:36.744Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4770worker2 # [ 85.178061] nix-grpc-daemon[1124]: time=2026-09-20T09:01:36.745Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4771worker2 # [ 85.179791] nix-grpc-daemon[1124]: time=2026-09-20T09:01:36.745Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4772lb # [ 85.257258] niks3-server[1020]: 2026/09/20 09:01:36 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4773lb # [ 85.269320] niks3-server[1020]: 2026/09/20 09:01:36 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4774lb # [ 85.280940] niks3-server[1020]: 2026/09/20 09:01:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4775lb # [ 85.291489] niks3-server[1020]: 2026/09/20 09:01:36 INFO Signed narinfos id=25 count=14776lb # [ 85.299344] niks3-server[1020]: 2026/09/20 09:01:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4777lb # [ 85.316094] niks3-server[1020]: 2026/09/20 09:01:36 INFO Signed narinfos id=26 count=24778worker2 # [ 85.279633] nix-grpc-daemon[1124]: time=2026-09-20T09:01:36.847Z level=INFO msg="Uploading 3 narinfos"4779lb # [ 85.351308] niks3-server[1020]: 2026/09/20 09:01:36 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4780lb # [ 85.535600] niks3-server[1020]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4781lb # [ 85.545513] niks3-server[1020]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4782lb # [ 85.558448] niks3-server[1020]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4783lb # [ 85.573004] niks3-server[1020]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4784lb # [ 85.582790] niks3-server[1020]: 2026/09/20 09:01:37 INFO Completed upload id=264785lb # [ 85.586250] niks3-server[1020]: 2026/09/20 09:01:37 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4786lb # [ 85.592751] niks3-server[1020]: 2026/09/20 09:01:37 INFO Completed upload id=254787worker2 # [ 85.552937] nix-grpc-daemon[1124]: time=2026-09-20T09:01:37.122Z level=INFO msg="Upload complete. (606ms)"4788lb # [ 85.596570] niks3-server[1020]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4789worker2 # [ 85.565230] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38370 duration_s=0 paths=2 nar_bytes_in=3124790worker2 # [ 85.582286] nix-daemon[836]: reaped child process 1122, status = succeeded4791client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.89 seconds)4792worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4793worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4794worker1 # [ 85.706611] systemd[1]: Listening on Nix worker-protocol over gRPC.4795worker1 # [ 85.715603] systemd[1]: Starting Nix worker-protocol over gRPC...4796worker1 # [ 85.910815] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4797worker1 # [ 85.913273] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14798worker1 # [ 85.920981] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4799worker1 # [ 85.922769] systemd[1]: Started Nix worker-protocol over gRPC.4800lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4801lb: must succeed: curl -sf localhost:9901/clusters4802worker1 # [ 85.964510] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:37Z level=info event=scheduler_connected addr=lb:500514803worker2 # [ 85.986155] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:37Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04804lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4805lb: must succeed: curl -sf localhost:9901/clusters4806lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4807lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.16 seconds)4808(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.57 seconds)4809subtest: scheduler down: the other node takes the lock and keeps it4810lb: must succeed: curl -sf localhost:9901/clusters4811lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4812lb: must succeed: curl -sf localhost:9901/clusters4813lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4814lb: must succeed: curl -sf localhost:9901/clusters4815lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4816lb: must succeed: curl -sf localhost:9901/clusters4817lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4818worker2 # [ 87.390606] systemd[1]: Stopping Nix worker-protocol over gRPC...4819worker2 # [ 87.995174] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:39Z level=info event=signal_exit4820worker2 # [ 88.205628] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:39Z level=info event=scheduler_yield4821lb # [ 88.249380] niks3-server[1020]: 2026/09/20 09:01:39 INFO lead: released remote=192.168.1.4:426404822worker1 # [ 88.194677] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:39Z level=info event=scheduler_restarting addr=lb:500514823worker2 # [ 88.216357] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:383684824worker2 # [ 88.223942] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:39Z level=info event=worker_gone addr=192.168.1.3:500514825worker2 # [ 88.228009] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:39Z level=info event=scheduler_restarting addr=lb:500514826worker2 # [ 88.231925] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:383684827worker2 # [ 88.236451] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:39Z level=info event=worker_gone addr=192.168.1.4:500514828worker1 # [ 88.394845] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:39Z level=info event=scheduler_connected addr=lb:500514829worker2 # [ 88.423489] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:39Z level=info event=scheduler_connected addr=lb:500514830worker1 # [ 88.414120] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4831worker2 # [ 88.433710] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4832worker1 # [ 88.615154] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:40Z level=info event=scheduler_connected addr=lb:500514833worker2 # [ 88.634683] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:40Z level=info event=scheduler_connected addr=lb:500514834worker2 # [ 88.641086] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4835worker1 # [ 88.623059] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4836worker2 # [ 88.842130] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:40Z level=info event=scheduler_connected addr=lb:500514837worker1 # [ 88.824096] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:40Z level=info event=scheduler_connected addr=lb:500514838worker2 # [ 88.848857] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4839worker1 # [ 88.830338] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4840worker1 # [ 89.031419] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:40Z level=info event=scheduler_connected addr=lb:500514841worker2 # [ 89.051691] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:40Z level=info event=scheduler_connected addr=lb:500514842worker1 # [ 89.038242] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4843worker2 # [ 89.057034] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4844worker2 # [ 89.211014] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:40Z level=info event=scheduler_restarting4845worker2 # [ 89.240589] nix-daemon[836]: reaped child process 1117, status = succeeded4846worker1 # [ 89.240601] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:40Z level=info event=scheduler_connected addr=lb:500514847worker2 # [ 89.263604] nix-grpc-daemon[1068]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4848worker2 # [ 89.281228] nix-grpc-daemon[1068]: E0000 00:00:1789894900.833615 1111 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4849worker2 # [ 89.287771] nix-grpc-daemon[1068]: ts=2026-09-20T09:01:40Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4850worker2 # [ 90.018930] nix-grpc-daemon[1068]: E0000 00:00:1789894901.588709 1111 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4851worker2 # [ 90.019274] nix-grpc-daemon[1068]: E0000 00:00:1789894901.589047 1111 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4852lb # [ 90.992251] niks3-server[1020]: 2026/09/20 09:01:42 INFO lead: acquired remote=192.168.1.3:346864853worker1 # [ 90.934588] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:42Z level=info event=scheduler_take_over4854worker1 # [ 90.981929] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4855worker2 # [ 91.024886] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4856worker2 # [ 91.027831] systemd[1]: Stopped Nix worker-protocol over gRPC.4857worker2 # [ 91.034948] systemd[1]: nix-grpc-daemon.service: Consumed 495ms CPU time over 10.257s wall clock time, 33.1M memory peak, 18.1K incoming IP traffic, 22.7K outgoing IP traffic.4858worker2 # [ 91.048387] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4859worker2 # [ 91.050544] systemd[1]: Closed Nix worker-protocol over gRPC.4860worker2 # [ 91.052888] systemd[1]: nix-grpc-daemon.socket: Consumed 970us CPU time over 10.848s wall clock time, 256K memory peak, 26.5K incoming IP traffic, 21K outgoing IP traffic.4861worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4862worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.08 seconds)4863worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4864worker1 # [ 91.182775] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:42Z level=info event=scheduler_connected addr=lb:500514865worker1 # [ 91.188624] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:42Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04866worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)4867client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24868lb # [ 91.281648] envoy[912]: conn peer=[2001:db8:1::3]:47204 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9006 tx=2714 ms=602594869lb # [ 91.287699] envoy[912]: conn peer=[2001:db8:1::1]:34660 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1009 tx=305 ms=16174870lb # [ 91.294946] envoy[912]: conn peer=[2001:db8:1::4]:60536 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1003 tx=362 ms=82394871worker1 # [ 91.440999] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:600724872worker1 # [ 91.454425] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4873client # don't know how to build these paths:4874client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4875worker1 # [ 91.475271] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600724876worker1 # [ 91.492131] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5)4877worker1 # [ 91.581372] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 162 ms (attempt 2/5)4878worker1 # [ 91.751076] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 327 ms (attempt 3/5)4879worker1 # [ 92.086937] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 497 ms (attempt 4/5)4880worker1 # [ 92.592641] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4881worker1 # [ 92.625018] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:44Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04882worker1 # [ 92.631904] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:44Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14883worker1 # [ 92.670840] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600724884worker1 # [ 92.685515] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600724885client # copying 1 paths to 'lb:50051'...4886client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4887worker1 # [ 92.699611] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600724888worker1 # [ 92.714945] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4889worker1 # [ 92.740640] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:44Z level=info event=niks3_push_started pid=12704890worker1 # [ 93.128955] nix-daemon[832]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)4891worker1 # [ 93.146322] nix-daemon[832]: reaped child process 1286, status = succeeded4892worker1 # [ 93.318551] nix-daemon[832]: accepted connection from pid 1288, user nix-grpc-daemon (trusted)4893worker1 # [ 93.334430] nix-daemon[832]: reaped child process 1291, status = succeeded4894lb # [ 93.405397] niks3-server[1020]: 2026/09/20 09:01:44 INFO Received uploads request method=POST path=/api/pending_closures4895worker1 # [ 93.356414] nix-grpc-daemon[1270]: time=2026-09-20T09:01:44.926Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4896worker1 # [ 93.357892] nix-grpc-daemon[1270]: time=2026-09-20T09:01:44.926Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4897lb # [ 93.448881] niks3-server[1020]: 2026/09/20 09:01:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4898lb # [ 93.464203] niks3-server[1020]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4899lb # [ 93.470476] niks3-server[1020]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4900lb # [ 93.484209] niks3-server[1020]: 2026/09/20 09:01:45 INFO Signed narinfos id=27 count=14901worker1 # [ 93.426847] nix-grpc-daemon[1270]: time=2026-09-20T09:01:44.996Z level=INFO msg="Uploading 1 narinfos"4902lb # [ 93.499060] niks3-server[1020]: 2026/09/20 09:01:45 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4903worker1 # [ 93.449348] nix-grpc-daemon[1270]: time=2026-09-20T09:01:45.019Z level=INFO msg="Upload complete. (490ms)"4904lb # [ 93.510158] niks3-server[1020]: 2026/09/20 09:01:45 INFO Completed upload id=274905worker1 # [ 93.459915] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60072 duration_s=0 paths=1 nar_bytes_in=5204906lb # [ 93.520397] niks3-server[1020]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4907worker1 # [ 93.476597] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600724908worker1 # [ 93.483919] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4909worker1 # [ 93.489790] nix-daemon[832]: reaped child process 1268, status = succeeded4910client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4911client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4912worker1 # [ 93.504615] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4913client # farm-a> LOG-farm-a-on-standby4914worker1 # [ 94.336120] nix-daemon[832]: reaped child process 1295, status = succeeded4915worker1 # [ 94.501194] nix-daemon[832]: accepted connection from pid 1310, user nix-grpc-daemon (trusted)4916worker1 # [ 94.520343] nix-daemon[832]: reaped child process 1313, status = succeeded4917lb # [ 94.590692] niks3-server[1020]: 2026/09/20 09:01:46 INFO Received uploads request method=POST path=/api/pending_closures4918worker1 # [ 94.547683] nix-grpc-daemon[1270]: time=2026-09-20T09:01:46.115Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4919worker1 # [ 94.550685] nix-grpc-daemon[1270]: time=2026-09-20T09:01:46.115Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4920lb # [ 94.636869] niks3-server[1020]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4921lb # [ 94.647787] niks3-server[1020]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4922lb # [ 94.657160] niks3-server[1020]: 2026/09/20 09:01:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4923worker1 # [ 94.606492] nix-grpc-daemon[1270]: time=2026-09-20T09:01:46.175Z level=INFO msg="Uploading 1 narinfos"4924lb # [ 94.663080] niks3-server[1020]: 2026/09/20 09:01:46 INFO Signed narinfos id=28 count=14925lb # [ 94.669359] niks3-server[1020]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4926lb # [ 94.678894] niks3-server[1020]: 2026/09/20 09:01:46 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4927lb # [ 94.688377] niks3-server[1020]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4928lb # [ 94.693392] niks3-server[1020]: 2026/09/20 09:01:46 INFO Completed upload id=284929worker1 # [ 94.635825] nix-grpc-daemon[1270]: time=2026-09-20T09:01:46.206Z level=INFO msg="Upload complete. (319ms)"4930worker1 # [ 94.657380] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60072 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14931worker1 # [ 94.672326] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:46Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04932worker1 # [ 94.675461] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:46Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14933worker1 # [ 94.679690] nix-daemon[832]: reaped child process 1293, status = succeeded4934worker1 # [ 94.702600] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600724935worker1 # [ 94.717414] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600724936worker1 # [ 94.732403] nix-grpc-daemon[1270]: time=2026-09-20T09:01:46.302Z level=INFO msg="All 1 paths already cached"4937client # copying 1 paths to 'lb:50051'...4938client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4939worker1 # [ 94.742581] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600724940worker1 # [ 94.756310] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4941worker1 # [ 94.966440] nix-daemon[832]: accepted connection from pid 1319, user nix-grpc-daemon (trusted)4942worker1 # [ 94.983637] nix-daemon[832]: reaped child process 1322, status = succeeded4943worker1 # [ 95.158235] nix-daemon[832]: accepted connection from pid 1324, user nix-grpc-daemon (trusted)4944worker1 # [ 95.174645] nix-daemon[832]: reaped child process 1327, status = succeeded4945lb # [ 95.243573] niks3-server[1020]: 2026/09/20 09:01:46 INFO Received uploads request method=POST path=/api/pending_closures4946worker1 # [ 95.195462] nix-grpc-daemon[1270]: time=2026-09-20T09:01:46.765Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4947worker1 # [ 95.197246] nix-grpc-daemon[1270]: time=2026-09-20T09:01:46.765Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4948lb # [ 95.270590] niks3-server[1020]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4949lb # [ 95.284793] niks3-server[1020]: 2026/09/20 09:01:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4950worker1 # [ 95.233434] nix-grpc-daemon[1270]: time=2026-09-20T09:01:46.803Z level=INFO msg="Uploading 1 narinfos"4951lb # [ 95.297840] niks3-server[1020]: 2026/09/20 09:01:46 INFO Signed narinfos id=29 count=14952lb # [ 95.303267] niks3-server[1020]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4953lb # [ 95.311605] niks3-server[1020]: 2026/09/20 09:01:46 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4954lb # [ 95.316698] niks3-server[1020]: 2026/09/20 09:01:46 INFO Completed upload id=294955worker1 # [ 95.258398] nix-grpc-daemon[1270]: time=2026-09-20T09:01:46.828Z level=INFO msg="Upload complete. (485ms)"4956lb # [ 95.319679] niks3-server[1020]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4957worker1 # [ 95.268221] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60072 duration_s=0 paths=1 nar_bytes_in=6404958worker1 # [ 95.278486] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600724959worker1 # [ 95.287086] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4960worker1 # [ 95.289886] nix-daemon[832]: reaped child process 1317, status = succeeded4961client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4962client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4963worker1 # [ 95.302682] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4964client # farm-b> LOG-farm-b-on-standby4965worker1 # [ 96.928580] nix-daemon[832]: reaped child process 1331, status = succeeded4966worker1 # [ 97.089432] nix-daemon[832]: accepted connection from pid 1346, user nix-grpc-daemon (trusted)4967worker1 # [ 97.106050] nix-daemon[832]: reaped child process 1349, status = succeeded4968lb # [ 97.177940] niks3-server[1020]: 2026/09/20 09:01:48 INFO Received uploads request method=POST path=/api/pending_closures4969worker1 # [ 97.128336] nix-grpc-daemon[1270]: time=2026-09-20T09:01:48.698Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4970worker1 # [ 97.130001] nix-grpc-daemon[1270]: time=2026-09-20T09:01:48.698Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4971worker1 # [ 97.169177] nix-grpc-daemon[1270]: time=2026-09-20T09:01:48.739Z level=INFO msg="Uploading 1 narinfos"4972lb # [ 97.213079] niks3-server[1020]: 2026/09/20 09:01:48 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4973lb # [ 97.230373] niks3-server[1020]: 2026/09/20 09:01:48 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4974lb # [ 97.238915] niks3-server[1020]: 2026/09/20 09:01:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4975lb # [ 97.243749] niks3-server[1020]: 2026/09/20 09:01:48 INFO Signed narinfos id=30 count=14976lb # [ 97.249532] niks3-server[1020]: 2026/09/20 09:01:48 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4977worker1 # [ 97.195896] nix-grpc-daemon[1270]: time=2026-09-20T09:01:48.766Z level=INFO msg="Upload complete. (282ms)"4978lb # [ 97.253734] niks3-server[1020]: 2026/09/20 09:01:48 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4979lb # [ 97.257572] niks3-server[1020]: 2026/09/20 09:01:48 INFO Completed upload id=304980lb # [ 97.260613] niks3-server[1020]: 2026/09/20 09:01:48 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4981worker1 # [ 97.204837] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60072 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14982worker1 # [ 97.221220] nix-daemon[832]: reaped child process 1329, status = succeeded4983worker1 # [ 97.225581] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:48Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04984worker1 # [ 97.229990] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:48Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=14985worker1 # [ 97.270166] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600724986worker1 # [ 97.285577] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600724987worker1 # [ 97.299183] nix-grpc-daemon[1270]: time=2026-09-20T09:01:48.869Z level=INFO msg="All 2 paths already cached"4988client # copying 1 paths to 'lb:50051'...4989client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4990worker1 # [ 97.309443] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600724991worker1 # [ 97.322770] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4992worker1 # [ 97.517173] nix-daemon[832]: accepted connection from pid 1355, user nix-grpc-daemon (trusted)4993worker1 # [ 97.534324] nix-daemon[832]: reaped child process 1358, status = succeeded4994worker1 # [ 97.704655] nix-daemon[832]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)4995worker1 # [ 97.721015] nix-daemon[832]: reaped child process 1363, status = succeeded4996lb # [ 97.792404] niks3-server[1020]: 2026/09/20 09:01:49 INFO Received uploads request method=POST path=/api/pending_closures4997worker1 # [ 97.745964] nix-grpc-daemon[1270]: time=2026-09-20T09:01:49.316Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4998worker1 # [ 97.747444] nix-grpc-daemon[1270]: time=2026-09-20T09:01:49.316Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4999lb # [ 97.825228] niks3-server[1020]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5000worker1 # [ 97.781836] nix-grpc-daemon[1270]: time=2026-09-20T09:01:49.352Z level=INFO msg="Uploading 1 narinfos"5001lb # [ 97.841111] niks3-server[1020]: 2026/09/20 09:01:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5002lb # [ 97.852179] niks3-server[1020]: 2026/09/20 09:01:49 INFO Signed narinfos id=31 count=15003lb # [ 97.857168] niks3-server[1020]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5004lb # [ 97.863250] niks3-server[1020]: 2026/09/20 09:01:49 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5005lb # [ 97.869999] niks3-server[1020]: 2026/09/20 09:01:49 INFO Completed upload id=315006worker1 # [ 97.812368] nix-grpc-daemon[1270]: time=2026-09-20T09:01:49.382Z level=INFO msg="Upload complete. (474ms)"5007lb # [ 97.872391] niks3-server[1020]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5008worker1 # [ 97.821020] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60072 duration_s=0 paths=1 nar_bytes_in=7685009worker1 # [ 97.834394] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600725010worker1 # [ 97.838473] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5011worker1 # [ 97.843621] nix-daemon[832]: reaped child process 1353, status = succeeded5012client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5013worker1 # [ 97.854678] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5014client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5015client # farm-top> LOG-farm-top-on-standby5016worker1 # [ 98.697434] nix-daemon[832]: reaped child process 1367, status = succeeded5017worker1 # [ 98.885200] nix-daemon[832]: accepted connection from pid 1382, user nix-grpc-daemon (trusted)5018worker1 # [ 98.902550] nix-daemon[832]: reaped child process 1385, status = succeeded5019lb # [ 98.974160] niks3-server[1020]: 2026/09/20 09:01:50 INFO Received uploads request method=POST path=/api/pending_closures5020worker1 # [ 98.930605] nix-grpc-daemon[1270]: time=2026-09-20T09:01:50.499Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5021worker1 # [ 98.932889] nix-grpc-daemon[1270]: time=2026-09-20T09:01:50.499Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5022lb # [ 99.007768] niks3-server[1020]: 2026/09/20 09:01:50 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5023lb # [ 99.021583] niks3-server[1020]: 2026/09/20 09:01:50 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5024worker1 # [ 98.981648] nix-grpc-daemon[1270]: time=2026-09-20T09:01:50.551Z level=INFO msg="Uploading 1 narinfos"5025lb # [ 99.033972] niks3-server[1020]: 2026/09/20 09:01:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5026lb # [ 99.044276] niks3-server[1020]: 2026/09/20 09:01:50 INFO Signed narinfos id=32 count=15027lb # [ 99.049928] niks3-server[1020]: 2026/09/20 09:01:50 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5028lb # [ 99.056330] niks3-server[1020]: 2026/09/20 09:01:50 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5029lb # [ 99.064673] niks3-server[1020]: 2026/09/20 09:01:50 INFO Completed upload id=325030worker1 # [ 99.006996] nix-grpc-daemon[1270]: time=2026-09-20T09:01:50.577Z level=INFO msg="Upload complete. (343ms)"5031lb # [ 99.067964] niks3-server[1020]: 2026/09/20 09:01:50 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5032worker1 # [ 99.021195] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60072 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15033worker1 # [ 99.037703] nix-daemon[832]: reaped child process 1365, status = succeeded5034client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.88 seconds)5035client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5036client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5037worker2 # [ 99.414654] systemd[1]: Listening on Nix worker-protocol over gRPC.5038worker2 # [ 99.424280] systemd[1]: Starting Nix worker-protocol over gRPC...5039worker2 # [ 99.614724] nix-grpc-daemon[1161]: ts=2026-09-20T09:01:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5040worker2 # [ 99.617120] nix-grpc-daemon[1161]: ts=2026-09-20T09:01:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15041worker2 # [ 99.624508] nix-grpc-daemon[1161]: ts=2026-09-20T09:01:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5042worker2 # [ 99.626220] systemd[1]: Started Nix worker-protocol over gRPC.5043lb: must succeed: curl -sf localhost:9901/clusters5044worker2 # [ 99.667407] nix-grpc-daemon[1161]: ts=2026-09-20T09:01:51Z level=info event=scheduler_connected addr=lb:500515045worker1 # [ 99.650964] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05046lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5047worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5048worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5049lb: must succeed: curl -sf localhost:9901/clusters5050lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5051lb: must succeed: curl -sf localhost:9901/clusters5052lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5053worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5054worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5055(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.92 seconds)5056subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5057client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5058client # [ 100.068219] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5059client # Running as unit: rs.service; invocation ID: de7c021e20a4456ca29ee80ec4ec0a5d5060client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5061worker1 # [ 100.325161] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:600725062client # [ 100.312402] nix[1162]: don't know how to build these paths:5063client # [ 100.313421] nix[1162]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5064worker1 # [ 100.344144] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:51Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05065worker1 # [ 100.351272] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:51Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15066worker1 # [ 100.389724] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600725067worker1 # [ 100.405696] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600725068client # [ 100.397303] nix[1162]: copying 1 paths to 'lb:50051'...5069client # [ 100.401762] nix[1162]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5070worker1 # [ 100.422823] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600725071worker1 # [ 100.438045] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5072worker1 # [ 100.638331] nix-daemon[832]: accepted connection from pid 1400, user nix-grpc-daemon (trusted)5073worker1 # [ 100.657326] nix-daemon[832]: reaped child process 1403, status = succeeded5074worker1 # [ 100.834047] nix-daemon[832]: accepted connection from pid 1405, user nix-grpc-daemon (trusted)5075worker1 # [ 100.851214] nix-daemon[832]: reaped child process 1408, status = succeeded5076lb # [ 100.921553] niks3-server[1020]: 2026/09/20 09:01:52 INFO Received uploads request method=POST path=/api/pending_closures5077worker1 # [ 100.873622] nix-grpc-daemon[1270]: time=2026-09-20T09:01:52.443Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5078worker1 # [ 100.875149] nix-grpc-daemon[1270]: time=2026-09-20T09:01:52.443Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5079lb # [ 100.953543] niks3-server[1020]: 2026/09/20 09:01:52 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5080worker1 # [ 100.904490] nix-grpc-daemon[1270]: time=2026-09-20T09:01:52.474Z level=INFO msg="Uploading 1 narinfos"5081lb # [ 100.966739] niks3-server[1020]: 2026/09/20 09:01:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5082lb # [ 100.977404] niks3-server[1020]: 2026/09/20 09:01:52 INFO Signed narinfos id=33 count=15083lb # [ 100.980866] niks3-server[1020]: 2026/09/20 09:01:52 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5084lb # [ 100.990130] niks3-server[1020]: 2026/09/20 09:01:52 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5085lb # [ 100.995331] niks3-server[1020]: 2026/09/20 09:01:52 INFO Completed upload id=335086worker1 # [ 100.937643] nix-grpc-daemon[1270]: time=2026-09-20T09:01:52.508Z level=INFO msg="Upload complete. (483ms)"5087lb # [ 100.998540] niks3-server[1020]: 2026/09/20 09:01:52 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5088worker1 # [ 100.944537] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60072 duration_s=0 paths=1 nar_bytes_in=4165089worker1 # [ 100.959551] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600725090worker1 # [ 100.966029] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5091worker1 # [ 100.970645] nix-daemon[832]: reaped child process 1398, status = succeeded5092worker1 # [ 100.982359] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5093client # [ 100.960632] nix[1162]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5094lb # [ 101.278483] envoy[912]: conn peer=[2001:db8:1::1]:51692 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9593 tx=3868 ms=75995095lb: must succeed: curl -sf localhost:9901/clusters5096lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5097lb: must succeed: curl -sf localhost:9901/clusters5098lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5099lb: must succeed: curl -sf localhost:9901/clusters5100lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5101lb: must succeed: curl -sf localhost:9901/clusters5102lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5103worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5104worker2 # [ 103.057817] systemd-journald[274]: Received client request to rotate journal, rotating.5105worker2 # [ 103.076530] systemd-journald[274]: Vacuuming done, freed 0B of archived journals from /var/log/journal/9f63c6a1da4c47ab8a846d3cfec5dd3d.5106worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5107worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5108worker1 # [ 103.110093] systemd[1]: Stopping Nix worker-protocol over gRPC...5109worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5110??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5111 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735112client: must succeed: sleep 5.05113worker1 # [ 103.935830] nix-grpc-daemon[1201]: ts=2026-09-20T09:01:55Z level=info event=draining5114client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5115worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5116worker1 # [ 108.633753] nix-daemon[832]: reaped child process 1412, status = succeeded5117worker1 # [ 108.870677] nix-daemon[832]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)5118worker1 # [ 108.897643] nix-daemon[832]: reaped child process 1455, status = succeeded5119lb # [ 108.977594] niks3-server[1020]: 2026/09/20 09:02:00 INFO Received uploads request method=POST path=/api/pending_closures5120worker1 # [ 108.936274] nix-grpc-daemon[1270]: time=2026-09-20T09:02:00.506Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5121worker1 # [ 108.943379] nix-grpc-daemon[1270]: time=2026-09-20T09:02:00.509Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5122lb # [ 109.059004] niks3-server[1020]: 2026/09/20 09:02:00 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5123lb # [ 109.069910] niks3-server[1020]: 2026/09/20 09:02:00 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5124worker1 # [ 109.030779] nix-grpc-daemon[1270]: time=2026-09-20T09:02:00.600Z level=INFO msg="Uploading 1 narinfos"5125lb # [ 109.080998] niks3-server[1020]: 2026/09/20 09:02:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5126lb # [ 109.093802] niks3-server[1020]: 2026/09/20 09:02:00 INFO Signed narinfos id=34 count=15127lb # [ 109.100464] niks3-server[1020]: 2026/09/20 09:02:00 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5128lb # [ 109.112787] niks3-server[1020]: 2026/09/20 09:02:00 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5129lb # [ 109.122444] niks3-server[1020]: 2026/09/20 09:02:00 INFO Completed upload id=345130worker1 # [ 109.063064] nix-grpc-daemon[1270]: time=2026-09-20T09:02:00.633Z level=INFO msg="Upload complete. (457ms)"5131lb # [ 109.125117] niks3-server[1020]: 2026/09/20 09:02:00 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5132worker1 # [ 109.086038] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60072 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15133worker1 # [ 109.111682] nix-daemon[832]: reaped child process 1410, status = succeeded5134client # [ 109.133944] systemd[1]: rs.service: Deactivated successfully.5135client # [ 109.141506] systemd[1]: rs.service: Consumed 183ms CPU time over 9.067s wall clock time, 39M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5136worker1 # [ 109.939362] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:01Z level=info event=signal_exit5137worker1 # [ 110.161217] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:01Z level=info event=scheduler_yield5138lb # [ 110.221405] niks3-server[1020]: 2026/09/20 09:02:01 INFO lead: released remote=192.168.1.3:346865139worker2 # [ 110.186849] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:01Z level=info event=scheduler_restarting addr=lb:500515140worker1 # [ 110.172097] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:590405141worker1 # [ 110.178383] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:01Z level=info event=worker_gone addr=192.168.1.4:500515142worker1 # [ 110.183851] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:01Z level=info event=scheduler_restarting addr=lb:500515143worker1 # [ 110.187941] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:590405144worker1 # [ 110.192377] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:01Z level=info event=worker_gone addr=192.168.1.3:500515145worker2 # [ 110.386844] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:01Z level=info event=scheduler_connected addr=lb:500515146worker2 # [ 110.392797] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5147worker1 # [ 110.379521] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:01Z level=info event=scheduler_connected addr=lb:500515148worker1 # [ 110.386164] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5149worker2 # [ 110.593530] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:02Z level=info event=scheduler_connected addr=lb:500515150worker2 # [ 110.599016] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5151worker1 # [ 110.587054] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:02Z level=info event=scheduler_connected addr=lb:500515152worker1 # [ 110.593571] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5153worker2 # [ 110.800334] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:02Z level=info event=scheduler_connected addr=lb:500515154worker1 # [ 110.794618] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:02Z level=info event=scheduler_connected addr=lb:500515155worker2 # [ 110.816998] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5156worker1 # [ 110.816583] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5157worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.24 seconds)5158client: waiting for success: ! systemctl is-active rs5159client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5160client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5161client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5162client: must fail: journalctl -u rs | grep -q 'reconnecting'5163worker2 # [ 111.017479] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:02Z level=info event=scheduler_connected addr=lb:500515164worker2 # [ 111.024944] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5165client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5166lb: must succeed: curl -sf localhost:9901/clusters5167worker1 # [ 111.017575] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:02Z level=info event=scheduler_connected addr=lb:500515168worker1 # [ 111.025446] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5169lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5170worker1 # [ 111.171717] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:02Z level=info event=scheduler_restarting5171worker1 # [ 111.201493] nix-daemon[832]: reaped child process 1261, status = succeeded5172worker2 # [ 111.229389] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:02Z level=info event=scheduler_connected addr=lb:500515173worker2 # [ 111.233664] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5174lb # [ 111.279447] envoy[912]: conn peer=[2001:db8:1::1]:51704 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1349 ms=87745175worker1 # [ 111.249808] nix-grpc-daemon[1201]: ts=2026-09-20T09:02:02Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5176worker2 # [ 111.430257] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:03Z level=info event=scheduler_connected addr=lb:500515177worker1 # [ 111.413591] nix-grpc-daemon[1201]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5178worker1 # [ 111.418330] nix-grpc-daemon[1201]: E0000 00:00:1789894922.983854 1244 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5179worker1 # [ 111.604245] nix-grpc-daemon[1201]: E0000 00:00:1789894923.174557 1244 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5180worker1 # [ 111.613120] nix-grpc-daemon[1201]: E0000 00:00:1789894923.183618 1244 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5181worker2 # [ 111.830529] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:03Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5182worker1 # [ 111.832841] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5183worker1 # [ 111.840201] systemd[1]: Stopped Nix worker-protocol over gRPC.5184worker1 # [ 111.842853] systemd[1]: nix-grpc-daemon.service: Consumed 1.844s CPU time over 26.116s wall clock time, 36.9M memory peak, 44.7K incoming IP traffic, 82.2K outgoing IP traffic.5185worker1 # [ 111.862291] systemd[1]: Starting Nix worker-protocol over gRPC...5186worker2 # [ 112.031562] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:03Z level=info event=scheduler_connected addr=lb:500515187worker2 # [ 112.038767] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5188worker1 # [ 112.073597] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5189worker1 # [ 112.076199] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15190worker1 # [ 112.084063] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5191worker1 # [ 112.085835] systemd[1]: Started Nix worker-protocol over gRPC.5192worker1 # [ 112.093458] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:03Z level=info event=scheduler_take_over5193lb # [ 112.152643] niks3-server[1020]: 2026/09/20 09:02:03 INFO lead: acquired remote=192.168.1.3:575525194lb: must succeed: curl -sf localhost:9901/clusters5195worker1 # [ 112.125743] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:03Z level=info event=scheduler_connected addr=lb:500515196worker1 # [ 112.143243] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05197lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5198worker2 # [ 112.242851] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:03Z level=info event=scheduler_connected addr=lb:500515199worker2 # [ 112.247125] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5200worker2 # [ 112.443825] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:04Z level=info event=scheduler_connected addr=lb:500515201worker1 # [ 112.427093] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05202lb: must succeed: curl -sf localhost:9901/clusters5203lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5204worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5205worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5206(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.34 seconds)5207subtest: scheduler restart mid-build: build finishes, no double build5208client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5209client # [ 113.414079] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5210client # Running as unit: mid.service; invocation ID: e72312f0cf5f42db81c326a85ea97ffe5211client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5212worker1 # [ 113.691099] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:511405213worker1 # [ 113.705896] nix-daemon[832]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5214client # [ 113.703139] nix[1196]: don't know how to build these paths:5215client # [ 113.704779] nix[1196]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5216worker1 # [ 113.736086] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:05Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05217worker1 # [ 113.742740] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:05Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15218worker1 # [ 113.790910] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511405219worker1 # [ 113.812523] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)5220worker1 # [ 113.857156] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 2/5)5221worker1 # [ 113.930908] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 282 ms (attempt 3/5)5222worker1 # [ 114.220647] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 4/5)5223worker1 # [ 114.318710] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5224worker1 # [ 114.339723] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511405225client # [ 114.332121] nix[1196]: copying 1 paths to 'lb:50051'...5226client # [ 114.338223] nix[1196]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5227worker1 # [ 114.357693] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511405228worker1 # [ 114.373323] nix-daemon[832]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5229worker1 # [ 114.401823] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:05Z level=info event=niks3_push_started pid=15295230worker1 # [ 114.798856] nix-daemon[832]: accepted connection from pid 1545, user nix-grpc-daemon (trusted)5231worker1 # [ 114.815726] nix-daemon[832]: reaped child process 1549, status = succeeded5232worker1 # [ 114.989833] nix-daemon[832]: accepted connection from pid 1551, user nix-grpc-daemon (trusted)5233worker1 # [ 115.006284] nix-daemon[832]: reaped child process 1554, status = succeeded5234lb # [ 115.077817] niks3-server[1020]: 2026/09/20 09:02:06 INFO Received uploads request method=POST path=/api/pending_closures5235worker1 # [ 115.028400] nix-grpc-daemon[1529]: time=2026-09-20T09:02:06.598Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5236worker1 # [ 115.029892] nix-grpc-daemon[1529]: time=2026-09-20T09:02:06.598Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5237lb # [ 115.112585] niks3-server[1020]: 2026/09/20 09:02:06 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5238lb # [ 115.123703] niks3-server[1020]: 2026/09/20 09:02:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5239worker1 # [ 115.073416] nix-grpc-daemon[1529]: time=2026-09-20T09:02:06.643Z level=INFO msg="Uploading 1 narinfos"5240lb # [ 115.134936] niks3-server[1020]: 2026/09/20 09:02:06 INFO Signed narinfos id=35 count=15241lb # [ 115.146973] niks3-server[1020]: 2026/09/20 09:02:06 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5242lb # [ 115.157545] niks3-server[1020]: 2026/09/20 09:02:06 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5243lb # [ 115.167131] niks3-server[1020]: 2026/09/20 09:02:06 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5244lb # [ 115.173583] niks3-server[1020]: 2026/09/20 09:02:06 INFO Completed upload id=355245worker1 # [ 115.116070] nix-grpc-daemon[1529]: time=2026-09-20T09:02:06.686Z level=INFO msg="Upload complete. (499ms)"5246worker1 # [ 115.128786] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51140 duration_s=0 paths=1 nar_bytes_in=4245247worker1 # [ 115.141848] nix-grpc-daemon[1462]: ts=2026-09-20T09:02:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511405248worker1 # [ 115.147974] nix-daemon[832]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5249worker1 # [ 115.153124] nix-daemon[832]: reaped child process 1527, status = succeeded5250client # [ 115.143705] nix[1196]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5251worker1 # [ 115.166812] nix-daemon[832]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5252lb: must succeed: curl -sf localhost:9901/clusters5253lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5254lb: must succeed: curl -sf localhost:9901/clusters5255lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5256worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5257worker1 # [ 117.402158] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1462 (nix-grpc-daemon) on client request.5258worker1 # [ 117.404953] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5259lb # [ 117.465272] niks3-server[1020]: 2026/09/20 09:02:09 INFO lead: released remote=192.168.1.3:575525260client # [ 117.385453] nix[1196]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5261worker2 # [ 117.424357] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:08Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5262client # [ 117.392391] nix[1196]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5263worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5264client: must succeed: sleep 5.05265worker1 # [ 117.439947] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5266worker1 # [ 117.448539] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5267worker1 # [ 117.450038] systemd[1]: nix-grpc-daemon.service: Consumed 518ms CPU time over 5.575s wall clock time, 34M memory peak, 11.6K incoming IP traffic, 14.6K outgoing IP traffic.5268worker1 # [ 117.457051] nix-daemon[832]: reaped child process 1520, status = succeeded5269worker1 # [ 117.458146] nix-daemon[832]: reaped child process 1556, status = succeeded5270worker1 # [ 117.464607] nix-daemon[1558]: unexpected Nix daemon error: error: interrupted by the user5271worker1 # [ 117.471542] nix-daemon[832]: reaped child process 1558, status = failed with exit code 15272worker2 # [ 117.624475] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:09Z level=info event=scheduler_connected addr=lb:500515273worker1 # [ 117.608640] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5274worker1 # [ 117.616678] systemd[1]: Starting Nix worker-protocol over gRPC...5275worker1 # [ 117.815907] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5276worker1 # [ 117.818333] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15277worker1 # [ 117.825939] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5278worker1 # [ 117.827670] systemd[1]: Started Nix worker-protocol over gRPC.5279worker1 # [ 117.843030] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:09Z level=info event=scheduler_take_over5280lb # [ 117.900905] niks3-server[1020]: 2026/09/20 09:02:09 INFO lead: acquired remote=192.168.1.3:575925281worker2 # [ 117.867826] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5282worker1 # [ 117.872343] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:09Z level=info event=scheduler_connected addr=lb:500515283worker1 # [ 117.874236] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05284worker1 # [ 117.920810] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:09Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05285worker1 # [ 117.924758] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:09Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15286worker1 # [ 117.971547] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511645287worker1 # [ 117.985501] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)5288worker1 # [ 118.003584] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)5289worker1 # [ 118.016516] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)5290client # [ 117.994739] nix[1196]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5291worker2 # [ 118.068860] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:09Z level=info event=scheduler_connected addr=lb:500515292worker1 # [ 118.051424] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05293lb # [ 121.277383] envoy[912]: conn peer=[2001:db8:1::3]:32898 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2675 tx=1044 ms=252755294lb # [ 121.282534] envoy[912]: conn peer=[2001:db8:1::3]:49698 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=475 tx=226 ms=52895295client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5296client: waiting for success: ! systemctl is-active mid5297worker1 # [ 122.844873] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:14Z level=info event=niks3_push_started pid=16735298worker1 # [ 122.880854] nix-daemon[832]: reaped child process 1649, status = succeeded5299worker1 # [ 123.230079] nix-daemon[832]: accepted connection from pid 1686, user nix-grpc-daemon (trusted)5300worker1 # [ 123.248330] nix-daemon[832]: reaped child process 1689, status = succeeded5301lb # [ 123.322401] niks3-server[1020]: 2026/09/20 09:02:14 INFO Received uploads request method=POST path=/api/pending_closures5302worker1 # [ 123.274291] nix-grpc-daemon[1673]: time=2026-09-20T09:02:14.844Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5303worker1 # [ 123.278890] nix-grpc-daemon[1673]: time=2026-09-20T09:02:14.846Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5304lb # [ 123.364424] niks3-server[1020]: 2026/09/20 09:02:14 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5305lb # [ 123.375959] niks3-server[1020]: 2026/09/20 09:02:14 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5306lb # [ 123.386030] niks3-server[1020]: 2026/09/20 09:02:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5307worker1 # [ 123.334482] nix-grpc-daemon[1673]: time=2026-09-20T09:02:14.903Z level=INFO msg="Uploading 1 narinfos"5308lb # [ 123.394494] niks3-server[1020]: 2026/09/20 09:02:14 INFO Signed narinfos id=36 count=15309lb # [ 123.407005] niks3-server[1020]: 2026/09/20 09:02:14 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5310lb # [ 123.415077] niks3-server[1020]: 2026/09/20 09:02:14 INFO Completed upload id=365311worker1 # [ 123.356600] nix-grpc-daemon[1673]: time=2026-09-20T09:02:14.927Z level=INFO msg="Upload complete. (292ms)"5312worker1 # [ 123.372148] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51164 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15313lb # [ 123.437871] niks3-server[1020]: 2026/09/20 09:02:15 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5314worker1 # [ 123.380412] nix-grpc-daemon[1673]: time=2026-09-20T09:02:14.948Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5315worker1 # [ 123.389846] nix-daemon[832]: reaped child process 1647, status = succeeded5316client # [ 123.389590] systemd[1]: mid.service: Deactivated successfully.5317client # [ 123.393831] systemd[1]: mid.service: Consumed 182ms CPU time over 9.979s wall clock time, 36.9M memory peak, 9.7K incoming IP traffic, 10.8K outgoing IP traffic.5318client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5319client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5320client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5321(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.64 seconds)5322subtest: interrupting the client stops the build on the worker5323client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5324client # [ 124.023277] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5325client # Running as unit: intr.service; invocation ID: 5b5dc48f93b64ef68b6a8558d98024f25326client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5327client # [ 124.245846] nix[1231]: don't know how to build these paths:5328client # [ 124.246850] nix[1231]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5329worker1 # [ 124.265096] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:511645330worker1 # [ 124.281211] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:15Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05331worker1 # [ 124.287104] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:15Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15332worker2 # [ 124.361233] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376525333worker2 # [ 124.379890] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5334worker2 # [ 124.410291] nix-grpc-daemon[1161]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5)5335worker2 # [ 124.451260] nix-grpc-daemon[1161]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 2/5)5336worker2 # [ 124.510776] nix-grpc-daemon[1161]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 327 ms (attempt 3/5)5337worker2 # [ 124.845397] nix-grpc-daemon[1161]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 655 ms (attempt 4/5)5338worker2 # [ 125.510118] nix-grpc-daemon[1161]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5339worker2 # [ 125.531850] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376525340client # [ 125.509303] nix[1231]: copying 1 paths to 'lb:50051'...5341worker2 # [ 125.547145] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:376525342client # [ 125.509557] nix[1231]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5343worker2 # [ 125.563298] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5344worker2 # [ 125.593543] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:17Z level=info event=niks3_push_started pid=13055345worker2 # [ 125.985939] nix-daemon[836]: accepted connection from pid 1318, user nix-grpc-daemon (trusted)5346worker2 # [ 126.005306] nix-daemon[836]: reaped child process 1321, status = succeeded5347worker2 # [ 126.178193] nix-daemon[836]: accepted connection from pid 1323, user nix-grpc-daemon (trusted)5348worker2 # [ 126.194518] nix-daemon[836]: reaped child process 1326, status = succeeded5349lb # [ 126.246245] niks3-server[1020]: 2026/09/20 09:02:17 INFO Received uploads request method=POST path=/api/pending_closures5350worker2 # [ 126.221997] nix-grpc-daemon[1305]: time=2026-09-20T09:02:17.790Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5351worker2 # [ 126.223453] nix-grpc-daemon[1305]: time=2026-09-20T09:02:17.790Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5352lb # [ 126.287824] niks3-server[1020]: 2026/09/20 09:02:17 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5353lb # [ 126.298668] niks3-server[1020]: 2026/09/20 09:02:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5354worker2 # [ 126.267236] nix-grpc-daemon[1305]: time=2026-09-20T09:02:17.836Z level=INFO msg="Uploading 1 narinfos"5355lb # [ 126.312404] niks3-server[1020]: 2026/09/20 09:02:17 INFO Signed narinfos id=37 count=15356lb # [ 126.332266] niks3-server[1020]: 2026/09/20 09:02:17 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5357lb # [ 126.342270] niks3-server[1020]: 2026/09/20 09:02:17 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5358lb # [ 126.346335] niks3-server[1020]: 2026/09/20 09:02:17 INFO Completed upload id=375359worker2 # [ 126.307631] nix-grpc-daemon[1305]: time=2026-09-20T09:02:17.877Z level=INFO msg="Upload complete. (488ms)"5360lb # [ 126.350041] niks3-server[1020]: 2026/09/20 09:02:17 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5361worker2 # [ 126.319238] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=0 paths=1 nar_bytes_in=4245362worker2 # [ 126.332750] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376525363worker2 # [ 126.341730] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5364worker2 # [ 126.344315] nix-daemon[836]: reaped child process 1303, status = succeeded5365client # [ 126.315216] nix[1231]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5366worker2 # [ 126.358247] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5367client: must succeed: systemctl kill -s INT intr5368client # [ 128.888245] systemd[1]: intr.service: Sent signal SIGINT to main process 1231 (nix) on client request.5369client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds)5370client # [ 128.896934] nix[1231]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5371client # [ 128.903917] nix[1231]: error: interrupted by the user5372client # [ 128.938549] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5373client # [ 128.941524] systemd[1]: intr.service: Failed with result 'exit-code'.5374worker2 # [ 128.984518] nix-daemon[836]: reaped child process 1328, status = succeeded5375client # [ 128.945653] systemd[1]: intr.service: Consumed 141ms CPU time over 4.920s wall clock time, 39.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5376worker2 # [ 128.987316] nix-daemon[1330]: unexpected Nix daemon error: error: interrupted by the user5377worker2 # [ 128.995680] nix-daemon[836]: reaped child process 1330, status = failed with exit code 15378(finished: subtest: interrupting the client stops the build on the worker, in 5.04 seconds)5379subtest: a deploy mid-build drains: the build finishes, the new generation takes over5380client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5381client # [ 129.082246] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5382client # Running as unit: sw.service; invocation ID: 84cf18f8078e4c628b7b584620f9c7ae5383client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.08 seconds)5384client # [ 129.313173] nix[1250]: don't know how to build these paths:5385client # [ 129.314121] nix[1250]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5386worker1 # [ 129.333034] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:511645387worker1 # [ 129.347734] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:20Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05388worker1 # [ 129.354759] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:20Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15389worker1 # [ 129.394285] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511645390worker1 # [ 129.410433] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 1/5)5391worker1 # [ 129.447982] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 2/5)5392worker1 # [ 129.487347] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 334 ms (attempt 3/5)5393worker1 # [ 129.828991] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 486 ms (attempt 4/5)5394worker1 # [ 130.317509] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5395worker1 # [ 130.340753] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511645396client # [ 130.329179] nix[1250]: copying 1 paths to 'lb:50051'...5397worker1 # [ 130.352200] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511645398client # [ 130.334744] nix[1250]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5399worker1 # [ 130.365192] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)5400worker1 # [ 130.562331] nix-daemon[832]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)5401worker1 # [ 130.579453] nix-daemon[832]: reaped child process 1735, status = succeeded5402worker1 # [ 130.749152] nix-daemon[832]: accepted connection from pid 1737, user nix-grpc-daemon (trusted)5403worker1 # [ 130.767513] nix-daemon[832]: reaped child process 1740, status = succeeded5404lb # [ 130.838120] niks3-server[1020]: 2026/09/20 09:02:22 INFO Received uploads request method=POST path=/api/pending_closures5405worker1 # [ 130.793587] nix-grpc-daemon[1673]: time=2026-09-20T09:02:22.363Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5406worker1 # [ 130.795097] nix-grpc-daemon[1673]: time=2026-09-20T09:02:22.363Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5407lb # [ 130.871933] niks3-server[1020]: 2026/09/20 09:02:22 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5408worker1 # [ 130.837610] nix-grpc-daemon[1673]: time=2026-09-20T09:02:22.407Z level=INFO msg="Uploading 1 narinfos"5409lb # [ 130.889157] niks3-server[1020]: 2026/09/20 09:02:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5410lb # [ 130.902113] niks3-server[1020]: 2026/09/20 09:02:22 INFO Signed narinfos id=38 count=15411lb # [ 130.908873] niks3-server[1020]: 2026/09/20 09:02:22 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5412lb # [ 130.914678] niks3-server[1020]: 2026/09/20 09:02:22 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5413lb # [ 130.925653] niks3-server[1020]: 2026/09/20 09:02:22 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5414lb # [ 130.929703] niks3-server[1020]: 2026/09/20 09:02:22 INFO Completed upload id=385415worker1 # [ 130.872080] nix-grpc-daemon[1673]: time=2026-09-20T09:02:22.442Z level=INFO msg="Upload complete. (486ms)"5416worker1 # [ 130.884292] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51164 duration_s=0 paths=1 nar_bytes_in=4165417worker1 # [ 130.896809] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511645418worker1 # [ 130.908809] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)5419worker1 # [ 130.914687] nix-daemon[832]: reaped child process 1730, status = succeeded5420client # [ 130.904281] nix[1250]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5421worker1 # [ 130.926439] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)5422lb # [ 131.281012] envoy[912]: conn peer=[2001:db8:1::1]:52054 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3871 tx=1648 ms=96975423lb # [ 131.286809] envoy[912]: conn peer=[2001:db8:1::1]:50930 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=732 ms=46755424worker1: must succeed: systemctl reload nix-grpc-daemon.service5425worker1 # [ 133.020783] systemd[1]: Reloading Nix worker-protocol over gRPC...5426worker1 # [ 133.074290] systemd[1]: Reloaded Nix worker-protocol over gRPC.5427worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5428worker1: must succeed: pgrep -f 'read -t [9]0 x'5429worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5430client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25431worker2 # [ 133.407221] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:376525432client # don't know how to build these paths:5433client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5434worker2 # [ 133.420831] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376525435worker1 # [ 133.425916] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:24Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05436worker1 # [ 133.427775] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:24Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15437worker2 # [ 133.494642] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376525438worker2 # [ 133.509479] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376525439client # copying 1 paths to 'lb:50051'...5440worker2 # [ 133.525017] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:376525441client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5442worker2 # [ 133.549125] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5443worker2 # [ 133.758202] nix-daemon[836]: accepted connection from pid 1384, user nix-grpc-daemon (trusted)5444worker2 # [ 133.775787] nix-daemon[836]: reaped child process 1387, status = succeeded5445worker1 # [ 133.842136] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:25Z level=info event=draining5446worker2 # [ 133.950674] nix-daemon[836]: accepted connection from pid 1389, user nix-grpc-daemon (trusted)5447worker2 # [ 133.967224] nix-daemon[836]: reaped child process 1392, status = succeeded5448lb # [ 134.019229] niks3-server[1020]: 2026/09/20 09:02:25 INFO Received uploads request method=POST path=/api/pending_closures5449worker2 # [ 133.990265] nix-grpc-daemon[1305]: time=2026-09-20T09:02:25.559Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5450worker2 # [ 133.991720] nix-grpc-daemon[1305]: time=2026-09-20T09:02:25.559Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5451lb # [ 134.046564] niks3-server[1020]: 2026/09/20 09:02:25 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5452worker2 # [ 134.021668] nix-grpc-daemon[1305]: time=2026-09-20T09:02:25.591Z level=INFO msg="Uploading 1 narinfos"5453lb # [ 134.061501] niks3-server[1020]: 2026/09/20 09:02:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5454lb # [ 134.072588] niks3-server[1020]: 2026/09/20 09:02:25 INFO Signed narinfos id=39 count=15455lb # [ 134.078465] niks3-server[1020]: 2026/09/20 09:02:25 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5456worker2 # [ 134.046906] nix-grpc-daemon[1305]: time=2026-09-20T09:02:25.617Z level=INFO msg="Upload complete. (481ms)"5457lb # [ 134.087395] niks3-server[1020]: 2026/09/20 09:02:25 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5458lb # [ 134.092454] niks3-server[1020]: 2026/09/20 09:02:25 INFO Completed upload id=395459worker2 # [ 134.053443] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=0 paths=1 nar_bytes_in=5285460lb # [ 134.095632] niks3-server[1020]: 2026/09/20 09:02:25 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5461worker2 # [ 134.066091] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376525462worker2 # [ 134.072917] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5463worker2 # [ 134.077383] nix-daemon[836]: reaped child process 1382, status = succeeded5464client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5465client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5466worker2 # [ 134.090441] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5467worker2 # [ 135.510501] nix-daemon[836]: reaped child process 1396, status = succeeded5468client # farm-a> LOG-farm-a-during-drain5469worker2 # [ 135.662663] nix-daemon[836]: accepted connection from pid 1411, user nix-grpc-daemon (trusted)5470worker2 # [ 135.681085] nix-daemon[836]: reaped child process 1414, status = succeeded5471lb # [ 135.733022] niks3-server[1020]: 2026/09/20 09:02:27 INFO Received uploads request method=POST path=/api/pending_closures5472worker2 # [ 135.704373] nix-grpc-daemon[1305]: time=2026-09-20T09:02:27.273Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5473worker2 # [ 135.705826] nix-grpc-daemon[1305]: time=2026-09-20T09:02:27.273Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5474lb # [ 135.773676] niks3-server[1020]: 2026/09/20 09:02:27 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5475lb # [ 135.785429] niks3-server[1020]: 2026/09/20 09:02:27 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5476lb # [ 135.796194] niks3-server[1020]: 2026/09/20 09:02:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5477worker2 # [ 135.764137] nix-grpc-daemon[1305]: time=2026-09-20T09:02:27.333Z level=INFO msg="Uploading 1 narinfos"5478lb # [ 135.802075] niks3-server[1020]: 2026/09/20 09:02:27 INFO Signed narinfos id=40 count=15479lb # [ 135.806732] niks3-server[1020]: 2026/09/20 09:02:27 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5480lb # [ 135.818895] niks3-server[1020]: 2026/09/20 09:02:27 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5481lb # [ 135.824127] niks3-server[1020]: 2026/09/20 09:02:27 INFO Completed upload id=405482worker2 # [ 135.785233] nix-grpc-daemon[1305]: time=2026-09-20T09:02:27.354Z level=INFO msg="Upload complete. (284ms)"5483lb # [ 135.827333] niks3-server[1020]: 2026/09/20 09:02:27 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5484worker1 # [ 135.780592] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:27Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05485worker2 # [ 135.796969] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15486worker1 # [ 135.784250] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:27Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15487worker2 # [ 135.812284] nix-daemon[836]: reaped child process 1394, status = succeeded5488worker2 # [ 135.850562] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376525489worker2 # [ 135.870348] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376525490worker2 # [ 135.885436] nix-grpc-daemon[1305]: time=2026-09-20T09:02:27.455Z level=INFO msg="All 1 paths already cached"5491client # copying 1 paths to 'lb:50051'...5492worker2 # [ 135.896691] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:376525493client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5494worker2 # [ 135.916314] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5495worker2 # [ 136.126298] nix-daemon[836]: accepted connection from pid 1418, user nix-grpc-daemon (trusted)5496worker2 # [ 136.143657] nix-daemon[836]: reaped child process 1421, status = succeeded5497worker2 # [ 136.315643] nix-daemon[836]: accepted connection from pid 1423, user nix-grpc-daemon (trusted)5498worker2 # [ 136.332633] nix-daemon[836]: reaped child process 1426, status = succeeded5499lb # [ 136.383591] niks3-server[1020]: 2026/09/20 09:02:27 INFO Received uploads request method=POST path=/api/pending_closures5500worker2 # [ 136.354134] nix-grpc-daemon[1305]: time=2026-09-20T09:02:27.923Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5501worker2 # [ 136.355584] nix-grpc-daemon[1305]: time=2026-09-20T09:02:27.923Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5502lb # [ 136.409518] niks3-server[1020]: 2026/09/20 09:02:27 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5503lb # [ 136.428543] niks3-server[1020]: 2026/09/20 09:02:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5504worker2 # [ 136.395236] nix-grpc-daemon[1305]: time=2026-09-20T09:02:27.965Z level=INFO msg="Uploading 1 narinfos"5505lb # [ 136.440679] niks3-server[1020]: 2026/09/20 09:02:27 INFO Signed narinfos id=41 count=15506lb # [ 136.447407] niks3-server[1020]: 2026/09/20 09:02:28 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5507lb # [ 136.455011] niks3-server[1020]: 2026/09/20 09:02:28 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5508lb # [ 136.464117] niks3-server[1020]: 2026/09/20 09:02:28 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5509lb # [ 136.469593] niks3-server[1020]: 2026/09/20 09:02:28 INFO Completed upload id=415510worker2 # [ 136.430387] nix-grpc-daemon[1305]: time=2026-09-20T09:02:28.000Z level=INFO msg="Upload complete. (493ms)"5511worker2 # [ 136.438368] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=0 paths=1 nar_bytes_in=6405512worker2 # [ 136.452439] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376525513worker2 # [ 136.461687] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5514worker2 # [ 136.464348] nix-daemon[836]: reaped child process 1416, status = succeeded5515client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5516client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5517worker2 # [ 136.478158] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5518client # farm-b> LOG-farm-b-during-drain5519worker2 # [ 137.922919] nix-daemon[836]: reaped child process 1430, status = succeeded5520worker2 # [ 138.100992] nix-daemon[836]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)5521worker2 # [ 138.120789] nix-daemon[836]: reaped child process 1448, status = succeeded5522lb # [ 138.173483] niks3-server[1020]: 2026/09/20 09:02:29 INFO Received uploads request method=POST path=/api/pending_closures5523worker2 # [ 138.144722] nix-grpc-daemon[1305]: time=2026-09-20T09:02:29.713Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5524worker2 # [ 138.146272] nix-grpc-daemon[1305]: time=2026-09-20T09:02:29.713Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5525lb # [ 138.202685] niks3-server[1020]: 2026/09/20 09:02:29 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5526worker2 # [ 138.184036] nix-grpc-daemon[1305]: time=2026-09-20T09:02:29.753Z level=INFO msg="Uploading 1 narinfos"5527lb # [ 138.223482] niks3-server[1020]: 2026/09/20 09:02:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5528lb # [ 138.233678] niks3-server[1020]: 2026/09/20 09:02:29 INFO Signed narinfos id=42 count=15529lb # [ 138.239290] niks3-server[1020]: 2026/09/20 09:02:29 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5530lb # [ 138.244755] niks3-server[1020]: 2026/09/20 09:02:29 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5531lb # [ 138.251182] niks3-server[1020]: 2026/09/20 09:02:29 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5532lb # [ 138.255615] niks3-server[1020]: 2026/09/20 09:02:29 INFO Completed upload id=425533worker2 # [ 138.216783] nix-grpc-daemon[1305]: time=2026-09-20T09:02:29.786Z level=INFO msg="Upload complete. (327ms)"5534lb # [ 138.258169] niks3-server[1020]: 2026/09/20 09:02:29 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5535worker1 # [ 138.210460] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:29Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05536worker1 # [ 138.212314] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:29Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15537worker2 # [ 138.228735] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15538worker2 # [ 138.246825] nix-daemon[836]: reaped child process 1428, status = succeeded5539worker2 # [ 138.273574] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376525540worker2 # [ 138.288480] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376525541worker2 # [ 138.303039] nix-grpc-daemon[1305]: time=2026-09-20T09:02:29.873Z level=INFO msg="All 2 paths already cached"5542client # copying 1 paths to 'lb:50051'...5543worker2 # [ 138.313128] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:376525544client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5545worker2 # [ 138.336744] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5546worker2 # [ 138.539472] nix-daemon[836]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)5547worker2 # [ 138.559730] nix-daemon[836]: reaped child process 1455, status = succeeded5548worker2 # [ 138.733623] nix-daemon[836]: accepted connection from pid 1457, user nix-grpc-daemon (trusted)5549worker2 # [ 138.753065] nix-daemon[836]: reaped child process 1460, status = succeeded5550lb # [ 138.805808] niks3-server[1020]: 2026/09/20 09:02:30 INFO Received uploads request method=POST path=/api/pending_closures5551worker2 # [ 138.777740] nix-grpc-daemon[1305]: time=2026-09-20T09:02:30.347Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5552worker2 # [ 138.779244] nix-grpc-daemon[1305]: time=2026-09-20T09:02:30.347Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5553lb # [ 138.832773] niks3-server[1020]: 2026/09/20 09:02:30 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5554worker2 # [ 138.807245] nix-grpc-daemon[1305]: time=2026-09-20T09:02:30.377Z level=INFO msg="Uploading 1 narinfos"5555lb # [ 138.847309] niks3-server[1020]: 2026/09/20 09:02:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5556lb # [ 138.857431] niks3-server[1020]: 2026/09/20 09:02:30 INFO Signed narinfos id=43 count=15557lb # [ 138.865686] niks3-server[1020]: 2026/09/20 09:02:30 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5558lb # [ 138.873118] niks3-server[1020]: 2026/09/20 09:02:30 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5559worker2 # [ 138.838030] nix-grpc-daemon[1305]: time=2026-09-20T09:02:30.408Z level=INFO msg="Upload complete. (484ms)"5560lb # [ 138.877612] niks3-server[1020]: 2026/09/20 09:02:30 INFO Completed upload id=435561lb # [ 138.881246] niks3-server[1020]: 2026/09/20 09:02:30 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5562worker2 # [ 138.844221] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=0 paths=1 nar_bytes_in=7685563worker2 # [ 138.855748] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376525564worker2 # [ 138.862303] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5565worker2 # [ 138.867118] nix-daemon[836]: reaped child process 1450, status = succeeded5566client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5567worker2 # [ 138.880303] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)5568client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5569client # farm-top> LOG-farm-top-during-drain5570worker2 # [ 140.126489] nix-daemon[836]: reaped child process 1464, status = succeeded5571worker2 # [ 140.309490] nix-daemon[836]: accepted connection from pid 1479, user nix-grpc-daemon (trusted)5572worker2 # [ 140.327465] nix-daemon[836]: reaped child process 1482, status = succeeded5573lb # [ 140.378968] niks3-server[1020]: 2026/09/20 09:02:31 INFO Received uploads request method=POST path=/api/pending_closures5574worker2 # [ 140.351123] nix-grpc-daemon[1305]: time=2026-09-20T09:02:31.920Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5575worker2 # [ 140.355123] nix-grpc-daemon[1305]: time=2026-09-20T09:02:31.923Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5576lb # [ 140.417053] niks3-server[1020]: 2026/09/20 09:02:31 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5577lb # [ 140.430124] niks3-server[1020]: 2026/09/20 09:02:31 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5578lb # [ 140.438533] niks3-server[1020]: 2026/09/20 09:02:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5579worker2 # [ 140.404913] nix-grpc-daemon[1305]: time=2026-09-20T09:02:31.974Z level=INFO msg="Uploading 1 narinfos"5580lb # [ 140.447605] niks3-server[1020]: 2026/09/20 09:02:32 INFO Signed narinfos id=44 count=15581lb # [ 140.453790] niks3-server[1020]: 2026/09/20 09:02:32 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5582lb # [ 140.460236] niks3-server[1020]: 2026/09/20 09:02:32 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5583lb # [ 140.469937] niks3-server[1020]: 2026/09/20 09:02:32 INFO Completed upload id=445584worker2 # [ 140.431020] nix-grpc-daemon[1305]: time=2026-09-20T09:02:32.001Z level=INFO msg="Upload complete. (338ms)"5585lb # [ 140.473226] niks3-server[1020]: 2026/09/20 09:02:32 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5586worker2 # [ 140.445147] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15587worker2 # [ 140.461013] nix-daemon[836]: reaped child process 1462, status = succeeded5588client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 7.34 seconds)5589client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5590client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5591worker1: must succeed: pkill -f 'read -t [9]0 x'5592worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5593client: waiting for success: ! systemctl is-active sw5594worker1 # [ 140.987471] nix-daemon[832]: reaped child process 1744, status = succeeded5595worker1 # [ 141.161587] nix-daemon[832]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5596worker1 # [ 141.179846] nix-daemon[832]: reaped child process 1793, status = succeeded5597lb # [ 141.249514] niks3-server[1020]: 2026/09/20 09:02:32 INFO Received uploads request method=POST path=/api/pending_closures5598worker1 # [ 141.202036] nix-grpc-daemon[1673]: time=2026-09-20T09:02:32.771Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5599worker1 # [ 141.203589] nix-grpc-daemon[1673]: time=2026-09-20T09:02:32.771Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5600lb # [ 141.281056] envoy[912]: conn peer=[2001:db8:1::1]:45194 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9599 tx=3892 ms=70535601lb # [ 141.296968] niks3-server[1020]: 2026/09/20 09:02:32 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5602worker1 # [ 141.252164] nix-grpc-daemon[1673]: time=2026-09-20T09:02:32.822Z level=INFO msg="Uploading 1 narinfos"5603lb # [ 141.309965] niks3-server[1020]: 2026/09/20 09:02:32 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5604lb # [ 141.316215] niks3-server[1020]: 2026/09/20 09:02:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5605lb # [ 141.319361] niks3-server[1020]: 2026/09/20 09:02:32 INFO Signed narinfos id=45 count=15606lb # [ 141.325240] niks3-server[1020]: 2026/09/20 09:02:32 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5607lb # [ 141.331990] niks3-server[1020]: 2026/09/20 09:02:32 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5608lb # [ 141.335914] niks3-server[1020]: 2026/09/20 09:02:32 INFO Completed upload id=455609worker1 # [ 141.278249] nix-grpc-daemon[1673]: time=2026-09-20T09:02:32.848Z level=INFO msg="Upload complete. (328ms)"5610lb # [ 141.338298] niks3-server[1020]: 2026/09/20 09:02:32 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5611worker1 # [ 141.293160] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51164 duration_s=10 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15612worker1 # [ 141.307305] nix-daemon[832]: reaped child process 1742, status = succeeded5613client # [ 141.310036] systemd[1]: sw.service: Deactivated successfully.5614client # [ 141.314383] systemd[1]: sw.service: Consumed 153ms CPU time over 12.230s wall clock time, 37M memory peak, 8.9K incoming IP traffic, 9K outgoing IP traffic.5615worker1 # [ 141.846861] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:33Z level=info event=signal_exit5616worker1 # [ 141.867642] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:33Z level=info event=scheduler_yield5617lb # [ 141.929309] niks3-server[1020]: 2026/09/20 09:02:33 INFO lead: released remote=192.168.1.3:575925618worker2 # [ 141.893235] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:33Z level=info event=scheduler_restarting addr=lb:500515619worker1 # [ 141.877285] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:511445620client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5621client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5622worker1 # [ 141.885238] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:33Z level=info event=worker_gone addr=192.168.1.4:500515623worker1 # [ 141.889356] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:33Z level=info event=scheduler_restarting addr=lb:500515624worker1 # [ 141.893370] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:511445625worker1 # [ 141.897797] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:33Z level=info event=worker_gone addr=192.168.1.3:500515626client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5627worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5628worker2 # [ 142.093242] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:33Z level=info event=scheduler_connected addr=lb:500515629worker2 # [ 142.100519] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5630worker1 # [ 142.084988] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:33Z level=info event=scheduler_connected addr=lb:500515631worker1 # [ 142.095336] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5632worker2 # [ 142.301537] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:33Z level=info event=scheduler_connected addr=lb:500515633worker2 # [ 142.308361] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5634worker1 # [ 142.299383] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:33Z level=info event=scheduler_connected addr=lb:500515635worker1 # [ 142.303639] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5636worker2 # [ 142.509398] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:34Z level=info event=scheduler_connected addr=lb:500515637worker2 # [ 142.515942] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5638worker1 # [ 142.500189] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:34Z level=info event=scheduler_connected addr=lb:500515639worker1 # [ 142.506703] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5640worker2 # [ 142.717017] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:34Z level=info event=scheduler_connected addr=lb:500515641worker2 # [ 142.723591] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5642worker1 # [ 142.707700] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:34Z level=info event=scheduler_connected addr=lb:500515643worker1 # [ 142.714278] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5644worker1 # [ 142.872170] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:34Z level=info event=scheduler_restarting5645worker1 # [ 142.887704] nix-grpc-daemon[1594]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5646worker1 # [ 142.900592] nix-grpc-daemon[1594]: E0000 00:00:1789894954.457980 1637 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5647worker2 # [ 142.926565] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:34Z level=info event=scheduler_connected addr=lb:500515648worker2 # [ 142.931697] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5649worker1 # [ 142.934968] nix-grpc-daemon[1594]: E0000 00:00:1789894954.486295 1637 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5650worker1 # [ 142.941802] nix-grpc-daemon[1594]: ts=2026-09-20T09:02:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5651worker1 # [ 142.946346] nix-daemon[832]: reaped child process 1645, status = succeeded5652worker2 # [ 143.132448] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:34Z level=info event=scheduler_connected addr=lb:500515653worker1 # [ 143.115740] nix-grpc-daemon[1594]: E0000 00:00:1789894954.686024 1637 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5654worker2 # [ 143.877611] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:35Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5655worker1 # [ 143.878171] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5656worker1 # [ 143.884504] systemd[1]: nix-grpc-daemon.service: Consumed 873ms CPU time over 26.444s wall clock time, 33.9M memory peak, 24.2K incoming IP traffic, 32.4K outgoing IP traffic.5657worker1 # [ 143.907086] systemd[1]: Starting Nix worker-protocol over gRPC...5658worker2 # [ 144.081222] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:35Z level=info event=scheduler_connected addr=lb:500515659worker2 # [ 144.086375] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5660worker1 # [ 144.107828] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5661worker1 # [ 144.110339] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15662worker1 # [ 144.117896] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5663worker1 # [ 144.119623] systemd[1]: Started Nix worker-protocol over gRPC.5664lb # [ 144.186694] niks3-server[1020]: 2026/09/20 09:02:35 INFO lead: acquired remote=192.168.1.3:540585665worker1 # [ 144.131542] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:35Z level=info event=scheduler_take_over5666worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.21 seconds)5667lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5668lb: must succeed: curl -sf localhost:9901/clusters5669worker1 # [ 144.162660] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:35Z level=info event=scheduler_connected addr=lb:500515670worker1 # [ 144.178209] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05671lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5672worker2 # [ 144.287074] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:35Z level=info event=scheduler_connected addr=lb:500515673worker2 # [ 144.293836] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5674worker2 # [ 144.494866] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:36Z level=info event=scheduler_connected addr=lb:500515675worker1 # [ 144.478712] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:36Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05676lb: must succeed: curl -sf localhost:9901/clusters5677lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5678lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.16 seconds)5679lb: must succeed: curl -sf localhost:9901/clusters5680lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5681worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5682worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5683(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.42 seconds)5684subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5685client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15686worker1 # [ 145.707735] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:532565687worker1 # [ 145.721918] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5688worker1 # [ 145.742141] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532565689worker1 # [ 145.757717] nix-grpc-daemon[1807]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 1/5)5690worker1 # [ 145.787307] nix-grpc-daemon[1807]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5)5691worker1 # [ 145.879912] nix-grpc-daemon[1807]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 203 ms (attempt 3/5)5692worker1 # [ 146.090503] nix-grpc-daemon[1807]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 759 ms (attempt 4/5)5693worker1 # [ 146.858227] nix-grpc-daemon[1807]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5694worker1 # [ 146.912948] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:38Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05695worker1 # [ 146.918713] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:38Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15696worker1 # [ 146.925933] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:38Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05697worker1 # [ 146.931323] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:38Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05698worker1 # [ 146.967366] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565699worker1 # [ 146.982966] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532565700worker1 # [ 146.997756] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532565701worker1 # [ 147.013309] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5702worker1 # [ 147.040378] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:38Z level=info event=niks3_push_started pid=18705703worker1 # [ 147.420471] nix-daemon[832]: accepted connection from pid 1883, user nix-grpc-daemon (trusted)5704worker1 # [ 147.439044] nix-daemon[832]: reaped child process 1886, status = succeeded5705worker1 # [ 147.607322] nix-daemon[832]: accepted connection from pid 1888, user nix-grpc-daemon (trusted)5706worker1 # [ 147.624521] nix-daemon[832]: reaped child process 1891, status = succeeded5707lb # [ 147.697046] niks3-server[1020]: 2026/09/20 09:02:39 INFO Received uploads request method=POST path=/api/pending_closures5708worker1 # [ 147.651400] nix-grpc-daemon[1870]: time=2026-09-20T09:02:39.220Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5709worker1 # [ 147.653118] nix-grpc-daemon[1870]: time=2026-09-20T09:02:39.220Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5710lb # [ 147.737543] niks3-server[1020]: 2026/09/20 09:02:39 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5711worker1 # [ 147.689855] nix-grpc-daemon[1870]: time=2026-09-20T09:02:39.259Z level=INFO msg="Uploading 1 narinfos"5712lb # [ 147.747342] niks3-server[1020]: 2026/09/20 09:02:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5713lb # [ 147.756093] niks3-server[1020]: 2026/09/20 09:02:39 INFO Signed narinfos id=46 count=15714lb # [ 147.764765] niks3-server[1020]: 2026/09/20 09:02:39 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5715worker1 # [ 147.719882] nix-grpc-daemon[1870]: time=2026-09-20T09:02:39.290Z level=INFO msg="Upload complete. (470ms)"5716lb # [ 147.777513] niks3-server[1020]: 2026/09/20 09:02:39 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5717lb # [ 147.787291] niks3-server[1020]: 2026/09/20 09:02:39 INFO Completed upload id=465718worker1 # [ 147.729775] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=0 paths=1 nar_bytes_in=5125719lb # [ 147.789525] niks3-server[1020]: 2026/09/20 09:02:39 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5720worker1 # [ 147.741357] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565721worker1 # [ 147.746974] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5722worker1 # [ 147.751195] nix-daemon[832]: reaped child process 1868, status = succeeded5723worker1 # [ 147.763102] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5724worker1 # [ 149.185009] nix-daemon[832]: reaped child process 1895, status = succeeded5725worker1 # [ 149.344912] nix-daemon[832]: accepted connection from pid 1910, user nix-grpc-daemon (trusted)5726worker1 # [ 149.364414] nix-daemon[832]: reaped child process 1913, status = succeeded5727lb # [ 149.434698] niks3-server[1020]: 2026/09/20 09:02:40 INFO Received uploads request method=POST path=/api/pending_closures5728worker1 # [ 149.388415] nix-grpc-daemon[1870]: time=2026-09-20T09:02:40.956Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5729worker1 # [ 149.389914] nix-grpc-daemon[1870]: time=2026-09-20T09:02:40.956Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5730lb # [ 149.476187] niks3-server[1020]: 2026/09/20 09:02:41 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5731lb # [ 149.486916] niks3-server[1020]: 2026/09/20 09:02:41 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5732lb # [ 149.496549] niks3-server[1020]: 2026/09/20 09:02:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5733worker1 # [ 149.444733] nix-grpc-daemon[1870]: time=2026-09-20T09:02:41.014Z level=INFO msg="Uploading 1 narinfos"5734lb # [ 149.502278] niks3-server[1020]: 2026/09/20 09:02:41 INFO Signed narinfos id=47 count=15735lb # [ 149.507135] niks3-server[1020]: 2026/09/20 09:02:41 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5736lb # [ 149.518561] niks3-server[1020]: 2026/09/20 09:02:41 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5737lb # [ 149.523992] niks3-server[1020]: 2026/09/20 09:02:41 INFO Completed upload id=475738worker1 # [ 149.466316] nix-grpc-daemon[1870]: time=2026-09-20T09:02:41.036Z level=INFO msg="Upload complete. (293ms)"5739lb # [ 149.526843] niks3-server[1020]: 2026/09/20 09:02:41 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5740worker1 # [ 149.483766] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=15741worker1 # [ 149.496432] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:41Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15742worker1 # [ 149.499739] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:41Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05743worker1 # [ 149.503594] nix-daemon[832]: reaped child process 1893, status = succeeded5744worker1 # [ 149.525183] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565745worker1 # [ 149.539388] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532565746worker1 # [ 149.553412] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532565747worker1 # [ 149.566708] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5748worker1 # [ 149.760715] nix-daemon[832]: accepted connection from pid 1919, user nix-grpc-daemon (trusted)5749worker1 # [ 149.778104] nix-daemon[832]: reaped child process 1922, status = succeeded5750worker1 # [ 149.954897] nix-daemon[832]: accepted connection from pid 1924, user nix-grpc-daemon (trusted)5751worker1 # [ 149.971962] nix-daemon[832]: reaped child process 1927, status = succeeded5752lb # [ 150.041463] niks3-server[1020]: 2026/09/20 09:02:41 INFO Received uploads request method=POST path=/api/pending_closures5753worker1 # [ 149.992072] nix-grpc-daemon[1870]: time=2026-09-20T09:02:41.562Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5754worker1 # [ 149.993640] nix-grpc-daemon[1870]: time=2026-09-20T09:02:41.562Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5755lb # [ 150.071794] niks3-server[1020]: 2026/09/20 09:02:41 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5756lb # [ 150.085226] niks3-server[1020]: 2026/09/20 09:02:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5757worker1 # [ 150.033214] nix-grpc-daemon[1870]: time=2026-09-20T09:02:41.603Z level=INFO msg="Uploading 1 narinfos"5758lb # [ 150.095487] niks3-server[1020]: 2026/09/20 09:02:41 INFO Signed narinfos id=48 count=15759lb # [ 150.105901] niks3-server[1020]: 2026/09/20 09:02:41 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5760lb # [ 150.116216] niks3-server[1020]: 2026/09/20 09:02:41 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5761lb # [ 150.121450] niks3-server[1020]: 2026/09/20 09:02:41 INFO Completed upload id=485762worker1 # [ 150.063651] nix-grpc-daemon[1870]: time=2026-09-20T09:02:41.634Z level=INFO msg="Upload complete. (482ms)"5763lb # [ 150.124311] niks3-server[1020]: 2026/09/20 09:02:41 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5764worker1 # [ 150.072368] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=0 paths=1 nar_bytes_in=5125765worker1 # [ 150.084581] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565766worker1 # [ 150.091245] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5767worker1 # [ 150.096305] nix-daemon[832]: reaped child process 1917, status = succeeded5768worker1 # [ 150.110395] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5769lb # [ 151.280513] envoy[912]: conn peer=[2001:db8:1::1]:50940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1374 ms=119705770lb # [ 151.280777] envoy[912]: conn peer=[2001:db8:1::3]:49714 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1426 tx=552 ms=250555771worker1 # [ 151.352811] nix-daemon[832]: reaped child process 1931, status = succeeded5772worker1 # [ 151.539792] nix-daemon[832]: accepted connection from pid 1946, user nix-grpc-daemon (trusted)5773worker1 # [ 151.556401] nix-daemon[832]: reaped child process 1949, status = succeeded5774lb # [ 151.629061] niks3-server[1020]: 2026/09/20 09:02:43 INFO Received uploads request method=POST path=/api/pending_closures5775worker1 # [ 151.582705] nix-grpc-daemon[1870]: time=2026-09-20T09:02:43.152Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5776worker1 # [ 151.584292] nix-grpc-daemon[1870]: time=2026-09-20T09:02:43.152Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5777lb # [ 151.667465] niks3-server[1020]: 2026/09/20 09:02:43 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5778lb # [ 151.680331] niks3-server[1020]: 2026/09/20 09:02:43 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5779lb # [ 151.689114] niks3-server[1020]: 2026/09/20 09:02:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5780worker1 # [ 151.636771] nix-grpc-daemon[1870]: time=2026-09-20T09:02:43.206Z level=INFO msg="Uploading 1 narinfos"5781lb # [ 151.695765] niks3-server[1020]: 2026/09/20 09:02:43 INFO Signed narinfos id=49 count=15782lb # [ 151.701468] niks3-server[1020]: 2026/09/20 09:02:43 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5783lb # [ 151.711118] niks3-server[1020]: 2026/09/20 09:02:43 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5784lb # [ 151.718266] niks3-server[1020]: 2026/09/20 09:02:43 INFO Completed upload id=495785worker1 # [ 151.660057] nix-grpc-daemon[1870]: time=2026-09-20T09:02:43.230Z level=INFO msg="Upload complete. (336ms)"5786lb # [ 151.721122] niks3-server[1020]: 2026/09/20 09:02:43 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5787worker1 # [ 151.681077] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=15788worker1 # [ 151.692723] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:43Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15789worker1 # [ 151.704420] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565790worker1 # [ 151.707924] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:43Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05791worker1 # [ 151.713862] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532565792worker1 # [ 151.718479] nix-daemon[832]: reaped child process 1929, status = succeeded5793worker1 # [ 151.720537] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532565794worker1 # [ 151.731078] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5795worker1 # [ 151.917369] nix-daemon[832]: accepted connection from pid 1955, user nix-grpc-daemon (trusted)5796worker1 # [ 151.935760] nix-daemon[832]: reaped child process 1958, status = succeeded5797worker1 # [ 152.112866] nix-daemon[832]: accepted connection from pid 1960, user nix-grpc-daemon (trusted)5798worker1 # [ 152.132113] nix-daemon[832]: reaped child process 1963, status = succeeded5799lb # [ 152.205891] niks3-server[1020]: 2026/09/20 09:02:43 INFO Received uploads request method=POST path=/api/pending_closures5800worker1 # [ 152.156754] nix-grpc-daemon[1870]: time=2026-09-20T09:02:43.727Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5801worker1 # [ 152.158287] nix-grpc-daemon[1870]: time=2026-09-20T09:02:43.727Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5802lb # [ 152.233919] niks3-server[1020]: 2026/09/20 09:02:43 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5803worker1 # [ 152.186035] nix-grpc-daemon[1870]: time=2026-09-20T09:02:43.756Z level=INFO msg="Uploading 1 narinfos"5804lb # [ 152.249638] niks3-server[1020]: 2026/09/20 09:02:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5805lb # [ 152.259940] niks3-server[1020]: 2026/09/20 09:02:43 INFO Signed narinfos id=50 count=15806lb # [ 152.267621] niks3-server[1020]: 2026/09/20 09:02:43 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5807worker1 # [ 152.215695] nix-grpc-daemon[1870]: time=2026-09-20T09:02:43.786Z level=INFO msg="Upload complete. (474ms)"5808lb # [ 152.273308] niks3-server[1020]: 2026/09/20 09:02:43 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5809lb # [ 152.279083] niks3-server[1020]: 2026/09/20 09:02:43 INFO Completed upload id=505810worker1 # [ 152.224294] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=0 paths=1 nar_bytes_in=5125811lb # [ 152.283097] niks3-server[1020]: 2026/09/20 09:02:43 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5812worker1 # [ 152.228638] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565813worker1 # [ 152.240588] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5814worker1 # [ 152.243151] nix-daemon[832]: reaped child process 1953, status = succeeded5815worker1 # [ 152.255266] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5816worker1 # [ 153.490827] nix-daemon[832]: reaped child process 1967, status = succeeded5817worker1 # [ 153.658665] nix-daemon[832]: accepted connection from pid 1982, user nix-grpc-daemon (trusted)5818worker1 # [ 153.677514] nix-daemon[832]: reaped child process 1985, status = succeeded5819lb # [ 153.749017] niks3-server[1020]: 2026/09/20 09:02:45 INFO Received uploads request method=POST path=/api/pending_closures5820worker1 # [ 153.702583] nix-grpc-daemon[1870]: time=2026-09-20T09:02:45.271Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5821worker1 # [ 153.704186] nix-grpc-daemon[1870]: time=2026-09-20T09:02:45.271Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5822lb # [ 153.783590] niks3-server[1020]: 2026/09/20 09:02:45 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5823worker1 # [ 153.740192] nix-grpc-daemon[1870]: time=2026-09-20T09:02:45.310Z level=INFO msg="Uploading 1 narinfos"5824lb # [ 153.800355] niks3-server[1020]: 2026/09/20 09:02:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5825lb # [ 153.810600] niks3-server[1020]: 2026/09/20 09:02:45 INFO Signed narinfos id=51 count=15826lb # [ 153.818088] niks3-server[1020]: 2026/09/20 09:02:45 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5827worker1 # [ 153.765442] nix-grpc-daemon[1870]: time=2026-09-20T09:02:45.336Z level=INFO msg="Upload complete. (300ms)"5828lb # [ 153.825043] niks3-server[1020]: 2026/09/20 09:02:45 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5829lb # [ 153.833090] niks3-server[1020]: 2026/09/20 09:02:45 INFO Completed upload id=515830worker1 # [ 153.773769] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=15831lb # [ 153.835009] niks3-server[1020]: 2026/09/20 09:02:45 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5832worker1 # [ 153.792212] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:45Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15833worker1 # [ 153.795953] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565834lb # [ 153.854338] niks3-server[1020]: 2026/09/20 09:02:45 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5835worker1 # [ 153.805123] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:45Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05836worker1 # [ 153.809570] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532565837worker1 # [ 153.812792] nix-daemon[832]: reaped child process 1965, status = succeeded5838worker1 # [ 153.815332] nix-grpc-daemon[1870]: time=2026-09-20T09:02:45.385Z level=INFO msg="All 1 paths already cached"5839worker1 # [ 153.818762] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532565840worker1 # [ 153.830036] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5841worker1 # [ 154.013068] nix-daemon[832]: accepted connection from pid 1991, user nix-grpc-daemon (trusted)5842worker1 # [ 154.031242] nix-daemon[832]: reaped child process 1994, status = succeeded5843worker1 # [ 154.205870] nix-daemon[832]: accepted connection from pid 1996, user nix-grpc-daemon (trusted)5844worker1 # [ 154.223729] nix-daemon[832]: reaped child process 1999, status = succeeded5845lb # [ 154.293412] niks3-server[1020]: 2026/09/20 09:02:45 INFO Received uploads request method=POST path=/api/pending_closures5846worker1 # [ 154.248754] nix-grpc-daemon[1870]: time=2026-09-20T09:02:45.819Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5847worker1 # [ 154.250310] nix-grpc-daemon[1870]: time=2026-09-20T09:02:45.819Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5848lb # [ 154.328064] niks3-server[1020]: 2026/09/20 09:02:45 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5849lb # [ 154.341709] niks3-server[1020]: 2026/09/20 09:02:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5850worker1 # [ 154.292072] nix-grpc-daemon[1870]: time=2026-09-20T09:02:45.862Z level=INFO msg="Uploading 1 narinfos"5851lb # [ 154.350093] niks3-server[1020]: 2026/09/20 09:02:45 INFO Signed narinfos id=52 count=15852lb # [ 154.355920] niks3-server[1020]: 2026/09/20 09:02:45 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5853lb # [ 154.366980] niks3-server[1020]: 2026/09/20 09:02:45 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5854lb # [ 154.372183] niks3-server[1020]: 2026/09/20 09:02:45 INFO Completed upload id=525855worker1 # [ 154.314292] nix-grpc-daemon[1870]: time=2026-09-20T09:02:45.884Z level=INFO msg="Upload complete. (473ms)"5856lb # [ 154.374754] niks3-server[1020]: 2026/09/20 09:02:45 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5857worker1 # [ 154.323793] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=0 paths=1 nar_bytes_in=6245858worker1 # [ 154.334664] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565859worker1 # [ 154.341044] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5860worker1 # [ 154.345977] nix-daemon[832]: reaped child process 1989, status = succeeded5861worker1 # [ 154.359407] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5862worker1 # [ 155.592213] nix-daemon[832]: reaped child process 2003, status = succeeded5863worker1 # [ 155.768232] nix-daemon[832]: accepted connection from pid 2018, user nix-grpc-daemon (trusted)5864worker1 # [ 155.784957] nix-daemon[832]: reaped child process 2021, status = succeeded5865lb # [ 155.857756] niks3-server[1020]: 2026/09/20 09:02:47 INFO Received uploads request method=POST path=/api/pending_closures5866worker1 # [ 155.812493] nix-grpc-daemon[1870]: time=2026-09-20T09:02:47.380Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5867worker1 # [ 155.814282] nix-grpc-daemon[1870]: time=2026-09-20T09:02:47.380Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5868lb # [ 155.896953] niks3-server[1020]: 2026/09/20 09:02:47 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5869worker1 # [ 155.856300] nix-grpc-daemon[1870]: time=2026-09-20T09:02:47.426Z level=INFO msg="Uploading 1 narinfos"5870lb # [ 155.914573] niks3-server[1020]: 2026/09/20 09:02:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5871lb # [ 155.923357] niks3-server[1020]: 2026/09/20 09:02:47 INFO Signed narinfos id=53 count=15872lb # [ 155.929453] niks3-server[1020]: 2026/09/20 09:02:47 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5873lb # [ 155.940150] niks3-server[1020]: 2026/09/20 09:02:47 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5874lb # [ 155.951815] niks3-server[1020]: 2026/09/20 09:02:47 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5875worker1 # [ 155.899455] nix-grpc-daemon[1870]: time=2026-09-20T09:02:47.469Z level=INFO msg="Upload complete. (329ms)"5876lb # [ 155.958212] niks3-server[1020]: 2026/09/20 09:02:47 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5877lb # [ 155.965393] niks3-server[1020]: 2026/09/20 09:02:47 INFO Completed upload id=535878worker1 # [ 155.917363] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=15879worker1 # [ 155.941014] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:47Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15880worker1 # [ 155.948553] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565881worker1 # [ 155.954306] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:47Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05882worker1 # [ 155.959318] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532565883worker1 # [ 155.965407] nix-daemon[832]: reaped child process 2001, status = succeeded5884worker1 # [ 155.975681] nix-grpc-daemon[1870]: time=2026-09-20T09:02:47.529Z level=INFO msg="All 1 paths already cached"5885worker1 # [ 155.982465] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5886worker1 # [ 155.986848] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532565887worker1 # [ 156.169754] nix-daemon[832]: accepted connection from pid 2027, user nix-grpc-daemon (trusted)5888worker1 # [ 156.189306] nix-daemon[832]: reaped child process 2030, status = succeeded5889worker1 # [ 156.363552] nix-daemon[832]: accepted connection from pid 2032, user nix-grpc-daemon (trusted)5890worker1 # [ 156.382326] nix-daemon[832]: reaped child process 2035, status = succeeded5891lb # [ 156.451604] niks3-server[1020]: 2026/09/20 09:02:48 INFO Received uploads request method=POST path=/api/pending_closures5892worker1 # [ 156.402540] nix-grpc-daemon[1870]: time=2026-09-20T09:02:47.973Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5893worker1 # [ 156.404568] nix-grpc-daemon[1870]: time=2026-09-20T09:02:47.974Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5894lb # [ 156.485103] niks3-server[1020]: 2026/09/20 09:02:48 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5895worker1 # [ 156.433405] nix-grpc-daemon[1870]: time=2026-09-20T09:02:48.003Z level=INFO msg="Uploading 1 narinfos"5896lb # [ 156.498173] niks3-server[1020]: 2026/09/20 09:02:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5897worker1 # [ 156.453808] nix-grpc-daemon[1870]: time=2026-09-20T09:02:48.024Z level=INFO msg="Upload complete. (462ms)"5898lb # [ 156.512362] niks3-server[1020]: 2026/09/20 09:02:48 INFO Signed narinfos id=54 count=15899lb # [ 156.516246] niks3-server[1020]: 2026/09/20 09:02:48 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5900worker1 # [ 156.460117] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=0 paths=1 nar_bytes_in=6245901lb # [ 156.520644] niks3-server[1020]: 2026/09/20 09:02:48 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5902lb # [ 156.524285] niks3-server[1020]: 2026/09/20 09:02:48 INFO Completed upload id=545903lb # [ 156.526864] niks3-server[1020]: 2026/09/20 09:02:48 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5904worker1 # [ 156.471233] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565905worker1 # [ 156.476742] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5906worker1 # [ 156.480981] nix-daemon[832]: reaped child process 2025, status = succeeded5907worker1 # [ 156.490679] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5908worker1 # [ 157.735996] nix-daemon[832]: reaped child process 2039, status = succeeded5909worker1 # [ 157.921668] nix-daemon[832]: accepted connection from pid 2054, user nix-grpc-daemon (trusted)5910worker1 # [ 157.938701] nix-daemon[832]: reaped child process 2057, status = succeeded5911lb # [ 158.009670] niks3-server[1020]: 2026/09/20 09:02:49 INFO Received uploads request method=POST path=/api/pending_closures5912worker1 # [ 157.964399] nix-grpc-daemon[1870]: time=2026-09-20T09:02:49.533Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5913worker1 # [ 157.965943] nix-grpc-daemon[1870]: time=2026-09-20T09:02:49.533Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5914lb # [ 158.055009] niks3-server[1020]: 2026/09/20 09:02:49 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5915lb # [ 158.067842] niks3-server[1020]: 2026/09/20 09:02:49 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5916worker1 # [ 158.016157] nix-grpc-daemon[1870]: time=2026-09-20T09:02:49.586Z level=INFO msg="Uploading 1 narinfos"5917lb # [ 158.079957] niks3-server[1020]: 2026/09/20 09:02:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5918lb # [ 158.083987] niks3-server[1020]: 2026/09/20 09:02:49 INFO Signed narinfos id=55 count=15919lb # [ 158.096437] niks3-server[1020]: 2026/09/20 09:02:49 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5920worker1 # [ 158.043236] nix-grpc-daemon[1870]: time=2026-09-20T09:02:49.613Z level=INFO msg="Upload complete. (341ms)"5921lb # [ 158.101594] niks3-server[1020]: 2026/09/20 09:02:49 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5922lb # [ 158.108189] niks3-server[1020]: 2026/09/20 09:02:49 INFO Completed upload id=555923lb # [ 158.110851] niks3-server[1020]: 2026/09/20 09:02:49 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5924worker1 # [ 158.057098] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=15925worker1 # [ 158.077091] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:49Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15926worker1 # [ 158.085122] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565927worker1 # [ 158.090607] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:49Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05928worker1 # [ 158.095814] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532565929worker1 # [ 158.100565] nix-daemon[832]: reaped child process 2037, status = succeeded5930worker1 # [ 158.102532] nix-grpc-daemon[1870]: time=2026-09-20T09:02:49.670Z level=INFO msg="All 1 paths already cached"5931worker1 # [ 158.106141] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532565932worker1 # [ 158.116669] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5933worker1 # [ 158.300268] nix-daemon[832]: accepted connection from pid 2063, user nix-grpc-daemon (trusted)5934worker1 # [ 158.319293] nix-daemon[832]: reaped child process 2066, status = succeeded5935worker1 # [ 158.489415] nix-daemon[832]: accepted connection from pid 2068, user nix-grpc-daemon (trusted)5936worker1 # [ 158.507304] nix-daemon[832]: reaped child process 2071, status = succeeded5937lb # [ 158.576678] niks3-server[1020]: 2026/09/20 09:02:50 INFO Received uploads request method=POST path=/api/pending_closures5938worker1 # [ 158.528772] nix-grpc-daemon[1870]: time=2026-09-20T09:02:50.099Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5939worker1 # [ 158.530288] nix-grpc-daemon[1870]: time=2026-09-20T09:02:50.099Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5940lb # [ 158.605453] niks3-server[1020]: 2026/09/20 09:02:50 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5941worker1 # [ 158.558400] nix-grpc-daemon[1870]: time=2026-09-20T09:02:50.128Z level=INFO msg="Uploading 1 narinfos"5942lb # [ 158.622362] niks3-server[1020]: 2026/09/20 09:02:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5943lb # [ 158.635872] niks3-server[1020]: 2026/09/20 09:02:50 INFO Signed narinfos id=56 count=15944worker1 # [ 158.581410] nix-grpc-daemon[1870]: time=2026-09-20T09:02:50.151Z level=INFO msg="Upload complete. (454ms)"5945lb # [ 158.641975] niks3-server[1020]: 2026/09/20 09:02:50 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5946worker1 # [ 158.588106] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=0 paths=1 nar_bytes_in=6245947lb # [ 158.647100] niks3-server[1020]: 2026/09/20 09:02:50 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5948lb # [ 158.651600] niks3-server[1020]: 2026/09/20 09:02:50 INFO Completed upload id=565949lb # [ 158.653856] niks3-server[1020]: 2026/09/20 09:02:50 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5950worker1 # [ 158.598979] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565951worker1 # [ 158.605351] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5952worker1 # [ 158.609809] nix-daemon[832]: reaped child process 2061, status = succeeded5953worker1 # [ 158.621150] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5954worker1 # [ 159.666010] nix-daemon[832]: reaped child process 2075, status = succeeded5955worker1 # [ 159.855425] nix-daemon[832]: accepted connection from pid 2090, user nix-grpc-daemon (trusted)5956worker1 # [ 159.871406] nix-daemon[832]: reaped child process 2093, status = succeeded5957lb # [ 159.945529] niks3-server[1020]: 2026/09/20 09:02:51 INFO Received uploads request method=POST path=/api/pending_closures5958worker1 # [ 159.900427] nix-grpc-daemon[1870]: time=2026-09-20T09:02:51.468Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5959worker1 # [ 159.902047] nix-grpc-daemon[1870]: time=2026-09-20T09:02:51.468Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5960lb # [ 159.987178] niks3-server[1020]: 2026/09/20 09:02:51 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5961lb # [ 160.000643] niks3-server[1020]: 2026/09/20 09:02:51 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5962worker1 # [ 159.954777] nix-grpc-daemon[1870]: time=2026-09-20T09:02:51.525Z level=INFO msg="Uploading 1 narinfos"5963lb # [ 160.012359] niks3-server[1020]: 2026/09/20 09:02:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5964lb # [ 160.020173] niks3-server[1020]: 2026/09/20 09:02:51 INFO Signed narinfos id=57 count=15965lb # [ 160.023400] niks3-server[1020]: 2026/09/20 09:02:51 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5966lb # [ 160.036412] niks3-server[1020]: 2026/09/20 09:02:51 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5967lb # [ 160.045039] niks3-server[1020]: 2026/09/20 09:02:51 INFO Completed upload id=575968worker1 # [ 159.987349] nix-grpc-daemon[1870]: time=2026-09-20T09:02:51.557Z level=INFO msg="Upload complete. (357ms)"5969lb # [ 160.048241] niks3-server[1020]: 2026/09/20 09:02:51 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5970worker1 # [ 160.005196] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=15971worker1 # [ 160.023960] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:51Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15972worker1 # [ 160.035529] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565973worker1 # [ 160.041509] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:51Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05974worker1 # [ 160.047241] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532565975worker1 # [ 160.053155] nix-daemon[832]: reaped child process 2073, status = succeeded5976worker1 # [ 160.057196] nix-grpc-daemon[1870]: time=2026-09-20T09:02:51.616Z level=INFO msg="All 2 paths already cached"5977worker1 # [ 160.071461] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532565978worker1 # [ 160.076899] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5979worker1 # [ 160.259730] nix-daemon[832]: accepted connection from pid 2099, user nix-grpc-daemon (trusted)5980worker1 # [ 160.277031] nix-daemon[832]: reaped child process 2102, status = succeeded5981worker1 # [ 160.449706] nix-daemon[832]: accepted connection from pid 2104, user nix-grpc-daemon (trusted)5982worker1 # [ 160.465617] nix-daemon[832]: reaped child process 2107, status = succeeded5983lb # [ 160.534315] niks3-server[1020]: 2026/09/20 09:02:52 INFO Received uploads request method=POST path=/api/pending_closures5984worker1 # [ 160.485351] nix-grpc-daemon[1870]: time=2026-09-20T09:02:52.055Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5985worker1 # [ 160.486841] nix-grpc-daemon[1870]: time=2026-09-20T09:02:52.055Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5986lb # [ 160.559354] niks3-server[1020]: 2026/09/20 09:02:52 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5987worker1 # [ 160.514329] nix-grpc-daemon[1870]: time=2026-09-20T09:02:52.084Z level=INFO msg="Uploading 1 narinfos"5988lb # [ 160.576190] niks3-server[1020]: 2026/09/20 09:02:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5989lb # [ 160.586134] niks3-server[1020]: 2026/09/20 09:02:52 INFO Signed narinfos id=58 count=15990lb # [ 160.591116] niks3-server[1020]: 2026/09/20 09:02:52 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5991lb # [ 160.599385] niks3-server[1020]: 2026/09/20 09:02:52 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5992worker1 # [ 160.545887] nix-grpc-daemon[1870]: time=2026-09-20T09:02:52.116Z level=INFO msg="Upload complete. (465ms)"5993lb # [ 160.604343] niks3-server[1020]: 2026/09/20 09:02:52 INFO Completed upload id=585994lb # [ 160.608008] niks3-server[1020]: 2026/09/20 09:02:52 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5995worker1 # [ 160.552197] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=0 paths=1 nar_bytes_in=7525996worker1 # [ 160.564534] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532565997worker1 # [ 160.571221] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5998worker1 # [ 160.575697] nix-daemon[832]: reaped child process 2097, status = succeeded5999worker1 # [ 160.586382] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)6000worker1 # [ 161.634276] nix-daemon[832]: reaped child process 2111, status = succeeded6001worker1 # [ 161.814312] nix-daemon[832]: accepted connection from pid 2126, user nix-grpc-daemon (trusted)6002worker1 # [ 161.831626] nix-daemon[832]: reaped child process 2129, status = succeeded6003lb # [ 161.902256] niks3-server[1020]: 2026/09/20 09:02:53 INFO Received uploads request method=POST path=/api/pending_closures6004worker1 # [ 161.856387] nix-grpc-daemon[1870]: time=2026-09-20T09:02:53.424Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6005worker1 # [ 161.857938] nix-grpc-daemon[1870]: time=2026-09-20T09:02:53.424Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6006lb # [ 161.943973] niks3-server[1020]: 2026/09/20 09:02:53 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6007lb # [ 161.953719] niks3-server[1020]: 2026/09/20 09:02:53 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6008worker1 # [ 161.907783] nix-grpc-daemon[1870]: time=2026-09-20T09:02:53.478Z level=INFO msg="Uploading 1 narinfos"6009lb # [ 161.969778] niks3-server[1020]: 2026/09/20 09:02:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6010lb # [ 161.978060] niks3-server[1020]: 2026/09/20 09:02:53 INFO Signed narinfos id=59 count=16011lb # [ 161.984289] niks3-server[1020]: 2026/09/20 09:02:53 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6012lb # [ 161.987455] niks3-server[1020]: 2026/09/20 09:02:53 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6013lb # [ 161.991734] niks3-server[1020]: 2026/09/20 09:02:53 INFO Completed upload id=596014lb # [ 161.994417] niks3-server[1020]: 2026/09/20 09:02:53 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6015worker1 # [ 161.933519] nix-grpc-daemon[1870]: time=2026-09-20T09:02:53.504Z level=INFO msg="Upload complete. (335ms)"6016worker1 # [ 161.947115] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=16017worker1 # [ 161.966934] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:53Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16018worker1 # [ 161.970944] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532566019worker1 # [ 161.975594] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532566020worker1 # [ 161.979657] nix-daemon[832]: reaped child process 2109, status = succeeded6021worker1 # [ 161.981433] nix-grpc-daemon[1870]: time=2026-09-20T09:02:53.549Z level=INFO msg="All 2 paths already cached"6022worker1 # [ 161.984720] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532566023worker1 # [ 161.994066] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)6024worker1 # [ 162.172047] nix-daemon[832]: accepted connection from pid 2133, user nix-grpc-daemon (trusted)6025worker1 # [ 162.190935] nix-daemon[832]: reaped child process 2136, status = succeeded6026worker1 # [ 162.361184] nix-daemon[832]: accepted connection from pid 2138, user nix-grpc-daemon (trusted)6027worker1 # [ 162.379482] nix-daemon[832]: reaped child process 2141, status = succeeded6028lb # [ 162.448862] niks3-server[1020]: 2026/09/20 09:02:54 INFO Received uploads request method=POST path=/api/pending_closures6029worker1 # [ 162.399520] nix-grpc-daemon[1870]: time=2026-09-20T09:02:53.969Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6030worker1 # [ 162.401150] nix-grpc-daemon[1870]: time=2026-09-20T09:02:53.969Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6031lb # [ 162.473913] niks3-server[1020]: 2026/09/20 09:02:54 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6032lb # [ 162.486301] niks3-server[1020]: 2026/09/20 09:02:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6033worker1 # [ 162.434060] nix-grpc-daemon[1870]: time=2026-09-20T09:02:54.004Z level=INFO msg="Uploading 1 narinfos"6034lb # [ 162.496203] niks3-server[1020]: 2026/09/20 09:02:54 INFO Signed narinfos id=60 count=16035lb # [ 162.503254] niks3-server[1020]: 2026/09/20 09:02:54 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6036lb # [ 162.512541] niks3-server[1020]: 2026/09/20 09:02:54 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6037lb # [ 162.519148] niks3-server[1020]: 2026/09/20 09:02:54 INFO Completed upload id=606038worker1 # [ 162.461407] nix-grpc-daemon[1870]: time=2026-09-20T09:02:54.031Z level=INFO msg="Upload complete. (457ms)"6039lb # [ 162.521627] niks3-server[1020]: 2026/09/20 09:02:54 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6040worker1 # [ 162.468121] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=0 paths=1 nar_bytes_in=7526041worker1 # [ 162.479426] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532566042worker1 # [ 162.485286] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)6043worker1 # [ 162.489970] nix-daemon[832]: reaped child process 2131, status = succeeded6044worker1 # [ 162.500381] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)6045worker1 # [ 163.721825] nix-daemon[832]: reaped child process 2145, status = succeeded6046worker1 # [ 163.878453] nix-daemon[832]: accepted connection from pid 2160, user nix-grpc-daemon (trusted)6047worker1 # [ 163.896777] nix-daemon[832]: reaped child process 2163, status = succeeded6048lb # [ 163.970623] niks3-server[1020]: 2026/09/20 09:02:55 INFO Received uploads request method=POST path=/api/pending_closures6049worker1 # [ 163.924218] nix-grpc-daemon[1870]: time=2026-09-20T09:02:55.492Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6050worker1 # [ 163.926257] nix-grpc-daemon[1870]: time=2026-09-20T09:02:55.492Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6051lb # [ 164.002562] niks3-server[1020]: 2026/09/20 09:02:55 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6052lb # [ 164.015618] niks3-server[1020]: 2026/09/20 09:02:55 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6053lb # [ 164.030952] niks3-server[1020]: 2026/09/20 09:02:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6054worker1 # [ 163.979114] nix-grpc-daemon[1870]: time=2026-09-20T09:02:55.549Z level=INFO msg="Uploading 1 narinfos"6055lb # [ 164.043568] niks3-server[1020]: 2026/09/20 09:02:55 INFO Signed narinfos id=61 count=16056lb # [ 164.050615] niks3-server[1020]: 2026/09/20 09:02:55 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6057lb # [ 164.058616] niks3-server[1020]: 2026/09/20 09:02:55 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6058lb # [ 164.066799] niks3-server[1020]: 2026/09/20 09:02:55 INFO Completed upload id=616059worker1 # [ 164.009233] nix-grpc-daemon[1870]: time=2026-09-20T09:02:55.579Z level=INFO msg="Upload complete. (298ms)"6060lb # [ 164.070171] niks3-server[1020]: 2026/09/20 09:02:55 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6061worker1 # [ 164.021145] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=16062worker1 # [ 164.036275] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:55Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16063worker1 # [ 164.043240] nix-daemon[832]: reaped child process 2143, status = succeeded6064worker1 # [ 164.062456] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532566065worker1 # [ 164.077291] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532566066worker1 # [ 164.090964] nix-grpc-daemon[1870]: time=2026-09-20T09:02:55.661Z level=INFO msg="All 2 paths already cached"6067worker1 # [ 164.100058] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532566068worker1 # [ 164.113633] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)6069worker1 # [ 164.318764] nix-daemon[832]: accepted connection from pid 2167, user nix-grpc-daemon (trusted)6070worker1 # [ 164.335319] nix-daemon[832]: reaped child process 2170, status = succeeded6071worker1 # [ 164.509208] nix-daemon[832]: accepted connection from pid 2172, user nix-grpc-daemon (trusted)6072worker1 # [ 164.525459] nix-daemon[832]: reaped child process 2175, status = succeeded6073lb # [ 164.595013] niks3-server[1020]: 2026/09/20 09:02:56 INFO Received uploads request method=POST path=/api/pending_closures6074worker1 # [ 164.545674] nix-grpc-daemon[1870]: time=2026-09-20T09:02:56.115Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6075worker1 # [ 164.547167] nix-grpc-daemon[1870]: time=2026-09-20T09:02:56.116Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6076lb # [ 164.619886] niks3-server[1020]: 2026/09/20 09:02:56 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6077worker1 # [ 164.574787] nix-grpc-daemon[1870]: time=2026-09-20T09:02:56.145Z level=INFO msg="Uploading 1 narinfos"6078lb # [ 164.636155] niks3-server[1020]: 2026/09/20 09:02:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6079lb # [ 164.646283] niks3-server[1020]: 2026/09/20 09:02:56 INFO Signed narinfos id=62 count=16080worker1 # [ 164.598840] nix-grpc-daemon[1870]: time=2026-09-20T09:02:56.169Z level=INFO msg="Upload complete. (468ms)"6081lb # [ 164.657210] niks3-server[1020]: 2026/09/20 09:02:56 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6082lb # [ 164.661687] niks3-server[1020]: 2026/09/20 09:02:56 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6083worker1 # [ 164.604265] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=0 paths=1 nar_bytes_in=7526084lb # [ 164.666523] niks3-server[1020]: 2026/09/20 09:02:56 INFO Completed upload id=626085lb # [ 164.668803] niks3-server[1020]: 2026/09/20 09:02:56 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6086worker1 # [ 164.612388] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532566087worker1 # [ 164.624134] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)6088worker1 # [ 164.626459] nix-daemon[832]: reaped child process 2165, status = succeeded6089worker1 # [ 164.639064] nix-daemon[832]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)6090worker1 # [ 165.661610] nix-daemon[832]: reaped child process 2179, status = succeeded6091worker1 # [ 165.817729] nix-daemon[832]: accepted connection from pid 2194, user nix-grpc-daemon (trusted)6092worker1 # [ 165.836452] nix-daemon[832]: reaped child process 2197, status = succeeded6093lb # [ 165.906641] niks3-server[1020]: 2026/09/20 09:02:57 INFO Received uploads request method=POST path=/api/pending_closures6094worker1 # [ 165.860084] nix-grpc-daemon[1870]: time=2026-09-20T09:02:57.428Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6095worker1 # [ 165.861633] nix-grpc-daemon[1870]: time=2026-09-20T09:02:57.428Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6096lb # [ 165.936320] niks3-server[1020]: 2026/09/20 09:02:57 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6097lb # [ 165.949854] niks3-server[1020]: 2026/09/20 09:02:57 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6098worker1 # [ 165.913649] nix-grpc-daemon[1870]: time=2026-09-20T09:02:57.483Z level=INFO msg="Uploading 1 narinfos"6099lb # [ 165.964145] niks3-server[1020]: 2026/09/20 09:02:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6100lb # [ 165.977086] niks3-server[1020]: 2026/09/20 09:02:57 INFO Signed narinfos id=63 count=16101lb # [ 165.980004] niks3-server[1020]: 2026/09/20 09:02:57 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6102lb # [ 165.991507] niks3-server[1020]: 2026/09/20 09:02:57 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6103lb # [ 165.998158] niks3-server[1020]: 2026/09/20 09:02:57 INFO Completed upload id=636104worker1 # [ 165.939688] nix-grpc-daemon[1870]: time=2026-09-20T09:02:57.510Z level=INFO msg="Upload complete. (291ms)"6105lb # [ 166.001164] niks3-server[1020]: 2026/09/20 09:02:57 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6106worker1 # [ 165.952746] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53256 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=16107worker1 # [ 165.968617] nix-daemon[832]: reaped child process 2177, status = succeeded6108client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.56 seconds)6109worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6110worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.08 seconds)6111client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16112worker2 # [ 166.366891] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:376526113worker1 # [ 166.373671] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:57Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06114client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.30 seconds)6115(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 20.95 seconds)6116subtest: low disk drains a worker and builds go to the other6117worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6118worker2 # [ 166.373632] nix-grpc-daemon[1161]: ts=2026-09-20T09:02:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376526119worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.14 seconds)6120worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6121worker1 # [ 168.133620] nix-grpc-daemon[1807]: ts=2026-09-20T09:02:59Z level=info event=unhealthy reason=min_free6122worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds)6123client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26124client # don't know how to build these paths:6125client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6126worker2 # [ 168.935317] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:376526127worker2 # [ 168.943694] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376526128worker1 # [ 168.944726] nix-grpc-daemon[1807]: ts=2026-09-20T09:03:00Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06129worker1 # [ 168.951819] nix-grpc-daemon[1807]: ts=2026-09-20T09:03:00Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16130worker2 # [ 169.017130] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376526131worker2 # [ 169.032121] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376526132client # copying 1 paths to 'lb:50051'...6133client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6134worker2 # [ 169.048552] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:376526135worker2 # [ 169.063378] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)6136worker2 # [ 169.271528] nix-daemon[836]: accepted connection from pid 1486, user nix-grpc-daemon (trusted)6137worker2 # [ 169.290612] nix-daemon[836]: reaped child process 1489, status = succeeded6138worker2 # [ 169.463348] nix-daemon[836]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)6139worker2 # [ 169.478830] nix-daemon[836]: reaped child process 1494, status = succeeded6140lb # [ 169.534206] niks3-server[1020]: 2026/09/20 09:03:01 INFO Received uploads request method=POST path=/api/pending_closures6141worker2 # [ 169.505509] nix-grpc-daemon[1305]: time=2026-09-20T09:03:01.075Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6142worker2 # [ 169.506977] nix-grpc-daemon[1305]: time=2026-09-20T09:03:01.075Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6143worker2 # [ 169.535889] nix-grpc-daemon[1305]: time=2026-09-20T09:03:01.105Z level=INFO msg="Uploading 1 narinfos"6144lb # [ 169.567105] niks3-server[1020]: 2026/09/20 09:03:01 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6145lb # [ 169.581351] niks3-server[1020]: 2026/09/20 09:03:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6146lb # [ 169.590278] niks3-server[1020]: 2026/09/20 09:03:01 INFO Signed narinfos id=64 count=16147lb # [ 169.595868] niks3-server[1020]: 2026/09/20 09:03:01 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6148worker2 # [ 169.564751] nix-grpc-daemon[1305]: time=2026-09-20T09:03:01.134Z level=INFO msg="Upload complete. (484ms)"6149lb # [ 169.603916] niks3-server[1020]: 2026/09/20 09:03:01 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6150lb # [ 169.613128] niks3-server[1020]: 2026/09/20 09:03:01 INFO Completed upload id=646151lb # [ 169.616731] niks3-server[1020]: 2026/09/20 09:03:01 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6152worker2 # [ 169.572130] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=0 paths=1 nar_bytes_in=5126153worker2 # [ 169.584705] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376526154worker2 # [ 169.591040] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)6155worker2 # [ 169.595697] nix-daemon[836]: reaped child process 1484, status = succeeded6156client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6157client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6158worker2 # [ 169.608187] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)6159client # farm-a> LOG-farm-a-drain6160worker2 # [ 170.837513] nix-daemon[836]: reaped child process 1498, status = succeeded6161worker2 # [ 171.008817] nix-daemon[836]: accepted connection from pid 1513, user nix-grpc-daemon (trusted)6162worker2 # [ 171.025893] nix-daemon[836]: reaped child process 1516, status = succeeded6163lb # [ 171.078402] niks3-server[1020]: 2026/09/20 09:03:02 INFO Received uploads request method=POST path=/api/pending_closures6164worker2 # [ 171.051269] nix-grpc-daemon[1305]: time=2026-09-20T09:03:02.618Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6165worker2 # [ 171.052891] nix-grpc-daemon[1305]: time=2026-09-20T09:03:02.618Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6166lb # [ 171.119983] niks3-server[1020]: 2026/09/20 09:03:02 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6167worker2 # [ 171.090471] nix-grpc-daemon[1305]: time=2026-09-20T09:03:02.660Z level=INFO msg="Uploading 1 narinfos"6168lb # [ 171.131641] niks3-server[1020]: 2026/09/20 09:03:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6169lb # [ 171.141440] niks3-server[1020]: 2026/09/20 09:03:02 INFO Signed narinfos id=65 count=16170lb # [ 171.145762] niks3-server[1020]: 2026/09/20 09:03:02 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6171worker2 # [ 171.114988] nix-grpc-daemon[1305]: time=2026-09-20T09:03:02.685Z level=INFO msg="Upload complete. (297ms)"6172lb # [ 171.154127] niks3-server[1020]: 2026/09/20 09:03:02 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6173lb # [ 171.159031] niks3-server[1020]: 2026/09/20 09:03:02 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6174lb # [ 171.162978] niks3-server[1020]: 2026/09/20 09:03:02 INFO Completed upload id=656175lb # [ 171.165195] niks3-server[1020]: 2026/09/20 09:03:02 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6176worker2 # [ 171.124945] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=16177worker1 # [ 171.114860] nix-grpc-daemon[1807]: ts=2026-09-20T09:03:02Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06178worker2 # [ 171.138772] nix-daemon[836]: reaped child process 1496, status = succeeded6179worker1 # [ 171.120472] nix-grpc-daemon[1807]: ts=2026-09-20T09:03:02Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16180worker2 # [ 171.176814] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376526181worker2 # [ 171.191763] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376526182worker2 # [ 171.207693] nix-grpc-daemon[1305]: time=2026-09-20T09:03:02.777Z level=INFO msg="All 1 paths already cached"6183client # copying 1 paths to 'lb:50051'...6184client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6185worker2 # [ 171.218212] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:376526186worker2 # [ 171.232671] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)6187lb # [ 171.288933] envoy[912]: conn peer=[2001:db8:1::1]:55734 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27131 tx=10742 ms=202646188lb # [ 171.295723] envoy[912]: conn peer=[2001:db8:1::1]:46360 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=880 tx=482 ms=476189worker2 # [ 171.440221] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6190worker2 # [ 171.458798] nix-daemon[836]: reaped child process 1523, status = succeeded6191worker2 # [ 171.632637] nix-daemon[836]: accepted connection from pid 1525, user nix-grpc-daemon (trusted)6192worker2 # [ 171.648385] nix-daemon[836]: reaped child process 1528, status = succeeded6193lb # [ 171.701183] niks3-server[1020]: 2026/09/20 09:03:03 INFO Received uploads request method=POST path=/api/pending_closures6194worker2 # [ 171.671275] nix-grpc-daemon[1305]: time=2026-09-20T09:03:03.241Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6195worker2 # [ 171.672894] nix-grpc-daemon[1305]: time=2026-09-20T09:03:03.241Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6196lb # [ 171.729189] niks3-server[1020]: 2026/09/20 09:03:03 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6197lb # [ 171.741128] niks3-server[1020]: 2026/09/20 09:03:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6198worker2 # [ 171.708918] nix-grpc-daemon[1305]: time=2026-09-20T09:03:03.278Z level=INFO msg="Uploading 1 narinfos"6199lb # [ 171.751481] niks3-server[1020]: 2026/09/20 09:03:03 INFO Signed narinfos id=66 count=16200lb # [ 171.758642] niks3-server[1020]: 2026/09/20 09:03:03 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6201lb # [ 171.768481] niks3-server[1020]: 2026/09/20 09:03:03 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6202lb # [ 171.775275] niks3-server[1020]: 2026/09/20 09:03:03 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6203lb # [ 171.781701] niks3-server[1020]: 2026/09/20 09:03:03 INFO Completed upload id=666204worker2 # [ 171.742834] nix-grpc-daemon[1305]: time=2026-09-20T09:03:03.312Z level=INFO msg="Upload complete. (491ms)"6205worker2 # [ 171.750534] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=0 paths=1 nar_bytes_in=6326206worker2 # [ 171.763550] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376526207worker2 # [ 171.769913] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)6208worker2 # [ 171.774575] nix-daemon[836]: reaped child process 1518, status = succeeded6209client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6210worker2 # [ 171.786377] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)6211client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6212client # farm-b> LOG-farm-b-drain6213worker2 # [ 172.617959] nix-daemon[836]: reaped child process 1532, status = succeeded6214worker2 # [ 172.778605] nix-daemon[836]: accepted connection from pid 1547, user nix-grpc-daemon (trusted)6215worker2 # [ 172.796322] nix-daemon[836]: reaped child process 1550, status = succeeded6216lb # [ 172.851418] niks3-server[1020]: 2026/09/20 09:03:04 INFO Received uploads request method=POST path=/api/pending_closures6217worker2 # [ 172.824383] nix-grpc-daemon[1305]: time=2026-09-20T09:03:04.391Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6218worker2 # [ 172.825848] nix-grpc-daemon[1305]: time=2026-09-20T09:03:04.391Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6219lb # [ 172.899987] niks3-server[1020]: 2026/09/20 09:03:04 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6220worker2 # [ 172.872919] nix-grpc-daemon[1305]: time=2026-09-20T09:03:04.442Z level=INFO msg="Uploading 1 narinfos"6221lb # [ 172.912444] niks3-server[1020]: 2026/09/20 09:03:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6222lb # [ 172.923656] niks3-server[1020]: 2026/09/20 09:03:04 INFO Signed narinfos id=67 count=16223lb # [ 172.928878] niks3-server[1020]: 2026/09/20 09:03:04 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6224lb # [ 172.932776] niks3-server[1020]: 2026/09/20 09:03:04 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6225lb # [ 172.938697] niks3-server[1020]: 2026/09/20 09:03:04 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6226lb # [ 172.942856] niks3-server[1020]: 2026/09/20 09:03:04 INFO Completed upload id=676227worker2 # [ 172.903910] nix-grpc-daemon[1305]: time=2026-09-20T09:03:04.474Z level=INFO msg="Upload complete. (303ms)"6228lb # [ 172.945316] niks3-server[1020]: 2026/09/20 09:03:04 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6229worker2 # [ 172.913077] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=16230worker1 # [ 172.900932] nix-grpc-daemon[1807]: ts=2026-09-20T09:03:04Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06231worker1 # [ 172.906826] nix-grpc-daemon[1807]: ts=2026-09-20T09:03:04Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16232worker2 # [ 172.931418] nix-daemon[836]: reaped child process 1530, status = succeeded6233worker2 # [ 172.965014] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376526234worker2 # [ 172.980260] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376526235worker2 # [ 172.993776] nix-grpc-daemon[1305]: time=2026-09-20T09:03:04.563Z level=INFO msg="All 2 paths already cached"6236client # copying 1 paths to 'lb:50051'...6237client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6238worker2 # [ 173.003615] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:376526239worker2 # [ 173.017467] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)6240worker2 # [ 173.216918] nix-daemon[836]: accepted connection from pid 1554, user nix-grpc-daemon (trusted)6241worker2 # [ 173.236469] nix-daemon[836]: reaped child process 1557, status = succeeded6242worker2 # [ 173.407682] nix-daemon[836]: accepted connection from pid 1559, user nix-grpc-daemon (trusted)6243worker2 # [ 173.423564] nix-daemon[836]: reaped child process 1562, status = succeeded6244lb # [ 173.476819] niks3-server[1020]: 2026/09/20 09:03:05 INFO Received uploads request method=POST path=/api/pending_closures6245worker2 # [ 173.446277] nix-grpc-daemon[1305]: time=2026-09-20T09:03:05.016Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6246worker2 # [ 173.447741] nix-grpc-daemon[1305]: time=2026-09-20T09:03:05.016Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6247lb # [ 173.505172] niks3-server[1020]: 2026/09/20 09:03:05 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6248worker2 # [ 173.478312] nix-grpc-daemon[1305]: time=2026-09-20T09:03:05.048Z level=INFO msg="Uploading 1 narinfos"6249lb # [ 173.520608] niks3-server[1020]: 2026/09/20 09:03:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6250lb # [ 173.531357] niks3-server[1020]: 2026/09/20 09:03:05 INFO Signed narinfos id=68 count=16251lb # [ 173.539107] niks3-server[1020]: 2026/09/20 09:03:05 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6252worker2 # [ 173.503902] nix-grpc-daemon[1305]: time=2026-09-20T09:03:05.074Z level=INFO msg="Upload complete. (470ms)"6253lb # [ 173.543740] niks3-server[1020]: 2026/09/20 09:03:05 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6254lb # [ 173.549021] niks3-server[1020]: 2026/09/20 09:03:05 INFO Completed upload id=686255worker2 # [ 173.512234] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=0 paths=1 nar_bytes_in=7606256lb # [ 173.552114] niks3-server[1020]: 2026/09/20 09:03:05 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6257worker2 # [ 173.522089] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376526258worker2 # [ 173.528902] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)6259worker2 # [ 173.533208] nix-daemon[836]: reaped child process 1552, status = succeeded6260client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6261worker2 # [ 173.545993] nix-daemon[836]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)6262client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6263client # farm-top> LOG-farm-top-drain6264worker2 # [ 174.790530] nix-daemon[836]: reaped child process 1566, status = succeeded6265worker2 # [ 174.968125] nix-daemon[836]: accepted connection from pid 1581, user nix-grpc-daemon (trusted)6266worker2 # [ 174.985775] nix-daemon[836]: reaped child process 1584, status = succeeded6267lb # [ 175.037080] niks3-server[1020]: 2026/09/20 09:03:06 INFO Received uploads request method=POST path=/api/pending_closures6268worker2 # [ 175.010724] nix-grpc-daemon[1305]: time=2026-09-20T09:03:06.579Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6269worker2 # [ 175.012737] nix-grpc-daemon[1305]: time=2026-09-20T09:03:06.579Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6270lb # [ 175.070309] niks3-server[1020]: 2026/09/20 09:03:06 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6271lb # [ 175.082539] niks3-server[1020]: 2026/09/20 09:03:06 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6272lb # [ 175.094051] niks3-server[1020]: 2026/09/20 09:03:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6273worker2 # [ 175.060531] nix-grpc-daemon[1305]: time=2026-09-20T09:03:06.630Z level=INFO msg="Uploading 1 narinfos"6274lb # [ 175.104270] niks3-server[1020]: 2026/09/20 09:03:06 INFO Signed narinfos id=69 count=16275lb # [ 175.106779] niks3-server[1020]: 2026/09/20 09:03:06 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6276lb # [ 175.116282] niks3-server[1020]: 2026/09/20 09:03:06 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6277lb # [ 175.122170] niks3-server[1020]: 2026/09/20 09:03:06 INFO Completed upload id=696278worker2 # [ 175.083262] nix-grpc-daemon[1305]: time=2026-09-20T09:03:06.653Z level=INFO msg="Upload complete. (327ms)"6279lb # [ 175.125670] niks3-server[1020]: 2026/09/20 09:03:06 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6280worker2 # [ 175.097172] nix-grpc-daemon[1161]: ts=2026-09-20T09:03:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37652 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=16281worker2 # [ 175.112325] nix-daemon[836]: reaped child process 1564, status = succeeded6282client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.45 seconds)6283client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6284client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds)6285worker1: must succeed: rm /nix/.rw-store/fill6286worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6287worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6288worker1 # [ 176.143605] nix-grpc-daemon[1807]: ts=2026-09-20T09:03:07Z level=info event=healthy reason=min_free6289worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6290(finished: subtest: low disk drains a worker and builds go to the other, in 10.32 seconds)6291(finished: run the VM test script, in 177.67 seconds)6292test script finished in 177.96s6293cleanup6294kill QemuMachine (pid 50)6295client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6296kill QemuMachine (pid 49)6297lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6298kill QemuMachine (pid 51)6299worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6300kill QemuMachine (pid 52)6301worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6302(finished: cleanup, in 1.21 seconds)6303additionally exposed symbols:6304 client, lb, worker1, worker2,6305 vlan1,6306 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh