vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #277
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13client # Formatting '/build/vm-state-client/tmp.eGWGSa3qhl', fmt=raw size=107374182414client: QEMU running (pid 49)15worker1 # Disk image does not exist, creating the virtualisation disk image...16worker2 # Disk image does not exist, creating the virtualisation disk image...17lb # Disk image does not exist, creating the virtualisation disk image...18worker1 # Formatting '/build/vm-state-worker1/tmp.CWkteXR4Cx', fmt=raw size=107374182419worker1: QEMU running (pid 52)20worker2 # Formatting '/build/vm-state-worker2/tmp.MlipCtExtx', fmt=raw size=107374182421lb # Formatting '/build/vm-state-lb/tmp.dyTHNZiaXE', fmt=raw size=107374182422worker1 # mke2fs 1.47.4 (6-Mar-2025)23client # mke2fs 1.47.4 (6-Mar-2025)24worker2: QEMU running (pid 51)25lb: QEMU running (pid 50)26worker2 # mke2fs 1.47.4 (6-Mar-2025)27lb # mke2fs 1.47.4 (6-Mar-2025)28client # Discarding device blocks: 0/262144 done29worker1 # Discarding device blocks: 0/262144 done30worker2 # Discarding device blocks: 0/262144 done31(finished: start all VMs, in 0.46 seconds)32worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes33worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes34client: waiting for unit network-addresses-eth1.service35worker1 # Filesystem UUID: cdabd6ab-a86f-4aee-a7be-f2bbcb02225236worker2 # Filesystem UUID: ebc981a5-c744-4b44-9a0f-db7807dd89a537client: waiting for the VM to finish booting38worker1 # Superblock backups stored on blocks:39worker2 # Superblock backups stored on blocks:40client # Creating filesystem with 262144 4k blocks and 65536 inodes41lb # Discarding device blocks: 0/262144 done42worker1 # 32768, 98304, 163840, 22937643worker2 # 32768, 98304, 163840, 22937644client # Filesystem UUID: 459c0bb6-c725-42d8-b253-0a9ab86755fd45lb # Creating filesystem with 262144 4k blocks and 65536 inodes46worker1 # 47worker2 # 48client # Superblock backups stored on blocks:49lb # Filesystem UUID: 24367d81-74ac-478d-a09f-1f4e8390f8c950worker1 # Allocating group tables: 0/8 done51worker1 # Writing inode tables: 0/8 done52worker2 # Allocating group tables: 0/8 done53lb # Superblock backups stored on blocks:54worker1 # Creating journal (8192 blocks): done55client # 32768, 98304, 163840, 22937656worker1 # Writing superblocks and filesystem accounting information: 0/8 done57client # 58lb # 32768, 98304, 163840, 22937659worker2 # Writing inode tables: 0/8 done60worker1 # 61client # Allocating group tables: 0/8 done62lb # 63worker2 # Creating journal (8192 blocks): done64worker1 # Virtualisation disk image created.65client # Writing inode tables: 0/8 done66lb # Allocating group tables: 0/8 done67client # Creating journal (8192 blocks): done68lb # Writing inode tables: 0/8 done69client # Writing superblocks and filesystem accounting information: 0/8 done70lb # Creating journal (8192 blocks): done71client # 72lb # Writing superblocks and filesystem accounting information: 0/8 done73client # Virtualisation disk image created.74lb # 75worker2 # Writing superblocks and filesystem accounting information: 0/8 done76lb # Virtualisation disk image created.77worker2 # 78worker2 # Virtualisation disk image created.79worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker1 # [ 0.000000] KASLR enabled82worker1 # [ 0.000000] random: crng init done83worker1 # [ 0.000000] Machine model: linux,dummy-virt84worker1 # [ 0.000000] efi: UEFI not found.85worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]89worker1 # [ 0.000000] Zone ranges:90worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]91worker1 # [ 0.000000] DMA32 empty92client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202693worker1 # [ 0.000000] Normal empty94client # [ 0.000000] KASLR enabled95worker1 # [ 0.000000] Device empty96client # [ 0.000000] random: crng init done97worker1 # [ 0.000000] Movable zone start for each node98client # [ 0.000000] Machine model: linux,dummy-virt99worker1 # [ 0.000000] Early memory node ranges100client # [ 0.000000] efi: UEFI not found.101worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]102client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT103worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]104client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]105worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000106client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]107worker1 # [ 0.000000] psci: probing for conduit method from DT.108client # [ 0.000000] Zone ranges:109worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.110client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]111worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs112client # [ 0.000000] DMA32 empty113client # [ 0.000000] Normal empty114worker1 # [ 0.000000] psci: Trusted OS migration not required115client # [ 0.000000] Device empty116worker1 # [ 0.000000] psci: SMC Calling Convention v1.1117client # [ 0.000000] Movable zone start for each node118client # [ 0.000000] Early memory node ranges119worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]120worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)121client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]122worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296123client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]124worker1 # [ 0.000000] Detected PIPT I-cache on CPU0125worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026126client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000127worker2 # [ 0.000000] KASLR enabled128lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]129worker2 # [ 0.000000] random: crng init done130worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)131client # [ 0.000000] psci: probing for conduit method from DT.132worker2 # [ 0.000000] Machine model: linux,dummy-virt133worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface134client # [ 0.000000] psci: PSCIv1.3 detected in firmware.135worker2 # [ 0.000000] efi: UEFI not found.136worker1 # [ 0.000000] CPU features: detected: Spectre-v4137client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs138lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026139worker1 # [ 0.000000] CPU features: detected: Spectre-BHB140worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT141lb # [ 0.000000] KASLR enabled142client # [ 0.000000] psci: Trusted OS migration not required143lb # [ 0.000000] random: crng init done144worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38145client # [ 0.000000] psci: SMC Calling Convention v1.1146lb # [ 0.000000] Machine model: linux,dummy-virt147worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]148lb # [ 0.000000] efi: UEFI not found.149worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23150worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]151client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)152worker2 # [ 0.000000] Zone ranges:153worker1 # [ 0.000000] alternatives: applying boot alternatives154lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT155worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]156client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296157worker2 # [ 0.000000] DMA32 empty158lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]159client # [ 0.000000] Detected PIPT I-cache on CPU0160worker2 # [ 0.000000] Normal empty161worker2 # [ 0.000000] Device empty162lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]163lb # [ 0.000000] Zone ranges:164worker2 # [ 0.000000] Movable zone start for each node165client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)166worker2 # [ 0.000000] Early memory node ranges167client # [ 0.000000] CPU features: detected: GICv3 CPU interface168lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]169lb # [ 0.000000] DMA32 empty170client # [ 0.000000] CPU features: detected: Spectre-v4171worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]172lb # [ 0.000000] Normal empty173worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bd8l1brw989alvvrp02daysj9ckfky9v-nixos-system-worker1-test/init regInfo=/nix/store/d8yni1hr6dr8cwacx46vd28l4c239im6-closure-info/registration console=ttyAMA0,115200n8 console=tty0174client # [ 0.000000] CPU features: detected: Spectre-BHB175lb # [ 0.000000] Device empty176worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]177lb # [ 0.000000] Movable zone start for each node178client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38179lb # [ 0.000000] Early memory node ranges180worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000181client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23182worker2 # [ 0.000000] psci: probing for conduit method from DT.183lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]184client # [ 0.000000] alternatives: applying boot alternatives185worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.186worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/d8yni1hr6dr8cwacx46vd28l4c239im6-closure-info/registration", will be passed to user space.187lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]188worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs189worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes190lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000191worker2 # [ 0.000000] psci: Trusted OS migration not required192lb # [ 0.000000] psci: probing for conduit method from DT.193worker2 # [ 0.000000] psci: SMC Calling Convention v1.1194worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)195lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.196worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)197worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)198lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs199lb # [ 0.000000] psci: Trusted OS migration not required200worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB201client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test/init regInfo=/nix/store/5w5n39zm4lsx78izjimsskk5ypfszqda-closure-info/registration console=ttyAMA0,115200n8 console=tty0202worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296203lb # [ 0.000000] psci: SMC Calling Convention v1.1204worker2 # [ 0.000000] Detected PIPT I-cache on CPU0205worker1 # [ 0.000000] software IO TLB: area num 1.206worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB207worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)208lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)209client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/5w5n39zm4lsx78izjimsskk5ypfszqda-closure-info/registration", will be passed to user space.210worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface211worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)212lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296213worker2 # [ 0.000000] CPU features: detected: Spectre-v4214worker1 # [ 0.000000] Fallback order for Node 0: 0215lb # [ 0.000000] Detected PIPT I-cache on CPU0216worker2 # [ 0.000000] CPU features: detected: Spectre-BHB217client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes218worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216219lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)220worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38221worker1 # [ 0.000000] Policy zone: DMA222client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)223lb # [ 0.000000] CPU features: detected: GICv3 CPU interface224worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23225worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off226lb # [ 0.000000] CPU features: detected: Spectre-v4227worker2 # [ 0.000000] alternatives: applying boot alternatives228client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)229worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1230lb # [ 0.000000] CPU features: detected: Spectre-BHB231worker1 # [ 0.000000] allocated 3145728 bytes of page_ext232client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB233lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38234client # [ 0.000000] software IO TLB: area num 1.235worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages236lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23237worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups238client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB239lb # [ 0.000000] alternatives: applying boot alternatives240worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.241client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)242worker1 # [ 0.000000] rcu: RCU event tracing is enabled.243client # [ 0.000000] Fallback order for Node 0: 0244worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/653izmi0ka8dwac3kpqd66p1v4c6d633-nixos-system-worker2-test/init regInfo=/nix/store/a21z6nrlwrspnl4pf7fkqnw4r5z0paf2-closure-info/registration console=ttyAMA0,115200n8 console=tty0245worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.246client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216247worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.248client # [ 0.000000] Policy zone: DMA249worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.250client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off251worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.252worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/a21z6nrlwrspnl4pf7fkqnw4r5z0paf2-closure-info/registration", will be passed to user space.253client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1254lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1y76sp58sczakc84qnb2p7nq6lq4cpg2-nixos-system-lb-test/init regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration console=ttyAMA0,115200n8 console=tty0255worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.256worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes257client # [ 0.000000] allocated 3145728 bytes of page_ext258worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1259worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)260client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages261lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration", will be passed to user space.262client # [ 0.000000] ftrace: allocated 294 pages with 4 groups263worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.264worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)265client # [ 0.000000] rcu: Hierarchical RCU implementation.266lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes267worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB268client # [ 0.000000] rcu: RCU event tracing is enabled.269worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.270worker2 # [ 0.000000] software IO TLB: area num 1.271lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)272client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.273worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB274worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.275client # [ 0.000000] Trampoline variant of Tasks RCU enabled.276lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)277client # [ 0.000000] Rude variant of Tasks RCU enabled.278worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0279worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)280worker1 # [ 0.000000] GICv3: 256 SPIs implemented281worker2 # [ 0.000000] Fallback order for Node 0: 0282client # [ 0.000000] Tracing variant of Tasks RCU enabled.283worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented284lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB285client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.286worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216287worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq288lb # [ 0.000000] software IO TLB: area num 1.289worker2 # [ 0.000000] Policy zone: DMA290worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI291client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1292lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB293worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off294worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0295client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.296lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)297worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1298worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000299lb # [ 0.000000] Fallback order for Node 0: 0300worker2 # [ 0.000000] allocated 3145728 bytes of page_ext301worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]302client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.303worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages304lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216305lb # [ 0.000000] Policy zone: DMA306worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups307worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)308client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.309worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.310lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off311client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0312worker2 # [ 0.000000] rcu: RCU event tracing is enabled.313worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)314client # [ 0.000000] GICv3: 256 SPIs implemented315lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1316worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000317worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.318lb # [ 0.000000] allocated 3145728 bytes of page_ext319client # [ 0.000000] GICv3: 0 Extended SPIs implemented320client # [ 0.000000] Root IRQ handler: gic_handle_irq321worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.322lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages323worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000324client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI325worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.326lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups327worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.328client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0329worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.330lb # [ 0.000000] rcu: Hierarchical RCU implementation.331lb # [ 0.000000] rcu: RCU event tracing is enabled.332client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000333worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.334worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns335client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]336lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.337worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1338worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).339lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.340client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)341lb # [ 0.000000] Rude variant of Tasks RCU enabled.342worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.343worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns344lb # [ 0.000000] Tracing variant of Tasks RCU enabled.345client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)346worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.347lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.348worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns349client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000350worker1 # [ 0.000031] arm-pv: using stolen time PV351lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1352worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.353client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000354worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0355worker1 # [ 0.000547] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)356client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.357lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.358worker2 # [ 0.000000] GICv3: 256 SPIs implemented359worker1 # [ 0.000725] Console: colour dummy device 80x25360worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented361worker1 # [ 0.000733] printk: legacy console [tty0] enabled362lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.363worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq364client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns365worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI366client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).367worker1 # [ 0.000929] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)368lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.369worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0370worker1 # [ 0.000936] pid_max: default: 32768 minimum: 301371lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0372worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000373client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns374lb # [ 0.000000] GICv3: 256 SPIs implemented375worker1 # [ 0.001014] LSM: initializing lsm=capability,landlock,yama,bpf,ima376worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]377lb # [ 0.000000] GICv3: 0 Extended SPIs implemented378worker1 # [ 0.001165] landlock: Up and running.379client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns380worker1 # [ 0.001168] Yama: becoming mindful.381lb # [ 0.000000] Root IRQ handler: gic_handle_irq382client # [ 0.000032] arm-pv: using stolen time PV383worker1 # [ 0.001740] LSM support for eBPF active384worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)385lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI386lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0387worker1 # [ 0.001888] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)388client # [ 0.000443] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)389worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)390lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000391client # [ 0.000606] Console: colour dummy device 80x25392worker1 # [ 0.001922] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)393worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000394client # [ 0.000614] printk: legacy console [tty0] enabled395lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]396worker1 # [ 0.003079] cacheinfo: Unable to detect cache hierarchy for CPU 0397worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000398worker1 # [ 0.003838] rcu: Hierarchical SRCU implementation.399lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)400client # [ 0.000806] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)401worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.402worker1 # [ 0.003842] rcu: Max phase no-delay instances is 1000.403client # [ 0.000812] pid_max: default: 32768 minimum: 301404worker1 # [ 0.005047] fsl-mc MSI: its@8080000 domain created405lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)406worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns407worker1 # [ 0.005139] EFI services will not be available.408client # [ 0.000907] LSM: initializing lsm=capability,landlock,yama,bpf,ima409lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000410client # [ 0.001053] landlock: Up and running.411worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).412worker1 # [ 0.005254] smp: Bringing up secondary CPUs ...413client # [ 0.001056] Yama: becoming mindful.414worker1 # [ 0.005262] smp: Brought up 1 node, 1 CPU415lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000416client # [ 0.001541] LSM support for eBPF active417worker1 # [ 0.005265] SMP: Total of 1 processors activated.418worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns419lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.420client # [ 0.001678] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)421worker1 # [ 0.005271] CPU: All CPU(s) started at EL1422worker1 # [ 0.005282] CPU features: detected: Branch Target Identification423worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns424client # [ 0.001717] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)425lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns426worker2 # [ 0.000028] arm-pv: using stolen time PV427worker1 # [ 0.005287] CPU features: detected: ARMv8.4 Translation Table Level428client # [ 0.002837] cacheinfo: Unable to detect cache hierarchy for CPU 0429lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).430client # [ 0.003567] rcu: Hierarchical SRCU implementation.431worker2 # [ 0.000399] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)432worker1 # [ 0.005291] CPU features: detected: Instruction cache invalidation not required for I/D coherence433client # [ 0.003571] rcu: Max phase no-delay instances is 1000.434worker2 # [ 0.000567] Console: colour dummy device 80x25435lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns436client # [ 0.004787] fsl-mc MSI: its@8080000 domain created437worker1 # [ 0.005294] CPU features: detected: Data cache clean to the PoU not required for I/D coherence438worker2 # [ 0.000575] printk: legacy console [tty0] enabled439client # [ 0.004874] EFI services will not be available.440lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns441worker1 # [ 0.005298] CPU features: detected: Common not Private translations442lb # [ 0.000030] arm-pv: using stolen time PV443client # [ 0.004987] smp: Bringing up secondary CPUs ...444worker2 # [ 0.000772] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)445worker1 # [ 0.005301] CPU features: detected: CRC32 instructions446client # [ 0.004995] smp: Brought up 1 node, 1 CPU447worker2 # [ 0.000779] pid_max: default: 32768 minimum: 301448client # [ 0.004998] SMP: Total of 1 processors activated.449lb # [ 0.000398] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)450worker1 # [ 0.005304] CPU features: detected: Data cache clean to Point of Deep Persistence451client # [ 0.005003] CPU: All CPU(s) started at EL1452worker2 # [ 0.000846] LSM: initializing lsm=capability,landlock,yama,bpf,ima453lb # [ 0.000536] Console: colour dummy device 80x25454worker2 # [ 0.000963] landlock: Up and running.455worker1 # [ 0.005308] CPU features: detected: Data cache clean to Point of Persistence456client # [ 0.005014] CPU features: detected: Branch Target Identification457lb # [ 0.000544] printk: legacy console [tty0] enabled458worker2 # [ 0.000966] Yama: becoming mindful.459worker2 # [ 0.001402] LSM support for eBPF active460worker1 # [ 0.005311] CPU features: detected: Data independent timing control (DIT)461client # [ 0.005019] CPU features: detected: ARMv8.4 Translation Table Level462worker1 # [ 0.005314] CPU features: detected: E0PD463lb # [ 0.000730] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)464worker2 # [ 0.001542] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)465client # [ 0.005022] CPU features: detected: Instruction cache invalidation not required for I/D coherence466lb # [ 0.000736] pid_max: default: 32768 minimum: 301467worker1 # [ 0.005316] CPU features: detected: Enhanced Counter Virtualization468worker2 # [ 0.001574] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)469lb # [ 0.000812] LSM: initializing lsm=capability,landlock,yama,bpf,ima470client # [ 0.005026] CPU features: detected: Data cache clean to the PoU not required for I/D coherence471worker1 # [ 0.005319] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)472lb # [ 0.000949] landlock: Up and running.473worker2 # [ 0.002665] cacheinfo: Unable to detect cache hierarchy for CPU 0474lb # [ 0.000952] Yama: becoming mindful.475client # [ 0.005029] CPU features: detected: Common not Private translations476worker1 # [ 0.005322] CPU features: detected: Enhanced Virtualization Traps477worker2 # [ 0.003392] rcu: Hierarchical SRCU implementation.478lb # [ 0.001399] LSM support for eBPF active479worker1 # [ 0.005325] CPU features: detected: Fine Grained Traps480client # [ 0.005033] CPU features: detected: CRC32 instructions481worker2 # [ 0.003396] rcu: Max phase no-delay instances is 1000.482lb # [ 0.001522] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)483worker2 # [ 0.004587] fsl-mc MSI: its@8080000 domain created484client # [ 0.005036] CPU features: detected: Data cache clean to Point of Deep Persistence485worker1 # [ 0.005329] CPU features: detected: Generic authentication (architected QARMA5 algorithm)486worker2 # [ 0.004674] EFI services will not be available.487worker1 # [ 0.005335] CPU features: detected: RCpc load-acquire (LDAPR)488lb # [ 0.001559] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)489client # [ 0.005039] CPU features: detected: Data cache clean to Point of Persistence490worker2 # [ 0.004794] smp: Bringing up secondary CPUs ...491worker1 # [ 0.005338] CPU features: detected: LSE atomic instructions492lb # [ 0.002622] cacheinfo: Unable to detect cache hierarchy for CPU 0493worker2 # [ 0.004801] smp: Brought up 1 node, 1 CPU494client # [ 0.005042] CPU features: detected: Data independent timing control (DIT)495lb # [ 0.003346] rcu: Hierarchical SRCU implementation.496worker1 # [ 0.005341] CPU features: detected: Privileged Access Never497worker2 # [ 0.004805] SMP: Total of 1 processors activated.498client # [ 0.005045] CPU features: detected: E0PD499worker2 # [ 0.004810] CPU: All CPU(s) started at EL1500lb # [ 0.003350] rcu: Max phase no-delay instances is 1000.501worker1 # [ 0.005343] CPU features: detected: PMUv3502client # [ 0.005048] CPU features: detected: Enhanced Counter Virtualization503worker1 # [ 0.005346] CPU features: detected: RAS Extension Support504lb # [ 0.004489] fsl-mc MSI: its@8080000 domain created505worker2 # [ 0.004821] CPU features: detected: Branch Target Identification506lb # [ 0.004586] EFI services will not be available.507client # [ 0.005051] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)508worker2 # [ 0.004826] CPU features: detected: ARMv8.4 Translation Table Level509worker1 # [ 0.005349] CPU features: detected: RASv1p1 Extension Support510lb # [ 0.004653] smp: Bringing up secondary CPUs ...511client # [ 0.005055] CPU features: detected: Enhanced Virtualization Traps512worker1 # [ 0.005352] CPU features: detected: Random Number Generator513lb # [ 0.004660] smp: Brought up 1 node, 1 CPU514worker2 # [ 0.004829] CPU features: detected: Instruction cache invalidation not required for I/D coherence515client # [ 0.005058] CPU features: detected: Fine Grained Traps516lb # [ 0.004663] SMP: Total of 1 processors activated.517worker1 # [ 0.005354] CPU features: detected: Speculation barrier (SB)518lb # [ 0.004668] CPU: All CPU(s) started at EL1519client # [ 0.005062] CPU features: detected: Generic authentication (architected QARMA5 algorithm)520worker2 # [ 0.004833] CPU features: detected: Data cache clean to the PoU not required for I/D coherence521worker1 # [ 0.005358] CPU features: detected: Stage-2 Force Write-Back522lb # [ 0.004679] CPU features: detected: Branch Target Identification523client # [ 0.005067] CPU features: detected: RCpc load-acquire (LDAPR)524worker1 # [ 0.005361] CPU features: detected: TLB range maintenance instructions525worker2 # [ 0.004837] CPU features: detected: Common not Private translations526lb # [ 0.004684] CPU features: detected: ARMv8.4 Translation Table Level527client # [ 0.005070] CPU features: detected: LSE atomic instructions528worker2 # [ 0.004840] CPU features: detected: CRC32 instructions529worker1 # [ 0.005365] CPU features: detected: Speculative Store Bypassing Safe (SSBS)530client # [ 0.005073] CPU features: detected: Privileged Access Never531worker2 # [ 0.004843] CPU features: detected: Data cache clean to Point of Deep Persistence532worker1 # [ 0.005404] alternatives: applying system-wide alternatives533lb # [ 0.004687] CPU features: detected: Instruction cache invalidation not required for I/D coherence534client # [ 0.005076] CPU features: detected: PMUv3535worker2 # [ 0.004846] CPU features: detected: Data cache clean to Point of Persistence536client # [ 0.005079] CPU features: detected: RAS Extension Support537worker1 # [ 0.008393] CPU features: detected: BBM Level 2 without TLB conflict abort538lb # [ 0.004691] CPU features: detected: Data cache clean to the PoU not required for I/D coherence539client # [ 0.005081] CPU features: detected: RASv1p1 Extension Support540worker2 # [ 0.004850] CPU features: detected: Data independent timing control (DIT)541lb # [ 0.004694] CPU features: detected: Common not Private translations542worker2 # [ 0.004853] CPU features: detected: E0PD543client # [ 0.005084] CPU features: detected: Random Number Generator544lb # [ 0.004697] CPU features: detected: CRC32 instructions545worker1 # [ 0.008546] Memory: 1406512K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)546worker1 # [ 0.008924] devtmpfs: initialized547worker2 # [ 0.004855] CPU features: detected: Enhanced Counter Virtualization548client # [ 0.005087] CPU features: detected: Speculation barrier (SB)549lb # [ 0.004700] CPU features: detected: Data cache clean to Point of Deep Persistence550client # [ 0.005090] CPU features: detected: Stage-2 Force Write-Back551worker2 # [ 0.004858] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)552worker1 # [ 0.010782] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)553lb # [ 0.004704] CPU features: detected: Data cache clean to Point of Persistence554worker2 # [ 0.004861] CPU features: detected: Enhanced Virtualization Traps555client # [ 0.005093] CPU features: detected: TLB range maintenance instructions556worker1 # [ 0.010805] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).557lb # [ 0.004707] CPU features: detected: Data independent timing control (DIT)558worker2 # [ 0.004864] CPU features: detected: Fine Grained Traps559client # [ 0.005097] CPU features: detected: Speculative Store Bypassing Safe (SSBS)560lb # [ 0.004710] CPU features: detected: E0PD561worker1 # [ 0.010978] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL562client # [ 0.005131] alternatives: applying system-wide alternatives563worker2 # [ 0.004868] CPU features: detected: Generic authentication (architected QARMA5 algorithm)564lb # [ 0.004713] CPU features: detected: Enhanced Counter Virtualization565worker2 # [ 0.004873] CPU features: detected: RCpc load-acquire (LDAPR)566client # [ 0.008142] CPU features: detected: BBM Level 2 without TLB conflict abort567lb # [ 0.004716] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)568worker2 # [ 0.004876] CPU features: detected: LSE atomic instructions569lb # [ 0.004719] CPU features: detected: Enhanced Virtualization Traps570worker2 # [ 0.004879] CPU features: detected: Privileged Access Never571lb # [ 0.004722] CPU features: detected: Fine Grained Traps572client # [ 0.008296] Memory: 1406560K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)573worker2 # [ 0.004882] CPU features: detected: PMUv3574client # [ 0.008715] devtmpfs: initialized575worker2 # [ 0.004884] CPU features: detected: RAS Extension Support576lb # [ 0.004725] CPU features: detected: Generic authentication (architected QARMA5 algorithm)577client # [ 0.010490] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)578worker2 # [ 0.004887] CPU features: detected: RASv1p1 Extension Support579lb # [ 0.004730] CPU features: detected: RCpc load-acquire (LDAPR)580worker2 # [ 0.004890] CPU features: detected: Random Number Generator581client # [ 0.010514] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).582lb # [ 0.004733] CPU features: detected: LSE atomic instructions583worker2 # [ 0.004892] CPU features: detected: Speculation barrier (SB)584client # [ 0.010692] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL585lb # [ 0.004737] CPU features: detected: Privileged Access Never586worker2 # [ 0.004895] CPU features: detected: Stage-2 Force Write-Back587client # [ 0.010696] 0 pages in range for non-PLT usage588lb # [ 0.004739] CPU features: detected: PMUv3589client # [ 0.010697] 508288 pages in range for PLT usage590worker2 # [ 0.004898] CPU features: detected: TLB range maintenance instructions591lb # [ 0.004742] CPU features: detected: RAS Extension Support592client # [ 0.010823] pinctrl core: initialized pinctrl subsystem593lb # [ 0.004745] CPU features: detected: RASv1p1 Extension Support594worker2 # [ 0.004903] CPU features: detected: Speculative Store Bypassing Safe (SSBS)595lb # [ 0.004747] CPU features: detected: Random Number Generator596worker2 # [ 0.004937] alternatives: applying system-wide alternatives597worker1 # [ 0.010983] 0 pages in range for non-PLT usage598lb # [ 0.004750] CPU features: detected: Speculation barrier (SB)599worker1 # [ 0.010984] 508288 pages in range for PLT usage600worker2 # [ 0.007827] CPU features: detected: BBM Level 2 without TLB conflict abort601lb # [ 0.004753] CPU features: detected: Stage-2 Force Write-Back602worker1 # [ 0.011089] pinctrl core: initialized pinctrl subsystem603worker1 # [ 0.011870] DMI not present or invalid.604lb # [ 0.004756] CPU features: detected: TLB range maintenance instructions605worker2 # [ 0.008000] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)606worker1 # [ 0.015121] NET: Registered PF_NETLINK/PF_ROUTE protocol family607worker2 # [ 0.008396] devtmpfs: initialized608lb # [ 0.004760] CPU features: detected: Speculative Store Bypassing Safe (SSBS)609worker1 # [ 0.017406] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations610lb # [ 0.004796] alternatives: applying system-wide alternatives611worker2 # [ 0.010141] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)612worker1 # [ 0.017585] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations613lb # [ 0.007733] CPU features: detected: BBM Level 2 without TLB conflict abort614worker2 # [ 0.010163] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).615worker1 # [ 0.017782] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations616worker2 # [ 0.010345] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL617worker1 # [ 0.017804] audit: initializing netlink subsys (disabled)618worker2 # [ 0.010349] 0 pages in range for non-PLT usage619lb # [ 0.007959] Memory: 1406540K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)620lb # [ 0.008382] devtmpfs: initialized621worker1 # [ 0.018387] thermal_sys: Registered thermal governor 'fair_share'622worker2 # [ 0.010350] 508288 pages in range for PLT usage623worker2 # [ 0.010438] pinctrl core: initialized pinctrl subsystem624worker1 # [ 0.018389] thermal_sys: Registered thermal governor 'bang_bang'625lb # [ 0.010283] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)626worker2 # [ 0.011165] DMI not present or invalid.627client # [ 0.011531] DMI not present or invalid.628worker1 # [ 0.018392] thermal_sys: Registered thermal governor 'step_wise'629worker2 # [ 0.014325] NET: Registered PF_NETLINK/PF_ROUTE protocol family630lb # [ 0.010306] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).631client # [ 0.014783] NET: Registered PF_NETLINK/PF_ROUTE protocol family632worker1 # [ 0.018397] thermal_sys: Registered thermal governor 'user_space'633worker2 # [ 0.016516] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations634client # [ 0.016995] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations635lb # [ 0.010500] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL636worker1 # [ 0.018400] thermal_sys: Registered thermal governor 'power_allocator'637lb # [ 0.010505] 0 pages in range for non-PLT usage638worker2 # [ 0.016698] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations639client # [ 0.017187] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations640lb # [ 0.010506] 508288 pages in range for PLT usage641worker1 # [ 0.018423] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1642lb # [ 0.010595] pinctrl core: initialized pinctrl subsystem643worker1 # [ 0.018432] cpuidle: using governor ladder644client # [ 0.017387] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations645worker1 # [ 0.018438] cpuidle: using governor menu646lb # [ 0.011342] DMI not present or invalid.647client # [ 0.017421] audit: initializing netlink subsys (disabled)648worker2 # [ 0.016899] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations649lb # [ 0.014567] NET: Registered PF_NETLINK/PF_ROUTE protocol family650worker1 # [ 0.018619] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.651client # [ 0.017979] thermal_sys: Registered thermal governor 'fair_share'652worker2 # [ 0.016921] audit: initializing netlink subsys (disabled)653worker1 # [ 0.018634] ASID allocator initialised with 65536 entries654lb # [ 0.016716] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations655worker2 # [ 0.017432] thermal_sys: Registered thermal governor 'fair_share'656client # [ 0.017981] thermal_sys: Registered thermal governor 'bang_bang'657worker1 # [ 0.019794] Serial: AMBA PL011 UART driver658lb # [ 0.016906] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations659worker2 # [ 0.017435] thermal_sys: Registered thermal governor 'bang_bang'660client # [ 0.017984] thermal_sys: Registered thermal governor 'step_wise'661worker1 # [ 0.024870] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1662worker2 # [ 0.017438] thermal_sys: Registered thermal governor 'step_wise'663client # [ 0.017990] thermal_sys: Registered thermal governor 'user_space'664worker1 # [ 0.024986] printk: console [ttyAMA0] enabled665worker2 # [ 0.017444] thermal_sys: Registered thermal governor 'user_space'666client # [ 0.017992] thermal_sys: Registered thermal governor 'power_allocator'667worker2 # [ 0.017446] thermal_sys: Registered thermal governor 'power_allocator'668worker1 # [ 0.143689] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages669client # [ 0.018024] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1670worker1 # [ 0.143705] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page671client # [ 0.018032] cpuidle: using governor ladder672worker2 # [ 0.017469] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1673client # [ 0.018038] cpuidle: using governor menu674worker2 # [ 0.017479] cpuidle: using governor ladder675worker1 # [ 0.143710] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages676worker2 # [ 0.017485] cpuidle: using governor menu677client # [ 0.018215] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.678worker1 # [ 0.143714] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page679worker2 # [ 0.017665] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.680client # [ 0.018230] ASID allocator initialised with 65536 entries681worker1 # [ 0.143718] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages682client # [ 0.019391] Serial: AMBA PL011 UART driver683worker2 # [ 0.017679] ASID allocator initialised with 65536 entries684worker2 # [ 0.018886] Serial: AMBA PL011 UART driver685worker1 # [ 0.143723] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page686client # [ 0.024501] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1687worker1 # [ 0.143727] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages688client # [ 0.024653] printk: console [ttyAMA0] enabled689worker2 # [ 0.023950] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1690worker2 # [ 0.024122] printk: console [ttyAMA0] enabled691worker1 # [ 0.143731] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page692client # [ 0.143538] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages693client # [ 0.143553] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page694lb # [ 0.017099] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations695lb # [ 0.017119] audit: initializing netlink subsys (disabled)696worker1 # [ 0.150806] fbcon: Taking over console697client # [ 0.143559] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages698worker1 # [ 0.150819] ACPI: Interpreter disabled.699lb # [ 0.017634] thermal_sys: Registered thermal governor 'fair_share'700client # [ 0.143563] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page701worker1 # [ 0.152600] iommu: Default domain type: Translated702lb # [ 0.017636] thermal_sys: Registered thermal governor 'bang_bang'703client # [ 0.143567] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages704worker1 # [ 0.152609] iommu: DMA domain TLB invalidation policy: strict mode705lb # [ 0.017639] thermal_sys: Registered thermal governor 'step_wise'706client # [ 0.143572] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page707worker1 # [ 0.154193] SCSI subsystem initialized708lb # [ 0.017644] thermal_sys: Registered thermal governor 'user_space'709client # [ 0.143576] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages710lb # [ 0.017646] thermal_sys: Registered thermal governor 'power_allocator'711client # [ 0.143580] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page712lb # [ 0.017668] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1713worker2 # [ 0.140336] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages714lb # [ 0.017678] cpuidle: using governor ladder715worker2 # [ 0.140349] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page716lb # [ 0.017683] cpuidle: using governor menu717client # [ 0.150816] fbcon: Taking over console718worker2 # [ 0.140354] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages719lb # [ 0.017857] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.720client # [ 0.150829] ACPI: Interpreter disabled.721worker2 # [ 0.140358] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page722lb # [ 0.017881] ASID allocator initialised with 65536 entries723client # [ 0.152667] iommu: Default domain type: Translated724lb # [ 0.019034] Serial: AMBA PL011 UART driver725worker2 # [ 0.140363] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages726client # [ 0.152677] iommu: DMA domain TLB invalidation policy: strict mode727worker2 # [ 0.140367] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page728lb # [ 0.024166] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1729client # [ 0.154307] SCSI subsystem initialized730lb # [ 0.024281] printk: console [ttyAMA0] enabled731worker2 # [ 0.140371] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages732worker2 # [ 0.140376] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page733lb # [ 0.143728] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages734worker1 # [ 0.161713] usbcore: registered new interface driver usbfs735lb # [ 0.143743] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page736worker1 # [ 0.161746] usbcore: registered new interface driver hub737lb # [ 0.143748] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages738worker1 # [ 0.161763] usbcore: registered new device driver usb739worker2 # [ 0.147625] fbcon: Taking over console740lb # [ 0.143753] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page741worker2 # [ 0.147639] ACPI: Interpreter disabled.742worker1 # [ 0.162020] pps_core: LinuxPPS API ver. 1 registered743lb # [ 0.143757] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages744worker1 # [ 0.162026] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>745lb # [ 0.143761] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page746worker1 # [ 0.162035] PTP clock support registered747worker1 # [ 0.162082] EDAC MC: Ver: 3.0.0748lb # [ 0.143765] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages749client # [ 0.159844] usbcore: registered new interface driver usbfs750worker1 # [ 0.166654] scmi_core: SCMI protocol bus registered751lb # [ 0.143769] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page752client # [ 0.159877] usbcore: registered new interface driver hub753client # [ 0.159896] usbcore: registered new device driver usb754worker1 # [ 0.167610] FPGA manager framework755worker1 # [ 0.168499] vgaarb: loaded756client # [ 0.160173] pps_core: LinuxPPS API ver. 1 registered757lb # [ 0.151092] fbcon: Taking over console758client # [ 0.160179] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>759lb # [ 0.151105] ACPI: Interpreter disabled.760client # [ 0.160190] PTP clock support registered761worker1 # [ 0.169129] clocksource: Switched to clocksource arch_sys_counter762client # [ 0.160238] EDAC MC: Ver: 3.0.0763worker1 # [ 0.169701] VFS: Disk quotas dquot_6.6.0764lb # [ 0.152906] iommu: Default domain type: Translated765client # [ 0.164888] scmi_core: SCMI protocol bus registered766worker1 # [ 0.169733] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)767lb # [ 0.152916] iommu: DMA domain TLB invalidation policy: strict mode768lb # [ 0.154549] SCSI subsystem initialized769worker1 # [ 0.172026] netfs: FS-Cache loaded770client # [ 0.165846] FPGA manager framework771worker2 # [ 0.156613] iommu: Default domain type: Translated772worker1 # [ 0.172117] pnp: PnP ACPI: disabled773client # [ 0.166736] vgaarb: loaded774worker2 # [ 0.156622] iommu: DMA domain TLB invalidation policy: strict mode775lb # [ 0.155190] usbcore: registered new interface driver usbfs776worker2 # [ 0.157050] SCSI subsystem initialized777client # [ 0.167340] clocksource: Switched to clocksource arch_sys_counter778lb # [ 0.155221] usbcore: registered new interface driver hub779lb # [ 0.155238] usbcore: registered new device driver usb780worker2 # [ 0.158986] usbcore: registered new interface driver usbfs781lb # [ 0.155496] pps_core: LinuxPPS API ver. 1 registered782worker2 # [ 0.159017] usbcore: registered new interface driver hub783worker2 # [ 0.159046] usbcore: registered new device driver usb784lb # [ 0.155503] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>785worker2 # [ 0.159309] pps_core: LinuxPPS API ver. 1 registered786lb # [ 0.155512] PTP clock support registered787client # [ 0.170685] VFS: Disk quotas dquot_6.6.0788lb # [ 0.155567] EDAC MC: Ver: 3.0.0789client # [ 0.170714] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)790worker2 # [ 0.159315] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>791worker2 # [ 0.159325] PTP clock support registered792worker2 # [ 0.159373] EDAC MC: Ver: 3.0.0793worker2 # [ 0.163962] scmi_core: SCMI protocol bus registered794client # [ 0.174294] netfs: FS-Cache loaded795worker2 # [ 0.164912] FPGA manager framework796client # [ 0.174411] pnp: PnP ACPI: disabled797worker2 # [ 0.165846] vgaarb: loaded798worker1 # [ 0.177870] NET: Registered PF_INET protocol family799worker2 # [ 0.166447] clocksource: Switched to clocksource arch_sys_counter800worker1 # [ 0.178148] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)801lb # [ 0.166901] scmi_core: SCMI protocol bus registered802client # [ 0.178313] NET: Registered PF_INET protocol family803lb # [ 0.167913] FPGA manager framework804lb # [ 0.168825] vgaarb: loaded805client # [ 0.178569] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)806worker2 # [ 0.172371] VFS: Disk quotas dquot_6.6.0807lb # [ 0.169437] clocksource: Switched to clocksource arch_sys_counter808lb # [ 0.170047] VFS: Disk quotas dquot_6.6.0809worker2 # [ 0.172412] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)810lb # [ 0.170072] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)811worker2 # [ 0.174039] netfs: FS-Cache loaded812worker2 # [ 0.174167] pnp: PnP ACPI: disabled813lb # [ 0.172398] netfs: FS-Cache loaded814lb # [ 0.172506] pnp: PnP ACPI: disabled815worker2 # [ 0.178030] NET: Registered PF_INET protocol family816worker2 # [ 0.178292] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)817lb # [ 0.178135] NET: Registered PF_INET protocol family818lb # [ 0.178404] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)819worker1 # [ 0.206598] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)820worker1 # [ 0.206639] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)821worker1 # [ 0.206663] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)822worker1 # [ 0.206734] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)823worker1 # [ 0.206876] TCP: Hash tables configured (established 16384 bind 16384)824worker1 # [ 0.206949] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)825worker1 # [ 0.206983] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)826worker1 # [ 0.207019] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)827worker1 # [ 0.207108] NET: Registered PF_UNIX/PF_LOCAL protocol family828worker1 # [ 0.207132] NET: Registered PF_XDP protocol family829worker1 # [ 0.207148] PCI: CLS 0 bytes, default 64830client # [ 0.207476] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)831worker1 # [ 0.207389] Trying to unpack rootfs image as initramfs...832client # [ 0.207521] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)833client # [ 0.207549] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)834client # [ 0.207626] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)835client # [ 0.207769] TCP: Hash tables configured (established 16384 bind 16384)836client # [ 0.207848] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)837client # [ 0.207884] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)838client # [ 0.207920] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)839client # [ 0.208007] NET: Registered PF_UNIX/PF_LOCAL protocol family840worker1 # [ 0.222704] kvm [1]: HYP mode not available841client # [ 0.208036] NET: Registered PF_XDP protocol family842client # [ 0.208052] PCI: CLS 0 bytes, default 64843worker2 # [ 0.206778] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)844client # [ 0.208278] Trying to unpack rootfs image as initramfs...845worker2 # [ 0.206826] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)846lb # [ 0.206968] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)847worker2 # [ 0.206854] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)848lb # [ 0.207013] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)849worker2 # [ 0.206930] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)850lb # [ 0.207040] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)851worker2 # [ 0.207073] TCP: Hash tables configured (established 16384 bind 16384)852lb # [ 0.207112] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)853worker2 # [ 0.207154] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)854lb # [ 0.207254] TCP: Hash tables configured (established 16384 bind 16384)855worker2 # [ 0.207187] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)856lb # [ 0.207337] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)857worker2 # [ 0.207222] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)858lb # [ 0.207373] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)859worker2 # [ 0.207312] NET: Registered PF_UNIX/PF_LOCAL protocol family860worker2 # [ 0.207366] NET: Registered PF_XDP protocol family861lb # [ 0.207409] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)862worker2 # [ 0.207384] PCI: CLS 0 bytes, default 64863lb # [ 0.207496] NET: Registered PF_UNIX/PF_LOCAL protocol family864worker2 # [ 0.207636] Trying to unpack rootfs image as initramfs...865lb # [ 0.207518] NET: Registered PF_XDP protocol family866lb # [ 0.207536] PCI: CLS 0 bytes, default 64867lb # [ 0.207783] Trying to unpack rootfs image as initramfs...868worker2 # [ 0.224122] kvm [1]: HYP mode not available869client # [ 0.231381] kvm [1]: HYP mode not available870lb # [ 0.223126] kvm [1]: HYP mode not available871worker1 # [ 0.313650] Initialise system trusted keyrings872worker1 # [ 0.314392] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker1 # [ 0.315712] squashfs: version 4.0 (2009/01/31) Phillip Lougher874worker1 # [ 0.316474] 9p: Installing v9fs 9p2000 file system support875client # [ 0.323940] Initialise system trusted keyrings876worker2 # [ 0.315002] Initialise system trusted keyrings877client # [ 0.324700] workingset: timestamp_bits=42 max_order=19 bucket_order=0878worker2 # [ 0.315739] workingset: timestamp_bits=42 max_order=19 bucket_order=0879lb # [ 0.313975] Initialise system trusted keyrings880client # [ 0.326018] squashfs: version 4.0 (2009/01/31) Phillip Lougher881worker2 # [ 0.317016] squashfs: version 4.0 (2009/01/31) Phillip Lougher882lb # [ 0.314708] workingset: timestamp_bits=42 max_order=19 bucket_order=0883client # [ 0.326767] 9p: Installing v9fs 9p2000 file system support884lb # [ 0.315911] squashfs: version 4.0 (2009/01/31) Phillip Lougher885worker2 # [ 0.317767] 9p: Installing v9fs 9p2000 file system support886lb # [ 0.316670] 9p: Installing v9fs 9p2000 file system support887worker1 # [ 0.337014] Key type asymmetric registered888worker1 # [ 0.337038] Asymmetric key parser 'x509' registered889worker1 # [ 0.337110] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)890worker1 # [ 0.345184] io scheduler mq-deadline registered891worker1 # [ 0.345203] io scheduler kyber registered892client # [ 0.347335] Key type asymmetric registered893worker2 # [ 0.338383] Key type asymmetric registered894worker1 # [ 0.353267] pl061_gpio 9030000.pl061: PL061 GPIO chip registered895worker2 # [ 0.338405] Asymmetric key parser 'x509' registered896lb # [ 0.337241] Key type asymmetric registered897lb # [ 0.337264] Asymmetric key parser 'x509' registered898lb # [ 0.337336] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)899worker1 # [ 0.354611] ledtrig-cpu: registered to indicate activity on CPUs900worker1 # [ 0.354996] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:901worker1 # [ 0.355013] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000902worker1 # [ 0.355024] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000903worker1 # [ 0.355033] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000904client # [ 0.355389] Asymmetric key parser 'x509' registered905worker2 # [ 0.346542] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)906worker1 # [ 0.355053] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits907client # [ 0.355457] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)908worker2 # [ 0.347552] io scheduler mq-deadline registered909lb # [ 0.345495] io scheduler mq-deadline registered910client # [ 0.357036] io scheduler mq-deadline registered911worker2 # [ 0.347563] io scheduler kyber registered912worker1 # [ 0.355075] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]913client # [ 0.357047] io scheduler kyber registered914lb # [ 0.345512] io scheduler kyber registered915worker1 # [ 0.355147] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00916worker1 # [ 0.355156] pci_bus 0000:00: root bus resource [bus 00-ff]917worker1 # [ 0.355162] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]918worker1 # [ 0.355167] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]919worker1 # [ 0.355172] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]920worker1 # [ 0.355228] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint921worker1 # [ 0.355678] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint922worker1 # [ 0.355866] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]923worker1 # [ 0.355882] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]924worker1 # [ 0.355911] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]925lb # [ 0.353559] pl061_gpio 9030000.pl061: PL061 GPIO chip registered926worker1 # [ 0.355927] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]927worker1 # [ 0.356380] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint928worker1 # [ 0.356564] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]929client # [ 0.367458] pl061_gpio 9030000.pl061: PL061 GPIO chip registered930worker1 # [ 0.356580] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]931worker2 # [ 0.358560] pl061_gpio 9030000.pl061: PL061 GPIO chip registered932lb # [ 0.354888] ledtrig-cpu: registered to indicate activity on CPUs933worker1 # [ 0.356609] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]934lb # [ 0.355257] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:935worker1 # [ 0.357057] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint936lb # [ 0.355273] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000937client # [ 0.368757] ledtrig-cpu: registered to indicate activity on CPUs938worker2 # [ 0.359872] ledtrig-cpu: registered to indicate activity on CPUs939lb # [ 0.355285] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000940client # [ 0.369113] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:941worker2 # [ 0.360262] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:942lb # [ 0.355294] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000943client # [ 0.369130] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000944worker2 # [ 0.360278] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000945lb # [ 0.355319] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits946client # [ 0.369142] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000947worker2 # [ 0.360290] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000948lb # [ 0.355341] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]949client # [ 0.369150] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000950worker2 # [ 0.360298] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000951lb # [ 0.355437] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00952client # [ 0.369169] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits953lb # [ 0.355447] pci_bus 0000:00: root bus resource [bus 00-ff]954worker2 # [ 0.360331] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits955lb # [ 0.355453] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]956client # [ 0.369191] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]957worker2 # [ 0.360354] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]958lb # [ 0.355458] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]959client # [ 0.369265] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00960worker2 # [ 0.360434] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00961client # [ 0.369275] pci_bus 0000:00: root bus resource [bus 00-ff]962lb # [ 0.355463] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]963worker2 # [ 0.360443] pci_bus 0000:00: root bus resource [bus 00-ff]964client # [ 0.369281] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]965worker2 # [ 0.360449] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]966lb # [ 0.355518] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint967client # [ 0.369286] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]968worker2 # [ 0.360454] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]969lb # [ 0.355951] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint970client # [ 0.369291] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]971lb # [ 0.356137] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]972worker2 # [ 0.360459] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]973client # [ 0.369347] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint974lb # [ 0.356153] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]975worker2 # [ 0.360514] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint976lb # [ 0.356182] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]977client # [ 0.369781] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint978worker2 # [ 0.360945] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint979lb # [ 0.356198] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]980client # [ 0.369968] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]981worker2 # [ 0.361130] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]982client # [ 0.369983] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]983lb # [ 0.356651] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint984worker2 # [ 0.361146] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]985client # [ 0.370012] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]986lb # [ 0.356836] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]987worker2 # [ 0.361175] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]988lb # [ 0.356852] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]989client # [ 0.370028] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]990worker2 # [ 0.361191] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]991lb # [ 0.356881] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]992client # [ 0.370474] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint993worker1 # [ 0.385289] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]994worker2 # [ 0.361639] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint995client # [ 0.370656] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]996worker1 # [ 0.385316] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]997lb # [ 0.357332] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint998worker2 # [ 0.361820] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]999client # [ 0.370672] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1000worker1 # [ 0.385346] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1001worker2 # [ 0.361836] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1002client # [ 0.370700] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1003worker2 # [ 0.361865] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1004worker1 # [ 0.385835] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1005client # [ 0.371150] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1006worker1 # [ 0.386020] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1007worker2 # [ 0.362310] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1008client # [ 0.371330] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1009worker1 # [ 0.386036] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1010client # [ 0.391283] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1011worker1 # [ 0.386068] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1012worker2 # [ 0.381824] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1013client # [ 0.391315] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1014worker2 # [ 0.381842] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1015worker1 # [ 0.386533] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1016worker2 # [ 0.381872] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1017worker1 # [ 0.386715] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1018worker1 # [ 0.386730] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1019worker2 # [ 0.382327] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1020worker1 # [ 0.386760] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1021worker1 # [ 0.387209] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1022client # [ 0.393260] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1023worker2 # [ 0.385595] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1024client # [ 0.393451] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1025worker1 # [ 0.387392] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1026worker2 # [ 0.385614] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1027client # [ 0.393466] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1028worker1 # [ 0.387408] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1029worker2 # [ 0.385645] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1030worker1 # [ 0.387442] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1031client # [ 0.393497] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1032worker2 # [ 0.386102] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1033worker2 # [ 0.386283] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1034client # [ 0.393948] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1035worker1 # [ 0.387925] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1036client # [ 0.394128] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1037worker1 # [ 0.388109] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1038worker2 # [ 0.386298] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1039client # [ 0.394144] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1040worker1 # [ 0.388125] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1041worker2 # [ 0.386327] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1042client # [ 0.394173] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1043worker1 # [ 0.388154] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1044lb # [ 0.381549] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1045worker1 # [ 0.388170] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1046lb # [ 0.381573] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1047client # [ 0.394620] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1048client # [ 0.394800] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1049lb # [ 0.381602] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1050worker1 # [ 0.388621] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1051client # [ 0.394815] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1052worker1 # [ 0.388807] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1053lb # [ 0.382092] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1054client # [ 0.394844] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1055worker1 # [ 0.388836] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1056lb # [ 0.382278] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1057lb # [ 0.382294] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1058client # [ 0.395316] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1059worker1 # [ 0.389298] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1060lb # [ 0.382326] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1061worker1 # [ 0.389484] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1062worker1 # [ 0.389514] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1063lb # [ 0.382783] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1064lb # [ 0.382966] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1065worker1 # [ 0.389909] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1066lb # [ 0.382981] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1067worker1 # [ 0.390092] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1068lb # [ 0.383011] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1069worker1 # [ 0.390347] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1070lb # [ 0.383460] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1071worker1 # [ 0.390644] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1072lb # [ 0.383644] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1073worker1 # [ 0.390660] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1074lb # [ 0.383659] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1075worker1 # [ 0.390690] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1076lb # [ 0.383689] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1077worker1 # [ 0.391156] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1078lb # [ 0.384141] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1079worker1 # [ 0.391339] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1080lb # [ 0.384325] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1081worker1 # [ 0.391354] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1082lb # [ 0.384341] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1083worker1 # [ 0.391384] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1084lb # [ 0.384370] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1085worker1 # [ 0.391955] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1086lb # [ 0.384386] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1087worker2 # [ 0.398839] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1088worker1 # [ 0.391966] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1089worker2 # [ 0.399036] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1090lb # [ 0.384879] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1091worker1 # [ 0.391972] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1092worker2 # [ 0.399052] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1093lb # [ 0.385067] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1094worker1 # [ 0.392016] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1095worker2 # [ 0.399081] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1096lb # [ 0.385096] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1097worker1 # [ 0.392064] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1098worker2 # [ 0.399564] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1099client # [ 0.411567] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1100lb # [ 0.385564] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1101worker2 # [ 0.399747] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1102client # [ 0.411595] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1103lb # [ 0.385751] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1104worker1 # [ 0.392110] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1105worker2 # [ 0.399761] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1106client # [ 0.411625] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1107lb # [ 0.385780] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1108worker1 # [ 0.392156] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1109worker2 # [ 0.399790] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1110client # [ 0.411641] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1111lb # [ 0.386173] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1112worker1 # [ 0.392203] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1113worker2 # [ 0.399806] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1114client # [ 0.412123] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1115lb # [ 0.386355] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1116worker1 # [ 0.392249] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1117worker2 # [ 0.400275] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1118client # [ 0.412309] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1119lb # [ 0.386603] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1120worker2 # [ 0.400461] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1121worker1 # [ 0.392295] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1122client # [ 0.412338] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1123lb # [ 0.386878] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1124worker2 # [ 0.400491] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1125worker1 # [ 0.392341] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1126lb # [ 0.386895] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1127client # [ 0.412785] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1128worker2 # [ 0.400939] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1129lb # [ 0.386924] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1130client # [ 0.412970] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1131worker1 # [ 0.392388] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1132worker2 # [ 0.401124] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1133client # [ 0.412999] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1134lb # [ 0.387388] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1135worker1 # [ 0.392463] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1136worker2 # [ 0.401153] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1137lb # [ 0.387570] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1138client # [ 0.413383] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1139worker1 # [ 0.392508] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1140lb # [ 0.387586] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1141worker2 # [ 0.401542] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1142client # [ 0.413573] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1143worker1 # [ 0.392529] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1144lb # [ 0.387615] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1145worker2 # [ 0.401720] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1146worker1 # [ 0.392551] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1147client # [ 0.413816] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1148lb # [ 0.388190] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1149client # [ 0.414065] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1150worker2 # [ 0.401961] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1151worker1 # [ 0.392572] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1152worker2 # [ 0.402210] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1153client # [ 0.414082] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1154lb # [ 0.388201] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1155worker1 # [ 0.392596] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1156worker2 # [ 0.402227] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1157client # [ 0.414111] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1158lb # [ 0.388207] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1159worker1 # [ 0.392617] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1160worker2 # [ 0.402256] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1161client # [ 0.414566] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1162worker1 # [ 0.392639] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1163lb # [ 0.388251] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1164client # [ 0.414747] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1165worker2 # [ 0.402730] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1166worker1 # [ 0.392661] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1167lb # [ 0.388297] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1168worker2 # [ 0.402912] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1169client # [ 0.414763] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1170worker1 # [ 0.392683] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1171worker2 # [ 0.402927] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1172lb # [ 0.388343] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1173client # [ 0.414792] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1174worker1 # [ 0.392704] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1175worker2 # [ 0.402956] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1176client # [ 0.415371] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1177lb # [ 0.388389] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1178worker1 # [ 0.392727] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1179worker2 # [ 0.403525] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1180client # [ 0.415381] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1181lb # [ 0.388434] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1182worker1 # [ 0.392749] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1183worker2 # [ 0.403535] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1184client # [ 0.415386] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1185worker1 # [ 0.392770] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1186lb # [ 0.388480] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1187worker2 # [ 0.403540] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1188worker1 # [ 0.392791] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1189client # [ 0.415436] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1190lb # [ 0.388527] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1191worker1 # [ 0.392812] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1192worker2 # [ 0.403584] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1193client # [ 0.415485] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1194lb # [ 0.388574] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1195worker1 # [ 0.392833] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1196worker2 # [ 0.403630] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1197client # [ 0.415536] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1198worker1 # [ 0.392855] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1199lb # [ 0.388619] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1200worker2 # [ 0.403677] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1201worker1 # [ 0.392876] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1202client # [ 0.415586] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1203lb # [ 0.388679] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1204worker1 # [ 0.392898] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1205worker2 # [ 0.403723] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1206client # [ 0.415633] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1207lb # [ 0.388724] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1208worker1 # [ 0.392919] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1209worker2 # [ 0.403769] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1210lb # [ 0.388746] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1211client # [ 0.415679] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1212worker1 # [ 0.392941] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1213worker2 # [ 0.403815] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1214lb # [ 0.388767] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1215worker1 # [ 0.392967] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1216client # [ 0.415726] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1217worker1 # [ 0.392977] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1218lb # [ 0.388789] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1219worker2 # [ 0.403861] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1220client # [ 0.415772] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1221lb # [ 0.388813] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1222worker1 # [ 0.392982] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1223worker2 # [ 0.403908] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1224client # [ 0.415818] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1225lb # [ 0.388835] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1226worker2 # [ 0.403954] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1227client # [ 0.415889] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1228lb # [ 0.388857] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1229worker2 # [ 0.404014] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1230client # [ 0.415935] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1231lb # [ 0.388879] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1232worker2 # [ 0.404061] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1233client # [ 0.415956] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1234lb # [ 0.388901] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1235worker2 # [ 0.404082] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1236client # [ 0.415977] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1237lb # [ 0.388924] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1238worker2 # [ 0.404102] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1239client # [ 0.415999] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1240lb # [ 0.388946] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1241worker2 # [ 0.404124] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1242client # [ 0.416024] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1243lb # [ 0.388969] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1244worker2 # [ 0.404147] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1245client # [ 0.416046] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1246lb # [ 0.388990] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1247worker2 # [ 0.404177] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1248lb # [ 0.389011] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1249client # [ 0.416068] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1250lb # [ 0.389033] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1251worker2 # [ 0.404198] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1252client # [ 0.416092] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1253lb # [ 0.389054] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1254worker2 # [ 0.404220] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1255client # [ 0.416114] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1256lb # [ 0.389076] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1257client # [ 0.416136] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1258worker2 # [ 0.404241] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1259worker1 # [ 0.458203] pci 0000:00:0a.0: enabling device (0000 -> 0002)1260lb # [ 0.389098] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1261worker2 # [ 0.404263] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1262client # [ 0.416158] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1263lb # [ 0.389119] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1264worker2 # [ 0.404285] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1265client # [ 0.416180] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1266lb # [ 0.389142] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1267client # [ 0.416201] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1268worker2 # [ 0.404307] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1269lb # [ 0.389163] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1270client # [ 0.416222] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1271worker2 # [ 0.404329] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1272lb # [ 0.389190] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1273client # [ 0.416243] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1274worker2 # [ 0.404350] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1275lb # [ 0.389200] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1276client # [ 0.416265] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1277worker2 # [ 0.404370] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1278lb # [ 0.389204] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1279client # [ 0.416286] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1280worker2 # [ 0.404391] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1281client # [ 0.416307] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1282worker2 # [ 0.404412] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1283worker2 # [ 0.404433] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1284client # [ 0.416329] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1285worker2 # [ 0.404455] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1286client # [ 0.416350] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1287worker2 # [ 0.404476] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1288client # [ 0.416372] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1289client # [ 0.416406] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1290worker2 # [ 0.404498] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1291worker2 # [ 0.404524] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1292client # [ 0.416416] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1293worker2 # [ 0.404534] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1294client # [ 0.416420] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1295client # [ 0.417570] pci 0000:00:0a.0: enabling device (0000 -> 0002)1296worker2 # [ 0.404538] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1297worker2 # [ 0.405681] pci 0000:00:0a.0: enabling device (0000 -> 0002)1298lb # [ 0.454410] pci 0000:00:0a.0: enabling device (0000 -> 0002)1299worker1 # [ 0.478590] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1300worker1 # [ 0.480686] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1301worker1 # [ 0.491718] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1302client # [ 0.489577] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1303worker2 # [ 0.481599] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1304lb # [ 0.479667] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1305worker1 # [ 0.497703] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1306worker1 # [ 0.499658] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1307lb # [ 0.482830] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1308lb # [ 0.484721] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1309worker2 # [ 0.487770] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1310client # [ 0.495949] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1311client # [ 0.497999] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1312worker2 # [ 0.489788] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1313worker1 # [ 0.509654] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1314worker1 # [ 0.511673] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1315lb # [ 0.494837] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1316lb # [ 0.496758] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1317worker2 # [ 0.499856] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1318worker2 # [ 0.501842] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1319client # [ 0.507982] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1320client # [ 0.509997] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1321client # [ 0.512055] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1322client # [ 0.514037] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1323lb # [ 0.508084] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1324worker2 # [ 0.513458] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1325worker1 # [ 0.521686] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1326worker1 # [ 0.524517] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1327lb # [ 0.511057] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1328worker1 # [ 0.526315] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1329lb # [ 0.513051] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1330worker1 # [ 0.528760] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1331worker2 # [ 0.516469] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1332client # [ 0.532449] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1333client # [ 0.534863] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1334lb # [ 0.523214] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1335lb # [ 0.525211] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1336client # [ 0.538403] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1337worker1 # [ 0.546370] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1338lb # [ 0.528937] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1339worker1 # [ 0.548890] msm_serial: driver initialized1340worker1 # [ 0.549048] SuperH (H)SCI(F) driver initialized1341worker1 # [ 0.549102] STM32 USART driver initialized1342worker2 # [ 0.526547] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1343worker2 # [ 0.529018] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1344client # [ 0.541319] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1345worker2 # [ 0.530778] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1346worker2 # [ 0.532900] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1347lb # [ 0.546700] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1348client # [ 0.560515] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1349worker2 # [ 0.551634] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1350client # [ 0.563096] msm_serial: driver initialized1351worker2 # [ 0.554083] msm_serial: driver initialized1352client # [ 0.563231] SuperH (H)SCI(F) driver initialized1353worker2 # [ 0.554220] SuperH (H)SCI(F) driver initialized1354client # [ 0.563284] STM32 USART driver initialized1355worker2 # [ 0.554274] STM32 USART driver initialized1356lb # [ 0.554606] msm_serial: driver initialized1357lb # [ 0.554746] SuperH (H)SCI(F) driver initialized1358lb # [ 0.554802] STM32 USART driver initialized1359worker1 # [ 0.582360] loop: module loaded1360worker1 # [ 0.582524] virtio_blk virtio5: 1/0/0 default/read/poll queues1361worker1 # [ 0.583267] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1362worker1 # [ 0.589697] megasas: 07.734.00.00-rc11363worker1 # [ 0.590409] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1364client # [ 0.593856] loop: module loaded1365worker2 # [ 0.585192] loop: module loaded1366client # [ 0.594029] virtio_blk virtio5: 1/0/0 default/read/poll queues1367worker2 # [ 0.585371] virtio_blk virtio5: 1/0/0 default/read/poll queues1368client # [ 0.594742] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1369lb # [ 0.584144] loop: module loaded1370worker2 # [ 0.586083] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1371lb # [ 0.584311] virtio_blk virtio5: 1/0/0 default/read/poll queues1372lb # [ 0.585086] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1373worker1 # [ 0.601176] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001374worker1 # [ 0.601200] Intel/Sharp Extended Query Table at 0x00311375worker1 # [ 0.602781] Using buffer write method1376worker2 # [ 0.591021] megasas: 07.734.00.00-rc11377client # [ 0.599930] megasas: 07.734.00.00-rc11378worker1 # [ 0.602846] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1379worker2 # [ 0.591710] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1380client # [ 0.600639] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1381worker1 # [ 0.605759] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001382lb # [ 0.589980] megasas: 07.734.00.00-rc11383worker1 # [ 0.605789] Intel/Sharp Extended Query Table at 0x00311384worker2 # [ 0.593775] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001385client # [ 0.603202] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001386worker1 # [ 0.607116] Using buffer write method1387lb # [ 0.590698] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1388worker2 # [ 0.593842] Intel/Sharp Extended Query Table at 0x00311389client # [ 0.603230] Intel/Sharp Extended Query Table at 0x00311390worker1 # [ 0.607139] Concatenating MTD devices:1391worker1 # [ 0.607143] (0): "0.flash"1392lb # [ 0.592906] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001393worker1 # [ 0.607147] (1): "0.flash"1394worker1 # [ 0.607150] into device "0.flash"1395lb # [ 0.592925] Intel/Sharp Extended Query Table at 0x00311396client # [ 0.612357] Using buffer write method1397worker2 # [ 0.603490] Using buffer write method1398client # [ 0.612433] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1399lb # [ 0.602388] Using buffer write method1400worker2 # [ 0.603553] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1401client # [ 0.615333] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001402lb # [ 0.602453] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1403worker2 # [ 0.605041] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001404worker2 # [ 0.605067] Intel/Sharp Extended Query Table at 0x00311405lb # [ 0.605434] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001406worker2 # [ 0.614484] Using buffer write method1407worker2 # [ 0.614507] Concatenating MTD devices:1408worker2 # [ 0.614511] (0): "0.flash"1409worker2 # [ 0.614515] (1): "0.flash"1410client # [ 0.623387] Intel/Sharp Extended Query Table at 0x00311411worker2 # [ 0.614519] into device "0.flash"1412client # [ 0.624980] Using buffer write method1413client # [ 0.625010] Concatenating MTD devices:1414client # [ 0.625015] (0): "0.flash"1415client # [ 0.625019] (1): "0.flash"1416lb # [ 0.613498] Intel/Sharp Extended Query Table at 0x00311417client # [ 0.625022] into device "0.flash"1418lb # [ 0.615133] Using buffer write method1419lb # [ 0.615159] Concatenating MTD devices:1420lb # [ 0.615163] (0): "0.flash"1421lb # [ 0.615167] (1): "0.flash"1422lb # [ 0.615170] into device "0.flash"1423worker1 # [ 0.836172] Freeing initrd memory: 26148K1424worker1 # [ 0.842080] tun: Universal TUN/TAP device driver, 1.61425worker1 # [ 0.845762] thunder_xcv, ver 1.01426worker1 # [ 0.845808] thunder_bgx, ver 1.01427worker1 # [ 0.845829] nicpf, ver 1.01428worker1 # [ 0.846365] e1000: Intel(R) PRO/1000 Network Driver1429worker1 # [ 0.846372] e1000: Copyright (c) 1999-2006 Intel Corporation.1430worker1 # [ 0.846395] e1000e: Intel(R) PRO/1000 Network Driver1431worker1 # [ 0.846403] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432worker1 # [ 0.846433] igb: Intel(R) Gigabit Ethernet Network Driver1433worker1 # [ 0.846438] igb: Copyright (c) 2007-2014 Intel Corporation.1434worker2 # [ 0.837977] Freeing initrd memory: 26148K1435worker1 # [ 0.846461] igbvf: Intel(R) Gigabit Virtual Function Network Driver1436lb # [ 0.838407] Freeing initrd memory: 26140K1437worker1 # [ 0.846467] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1438worker1 # [ 0.846597] sky2: driver version 1.301439worker1 # [ 0.848227] usbcore: registered new interface driver usb-storage1440worker1 # [ 0.848316] usbcore: registered new interface driver usbserial_generic1441worker1 # [ 0.848330] usbserial: USB Serial support registered for generic1442worker2 # [ 0.844035] tun: Universal TUN/TAP device driver, 1.61443worker1 # [ 0.848917] hv_vmbus: registering driver hyperv_keyboard1444worker1 # [ 0.849831] ehci-pci 0000:00:0a.0: EHCI Host Controller1445worker1 # [ 0.849857] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11446client # [ 0.855521] Freeing initrd memory: 26160K1447worker1 # [ 0.850084] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001448lb # [ 0.844333] tun: Universal TUN/TAP device driver, 1.61449worker1 # [ 0.862442] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001450worker1 # [ 0.862845] hub 1-0:1.0: USB hub found1451worker1 # [ 0.862865] hub 1-0:1.0: 6 ports detected1452worker2 # [ 0.847857] thunder_xcv, ver 1.01453lb # [ 0.848075] thunder_xcv, ver 1.01454worker1 # [ 0.865744] rtc-pl031 9010000.pl031: registered as rtc01455worker2 # [ 0.847901] thunder_bgx, ver 1.01456lb # [ 0.848120] thunder_bgx, ver 1.01457worker2 # [ 0.847923] nicpf, ver 1.01458lb # [ 0.848141] nicpf, ver 1.01459client # [ 0.861586] tun: Universal TUN/TAP device driver, 1.61460worker1 # [ 0.865773] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:06 UTC (1789896726)1461worker2 # [ 0.848495] e1000: Intel(R) PRO/1000 Network Driver1462lb # [ 0.848686] e1000: Intel(R) PRO/1000 Network Driver1463worker1 # [ 0.866082] i2c_dev: i2c /dev entries driver1464worker2 # [ 0.848502] e1000: Copyright (c) 1999-2006 Intel Corporation.1465lb # [ 0.848693] e1000: Copyright (c) 1999-2006 Intel Corporation.1466worker2 # [ 0.848526] e1000e: Intel(R) PRO/1000 Network Driver1467lb # [ 0.848717] e1000e: Intel(R) PRO/1000 Network Driver1468worker2 # [ 0.848534] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1469lb # [ 0.848725] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1470worker2 # [ 0.848562] igb: Intel(R) Gigabit Ethernet Network Driver1471lb # [ 0.848752] igb: Intel(R) Gigabit Ethernet Network Driver1472worker2 # [ 0.848567] igb: Copyright (c) 2007-2014 Intel Corporation.1473lb # [ 0.848758] igb: Copyright (c) 2007-2014 Intel Corporation.1474worker2 # [ 0.848590] igbvf: Intel(R) Gigabit Virtual Function Network Driver1475lb # [ 0.848780] igbvf: Intel(R) Gigabit Virtual Function Network Driver1476worker2 # [ 0.848595] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1477lb # [ 0.848786] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1478worker2 # [ 0.848730] sky2: driver version 1.301479worker1 # [ 0.870917] sdhci: Secure Digital Host Controller Interface driver1480lb # [ 0.848920] sky2: driver version 1.301481worker2 # [ 0.850339] usbcore: registered new interface driver usb-storage1482worker1 # [ 0.870927] sdhci: Copyright(c) Pierre Ossman1483client # [ 0.865246] thunder_xcv, ver 1.01484worker1 # [ 0.871192] Synopsys Designware Multimedia Card Interface Driver1485worker2 # [ 0.850393] usbcore: registered new interface driver usbserial_generic1486client # [ 0.865298] thunder_bgx, ver 1.01487client # [ 0.865320] nicpf, ver 1.01488worker1 # [ 0.871564] sdhci-pltfm: SDHCI platform and OF driver helper1489worker2 # [ 0.850408] usbserial: USB Serial support registered for generic1490client # [ 0.865893] e1000: Intel(R) PRO/1000 Network Driver1491worker2 # [ 0.851189] ehci-pci 0000:00:0a.0: EHCI Host Controller1492lb # [ 0.858203] ehci-pci 0000:00:0a.0: EHCI Host Controller1493client # [ 0.865900] e1000: Copyright (c) 1999-2006 Intel Corporation.1494worker2 # [ 0.851215] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11495client # [ 0.865923] e1000e: Intel(R) PRO/1000 Network Driver1496lb # [ 0.858235] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11497worker1 # [ 0.875887] hid: raw HID events driver (C) Jiri Kosina1498worker2 # [ 0.851472] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001499client # [ 0.865931] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1500lb # [ 0.858486] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001501worker1 # [ 0.876124] usbcore: registered new interface driver usbhid1502client # [ 0.865960] igb: Intel(R) Gigabit Ethernet Network Driver1503worker1 # [ 0.876130] usbhid: USB HID core driver1504worker2 # [ 0.862720] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001505client # [ 0.865965] igb: Copyright (c) 2007-2014 Intel Corporation.1506lb # [ 0.860833] usbcore: registered new interface driver usb-storage1507worker2 # [ 0.863024] hub 1-0:1.0: USB hub found1508client # [ 0.865989] igbvf: Intel(R) Gigabit Virtual Function Network Driver1509worker2 # [ 0.863038] hub 1-0:1.0: 6 ports detected1510lb # [ 0.860928] usbcore: registered new interface driver usbserial_generic1511client # [ 0.865995] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1512lb # [ 0.860943] usbserial: USB Serial support registered for generic1513client # [ 0.866130] sky2: driver version 1.301514worker1 # [ 0.879013] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1515client # [ 0.868068] ehci-pci 0000:00:0a.0: EHCI Host Controller1516worker2 # [ 0.865600] hv_vmbus: registering driver hyperv_keyboard1517lb # [ 0.863761] hv_vmbus: registering driver hyperv_keyboard1518worker1 # [ 0.880529] drop_monitor: Initializing network drop monitor service1519client # [ 0.868097] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11520worker1 # [ 0.880665] NET: Registered PF_INET6 protocol family1521client # [ 0.868326] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001522lb # [ 0.865235] rtc-pl031 9010000.pl031: registered as rtc01523worker2 # [ 0.867087] rtc-pl031 9010000.pl031: registered as rtc01524worker1 # [ 0.883726] Segment Routing with IPv61525worker1 # [ 0.883751] In-situ OAM (IOAM) with IPv61526lb # [ 0.865262] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:06 UTC (1789896726)1527worker2 # [ 0.867110] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:06 UTC (1789896726)1528worker1 # [ 0.883783] NET: Registered PF_PACKET protocol family1529worker2 # [ 0.867428] i2c_dev: i2c /dev entries driver1530client # [ 0.877950] usbcore: registered new interface driver usb-storage1531lb # [ 0.867315] i2c_dev: i2c /dev entries driver1532client # [ 0.878068] usbcore: registered new interface driver usbserial_generic1533client # [ 0.878083] usbserial: USB Serial support registered for generic1534client # [ 0.878661] hv_vmbus: registering driver hyperv_keyboard1535client # [ 0.882264] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001536worker1 # [ 0.885563] 9pnet: Installing 9P2000 support1537client # [ 0.882571] hub 1-0:1.0: USB hub found1538worker1 # [ 0.887749] Key type dns_resolver registered1539client # [ 0.882596] hub 1-0:1.0: 6 ports detected1540worker2 # [ 0.872258] sdhci: Secure Digital Host Controller Interface driver1541worker2 # [ 0.872267] sdhci: Copyright(c) Pierre Ossman1542worker2 # [ 0.872531] Synopsys Designware Multimedia Card Interface Driver1543lb # [ 0.870564] sdhci: Secure Digital Host Controller Interface driver1544lb # [ 0.870579] sdhci: Copyright(c) Pierre Ossman1545worker2 # [ 0.872913] sdhci-pltfm: SDHCI platform and OF driver helper1546client # [ 0.884824] rtc-pl031 9010000.pl031: registered as rtc01547lb # [ 0.870845] Synopsys Designware Multimedia Card Interface Driver1548lb # [ 0.871207] sdhci-pltfm: SDHCI platform and OF driver helper1549client # [ 0.884852] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:06 UTC (1789896726)1550client # [ 0.885161] i2c_dev: i2c /dev entries driver1551lb # [ 0.872842] hid: raw HID events driver (C) Jiri Kosina1552worker2 # [ 0.877215] hid: raw HID events driver (C) Jiri Kosina1553lb # [ 0.873068] usbcore: registered new interface driver usbhid1554worker2 # [ 0.877491] usbcore: registered new interface driver usbhid1555lb # [ 0.873075] usbhid: USB HID core driver1556worker2 # [ 0.877498] usbhid: USB HID core driver1557lb # [ 0.877947] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001558lb # [ 0.878978] hub 1-0:1.0: USB hub found1559lb # [ 0.879452] hub 1-0:1.0: 6 ports detected1560worker1 # [ 0.894500] registered taskstats version 11561client # [ 0.890104] sdhci: Secure Digital Host Controller Interface driver1562worker2 # [ 0.880334] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1563worker1 # [ 0.894661] Loading compiled-in X.509 certificates1564client # [ 0.890117] sdhci: Copyright(c) Pierre Ossman1565worker2 # [ 0.881845] drop_monitor: Initializing network drop monitor service1566client # [ 0.890375] Synopsys Designware Multimedia Card Interface Driver1567worker2 # [ 0.881969] NET: Registered PF_INET6 protocol family1568client # [ 0.890734] sdhci-pltfm: SDHCI platform and OF driver helper1569lb # [ 0.881003] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1570worker2 # [ 0.884945] Segment Routing with IPv61571worker2 # [ 0.884973] In-situ OAM (IOAM) with IPv61572worker2 # [ 0.885001] NET: Registered PF_PACKET protocol family1573client # [ 0.895033] hid: raw HID events driver (C) Jiri Kosina1574lb # [ 0.883590] drop_monitor: Initializing network drop monitor service1575client # [ 0.895290] usbcore: registered new interface driver usbhid1576lb # [ 0.883765] NET: Registered PF_INET6 protocol family1577client # [ 0.895297] usbhid: USB HID core driver1578lb # [ 0.885664] Segment Routing with IPv61579worker1 # [ 0.903087] Demotion targets for Node 0: null1580lb # [ 0.885681] In-situ OAM (IOAM) with IPv61581worker1 # [ 0.903201] Key type .fscrypt registered1582lb # [ 0.885713] NET: Registered PF_PACKET protocol family1583worker1 # [ 0.903206] Key type fscrypt-provisioning registered1584worker1 # [ 0.903294] ima: No TPM chip found, activating TPM-bypass!1585worker2 # [ 0.886776] 9pnet: Installing 9P2000 support1586worker1 # [ 0.903312] ima: Allocated hash algorithm: sha11587client # [ 0.898193] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1588worker2 # [ 0.888828] Key type dns_resolver registered1589worker1 # [ 0.903334] ima: No architecture policies found1590lb # [ 0.887339] 9pnet: Installing 9P2000 support1591client # [ 0.900757] drop_monitor: Initializing network drop monitor service1592worker1 # [ 0.907293] input: gpio-keys as /devices/platform/gpio-keys/input/input01593client # [ 0.900886] NET: Registered PF_INET6 protocol family1594client # [ 0.902814] Segment Routing with IPv61595client # [ 0.902834] In-situ OAM (IOAM) with IPv61596client # [ 0.902865] NET: Registered PF_PACKET protocol family1597lb # [ 0.890037] Key type dns_resolver registered1598client # [ 0.904508] 9pnet: Installing 9P2000 support1599worker2 # [ 0.895570] registered taskstats version 11600client # [ 0.906604] Key type dns_resolver registered1601worker2 # [ 0.895726] Loading compiled-in X.509 certificates1602lb # [ 0.896115] registered taskstats version 11603lb # [ 0.896270] Loading compiled-in X.509 certificates1604worker2 # [ 0.904321] Demotion targets for Node 0: null1605worker2 # [ 0.904434] Key type .fscrypt registered1606worker2 # [ 0.904440] Key type fscrypt-provisioning registered1607client # [ 0.913566] registered taskstats version 11608worker2 # [ 0.904532] ima: No TPM chip found, activating TPM-bypass!1609client # [ 0.913721] Loading compiled-in X.509 certificates1610worker2 # [ 0.904552] ima: Allocated hash algorithm: sha11611lb # [ 0.904834] Demotion targets for Node 0: null1612worker2 # [ 0.904573] ima: No architecture policies found1613lb # [ 0.904938] Key type .fscrypt registered1614lb # [ 0.904945] Key type fscrypt-provisioning registered1615worker2 # [ 0.908600] input: gpio-keys as /devices/platform/gpio-keys/input/input01616lb # [ 0.905040] ima: No TPM chip found, activating TPM-bypass!1617lb # [ 0.905058] ima: Allocated hash algorithm: sha11618lb # [ 0.905079] ima: No architecture policies found1619lb # [ 0.909183] input: gpio-keys as /devices/platform/gpio-keys/input/input01620worker1 # [ 0.925569] clk: Disabling unused clocks1621worker1 # [ 0.925599] PM: genpd: Disabling unused power domains1622client # [ 0.922158] Demotion targets for Node 0: null1623client # [ 0.922266] Key type .fscrypt registered1624client # [ 0.922272] Key type fscrypt-provisioning registered1625worker1 # [ 0.929858] Freeing unused kernel memory: 4736K1626client # [ 0.922366] ima: No TPM chip found, activating TPM-bypass!1627worker1 # [ 0.930078] Run /init as init process1628client # [ 0.922386] ima: Allocated hash algorithm: sha11629client # [ 0.922408] ima: No architecture policies found1630client # [ 0.926403] input: gpio-keys as /devices/platform/gpio-keys/input/input01631worker2 # [ 0.926176] clk: Disabling unused clocks1632worker2 # [ 0.926199] PM: genpd: Disabling unused power domains1633worker2 # [ 0.930409] Freeing unused kernel memory: 4736K1634worker2 # [ 0.931159] Run /init as init process1635lb # [ 0.926934] clk: Disabling unused clocks1636lb # [ 0.926958] PM: genpd: Disabling unused power domains1637worker1 # [ 0.947393] systemd[1]: Successfully made /usr/ read-only.1638lb # [ 0.931175] Freeing unused kernel memory: 4736K1639lb # [ 0.931384] Run /init as init process1640client # [ 0.944792] clk: Disabling unused clocks1641client # [ 0.944822] PM: genpd: Disabling unused power domains1642client # [ 0.949057] Freeing unused kernel memory: 4736K1643client # [ 0.949261] Run /init as init process1644worker2 # [ 0.944609] systemd[1]: Successfully made /usr/ read-only.1645lb # [ 0.947650] systemd[1]: Successfully made /usr/ read-only.1646client # [ 0.965594] systemd[1]: Successfully made /usr/ read-only.1647worker1 # [ 1.109217] usb 1-1: new high-speed USB device number 2 using ehci-pci1648worker2 # [ 1.110557] usb 1-1: new high-speed USB device number 2 using ehci-pci1649client # [ 1.131424] usb 1-1: new high-speed USB device number 2 using ehci-pci1650lb # [ 1.125525] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker1 # [ 1.261434] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652worker2 # [ 1.262742] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653worker1 # [ 1.282289] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1654client # [ 1.283774] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11655worker1 # [ 1.294458] systemd[1]: Detected virtualization qemu.1656worker1 # [ 1.296476] systemd[1]: Detected architecture arm64.1657worker1 # [ 1.298463] systemd[1]: Running in initrd.1658lb # [ 1.277919] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659worker1 # [ 1.301022] systemd[1]: Initializing machine ID from random generator.1660worker1 # [ 1.304056] systemd[1]: Hostname set to <worker1>.1661worker2 # [ 1.279414] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1662worker2 # [ 1.291548] systemd[1]: Detected virtualization qemu.1663worker2 # [ 1.293606] systemd[1]: Detected architecture arm64.1664client # [ 1.300330] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1665worker2 # [ 1.295576] systemd[1]: Running in initrd.1666client # [ 1.305977] systemd[1]: Detected virtualization qemu.1667lb # [ 1.284046] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1668client # [ 1.306930] systemd[1]: Detected architecture arm64.1669client # [ 1.307860] systemd[1]: Running in initrd.1670worker2 # [ 1.298206] systemd[1]: Initializing machine ID from random generator.1671client # [ 1.309135] systemd[1]: Initializing machine ID from random generator.1672lb # [ 1.296492] systemd[1]: Detected virtualization qemu.1673client # [ 1.310569] systemd[1]: Hostname set to <client>.1674worker2 # [ 1.301225] systemd[1]: Hostname set to <worker2>.1675lb # [ 1.296592] systemd[1]: Detected architecture arm64.1676lb # [ 1.296618] systemd[1]: Running in initrd.1677lb # [ 1.302916] systemd[1]: Initializing machine ID from random generator.1678lb # [ 1.305506] systemd[1]: Hostname set to <lb>.1679worker1 # [ 1.349449] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01680worker2 # [ 1.346744] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681client # [ 1.363660] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682lb # [ 1.361696] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker1 # [ 1.469228] usb 1-2: new high-speed USB device number 3 using ehci-pci1684worker2 # [ 1.466550] usb 1-2: new high-speed USB device number 3 using ehci-pci1685client # [ 1.483464] usb 1-2: new high-speed USB device number 3 using ehci-pci1686lb # [ 1.481490] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker1 # [ 1.611281] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688client # [ 1.607899] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689worker2 # [ 1.598975] systemd[1]: bpf-restrict-fs: LSM BPF program attached1690worker1 # [ 1.625447] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21691worker1 # [ 1.633444] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01692lb # [ 1.618651] systemd[1]: bpf-restrict-fs: LSM BPF program attached1693client # [ 1.637598] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21694worker2 # [ 1.630245] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21695client # [ 1.643600] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01696worker2 # [ 1.635535] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697lb # [ 1.646301] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21698lb # [ 1.653744] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01699client # [ 1.715460] systemd[1]: Queued start job for default target Initrd Default Target.1700worker2 # [ 1.708907] systemd[1]: Queued start job for default target Initrd Default Target.1701worker1 # [ 1.725659] systemd[1]: Queued start job for default target Initrd Default Target.1702worker2 # [ 1.716596] systemd[1]: Created slice Slice /system/modprobe.1703client # [ 1.725818] systemd[1]: Created slice Slice /system/modprobe.1704worker2 # [ 1.717641] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1705client # [ 1.727014] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1706worker2 # [ 1.718873] systemd[1]: Expecting device /dev/disk/by-label/nixos...1707worker2 # [ 1.719782] systemd[1]: Reached target Path Units.1708worker1 # [ 1.735536] systemd[1]: Created slice Slice /system/modprobe.1709worker2 # [ 1.720488] systemd[1]: Reached target Slice Units.1710worker2 # [ 1.721207] systemd[1]: Reached target Swaps.1711client # [ 1.728437] systemd[1]: Expecting device /dev/disk/by-label/nixos...1712worker2 # [ 1.721921] systemd[1]: Reached target Timer Units.1713worker1 # [ 1.736668] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1714client # [ 1.728474] systemd[1]: Reached target Path Units.1715worker1 # [ 1.738007] systemd[1]: Expecting device /dev/disk/by-label/nixos...1716worker2 # [ 1.722833] systemd[1]: Listening on D-Bus System Message Bus Socket.1717client # [ 1.728496] systemd[1]: Reached target Slice Units.1718worker1 # [ 1.739017] systemd[1]: Reached target Path Units.1719client # [ 1.728515] systemd[1]: Reached target Swaps.1720worker2 # [ 1.723884] systemd[1]: Listening on Journal Socket (/dev/log).1721worker1 # [ 1.739820] systemd[1]: Reached target Slice Units.1722client # [ 1.728535] systemd[1]: Reached target Timer Units.1723worker2 # [ 1.724874] systemd[1]: Listening on Journal Sockets.1724worker1 # [ 1.740602] systemd[1]: Reached target Swaps.1725client # [ 1.728728] systemd[1]: Listening on D-Bus System Message Bus Socket.1726worker2 # [ 1.725715] systemd[1]: Listening on udev Control Socket.1727worker1 # [ 1.741344] systemd[1]: Reached target Timer Units.1728client # [ 1.728893] systemd[1]: Listening on Journal Socket (/dev/log).1729worker2 # [ 1.726611] systemd[1]: Listening on udev Kernel Socket.1730worker1 # [ 1.742288] systemd[1]: Listening on D-Bus System Message Bus Socket.1731worker2 # [ 1.727390] systemd[1]: Reached target Socket Units.1732client # [ 1.729035] systemd[1]: Listening on Journal Sockets.1733client # [ 1.729170] systemd[1]: Listening on udev Control Socket.1734worker1 # [ 1.743498] systemd[1]: Listening on Journal Socket (/dev/log).1735client # [ 1.729282] systemd[1]: Listening on udev Kernel Socket.1736worker1 # [ 1.744593] systemd[1]: Listening on Journal Sockets.1737worker2 # [ 1.729464] systemd[1]: Starting Create List of Static Device Nodes...1738client # [ 1.729306] systemd[1]: Reached target Socket Units.1739client # [ 1.740259] systemd[1]: Starting Create List of Static Device Nodes...1740worker1 # [ 1.745556] systemd[1]: Listening on udev Control Socket.1741worker1 # [ 1.745670] systemd[1]: Listening on udev Kernel Socket.1742worker1 # [ 1.745692] systemd[1]: Reached target Socket Units.1743worker1 # [ 1.749635] systemd[1]: Starting Create List of Static Device Nodes...1744lb # [ 1.735505] systemd[1]: Queued start job for default target Initrd Default Target.1745worker2 # [ 1.738271] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1746worker2 # [ 1.739445] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1747client # [ 1.750738] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1748worker1 # [ 1.757317] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1749client # [ 1.752074] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1750worker1 # [ 1.758438] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1751lb # [ 1.743857] systemd[1]: Created slice Slice /system/modprobe.1752lb # [ 1.745042] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1753lb # [ 1.746461] systemd[1]: Expecting device /dev/disk/by-label/nixos...1754lb # [ 1.747509] systemd[1]: Reached target Path Units.1755worker1 # [ 1.764866] systemd[1]: Mounting Kernel Configuration File System...1756lb # [ 1.748330] systemd[1]: Reached target Slice Units.1757lb # [ 1.749142] systemd[1]: Reached target Swaps.1758lb # [ 1.749948] systemd[1]: Reached target Timer Units.1759lb # [ 1.750947] systemd[1]: Listening on D-Bus System Message Bus Socket.1760worker2 # [ 1.751909] systemd[1]: Mounting Kernel Configuration File System...1761lb # [ 1.752153] systemd[1]: Listening on Journal Socket (/dev/log).1762lb # [ 1.753284] systemd[1]: Listening on Journal Sockets.1763client # [ 1.764860] systemd[1]: Mounting Kernel Configuration File System...1764lb # [ 1.754457] systemd[1]: Listening on udev Control Socket.1765lb # [ 1.754583] systemd[1]: Listening on udev Kernel Socket.1766lb # [ 1.754608] systemd[1]: Reached target Socket Units.1767lb # [ 1.758740] systemd[1]: Starting Create List of Static Device Nodes...1768worker1 # [ 1.784269] systemd[1]: Starting Journal Service...1769worker2 # [ 1.770745] systemd[1]: Starting Journal Service...1770lb # [ 1.769221] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1771lb # [ 1.770630] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1772client # [ 1.787538] systemd[1]: Starting Journal Service...1773worker2 # [ 1.778659] systemd[1]: Starting Load Kernel Modules...1774worker1 # [ 1.794169] systemd[1]: Starting Load Kernel Modules...1775worker2 # [ 1.779556] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1776worker1 # [ 1.795113] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1777client # [ 1.791574] systemd[1]: Starting Load Kernel Modules...1778client # [ 1.792482] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1779lb # [ 1.783094] systemd[1]: Mounting Kernel Configuration File System...1780worker1 # [ 1.813981] systemd[1]: Starting Coldplug All udev Devices...1781worker2 # [ 1.802930] systemd[1]: Starting Coldplug All udev Devices...1782lb # [ 1.805723] systemd[1]: Starting Journal Service...1783client # [ 1.819559] systemd[1]: Starting Coldplug All udev Devices...1784lb # [ 1.809658] systemd[1]: Starting Load Kernel Modules...1785lb # [ 1.810587] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1786client # [ 1.823572] systemd[1]: Finished Create List of Static Device Nodes.1787client # [ 1.825312] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1788worker1 # [ 1.833279] systemd[1]: Finished Create List of Static Device Nodes.1789worker2 # [ 1.818070] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1790worker1 # [ 1.834528] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1791worker2 # [ 1.818374] systemd[1]: Finished Create List of Static Device Nodes.1792client # [ 1.831904] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1793worker1 # [ 1.834842] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1794worker2 # [ 1.819501] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1795worker1 # [ 1.835096] systemd[1]: Mounted Kernel Configuration File System.1796worker2 # [ 1.819813] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1797worker1 # [ 1.849533] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1798client # [ 1.846456] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1799lb # [ 1.837642] systemd[1]: Starting Coldplug All udev Devices...1800client # [ 1.852440] systemd-journald[73]: Collecting audit messages is disabled.1801client # [ 1.855906] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1802client # [ 1.857491] systemd[1]: Mounted Kernel Configuration File System.1803worker2 # [ 1.846644] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1804worker2 # [ 1.851809] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01805worker1 # [ 1.865703] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1806client # [ 1.863572] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1807lb # [ 1.854811] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1808worker2 # [ 1.852038] [drm] features: -virgl +edid -resource_blob -host_visible1809worker2 # [ 1.852046] [drm] features: -context_init1810worker2 # [ 1.852766] [drm] number of scanouts: 11811lb # [ 1.856625] systemd[1]: Finished Create List of Static Device Nodes.1812worker2 # [ 1.852784] [drm] number of cap sets: 01813worker1 # [ 1.876689] systemd-journald[73]: Collecting audit messages is disabled.1814worker2 # [ 1.861096] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1815worker2 # [ 1.861731] systemd[1]: Mounted Kernel Configuration File System.1816client # [ 1.871677] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01817client # [ 1.871913] [drm] features: -virgl +edid -resource_blob -host_visible1818client # [ 1.871923] [drm] features: -context_init1819client # [ 1.872657] [drm] number of scanouts: 11820lb # [ 1.861689] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1821lb # [ 1.862050] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1822lb # [ 1.862342] systemd[1]: Mounted Kernel Configuration File System.1823worker1 # [ 1.885191] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1824worker2 # [ 1.868969] systemd-journald[73]: Collecting audit messages is disabled.1825lb # [ 1.869924] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1826client # [ 1.872677] [drm] number of cap sets: 01827worker1 # [ 1.888004] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1828worker2 # [ 1.879868] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1829worker2 # [ 1.879891] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01830worker1 # [ 1.897698] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01831worker1 # [ 1.897946] [drm] features: -virgl +edid -resource_blob -host_visible1832worker1 # [ 1.897956] [drm] features: -context_init1833worker1 # [ 1.898681] [drm] number of scanouts: 11834worker1 # [ 1.898699] [drm] number of cap sets: 01835worker2 # [ 1.884893] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1836lb # [ 1.877642] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1837lb # [ 1.882804] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01838client # [ 1.895702] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1839lb # [ 1.883034] [drm] features: -virgl +edid -resource_blob -host_visible1840lb # [ 1.883043] [drm] features: -context_init1841lb # [ 1.883746] [drm] number of scanouts: 11842lb # [ 1.883764] [drm] number of cap sets: 01843worker1 # [ 1.902466] systemd[1]: Starting Create Static Device Nodes in /dev...1844client # [ 1.898292] systemd[1]: Starting Create Static Device Nodes in /dev...1845worker2 # [ 1.890821] systemd[1]: Starting Create Static Device Nodes in /dev...1846client # [ 1.903881] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1847client # [ 1.903902] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01848lb # [ 1.896833] systemd-journald[73]: Collecting audit messages is disabled.1849worker1 # [ 1.914325] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1850worker1 # [ 1.914345] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01851lb # [ 1.910104] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1852lb # [ 1.910125] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01853worker2 # [ 1.918817] Console: switching to colour frame buffer device 160x501854worker2 # [ 1.925217] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1855client # [ 1.939513] Console: switching to colour frame buffer device 160x501856lb # [ 1.934096] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1857client # [ 1.946004] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1858lb # [ 1.936730] systemd[1]: Starting Create Static Device Nodes in /dev...1859worker1 # [ 1.949478] Console: switching to colour frame buffer device 160x501860worker2 # [ 1.939093] systemd[1]: Finished Create Static Device Nodes in /dev.1861worker2 # [ 1.939303] systemd[1]: Reached target Preparation for Local File Systems.1862worker2 # [ 1.939337] systemd[1]: Reached target Local File Systems.1863client # [ 1.952037] systemd[1]: Finished Create Static Device Nodes in /dev.1864client # [ 1.952249] systemd[1]: Reached target Preparation for Local File Systems.1865client # [ 1.952285] systemd[1]: Reached target Local File Systems.1866worker2 # [ 1.946849] systemd[1]: Starting Rule-based Manager for Device Events and Files...1867worker1 # [ 1.961771] systemd[1]: Finished Create Static Device Nodes in /dev.1868worker1 # [ 1.961964] systemd[1]: Reached target Preparation for Local File Systems.1869worker1 # [ 1.961989] systemd[1]: Reached target Local File Systems.1870lb # [ 1.941411] Console: switching to colour frame buffer device 160x501871client # [ 1.959743] systemd[1]: Starting Rule-based Manager for Device Events and Files...1872worker1 # [ 1.965992] systemd[1]: Starting Rule-based Manager for Device Events and Files...1873worker1 # [ 1.983480] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1874worker2 # [ 1.974721] systemd[1]: Finished Load Kernel Modules.1875lb # [ 1.974325] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1876client # [ 1.987670] systemd[1]: Finished Load Kernel Modules.1877lb # [ 1.977775] systemd[1]: Finished Create Static Device Nodes in /dev.1878worker2 # [ 1.978124] systemd[1]: Starting Apply Kernel Variables...1879lb # [ 1.978152] systemd[1]: Reached target Preparation for Local File Systems.1880worker1 # [ 1.997495] systemd[1]: Finished Load Kernel Modules.1881lb # [ 1.978190] systemd[1]: Reached target Local File Systems.1882worker1 # [ 2.000777] systemd[1]: Starting Apply Kernel Variables...1883client # [ 1.991101] systemd[1]: Starting Apply Kernel Variables...1884lb # [ 1.984016] systemd[1]: Starting Rule-based Manager for Device Events and Files...1885lb # [ 2.005625] systemd[1]: Finished Load Kernel Modules.1886lb # [ 2.008663] systemd[1]: Starting Apply Kernel Variables...1887worker2 # [ 2.015240] systemd[1]: Finished Apply Kernel Variables.1888client # [ 2.028096] systemd[1]: Finished Apply Kernel Variables.1889client # [ 2.049231] systemd[1]: Started Journal Service.1890worker1 # [ 2.061831] systemd[1]: Finished Apply Kernel Variables.1891client # [ 2.044331] systemd-modules-load[74]: Inserted module 'dm_mod'1892client # [ 2.048508] systemd-modules-load[74]: Module 'virtio_balloon' is built in1893client # [ 2.049642] systemd-modules-load[74]: Module 'virtio_console' is built in1894client # [ 2.050717] systemd-modules-load[74]: Inserted module 'virtio_gpu'1895client # [ 2.051747] systemd-modules-load[74]: Module 'virtio_rng' is built in1896lb # [ 2.058057] systemd[1]: Finished Apply Kernel Variables.1897worker1 # [ 2.064917] systemd-modules-load[74]: Inserted module 'dm_mod'1898worker2 # [ 2.061064] systemd[1]: Started Journal Service.1899worker1 # [ 2.079153] systemd[1]: Started Journal Service.1900worker2 # [ 2.052487] systemd-modules-load[74]: Inserted module 'dm_mod'1901worker1 # [ 2.069312] systemd-modules-load[74]: Module 'virtio_balloon' is built in1902client # [ 2.061457] systemd[1]: Starting Create System Files and Directories...1903worker2 # [ 2.053630] systemd-modules-load[74]: Module 'virtio_balloon' is built in1904worker1 # [ 2.070443] systemd-modules-load[74]: Module 'virtio_console' is built in1905worker1 # [ 2.071514] systemd-modules-load[74]: Inserted module 'virtio_gpu'1906worker2 # [ 2.057740] systemd-modules-load[74]: Module 'virtio_console' is built in1907client # [ 2.071088] systemd-udevd[80]: Using default interface naming scheme 'v261'.1908worker1 # [ 2.081969] systemd-modules-load[74]: Module 'virtio_rng' is built in1909worker1 # [ 2.084737] systemd-udevd[79]: Using default interface naming scheme 'v261'.1910worker2 # [ 2.068342] systemd-modules-load[74]: Inserted module 'virtio_gpu'1911worker2 # [ 2.070850] systemd-modules-load[74]: Module 'virtio_rng' is built in1912lb # [ 2.081641] systemd[1]: Started Journal Service.1913worker1 # [ 2.089832] systemd[1]: Starting Create System Files and Directories...1914worker2 # [ 2.074555] systemd-udevd[80]: Using default interface naming scheme 'v261'.1915lb # [ 2.072282] systemd-modules-load[74]: Inserted module 'dm_mod'1916lb # [ 2.073424] systemd-modules-load[74]: Module 'virtio_balloon' is built in1917lb # [ 2.074534] systemd-modules-load[74]: Module 'virtio_console' is built in1918lb # [ 2.075636] systemd-modules-load[74]: Inserted module 'virtio_gpu'1919worker2 # [ 2.084364] systemd[1]: Starting Create System Files and Directories...1920client # [ 2.099826] systemd[1]: Finished Create System Files and Directories.1921lb # [ 2.088424] systemd-modules-load[74]: Module 'virtio_rng' is built in1922lb # [ 2.089486] systemd[1]: Starting Create System Files and Directories...1923lb # [ 2.090837] systemd-udevd[80]: Using default interface naming scheme 'v261'.1924worker2 # [ 2.096636] systemd[1]: Finished Create System Files and Directories.1925client # [ 2.110026] systemd[1]: Started Rule-based Manager for Device Events and Files.1926worker2 # [ 2.108799] systemd[1]: Started Rule-based Manager for Device Events and Files.1927worker1 # [ 2.127037] systemd[1]: Started Rule-based Manager for Device Events and Files.1928worker1 # [ 2.132573] systemd[1]: Finished Create System Files and Directories.1929lb # [ 2.121965] systemd[1]: Finished Create System Files and Directories.1930lb # [ 2.134139] systemd[1]: Started Rule-based Manager for Device Events and Files.1931client # [ 2.164867] systemd[1]: Starting Virtual Console Setup...1932worker2 # [ 2.164542] systemd[1]: Starting Virtual Console Setup...1933worker1 # [ 2.185580] systemd[1]: Starting Virtual Console Setup...1934lb # [ 2.192329] systemd[1]: Starting Virtual Console Setup...1935client # [ 2.216480] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1936client # [ 2.219815] systemd[1]: Finished Virtual Console Setup.1937worker2 # [ 2.212461] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1938worker2 # [ 2.215847] systemd[1]: Finished Virtual Console Setup.1939worker1 # [ 2.236484] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940worker1 # [ 2.239882] systemd[1]: Finished Virtual Console Setup.1941lb # [ 2.236453] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942lb # [ 2.239805] systemd[1]: Finished Virtual Console Setup.1943worker2 # [ 2.812727] systemd[1]: Finished Coldplug All udev Devices.1944worker2 # [ 2.814528] systemd[1]: Reached target System Initialization.1945worker2 # [ 2.816433] systemd[1]: Reached target Basic System.1946lb # [ 2.823835] systemd[1]: Finished Coldplug All udev Devices.1947lb # [ 2.825770] systemd[1]: Reached target System Initialization.1948worker1 # [ 2.854864] systemd[1]: Finished Coldplug All udev Devices.1949lb # [ 2.833109] systemd[1]: Reached target Basic System.1950worker1 # [ 2.856149] systemd[1]: Reached target System Initialization.1951worker1 # [ 2.860503] systemd[1]: Reached target Basic System.1952client # [ 2.853090] systemd[1]: Finished Coldplug All udev Devices.1953client # [ 2.854063] systemd[1]: Reached target System Initialization.1954client # [ 2.854857] systemd[1]: Reached target Basic System.1955worker2 # [ 2.952194] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1956lb # [ 2.975905] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1957worker2 # [ 2.989632] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1958worker2 # [ 2.992990] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1959lb # [ 3.002315] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1960lb # [ 3.006280] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1961client # [ 3.023010] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1962client # [ 3.029594] (udev-worker)[106]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1963client # [ 3.034198] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1964worker1 # [ 3.049502] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1965worker1 # [ 3.052730] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1966worker1 # [ 3.059640] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1967worker2 # [ 3.056384] systemd[1]: Found device /dev/disk/by-label/nixos.1968worker2 # [ 3.059341] systemd[1]: Reached target Initrd Root Device.1969worker2 # [ 3.062672] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1970lb # [ 3.064363] systemd[1]: Found device /dev/disk/by-label/nixos.1971lb # [ 3.069196] systemd[1]: Reached target Initrd Root Device.1972lb # [ 3.080679] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1973client # [ 3.100450] systemd[1]: Found device /dev/disk/by-label/nixos.1974client # [ 3.103337] systemd[1]: Reached target Initrd Root Device.1975worker1 # [ 3.129563] systemd[1]: Found device /dev/disk/by-label/nixos.1976client # [ 3.124087] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1977worker1 # [ 3.133294] systemd[1]: Reached target Initrd Root Device.1978worker2 # [ 3.117457] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1979worker1 # [ 3.138421] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1980worker2 # [ 3.124157] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1981lb # [ 3.120219] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1982worker2 # [ 3.126408] systemd[1]: Mounting /sysroot...1983lb # [ 3.128099] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1984lb # [ 3.131843] systemd[1]: Mounting /sysroot...1985client # [ 3.155100] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1986client # [ 3.162166] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1987client # [ 3.168157] systemd[1]: Mounting /sysroot...1988worker1 # [ 3.179772] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1989worker2 # [ 3.176468] EXT4-fs (vda): mounted filesystem ebc981a5-c744-4b44-9a0f-db7807dd89a5 r/w with ordered data mode. Quota mode: none.1990worker2 # [ 3.167017] systemd[1]: Mounted /sysroot.1991worker2 # [ 3.168065] systemd[1]: Reached target Initrd Root File System.1992worker2 # [ 3.170124] systemd[1]: Starting Mountpoints Configured in the Real Root...1993worker1 # [ 3.186703] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1994worker1 # [ 3.188171] systemd[1]: Mounting /sysroot...1995lb # [ 3.186427] EXT4-fs (vda): mounted filesystem 24367d81-74ac-478d-a09f-1f4e8390f8c9 r/w with ordered data mode. Quota mode: none.1996lb # [ 3.173710] systemd[1]: Mounted /sysroot.1997lb # [ 3.175490] systemd[1]: Reached target Initrd Root File System.1998lb # [ 3.180240] systemd[1]: Starting Mountpoints Configured in the Real Root...1999worker2 # [ 3.195467] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.2000client # [ 3.219547] EXT4-fs (vda): mounted filesystem 459c0bb6-c725-42d8-b253-0a9ab86755fd r/w with ordered data mode. Quota mode: none.
loading 1,297 hidden lines…
3298lb # [ 12.943570] postgresql-pre-start[698]: creating subdirectories ... ok3299lb # [ 12.951856] postgresql-pre-start[698]: selecting dynamic shared memory implementation ... posix3300worker2 # [ 13.118779] dhcpcd[637]: eth0: soliciting a DHCP lease3301worker2 # [ 13.125633] dhcpcd[637]: eth0: offered 10.0.2.15 from 10.0.2.23302worker2 # [ 13.132240] dhcpcd[637]: eth0: probing address 10.0.2.15/243303lb # [ 13.156829] postgresql-pre-start[698]: selecting default "max_connections" ... 1003304lb # [ 13.162632] systemd-logind[528]: Watching system buttons on /dev/input/event0 (gpio-keys)3305lb # [ 13.224322] systemd[1]: Condition check resulted in Virtio network device being skipped.3306lb # [ 13.238229] systemd[1]: Starting Address configuration of eth1...3307client # [ 13.375502] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33308lb # [ 13.376986] 8021q: adding VLAN 0 to HW filter on device eth03309lb # [ 13.362774] dhcpcd[673]: eth0: waiting for carrier3310lb # [ 13.367474] dhcpcd[673]: eth0: carrier acquired3311lb # [ 13.399562] dhcpcd[673]: DUID 00:01:00:01:32:42:64:a3:52:54:00:12:34:563312lb # [ 13.401726] dhcpcd[673]: eth0: IAID 00:12:34:563313lb # [ 13.404587] postgresql-pre-start[698]: selecting default "shared_buffers" ... 128MB3314lb # [ 13.407806] dhcpcd[673]: eth0: adding address fe80::5054:ff:fe12:34563315lb # [ 13.431211] 8021q: adding VLAN 0 to HW filter on device eth13316lb # [ 13.436828] network-addresses-eth1-start[734]: adding address 192.168.1.2/24... done3317lb # [ 13.453400] network-addresses-eth1-start[734]: adding address 2001:db8:1::2/64... done3318lb # [ 13.475077] systemd[1]: Finished Address configuration of eth1.3319lb # [ 13.528806] mousedev: PS/2 mouse device common for all mice3320worker2 # [ 13.609942] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3321worker2 # [ 13.614225] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3322worker2 # [ 13.618063] systemd[1]: Stopped Virtual Console Setup.3323worker2 # [ 13.621126] systemd[1]: Stopping Virtual Console Setup...3324worker2 # [ 13.621944] systemd[1]: Starting Virtual Console Setup...3325worker2 # [ 13.646728] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3326worker2 # [ 13.652337] systemd[1]: Stopped Virtual Console Setup.3327worker2 # [ 13.655235] systemd[1]: Starting Virtual Console Setup...3328client # [ 13.684332] systemd[1]: Starting Virtual Console Setup...3329worker2 # [ 13.690485] systemd-logind[504]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3330lb # [ 13.686391] systemd-logind[528]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3331client # [ 13.723531] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3332client # [ 13.734625] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3333client # [ 13.735689] systemd[1]: Stopped Virtual Console Setup.3334client # [ 13.742299] systemd[1]: Starting Virtual Console Setup...3335worker1 # [ 13.774142] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3336worker1 # [ 13.780269] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3337worker1 # [ 13.781341] systemd[1]: Stopped Virtual Console Setup.3338worker1 # [ 13.782071] systemd[1]: Stopping Virtual Console Setup...3339worker1 # [ 13.788393] systemd[1]: Starting Virtual Console Setup...3340client # [ 13.783204] systemd-logind[436]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3341worker1 # [ 13.810484] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3342worker1 # [ 13.811551] systemd[1]: Stopped Virtual Console Setup.3343worker1 # [ 13.815137] systemd[1]: Starting Virtual Console Setup...3344worker1 # [ 13.851386] systemd-logind[512]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3345worker2 # [ 13.980662] systemd-vconsole-setup[704]: Configuration of first virtual console was skipped, ignoring remaining ones.3346worker2 # [ 13.985841] systemd[1]: Finished Virtual Console Setup.3347worker1 # [ 14.145500] systemd-vconsole-setup[704]: Configuration of first virtual console was skipped, ignoring remaining ones.3348worker1 # [ 14.150961] systemd[1]: Finished Virtual Console Setup.3349worker1 # [ 14.170423] dhcpcd[630]: eth0: soliciting a DHCP lease3350client # [ 14.164458] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones.3351lb: (finished: waiting for unit network-addresses-eth1.service, in 1.30 seconds)3352worker1 # [ 14.176775] dhcpcd[630]: eth0: offered 10.0.2.15 from 10.0.2.23353lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3354client # [ 14.169121] systemd[1]: Finished Virtual Console Setup.3355worker1 # [ 14.184307] dhcpcd[630]: eth0: probing address 10.0.2.15/243356lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3357worker1: waiting for unit network-addresses-eth1.service3358worker1: waiting for the VM to finish booting3359worker1: Guest shell says: b'Spawning backdoor root shell...\n'3360worker1: connected to guest root shell3361worker1: (connecting took 0.00 seconds)3362worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3363worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3364worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3365worker1 # [ 14.348599] dhcpcd[630]: eth0: soliciting an IPv6 router3366worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3367worker2: waiting for unit network-addresses-eth1.service3368worker2: waiting for the VM to finish booting3369worker2: Guest shell says: b'Spawning backdoor root shell...\n'3370worker2: connected to guest root shell3371worker2: (connecting took 0.00 seconds)3372worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3373worker1 # [ 14.350718] dhcpcd[630]: eth0: Router Advertisement from fe80::23374worker1 # [ 14.352279] dhcpcd[630]: eth0: adding address fec0::5054:ff:fe12:3456/643375worker1 # [ 14.353362] dhcpcd[630]: eth0: adding route to fec0::/643376worker1 # [ 14.354270] dhcpcd[630]: eth0: adding default route via fe80::23377worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3378worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3379worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3380lb: waiting for unit niks3.service3381worker2 # [ 14.533926] dhcpcd[637]: eth0: soliciting an IPv6 router3382worker2 # [ 14.537131] dhcpcd[637]: eth0: Router Advertisement from fe80::23383worker2 # [ 14.539440] dhcpcd[637]: eth0: adding address fec0::5054:ff:fe12:3456/643384worker2 # [ 14.542146] dhcpcd[637]: eth0: adding route to fec0::/643385worker2 # [ 14.544224] dhcpcd[637]: eth0: adding default route via fe80::23386lb # [ 14.603171] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33387client # [ 14.671055] dhcpcd[542]: eth0: soliciting an IPv6 router3388client # [ 14.674955] dhcpcd[542]: eth0: Router Advertisement from fe80::23389client # [ 14.677613] dhcpcd[542]: eth0: adding address fec0::5054:ff:fe12:3456/643390client # [ 14.680485] dhcpcd[542]: eth0: adding route to fec0::/643391client # [ 14.682686] dhcpcd[542]: eth0: adding default route via fe80::23392lb # [ 14.840616] dhcpcd[673]: eth0: soliciting a DHCP lease3393lb # [ 14.852209] dhcpcd[673]: eth0: offered 10.0.2.15 from 10.0.2.23394lb # [ 14.860183] dhcpcd[673]: eth0: probing address 10.0.2.15/243395lb # [ 15.062880] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3396lb # [ 15.073088] systemd[1]: Starting Virtual Console Setup...3397lb # [ 15.163944] systemd-logind[528]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3398lb # [ 15.278751] dhcpcd[673]: eth0: soliciting an IPv6 router3399lb # [ 15.280237] dhcpcd[673]: eth0: Router Advertisement from fe80::23400lb # [ 15.281203] dhcpcd[673]: eth0: adding address fec0::5054:ff:fe12:3456/643401lb # [ 15.283075] dhcpcd[673]: eth0: adding route to fec0::/643402lb # [ 15.288276] dhcpcd[673]: eth0: adding default route via fe80::23403lb # [ 15.552772] systemd-vconsole-setup[773]: Configuration of first virtual console was skipped, ignoring remaining ones.3404lb # [ 15.557492] systemd[1]: Finished Virtual Console Setup.3405lb # [ 15.920823] postgresql-pre-start[698]: selecting default time zone ... UTC3406lb # [ 15.925546] postgresql-pre-start[698]: creating configuration files ... ok3407lb # [ 16.186670] postgresql-pre-start[698]: running bootstrap script ... ok3408lb # [ 16.830397] postgresql-pre-start[698]: performing post-bootstrap initialization ... ok3409lb # [ 16.997873] postgresql-pre-start[698]: syncing data to disk ... ok3410lb # [ 16.999919] postgresql-pre-start[698]: initdb: warning: enabling "trust" authentication for local connections3411lb # [ 17.001947] postgresql-pre-start[698]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3412lb # [ 17.004473] postgresql-pre-start[698]: Success. You can now start the database server using:3413lb # [ 17.005929] postgresql-pre-start[698]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3414lb # [ 17.128888] postgres[807]: [807] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3415lb # [ 17.133265] postgres[807]: [807] LOG: listening on IPv6 address "::1", port 54323416lb # [ 17.134509] postgres[807]: [807] LOG: listening on IPv4 address "127.0.0.1", port 54323417lb # [ 17.136110] postgres[807]: [807] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3418lb # [ 17.148651] postgres[816]: [816] LOG: database system was shut down at 2026-09-20 09:32:22 GMT3419lb # [ 17.154756] postgres[807]: [807] LOG: database system is ready to accept connections3420lb # [ 17.159961] systemd[1]: Started PostgreSQL Server.3421lb # [ 17.168786] systemd[1]: Starting PostgreSQL Setup Scripts...3422lb # [ 17.389958] postgresql-setup-start[827]: CREATE DATABASE3423lb # [ 17.442918] postgresql-setup-start[832]: CREATE ROLE3424lb # [ 17.466600] postgresql-setup-start[834]: ALTER DATABASE3425lb # [ 17.473615] systemd[1]: Finished PostgreSQL Setup Scripts.3426lb # [ 17.475437] systemd[1]: Reached target PostgreSQL.3427worker2 # [ 17.796301] dhcpcd[637]: eth0: leased 10.0.2.15 for 86400 seconds3428worker2 # [ 17.799520] dhcpcd[637]: eth0: adding route to 10.0.2.0/243429worker2 # [ 17.802676] dhcpcd[637]: eth0: adding default route via 10.0.2.23430worker2 # [ 17.968473] systemd[1]: Started DHCP Client.3431worker2 # [ 17.970462] systemd[1]: Reached target Multi-User System.3432worker2 # [ 17.971753] systemd[1]: Startup finished in 920ms (kernel) + 4.597s (initrd) + 12.453s (userspace) = 17.971s.3433client # [ 18.528456] dhcpcd[542]: eth0: leased 10.0.2.15 for 86400 seconds3434client # [ 18.531781] dhcpcd[542]: eth0: adding route to 10.0.2.0/243435client # [ 18.534804] dhcpcd[542]: eth0: adding default route via 10.0.2.23436client # [ 18.696403] systemd[1]: Started DHCP Client.3437client # [ 18.698443] systemd[1]: Reached target Multi-User System.3438client # [ 18.699827] systemd[1]: Startup finished in 938ms (kernel) + 5.437s (initrd) + 12.324s (userspace) = 18.699s.3439worker1 # [ 19.370258] dhcpcd[630]: eth0: leased 10.0.2.15 for 86400 seconds3440worker1 # [ 19.373799] dhcpcd[630]: eth0: adding route to 10.0.2.0/243441worker1 # [ 19.374512] dhcpcd[630]: eth0: adding default route via 10.0.2.23442worker1 # [ 19.526411] systemd[1]: Started DHCP Client.3443worker1 # [ 19.530181] systemd[1]: Reached target Multi-User System.3444worker1 # [ 19.531008] systemd[1]: Startup finished in 921ms (kernel) + 4.608s (initrd) + 13.999s (userspace) = 19.529s.3445lb # [ 20.188617] dhcpcd[673]: eth0: leased 10.0.2.15 for 86400 seconds3446lb # [ 20.190410] dhcpcd[673]: eth0: adding route to 10.0.2.0/243447lb # [ 20.191659] dhcpcd[673]: eth0: adding default route via 10.0.2.23448lb # [ 20.307942] systemd[1]: Started DHCP Client.3449lb # [ 20.312329] systemd[1]: Reached target Network is Online.3450lb # [ 20.315123] systemd[1]: Started Envoy reverse proxy.3451lb # [ 20.321742] systemd[1]: Started mock-oidc.service.3452lb # [ 20.419437] mock-oidc-server[921]: Mock OIDC Server running3453lb # [ 20.420757] mock-oidc-server[921]: OIDC Address: 192.168.1.2:80803454lb # [ 20.422321] mock-oidc-server[921]: Issue Address: 0.0.0.0:80813455lb # [ 20.423501] mock-oidc-server[921]: Issuer: http://192.168.1.2:8080/oidc3456lb # [ 20.425063] mock-oidc-server[921]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3457lb # [ 20.426614] mock-oidc-server[921]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3458lb # [ 20.428160] mock-oidc-server[921]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3459lb # [ 20.950474] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3460lb # [ 20.952898] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:469] statically linked extensions:3461lb # [ 20.954509] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3462lb # [ 20.957481] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3463lb # [ 20.999053] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3464lb # [ 21.006431] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13465lb # [ 21.009267] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3466lb # [ 21.011546] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3467lb # [ 21.013819] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3468lb # [ 21.016507] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3469lb # [ 21.019841] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3470lb # [ 21.022447] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3471lb # [ 21.025273] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3472lb # [ 21.027953] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3473lb # [ 21.029984] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3474lb # [ 21.035676] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3475lb # [ 21.037646] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3476lb # [ 21.040344] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3477lb # [ 21.042020] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83478lb # [ 21.046915] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3479lb # [ 21.050255] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3480lb # [ 21.052132] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3481lb # [ 21.053717] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3482lb # [ 21.057253] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3483lb # [ 21.059216] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3484lb # [ 21.061754] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3485lb # [ 21.063991] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3486lb # [ 21.066524] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3487lb # [ 21.068835] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3488lb # [ 21.071305] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3489lb # [ 21.076383] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3490lb # [ 21.079825] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3491lb # [ 21.082552] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3492lb # [ 21.090912] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3493lb # [ 21.093453] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3494lb # [ 21.099925] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3495lb # [ 21.103760] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3496lb # [ 21.106712] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3497lb # [ 21.112315] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3498lb # [ 21.119903] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3499lb # [ 21.122314] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3500lb # [ 21.124125] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3501lb # [ 21.126464] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3502lb # [ 21.128606] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3503lb # [ 21.130541] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3504lb # [ 21.133903] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3505lb # [ 21.137361] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23506lb # [ 21.139743] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3507lb # [ 21.142499] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3508lb # [ 21.147706] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23509lb # [ 21.149684] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3510lb # [ 21.156350] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3511lb # [ 21.158448] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3512lb # [ 21.161827] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3513lb # [ 21.164985] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3514lb # [ 21.167671] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3515lb # [ 21.170497] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3516lb # [ 21.172507] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3517lb # [ 21.174463] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3518lb # [ 21.176798] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3519lb # [ 21.179392] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3520lb # [ 21.182702] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3521lb # [ 21.184772] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3522lb # [ 21.186607] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3523lb # [ 21.189626] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3524lb # [ 21.191675] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3525lb # [ 21.195296] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3526lb # [ 21.198422] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23527lb # [ 21.200521] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3528lb # [ 21.203933] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3529lb # [ 21.206473] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3530lb # [ 21.214917] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3531lb # [ 21.222566] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3532lb # [ 21.227073] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3533lb # [ 21.233459] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3534lb # [ 21.236727] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3535lb # [ 21.239547] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3536lb # [ 21.243050] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3537lb # [ 21.245518] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3538lb # [ 21.248281] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3539lb # [ 21.261353] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3540lb # [ 21.270859] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3541lb # [ 21.277079] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3542lb # [ 21.283170] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3543lb # [ 21.286711] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3544lb # [ 21.290341] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3545lb # [ 21.293041] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3546lb # [ 21.295016] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3547lb # [ 21.303761] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3548lb # [ 21.306070] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3549lb # [ 21.311392] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3550lb # [ 21.322088] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3551lb # [ 21.325262] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3552lb # [ 21.328386] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3553lb # [ 21.342231] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3554lb # [ 21.344439] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3555lb # [ 21.347391] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3556lb # [ 21.350831] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3557lb # [ 21.353132] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3558lb # [ 21.354842] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3559lb # [ 21.357167] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3560lb # [ 21.359333] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3561lb # [ 21.361843] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3562lb # [ 21.364867] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3563lb # [ 21.367395] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3564lb # [ 21.373313] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3565lb # [ 21.375081] envoy[920]: [2026-09-20 09:32:26.647][920][info][main] [source/server/server.cc:531] HTTP header map info:3566lb # [ 21.376772] envoy[920]: [2026-09-20 09:32:26.649][920][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3567lb # [ 21.392839] envoy[920]: [2026-09-20 09:32:26.649][920][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3568lb # [ 21.394364] envoy[920]: [2026-09-20 09:32:26.649][920][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3569lb # [ 21.403555] envoy[920]: [2026-09-20 09:32:26.649][920][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3570lb # [ 21.405611] envoy[920]: [2026-09-20 09:32:26.858][920][info][main] [source/server/server.cc:968] runtime: {}3571lb # [ 21.407244] envoy[920]: [2026-09-20 09:32:26.884][920][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3572lb # [ 21.411037] envoy[920]: [2026-09-20 09:32:26.884][920][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013573lb # [ 21.413013] envoy[920]: [2026-09-20 09:32:26.884][920][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013574lb # [ 21.414986] envoy[920]: [2026-09-20 09:32:26.888][920][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3575lb # [ 21.417213] envoy[920]: [2026-09-20 09:32:26.888][920][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3576lb # [ 21.419096] envoy[920]: [2026-09-20 09:32:26.888][920][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3577lb # [ 21.440920] envoy[920]: [2026-09-20 09:32:27.092][920][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3578lb # [ 21.454557] envoy[920]: [2026-09-20 09:32:27.106][920][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3579worker1 # [ 21.476194] systemd[1]: Starting Nix worker-protocol over gRPC...3580lb # [ 21.457315] envoy[920]: [2026-09-20 09:32:27.109][920][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3581worker2 # [ 21.464485] systemd[1]: Starting Nix worker-protocol over gRPC...3582lb # [ 21.461164] envoy[920]: [2026-09-20 09:32:27.109][920][info][main] [source/server/server.cc:1077] starting main dispatch loop3583worker1 # [ 21.725547] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3584worker2 # [ 21.711321] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3585worker1 # [ 21.738542] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13586worker2 # [ 21.722904] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13587worker2 # [ 21.764427] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3588worker1 # [ 21.781562] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3589worker2 # [ 21.766237] systemd[1]: Started Nix worker-protocol over gRPC.3590worker1 # [ 21.786417] systemd[1]: Started Nix worker-protocol over gRPC.3591lb # [ 21.798701] envoy[920]: [2026-09-20 09:32:27.450][920][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3592lb # [ 21.806982] envoy[920]: [2026-09-20 09:32:27.450][920][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3593lb # [ 21.816255] envoy[920]: [2026-09-20 09:32:27.450][920][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3594lb # [ 21.828228] envoy[920]: [2026-09-20 09:32:27.450][920][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3595worker1 # [ 21.859821] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500513596worker2 # [ 21.843428] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500513597worker1 # [ 21.864333] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3598worker2 # [ 21.847820] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3599worker2 # [ 22.049419] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500513600worker1 # [ 22.065714] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500513601worker1 # [ 22.070968] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3602worker2 # [ 22.060356] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3603worker2 # [ 22.257872] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500513604worker1 # [ 22.271800] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:500513605worker2 # [ 22.263033] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3606worker1 # [ 22.282544] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3607worker1 # [ 22.478049] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500513608worker2 # [ 22.464177] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500513609worker1 # [ 22.483468] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3610worker2 # [ 22.469276] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3611worker1 # [ 22.684428] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500513612worker2 # [ 22.670151] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500513613worker1 # [ 22.689650] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3614worker2 # [ 22.675363] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3615worker1 # [ 22.892283] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 22.877971] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500513617worker1 # [ 22.896511] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3618worker2 # [ 22.882146] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3619worker1 # [ 23.092788] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500513620worker2 # [ 23.078285] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500513621worker1 # [ 23.098174] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3622worker2 # [ 23.083509] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3623worker1 # [ 23.298716] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 23.301538] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3625worker2 # [ 23.284660] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:500513626worker2 # [ 23.289681] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker1 # [ 23.502681] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 23.490531] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500513629worker1 # [ 23.508197] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3630worker2 # [ 23.495726] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3631worker1 # [ 23.709090] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500513632worker2 # [ 23.696749] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500513633worker1 # [ 23.714416] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3634worker2 # [ 23.701736] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker1 # [ 23.917017] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 23.904326] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500513637worker1 # [ 23.921366] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3638worker2 # [ 23.908411] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker1 # [ 24.117682] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 24.104821] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500513641worker1 # [ 24.122981] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3642worker2 # [ 24.109838] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker1 # [ 24.323889] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 24.310748] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:500513645worker1 # [ 24.329353] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3646worker2 # [ 24.315994] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker1 # [ 24.530001] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 24.516768] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500513649worker1 # [ 24.533743] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3650worker2 # [ 24.520355] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker1 # [ 24.734677] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 24.721538] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500513653worker1 # [ 24.739973] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3654worker2 # [ 24.726870] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker1 # [ 24.942436] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 24.929565] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500513657worker1 # [ 24.946516] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3658worker2 # [ 24.933411] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker1 # [ 25.143149] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500513660worker2 # [ 25.129853] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500513661worker1 # [ 25.148566] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3662worker2 # [ 25.135235] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker1 # [ 25.349489] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500513664worker2 # [ 25.337197] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:500513665worker1 # [ 25.354729] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3666worker2 # [ 25.347326] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker2 # [ 25.538274] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500513668worker1 # [ 25.555701] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500513669worker2 # [ 25.543847] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3670worker1 # [ 25.561240] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker2 # [ 25.744794] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500513672worker1 # [ 25.761907] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500513673worker2 # [ 25.750043] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3674worker1 # [ 25.767246] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker1 # [ 25.969047] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500513676worker2 # [ 25.951878] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 25.957098] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3678worker1 # [ 25.974277] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker2 # [ 26.157888] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 26.175319] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 26.163791] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3682worker1 # [ 26.181720] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3683worker2 # [ 26.365268] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500513684worker1 # [ 26.382739] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500513685worker2 # [ 26.371460] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3686worker1 # [ 26.388765] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3687worker2 # [ 26.572676] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500513688worker1 # [ 26.590543] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 26.578571] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3690worker1 # [ 26.597028] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3691worker2 # [ 26.780360] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500513692worker1 # [ 26.798214] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500513693worker2 # [ 26.786708] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3694worker1 # [ 26.804130] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3695worker2 # [ 26.989352] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500513696worker1 # [ 27.008675] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500513697worker2 # [ 26.994747] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3698worker1 # [ 27.013139] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3699worker1 # [ 27.208692] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500513700worker2 # [ 27.191519] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:500513701worker2 # [ 27.197314] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3702worker1 # [ 27.214429] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3703worker2 # [ 27.398516] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500513704worker1 # [ 27.415528] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500513705worker1 # [ 27.421510] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3706worker2 # [ 27.405656] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3707worker1 # [ 27.622288] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500513708worker2 # [ 27.606889] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500513709worker1 # [ 27.628106] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3710worker2 # [ 27.613499] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3711worker1 # [ 27.829515] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500513712worker2 # [ 27.817656] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500513713worker1 # [ 27.835533] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3714worker2 # [ 27.824122] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3715worker2 # [ 28.019697] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500513716worker1 # [ 28.039758] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500513717worker2 # [ 28.024871] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3718worker1 # [ 28.044508] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3719worker1 # [ 28.240596] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500513720worker2 # [ 28.226990] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:500513721worker1 # [ 28.246638] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3722worker2 # [ 28.232754] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3723lb # [ 28.336533] rustfs-bucket-start[997]: mb s3://farm3724lb # [ 28.344840] systemd[1]: Finished rustfs-bucket.service.3725lb # [ 28.353382] systemd[1]: Starting niks3 server...3726worker2 # [ 28.429624] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500513727worker1 # [ 28.448518] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500513728worker2 # [ 28.435640] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3729worker1 # [ 28.455101] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3730lb # [ 28.584895] postgres[1017]: [1017] ERROR: relation "goose_db_version" does not exist at character 363731lb # [ 28.586217] postgres[1017]: [1017] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3732lb # [ 28.624567] niks3-server[1011]: 2026/09/20 09:32:34 OK 20241026095416_initial_model.sql (24.82ms)3733lb # [ 28.628314] niks3-server[1011]: 2026/09/20 09:32:34 OK 20251210153512_drop_unused_gin_index.sql (2.04ms)3734worker2 # [ 28.637188] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500513735lb # [ 28.635166] niks3-server[1011]: 2026/09/20 09:32:34 OK 20251218171726_add_pins.sql (6.79ms)3736worker1 # [ 28.657193] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500513737lb # [ 28.640454] niks3-server[1011]: 2026/09/20 09:32:34 OK 20260628120000_add_object_size_and_stats.sql (5.24ms)3738worker2 # [ 28.644466] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3739worker1 # [ 28.662373] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3740lb # [ 28.647530] niks3-server[1011]: 2026/09/20 09:32:34 OK 20260905000000_add_claims.sql (7.04ms)3741lb # [ 28.652552] niks3-server[1011]: 2026/09/20 09:32:34 OK 20260920000000_drop_claims.sql (4.83ms)3742lb # [ 28.653812] niks3-server[1011]: 2026/09/20 09:32:34 goose: successfully migrated database to version: 202609200000003743lb # [ 28.659177] niks3-server[1011]: 2026/09/20 09:32:34 OK 1_commit_pending_closure.sql (6.59ms)3744lb # [ 28.662456] niks3-server[1011]: 2026/09/20 09:32:34 OK 2_object_stats_trigger.sql (3.12ms)3745lb # [ 28.663760] niks3-server[1011]: 2026/09/20 09:32:34 goose: up to current file version: 23746lb # [ 28.668504] niks3-server[1011]: 2026/09/20 09:32:34 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3747lb # [ 28.722138] niks3-server[1011]: 2026/09/20 09:32:34 INFO Read proxy enabled — serving cache objects from S33748lb # [ 28.724949] niks3-server[1011]: 2026/09/20 09:32:34 INFO Using socket-activated listener address=0.0.0.0:57513749lb # [ 28.729428] niks3-server[1011]: 2026/09/20 09:32:34 INFO systemd watchdog enabled interval=15s3750lb # [ 28.730588] niks3-server[1011]: 2026/09/20 09:32:34 INFO Starting HTTP server address=0.0.0.0:57513751lb # [ 28.736293] systemd[1]: Started niks3 server.3752lb # [ 28.737147] niks3-server[1011]: 2026/09/20 09:32:34 INFO lead: acquired remote=192.168.1.4:354743753lb # [ 28.738297] systemd[1]: Reached target Multi-User System.3754worker2 # [ 28.742050] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_take_over3755lb # [ 28.739095] systemd[1]: Startup finished in 918ms (kernel) + 5.486s (initrd) + 22.324s (userspace) = 28.729s.3756worker2 # [ 28.844634] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500513757worker1 # [ 28.863975] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:500513758worker2 # [ 28.864800] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03759worker2 # [ 28.871582] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03760lb: (finished: waiting for unit niks3.service, in 14.96 seconds)3761lb: waiting for TCP port 5751 on localhost3762lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3763lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds)3764lb: waiting for unit envoy.service3765lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3766lb: waiting for TCP port 50051 on localhost3767lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3768lb # [ 29.643169] envoy[920]: conn peer=[::1]:37456 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33769lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3770lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3771??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3772 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283773lb: must succeed: curl -sf localhost:9901/clusters3774lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)3775lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.12 seconds)3776subtest: one node schedules and both builders hold a WorkerSession on it3777lb: must succeed: curl -sf localhost:9901/clusters3778lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3779worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3780worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)3781(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.16 seconds)3782subtest: balancer auth: client cert, bearer token, nothing, unknown CN3783worker2 # [ 30.534753] nix-grpc-daemon[778]: ts=2026-09-20T09:32:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:603183784worker2 # [ 30.553777] systemd[1]: Started Nix Daemon.3785worker2 # [ 30.907246] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3786worker2 # [ 30.950527] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 1/5)3787worker2 # [ 30.968780] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 2/5)3788worker2 # [ 31.012297] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 298 ms (attempt 3/5)3789worker2 # [ 31.316788] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 351 ms (attempt 4/5)3790worker2 # [ 31.673720] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3791worker2 # [ 31.705551] nix-grpc-daemon[778]: ts=2026-09-20T09:32:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:603183792worker2 # [ 31.723592] nix-grpc-daemon[778]: ts=2026-09-20T09:32:37Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it"3793worker2 # [ 31.738230] nix-grpc-daemon[778]: ts=2026-09-20T09:32:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:603183794worker2 # [ 31.750743] nix-grpc-daemon[778]: ts=2026-09-20T09:32:37Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it"3795client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3796client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.13 seconds)3797client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3798client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds)3799worker2 # [ 32.742336] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=info event=oidc_jwks provider=mock keys=13800worker2 # [ 32.742808] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:603183801worker2 # [ 32.761730] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:603183802worker2 # [ 32.775780] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it"3803worker2 # [ 32.791483] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:603183804worker2 # [ 32.799668] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it"3805client: must succeed: rm -r /var/lib/nix-grpc-store3806client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.06 seconds)3807worker2 # [ 35.165802] nix-grpc-daemon[778]: ts=2026-09-20T09:32:40Z level=info event=denied method=QueryMissing cn=- role=none3808worker2 # [ 35.444639] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=info event=denied method=QueryMissing cn=stranger role=none3809(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.34 seconds)3810subtest: DAG build is scheduled across workers and lands in the cache3811client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23812worker1 # [ 35.766441] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:456803813worker1 # [ 35.781422] systemd[1]: Started Nix Daemon.3814worker1 # [ 36.117352] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3815client # don't know how to build these paths:3816client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3817worker2 # [ 36.131560] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603183818worker2 # [ 36.203863] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03819worker2 # [ 36.210945] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13820worker1 # [ 36.275549] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456803821worker1 # [ 36.331403] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5)3822worker1 # [ 36.356576] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 132 ms (attempt 2/5)3823worker1 # [ 36.496836] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 3/5)3824worker1 # [ 36.596633] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 691 ms (attempt 4/5)3825worker1 # [ 37.298843] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3826worker1 # [ 37.323112] nix-grpc-daemon[778]: ts=2026-09-20T09:32:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456803827client # copying 1 paths to 'lb:50051'...3828worker1 # [ 37.340113] nix-grpc-daemon[778]: ts=2026-09-20T09:32:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456803829client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3830worker1 # [ 37.372577] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3831worker1 # [ 37.408701] nix-grpc-daemon[778]: ts=2026-09-20T09:32:43Z level=info event=niks3_push_started pid=8463832worker1 # [ 37.876075] nix-daemon[837]: accepted connection from pid 859, user nix-grpc-daemon (trusted)3833worker1 # [ 37.896711] nix-daemon[837]: reaped child process 862, status = succeeded3834worker1 # [ 38.069008] nix-daemon[837]: accepted connection from pid 864, user nix-grpc-daemon (trusted)3835worker1 # [ 38.088240] nix-daemon[837]: reaped child process 867, status = succeeded3836lb # [ 38.079254] niks3-server[1011]: 2026/09/20 09:32:43 INFO Received uploads request method=POST path=/api/pending_closures3837worker1 # [ 38.132095] nix-grpc-daemon[846]: time=2026-09-20T09:32:43.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3838worker1 # [ 38.133731] nix-grpc-daemon[846]: time=2026-09-20T09:32:43.777Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3839lb # [ 38.161799] niks3-server[1011]: 2026/09/20 09:32:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3840lb # [ 38.168377] niks3-server[1011]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3841lb # [ 38.184114] niks3-server[1011]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3842lb # [ 38.202718] niks3-server[1011]: 2026/09/20 09:32:43 INFO Signed narinfos id=1 count=13843worker1 # [ 38.230292] nix-grpc-daemon[846]: time=2026-09-20T09:32:43.876Z level=INFO msg="Uploading 1 narinfos"3844lb # [ 38.218750] niks3-server[1011]: 2026/09/20 09:32:43 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3845lb # [ 38.226290] niks3-server[1011]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3846lb # [ 38.242482] niks3-server[1011]: 2026/09/20 09:32:43 INFO Completed upload id=13847worker1 # [ 38.264981] nix-grpc-daemon[846]: time=2026-09-20T09:32:43.912Z level=INFO msg="Upload complete. (571ms)"3848worker1 # [ 38.275686] nix-grpc-daemon[778]: ts=2026-09-20T09:32:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=5043849worker1 # [ 38.292686] nix-grpc-daemon[778]: ts=2026-09-20T09:32:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456803850worker1 # [ 38.306742] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3851worker1 # [ 38.314221] nix-daemon[837]: reaped child process 844, status = succeeded3852client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3853worker1 # [ 38.323224] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3854client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3855client # farm-a> LOG-farm-a-t13856worker1 # [ 40.171302] nix-daemon[837]: reaped child process 871, status = succeeded3857worker1 # [ 40.358854] nix-daemon[837]: accepted connection from pid 887, user nix-grpc-daemon (trusted)3858worker1 # [ 40.377026] nix-daemon[837]: reaped child process 890, status = succeeded3859lb # [ 40.366985] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received uploads request method=POST path=/api/pending_closures3860worker1 # [ 40.402878] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.048Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3861worker1 # [ 40.405036] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.048Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3862lb # [ 40.415111] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3863lb # [ 40.431794] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3864lb # [ 40.442971] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3865worker1 # [ 40.466085] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.112Z level=INFO msg="Uploading 1 narinfos"3866lb # [ 40.446678] niks3-server[1011]: 2026/09/20 09:32:46 INFO Signed narinfos id=2 count=13867lb # [ 40.449565] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3868lb # [ 40.457924] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3869lb # [ 40.466247] niks3-server[1011]: 2026/09/20 09:32:46 INFO Completed upload id=23870worker1 # [ 40.487626] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.134Z level=INFO msg="Upload complete. (348ms)"3871lb # [ 40.468819] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3872worker1 # [ 40.501377] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13873worker1 # [ 40.517123] nix-daemon[837]: reaped child process 869, status = succeeded3874worker2 # [ 40.497423] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03875worker2 # [ 40.498165] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13876worker1 # [ 40.564145] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456803877worker1 # [ 40.579647] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456803878worker1 # [ 40.594795] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.242Z level=INFO msg="All 1 paths already cached"3879client # copying 1 paths to 'lb:50051'...3880worker1 # [ 40.603893] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456803881client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3882worker1 # [ 40.628199] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3883worker1 # [ 40.839532] nix-daemon[837]: accepted connection from pid 894, user nix-grpc-daemon (trusted)3884worker1 # [ 40.857212] nix-daemon[837]: reaped child process 897, status = succeeded3885worker1 # [ 41.032810] nix-daemon[837]: accepted connection from pid 899, user nix-grpc-daemon (trusted)3886worker1 # [ 41.050445] nix-daemon[837]: reaped child process 902, status = succeeded3887lb # [ 41.040509] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received uploads request method=POST path=/api/pending_closures3888worker1 # [ 41.074447] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.721Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3889worker1 # [ 41.076098] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.721Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3890lb # [ 41.071331] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3891lb # [ 41.084518] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3892worker1 # [ 41.113105] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.760Z level=INFO msg="Uploading 1 narinfos"3893lb # [ 41.098468] niks3-server[1011]: 2026/09/20 09:32:46 INFO Signed narinfos id=3 count=13894lb # [ 41.104453] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3895lb # [ 41.111150] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3896lb # [ 41.119371] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3897lb # [ 41.126229] niks3-server[1011]: 2026/09/20 09:32:46 INFO Completed upload id=33898worker1 # [ 41.148485] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.795Z level=INFO msg="Upload complete. (503ms)"3899worker1 # [ 41.159193] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=6243900worker1 # [ 41.174921] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456803901worker1 # [ 41.181761] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3902worker1 # [ 41.190775] nix-daemon[837]: reaped child process 892, status = succeeded3903client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3904worker1 # [ 41.200466] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3905client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3906lb # [ 41.447380] envoy[920]: conn peer=[2001:db8:1::1]:37550 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=12863907lb # [ 41.452586] envoy[920]: conn peer=[2001:db8:1::1]:54194 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1013908lb # [ 41.457117] envoy[920]: conn peer=[2001:db8:1::1]:54196 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=183909lb # [ 41.462318] envoy[920]: conn peer=[2001:db8:1::1]:54210 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=153910client # farm-b> LOG-farm-b-t13911worker1 # [ 42.033601] nix-daemon[837]: reaped child process 906, status = succeeded3912worker1 # [ 42.198955] nix-daemon[837]: accepted connection from pid 921, user nix-grpc-daemon (trusted)3913worker1 # [ 42.223626] nix-daemon[837]: reaped child process 924, status = succeeded3914lb # [ 42.218970] niks3-server[1011]: 2026/09/20 09:32:47 INFO Received uploads request method=POST path=/api/pending_closures3915worker1 # [ 42.252601] nix-grpc-daemon[846]: time=2026-09-20T09:32:47.898Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3916worker1 # [ 42.254093] nix-grpc-daemon[846]: time=2026-09-20T09:32:47.898Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3917lb # [ 42.257621] niks3-server[1011]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3918worker1 # [ 42.295917] nix-grpc-daemon[846]: time=2026-09-20T09:32:47.942Z level=INFO msg="Uploading 1 narinfos"3919lb # [ 42.273164] niks3-server[1011]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3920lb # [ 42.284291] niks3-server[1011]: 2026/09/20 09:32:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3921lb # [ 42.291299] niks3-server[1011]: 2026/09/20 09:32:47 INFO Signed narinfos id=4 count=13922lb # [ 42.298233] niks3-server[1011]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3923worker1 # [ 42.326794] nix-grpc-daemon[846]: time=2026-09-20T09:32:47.974Z level=INFO msg="Upload complete. (314ms)"3924lb # [ 42.305381] niks3-server[1011]: 2026/09/20 09:32:47 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3925lb # [ 42.311423] niks3-server[1011]: 2026/09/20 09:32:47 INFO Completed upload id=43926lb # [ 42.314722] niks3-server[1011]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3927worker1 # [ 42.332670] nix-grpc-daemon[778]: ts=2026-09-20T09:32:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13928worker1 # [ 42.341894] nix-daemon[837]: reaped child process 904, status = succeeded3929worker2 # [ 42.330281] nix-grpc-daemon[778]: ts=2026-09-20T09:32:47Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03930worker2 # [ 42.336349] nix-grpc-daemon[778]: ts=2026-09-20T09:32:47Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13931worker1 # [ 42.389982] nix-grpc-daemon[778]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456803932worker1 # [ 42.408830] nix-grpc-daemon[778]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456803933worker1 # [ 42.422443] nix-grpc-daemon[846]: time=2026-09-20T09:32:48.069Z level=INFO msg="All 2 paths already cached"3934client # copying 1 paths to 'lb:50051'...3935worker1 # [ 42.432092] nix-grpc-daemon[778]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456803936client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3937worker1 # [ 42.454075] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3938worker1 # [ 42.651184] nix-daemon[837]: accepted connection from pid 929, user nix-grpc-daemon (trusted)3939worker1 # [ 42.668829] nix-daemon[837]: reaped child process 932, status = succeeded3940worker1 # [ 42.841313] nix-daemon[837]: accepted connection from pid 934, user nix-grpc-daemon (trusted)3941worker1 # [ 42.859795] nix-daemon[837]: reaped child process 937, status = succeeded3942lb # [ 42.849007] niks3-server[1011]: 2026/09/20 09:32:48 INFO Received uploads request method=POST path=/api/pending_closures3943worker1 # [ 42.882763] nix-grpc-daemon[846]: time=2026-09-20T09:32:48.529Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3944worker1 # [ 42.884388] nix-grpc-daemon[846]: time=2026-09-20T09:32:48.529Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3945lb # [ 42.883267] niks3-server[1011]: 2026/09/20 09:32:48 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3946lb # [ 42.895540] niks3-server[1011]: 2026/09/20 09:32:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3947worker1 # [ 42.924344] nix-grpc-daemon[846]: time=2026-09-20T09:32:48.571Z level=INFO msg="Uploading 1 narinfos"3948lb # [ 42.906668] niks3-server[1011]: 2026/09/20 09:32:48 INFO Signed narinfos id=5 count=13949lb # [ 42.912295] niks3-server[1011]: 2026/09/20 09:32:48 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3950lb # [ 42.919524] niks3-server[1011]: 2026/09/20 09:32:48 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3951lb # [ 42.926187] niks3-server[1011]: 2026/09/20 09:32:48 INFO Completed upload id=53952worker1 # [ 42.948272] nix-grpc-daemon[846]: time=2026-09-20T09:32:48.595Z level=INFO msg="Upload complete. (477ms)"3953lb # [ 42.928654] niks3-server[1011]: 2026/09/20 09:32:48 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3954worker1 # [ 42.956070] nix-grpc-daemon[778]: ts=2026-09-20T09:32:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=7523955worker1 # [ 42.970423] nix-grpc-daemon[778]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456803956worker1 # [ 42.976615] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3957worker1 # [ 42.981435] nix-daemon[837]: reaped child process 927, status = succeeded3958client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3959client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3960worker1 # [ 42.995202] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3961client # farm-top> LOG-farm-top-t13962worker1 # [ 44.442826] nix-daemon[837]: reaped child process 941, status = succeeded3963worker1 # [ 44.617546] nix-daemon[837]: accepted connection from pid 956, user nix-grpc-daemon (trusted)3964worker1 # [ 44.636313] nix-daemon[837]: reaped child process 959, status = succeeded3965lb # [ 44.626643] niks3-server[1011]: 2026/09/20 09:32:50 INFO Received uploads request method=POST path=/api/pending_closures3966worker1 # [ 44.660425] nix-grpc-daemon[846]: time=2026-09-20T09:32:50.306Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3967worker1 # [ 44.661905] nix-grpc-daemon[846]: time=2026-09-20T09:32:50.306Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3968lb # [ 44.661460] niks3-server[1011]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3969lb # [ 44.677731] niks3-server[1011]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3970lb # [ 44.691986] niks3-server[1011]: 2026/09/20 09:32:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3971worker1 # [ 44.718338] nix-grpc-daemon[846]: time=2026-09-20T09:32:50.365Z level=INFO msg="Uploading 1 narinfos"3972lb # [ 44.700702] niks3-server[1011]: 2026/09/20 09:32:50 INFO Signed narinfos id=6 count=13973lb # [ 44.702972] niks3-server[1011]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3974lb # [ 44.713106] niks3-server[1011]: 2026/09/20 09:32:50 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3975lb # [ 44.720961] niks3-server[1011]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3976lb # [ 44.725954] niks3-server[1011]: 2026/09/20 09:32:50 INFO Completed upload id=63977worker1 # [ 44.748306] nix-grpc-daemon[846]: time=2026-09-20T09:32:50.395Z level=INFO msg="Upload complete. (341ms)"3978worker1 # [ 44.761177] nix-grpc-daemon[778]: ts=2026-09-20T09:32:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13979worker1 # [ 44.778043] nix-daemon[837]: reaped child process 939, status = succeeded3980client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 9.33 seconds)3981client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3982client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds)3983client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3984client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)3985client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3986client # copying 3 paths...3987client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3988client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3989client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3990client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds)3991(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 10.01 seconds)3992subtest: repeat is answered Cached by the scheduler without building3993worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3994worker1 # finding garbage collector roots...3995worker1 # deleting specified paths...3996worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3997worker1 # deleting unused links...3998worker1 # note: hard linking is currently saving 0.0 KiB3999worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)4000worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4001worker2 # finding garbage collector roots...4002worker2 # deleting specified paths...4003worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4004worker2 # deleting unused links...4005worker2 # note: hard linking is currently saving 0.0 KiB4006worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)4007client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24008worker1 # [ 46.382750] nix-grpc-daemon[778]: ts=2026-09-20T09:32:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:456804009client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4010client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4011worker1 # [ 46.401723] nix-grpc-daemon[778]: ts=2026-09-20T09:32:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456804012worker1 # [ 46.414440] nix-grpc-daemon[846]: time=2026-09-20T09:32:52.059Z level=INFO msg="All 2 paths already cached"4013worker2 # [ 46.412726] nix-grpc-daemon[778]: ts=2026-09-20T09:32:52Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14014client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.35 seconds)4015client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4016client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds)4017lb: must succeed: curl -sf localhost:9901/clusters4018lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4019lb: must succeed: curl -sf localhost:9901/clusters4020lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4021worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4022worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.08 seconds)4023(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.54 seconds)4024subtest: inputs already in the cache are not sent to the scheduler4025lb: must succeed: curl -sf localhost:9901/clusters4026lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4027lb: must succeed: curl -sf localhost:9901/clusters4028lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4029worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4030worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4031client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24032client # don't know how to build these paths:4033client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4034worker1 # [ 47.480991] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:456804035worker2 # [ 47.471215] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603184036worker2 # [ 47.502145] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04037worker2 # [ 47.508395] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14038worker1 # [ 47.566503] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456804039worker1 # [ 47.580805] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456804040worker1 # [ 47.597348] nix-grpc-daemon[846]: time=2026-09-20T09:32:53.243Z level=INFO msg="All 2 paths already cached"4041client # copying 1 paths to 'lb:50051'...4042client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4043worker1 # [ 47.608143] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456804044worker1 # [ 47.622976] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4045worker1 # [ 47.829357] nix-daemon[837]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4046worker1 # [ 47.850709] nix-daemon[837]: reaped child process 980, status = succeeded4047worker1 # [ 48.023516] nix-daemon[837]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4048worker1 # [ 48.042935] nix-daemon[837]: reaped child process 985, status = succeeded4049lb # [ 48.034693] niks3-server[1011]: 2026/09/20 09:32:53 INFO Received uploads request method=POST path=/api/pending_closures4050worker1 # [ 48.066902] nix-grpc-daemon[846]: time=2026-09-20T09:32:53.713Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4051worker1 # [ 48.068497] nix-grpc-daemon[846]: time=2026-09-20T09:32:53.713Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4052lb # [ 48.063060] niks3-server[1011]: 2026/09/20 09:32:53 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4053lb # [ 48.080513] niks3-server[1011]: 2026/09/20 09:32:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4054worker1 # [ 48.108109] nix-grpc-daemon[846]: time=2026-09-20T09:32:53.755Z level=INFO msg="Uploading 1 narinfos"4055lb # [ 48.093042] niks3-server[1011]: 2026/09/20 09:32:53 INFO Signed narinfos id=7 count=14056lb # [ 48.099620] niks3-server[1011]: 2026/09/20 09:32:53 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4057lb # [ 48.107347] niks3-server[1011]: 2026/09/20 09:32:53 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4058lb # [ 48.114800] niks3-server[1011]: 2026/09/20 09:32:53 INFO Completed upload id=74059worker1 # [ 48.134615] nix-grpc-daemon[846]: time=2026-09-20T09:32:53.781Z level=INFO msg="Upload complete. (493ms)"4060lb # [ 48.118384] niks3-server[1011]: 2026/09/20 09:32:53 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4061worker1 # [ 48.144551] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=7524062worker1 # [ 48.155255] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456804063worker1 # [ 48.162145] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4064worker1 # [ 48.166669] nix-daemon[837]: reaped child process 975, status = succeeded4065client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4066client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4067worker1 # [ 48.180106] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4068client # farm-top> LOG-farm-top-t1b4069worker1 # [ 49.840306] nix-daemon[837]: reaped child process 989, status = succeeded4070worker1 # [ 50.018652] nix-daemon[837]: accepted connection from pid 1004, user nix-grpc-daemon (trusted)4071worker1 # [ 50.038018] nix-daemon[837]: reaped child process 1007, status = succeeded4072lb # [ 50.030224] niks3-server[1011]: 2026/09/20 09:32:55 INFO Received uploads request method=POST path=/api/pending_closures4073worker1 # [ 50.065270] nix-grpc-daemon[846]: time=2026-09-20T09:32:55.710Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4074worker1 # [ 50.070347] nix-grpc-daemon[846]: time=2026-09-20T09:32:55.710Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4075lb # [ 50.071636] niks3-server[1011]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4076lb # [ 50.087015] niks3-server[1011]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4077lb # [ 50.097867] niks3-server[1011]: 2026/09/20 09:32:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4078worker1 # [ 50.124421] nix-grpc-daemon[846]: time=2026-09-20T09:32:55.771Z level=INFO msg="Uploading 1 narinfos"4079lb # [ 50.105945] niks3-server[1011]: 2026/09/20 09:32:55 INFO Signed narinfos id=8 count=14080lb # [ 50.110620] niks3-server[1011]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4081lb # [ 50.118478] niks3-server[1011]: 2026/09/20 09:32:55 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4082lb # [ 50.127570] niks3-server[1011]: 2026/09/20 09:32:55 INFO Completed upload id=84083lb # [ 50.130410] niks3-server[1011]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4084worker1 # [ 50.149279] nix-grpc-daemon[846]: time=2026-09-20T09:32:55.796Z level=INFO msg="Upload complete. (358ms)"4085worker1 # [ 50.161498] nix-grpc-daemon[778]: ts=2026-09-20T09:32:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=2 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14086worker1 # [ 50.181260] nix-daemon[837]: reaped child process 987, status = succeeded4087client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.97 seconds)4088client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4089client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds)4090lb: must succeed: curl -sf localhost:9901/clusters4091lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4092lb: must succeed: curl -sf localhost:9901/clusters4093lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4094worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4095worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4096(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.62 seconds)4097subtest: two clients wanting the same drv build it once4098client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4099client # [ 50.729902] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4100client # Running as unit: dedup1.service; invocation ID: 899eaf41316c457b84b6fe56ff4bb2a14101client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.11 seconds)4102client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4103client # [ 50.982151] nix[885]: don't know how to build these paths:4104client # [ 50.984064] nix[885]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4105worker2 # [ 50.973430] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:603184106worker2 # [ 50.987785] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04107worker2 # [ 50.995619] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14108worker2 # [ 51.033689] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603184109worker2 # [ 51.053389] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603184110client # [ 51.076206] nix[885]: copying 1 paths to 'lb:50051'...4111client # [ 51.078523] nix[885]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4112worker2 # [ 51.068346] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603184113worker2 # [ 51.083091] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4114worker2 # [ 51.115842] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=info event=niks3_push_started pid=8944115lb # [ 51.449175] envoy[920]: conn peer=[2001:db8:1::1]:54224 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9540 tx=3880 ms=90434116lb # [ 51.449484] envoy[920]: conn peer=[2001:db8:1::1]:38156 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=734117lb # [ 51.449591] envoy[920]: conn peer=[2001:db8:1::1]:38172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1727 ms=26954118worker2 # [ 51.564235] nix-daemon[840]: accepted connection from pid 907, user nix-grpc-daemon (trusted)4119worker2 # [ 51.584248] nix-daemon[840]: reaped child process 910, status = succeeded4120worker2 # [ 51.762590] nix-daemon[840]: accepted connection from pid 912, user nix-grpc-daemon (trusted)4121worker2 # [ 51.780301] nix-daemon[840]: reaped child process 915, status = succeeded4122lb # [ 51.789721] niks3-server[1011]: 2026/09/20 09:32:57 INFO Received uploads request method=POST path=/api/pending_closures4123worker2 # [ 51.806174] nix-grpc-daemon[894]: time=2026-09-20T09:32:57.451Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4124worker2 # [ 51.807966] nix-grpc-daemon[894]: time=2026-09-20T09:32:57.451Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4125lb # [ 51.824183] niks3-server[1011]: 2026/09/20 09:32:57 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4126lb # [ 51.836644] niks3-server[1011]: 2026/09/20 09:32:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4127worker2 # [ 51.849281] nix-grpc-daemon[894]: time=2026-09-20T09:32:57.495Z level=INFO msg="Uploading 1 narinfos"4128client # [ 51.849369] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4129lb # [ 51.847443] niks3-server[1011]: 2026/09/20 09:32:57 INFO Signed narinfos id=9 count=14130client # Running as unit: dedup2.service; invocation ID: 173c4c88bfe241ad91a1dc16592e4eb94131lb # [ 51.856726] niks3-server[1011]: 2026/09/20 09:32:57 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4132client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4133lb # [ 51.867851] niks3-server[1011]: 2026/09/20 09:32:57 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4134lb # [ 51.877206] niks3-server[1011]: 2026/09/20 09:32:57 INFO Completed upload id=94135worker2 # [ 51.883782] nix-grpc-daemon[894]: time=2026-09-20T09:32:57.529Z level=INFO msg="Upload complete. (504ms)"4136lb # [ 51.881273] niks3-server[1011]: 2026/09/20 09:32:57 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4137worker2 # [ 51.892305] nix-grpc-daemon[778]: ts=2026-09-20T09:32:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=1 nar_bytes_in=4324138worker2 # [ 51.900332] nix-grpc-daemon[778]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603184139worker2 # [ 51.913307] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4140worker2 # [ 51.916701] nix-daemon[840]: reaped child process 892, status = succeeded4141client # [ 51.934180] nix[885]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4142worker2 # [ 51.929612] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4143worker1 # [ 52.182707] nix-grpc-daemon[778]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:456804144client # [ 52.182425] nix[900]: don't know how to build these paths:4145client # [ 52.183494] nix[900]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4146worker2 # [ 52.189138] nix-grpc-daemon[778]: ts=2026-09-20T09:32:57Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04147client # [ 52.206726] nix[900]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4148worker2 # [ 52.197715] nix-grpc-daemon[778]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603184149client: must succeed: sleep 24150client: (finished: must succeed: sleep 2, in 2.07 seconds)4151??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4152 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394153client: waiting for success: ! systemctl is-active dedup1 dedup24154??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4155 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394156worker2 # [ 56.777428] nix-daemon[840]: reaped child process 919, status = succeeded4157worker2 # [ 56.967035] nix-daemon[840]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4158worker2 # [ 56.987203] nix-daemon[840]: reaped child process 957, status = succeeded4159lb # [ 56.994989] niks3-server[1011]: 2026/09/20 09:33:02 INFO Received uploads request method=POST path=/api/pending_closures4160worker2 # [ 57.012717] nix-grpc-daemon[894]: time=2026-09-20T09:33:02.657Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4161worker2 # [ 57.015884] nix-grpc-daemon[894]: time=2026-09-20T09:33:02.657Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4162lb # [ 57.043553] niks3-server[1011]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4163lb # [ 57.056889] niks3-server[1011]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4164worker2 # [ 57.072283] nix-grpc-daemon[894]: time=2026-09-20T09:33:02.718Z level=INFO msg="Uploading 1 narinfos"4165lb # [ 57.069023] niks3-server[1011]: 2026/09/20 09:33:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4166lb # [ 57.073382] niks3-server[1011]: 2026/09/20 09:33:02 INFO Signed narinfos id=10 count=14167lb # [ 57.075712] niks3-server[1011]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4168lb # [ 57.089366] niks3-server[1011]: 2026/09/20 09:33:02 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4169lb # [ 57.095395] niks3-server[1011]: 2026/09/20 09:33:02 INFO Completed upload id=104170worker2 # [ 57.099836] nix-grpc-daemon[894]: time=2026-09-20T09:33:02.747Z level=INFO msg="Upload complete. (353ms)"4171lb # [ 57.098401] niks3-server[1011]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4172worker2 # [ 57.117038] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14173worker2 # [ 57.134115] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14174worker2 # [ 57.141455] nix-daemon[840]: reaped child process 917, status = succeeded4175client # [ 57.182317] systemd[1]: dedup2.service: Deactivated successfully.4176client # [ 57.186728] systemd[1]: dedup2.service: Consumed 184ms CPU time over 5.337s wall clock time, 31M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic.4177client # [ 57.198278] systemd[1]: dedup1.service: Deactivated successfully.4178client # [ 57.201129] systemd[1]: dedup1.service: Consumed 158ms CPU time over 6.465s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.4179client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds)4180client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4181client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4182worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4183worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4184worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4185worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4186worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4187worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4188worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4189worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds)4190(finished: subtest: two clients wanting the same drv build it once, in 7.47 seconds)4191subtest: build hook: nix-daemon with builders = grpc://lb4192client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4193client # [ 58.348623] systemd[1]: Started Nix Daemon.4194client # [ 58.535343] nix-daemon[941]: accepted connection from pid 938, user root (trusted)4195worker2 # [ 58.738690] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:603184196worker2 # [ 58.746119] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603184197worker2 # [ 58.758815] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04198worker2 # [ 58.769661] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14199worker1 # [ 58.825204] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456804200worker1 # [ 58.842503] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456804201worker1 # [ 58.859138] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456804202worker1 # [ 58.874867] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4203worker1 # [ 59.085538] nix-daemon[837]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)4204worker1 # [ 59.103831] nix-daemon[837]: reaped child process 1041, status = succeeded4205worker1 # [ 59.279260] nix-daemon[837]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)4206worker1 # [ 59.295752] nix-daemon[837]: reaped child process 1046, status = succeeded4207lb # [ 59.289824] niks3-server[1011]: 2026/09/20 09:33:04 INFO Received uploads request method=POST path=/api/pending_closures4208worker1 # [ 59.323171] nix-grpc-daemon[846]: time=2026-09-20T09:33:04.969Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4209worker1 # [ 59.324782] nix-grpc-daemon[846]: time=2026-09-20T09:33:04.969Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4210lb # [ 59.322456] niks3-server[1011]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4211worker1 # [ 59.359172] nix-grpc-daemon[846]: time=2026-09-20T09:33:05.006Z level=INFO msg="Uploading 1 narinfos"4212lb # [ 59.339438] niks3-server[1011]: 2026/09/20 09:33:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4213lb # [ 59.349915] niks3-server[1011]: 2026/09/20 09:33:04 INFO Signed narinfos id=11 count=14214lb # [ 59.358722] niks3-server[1011]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4215worker1 # [ 59.386717] nix-grpc-daemon[846]: time=2026-09-20T09:33:05.033Z level=INFO msg="Upload complete. (494ms)"4216lb # [ 59.365354] niks3-server[1011]: 2026/09/20 09:33:05 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4217lb # [ 59.370178] niks3-server[1011]: 2026/09/20 09:33:05 INFO Completed upload id=114218lb # [ 59.373464] niks3-server[1011]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4219worker1 # [ 59.396138] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=5124220worker1 # [ 59.407575] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456804221worker1 # [ 59.414240] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4222worker1 # [ 59.418713] nix-daemon[837]: reaped child process 1036, status = succeeded4223worker1 # [ 59.429526] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4224worker1 # [ 60.675419] nix-daemon[837]: reaped child process 1050, status = succeeded4225worker1 # [ 60.860928] nix-daemon[837]: accepted connection from pid 1065, user nix-grpc-daemon (trusted)4226worker1 # [ 60.879219] nix-daemon[837]: reaped child process 1068, status = succeeded4227lb # [ 60.869933] niks3-server[1011]: 2026/09/20 09:33:06 INFO Received uploads request method=POST path=/api/pending_closures4228worker1 # [ 60.904612] nix-grpc-daemon[846]: time=2026-09-20T09:33:06.549Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4229worker1 # [ 60.906465] nix-grpc-daemon[846]: time=2026-09-20T09:33:06.549Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4230lb # [ 60.908726] niks3-server[1011]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4231lb # [ 60.924510] niks3-server[1011]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4232lb # [ 60.937324] niks3-server[1011]: 2026/09/20 09:33:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4233worker1 # [ 60.959860] nix-grpc-daemon[846]: time=2026-09-20T09:33:06.606Z level=INFO msg="Uploading 1 narinfos"4234lb # [ 60.942570] niks3-server[1011]: 2026/09/20 09:33:06 INFO Signed narinfos id=12 count=14235lb # [ 60.949020] niks3-server[1011]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4236lb # [ 60.958498] niks3-server[1011]: 2026/09/20 09:33:06 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4237lb # [ 60.965819] niks3-server[1011]: 2026/09/20 09:33:06 INFO Completed upload id=124238worker1 # [ 60.988000] nix-grpc-daemon[846]: time=2026-09-20T09:33:06.635Z level=INFO msg="Upload complete. (345ms)"4239lb # [ 60.968675] niks3-server[1011]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4240worker1 # [ 61.001248] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14241worker2 # [ 60.987121] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:603184242worker1 # [ 61.018627] nix-daemon[837]: reaped child process 1048, status = succeeded4243worker2 # [ 61.004146] nix-grpc-daemon[778]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4244worker1 # [ 61.101383] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:456804245worker1 # [ 61.109926] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_out=1284246worker2 # [ 61.357160] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:603184247worker2 # [ 61.365058] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603184248worker2 # [ 61.372812] nix-grpc-daemon[894]: time=2026-09-20T09:33:07.018Z level=INFO msg="All 1 paths already cached"4249worker2 # [ 61.385630] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04250worker1 # [ 61.405912] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456804251worker2 # [ 61.391789] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14252worker1 # [ 61.422116] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456804253worker1 # [ 61.437435] nix-grpc-daemon[846]: time=2026-09-20T09:33:07.084Z level=INFO msg="All 1 paths already cached"4254worker1 # [ 61.447640] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456804255worker1 # [ 61.461955] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4256lb # [ 61.446639] envoy[920]: conn peer=[2001:db8:1::1]:58642 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1374 ms=61584257lb # [ 61.452266] envoy[920]: conn peer=[2001:db8:1::1]:58654 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=49714258lb # [ 61.457584] envoy[920]: conn peer=[2001:db8:1::1]:58668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3414 tx=1747 ms=23774259lb # [ 61.463185] envoy[920]: conn peer=[2001:db8:1::1]:49486 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=334 ms=354260worker1 # [ 61.691917] nix-daemon[837]: accepted connection from pid 1072, user nix-grpc-daemon (trusted)4261worker1 # [ 61.713208] nix-daemon[837]: reaped child process 1075, status = succeeded4262worker1 # [ 61.892218] nix-daemon[837]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4263worker1 # [ 61.910841] nix-daemon[837]: reaped child process 1080, status = succeeded4264lb # [ 61.903584] niks3-server[1011]: 2026/09/20 09:33:07 INFO Received uploads request method=POST path=/api/pending_closures4265worker1 # [ 61.935297] nix-grpc-daemon[846]: time=2026-09-20T09:33:07.581Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4266worker1 # [ 61.937012] nix-grpc-daemon[846]: time=2026-09-20T09:33:07.581Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4267lb # [ 61.932894] niks3-server[1011]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4268worker1 # [ 61.969040] nix-grpc-daemon[846]: time=2026-09-20T09:33:07.616Z level=INFO msg="Uploading 1 narinfos"4269lb # [ 61.950142] niks3-server[1011]: 2026/09/20 09:33:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4270lb # [ 61.960523] niks3-server[1011]: 2026/09/20 09:33:07 INFO Signed narinfos id=13 count=14271lb # [ 61.966029] niks3-server[1011]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4272lb # [ 61.974833] niks3-server[1011]: 2026/09/20 09:33:07 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4273lb # [ 61.980129] niks3-server[1011]: 2026/09/20 09:33:07 INFO Completed upload id=134274worker1 # [ 62.001560] nix-grpc-daemon[846]: time=2026-09-20T09:33:07.648Z level=INFO msg="Upload complete. (522ms)"4275lb # [ 61.982885] niks3-server[1011]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4276worker1 # [ 62.013196] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=6244277worker1 # [ 62.024241] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456804278worker1 # [ 62.031024] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4279worker1 # [ 62.035706] nix-daemon[837]: reaped child process 1070, status = succeeded4280worker1 # [ 62.049303] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4281worker1 # [ 63.697317] nix-daemon[837]: reaped child process 1084, status = succeeded4282worker1 # [ 63.876545] nix-daemon[837]: accepted connection from pid 1099, user nix-grpc-daemon (trusted)4283worker1 # [ 63.896528] nix-daemon[837]: reaped child process 1102, status = succeeded4284lb # [ 63.886916] niks3-server[1011]: 2026/09/20 09:33:09 INFO Received uploads request method=POST path=/api/pending_closures4285worker1 # [ 63.919664] nix-grpc-daemon[846]: time=2026-09-20T09:33:09.565Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4286worker1 # [ 63.921411] nix-grpc-daemon[846]: time=2026-09-20T09:33:09.565Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4287lb # [ 63.922541] niks3-server[1011]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4288lb # [ 63.941395] niks3-server[1011]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4289worker1 # [ 63.977101] nix-grpc-daemon[846]: time=2026-09-20T09:33:09.624Z level=INFO msg="Uploading 1 narinfos"4290lb # [ 63.950482] niks3-server[1011]: 2026/09/20 09:33:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4291lb # [ 63.959812] niks3-server[1011]: 2026/09/20 09:33:09 INFO Signed narinfos id=14 count=14292lb # [ 63.965110] niks3-server[1011]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4293lb # [ 63.972253] niks3-server[1011]: 2026/09/20 09:33:09 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4294lb # [ 63.977839] niks3-server[1011]: 2026/09/20 09:33:09 INFO Completed upload id=144295worker1 # [ 63.999895] nix-grpc-daemon[846]: time=2026-09-20T09:33:09.646Z level=INFO msg="Upload complete. (339ms)"4296lb # [ 63.980279] niks3-server[1011]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4297worker1 # [ 64.014828] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14298worker1 # [ 64.028395] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:456804299worker1 # [ 64.032884] nix-daemon[837]: reaped child process 1082, status = succeeded4300worker2 # [ 64.021895] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:603184301worker2 # [ 64.035307] nix-grpc-daemon[778]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4302worker2 # [ 64.054800] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=1 nar_bytes_out=1764303worker1 # [ 64.382733] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:456804304worker2 # [ 64.370081] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603184305worker2 # [ 64.381271] nix-grpc-daemon[894]: time=2026-09-20T09:33:10.027Z level=INFO msg="All 2 paths already cached"4306worker2 # [ 64.399810] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04307worker2 # [ 64.406285] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14308worker1 # [ 64.426317] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456804309worker1 # [ 64.442553] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456804310worker1 # [ 64.457403] nix-grpc-daemon[846]: time=2026-09-20T09:33:10.104Z level=INFO msg="All 2 paths already cached"4311worker1 # [ 64.467562] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456804312worker1 # [ 64.482263] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4313worker1 # [ 64.693748] nix-daemon[837]: accepted connection from pid 1106, user nix-grpc-daemon (trusted)4314worker1 # [ 64.713565] nix-daemon[837]: reaped child process 1109, status = succeeded4315worker1 # [ 64.891123] nix-daemon[837]: accepted connection from pid 1111, user nix-grpc-daemon (trusted)4316worker1 # [ 64.909275] nix-daemon[837]: reaped child process 1114, status = succeeded4317lb # [ 64.901879] niks3-server[1011]: 2026/09/20 09:33:10 INFO Received uploads request method=POST path=/api/pending_closures4318worker1 # [ 64.933873] nix-grpc-daemon[846]: time=2026-09-20T09:33:10.580Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4319worker1 # [ 64.935360] nix-grpc-daemon[846]: time=2026-09-20T09:33:10.580Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4320lb # [ 64.935784] niks3-server[1011]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4321worker1 # [ 64.967925] nix-grpc-daemon[846]: time=2026-09-20T09:33:10.615Z level=INFO msg="Uploading 1 narinfos"4322lb # [ 64.950689] niks3-server[1011]: 2026/09/20 09:33:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4323lb # [ 64.961243] niks3-server[1011]: 2026/09/20 09:33:10 INFO Signed narinfos id=15 count=14324lb # [ 64.963762] niks3-server[1011]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4325lb # [ 64.974621] niks3-server[1011]: 2026/09/20 09:33:10 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4326worker1 # [ 65.000795] nix-grpc-daemon[846]: time=2026-09-20T09:33:10.648Z level=INFO msg="Upload complete. (500ms)"4327lb # [ 64.979407] niks3-server[1011]: 2026/09/20 09:33:10 INFO Completed upload id=154328lb # [ 64.982184] niks3-server[1011]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4329worker1 # [ 65.008214] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=7524330worker1 # [ 65.023193] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456804331worker1 # [ 65.029827] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4332worker1 # [ 65.034729] nix-daemon[837]: reaped child process 1104, status = succeeded4333worker1 # [ 65.046121] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4334worker1 # [ 66.486071] nix-daemon[837]: reaped child process 1118, status = succeeded4335worker1 # [ 66.658490] nix-daemon[837]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)4336worker1 # [ 66.679157] nix-daemon[837]: reaped child process 1136, status = succeeded4337lb # [ 66.671550] niks3-server[1011]: 2026/09/20 09:33:12 INFO Received uploads request method=POST path=/api/pending_closures4338worker1 # [ 66.711409] nix-grpc-daemon[846]: time=2026-09-20T09:33:12.355Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4339worker1 # [ 66.713149] nix-grpc-daemon[846]: time=2026-09-20T09:33:12.355Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4340lb # [ 66.716351] niks3-server[1011]: 2026/09/20 09:33:12 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4341lb # [ 66.723199] niks3-server[1011]: 2026/09/20 09:33:12 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4342worker1 # [ 66.752774] nix-grpc-daemon[846]: time=2026-09-20T09:33:12.399Z level=INFO msg="Uploading 1 narinfos"4343lb # [ 66.732526] niks3-server[1011]: 2026/09/20 09:33:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4344lb # [ 66.734890] niks3-server[1011]: 2026/09/20 09:33:12 INFO Signed narinfos id=16 count=14345lb # [ 66.741445] niks3-server[1011]: 2026/09/20 09:33:12 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4346lb # [ 66.747926] niks3-server[1011]: 2026/09/20 09:33:12 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4347worker1 # [ 66.773960] nix-grpc-daemon[846]: time=2026-09-20T09:33:12.421Z level=INFO msg="Upload complete. (314ms)"4348lb # [ 66.753963] niks3-server[1011]: 2026/09/20 09:33:12 INFO Completed upload id=164349lb # [ 66.757390] niks3-server[1011]: 2026/09/20 09:33:12 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4350worker1 # [ 66.784991] nix-grpc-daemon[778]: ts=2026-09-20T09:33:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14351worker2 # [ 66.771531] nix-grpc-daemon[778]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:603184352worker1 # [ 66.797974] nix-daemon[837]: reaped child process 1116, status = succeeded4353worker2 # [ 66.785095] nix-grpc-daemon[778]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4354worker2 # [ 66.827904] nix-grpc-daemon[778]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:603184355worker2 # [ 66.833171] nix-grpc-daemon[778]: ts=2026-09-20T09:33:12Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=1 nar_bytes_out=2324356client # [ 66.974164] nix-daemon[941]: reaped child process 943, status = succeeded4357client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.87 seconds)4358client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4359client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4360client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4361client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4362client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4363client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4364(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 9.00 seconds)4365subtest: an input only one worker has still reaches the builder4366client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4367client # this derivation will be built:4368client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4369client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4370client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.45 seconds)4371client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4372client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds)4373worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4374worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds)4375worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4376worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4377client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24378client # [ 68.279749] nix-daemon[941]: accepted connection from pid 1021, user root (trusted)4379client # this derivation will be built:4380client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4381worker1 # [ 68.491050] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:456804382client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4383worker1 # [ 68.499164] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456804384worker1 # [ 68.697733] nix-daemon[837]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)4385worker1 # [ 68.715470] nix-daemon[837]: reaped child process 1146, status = succeeded4386lb # [ 68.705911] niks3-server[1011]: 2026/09/20 09:33:14 INFO Received uploads request method=POST path=/api/pending_closures4387worker1 # [ 68.737840] nix-grpc-daemon[846]: time=2026-09-20T09:33:14.384Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4388worker1 # [ 68.739343] nix-grpc-daemon[846]: time=2026-09-20T09:33:14.384Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4389lb # [ 68.734855] niks3-server[1011]: 2026/09/20 09:33:14 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4390lb # [ 68.750428] niks3-server[1011]: 2026/09/20 09:33:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4391worker1 # [ 68.778635] nix-grpc-daemon[846]: time=2026-09-20T09:33:14.425Z level=INFO msg="Uploading 1 narinfos"4392lb # [ 68.763626] niks3-server[1011]: 2026/09/20 09:33:14 INFO Signed narinfos id=17 count=14393lb # [ 68.769644] niks3-server[1011]: 2026/09/20 09:33:14 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4394lb # [ 68.777682] niks3-server[1011]: 2026/09/20 09:33:14 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4395lb # [ 68.783265] niks3-server[1011]: 2026/09/20 09:33:14 INFO Completed upload id=174396worker1 # [ 68.804502] nix-grpc-daemon[846]: time=2026-09-20T09:33:14.451Z level=INFO msg="Upload complete. (306ms)"4397lb # [ 68.785523] niks3-server[1011]: 2026/09/20 09:33:14 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4398worker2 # [ 68.815987] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04399worker2 # [ 68.816484] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14400worker2 # [ 68.862679] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603184401worker2 # [ 68.879241] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603184402client # copying 2 paths to 'lb:50051'...4403client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4404worker2 # [ 68.899288] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603184405client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4406worker2 # [ 68.915517] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4407worker2 # [ 69.132180] nix-daemon[840]: accepted connection from pid 986, user nix-grpc-daemon (trusted)4408worker2 # [ 69.150935] nix-daemon[840]: reaped child process 989, status = succeeded4409worker2 # [ 69.322355] nix-daemon[840]: accepted connection from pid 991, user nix-grpc-daemon (trusted)4410worker2 # [ 69.340392] nix-daemon[840]: reaped child process 994, status = succeeded4411lb # [ 69.345899] niks3-server[1011]: 2026/09/20 09:33:14 INFO Received uploads request method=POST path=/api/pending_closures4412lb # [ 69.356381] niks3-server[1011]: 2026/09/20 09:33:15 INFO Received uploads request method=POST path=/api/pending_closures4413worker2 # [ 69.372062] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.018Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4414worker2 # [ 69.373612] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.018Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4415worker2 # [ 69.375344] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.018Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4416lb # [ 69.399178] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4417lb # [ 69.414078] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4418lb # [ 69.422950] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4419worker2 # [ 69.437282] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.083Z level=INFO msg="Uploading 3 narinfos"4420lb # [ 69.433593] niks3-server[1011]: 2026/09/20 09:33:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4421lb # [ 69.440148] niks3-server[1011]: 2026/09/20 09:33:15 INFO Signed narinfos id=19 count=24422lb # [ 69.442081] niks3-server[1011]: 2026/09/20 09:33:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4423lb # [ 69.450852] niks3-server[1011]: 2026/09/20 09:33:15 INFO Signed narinfos id=18 count=14424lb # [ 69.455184] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4425lb # [ 69.462991] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4426lb # [ 69.472362] niks3-server[1011]: 2026/09/20 09:33:15 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4427lb # [ 69.480847] niks3-server[1011]: 2026/09/20 09:33:15 INFO Completed upload id=184428lb # [ 69.483350] niks3-server[1011]: 2026/09/20 09:33:15 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4429worker2 # [ 69.497242] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.144Z level=INFO msg="Upload complete. (561ms)"4430lb # [ 69.491632] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4431lb # [ 69.496318] niks3-server[1011]: 2026/09/20 09:33:15 INFO Completed upload id=194432worker2 # [ 69.508389] nix-grpc-daemon[778]: ts=2026-09-20T09:33:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=2 nar_bytes_in=9844433worker2 # [ 69.524641] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.153Z level=WARN msg="Failed to register uploaded object" key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo error="server returned 404: object is not pending upload\n"4434worker2 # [ 69.539890] nix-grpc-daemon[778]: ts=2026-09-20T09:33:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603184435worker2 # [ 69.548181] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4436worker2 # [ 69.550188] nix-daemon[840]: reaped child process 984, status = succeeded4437worker2 # [ 69.558839] nix-grpc-daemon[778]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4438client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4439worker2 # [ 69.576258] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4440client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4441worker2 # [ 71.209621] nix-daemon[840]: reaped child process 999, status = succeeded4442worker2 # [ 71.379493] nix-daemon[840]: accepted connection from pid 1014, user nix-grpc-daemon (trusted)4443worker2 # [ 71.400331] nix-daemon[840]: reaped child process 1017, status = succeeded4444lb # [ 71.410411] niks3-server[1011]: 2026/09/20 09:33:17 INFO Received uploads request method=POST path=/api/pending_closures4445worker2 # [ 71.435997] nix-grpc-daemon[894]: time=2026-09-20T09:33:17.082Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4446lb # [ 71.446631] envoy[920]: conn peer=[2001:db8:1::1]:49490 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3900 tx=1876 ms=27574447lb # [ 71.459915] envoy[920]: conn peer=[2001:db8:1::1]:49498 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=984448worker2 # [ 71.479661] nix-grpc-daemon[894]: time=2026-09-20T09:33:17.126Z level=INFO msg="Uploading 1 narinfos"4449lb # [ 71.477030] envoy[920]: conn peer=[2001:db8:1::1]:49506 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4352 tx=2223 ms=25224450lb # [ 71.484839] envoy[920]: conn peer=[2001:db8:1::1]:49508 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=654451lb # [ 71.494525] niks3-server[1011]: 2026/09/20 09:33:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4452lb # [ 71.501515] niks3-server[1011]: 2026/09/20 09:33:17 INFO Signed narinfos id=20 count=14453lb # [ 71.507351] niks3-server[1011]: 2026/09/20 09:33:17 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4454lb # [ 71.513157] niks3-server[1011]: 2026/09/20 09:33:17 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4455lb # [ 71.517668] niks3-server[1011]: 2026/09/20 09:33:17 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4456lb # [ 71.522235] niks3-server[1011]: 2026/09/20 09:33:17 INFO Completed upload id=204457worker2 # [ 71.517840] nix-grpc-daemon[894]: time=2026-09-20T09:33:17.164Z level=INFO msg="Upload complete. (325ms)"4458lb # [ 71.525148] niks3-server[1011]: 2026/09/20 09:33:17 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4459worker2 # [ 71.532306] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=2 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14460worker2 # [ 71.551060] nix-daemon[840]: reaped child process 996, status = succeeded4461client # copying 1 paths...4462worker2 # [ 71.580185] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:603184463client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4464worker1 # [ 71.632663] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:456804465worker1 # [ 71.654410] nix-grpc-daemon[778]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4466worker1 # [ 71.678199] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_out=1204467client # [ 71.810028] nix-daemon[941]: reaped child process 1024, status = succeeded4468client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.76 seconds)4469client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24470client # [ 72.029138] nix-daemon[941]: accepted connection from pid 1041, user root (trusted)4471client # this derivation will be built:4472client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4473worker2 # [ 72.230835] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:603184474client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4475worker2 # [ 72.239186] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603184476worker2 # [ 72.246488] nix-grpc-daemon[894]: time=2026-09-20T09:33:17.892Z level=INFO msg="All 1 paths already cached"4477worker2 # [ 72.259833] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04478worker1 # [ 72.281322] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456804479worker2 # [ 72.266987] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14480worker1 # [ 72.298004] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456804481client # copying 1 paths to 'lb:50051'...4482client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4483worker1 # [ 72.322693] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456804484worker1 # [ 72.338762] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4485worker1 # [ 72.364103] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 1/5)4486worker1 # [ 72.457047] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 2/5)4487worker1 # [ 72.480361] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 244 ms (attempt 3/5)4488worker1 # [ 72.733051] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 4/5)4489worker1 # [ 72.787990] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4490worker1 # [ 72.799112] nix-grpc-daemon[778]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4491worker1 # [ 73.049356] nix-daemon[837]: accepted connection from pid 1155, user nix-grpc-daemon (trusted)4492worker1 # [ 73.068985] nix-daemon[837]: reaped child process 1158, status = succeeded4493worker1 # [ 73.256910] nix-daemon[837]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)4494worker1 # [ 73.275806] nix-daemon[837]: reaped child process 1163, status = succeeded4495lb # [ 73.266580] niks3-server[1011]: 2026/09/20 09:33:18 INFO Received uploads request method=POST path=/api/pending_closures4496worker1 # [ 73.300092] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.946Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4497worker1 # [ 73.301677] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.946Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4498lb # [ 73.297260] niks3-server[1011]: 2026/09/20 09:33:18 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4499lb # [ 73.315426] niks3-server[1011]: 2026/09/20 09:33:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4500worker1 # [ 73.343524] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.990Z level=INFO msg="Uploading 1 narinfos"4501lb # [ 73.329749] niks3-server[1011]: 2026/09/20 09:33:18 INFO Signed narinfos id=21 count=14502lb # [ 73.336729] niks3-server[1011]: 2026/09/20 09:33:18 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4503lb # [ 73.350712] niks3-server[1011]: 2026/09/20 09:33:18 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4504lb # [ 73.356677] niks3-server[1011]: 2026/09/20 09:33:19 INFO Completed upload id=214505worker1 # [ 73.378848] nix-grpc-daemon[846]: time=2026-09-20T09:33:19.026Z level=INFO msg="Upload complete. (544ms)"4506lb # [ 73.359661] niks3-server[1011]: 2026/09/20 09:33:19 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4507worker1 # [ 73.388351] nix-grpc-daemon[778]: ts=2026-09-20T09:33:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 paths=1 nar_bytes_in=5684508worker1 # [ 73.400373] nix-grpc-daemon[778]: ts=2026-09-20T09:33:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456804509worker1 # [ 73.419127] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4510worker1 # [ 73.422920] nix-daemon[837]: reaped child process 1149, status = succeeded4511client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4512worker1 # [ 73.437850] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4513client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4514worker1 # [ 74.874838] nix-daemon[837]: reaped child process 1167, status = succeeded4515worker1 # [ 75.054192] nix-daemon[837]: accepted connection from pid 1182, user nix-grpc-daemon (trusted)4516worker1 # [ 75.074334] nix-daemon[837]: reaped child process 1185, status = succeeded4517lb # [ 75.066614] niks3-server[1011]: 2026/09/20 09:33:20 INFO Received uploads request method=POST path=/api/pending_closures4518worker1 # [ 75.097534] nix-grpc-daemon[846]: time=2026-09-20T09:33:20.743Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4519lb # [ 75.095625] niks3-server[1011]: 2026/09/20 09:33:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4520worker1 # [ 75.126510] nix-grpc-daemon[846]: time=2026-09-20T09:33:20.773Z level=INFO msg="Uploading 1 narinfos"4521lb # [ 75.111816] niks3-server[1011]: 2026/09/20 09:33:20 INFO Signed narinfos id=22 count=14522lb # [ 75.119301] niks3-server[1011]: 2026/09/20 09:33:20 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4523lb # [ 75.125601] niks3-server[1011]: 2026/09/20 09:33:20 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4524lb # [ 75.133213] niks3-server[1011]: 2026/09/20 09:33:20 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4525worker1 # [ 75.161123] nix-grpc-daemon[846]: time=2026-09-20T09:33:20.808Z level=INFO msg="Upload complete. (310ms)"4526lb # [ 75.139799] niks3-server[1011]: 2026/09/20 09:33:20 INFO Completed upload id=224527lb # [ 75.142163] niks3-server[1011]: 2026/09/20 09:33:20 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4528worker1 # [ 75.168924] nix-grpc-daemon[778]: ts=2026-09-20T09:33:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14529worker1 # [ 75.183709] nix-daemon[837]: reaped child process 1165, status = succeeded4530client # copying 1 paths...4531worker1 # [ 75.221235] nix-grpc-daemon[778]: ts=2026-09-20T09:33:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:456804532client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4533worker2 # [ 75.247369] nix-grpc-daemon[778]: ts=2026-09-20T09:33:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:603184534worker2 # [ 75.262278] nix-grpc-daemon[778]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4535worker2 # [ 75.284231] nix-grpc-daemon[778]: ts=2026-09-20T09:33:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=1 nar_bytes_out=1204536client # [ 75.433459] nix-daemon[941]: reaped child process 1044, status = succeeded4537client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.62 seconds)4538client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24539client # [ 75.654346] nix-daemon[941]: accepted connection from pid 1062, user root (trusted)4540client # this derivation will be built:4541client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4542worker1 # [ 75.865488] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:456804543client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4544worker1 # [ 75.873662] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456804545worker1 # [ 75.881012] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.526Z level=INFO msg="All 1 paths already cached"4546worker2 # [ 75.878638] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04547worker2 # [ 75.886723] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14548worker2 # [ 75.897819] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603184549worker2 # [ 75.910801] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603184550worker2 # [ 75.928713] nix-grpc-daemon[894]: time=2026-09-20T09:33:21.574Z level=INFO msg="All 1 paths already cached"4551client # copying 1 paths to 'lb:50051'...4552client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4553worker2 # [ 75.940639] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603184554worker2 # [ 75.959629] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4555worker2 # [ 76.166920] nix-daemon[840]: accepted connection from pid 1026, user nix-grpc-daemon (trusted)4556worker2 # [ 76.189495] nix-daemon[840]: reaped child process 1029, status = succeeded4557worker2 # [ 76.369115] nix-daemon[840]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)4558worker2 # [ 76.388310] nix-daemon[840]: reaped child process 1034, status = succeeded4559lb # [ 76.397574] niks3-server[1011]: 2026/09/20 09:33:22 INFO Received uploads request method=POST path=/api/pending_closures4560worker2 # [ 76.413958] nix-grpc-daemon[894]: time=2026-09-20T09:33:22.060Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4561worker2 # [ 76.415565] nix-grpc-daemon[894]: time=2026-09-20T09:33:22.060Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4562lb # [ 76.432066] niks3-server[1011]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4563worker2 # [ 76.452122] nix-grpc-daemon[894]: time=2026-09-20T09:33:22.099Z level=INFO msg="Uploading 1 narinfos"4564lb # [ 76.448282] niks3-server[1011]: 2026/09/20 09:33:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4565lb # [ 76.459417] niks3-server[1011]: 2026/09/20 09:33:22 INFO Signed narinfos id=23 count=14566lb # [ 76.464669] niks3-server[1011]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4567lb # [ 76.476218] niks3-server[1011]: 2026/09/20 09:33:22 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4568lb # [ 76.478952] niks3-server[1011]: 2026/09/20 09:33:22 INFO Completed upload id=234569lb # [ 76.482024] niks3-server[1011]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4570worker2 # [ 76.481467] nix-grpc-daemon[894]: time=2026-09-20T09:33:22.128Z level=INFO msg="Upload complete. (503ms)"4571worker2 # [ 76.494188] nix-grpc-daemon[778]: ts=2026-09-20T09:33:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=1 nar_bytes_in=5684572worker2 # [ 76.508295] nix-grpc-daemon[778]: ts=2026-09-20T09:33:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603184573worker2 # [ 76.514551] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4574worker2 # [ 76.519831] nix-daemon[840]: reaped child process 1024, status = succeeded4575worker2 # [ 76.531508] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4576client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4577client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4578worker2 # [ 77.993260] nix-daemon[840]: reaped child process 1038, status = succeeded4579worker2 # [ 78.178827] nix-daemon[840]: accepted connection from pid 1053, user nix-grpc-daemon (trusted)4580worker2 # [ 78.197840] nix-daemon[840]: reaped child process 1056, status = succeeded4581lb # [ 78.206767] niks3-server[1011]: 2026/09/20 09:33:23 INFO Received uploads request method=POST path=/api/pending_closures4582worker2 # [ 78.224255] nix-grpc-daemon[894]: time=2026-09-20T09:33:23.869Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4583lb # [ 78.239621] niks3-server[1011]: 2026/09/20 09:33:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4584worker2 # [ 78.257351] nix-grpc-daemon[894]: time=2026-09-20T09:33:23.904Z level=INFO msg="Uploading 1 narinfos"4585lb # [ 78.257519] niks3-server[1011]: 2026/09/20 09:33:23 INFO Signed narinfos id=24 count=14586lb # [ 78.263104] niks3-server[1011]: 2026/09/20 09:33:23 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4587lb # [ 78.270789] niks3-server[1011]: 2026/09/20 09:33:23 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4588lb # [ 78.278587] niks3-server[1011]: 2026/09/20 09:33:23 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4589lb # [ 78.283876] niks3-server[1011]: 2026/09/20 09:33:23 INFO Completed upload id=244590worker2 # [ 78.288580] nix-grpc-daemon[894]: time=2026-09-20T09:33:23.935Z level=INFO msg="Upload complete. (334ms)"4591lb # [ 78.286754] niks3-server[1011]: 2026/09/20 09:33:23 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4592worker2 # [ 78.301187] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14593worker2 # [ 78.316525] nix-daemon[840]: reaped child process 1036, status = succeeded4594client # copying 1 paths...4595worker2 # [ 78.347959] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:603184596client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4597worker1 # [ 78.402176] nix-grpc-daemon[778]: ts=2026-09-20T09:33:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:456804598worker1 # [ 78.418162] nix-grpc-daemon[778]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4599worker1 # [ 78.439517] nix-grpc-daemon[778]: ts=2026-09-20T09:33:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_out=1204600client # [ 78.566060] nix-daemon[941]: reaped child process 1065, status = succeeded4601client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.14 seconds)4602(finished: subtest: an input only one worker has still reaches the builder, in 11.46 seconds)4603subtest: upload whose reference the worker lacks is completed from the cache4604client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4605client # this derivation will be built:4606client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4607client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4608client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.48 seconds)4609client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4610client # this derivation will be built:4611client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4612client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4613client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.46 seconds)4614client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4615client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds)4616worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4617worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4618worker2 # [ 80.044255] systemd[1]: Stopping Nix worker-protocol over gRPC...4619worker2 # [ 80.802707] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=signal_exit4620worker2 # [ 81.059772] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_yield4621lb # [ 81.059092] niks3-server[1011]: 2026/09/20 09:33:26 INFO lead: released remote=192.168.1.4:354744622worker2 # [ 81.065783] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_restarting addr=lb:500514623worker2 # [ 81.071295] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:603044624worker2 # [ 81.076230] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=worker_gone addr=192.168.1.4:500514625worker1 # [ 81.097103] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_restarting addr=lb:500514626worker2 # [ 81.082399] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:603044627worker2 # [ 81.087166] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=worker_gone addr=192.168.1.3:500514628worker2 # [ 81.266995] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500514629worker2 # [ 81.272666] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4630worker1 # [ 81.296624] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:500514631worker1 # [ 81.302050] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4632lb # [ 81.445505] envoy[920]: conn peer=[2001:db8:1::1]:49522 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3862 tx=1787 ms=32514633lb # [ 81.450786] envoy[920]: conn peer=[2001:db8:1::1]:58716 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1184634lb # [ 81.455798] envoy[920]: conn peer=[2001:db8:1::1]:58724 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3722 tx=1804 ms=31154635lb # [ 81.460981] envoy[920]: conn peer=[2001:db8:1::1]:58734 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1064636lb # [ 81.465857] envoy[920]: conn peer=[2001:db8:1::1]:58760 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1034637worker2 # [ 81.473808] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500514638lb # [ 81.472754] envoy[920]: conn peer=[2001:db8:1::1]:58746 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3723 tx=1805 ms=26364639worker2 # [ 81.479362] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4640worker1 # [ 81.503416] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500514641worker1 # [ 81.509688] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4642worker2 # [ 81.680344] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500514643worker2 # [ 81.685767] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4644worker1 # [ 81.710267] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500514645worker1 # [ 81.716382] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4646worker2 # [ 81.889290] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500514647worker2 # [ 81.893703] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4648worker1 # [ 81.917852] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500514649worker1 # [ 81.924402] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4650worker2 # [ 82.061735] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_restarting4651worker1 # [ 82.127689] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500514652worker1 # [ 82.132691] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4653worker2 # [ 82.118706] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4654worker2 # [ 82.131827] nix-daemon[840]: reaped child process 842, status = succeeded4655worker2 # [ 82.176701] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4656worker2 # [ 82.178890] systemd[1]: Stopped Nix worker-protocol over gRPC.4657worker2 # [ 82.186396] systemd[1]: nix-grpc-daemon.service: Consumed 1.927s CPU time over 1min 715ms wall clock time, 54.9M memory peak, 52.1K incoming IP traffic, 94.9K outgoing IP traffic.4658worker2 # [ 82.193653] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4659worker2 # [ 82.195252] systemd[1]: Closed Nix worker-protocol over gRPC.4660worker2 # [ 82.200622] systemd[1]: nix-grpc-daemon.socket: Consumed 615us CPU time over 1min 11.484s wall clock time, 256K memory peak, 77K incoming IP traffic, 68.8K outgoing IP traffic.4661lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4662lb: must succeed: curl -sf localhost:9901/clusters4663lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4664lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4665client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24666worker1 # [ 82.327970] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:500514667worker1 # [ 82.333076] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4668worker1 # [ 82.533729] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_connected addr=lb:500514669worker1 # [ 82.538941] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4670worker1 # [ 82.550174] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:456804671worker1 # [ 82.558626] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:456804672client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4673client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.28 seconds)4674worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4675worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4676worker2 # [ 82.691194] systemd[1]: Listening on Nix worker-protocol over gRPC.4677worker1 # [ 82.740381] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_connected addr=lb:500514678worker1 # [ 82.752232] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4679worker1 # [ 82.798282] systemd[1]: Stopping Nix worker-protocol over gRPC...4680worker1 # [ 82.826554] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=signal_exit4681worker1 # [ 82.949974] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_connected addr=lb:500514682worker1 # [ 82.955143] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4683worker2 # [ 82.981939] systemd[1]: Starting Nix worker-protocol over gRPC...4684worker1 # [ 83.157866] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_connected addr=lb:500514685worker1 # [ 83.162021] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4686worker2 # [ 83.200173] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4687worker2 # [ 83.202662] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14688worker2 # [ 83.211329] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4689lb # [ 83.222078] niks3-server[1011]: 2026/09/20 09:33:28 INFO lead: acquired remote=192.168.1.4:427084690worker2 # [ 83.234348] systemd[1]: Started Nix worker-protocol over gRPC.4691worker2 # [ 83.235569] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=scheduler_take_over4692worker2 # [ 83.257493] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=scheduler_connected addr=lb:500514693worker2 # [ 83.261117] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04694worker1 # [ 83.358379] nix-grpc-daemon[778]: ts=2026-09-20T09:33:29Z level=info event=scheduler_connected addr=lb:500514695worker2 # [ 83.343395] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04696worker1 # [ 84.077242] nix-grpc-daemon[778]: ts=2026-09-20T09:33:29Z level=info event=scheduler_restarting4697worker2 # [ 84.072228] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:501484698worker2 # [ 84.072685] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:29Z level=info event=worker_gone addr=192.168.1.3:500514699worker1 # [ 84.120534] nix-grpc-daemon[778]: ts=2026-09-20T09:33:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4700worker1 # [ 84.139609] nix-daemon[837]: reaped child process 839, status = succeeded4701worker1 # [ 84.984096] nix-grpc-daemon[778]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4702worker1 # [ 84.984384] nix-grpc-daemon[778]: E0000 00:00:1789896810.629743 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4703worker1 # [ 84.984574] nix-grpc-daemon[778]: E0000 00:00:1789896810.630138 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4704worker1 # [ 86.105992] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4705worker1 # [ 86.109973] systemd[1]: Stopped Nix worker-protocol over gRPC.4706worker1 # [ 86.115379] systemd[1]: nix-grpc-daemon.service: Consumed 3.716s CPU time over 1min 4.630s wall clock time, 58.4M memory peak, 84.3K incoming IP traffic, 154.3K outgoing IP traffic.4707worker1 # [ 86.133397] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4708worker1 # [ 86.135422] systemd[1]: Closed Nix worker-protocol over gRPC.4709worker1 # [ 86.137275] systemd[1]: nix-grpc-daemon.socket: Consumed 592us CPU time over 1min 15.446s wall clock time, 256K memory peak, 77.3K incoming IP traffic, 63.8K outgoing IP traffic.4710lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4711lb: must succeed: curl -sf localhost:9901/clusters4712lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4713lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4714client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24715worker2 # [ 86.461044] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:501624716worker2 # [ 86.476568] nix-daemon[840]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4717worker2 # [ 86.506167] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5)4718worker2 # [ 86.556073] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 2/5)4719worker2 # [ 86.599416] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 114 ms (attempt 3/5)4720worker2 # [ 86.721246] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 412 ms (attempt 4/5)4721worker2 # [ 87.134370] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4722client # copying 2 paths...4723client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4724worker2 # [ 87.163357] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:501624725client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4726worker2 # [ 87.177623] nix-daemon[840]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4727worker2 # [ 87.211144] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:32Z level=info event=niks3_push_started pid=11334728worker2 # [ 87.603622] nix-daemon[840]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)4729worker2 # [ 87.621246] nix-daemon[840]: reaped child process 1149, status = succeeded4730lb # [ 87.630871] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received uploads request method=POST path=/api/pending_closures4731lb # [ 87.641031] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received uploads request method=POST path=/api/pending_closures4732worker2 # [ 87.656464] nix-grpc-daemon[1133]: time=2026-09-20T09:33:33.301Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4733worker2 # [ 87.657973] nix-grpc-daemon[1133]: time=2026-09-20T09:33:33.301Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4734worker2 # [ 87.659705] nix-grpc-daemon[1133]: time=2026-09-20T09:33:33.302Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4735lb # [ 87.688936] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4736lb # [ 87.703280] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4737worker2 # [ 87.724130] nix-grpc-daemon[1133]: time=2026-09-20T09:33:33.370Z level=INFO msg="Uploading 3 narinfos"4738lb # [ 87.719774] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4739lb # [ 87.723727] niks3-server[1011]: 2026/09/20 09:33:33 INFO Signed narinfos id=25 count=14740lb # [ 87.734795] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4741lb # [ 87.740762] niks3-server[1011]: 2026/09/20 09:33:33 INFO Signed narinfos id=26 count=24742lb # [ 87.742561] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4743lb # [ 87.751037] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4744lb # [ 87.760727] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4745lb # [ 87.774834] niks3-server[1011]: 2026/09/20 09:33:33 INFO Completed upload id=254746lb # [ 87.778268] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4747lb # [ 87.784626] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4748lb # [ 87.786692] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4749lb # [ 87.790950] niks3-server[1011]: 2026/09/20 09:33:33 INFO Completed upload id=264750worker2 # [ 87.796480] nix-grpc-daemon[1133]: time=2026-09-20T09:33:33.443Z level=INFO msg="Upload complete. (365ms)"4751lb # [ 87.795987] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4752worker2 # [ 87.809213] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50162 duration_s=0 paths=2 nar_bytes_in=3124753worker2 # [ 87.825806] nix-daemon[840]: reaped child process 1131, status = succeeded4754client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.64 seconds)4755worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4756worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4757worker1 # [ 87.982878] systemd[1]: Listening on Nix worker-protocol over gRPC.4758worker1 # [ 87.993260] systemd[1]: Starting Nix worker-protocol over gRPC...4759worker1 # [ 88.196966] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4760worker1 # [ 88.199743] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14761worker1 # [ 88.208079] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4762worker1 # [ 88.224207] systemd[1]: Started Nix worker-protocol over gRPC.4763lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4764lb: must succeed: curl -sf localhost:9901/clusters4765worker1 # [ 88.262509] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:33Z level=info event=scheduler_connected addr=lb:500514766worker2 # [ 88.248404] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:33Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04767lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4768lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4769(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.74 seconds)4770subtest: scheduler down: the other node takes the lock and keeps it4771lb: must succeed: curl -sf localhost:9901/clusters4772lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4773lb: must succeed: curl -sf localhost:9901/clusters4774lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4775lb: must succeed: curl -sf localhost:9901/clusters4776lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4777lb: must succeed: curl -sf localhost:9901/clusters4778lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4779worker2 # [ 88.582525] systemd[1]: Stopping Nix worker-protocol over gRPC...4780worker2 # [ 89.223082] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:34Z level=info event=signal_exit4781worker2 # [ 89.430726] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_yield4782worker1 # [ 89.453427] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_restarting addr=lb:500514783lb # [ 89.432249] niks3-server[1011]: 2026/09/20 09:33:35 INFO lead: released remote=192.168.1.4:427084784worker2 # [ 89.437601] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:501484785worker2 # [ 89.444240] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=worker_gone addr=192.168.1.3:500514786worker2 # [ 89.448308] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_restarting addr=lb:500514787worker2 # [ 89.452269] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:501484788worker2 # [ 89.456672] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=worker_gone addr=192.168.1.4:500514789worker1 # [ 89.653073] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500514790worker2 # [ 89.638822] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500514791worker1 # [ 89.658954] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4792worker2 # [ 89.644253] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4793worker1 # [ 89.859508] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500514794worker2 # [ 89.845006] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500514795worker1 # [ 89.865111] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4796worker2 # [ 89.850194] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4797worker1 # [ 90.065946] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500514798worker2 # [ 90.051029] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500514799worker1 # [ 90.071345] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4800worker2 # [ 90.056364] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4801worker1 # [ 90.272406] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500514802worker2 # [ 90.259505] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500514803worker1 # [ 90.278351] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4804worker2 # [ 90.265507] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4805worker2 # [ 90.436271] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:36Z level=info event=scheduler_restarting4806worker1 # [ 90.480633] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500514807worker1 # [ 90.486690] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4808worker2 # [ 90.485482] nix-daemon[840]: reaped child process 1126, status = succeeded4809worker2 # [ 90.488397] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:36Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4810worker1 # [ 90.686912] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500514811worker1 # [ 90.692658] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4812worker1 # [ 90.893604] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500514813worker1 # [ 90.898905] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4814worker1 # [ 91.099823] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500514815worker1 # [ 91.105433] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4816worker2 # [ 91.256599] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4817worker2 # [ 91.261162] systemd[1]: Stopped Nix worker-protocol over gRPC.4818worker2 # [ 91.263605] systemd[1]: nix-grpc-daemon.service: Consumed 491ms CPU time over 8.268s wall clock time, 33.5M memory peak, 17.5K incoming IP traffic, 22K outgoing IP traffic.4819worker2 # [ 91.280402] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4820worker2 # [ 91.283058] systemd[1]: Closed Nix worker-protocol over gRPC.4821worker1 # [ 91.305978] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500514822worker2 # [ 91.288754] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 8.601s wall clock time, 256K memory peak, 19.9K incoming IP traffic, 15.3K outgoing IP traffic.4823worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4824worker1 # [ 91.311340] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4825lb # [ 91.447689] envoy[920]: conn peer=[2001:db8:1::4]:34642 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6094 tx=1799 ms=602724826lb # [ 91.452900] envoy[920]: conn peer=[2001:db8:1::1]:43882 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=284827lb # [ 91.457618] envoy[920]: conn peer=[2001:db8:1::3]:37996 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8140 tx=2373 ms=622624828lb # [ 91.462607] envoy[920]: conn peer=[2001:db8:1::1]:43898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=304 ms=13654829lb # [ 91.467326] envoy[920]: conn peer=[2001:db8:1::4]:39000 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1003 tx=349 ms=72174830worker1 # [ 91.514265] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500514831worker1 # [ 91.518601] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4832worker1 # [ 91.715152] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500514833worker1 # [ 91.720677] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4834worker1 # [ 91.921622] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500514835worker1 # [ 91.926864] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4836worker1 # [ 92.127710] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500514837worker1 # [ 92.133086] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4838worker1 # [ 92.333824] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500514839worker1 # [ 92.339059] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4840worker1 # [ 92.541999] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500514841worker1 # [ 92.546358] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4842worker1 # [ 92.743011] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500514843worker1 # [ 92.748688] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4844worker1 # [ 92.949531] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500514845worker1 # [ 92.954925] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4846worker1 # [ 93.155973] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500514847worker1 # [ 93.161597] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4848worker1 # [ 93.225842] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_take_over4849lb # [ 93.204784] niks3-server[1011]: 2026/09/20 09:33:38 INFO lead: acquired remote=192.168.1.3:583464850worker1 # [ 93.362354] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:500514851worker1 # [ 93.371834] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04852worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.24 seconds)4853worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4854worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4855client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24856worker1 # [ 93.864847] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:436764857worker1 # [ 93.878191] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)4858client # don't know how to build these paths:4859client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4860worker1 # [ 93.900480] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436764861worker1 # [ 93.916463] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5)4862worker1 # [ 93.992340] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 154 ms (attempt 2/5)4863worker1 # [ 94.146795] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 93 ms (attempt 3/5)4864worker1 # [ 94.247493] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 272 ms (attempt 4/5)4865worker1 # [ 94.527785] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4866worker1 # [ 94.562103] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04867worker1 # [ 94.569853] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14868worker1 # [ 94.611592] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436764869worker1 # [ 94.627905] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436764870client # copying 1 paths to 'lb:50051'...4871client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4872worker1 # [ 94.643287] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436764873worker1 # [ 94.657876] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)4874worker1 # [ 94.684831] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=info event=niks3_push_started pid=12904875worker1 # [ 95.070178] nix-daemon[837]: accepted connection from pid 1303, user nix-grpc-daemon (trusted)4876worker1 # [ 95.090858] nix-daemon[837]: reaped child process 1306, status = succeeded4877worker1 # [ 95.269032] nix-daemon[837]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)4878worker1 # [ 95.288917] nix-daemon[837]: reaped child process 1311, status = succeeded4879lb # [ 95.279656] niks3-server[1011]: 2026/09/20 09:33:40 INFO Received uploads request method=POST path=/api/pending_closures4880worker1 # [ 95.314577] nix-grpc-daemon[1290]: time=2026-09-20T09:33:40.959Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4881worker1 # [ 95.316291] nix-grpc-daemon[1290]: time=2026-09-20T09:33:40.959Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4882lb # [ 95.315362] niks3-server[1011]: 2026/09/20 09:33:40 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4883lb # [ 95.328305] niks3-server[1011]: 2026/09/20 09:33:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4884worker1 # [ 95.357441] nix-grpc-daemon[1290]: time=2026-09-20T09:33:41.004Z level=INFO msg="Uploading 1 narinfos"4885lb # [ 95.340922] niks3-server[1011]: 2026/09/20 09:33:40 INFO Signed narinfos id=27 count=14886lb # [ 95.347895] niks3-server[1011]: 2026/09/20 09:33:40 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4887lb # [ 95.358364] niks3-server[1011]: 2026/09/20 09:33:41 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4888lb # [ 95.367333] niks3-server[1011]: 2026/09/20 09:33:41 INFO Completed upload id=274889worker1 # [ 95.389709] nix-grpc-daemon[1290]: time=2026-09-20T09:33:41.036Z level=INFO msg="Upload complete. (490ms)"4890lb # [ 95.370333] niks3-server[1011]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4891worker1 # [ 95.401404] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=0 paths=1 nar_bytes_in=5204892worker1 # [ 95.413748] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436764893worker1 # [ 95.419706] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)4894worker1 # [ 95.424639] nix-daemon[837]: reaped child process 1288, status = succeeded4895client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4896client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4897worker1 # [ 95.437327] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)4898client # farm-a> LOG-farm-a-on-standby4899worker1 # [ 96.663476] nix-daemon[837]: reaped child process 1315, status = succeeded4900worker1 # [ 96.831387] nix-daemon[837]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)4901worker1 # [ 96.848705] nix-daemon[837]: reaped child process 1333, status = succeeded4902lb # [ 96.840942] niks3-server[1011]: 2026/09/20 09:33:42 INFO Received uploads request method=POST path=/api/pending_closures4903worker1 # [ 96.880424] nix-grpc-daemon[1290]: time=2026-09-20T09:33:42.525Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4904worker1 # [ 96.881905] nix-grpc-daemon[1290]: time=2026-09-20T09:33:42.526Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4905lb # [ 96.901029] niks3-server[1011]: 2026/09/20 09:33:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4906worker1 # [ 96.931874] nix-grpc-daemon[1290]: time=2026-09-20T09:33:42.577Z level=INFO msg="Uploading 1 narinfos"4907lb # [ 96.909089] niks3-server[1011]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4908lb # [ 96.921516] niks3-server[1011]: 2026/09/20 09:33:42 INFO Signed narinfos id=28 count=14909lb # [ 96.923728] niks3-server[1011]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4910worker1 # [ 96.963979] nix-grpc-daemon[1290]: time=2026-09-20T09:33:42.611Z level=INFO msg="Upload complete. (316ms)"4911lb # [ 96.943499] niks3-server[1011]: 2026/09/20 09:33:42 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4912lb # [ 96.949060] niks3-server[1011]: 2026/09/20 09:33:42 INFO Completed upload id=284913lb # [ 96.951779] niks3-server[1011]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4914lb # [ 96.959030] niks3-server[1011]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4915worker1 # [ 96.986521] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14916worker1 # [ 96.999962] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04917worker1 # [ 97.003311] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14918worker1 # [ 97.006903] nix-daemon[837]: reaped child process 1313, status = succeeded4919worker1 # [ 97.030821] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436764920worker1 # [ 97.045544] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436764921worker1 # [ 97.062591] nix-grpc-daemon[1290]: time=2026-09-20T09:33:42.709Z level=INFO msg="All 1 paths already cached"4922client # copying 1 paths to 'lb:50051'...4923client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4924worker1 # [ 97.073626] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436764925worker1 # [ 97.087703] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)4926worker1 # [ 97.296486] nix-daemon[837]: accepted connection from pid 1339, user nix-grpc-daemon (trusted)4927worker1 # [ 97.314376] nix-daemon[837]: reaped child process 1342, status = succeeded4928worker1 # [ 97.492090] nix-daemon[837]: accepted connection from pid 1344, user nix-grpc-daemon (trusted)4929worker1 # [ 97.509314] nix-daemon[837]: reaped child process 1347, status = succeeded4930lb # [ 97.500662] niks3-server[1011]: 2026/09/20 09:33:43 INFO Received uploads request method=POST path=/api/pending_closures4931worker1 # [ 97.537485] nix-grpc-daemon[1290]: time=2026-09-20T09:33:43.184Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4932worker1 # [ 97.539020] nix-grpc-daemon[1290]: time=2026-09-20T09:33:43.184Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4933lb # [ 97.536405] niks3-server[1011]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4934lb # [ 97.549825] niks3-server[1011]: 2026/09/20 09:33:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4935worker1 # [ 97.578080] nix-grpc-daemon[1290]: time=2026-09-20T09:33:43.225Z level=INFO msg="Uploading 1 narinfos"4936lb # [ 97.561895] niks3-server[1011]: 2026/09/20 09:33:43 INFO Signed narinfos id=29 count=14937lb # [ 97.566857] niks3-server[1011]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4938lb # [ 97.577027] niks3-server[1011]: 2026/09/20 09:33:43 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4939lb # [ 97.581107] niks3-server[1011]: 2026/09/20 09:33:43 INFO Completed upload id=294940worker1 # [ 97.602661] nix-grpc-daemon[1290]: time=2026-09-20T09:33:43.249Z level=INFO msg="Upload complete. (498ms)"4941lb # [ 97.583484] niks3-server[1011]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4942worker1 # [ 97.612341] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=0 paths=1 nar_bytes_in=6404943worker1 # [ 97.622721] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436764944worker1 # [ 97.629800] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)4945worker1 # [ 97.634857] nix-daemon[837]: reaped child process 1337, status = succeeded4946client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4947worker1 # [ 97.646155] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)4948client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4949client # farm-b> LOG-farm-b-on-standby4950worker1 # [ 98.477665] nix-daemon[837]: reaped child process 1351, status = succeeded4951worker1 # [ 98.641329] nix-daemon[837]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)4952worker1 # [ 98.657938] nix-daemon[837]: reaped child process 1369, status = succeeded4953lb # [ 98.652725] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received uploads request method=POST path=/api/pending_closures4954worker1 # [ 98.687756] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.334Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4955worker1 # [ 98.689504] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.334Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4956lb # [ 98.695357] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4957lb # [ 98.706338] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4958worker1 # [ 98.741907] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.388Z level=INFO msg="Uploading 1 narinfos"4959lb # [ 98.719625] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4960lb # [ 98.724916] niks3-server[1011]: 2026/09/20 09:33:44 INFO Signed narinfos id=30 count=14961lb # [ 98.727062] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4962lb # [ 98.736305] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4963lb # [ 98.744046] niks3-server[1011]: 2026/09/20 09:33:44 INFO Completed upload id=304964worker1 # [ 98.765547] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.412Z level=INFO msg="Upload complete. (307ms)"4965lb # [ 98.746655] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4966worker1 # [ 98.781567] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14967worker1 # [ 98.796003] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04968worker1 # [ 98.799830] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=14969worker1 # [ 98.803763] nix-daemon[837]: reaped child process 1349, status = succeeded4970worker1 # [ 98.827186] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436764971worker1 # [ 98.842679] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436764972worker1 # [ 98.859006] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.506Z level=INFO msg="All 2 paths already cached"4973client # copying 1 paths to 'lb:50051'...4974client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4975worker1 # [ 98.869494] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436764976worker1 # [ 98.882798] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)4977worker1 # [ 99.080817] nix-daemon[837]: accepted connection from pid 1375, user nix-grpc-daemon (trusted)4978worker1 # [ 99.098749] nix-daemon[837]: reaped child process 1378, status = succeeded4979worker1 # [ 99.273785] nix-daemon[837]: accepted connection from pid 1380, user nix-grpc-daemon (trusted)4980worker1 # [ 99.291269] nix-daemon[837]: reaped child process 1383, status = succeeded4981lb # [ 99.280786] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received uploads request method=POST path=/api/pending_closures4982worker1 # [ 99.313719] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.960Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4983worker1 # [ 99.315268] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.960Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4984lb # [ 99.309773] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst4985worker1 # [ 99.345390] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.992Z level=INFO msg="Uploading 1 narinfos"4986lb # [ 99.327057] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4987lb # [ 99.337919] niks3-server[1011]: 2026/09/20 09:33:44 INFO Signed narinfos id=31 count=14988lb # [ 99.342884] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls4989lb # [ 99.350639] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete4990lb # [ 99.355643] niks3-server[1011]: 2026/09/20 09:33:45 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo4991lb # [ 99.359970] niks3-server[1011]: 2026/09/20 09:33:45 INFO Completed upload id=314992worker1 # [ 99.381743] nix-grpc-daemon[1290]: time=2026-09-20T09:33:45.028Z level=INFO msg="Upload complete. (483ms)"4993worker1 # [ 99.388357] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=0 paths=1 nar_bytes_in=7684994worker1 # [ 99.400587] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436764995worker1 # [ 99.411327] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)4996worker1 # [ 99.413446] nix-daemon[837]: reaped child process 1373, status = succeeded4997client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...4998client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4999worker1 # [ 99.426732] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5000client # farm-top> LOG-farm-top-on-standby5001worker1 # [ 101.071662] nix-daemon[837]: reaped child process 1387, status = succeeded5002worker1 # [ 101.255256] nix-daemon[837]: accepted connection from pid 1402, user nix-grpc-daemon (trusted)5003worker1 # [ 101.274012] nix-daemon[837]: reaped child process 1405, status = succeeded5004lb # [ 101.264755] niks3-server[1011]: 2026/09/20 09:33:46 INFO Received uploads request method=POST path=/api/pending_closures5005worker1 # [ 101.299673] nix-grpc-daemon[1290]: time=2026-09-20T09:33:46.945Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5006worker1 # [ 101.301670] nix-grpc-daemon[1290]: time=2026-09-20T09:33:46.945Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5007lb # [ 101.302274] niks3-server[1011]: 2026/09/20 09:33:46 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5008lb # [ 101.318662] niks3-server[1011]: 2026/09/20 09:33:46 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5009lb # [ 101.327953] niks3-server[1011]: 2026/09/20 09:33:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5010lb # [ 101.334373] niks3-server[1011]: 2026/09/20 09:33:46 INFO Signed narinfos id=32 count=15011worker1 # [ 101.354923] nix-grpc-daemon[1290]: time=2026-09-20T09:33:47.001Z level=INFO msg="Uploading 1 narinfos"5012lb # [ 101.339526] niks3-server[1011]: 2026/09/20 09:33:46 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5013lb # [ 101.348480] niks3-server[1011]: 2026/09/20 09:33:46 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5014lb # [ 101.355405] niks3-server[1011]: 2026/09/20 09:33:47 INFO Completed upload id=325015worker1 # [ 101.377630] nix-grpc-daemon[1290]: time=2026-09-20T09:33:47.024Z level=INFO msg="Upload complete. (338ms)"5016lb # [ 101.358397] niks3-server[1011]: 2026/09/20 09:33:47 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5017worker1 # [ 101.393157] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15018worker1 # [ 101.409673] nix-daemon[837]: reaped child process 1385, status = succeeded5019client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.83 seconds)5020client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5021lb # [ 101.446804] envoy[920]: conn peer=[2001:db8:1::1]:36636 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=3854 ms=75495022client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5023worker2 # [ 101.752992] systemd[1]: Listening on Nix worker-protocol over gRPC.5024worker2 # [ 101.761687] systemd[1]: Starting Nix worker-protocol over gRPC...5025worker2 # [ 101.964197] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5026worker2 # [ 101.966896] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15027worker2 # [ 101.974686] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5028worker2 # [ 101.982626] systemd[1]: Started Nix worker-protocol over gRPC.5029lb: must succeed: curl -sf localhost:9901/clusters5030worker2 # [ 102.017791] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500515031worker1 # [ 102.036502] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05032lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5033worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5034worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5035lb: must succeed: curl -sf localhost:9901/clusters5036lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5037lb: must succeed: curl -sf localhost:9901/clusters5038lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5039worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5040worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5041(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.08 seconds)5042subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5043client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5044client # [ 102.476893] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5045client # Running as unit: rs.service; invocation ID: 332d180493714d23aa39c106fce436b65046client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5047client # [ 102.710508] nix[1163]: don't know how to build these paths:5048client # [ 102.711647] nix[1163]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5049worker1 # [ 102.718647] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:436765050worker1 # [ 102.734490] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05051worker1 # [ 102.741965] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15052worker1 # [ 102.782577] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436765053worker1 # [ 102.798627] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436765054client # [ 102.802850] nix[1163]: copying 1 paths to 'lb:50051'...5055client # [ 102.808368] nix[1163]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5056worker1 # [ 102.816316] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436765057worker1 # [ 102.831909] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5058worker1 # [ 103.039332] nix-daemon[837]: accepted connection from pid 1420, user nix-grpc-daemon (trusted)5059worker1 # [ 103.059383] nix-daemon[837]: reaped child process 1423, status = succeeded5060worker1 # [ 103.235877] nix-daemon[837]: accepted connection from pid 1425, user nix-grpc-daemon (trusted)5061worker1 # [ 103.252335] nix-daemon[837]: reaped child process 1428, status = succeeded5062lb # [ 103.245684] niks3-server[1011]: 2026/09/20 09:33:48 INFO Received uploads request method=POST path=/api/pending_closures5063worker1 # [ 103.278398] nix-grpc-daemon[1290]: time=2026-09-20T09:33:48.925Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5064worker1 # [ 103.279862] nix-grpc-daemon[1290]: time=2026-09-20T09:33:48.925Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5065lb # [ 103.273150] niks3-server[1011]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5066lb # [ 103.286736] niks3-server[1011]: 2026/09/20 09:33:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5067worker1 # [ 103.314398] nix-grpc-daemon[1290]: time=2026-09-20T09:33:48.961Z level=INFO msg="Uploading 1 narinfos"5068lb # [ 103.296827] niks3-server[1011]: 2026/09/20 09:33:48 INFO Signed narinfos id=33 count=15069lb # [ 103.299784] niks3-server[1011]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5070lb # [ 103.312893] niks3-server[1011]: 2026/09/20 09:33:48 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5071worker1 # [ 103.341148] nix-grpc-daemon[1290]: time=2026-09-20T09:33:48.988Z level=INFO msg="Upload complete. (492ms)"5072lb # [ 103.323952] niks3-server[1011]: 2026/09/20 09:33:48 INFO Completed upload id=335073lb # [ 103.327121] niks3-server[1011]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5074worker1 # [ 103.348488] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=0 paths=1 nar_bytes_in=4165075worker1 # [ 103.361849] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436765076worker1 # [ 103.371803] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5077worker1 # [ 103.374220] nix-daemon[837]: reaped child process 1418, status = succeeded5078client # [ 103.375372] nix[1163]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5079worker1 # [ 103.387243] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5080lb: must succeed: curl -sf localhost:9901/clusters5081lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5082lb: must succeed: curl -sf localhost:9901/clusters5083lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5084lb: must succeed: curl -sf localhost:9901/clusters5085lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5086lb: must succeed: curl -sf localhost:9901/clusters5087lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5088worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5089worker2 # [ 105.427163] systemd-journald[267]: Received client request to rotate journal, rotating.5090worker2 # [ 105.447841] systemd-journald[267]: Vacuuming done, freed 0B of archived journals from /var/log/journal/65e045999aab422fab181f45d379ab3f.5091worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5092worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5093worker1 # [ 105.523155] systemd[1]: Stopping Nix worker-protocol over gRPC...5094worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5095??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5096 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735097client: must succeed: sleep 5.05098worker1 # [ 106.227623] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:51Z level=info event=draining5099client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5100worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5101worker1 # [ 111.037419] nix-daemon[837]: reaped child process 1432, status = succeeded5102worker1 # [ 111.220591] nix-daemon[837]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)5103worker1 # [ 111.237927] nix-daemon[837]: reaped child process 1475, status = succeeded5104lb # [ 111.230071] niks3-server[1011]: 2026/09/20 09:33:56 INFO Received uploads request method=POST path=/api/pending_closures5105worker1 # [ 111.264519] nix-grpc-daemon[1290]: time=2026-09-20T09:33:56.909Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5106worker1 # [ 111.266416] nix-grpc-daemon[1290]: time=2026-09-20T09:33:56.909Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5107lb # [ 111.274380] niks3-server[1011]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5108lb # [ 111.287788] niks3-server[1011]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5109lb # [ 111.296292] niks3-server[1011]: 2026/09/20 09:33:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5110worker1 # [ 111.325273] nix-grpc-daemon[1290]: time=2026-09-20T09:33:56.972Z level=INFO msg="Uploading 1 narinfos"5111lb # [ 111.302743] niks3-server[1011]: 2026/09/20 09:33:56 INFO Signed narinfos id=34 count=15112lb # [ 111.308456] niks3-server[1011]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5113lb # [ 111.318711] niks3-server[1011]: 2026/09/20 09:33:56 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5114lb # [ 111.331209] niks3-server[1011]: 2026/09/20 09:33:56 INFO Completed upload id=345115worker1 # [ 111.353509] nix-grpc-daemon[1290]: time=2026-09-20T09:33:57.000Z level=INFO msg="Upload complete. (349ms)"5116lb # [ 111.334607] niks3-server[1011]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5117worker1 # [ 111.369379] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15118worker1 # [ 111.388808] nix-daemon[837]: reaped child process 1430, status = succeeded5119client # [ 111.401673] systemd[1]: rs.service: Deactivated successfully.5120client # [ 111.406092] systemd[1]: rs.service: Consumed 152ms CPU time over 8.928s wall clock time, 37M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5121lb # [ 111.446145] envoy[920]: conn peer=[2001:db8:1::1]:37368 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1324 ms=86655122worker1 # [ 112.233465] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:57Z level=info event=signal_exit5123worker1 # [ 112.446993] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_yield5124worker1 # [ 112.456267] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_restarting addr=lb:500515125lb # [ 112.433838] niks3-server[1011]: 2026/09/20 09:33:58 INFO lead: released remote=192.168.1.3:583465126worker2 # [ 112.441138] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_restarting addr=lb:500515127worker1 # [ 112.462927] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:436625128worker1 # [ 112.467655] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=worker_gone addr=192.168.1.3:500515129worker1 # [ 112.471774] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:436625130worker1 # [ 112.476302] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=worker_gone addr=192.168.1.4:500515131worker2 # [ 112.640738] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:500515132worker1 # [ 112.657601] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:500515133worker2 # [ 112.646087] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5134worker1 # [ 112.663061] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5135worker2 # [ 112.846848] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:500515136worker1 # [ 112.863858] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:500515137worker2 # [ 112.851824] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5138worker1 # [ 112.869093] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5139worker2 # [ 113.052805] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:500515140worker1 # [ 113.069917] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:500515141worker1 # [ 113.075298] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5142worker2 # [ 113.062022] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5143worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.20 seconds)5144client: waiting for success: ! systemctl is-active rs5145client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5146client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5147client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5148client: must fail: journalctl -u rs | grep -q 'reconnecting'5149client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5150lb: must succeed: curl -sf localhost:9901/clusters5151worker2 # [ 113.258779] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:500515152worker1 # [ 113.276146] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:500515153worker2 # [ 113.264275] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5154worker1 # [ 113.281593] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5155lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5156worker1 # [ 113.456944] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:59Z level=info event=scheduler_restarting5157worker2 # [ 113.467023] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_connected addr=lb:500515158worker2 # [ 113.471564] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5159worker1 # [ 113.507272] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5160worker1 # [ 113.513179] nix-daemon[837]: reaped child process 1281, status = succeeded5161worker2 # [ 113.667423] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_connected addr=lb:500515162worker2 # [ 113.670379] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5163worker2 # [ 113.871413] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_connected addr=lb:500515164worker2 # [ 113.876890] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5165worker2 # [ 114.077718] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_connected addr=lb:500515166worker2 # [ 114.082734] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5167worker1 # [ 114.239026] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5168worker1 # [ 114.242667] systemd[1]: Stopped Nix worker-protocol over gRPC.5169worker1 # [ 114.247839] systemd[1]: nix-grpc-daemon.service: Consumed 1.823s CPU time over 26.241s wall clock time, 37M memory peak, 47.4K incoming IP traffic, 87.4K outgoing IP traffic.5170worker1 # [ 114.262681] systemd[1]: Starting Nix worker-protocol over gRPC...5171worker2 # [ 114.283567] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_connected addr=lb:500515172worker2 # [ 114.288933] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5173lb: must succeed: curl -sf localhost:9901/clusters5174lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5175worker1 # [ 114.470009] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5176worker1 # [ 114.472756] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15177worker1 # [ 114.481000] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5178worker1 # [ 114.482832] systemd[1]: Started Nix worker-protocol over gRPC.5179worker1 # [ 114.499470] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_take_over5180lb # [ 114.479262] niks3-server[1011]: 2026/09/20 09:34:00 INFO lead: acquired remote=192.168.1.3:551825181worker2 # [ 114.491210] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:500515182worker2 # [ 114.496993] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5183worker1 # [ 114.528856] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:500515184worker1 # [ 114.530798] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5185worker2 # [ 114.697985] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:500515186worker2 # [ 114.703687] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5187worker1 # [ 114.732443] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:500515188worker1 # [ 114.737975] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5189worker2 # [ 114.904737] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:500515190worker2 # [ 114.910373] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5191worker1 # [ 114.939434] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:500515192worker1 # [ 114.945084] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5193worker2 # [ 115.111301] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:500515194worker2 # [ 115.117055] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5195worker1 # [ 115.146016] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:500515196worker1 # [ 115.151651] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5197worker2 # [ 115.317937] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:500515198worker2 # [ 115.323526] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5199worker1 # [ 115.353776] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:500515200worker1 # [ 115.360551] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5201lb: must succeed: curl -sf localhost:9901/clusters5202lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5203worker2 # [ 115.525765] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:500515204worker1 # [ 115.549139] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05205worker1 # [ 115.556701] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:500515206worker1 # [ 115.562488] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05207lb: must succeed: curl -sf localhost:9901/clusters5208lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5209worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5210worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5211(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 14.27 seconds)5212subtest: scheduler restart mid-build: build finishes, no double build5213client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5214client # [ 116.748886] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5215client # Running as unit: mid.service; invocation ID: 170f5f461bd041ba80cdf56d0068caab5216client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5217worker1 # [ 117.003520] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:525765218worker1 # [ 117.019467] nix-daemon[837]: accepted connection from pid 1482, user nix-grpc-daemon (trusted)5219client # [ 117.029511] nix[1198]: don't know how to build these paths:5220client # [ 117.030823] nix[1198]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5221worker1 # [ 117.051290] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:02Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05222worker1 # [ 117.058311] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:02Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15223worker2 # [ 117.107501] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347005224worker2 # [ 117.122837] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5225worker2 # [ 117.149437] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 1/5)5226worker2 # [ 117.165188] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 2/5)5227worker2 # [ 117.206284] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 3/5)5228worker2 # [ 117.255989] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 584 ms (attempt 4/5)5229worker2 # [ 117.848374] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5230worker2 # [ 117.873880] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347005231client # [ 117.899762] nix[1198]: copying 1 paths to 'lb:50051'...5232worker2 # [ 117.891181] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347005233client # [ 117.900278] nix[1198]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5234worker2 # [ 117.907004] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5235worker2 # [ 117.937567] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:03Z level=info event=niks3_push_started pid=12825236worker2 # [ 118.344596] nix-daemon[840]: accepted connection from pid 1299, user nix-grpc-daemon (trusted)5237worker2 # [ 118.361297] nix-daemon[840]: reaped child process 1302, status = succeeded5238worker2 # [ 118.538296] nix-daemon[840]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5239worker2 # [ 118.555615] nix-daemon[840]: reaped child process 1307, status = succeeded5240lb # [ 118.563081] niks3-server[1011]: 2026/09/20 09:34:04 INFO Received uploads request method=POST path=/api/pending_closures5241worker2 # [ 118.580458] nix-grpc-daemon[1282]: time=2026-09-20T09:34:04.226Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5242worker2 # [ 118.581945] nix-grpc-daemon[1282]: time=2026-09-20T09:34:04.226Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5243lb # [ 118.600882] niks3-server[1011]: 2026/09/20 09:34:04 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5244worker2 # [ 118.619273] nix-grpc-daemon[1282]: time=2026-09-20T09:34:04.265Z level=INFO msg="Uploading 1 narinfos"5245lb # [ 118.613622] niks3-server[1011]: 2026/09/20 09:34:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5246lb # [ 118.621856] niks3-server[1011]: 2026/09/20 09:34:04 INFO Signed narinfos id=35 count=15247lb # [ 118.632356] niks3-server[1011]: 2026/09/20 09:34:04 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5248lb # [ 118.644071] niks3-server[1011]: 2026/09/20 09:34:04 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5249worker2 # [ 118.654698] nix-grpc-daemon[1282]: time=2026-09-20T09:34:04.301Z level=INFO msg="Upload complete. (482ms)"5250lb # [ 118.651088] niks3-server[1011]: 2026/09/20 09:34:04 INFO Completed upload id=355251worker2 # [ 118.663870] nix-grpc-daemon[1282]: time=2026-09-20T09:34:04.305Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n"5252worker2 # [ 118.677108] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34700 duration_s=0 paths=1 nar_bytes_in=4245253worker2 # [ 118.681736] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347005254worker2 # [ 118.688888] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5255worker2 # [ 118.691457] nix-daemon[840]: reaped child process 1280, status = succeeded5256worker2 # [ 118.701590] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5257client # [ 118.709962] nix[1198]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5258lb: must succeed: curl -sf localhost:9901/clusters5259lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5260lb: must succeed: curl -sf localhost:9901/clusters5261lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5262worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5263lb # [ 120.783810] niks3-server[1011]: 2026/09/20 09:34:06 INFO lead: released remote=192.168.1.3:551825264worker1 # [ 120.799951] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1482 (nix-grpc-daemon) on client request.5265worker1 # [ 120.812902] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5266worker2 # [ 120.803441] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5267client # [ 120.813186] nix[1198]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5268worker1 # [ 120.853186] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5269worker1 # [ 120.868425] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5270worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.14 seconds)5271worker1 # [ 120.870923] systemd[1]: nix-grpc-daemon.service: Consumed 213ms CPU time over 6.594s wall clock time, 13.8M memory peak, 7.9K incoming IP traffic, 9.6K outgoing IP traffic.5272client: must succeed: sleep 5.05273worker1 # [ 120.875287] nix-daemon[837]: reaped child process 1540, status = succeeded5274worker1 # [ 120.954882] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5275worker1 # [ 120.968271] systemd[1]: Starting Nix worker-protocol over gRPC...5276worker2 # [ 121.003579] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:500515277worker1 # [ 121.180193] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5278worker1 # [ 121.182440] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15279worker1 # [ 121.190217] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5280worker1 # [ 121.191944] systemd[1]: Started Nix worker-protocol over gRPC.5281lb # [ 121.182036] niks3-server[1011]: 2026/09/20 09:34:06 INFO lead: acquired remote=192.168.1.3:364485282worker1 # [ 121.208032] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=scheduler_take_over5283worker1 # [ 121.219488] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=15284worker1 # [ 121.233004] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:500515285worker1 # [ 121.234902] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05286lb # [ 121.445966] envoy[920]: conn peer=[2001:db8:1::3]:50104 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4430 tx=1348 ms=252345287lb # [ 121.451518] envoy[920]: conn peer=[2001:db8:1::3]:33840 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1107 tx=295 ms=62985288client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5289client: waiting for success: ! systemctl is-active mid5290worker2 # [ 126.355383] nix-daemon[840]: reaped child process 1311, status = succeeded5291worker2 # [ 126.529296] nix-daemon[840]: accepted connection from pid 1347, user nix-grpc-daemon (trusted)5292worker2 # [ 126.547858] nix-daemon[840]: reaped child process 1350, status = succeeded5293lb # [ 126.556740] niks3-server[1011]: 2026/09/20 09:34:12 INFO Received uploads request method=POST path=/api/pending_closures5294worker2 # [ 126.574675] nix-grpc-daemon[1282]: time=2026-09-20T09:34:12.219Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5295worker2 # [ 126.576805] nix-grpc-daemon[1282]: time=2026-09-20T09:34:12.219Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5296lb # [ 126.598087] niks3-server[1011]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5297lb # [ 126.610775] niks3-server[1011]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5298lb # [ 126.619520] niks3-server[1011]: 2026/09/20 09:34:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5299worker2 # [ 126.632196] nix-grpc-daemon[1282]: time=2026-09-20T09:34:12.278Z level=INFO msg="Uploading 1 narinfos"5300lb # [ 126.627917] niks3-server[1011]: 2026/09/20 09:34:12 INFO Signed narinfos id=36 count=15301lb # [ 126.649052] niks3-server[1011]: 2026/09/20 09:34:12 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5302worker2 # [ 126.664140] nix-grpc-daemon[1282]: time=2026-09-20T09:34:12.311Z level=INFO msg="Upload complete. (344ms)"5303lb # [ 126.664437] niks3-server[1011]: 2026/09/20 09:34:12 INFO Completed upload id=365304worker2 # [ 126.677133] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34700 duration_s=8 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15305lb # [ 126.683922] niks3-server[1011]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5306worker2 # [ 126.692815] nix-grpc-daemon[1282]: time=2026-09-20T09:34:12.339Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5307worker2 # [ 126.700828] nix-daemon[840]: reaped child process 1309, status = succeeded5308client # [ 126.728798] systemd[1]: mid.service: Deactivated successfully.5309client # [ 126.733149] systemd[1]: mid.service: Consumed 164ms CPU time over 9.983s wall clock time, 34.9M memory peak, 8.8K incoming IP traffic, 9.2K outgoing IP traffic.5310client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5311client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5312client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5313(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.73 seconds)5314subtest: interrupting the client stops the build on the worker5315client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5316client # [ 127.444739] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5317client # Running as unit: intr.service; invocation ID: 19f822cecb9f4dc2abc0045e59f563f35318client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5319worker1 # [ 127.678782] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:475785320worker1 # [ 127.693758] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5321client # [ 127.702220] nix[1233]: don't know how to build these paths:5322client # [ 127.703262] nix[1233]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5323worker1 # [ 127.724870] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:13Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05324worker1 # [ 127.731680] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:13Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15325worker1 # [ 127.778247] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785326worker1 # [ 127.795338] nix-grpc-daemon[1568]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 1/5)5327worker1 # [ 127.856159] nix-grpc-daemon[1568]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 186 ms (attempt 2/5)5328worker1 # [ 128.049766] nix-grpc-daemon[1568]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 342 ms (attempt 3/5)5329worker1 # [ 128.399552] nix-grpc-daemon[1568]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 470 ms (attempt 4/5)5330worker1 # [ 128.879175] nix-grpc-daemon[1568]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5331worker1 # [ 128.900522] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785332client # [ 128.906491] nix[1233]: copying 1 paths to 'lb:50051'...5333worker1 # [ 128.918471] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475785334client # [ 128.911837] nix[1233]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5335worker1 # [ 128.936567] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5336worker1 # [ 128.964347] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:14Z level=info event=niks3_push_started pid=16425337worker1 # [ 129.354919] nix-daemon[837]: accepted connection from pid 1655, user nix-grpc-daemon (trusted)5338worker1 # [ 129.372348] nix-daemon[837]: reaped child process 1658, status = succeeded5339worker1 # [ 129.549311] nix-daemon[837]: accepted connection from pid 1660, user nix-grpc-daemon (trusted)5340worker1 # [ 129.567464] nix-daemon[837]: reaped child process 1663, status = succeeded5341lb # [ 129.558026] niks3-server[1011]: 2026/09/20 09:34:15 INFO Received uploads request method=POST path=/api/pending_closures5342worker1 # [ 129.596435] nix-grpc-daemon[1642]: time=2026-09-20T09:34:15.242Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5343worker1 # [ 129.597930] nix-grpc-daemon[1642]: time=2026-09-20T09:34:15.242Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5344lb # [ 129.609111] niks3-server[1011]: 2026/09/20 09:34:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5345worker1 # [ 129.640374] nix-grpc-daemon[1642]: time=2026-09-20T09:34:15.287Z level=INFO msg="Uploading 1 narinfos"5346lb # [ 129.622302] niks3-server[1011]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5347lb # [ 129.631337] niks3-server[1011]: 2026/09/20 09:34:15 INFO Signed narinfos id=37 count=15348lb # [ 129.638907] niks3-server[1011]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5349lb # [ 129.648631] niks3-server[1011]: 2026/09/20 09:34:15 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5350lb # [ 129.652201] niks3-server[1011]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5351lb # [ 129.656159] niks3-server[1011]: 2026/09/20 09:34:15 INFO Completed upload id=375352worker1 # [ 129.678655] nix-grpc-daemon[1642]: time=2026-09-20T09:34:15.325Z level=INFO msg="Upload complete. (500ms)"5353worker1 # [ 129.689249] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=4245354worker1 # [ 129.708196] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785355worker1 # [ 129.711879] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5356worker1 # [ 129.720189] nix-daemon[837]: reaped child process 1640, status = succeeded5357client # [ 129.718233] nix[1233]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5358worker1 # [ 129.730060] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5359client: must succeed: systemctl kill -s INT intr5360client # [ 131.156579] systemd[1]: intr.service: Sent signal SIGINT to main process 1233 (nix) on client request.5361client # [ 131.162367] nix[1233]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5362client # [ 131.169648] nix[1233]: error: interrupted by the user5363client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5364client # [ 131.204159] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5365client # [ 131.208749] systemd[1]: intr.service: Failed with result 'exit-code'.5366client # [ 131.210782] systemd[1]: intr.service: Consumed 141ms CPU time over 3.762s wall clock time, 37.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.5367worker1 # [ 131.355828] nix-daemon[837]: reaped child process 1665, status = succeeded5368worker1 # [ 131.358945] nix-daemon[1667]: unexpected Nix daemon error: error: interrupted by the user5369worker1 # [ 131.367464] nix-daemon[837]: reaped child process 1667, status = failed with exit code 15370lb # [ 131.445841] envoy[920]: conn peer=[2001:db8:1::1]:60054 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3022 tx=1424 ms=97145371lb # [ 131.451074] envoy[920]: conn peer=[2001:db8:1::1]:47332 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=755 ms=35195372(finished: subtest: interrupting the client stops the build on the worker, in 5.08 seconds)5373subtest: a deploy mid-build drains: the build finishes, the new generation takes over5374client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5375client # [ 132.549010] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5376client # Running as unit: sw.service; invocation ID: f96d2c16a95f4bd98b6da2a458736c0a5377client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds)5378client # [ 132.800843] nix[1252]: don't know how to build these paths:5379client # [ 132.801823] nix[1252]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5380worker2 # [ 132.791663] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:347005381worker1 # [ 132.824776] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:18Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05382worker1 # [ 132.825192] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:18Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15383worker2 # [ 132.854077] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347005384worker2 # [ 132.870697] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347005385client # [ 132.895100] nix[1252]: copying 1 paths to 'lb:50051'...5386worker2 # [ 132.886936] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347005387client # [ 132.897776] nix[1252]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5388worker2 # [ 132.901868] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5389worker2 # [ 133.109842] nix-daemon[840]: accepted connection from pid 1382, user nix-grpc-daemon (trusted)5390worker2 # [ 133.129574] nix-daemon[840]: reaped child process 1385, status = succeeded5391worker2 # [ 133.306439] nix-daemon[840]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)5392worker2 # [ 133.323937] nix-daemon[840]: reaped child process 1390, status = succeeded5393lb # [ 133.330996] niks3-server[1011]: 2026/09/20 09:34:18 INFO Received uploads request method=POST path=/api/pending_closures5394worker2 # [ 133.349940] nix-grpc-daemon[1282]: time=2026-09-20T09:34:18.996Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5395worker2 # [ 133.351479] nix-grpc-daemon[1282]: time=2026-09-20T09:34:18.996Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5396lb # [ 133.368093] niks3-server[1011]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5397worker2 # [ 133.387839] nix-grpc-daemon[1282]: time=2026-09-20T09:34:19.034Z level=INFO msg="Uploading 1 narinfos"5398lb # [ 133.385663] niks3-server[1011]: 2026/09/20 09:34:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5399lb # [ 133.395404] niks3-server[1011]: 2026/09/20 09:34:19 INFO Signed narinfos id=38 count=15400lb # [ 133.400623] niks3-server[1011]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5401lb # [ 133.410343] niks3-server[1011]: 2026/09/20 09:34:19 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5402lb # [ 133.414933] niks3-server[1011]: 2026/09/20 09:34:19 INFO Completed upload id=385403worker2 # [ 133.420519] nix-grpc-daemon[1282]: time=2026-09-20T09:34:19.067Z level=INFO msg="Upload complete. (501ms)"5404lb # [ 133.417585] niks3-server[1011]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5405worker2 # [ 133.428272] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34700 duration_s=0 paths=1 nar_bytes_in=4165406worker2 # [ 133.443622] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347005407worker2 # [ 133.451838] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5408worker2 # [ 133.457452] nix-daemon[840]: reaped child process 1380, status = succeeded5409client # [ 133.476617] nix[1252]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5410worker2 # [ 133.472574] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5411worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25412worker2 # Checking switch inhibitors... done5413worker2 # [ 136.040379] nixos[1425]: switching to system configuration /nix/store/clfbplp7p27ip16wqar5gfyx0y1bpgkm-nixos-system-worker2-test5414worker2 # [ 136.042312] systemd[1]: Stopped target Local File Systems.5415worker2 # [ 136.043087] systemd[1]: Stopped target Remote File Systems.5416worker2 # activating the configuration...5417worker2 # setting up /etc...5418worker2 # [ 136.822175] systemd[1]: Reload requested from client PID 1425 ('.switch-to-conf') (unit backdoor.service)...5419worker2 # [ 136.824786] systemd[1]: Reloading...5420worker2 # [ 137.712436] systemd[1]: Reloading finished in 885 ms.5421worker2 # restarting sysinit-reactivation.target5422worker2 # [ 137.797707] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5423worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5424worker2 # [ 137.958989] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5425worker2 # [ 137.964948] systemd[1]: Reached target Reactivate sysinit units.5426worker2 # [ 137.966074] dbus-broker-launch[495]: Caught SIGHUP, trigger reload.5427worker2 # [ 137.967022] systemd[1]: Reloading D-Bus System Message Bus...5428worker2 # [ 137.970735] systemd[1]: Reloading Nix worker-protocol over gRPC...5429worker2 # [ 137.991819] dbus-broker-launch[495]: Looking up NSS user entry for 'systemd-timesync'...5430worker2 # [ 137.996100] dbus-broker-launch[495]: NSS returned no entry for 'systemd-timesync'5431worker2 # [ 138.000121] dbus-broker-launch[495]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5432worker2 # [ 138.029737] systemd[1]: Reloaded Nix worker-protocol over gRPC.5433worker2 # [ 138.054186] systemd[1]: Reloaded D-Bus System Message Bus.5434worker2 # [ 138.057045] systemd[1]: Reached target Local File Systems.5435worker2 # [ 138.057855] systemd[1]: Reached target Remote File Systems.5436worker2 # [ 138.068096] systemd[1]: Starting linger-users.service...5437worker2 # [ 138.074351] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5438worker2 # [ 138.080384] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5439worker2 # [ 138.087140] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5440worker2 # [ 138.096786] systemd[1]: Starting Create SUID/SGID Wrappers...5441worker2 # [ 138.097628] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5442worker2 # [ 138.098830] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675443worker2 # [ 138.108341] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5444worker2 # [ 138.112574] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5445worker2 # [ 138.116771] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5446worker2 # [ 138.154148] systemd[1]: linger-users.service: Deactivated successfully.5447worker2 # [ 138.156164] systemd[1]: Finished linger-users.service.5448worker2 # [ 138.593967] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5449worker2 # [ 138.595026] systemd[1]: Finished Create SUID/SGID Wrappers.5450worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5451worker2 # [ 138.847528] nixos[1425]: finished switching to system configuration /nix/store/clfbplp7p27ip16wqar5gfyx0y1bpgkm-nixos-system-worker2-test5452worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.65 seconds)5453worker2: must succeed: pgrep -f 'read -t [9]0 x'5454worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5455client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25456worker2 # [ 138.994936] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:24Z level=info event=draining5457worker2 # [ 139.176770] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:347005458client # don't know how to build these paths:5459client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5460worker1 # [ 139.202916] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785461worker1 # [ 139.229294] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05462worker1 # [ 139.236423] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15463worker1 # [ 139.279255] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785464worker1 # [ 139.294829] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785465client # copying 1 paths to 'lb:50051'...5466worker1 # [ 139.311569] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475785467client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5468worker1 # [ 139.335988] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5469worker1 # [ 139.547874] nix-daemon[837]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)5470worker1 # [ 139.565248] nix-daemon[837]: reaped child process 1724, status = succeeded5471worker1 # [ 139.746078] nix-daemon[837]: accepted connection from pid 1726, user nix-grpc-daemon (trusted)5472worker1 # [ 139.763073] nix-daemon[837]: reaped child process 1729, status = succeeded5473lb # [ 139.753578] niks3-server[1011]: 2026/09/20 09:34:25 INFO Received uploads request method=POST path=/api/pending_closures5474worker1 # [ 139.786593] nix-grpc-daemon[1642]: time=2026-09-20T09:34:25.433Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5475worker1 # [ 139.788116] nix-grpc-daemon[1642]: time=2026-09-20T09:34:25.433Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5476lb # [ 139.786444] niks3-server[1011]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5477lb # [ 139.806846] niks3-server[1011]: 2026/09/20 09:34:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5478worker1 # [ 139.833828] nix-grpc-daemon[1642]: time=2026-09-20T09:34:25.480Z level=INFO msg="Uploading 1 narinfos"5479lb # [ 139.817227] niks3-server[1011]: 2026/09/20 09:34:25 INFO Signed narinfos id=39 count=15480lb # [ 139.819618] niks3-server[1011]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5481lb # [ 139.827571] niks3-server[1011]: 2026/09/20 09:34:25 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5482lb # [ 139.838064] niks3-server[1011]: 2026/09/20 09:34:25 INFO Completed upload id=395483worker1 # [ 139.860341] nix-grpc-daemon[1642]: time=2026-09-20T09:34:25.507Z level=INFO msg="Upload complete. (507ms)"5484lb # [ 139.840692] niks3-server[1011]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5485worker1 # [ 139.868286] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=5285486worker1 # [ 139.884277] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785487worker1 # [ 139.895649] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5488worker1 # [ 139.898691] nix-daemon[837]: reaped child process 1719, status = succeeded5489client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5490worker1 # [ 139.912210] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5491client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5492client # farm-a> LOG-farm-a-during-drain5493worker1 # [ 141.152788] nix-daemon[837]: reaped child process 1733, status = succeeded5494worker1 # [ 141.327173] nix-daemon[837]: accepted connection from pid 1748, user nix-grpc-daemon (trusted)5495worker1 # [ 141.346859] nix-daemon[837]: reaped child process 1751, status = succeeded5496lb # [ 141.337064] niks3-server[1011]: 2026/09/20 09:34:26 INFO Received uploads request method=POST path=/api/pending_closures5497worker1 # [ 141.371894] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.016Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5498worker1 # [ 141.374151] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.016Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5499lb # [ 141.379742] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5500lb # [ 141.395974] niks3-server[1011]: 2026/09/20 09:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5501lb # [ 141.400449] niks3-server[1011]: 2026/09/20 09:34:27 INFO Signed narinfos id=40 count=15502worker1 # [ 141.423621] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.069Z level=INFO msg="Uploading 1 narinfos"5503lb # [ 141.408991] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5504lb # [ 141.422709] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5505lb # [ 141.430050] niks3-server[1011]: 2026/09/20 09:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5506lb # [ 141.438003] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5507lb # [ 141.442276] niks3-server[1011]: 2026/09/20 09:34:27 INFO Completed upload id=405508worker1 # [ 141.464214] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.111Z level=INFO msg="Upload complete. (339ms)"5509worker1 # [ 141.481293] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=15510worker1 # [ 141.496322] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05511worker1 # [ 141.502844] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15512worker1 # [ 141.506978] nix-daemon[837]: reaped child process 1731, status = succeeded5513worker1 # [ 141.532143] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785514worker1 # [ 141.547955] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785515client # copying 1 paths to 'lb:50051'...5516worker1 # [ 141.562629] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.209Z level=INFO msg="All 1 paths already cached"5517worker1 # [ 141.569365] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475785518client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5519worker1 # [ 141.592195] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5520worker1 # [ 141.800655] nix-daemon[837]: accepted connection from pid 1757, user nix-grpc-daemon (trusted)5521worker1 # [ 141.817865] nix-daemon[837]: reaped child process 1760, status = succeeded5522worker1 # [ 141.997460] nix-daemon[837]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)5523worker1 # [ 142.014491] nix-daemon[837]: reaped child process 1765, status = succeeded5524lb # [ 142.003299] niks3-server[1011]: 2026/09/20 09:34:27 INFO Received uploads request method=POST path=/api/pending_closures5525worker1 # [ 142.034646] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.681Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5526worker1 # [ 142.036249] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.681Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5527lb # [ 142.029927] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5528worker1 # [ 142.065468] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.712Z level=INFO msg="Uploading 1 narinfos"5529lb # [ 142.046581] niks3-server[1011]: 2026/09/20 09:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5530lb # [ 142.056707] niks3-server[1011]: 2026/09/20 09:34:27 INFO Signed narinfos id=41 count=15531lb # [ 142.059467] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5532lb # [ 142.067291] niks3-server[1011]: 2026/09/20 09:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5533lb # [ 142.074195] niks3-server[1011]: 2026/09/20 09:34:27 INFO Completed upload id=415534worker1 # [ 142.095685] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.742Z level=INFO msg="Upload complete. (486ms)"5535lb # [ 142.076548] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5536worker1 # [ 142.104306] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=6405537worker1 # [ 142.115266] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785538worker1 # [ 142.122260] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5539worker1 # [ 142.126978] nix-daemon[837]: reaped child process 1755, status = succeeded5540client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5541worker1 # [ 142.140266] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5542client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5543client # farm-b> LOG-farm-b-during-drain5544worker1 # [ 142.975521] nix-daemon[837]: reaped child process 1769, status = succeeded5545worker1 # [ 143.146989] nix-daemon[837]: accepted connection from pid 1784, user nix-grpc-daemon (trusted)5546worker1 # [ 143.167256] nix-daemon[837]: reaped child process 1787, status = succeeded5547lb # [ 143.157440] niks3-server[1011]: 2026/09/20 09:34:28 INFO Received uploads request method=POST path=/api/pending_closures5548worker1 # [ 143.190376] nix-grpc-daemon[1642]: time=2026-09-20T09:34:28.836Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5549worker1 # [ 143.192253] nix-grpc-daemon[1642]: time=2026-09-20T09:34:28.836Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5550lb # [ 143.196380] niks3-server[1011]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5551worker1 # [ 143.228824] nix-grpc-daemon[1642]: time=2026-09-20T09:34:28.875Z level=INFO msg="Uploading 1 narinfos"5552lb # [ 143.210685] niks3-server[1011]: 2026/09/20 09:34:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5553lb # [ 143.219586] niks3-server[1011]: 2026/09/20 09:34:28 INFO Signed narinfos id=42 count=15554lb # [ 143.224641] niks3-server[1011]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5555lb # [ 143.231493] niks3-server[1011]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5556worker1 # [ 143.257943] nix-grpc-daemon[1642]: time=2026-09-20T09:34:28.905Z level=INFO msg="Upload complete. (308ms)"5557lb # [ 143.236598] niks3-server[1011]: 2026/09/20 09:34:28 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5558lb # [ 143.240597] niks3-server[1011]: 2026/09/20 09:34:28 INFO Completed upload id=425559lb # [ 143.243712] niks3-server[1011]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5560worker1 # [ 143.269195] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=15561worker1 # [ 143.292192] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:28Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05562worker1 # [ 143.295990] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:28Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15563worker1 # [ 143.300576] nix-daemon[837]: reaped child process 1767, status = succeeded5564worker1 # [ 143.335593] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785565worker1 # [ 143.351249] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785566worker1 # [ 143.365501] nix-grpc-daemon[1642]: time=2026-09-20T09:34:29.012Z level=INFO msg="All 2 paths already cached"5567client # copying 1 paths to 'lb:50051'...5568worker1 # [ 143.376114] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475785569client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5570worker1 # [ 143.394299] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5571worker1 # [ 143.607339] nix-daemon[837]: accepted connection from pid 1793, user nix-grpc-daemon (trusted)5572worker1 # [ 143.627893] nix-daemon[837]: reaped child process 1796, status = succeeded5573worker1 # [ 143.802309] nix-daemon[837]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5574worker1 # [ 143.821140] nix-daemon[837]: reaped child process 1801, status = succeeded5575lb # [ 143.810571] niks3-server[1011]: 2026/09/20 09:34:29 INFO Received uploads request method=POST path=/api/pending_closures5576worker1 # [ 143.842177] nix-grpc-daemon[1642]: time=2026-09-20T09:34:29.489Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5577worker1 # [ 143.843732] nix-grpc-daemon[1642]: time=2026-09-20T09:34:29.489Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5578lb # [ 143.837493] niks3-server[1011]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5579worker1 # [ 143.872838] nix-grpc-daemon[1642]: time=2026-09-20T09:34:29.519Z level=INFO msg="Uploading 1 narinfos"5580lb # [ 143.853971] niks3-server[1011]: 2026/09/20 09:34:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5581lb # [ 143.864399] niks3-server[1011]: 2026/09/20 09:34:29 INFO Signed narinfos id=43 count=15582lb # [ 143.870158] niks3-server[1011]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5583lb # [ 143.878534] niks3-server[1011]: 2026/09/20 09:34:29 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5584lb # [ 143.884117] niks3-server[1011]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5585lb # [ 143.888748] niks3-server[1011]: 2026/09/20 09:34:29 INFO Completed upload id=435586worker1 # [ 143.910762] nix-grpc-daemon[1642]: time=2026-09-20T09:34:29.558Z level=INFO msg="Upload complete. (498ms)"5587worker1 # [ 143.918880] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=7685588worker1 # [ 143.935442] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785589worker1 # [ 143.938997] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5590worker1 # [ 143.944730] nix-daemon[837]: reaped child process 1791, status = succeeded5591client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5592worker1 # [ 143.955755] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5593client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5594client # farm-top> LOG-farm-top-during-drain5595worker1 # [ 145.001312] nix-daemon[837]: reaped child process 1805, status = succeeded5596worker1 # [ 145.188648] nix-daemon[837]: accepted connection from pid 1820, user nix-grpc-daemon (trusted)5597worker1 # [ 145.206465] nix-daemon[837]: reaped child process 1823, status = succeeded5598lb # [ 145.198305] niks3-server[1011]: 2026/09/20 09:34:30 INFO Received uploads request method=POST path=/api/pending_closures5599worker1 # [ 145.232155] nix-grpc-daemon[1642]: time=2026-09-20T09:34:30.877Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5600worker1 # [ 145.233866] nix-grpc-daemon[1642]: time=2026-09-20T09:34:30.877Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5601lb # [ 145.238196] niks3-server[1011]: 2026/09/20 09:34:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5602worker1 # [ 145.270402] nix-grpc-daemon[1642]: time=2026-09-20T09:34:30.917Z level=INFO msg="Uploading 1 narinfos"5603lb # [ 145.255332] niks3-server[1011]: 2026/09/20 09:34:30 INFO Signed narinfos id=44 count=15604lb # [ 145.264489] niks3-server[1011]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5605lb # [ 145.272519] niks3-server[1011]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5606lb # [ 145.281438] niks3-server[1011]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5607lb # [ 145.285283] niks3-server[1011]: 2026/09/20 09:34:30 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5608lb # [ 145.290188] niks3-server[1011]: 2026/09/20 09:34:30 INFO Completed upload id=445609worker1 # [ 145.312207] nix-grpc-daemon[1642]: time=2026-09-20T09:34:30.959Z level=INFO msg="Upload complete. (339ms)"5610lb # [ 145.293723] niks3-server[1011]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5611worker1 # [ 145.323870] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=15612worker1 # [ 145.341980] nix-daemon[837]: reaped child process 1803, status = succeeded5613client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.44 seconds)5614client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5615client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds)5616worker2: must succeed: pkill -f 'read -t [9]0 x'5617worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5618client: waiting for success: ! systemctl is-active sw5619worker2 # [ 145.710034] nix-daemon[840]: reaped child process 1394, status = succeeded5620worker2 # [ 145.877603] nix-daemon[840]: accepted connection from pid 1566, user nix-grpc-daemon (trusted)5621worker2 # [ 145.896754] nix-daemon[840]: reaped child process 1569, status = succeeded5622lb # [ 145.903644] niks3-server[1011]: 2026/09/20 09:34:31 INFO Received uploads request method=POST path=/api/pending_closures5623worker2 # [ 145.918831] nix-grpc-daemon[1282]: time=2026-09-20T09:34:31.565Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5624worker2 # [ 145.920459] nix-grpc-daemon[1282]: time=2026-09-20T09:34:31.565Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5625lb # [ 145.938813] niks3-server[1011]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5626worker2 # [ 145.957793] nix-grpc-daemon[1282]: time=2026-09-20T09:34:31.604Z level=INFO msg="Uploading 1 narinfos"5627lb # [ 145.954819] niks3-server[1011]: 2026/09/20 09:34:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5628lb # [ 145.964332] niks3-server[1011]: 2026/09/20 09:34:31 INFO Signed narinfos id=45 count=15629lb # [ 145.969502] niks3-server[1011]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5630lb # [ 145.973891] niks3-server[1011]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5631worker2 # [ 145.988968] nix-grpc-daemon[1282]: time=2026-09-20T09:34:31.636Z level=INFO msg="Upload complete. (291ms)"5632lb # [ 145.983405] niks3-server[1011]: 2026/09/20 09:34:31 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5633lb # [ 145.989196] niks3-server[1011]: 2026/09/20 09:34:31 INFO Completed upload id=455634lb # [ 145.991809] niks3-server[1011]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5635worker2 # [ 146.000871] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34700 duration_s=12 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=15636worker2 # [ 146.012387] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:31Z level=info event=signal_exit5637worker2 # [ 146.016666] nix-daemon[840]: reaped child process 1392, status = succeeded5638client # [ 146.053465] systemd[1]: sw.service: Deactivated successfully.5639client # [ 146.056594] systemd[1]: sw.service: Consumed 163ms CPU time over 13.504s wall clock time, 37M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.5640client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5641client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5642client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5643worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5644worker1 # [ 147.258288] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:475445645worker1 # [ 147.258674] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:32Z level=info event=worker_gone addr=192.168.1.4:500515646worker2 # [ 147.251909] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:32Z level=info event=scheduler_restarting5647worker2 # [ 147.267146] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5648worker2 # [ 147.294524] nix-daemon[840]: reaped child process 1275, status = succeeded5649worker2 # [ 147.406197] nix-grpc-daemon[1170]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5650worker2 # [ 147.410945] nix-grpc-daemon[1170]: E0000 00:00:1789896873.053231 1213 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5651worker2 # [ 147.417500] nix-grpc-daemon[1170]: E0000 00:00:1789896873.057927 1213 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5652worker2 # [ 148.489753] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5653worker2 # [ 148.495642] systemd[1]: nix-grpc-daemon.service: Consumed 1.159s CPU time over 46.727s wall clock time, 33.6M memory peak, 28.1K incoming IP traffic, 40.6K outgoing IP traffic.5654worker2 # [ 148.517890] systemd[1]: Starting Nix worker-protocol over gRPC...5655worker2 # [ 148.724333] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5656worker2 # [ 148.727574] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15657worker2 # [ 148.735859] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5658worker2 # [ 148.745379] systemd[1]: Started Nix worker-protocol over gRPC.5659worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.93 seconds)5660lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5661lb: must succeed: curl -sf localhost:9901/clusters5662worker2 # [ 148.783569] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:34Z level=info event=scheduler_connected addr=lb:500515663worker1 # [ 148.806693] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05664lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5665lb: must succeed: curl -sf localhost:9901/clusters5666lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5667lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds)5668lb: must succeed: curl -sf localhost:9901/clusters5669lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5670worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5671worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5672(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.61 seconds)5673subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5674client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15675worker2 # [ 150.337197] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:474185676worker2 # [ 150.352877] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)5677worker1 # [ 150.391510] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785678worker1 # [ 150.439551] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05679worker1 # [ 150.446630] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15680worker1 # [ 150.452649] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05681worker1 # [ 150.458190] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05682worker1 # [ 150.486700] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785683worker1 # [ 150.502961] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785684worker1 # [ 150.518548] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475785685worker1 # [ 150.533389] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5686worker1 # [ 150.739488] nix-daemon[837]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)5687worker1 # [ 150.760657] nix-daemon[837]: reaped child process 1837, status = succeeded5688worker1 # [ 150.934885] nix-daemon[837]: accepted connection from pid 1839, user nix-grpc-daemon (trusted)5689worker1 # [ 150.952809] nix-daemon[837]: reaped child process 1842, status = succeeded5690lb # [ 150.942887] niks3-server[1011]: 2026/09/20 09:34:36 INFO Received uploads request method=POST path=/api/pending_closures5691worker1 # [ 150.976125] nix-grpc-daemon[1642]: time=2026-09-20T09:34:36.622Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5692worker1 # [ 150.977675] nix-grpc-daemon[1642]: time=2026-09-20T09:34:36.622Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5693lb # [ 150.971735] niks3-server[1011]: 2026/09/20 09:34:36 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5694worker1 # [ 151.008123] nix-grpc-daemon[1642]: time=2026-09-20T09:34:36.655Z level=INFO msg="Uploading 1 narinfos"5695lb # [ 150.985913] niks3-server[1011]: 2026/09/20 09:34:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5696lb # [ 150.997741] niks3-server[1011]: 2026/09/20 09:34:36 INFO Signed narinfos id=46 count=15697lb # [ 151.005182] niks3-server[1011]: 2026/09/20 09:34:36 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5698lb # [ 151.012952] niks3-server[1011]: 2026/09/20 09:34:36 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5699worker1 # [ 151.042618] nix-grpc-daemon[1642]: time=2026-09-20T09:34:36.689Z level=INFO msg="Upload complete. (492ms)"5700lb # [ 151.021381] niks3-server[1011]: 2026/09/20 09:34:36 INFO Completed upload id=465701lb # [ 151.025237] niks3-server[1011]: 2026/09/20 09:34:36 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5702worker1 # [ 151.052417] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=5125703worker1 # [ 151.063940] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785704worker1 # [ 151.070899] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5705worker1 # [ 151.075658] nix-daemon[837]: reaped child process 1832, status = succeeded5706worker1 # [ 151.090047] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5707lb # [ 151.446168] envoy[920]: conn peer=[2001:db8:1::1]:33102 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9582 tx=3872 ms=61435708lb # [ 151.451473] envoy[920]: conn peer=[2001:db8:1::1]:33100 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2935 tx=1311 ms=132255709lb # [ 151.456438] envoy[920]: conn peer=[2001:db8:1::4]:45680 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3035 tx=929 ms=452375710worker1 # [ 152.339713] nix-daemon[837]: reaped child process 1846, status = succeeded5711worker1 # [ 152.523876] nix-daemon[837]: accepted connection from pid 1861, user nix-grpc-daemon (trusted)5712worker1 # [ 152.543072] nix-daemon[837]: reaped child process 1864, status = succeeded5713lb # [ 152.533646] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received uploads request method=POST path=/api/pending_closures5714worker1 # [ 152.568471] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.212Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5715worker1 # [ 152.570096] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.213Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5716lb # [ 152.579431] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5717lb # [ 152.591575] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5718lb # [ 152.602011] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5719worker1 # [ 152.629241] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.276Z level=INFO msg="Uploading 1 narinfos"5720lb # [ 152.610043] niks3-server[1011]: 2026/09/20 09:34:38 INFO Signed narinfos id=47 count=15721lb # [ 152.614945] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5722lb # [ 152.623258] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5723lb # [ 152.629793] niks3-server[1011]: 2026/09/20 09:34:38 INFO Completed upload id=475724worker1 # [ 152.651538] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.298Z level=INFO msg="Upload complete. (350ms)"5725lb # [ 152.632536] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5726worker1 # [ 152.670495] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=15727worker1 # [ 152.688294] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15728worker1 # [ 152.696975] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785729worker1 # [ 152.699864] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05730worker1 # [ 152.704419] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785731worker1 # [ 152.708501] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475785732worker1 # [ 152.717293] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5733worker1 # [ 152.719830] nix-daemon[837]: reaped child process 1844, status = succeeded5734worker1 # [ 152.903809] nix-daemon[837]: accepted connection from pid 1870, user nix-grpc-daemon (trusted)5735worker1 # [ 152.923604] nix-daemon[837]: reaped child process 1873, status = succeeded5736worker1 # [ 153.101464] nix-daemon[837]: accepted connection from pid 1875, user nix-grpc-daemon (trusted)5737worker1 # [ 153.118465] nix-daemon[837]: reaped child process 1878, status = succeeded5738lb # [ 153.108699] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received uploads request method=POST path=/api/pending_closures5739worker1 # [ 153.139123] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.786Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5740worker1 # [ 153.140688] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.786Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5741lb # [ 153.132970] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5742lb # [ 153.148214] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5743worker1 # [ 153.177184] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.824Z level=INFO msg="Uploading 1 narinfos"5744lb # [ 153.160976] niks3-server[1011]: 2026/09/20 09:34:38 INFO Signed narinfos id=48 count=15745lb # [ 153.167905] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5746lb # [ 153.177580] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5747worker1 # [ 153.204482] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.851Z level=INFO msg="Upload complete. (474ms)"5748lb # [ 153.182699] niks3-server[1011]: 2026/09/20 09:34:38 INFO Completed upload id=485749lb # [ 153.186582] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5750worker1 # [ 153.211972] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=5125751worker1 # [ 153.223851] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785752worker1 # [ 153.233471] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5753worker1 # [ 153.235551] nix-daemon[837]: reaped child process 1868, status = succeeded5754worker1 # [ 153.245571] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5755worker1 # [ 154.491727] nix-daemon[837]: reaped child process 1882, status = succeeded5756worker1 # [ 154.667466] nix-daemon[837]: accepted connection from pid 1897, user nix-grpc-daemon (trusted)5757worker1 # [ 154.685082] nix-daemon[837]: reaped child process 1900, status = succeeded5758lb # [ 154.675515] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received uploads request method=POST path=/api/pending_closures5759worker1 # [ 154.708403] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.354Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5760worker1 # [ 154.709892] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.354Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5761lb # [ 154.710990] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5762lb # [ 154.725572] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5763lb # [ 154.742492] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5764worker1 # [ 154.770648] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.417Z level=INFO msg="Uploading 1 narinfos"5765lb # [ 154.754809] niks3-server[1011]: 2026/09/20 09:34:40 INFO Signed narinfos id=49 count=15766lb # [ 154.761256] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5767lb # [ 154.771312] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5768lb # [ 154.775919] niks3-server[1011]: 2026/09/20 09:34:40 INFO Completed upload id=495769worker1 # [ 154.797787] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.444Z level=INFO msg="Upload complete. (339ms)"5770lb # [ 154.778734] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5771worker1 # [ 154.817074] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=15772worker1 # [ 154.836694] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15773worker1 # [ 154.840889] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785774worker1 # [ 154.844002] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05775worker1 # [ 154.850449] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785776worker1 # [ 154.854839] nix-daemon[837]: reaped child process 1880, status = succeeded5777worker1 # [ 154.856712] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475785778worker1 # [ 154.866986] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5779worker1 # [ 155.054431] nix-daemon[837]: accepted connection from pid 1906, user nix-grpc-daemon (trusted)5780worker1 # [ 155.073542] nix-daemon[837]: reaped child process 1909, status = succeeded5781worker1 # [ 155.250281] nix-daemon[837]: accepted connection from pid 1911, user nix-grpc-daemon (trusted)5782worker1 # [ 155.267241] nix-daemon[837]: reaped child process 1914, status = succeeded5783lb # [ 155.256275] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received uploads request method=POST path=/api/pending_closures5784worker1 # [ 155.286850] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.933Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5785worker1 # [ 155.288451] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.933Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5786lb # [ 155.283980] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5787lb # [ 155.294861] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5788worker1 # [ 155.323782] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.970Z level=INFO msg="Uploading 1 narinfos"5789lb # [ 155.307959] niks3-server[1011]: 2026/09/20 09:34:40 INFO Signed narinfos id=50 count=15790lb # [ 155.310735] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5791lb # [ 155.320917] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5792lb # [ 155.327516] niks3-server[1011]: 2026/09/20 09:34:40 INFO Completed upload id=505793lb # [ 155.330201] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5794worker1 # [ 155.349733] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.996Z level=INFO msg="Upload complete. (472ms)"5795worker1 # [ 155.359446] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=5125796worker1 # [ 155.371524] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785797worker1 # [ 155.377297] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5798worker1 # [ 155.381893] nix-daemon[837]: reaped child process 1904, status = succeeded5799worker1 # [ 155.394783] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5800worker1 # [ 157.045735] nix-daemon[837]: reaped child process 1918, status = succeeded5801worker1 # [ 157.228774] nix-daemon[837]: accepted connection from pid 1933, user nix-grpc-daemon (trusted)5802worker1 # [ 157.247349] nix-daemon[837]: reaped child process 1936, status = succeeded5803lb # [ 157.237591] niks3-server[1011]: 2026/09/20 09:34:42 INFO Received uploads request method=POST path=/api/pending_closures5804worker1 # [ 157.272827] nix-grpc-daemon[1642]: time=2026-09-20T09:34:42.919Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5805worker1 # [ 157.275616] nix-grpc-daemon[1642]: time=2026-09-20T09:34:42.921Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5806lb # [ 157.301737] niks3-server[1011]: 2026/09/20 09:34:42 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5807lb # [ 157.307594] niks3-server[1011]: 2026/09/20 09:34:42 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5808lb # [ 157.314867] niks3-server[1011]: 2026/09/20 09:34:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5809lb # [ 157.320918] niks3-server[1011]: 2026/09/20 09:34:42 INFO Signed narinfos id=51 count=15810worker1 # [ 157.341979] nix-grpc-daemon[1642]: time=2026-09-20T09:34:42.988Z level=INFO msg="Uploading 1 narinfos"5811lb # [ 157.324767] niks3-server[1011]: 2026/09/20 09:34:42 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5812lb # [ 157.332623] niks3-server[1011]: 2026/09/20 09:34:42 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5813lb # [ 157.338134] niks3-server[1011]: 2026/09/20 09:34:42 INFO Completed upload id=515814worker1 # [ 157.360387] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.007Z level=INFO msg="Upload complete. (354ms)"5815lb # [ 157.340180] niks3-server[1011]: 2026/09/20 09:34:42 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5816worker1 # [ 157.378356] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=2 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=15817worker1 # [ 157.396953] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15818worker1 # [ 157.406609] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785819worker1 # [ 157.411167] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05820worker1 # [ 157.416736] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785821worker1 # [ 157.421492] nix-daemon[837]: reaped child process 1916, status = succeeded5822worker1 # [ 157.423454] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.067Z level=INFO msg="All 1 paths already cached"5823worker1 # [ 157.427271] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475785824worker1 # [ 157.439459] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5825worker1 # [ 157.629169] nix-daemon[837]: accepted connection from pid 1942, user nix-grpc-daemon (trusted)5826worker1 # [ 157.646925] nix-daemon[837]: reaped child process 1945, status = succeeded5827worker1 # [ 157.821203] nix-daemon[837]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)5828worker1 # [ 157.837693] nix-daemon[837]: reaped child process 1950, status = succeeded5829lb # [ 157.826735] niks3-server[1011]: 2026/09/20 09:34:43 INFO Received uploads request method=POST path=/api/pending_closures5830worker1 # [ 157.858471] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.505Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5831worker1 # [ 157.859977] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.505Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5832lb # [ 157.853140] niks3-server[1011]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5833worker1 # [ 157.891126] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.538Z level=INFO msg="Uploading 1 narinfos"5834lb # [ 157.868827] niks3-server[1011]: 2026/09/20 09:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5835lb # [ 157.879212] niks3-server[1011]: 2026/09/20 09:34:43 INFO Signed narinfos id=52 count=15836lb # [ 157.886261] niks3-server[1011]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5837lb # [ 157.895314] niks3-server[1011]: 2026/09/20 09:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5838lb # [ 157.903925] niks3-server[1011]: 2026/09/20 09:34:43 INFO Completed upload id=525839worker1 # [ 157.925522] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.572Z level=INFO msg="Upload complete. (473ms)"5840lb # [ 157.908346] niks3-server[1011]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5841worker1 # [ 157.936392] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=6245842worker1 # [ 157.939882] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785843worker1 # [ 157.950355] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5844worker1 # [ 157.955165] nix-daemon[837]: reaped child process 1940, status = succeeded5845worker1 # [ 157.967675] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5846worker1 # [ 158.787855] nix-daemon[837]: reaped child process 1954, status = succeeded5847worker1 # [ 158.944981] nix-daemon[837]: accepted connection from pid 1969, user nix-grpc-daemon (trusted)5848worker1 # [ 158.964859] nix-daemon[837]: reaped child process 1972, status = succeeded5849lb # [ 158.955080] niks3-server[1011]: 2026/09/20 09:34:44 INFO Received uploads request method=POST path=/api/pending_closures5850worker1 # [ 158.988413] nix-grpc-daemon[1642]: time=2026-09-20T09:34:44.635Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5851worker1 # [ 158.989889] nix-grpc-daemon[1642]: time=2026-09-20T09:34:44.635Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5852lb # [ 158.997893] niks3-server[1011]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5853lb # [ 159.009924] niks3-server[1011]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5854lb # [ 159.018413] niks3-server[1011]: 2026/09/20 09:34:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5855worker1 # [ 159.045404] nix-grpc-daemon[1642]: time=2026-09-20T09:34:44.692Z level=INFO msg="Uploading 1 narinfos"5856lb # [ 159.026136] niks3-server[1011]: 2026/09/20 09:34:44 INFO Signed narinfos id=53 count=15857lb # [ 159.030622] niks3-server[1011]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5858lb # [ 159.037419] niks3-server[1011]: 2026/09/20 09:34:44 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5859lb # [ 159.041396] niks3-server[1011]: 2026/09/20 09:34:44 INFO Completed upload id=535860worker1 # [ 159.063280] nix-grpc-daemon[1642]: time=2026-09-20T09:34:44.710Z level=INFO msg="Upload complete. (286ms)"5861lb # [ 159.043684] niks3-server[1011]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5862worker1 # [ 159.076994] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=15863worker1 # [ 159.088056] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15864worker1 # [ 159.091817] nix-daemon[837]: reaped child process 1952, status = succeeded5865worker1 # [ 159.116123] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785866worker1 # [ 159.126475] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05867worker1 # [ 159.137564] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785868worker1 # [ 159.150983] nix-grpc-daemon[1642]: time=2026-09-20T09:34:44.798Z level=INFO msg="All 1 paths already cached"5869worker1 # [ 159.159700] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475785870worker1 # [ 159.172979] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5871worker1 # [ 159.374495] nix-daemon[837]: accepted connection from pid 1978, user nix-grpc-daemon (trusted)5872worker1 # [ 159.393683] nix-daemon[837]: reaped child process 1981, status = succeeded5873worker1 # [ 159.566785] nix-daemon[837]: accepted connection from pid 1983, user nix-grpc-daemon (trusted)5874worker1 # [ 159.583620] nix-daemon[837]: reaped child process 1986, status = succeeded5875lb # [ 159.572870] niks3-server[1011]: 2026/09/20 09:34:45 INFO Received uploads request method=POST path=/api/pending_closures5876worker1 # [ 159.603504] nix-grpc-daemon[1642]: time=2026-09-20T09:34:45.250Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5877worker1 # [ 159.605134] nix-grpc-daemon[1642]: time=2026-09-20T09:34:45.250Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5878lb # [ 159.599296] niks3-server[1011]: 2026/09/20 09:34:45 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5879lb # [ 159.612765] niks3-server[1011]: 2026/09/20 09:34:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5880worker1 # [ 159.640739] nix-grpc-daemon[1642]: time=2026-09-20T09:34:45.287Z level=INFO msg="Uploading 1 narinfos"5881lb # [ 159.625221] niks3-server[1011]: 2026/09/20 09:34:45 INFO Signed narinfos id=54 count=15882lb # [ 159.632076] niks3-server[1011]: 2026/09/20 09:34:45 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5883worker1 # [ 159.662713] nix-grpc-daemon[1642]: time=2026-09-20T09:34:45.309Z level=INFO msg="Upload complete. (475ms)"5884lb # [ 159.640860] niks3-server[1011]: 2026/09/20 09:34:45 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5885lb # [ 159.645867] niks3-server[1011]: 2026/09/20 09:34:45 INFO Completed upload id=545886lb # [ 159.649191] niks3-server[1011]: 2026/09/20 09:34:45 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5887worker1 # [ 159.671829] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=6245888worker1 # [ 159.682179] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785889worker1 # [ 159.687726] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5890worker1 # [ 159.691954] nix-daemon[837]: reaped child process 1976, status = succeeded5891worker1 # [ 159.704245] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5892worker1 # [ 161.129629] nix-daemon[837]: reaped child process 1990, status = succeeded5893worker1 # [ 161.292149] nix-daemon[837]: accepted connection from pid 2005, user nix-grpc-daemon (trusted)5894worker1 # [ 161.311076] nix-daemon[837]: reaped child process 2008, status = succeeded5895lb # [ 161.301282] niks3-server[1011]: 2026/09/20 09:34:46 INFO Received uploads request method=POST path=/api/pending_closures5896worker1 # [ 161.334282] nix-grpc-daemon[1642]: time=2026-09-20T09:34:46.980Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5897worker1 # [ 161.335901] nix-grpc-daemon[1642]: time=2026-09-20T09:34:46.980Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5898lb # [ 161.331996] niks3-server[1011]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5899lb # [ 161.344589] niks3-server[1011]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5900lb # [ 161.358280] niks3-server[1011]: 2026/09/20 09:34:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5901worker1 # [ 161.385065] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.032Z level=INFO msg="Uploading 1 narinfos"5902lb # [ 161.368256] niks3-server[1011]: 2026/09/20 09:34:47 INFO Signed narinfos id=55 count=15903lb # [ 161.370904] niks3-server[1011]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5904lb # [ 161.381138] niks3-server[1011]: 2026/09/20 09:34:47 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5905lb # [ 161.388892] niks3-server[1011]: 2026/09/20 09:34:47 INFO Completed upload id=555906worker1 # [ 161.411077] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.058Z level=INFO msg="Upload complete. (297ms)"5907lb # [ 161.392302] niks3-server[1011]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5908worker1 # [ 161.426226] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=15909worker1 # [ 161.441043] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15910worker1 # [ 161.451513] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785911worker1 # [ 161.456864] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05912worker1 # [ 161.461986] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785913worker1 # [ 161.466804] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.113Z level=INFO msg="All 1 paths already cached"5914worker1 # [ 161.469660] nix-daemon[837]: reaped child process 1988, status = succeeded5915worker1 # [ 161.472617] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475785916worker1 # [ 161.483129] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5917worker1 # [ 161.665809] nix-daemon[837]: accepted connection from pid 2014, user nix-grpc-daemon (trusted)5918worker1 # [ 161.685044] nix-daemon[837]: reaped child process 2017, status = succeeded5919worker1 # [ 161.864539] nix-daemon[837]: accepted connection from pid 2019, user nix-grpc-daemon (trusted)5920worker1 # [ 161.881121] nix-daemon[837]: reaped child process 2022, status = succeeded5921lb # [ 161.874146] niks3-server[1011]: 2026/09/20 09:34:47 INFO Received uploads request method=POST path=/api/pending_closures5922worker1 # [ 161.904905] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.551Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5923worker1 # [ 161.906391] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.551Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5924lb # [ 161.900137] niks3-server[1011]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5925worker1 # [ 161.934981] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.582Z level=INFO msg="Uploading 1 narinfos"5926lb # [ 161.917091] niks3-server[1011]: 2026/09/20 09:34:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5927lb # [ 161.927270] niks3-server[1011]: 2026/09/20 09:34:47 INFO Signed narinfos id=56 count=15928lb # [ 161.932419] niks3-server[1011]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5929lb # [ 161.940424] niks3-server[1011]: 2026/09/20 09:34:47 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5930worker1 # [ 161.966788] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.614Z level=INFO msg="Upload complete. (472ms)"5931lb # [ 161.945238] niks3-server[1011]: 2026/09/20 09:34:47 INFO Completed upload id=565932lb # [ 161.948207] niks3-server[1011]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5933worker1 # [ 161.976241] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=6245934worker1 # [ 161.988003] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785935worker1 # [ 161.993824] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5936worker1 # [ 161.998783] nix-daemon[837]: reaped child process 2012, status = succeeded5937worker1 # [ 162.009641] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5938worker1 # [ 162.639649] nix-daemon[837]: reaped child process 2026, status = succeeded5939worker1 # [ 162.812962] nix-daemon[837]: accepted connection from pid 2041, user nix-grpc-daemon (trusted)5940worker1 # [ 162.829514] nix-daemon[837]: reaped child process 2044, status = succeeded5941lb # [ 162.822017] niks3-server[1011]: 2026/09/20 09:34:48 INFO Received uploads request method=POST path=/api/pending_closures5942worker1 # [ 162.856450] nix-grpc-daemon[1642]: time=2026-09-20T09:34:48.500Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5943worker1 # [ 162.857957] nix-grpc-daemon[1642]: time=2026-09-20T09:34:48.500Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5944lb # [ 162.858320] niks3-server[1011]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5945lb # [ 162.873054] niks3-server[1011]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5946lb # [ 162.885389] niks3-server[1011]: 2026/09/20 09:34:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5947worker1 # [ 162.912713] nix-grpc-daemon[1642]: time=2026-09-20T09:34:48.559Z level=INFO msg="Uploading 1 narinfos"5948lb # [ 162.894891] niks3-server[1011]: 2026/09/20 09:34:48 INFO Signed narinfos id=57 count=15949lb # [ 162.899586] niks3-server[1011]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5950worker1 # [ 162.927748] nix-grpc-daemon[1642]: time=2026-09-20T09:34:48.574Z level=INFO msg="Upload complete. (307ms)"5951lb # [ 162.906801] niks3-server[1011]: 2026/09/20 09:34:48 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5952lb # [ 162.911166] niks3-server[1011]: 2026/09/20 09:34:48 INFO Completed upload id=575953lb # [ 162.913928] niks3-server[1011]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5954worker1 # [ 162.943967] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=15955worker1 # [ 162.959755] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15956worker1 # [ 162.965124] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785957worker1 # [ 162.969742] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05958worker1 # [ 162.974643] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475785959worker1 # [ 162.979196] nix-daemon[837]: reaped child process 2024, status = succeeded5960worker1 # [ 162.982383] nix-grpc-daemon[1642]: time=2026-09-20T09:34:48.629Z level=INFO msg="All 2 paths already cached"5961worker1 # [ 162.989464] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475785962worker1 # [ 162.998672] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5963worker1 # [ 163.186315] nix-daemon[837]: accepted connection from pid 2050, user nix-grpc-daemon (trusted)5964worker1 # [ 163.204920] nix-daemon[837]: reaped child process 2053, status = succeeded5965worker1 # [ 163.382368] nix-daemon[837]: accepted connection from pid 2055, user nix-grpc-daemon (trusted)5966worker1 # [ 163.400337] nix-daemon[837]: reaped child process 2058, status = succeeded5967lb # [ 163.389570] niks3-server[1011]: 2026/09/20 09:34:49 INFO Received uploads request method=POST path=/api/pending_closures5968worker1 # [ 163.420110] nix-grpc-daemon[1642]: time=2026-09-20T09:34:49.067Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5969worker1 # [ 163.422128] nix-grpc-daemon[1642]: time=2026-09-20T09:34:49.067Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5970lb # [ 163.416444] niks3-server[1011]: 2026/09/20 09:34:49 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5971lb # [ 163.430493] niks3-server[1011]: 2026/09/20 09:34:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5972worker1 # [ 163.458459] nix-grpc-daemon[1642]: time=2026-09-20T09:34:49.105Z level=INFO msg="Uploading 1 narinfos"5973lb # [ 163.443033] niks3-server[1011]: 2026/09/20 09:34:49 INFO Signed narinfos id=58 count=15974lb # [ 163.449687] niks3-server[1011]: 2026/09/20 09:34:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5975lb # [ 163.457814] niks3-server[1011]: 2026/09/20 09:34:49 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5976worker1 # [ 163.484158] nix-grpc-daemon[1642]: time=2026-09-20T09:34:49.131Z level=INFO msg="Upload complete. (474ms)"5977lb # [ 163.462704] niks3-server[1011]: 2026/09/20 09:34:49 INFO Completed upload id=585978lb # [ 163.466555] niks3-server[1011]: 2026/09/20 09:34:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5979worker1 # [ 163.492149] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=7525980worker1 # [ 163.502112] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475785981worker1 # [ 163.508580] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5982worker1 # [ 163.513257] nix-daemon[837]: reaped child process 2048, status = succeeded5983worker1 # [ 163.526108] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5984worker1 # [ 164.949582] nix-daemon[837]: reaped child process 2062, status = succeeded5985worker1 # [ 165.114077] nix-daemon[837]: accepted connection from pid 2077, user nix-grpc-daemon (trusted)5986worker1 # [ 165.131483] nix-daemon[837]: reaped child process 2080, status = succeeded5987lb # [ 165.122010] niks3-server[1011]: 2026/09/20 09:34:50 INFO Received uploads request method=POST path=/api/pending_closures5988worker1 # [ 165.155372] nix-grpc-daemon[1642]: time=2026-09-20T09:34:50.801Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5989worker1 # [ 165.157250] nix-grpc-daemon[1642]: time=2026-09-20T09:34:50.801Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5990lb # [ 165.159457] niks3-server[1011]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5991lb # [ 165.175383] niks3-server[1011]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5992worker1 # [ 165.206417] nix-grpc-daemon[1642]: time=2026-09-20T09:34:50.853Z level=INFO msg="Uploading 1 narinfos"5993lb # [ 165.188181] niks3-server[1011]: 2026/09/20 09:34:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5994lb # [ 165.196246] niks3-server[1011]: 2026/09/20 09:34:50 INFO Signed narinfos id=59 count=15995lb # [ 165.202035] niks3-server[1011]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5996worker1 # [ 165.233046] nix-grpc-daemon[1642]: time=2026-09-20T09:34:50.880Z level=INFO msg="Upload complete. (296ms)"5997lb # [ 165.210247] niks3-server[1011]: 2026/09/20 09:34:50 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5998lb # [ 165.217211] niks3-server[1011]: 2026/09/20 09:34:50 INFO Completed upload id=595999lb # [ 165.220843] niks3-server[1011]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6000worker1 # [ 165.245077] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=16001worker1 # [ 165.261931] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:50Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16002worker1 # [ 165.266848] nix-daemon[837]: reaped child process 2060, status = succeeded6003worker1 # [ 165.287451] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475786004worker1 # [ 165.303307] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475786005worker1 # [ 165.318426] nix-grpc-daemon[1642]: time=2026-09-20T09:34:50.965Z level=INFO msg="All 2 paths already cached"6006worker1 # [ 165.327554] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475786007worker1 # [ 165.341802] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)6008worker1 # [ 165.539022] nix-daemon[837]: accepted connection from pid 2084, user nix-grpc-daemon (trusted)6009worker1 # [ 165.557557] nix-daemon[837]: reaped child process 2087, status = succeeded6010worker1 # [ 165.738836] nix-daemon[837]: accepted connection from pid 2089, user nix-grpc-daemon (trusted)6011worker1 # [ 165.756516] nix-daemon[837]: reaped child process 2092, status = succeeded6012lb # [ 165.745807] niks3-server[1011]: 2026/09/20 09:34:51 INFO Received uploads request method=POST path=/api/pending_closures6013worker1 # [ 165.778348] nix-grpc-daemon[1642]: time=2026-09-20T09:34:51.425Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6014worker1 # [ 165.779865] nix-grpc-daemon[1642]: time=2026-09-20T09:34:51.425Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6015lb # [ 165.776484] niks3-server[1011]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6016worker1 # [ 165.810315] nix-grpc-daemon[1642]: time=2026-09-20T09:34:51.457Z level=INFO msg="Uploading 1 narinfos"6017lb # [ 165.791357] niks3-server[1011]: 2026/09/20 09:34:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6018lb # [ 165.801336] niks3-server[1011]: 2026/09/20 09:34:51 INFO Signed narinfos id=60 count=16019worker1 # [ 165.831051] nix-grpc-daemon[1642]: time=2026-09-20T09:34:51.478Z level=INFO msg="Upload complete. (473ms)"6020lb # [ 165.810588] niks3-server[1011]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6021lb # [ 165.815508] niks3-server[1011]: 2026/09/20 09:34:51 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6022lb # [ 165.819809] niks3-server[1011]: 2026/09/20 09:34:51 INFO Completed upload id=606023lb # [ 165.821965] niks3-server[1011]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6024worker1 # [ 165.836453] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=7526025worker1 # [ 165.850769] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475786026worker1 # [ 165.856353] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)6027worker1 # [ 165.860975] nix-daemon[837]: reaped child process 2082, status = succeeded6028worker1 # [ 165.873053] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)6029worker1 # [ 167.501501] nix-daemon[837]: reaped child process 2096, status = succeeded6030worker1 # [ 167.670413] nix-daemon[837]: accepted connection from pid 2111, user nix-grpc-daemon (trusted)6031worker1 # [ 167.688983] nix-daemon[837]: reaped child process 2114, status = succeeded6032lb # [ 167.679345] niks3-server[1011]: 2026/09/20 09:34:53 INFO Received uploads request method=POST path=/api/pending_closures6033worker1 # [ 167.712413] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.357Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6034worker1 # [ 167.713933] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.357Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6035lb # [ 167.718320] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6036lb # [ 167.730548] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6037worker1 # [ 167.764501] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.411Z level=INFO msg="Uploading 1 narinfos"6038lb # [ 167.745660] niks3-server[1011]: 2026/09/20 09:34:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6039lb # [ 167.752923] niks3-server[1011]: 2026/09/20 09:34:53 INFO Signed narinfos id=61 count=16040lb # [ 167.755034] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6041lb # [ 167.762672] niks3-server[1011]: 2026/09/20 09:34:53 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6042lb # [ 167.768355] niks3-server[1011]: 2026/09/20 09:34:53 INFO Completed upload id=616043worker1 # [ 167.790525] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.437Z level=INFO msg="Upload complete. (307ms)"6044lb # [ 167.770667] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6045worker1 # [ 167.801131] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=16046worker1 # [ 167.817780] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:53Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16047worker1 # [ 167.822056] nix-daemon[837]: reaped child process 2094, status = succeeded6048worker1 # [ 167.843068] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475786049worker1 # [ 167.858823] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475786050worker1 # [ 167.874431] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.520Z level=INFO msg="All 2 paths already cached"6051worker1 # [ 167.879940] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475786052worker1 # [ 167.893829] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)6053worker1 # [ 168.090055] nix-daemon[837]: accepted connection from pid 2118, user nix-grpc-daemon (trusted)6054worker1 # [ 168.109557] nix-daemon[837]: reaped child process 2121, status = succeeded6055worker1 # [ 168.283406] nix-daemon[837]: accepted connection from pid 2123, user nix-grpc-daemon (trusted)6056worker1 # [ 168.300796] nix-daemon[837]: reaped child process 2126, status = succeeded6057lb # [ 168.289896] niks3-server[1011]: 2026/09/20 09:34:53 INFO Received uploads request method=POST path=/api/pending_closures6058worker1 # [ 168.321406] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.968Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6059worker1 # [ 168.323029] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.968Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6060lb # [ 168.316660] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6061lb # [ 168.333055] niks3-server[1011]: 2026/09/20 09:34:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6062worker1 # [ 168.360603] nix-grpc-daemon[1642]: time=2026-09-20T09:34:54.007Z level=INFO msg="Uploading 1 narinfos"6063lb # [ 168.345477] niks3-server[1011]: 2026/09/20 09:34:53 INFO Signed narinfos id=62 count=16064lb # [ 168.352610] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6065lb # [ 168.362846] niks3-server[1011]: 2026/09/20 09:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6066lb # [ 168.367890] niks3-server[1011]: 2026/09/20 09:34:54 INFO Completed upload id=626067worker1 # [ 168.389717] nix-grpc-daemon[1642]: time=2026-09-20T09:34:54.036Z level=INFO msg="Upload complete. (480ms)"6068lb # [ 168.370771] niks3-server[1011]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6069worker1 # [ 168.400378] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=7526070worker1 # [ 168.411919] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475786071worker1 # [ 168.421607] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)6072worker1 # [ 168.426108] nix-daemon[837]: reaped child process 2116, status = succeeded6073worker1 # [ 168.438953] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)6074worker1 # [ 169.884264] nix-daemon[837]: reaped child process 2130, status = succeeded6075worker1 # [ 170.062016] nix-daemon[837]: accepted connection from pid 2145, user nix-grpc-daemon (trusted)6076worker1 # [ 170.081962] nix-daemon[837]: reaped child process 2148, status = succeeded6077lb # [ 170.074104] niks3-server[1011]: 2026/09/20 09:34:55 INFO Received uploads request method=POST path=/api/pending_closures6078worker1 # [ 170.105426] nix-grpc-daemon[1642]: time=2026-09-20T09:34:55.752Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6079worker1 # [ 170.108150] nix-grpc-daemon[1642]: time=2026-09-20T09:34:55.754Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6080lb # [ 170.111861] niks3-server[1011]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6081lb # [ 170.123353] niks3-server[1011]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6082lb # [ 170.135241] niks3-server[1011]: 2026/09/20 09:34:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6083worker1 # [ 170.162526] nix-grpc-daemon[1642]: time=2026-09-20T09:34:55.809Z level=INFO msg="Uploading 1 narinfos"6084lb # [ 170.141797] niks3-server[1011]: 2026/09/20 09:34:55 INFO Signed narinfos id=63 count=16085lb # [ 170.147075] niks3-server[1011]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6086lb # [ 170.156412] niks3-server[1011]: 2026/09/20 09:34:55 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6087lb # [ 170.163726] niks3-server[1011]: 2026/09/20 09:34:55 INFO Completed upload id=636088worker1 # [ 170.185356] nix-grpc-daemon[1642]: time=2026-09-20T09:34:55.832Z level=INFO msg="Upload complete. (335ms)"6089lb # [ 170.166610] niks3-server[1011]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6090worker1 # [ 170.201277] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=16091worker1 # [ 170.215284] nix-daemon[837]: reaped child process 2128, status = succeeded6092client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.17 seconds)6093worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6094worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.08 seconds)6095client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16096worker1 # [ 170.602679] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:475786097worker1 # [ 170.612269] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475786098worker1 # [ 170.637264] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:56Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06099client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.32 seconds)6100(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 20.58 seconds)6101subtest: low disk drains a worker and builds go to the other6102worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6103lb # [ 171.446199] envoy[920]: conn peer=[2001:db8:1::1]:48438 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27161 tx=10712 ms=198666104lb # [ 171.446998] envoy[920]: conn peer=[2001:db8:1::1]:50094 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=880 tx=482 ms=556105worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.11 seconds)6106worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6107worker1 # [ 172.233817] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:57Z level=info event=unhealthy reason=min_free6108worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds)6109client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26110worker2 # [ 173.149018] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:474186111client # don't know how to build these paths:6112client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6113worker1 # [ 173.176937] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475786114worker1 # [ 173.203103] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:58Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06115worker1 # [ 173.209203] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:58Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16116worker2 # [ 173.234107] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474186117worker2 # [ 173.251488] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5)6118worker2 # [ 173.344367] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 163 ms (attempt 2/5)6119worker2 # [ 173.507941] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 3/5)6120worker2 # [ 173.531006] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 787 ms (attempt 4/5)6121worker2 # [ 174.327458] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6122worker2 # [ 174.349092] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474186123client # copying 1 paths to 'lb:50051'...6124client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6125worker2 # [ 174.367566] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474186126worker2 # [ 174.383209] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)6127worker2 # [ 174.415485] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:00Z level=info event=niks3_push_started pid=16396128worker2 # [ 174.803702] nix-daemon[840]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6129worker2 # [ 174.822707] nix-daemon[840]: reaped child process 1655, status = succeeded6130worker2 # [ 175.003275] nix-daemon[840]: accepted connection from pid 1657, user nix-grpc-daemon (trusted)6131worker2 # [ 175.020105] nix-daemon[840]: reaped child process 1660, status = succeeded6132lb # [ 175.031531] niks3-server[1011]: 2026/09/20 09:35:00 INFO Received uploads request method=POST path=/api/pending_closures6133worker2 # [ 175.048413] nix-grpc-daemon[1639]: time=2026-09-20T09:35:00.693Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6134worker2 # [ 175.050127] nix-grpc-daemon[1639]: time=2026-09-20T09:35:00.693Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6135lb # [ 175.072138] niks3-server[1011]: 2026/09/20 09:35:00 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6136worker2 # [ 175.089474] nix-grpc-daemon[1639]: time=2026-09-20T09:35:00.736Z level=INFO msg="Uploading 1 narinfos"6137lb # [ 175.084438] niks3-server[1011]: 2026/09/20 09:35:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6138lb # [ 175.092152] niks3-server[1011]: 2026/09/20 09:35:00 INFO Signed narinfos id=64 count=16139lb # [ 175.101570] niks3-server[1011]: 2026/09/20 09:35:00 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6140worker2 # [ 175.120351] nix-grpc-daemon[1639]: time=2026-09-20T09:35:00.767Z level=INFO msg="Upload complete. (490ms)"6141lb # [ 175.114830] niks3-server[1011]: 2026/09/20 09:35:00 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6142lb # [ 175.120966] niks3-server[1011]: 2026/09/20 09:35:00 INFO Completed upload id=646143worker2 # [ 175.127662] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=0 paths=1 nar_bytes_in=5126144lb # [ 175.125069] niks3-server[1011]: 2026/09/20 09:35:00 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6145worker2 # [ 175.143484] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474186146worker2 # [ 175.150168] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)6147worker2 # [ 175.154823] nix-daemon[840]: reaped child process 1637, status = succeeded6148client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6149client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6150worker2 # [ 175.168285] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)6151client # farm-a> LOG-farm-a-drain6152worker2 # [ 176.208292] nix-daemon[840]: reaped child process 1664, status = succeeded6153worker2 # [ 176.388192] nix-daemon[840]: accepted connection from pid 1679, user nix-grpc-daemon (trusted)6154worker2 # [ 176.408678] nix-daemon[840]: reaped child process 1682, status = succeeded6155lb # [ 176.415025] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received uploads request method=POST path=/api/pending_closures6156worker2 # [ 176.432428] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.078Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6157worker2 # [ 176.433958] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.078Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6158lb # [ 176.466540] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6159lb # [ 176.477254] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6160worker2 # [ 176.496197] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.142Z level=INFO msg="Uploading 1 narinfos"6161lb # [ 176.489754] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6162lb # [ 176.497816] niks3-server[1011]: 2026/09/20 09:35:02 INFO Signed narinfos id=65 count=16163lb # [ 176.503714] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6164lb # [ 176.513724] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6165worker2 # [ 176.524697] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.171Z level=INFO msg="Upload complete. (346ms)"6166lb # [ 176.521777] niks3-server[1011]: 2026/09/20 09:35:02 INFO Completed upload id=656167lb # [ 176.523862] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6168worker2 # [ 176.537255] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=16169worker1 # [ 176.562369] nix-grpc-daemon[1568]: ts=2026-09-20T09:35:02Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06170worker1 # [ 176.568414] nix-grpc-daemon[1568]: ts=2026-09-20T09:35:02Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16171worker2 # [ 176.556530] nix-daemon[840]: reaped child process 1662, status = succeeded6172worker2 # [ 176.590452] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474186173worker2 # [ 176.605375] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474186174worker2 # [ 176.619418] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.266Z level=INFO msg="All 1 paths already cached"6175client # copying 1 paths to 'lb:50051'...6176client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6177worker2 # [ 176.629802] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474186178worker2 # [ 176.643942] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)6179worker2 # [ 176.848755] nix-daemon[840]: accepted connection from pid 1686, user nix-grpc-daemon (trusted)6180worker2 # [ 176.867734] nix-daemon[840]: reaped child process 1689, status = succeeded6181worker2 # [ 177.042284] nix-daemon[840]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)6182worker2 # [ 177.059414] nix-daemon[840]: reaped child process 1694, status = succeeded6183lb # [ 177.069256] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received uploads request method=POST path=/api/pending_closures6184worker2 # [ 177.084165] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.731Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6185worker2 # [ 177.085686] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.731Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6186lb # [ 177.106363] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6187worker2 # [ 177.123455] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.770Z level=INFO msg="Uploading 1 narinfos"6188lb # [ 177.122593] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6189lb # [ 177.132141] niks3-server[1011]: 2026/09/20 09:35:02 INFO Signed narinfos id=66 count=16190lb # [ 177.139403] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6191lb # [ 177.146157] niks3-server[1011]: 2026/09/20 09:35:02 INFO Completed upload id=666192worker2 # [ 177.151246] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.798Z level=INFO msg="Upload complete. (490ms)"6193lb # [ 177.152577] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6194worker2 # [ 177.158454] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=0 paths=1 nar_bytes_in=6326195worker2 # [ 177.171460] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.804Z level=WARN msg="Failed to register uploaded object" key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo error="server returned 404: object is not pending upload\n"6196worker2 # [ 177.176068] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474186197worker2 # [ 177.183631] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)6198worker2 # [ 177.186536] nix-daemon[840]: reaped child process 1684, status = succeeded6199client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6200worker2 # [ 177.197391] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)6201client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6202client # farm-b> LOG-farm-b-drain6203worker2 # [ 178.440452] nix-daemon[840]: reaped child process 1698, status = succeeded6204worker2 # [ 178.610441] nix-daemon[840]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6205worker2 # [ 178.628663] nix-daemon[840]: reaped child process 1716, status = succeeded6206lb # [ 178.635703] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received uploads request method=POST path=/api/pending_closures6207worker2 # [ 178.653835] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.299Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6208worker2 # [ 178.655778] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.300Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6209lb # [ 178.672257] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6210lb # [ 178.689417] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6211lb # [ 178.698185] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6212worker2 # [ 178.709033] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.355Z level=INFO msg="Uploading 1 narinfos"6213lb # [ 178.707740] niks3-server[1011]: 2026/09/20 09:35:04 INFO Signed narinfos id=67 count=16214lb # [ 178.714430] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6215lb # [ 178.723698] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6216worker2 # [ 178.735101] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.382Z level=INFO msg="Upload complete. (328ms)"6217lb # [ 178.731838] niks3-server[1011]: 2026/09/20 09:35:04 INFO Completed upload id=676218lb # [ 178.734607] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6219worker1 # [ 178.771400] nix-grpc-daemon[1568]: ts=2026-09-20T09:35:04Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06220worker1 # [ 178.777581] nix-grpc-daemon[1568]: ts=2026-09-20T09:35:04Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16221worker2 # [ 178.746482] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=16222worker2 # [ 178.768941] nix-daemon[840]: reaped child process 1696, status = succeeded6223worker2 # [ 178.802243] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474186224worker2 # [ 178.818783] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474186225worker2 # [ 178.833308] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.480Z level=INFO msg="All 2 paths already cached"6226client # copying 1 paths to 'lb:50051'...6227client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6228worker2 # [ 178.843947] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474186229worker2 # [ 178.857849] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)6230worker2 # [ 179.059955] nix-daemon[840]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6231worker2 # [ 179.078999] nix-daemon[840]: reaped child process 1723, status = succeeded6232worker2 # [ 179.255193] nix-daemon[840]: accepted connection from pid 1725, user nix-grpc-daemon (trusted)6233worker2 # [ 179.271439] nix-daemon[840]: reaped child process 1728, status = succeeded6234lb # [ 179.281405] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received uploads request method=POST path=/api/pending_closures6235worker2 # [ 179.296147] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.943Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6236worker2 # [ 179.297658] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.943Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6237lb # [ 179.310665] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6238worker2 # [ 179.335919] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.982Z level=INFO msg="Uploading 1 narinfos"6239lb # [ 179.324403] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6240lb # [ 179.336955] niks3-server[1011]: 2026/09/20 09:35:04 INFO Signed narinfos id=68 count=16241lb # [ 179.339739] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6242lb # [ 179.351476] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6243lb # [ 179.356499] niks3-server[1011]: 2026/09/20 09:35:05 INFO Completed upload id=686244worker2 # [ 179.361994] nix-grpc-daemon[1639]: time=2026-09-20T09:35:05.009Z level=INFO msg="Upload complete. (487ms)"6245lb # [ 179.359290] niks3-server[1011]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6246worker2 # [ 179.372697] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=0 paths=1 nar_bytes_in=7606247worker2 # [ 179.380359] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474186248worker2 # [ 179.391300] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)6249worker2 # [ 179.393423] nix-daemon[840]: reaped child process 1718, status = succeeded6250client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6251worker2 # [ 179.405156] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)6252client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6253client # farm-top> LOG-farm-top-drain6254worker2 # [ 180.435161] nix-daemon[840]: reaped child process 1732, status = succeeded6255worker2 # [ 180.596384] nix-daemon[840]: accepted connection from pid 1747, user nix-grpc-daemon (trusted)6256worker2 # [ 180.616240] nix-daemon[840]: reaped child process 1750, status = succeeded6257lb # [ 180.623893] niks3-server[1011]: 2026/09/20 09:35:06 INFO Received uploads request method=POST path=/api/pending_closures6258worker2 # [ 180.640674] nix-grpc-daemon[1639]: time=2026-09-20T09:35:06.287Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6259worker2 # [ 180.642162] nix-grpc-daemon[1639]: time=2026-09-20T09:35:06.287Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6260lb # [ 180.669865] niks3-server[1011]: 2026/09/20 09:35:06 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6261lb # [ 180.681978] niks3-server[1011]: 2026/09/20 09:35:06 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6262worker2 # [ 180.695613] nix-grpc-daemon[1639]: time=2026-09-20T09:35:06.342Z level=INFO msg="Uploading 1 narinfos"6263lb # [ 180.695430] niks3-server[1011]: 2026/09/20 09:35:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6264lb # [ 180.705017] niks3-server[1011]: 2026/09/20 09:35:06 INFO Signed narinfos id=69 count=16265worker2 # [ 180.716101] nix-grpc-daemon[1639]: time=2026-09-20T09:35:06.363Z level=INFO msg="Upload complete. (299ms)"6266lb # [ 180.711533] niks3-server[1011]: 2026/09/20 09:35:06 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6267lb # [ 180.718754] niks3-server[1011]: 2026/09/20 09:35:06 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6268worker2 # [ 180.725034] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=16269lb # [ 180.724431] niks3-server[1011]: 2026/09/20 09:35:06 INFO Completed upload id=696270lb # [ 180.727852] niks3-server[1011]: 2026/09/20 09:35:06 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6271worker2 # [ 180.740743] nix-daemon[840]: reaped child process 1730, status = succeeded6272client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.89 seconds)6273client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6274client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds)6275worker1: must succeed: rm /nix/.rw-store/fill6276worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds)6277worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6278lb # [ 181.449277] envoy[920]: conn peer=[2001:db8:1::1]:50084 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9510 tx=3874 ms=76016279worker1 # [ 182.247429] nix-grpc-daemon[1568]: ts=2026-09-20T09:35:07Z level=info event=healthy reason=min_free6280worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6281(finished: subtest: low disk drains a worker and builds go to the other, in 11.74 seconds)6282(finished: run the VM test script, in 183.30 seconds)6283test script finished in 183.60s6284cleanup6285kill QemuMachine (pid 49)6286client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6287kill QemuMachine (pid 50)6288lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6289kill QemuMachine (pid 52)6290worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6291kill QemuMachine (pid 51)6292worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6293(finished: cleanup, in 1.07 seconds)6294additionally exposed symbols:6295 client, lb, worker1, worker2,6296 vlan1,6297 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh