vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #345
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13lb # Disk image does not exist, creating the virtualisation disk image...14worker2: QEMU running (pid 52)15lb # Formatting '/build/vm-state-lb/tmp.AMUOvUO54J', fmt=raw size=107374182416worker2 # Formatting '/build/vm-state-worker2/tmp.S5ce7dWRqT', fmt=raw size=107374182417worker1 # Disk image does not exist, creating the virtualisation disk image...18lb # mke2fs 1.47.4 (6-Mar-2025)19worker2 # mke2fs 1.47.4 (6-Mar-2025)20worker1 # Formatting '/build/vm-state-worker1/tmp.98C5xrCeHS', fmt=raw size=107374182421client # Disk image does not exist, creating the virtualisation disk image...22client: QEMU running (pid 49)23worker1: QEMU running (pid 51)24lb: QEMU running (pid 50)25lb # Discarding device blocks: 0/262144 done26worker1 # mke2fs 1.47.4 (6-Mar-2025)27worker2 # Discarding device blocks: 0/262144 done28client # Formatting '/build/vm-state-client/tmp.7q8PbbfMDP', fmt=raw size=107374182429lb # Creating filesystem with 262144 4k blocks and 65536 inodes30worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes31client # mke2fs 1.47.4 (6-Mar-2025)32lb # Filesystem UUID: 4c7d8b06-bb73-41bc-8960-1f2d360434f133worker2 # Filesystem UUID: 3b572f61-b666-4191-94cd-36fe463a0b3634client # Discarding device blocks: 0/262144 done35lb # Superblock backups stored on blocks:36worker2 # Superblock backups stored on blocks:37client # Creating filesystem with 262144 4k blocks and 65536 inodes38lb # 32768, 98304, 163840, 22937639worker2 # 32768, 98304, 163840, 22937640client # Filesystem UUID: 3a622939-5152-47d5-980c-5cbc2f36a8b341lb # 42worker2 # 43client # Superblock backups stored on blocks:44lb # Allocating group tables: 0/8 done45worker2 # Allocating group tables: 0/8 done46client # 32768, 98304, 163840, 22937647lb # Writing inode tables: 0/8 done48worker2 # Writing inode tables: 0/8 done49client # 50lb # Creating journal (8192 blocks): done51worker2 # Creating journal (8192 blocks): done52client # Allocating group tables: 0/8 done53lb # Writing superblocks and filesystem accounting information: 0/8 done54worker2 # Writing superblocks and filesystem accounting information: 0/8 done55client # Writing inode tables: 0/8 done56lb # 57worker2 # 58client # Creating journal (8192 blocks): done59lb # Virtualisation disk image created.60worker2 # Virtualisation disk image created.61client # Writing superblocks and filesystem accounting information: 0/8 done62worker1 # Discarding device blocks: 0/262144 done63client # 64worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes65client # Virtualisation disk image created.66worker1 # Filesystem UUID: 8ba644f8-ddc5-46a7-a81c-1c986c8bdb5467(finished: start all VMs, in 0.91 seconds)68worker1 # Superblock backups stored on blocks:69client: waiting for unit network-addresses-eth1.service70worker1 # 32768, 98304, 163840, 22937671client: waiting for the VM to finish booting72worker1 # 73worker1 # Allocating group tables: 0/8 done74worker1 # Writing inode tables: 0/8 done75worker1 # Creating journal (8192 blocks): done76worker1 # Writing superblocks and filesystem accounting information: 0/8 done77worker1 # 78worker1 # Virtualisation disk image created.79lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681lb # [ 0.000000] KASLR enabled82lb # [ 0.000000] random: crng init done83lb # [ 0.000000] Machine model: linux,dummy-virt84lb # [ 0.000000] efi: UEFI not found.85lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88lb # [ 0.000000] Zone ranges:89lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90lb # [ 0.000000] DMA32 empty91lb # [ 0.000000] Normal empty92lb # [ 0.000000] Device empty93lb # [ 0.000000] Movable zone start for each node94lb # [ 0.000000] Early memory node ranges95lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098lb # [ 0.000000] psci: probing for conduit method from DT.99lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.100client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]101lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs102lb # [ 0.000000] psci: Trusted OS migration not required103client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026104lb # [ 0.000000] psci: SMC Calling Convention v1.1105client # [ 0.000000] KASLR enabled106client # [ 0.000000] random: crng init done107lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)108client # [ 0.000000] Machine model: linux,dummy-virt109client # [ 0.000000] efi: UEFI not found.110lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296111client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT112lb # [ 0.000000] Detected PIPT I-cache on CPU0113client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]114lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)115client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]116lb # [ 0.000000] CPU features: detected: GICv3 CPU interface117client # [ 0.000000] Zone ranges:118lb # [ 0.000000] CPU features: detected: Spectre-v4119client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]120lb # [ 0.000000] CPU features: detected: Spectre-BHB121client # [ 0.000000] DMA32 empty122client # [ 0.000000] Normal empty123lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38124client # [ 0.000000] Device empty125client # [ 0.000000] Movable zone start for each node126lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23127client # [ 0.000000] Early memory node ranges128lb # [ 0.000000] alternatives: applying boot alternatives129client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]130client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]131client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000132client # [ 0.000000] psci: probing for conduit method from DT.133client # [ 0.000000] psci: PSCIv1.3 detected in firmware.134client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs135lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty0136client # [ 0.000000] psci: Trusted OS migration not required137client # [ 0.000000] psci: SMC Calling Convention v1.1138worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]139client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)140lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space.141client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296142worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026143client # [ 0.000000] Detected PIPT I-cache on CPU0144worker2 # [ 0.000000] KASLR enabled145lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes146worker2 # [ 0.000000] random: crng init done147client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)148worker2 # [ 0.000000] Machine model: linux,dummy-virt149lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)150worker2 # [ 0.000000] efi: UEFI not found.151client # [ 0.000000] CPU features: detected: GICv3 CPU interface152client # [ 0.000000] CPU features: detected: Spectre-v4153lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)154worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT155client # [ 0.000000] CPU features: detected: Spectre-BHB156lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB157worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]158client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38159lb # [ 0.000000] software IO TLB: area num 1.160worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]161client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23162worker2 # [ 0.000000] Zone ranges:163lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB164client # [ 0.000000] alternatives: applying boot alternatives165worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]166lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)167worker2 # [ 0.000000] DMA32 empty168worker2 # [ 0.000000] Normal empty169lb # [ 0.000000] Fallback order for Node 0: 0170worker2 # [ 0.000000] Device empty171worker2 # [ 0.000000] Movable zone start for each node172lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216173lb # [ 0.000000] Policy zone: DMA174worker2 # [ 0.000000] Early memory node ranges175lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off176worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]177lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1178client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vjqwk0w01cvrc7s0v48m3lmih9i5s8yp-nixos-system-client-test/init regInfo=/nix/store/1014gcc8vm0ydc1b8g1pnhswd2qhvga4-closure-info/registration console=ttyAMA0,115200n8 console=tty0179worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]180lb # [ 0.000000] allocated 3145728 bytes of page_ext181worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000182lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages183worker2 # [ 0.000000] psci: probing for conduit method from DT.184lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups185client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/1014gcc8vm0ydc1b8g1pnhswd2qhvga4-closure-info/registration", will be passed to user space.186worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.187lb # [ 0.000000] rcu: Hierarchical RCU implementation.188worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs189client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes190worker2 # [ 0.000000] psci: Trusted OS migration not required191client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)192worker2 # [ 0.000000] psci: SMC Calling Convention v1.1193client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)194worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)195lb # [ 0.000000] rcu: RCU event tracing is enabled.196lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.197lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.198lb # [ 0.000000] Rude variant of Tasks RCU enabled.199lb # [ 0.000000] Tracing variant of Tasks RCU enabled.200client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB201worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296202client # [ 0.000000] software IO TLB: area num 1.203worker2 # [ 0.000000] Detected PIPT I-cache on CPU0204lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.205client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB206lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1207worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)208client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)209worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface210client # [ 0.000000] Fallback order for Node 0: 0211lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.212worker2 # [ 0.000000] CPU features: detected: Spectre-v4213worker2 # [ 0.000000] CPU features: detected: Spectre-BHB214client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216215lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.216client # [ 0.000000] Policy zone: DMA217worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38218client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off219lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.220worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23221client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1222worker2 # [ 0.000000] alternatives: applying boot alternatives223lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0224client # [ 0.000000] allocated 3145728 bytes of page_ext225lb # [ 0.000000] GICv3: 256 SPIs implemented226lb # [ 0.000000] GICv3: 0 Extended SPIs implemented227client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages228worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]229lb # [ 0.000000] Root IRQ handler: gic_handle_irq230client # [ 0.000000] ftrace: allocated 294 pages with 4 groups231lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI232client # [ 0.000000] rcu: Hierarchical RCU implementation.233lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0234client # [ 0.000000] rcu: RCU event tracing is enabled.235worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026236worker1 # [ 0.000000] KASLR enabled237lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000238client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.239worker1 # [ 0.000000] random: crng init done240worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5pw6fnvwaf9lkcgs5rfp8j5wx00ap0rn-nixos-system-worker2-test/init regInfo=/nix/store/pka1z0bf00479w25dzm2g81g6w34m1zm-closure-info/registration console=ttyAMA0,115200n8 console=tty0241lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]242client # [ 0.000000] Trampoline variant of Tasks RCU enabled.243worker1 # [ 0.000000] Machine model: linux,dummy-virt244worker1 # [ 0.000000] efi: UEFI not found.245client # [ 0.000000] Rude variant of Tasks RCU enabled.246lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)247client # [ 0.000000] Tracing variant of Tasks RCU enabled.248worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT249worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/pka1z0bf00479w25dzm2g81g6w34m1zm-closure-info/registration", will be passed to user space.250client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.251worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]252worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes253lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)254client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1255worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]256lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000257worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)258worker1 # [ 0.000000] Zone ranges:259lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000260client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.261worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)262worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]263worker1 # [ 0.000000] DMA32 empty264lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.265worker1 # [ 0.000000] Normal empty266worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB267client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.268worker1 # [ 0.000000] Device empty269worker2 # [ 0.000000] software IO TLB: area num 1.270worker1 # [ 0.000000] Movable zone start for each node271lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns272client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.273worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB274worker1 # [ 0.000000] Early memory node ranges275lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).276client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0277worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]278worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)279client # [ 0.000000] GICv3: 256 SPIs implemented280worker2 # [ 0.000000] Fallback order for Node 0: 0281worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]282client # [ 0.000000] GICv3: 0 Extended SPIs implemented283lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns284client # [ 0.000000] Root IRQ handler: gic_handle_irq285worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216286worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000287worker2 # [ 0.000000] Policy zone: DMA288lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns289worker1 # [ 0.000000] psci: probing for conduit method from DT.290client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI291lb # [ 0.000048] arm-pv: using stolen time PV292worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off293worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.294client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0295worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs296client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000297worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1298lb # [ 0.001278] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)299client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]300worker1 # [ 0.000000] psci: Trusted OS migration not required301worker2 # [ 0.000000] allocated 3145728 bytes of page_ext302lb # [ 0.001486] Console: colour dummy device 80x25303worker1 # [ 0.000000] psci: SMC Calling Convention v1.1304worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages305lb # [ 0.001494] printk: legacy console [tty0] enabled306client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)307worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups308worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)309worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.310lb # [ 0.001703] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)311client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)312worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296313worker2 # [ 0.000000] rcu: RCU event tracing is enabled.314lb # [ 0.001710] pid_max: default: 32768 minimum: 301315worker1 # [ 0.000000] Detected PIPT I-cache on CPU0316client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000317worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.318lb # [ 0.001786] LSM: initializing lsm=capability,landlock,yama,bpf,ima319worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.320client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000321worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)322lb # [ 0.001942] landlock: Up and running.323lb # [ 0.001945] Yama: becoming mindful.324worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.325worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface326client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.327lb # [ 0.002567] LSM support for eBPF active328worker1 # [ 0.000000] CPU features: detected: Spectre-v4329worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.330worker1 # [ 0.000000] CPU features: detected: Spectre-BHB331lb # [ 0.002778] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)332worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.333client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns334worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38335lb # [ 0.002811] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)336client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).337worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1338worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23339lb # [ 0.003895] cacheinfo: Unable to detect cache hierarchy for CPU 0340worker1 # [ 0.000000] alternatives: applying boot alternatives341worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.342lb # [ 0.004805] rcu: Hierarchical SRCU implementation.343client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns344lb # [ 0.004810] rcu: Max phase no-delay instances is 1000.345worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.346client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns347lb # [ 0.006088] fsl-mc MSI: its@8080000 domain created348client # [ 0.000038] arm-pv: using stolen time PV349lb # [ 0.006192] EFI services will not be available.350worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.351lb # [ 0.006270] smp: Bringing up secondary CPUs ...352worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0353client # [ 0.000784] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)354lb # [ 0.006279] smp: Brought up 1 node, 1 CPU355worker2 # [ 0.000000] GICv3: 256 SPIs implemented356client # [ 0.000982] Console: colour dummy device 80x25357lb # [ 0.006283] SMP: Total of 1 processors activated.358worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9gg6bqj6936y7fn6kvx26f1n44j8gpbl-nixos-system-worker1-test/init regInfo=/nix/store/r8kflbsh1zmif219y6bjg8z5vag6dy1v-closure-info/registration console=ttyAMA0,115200n8 console=tty0359worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented360client # [ 0.000990] printk: legacy console [tty0] enabled361lb # [ 0.006289] CPU: All CPU(s) started at EL1362worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq363lb # [ 0.006301] CPU features: detected: Branch Target Identification364worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI365client # [ 0.001190] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)366worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/r8kflbsh1zmif219y6bjg8z5vag6dy1v-closure-info/registration", will be passed to user space.367lb # [ 0.006306] CPU features: detected: ARMv8.4 Translation Table Level368worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0369client # [ 0.001197] pid_max: default: 32768 minimum: 301370worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes371worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000372client # [ 0.001279] LSM: initializing lsm=capability,landlock,yama,bpf,ima373lb # [ 0.006309] CPU features: detected: Instruction cache invalidation not required for I/D coherence374worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]375client # [ 0.001467] landlock: Up and running.376worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)377client # [ 0.001469] Yama: becoming mindful.378lb # [ 0.006313] CPU features: detected: Data cache clean to the PoU not required for I/D coherence379client # [ 0.002238] LSM support for eBPF active380worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)381worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)382lb # [ 0.006317] CPU features: detected: Common not Private translations383client # [ 0.002403] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)384worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB385lb # [ 0.006320] CPU features: detected: CRC32 instructions386worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)387worker1 # [ 0.000000] software IO TLB: area num 1.388client # [ 0.002436] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)389lb # [ 0.006322] CPU features: detected: Data cache clean to Point of Deep Persistence390worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000391worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB392client # [ 0.003662] cacheinfo: Unable to detect cache hierarchy for CPU 0393lb # [ 0.006326] CPU features: detected: Data cache clean to Point of Persistence394worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000395client # [ 0.004562] rcu: Hierarchical SRCU implementation.396worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)397worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.398lb # [ 0.006329] CPU features: detected: Data independent timing control (DIT)399client # [ 0.004569] rcu: Max phase no-delay instances is 1000.400worker1 # [ 0.000000] Fallback order for Node 0: 0401client # [ 0.005766] fsl-mc MSI: its@8080000 domain created402lb # [ 0.006332] CPU features: detected: E0PD403worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216404client # [ 0.005859] EFI services will not be available.405worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns406worker1 # [ 0.000000] Policy zone: DMA407lb # [ 0.006335] CPU features: detected: Enhanced Counter Virtualization408client # [ 0.005936] smp: Bringing up secondary CPUs ...409worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).410lb # [ 0.006338] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)411worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off412client # [ 0.005946] smp: Brought up 1 node, 1 CPU413client # [ 0.005950] SMP: Total of 1 processors activated.414lb # [ 0.006341] CPU features: detected: Enhanced Virtualization Traps415worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1416client # [ 0.005955] CPU: All CPU(s) started at EL1417worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns418worker1 # [ 0.000000] allocated 3145728 bytes of page_ext419lb # [ 0.006344] CPU features: detected: Fine Grained Traps420client # [ 0.005968] CPU features: detected: Branch Target Identification421worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages422worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns423lb # [ 0.006348] CPU features: detected: Generic authentication (architected QARMA5 algorithm)424client # [ 0.005973] CPU features: detected: ARMv8.4 Translation Table Level425worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups426worker2 # [ 0.000036] arm-pv: using stolen time PV427lb # [ 0.006354] CPU features: detected: RCpc load-acquire (LDAPR)428worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.429client # [ 0.005976] CPU features: detected: Instruction cache invalidation not required for I/D coherence430worker1 # [ 0.000000] rcu: RCU event tracing is enabled.431lb # [ 0.006357] CPU features: detected: LSE atomic instructions432worker2 # [ 0.000846] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)433worker2 # [ 0.001027] Console: colour dummy device 80x25434lb # [ 0.006360] CPU features: detected: Privileged Access Never435worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.436client # [ 0.005980] CPU features: detected: Data cache clean to the PoU not required for I/D coherence437lb # [ 0.006362] CPU features: detected: PMUv3438worker2 # [ 0.001036] printk: legacy console [tty0] enabled439worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.440client # [ 0.005984] CPU features: detected: Common not Private translations441lb # [ 0.006365] CPU features: detected: RAS Extension Support442worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.443client # [ 0.005987] CPU features: detected: CRC32 instructions444worker2 # [ 0.001268] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)445lb # [ 0.006368] CPU features: detected: RASv1p1 Extension Support446worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.447worker2 # [ 0.001275] pid_max: default: 32768 minimum: 301448lb # [ 0.006370] CPU features: detected: Random Number Generator449client # [ 0.005990] CPU features: detected: Data cache clean to Point of Deep Persistence450worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.451worker2 # [ 0.001356] LSM: initializing lsm=capability,landlock,yama,bpf,ima452lb # [ 0.006373] CPU features: detected: Speculation barrier (SB)453client # [ 0.005993] CPU features: detected: Data cache clean to Point of Persistence454worker2 # [ 0.001506] landlock: Up and running.455worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1456lb # [ 0.006376] CPU features: detected: Stage-2 Force Write-Back457worker2 # [ 0.001508] Yama: becoming mindful.458client # [ 0.005996] CPU features: detected: Data independent timing control (DIT)459worker2 # [ 0.002115] LSM support for eBPF active460lb # [ 0.006379] CPU features: detected: TLB range maintenance instructions461client # [ 0.005999] CPU features: detected: E0PD462worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.463worker2 # [ 0.002281] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)464client # [ 0.006001] CPU features: detected: Enhanced Counter Virtualization465lb # [ 0.006384] CPU features: detected: Speculative Store Bypassing Safe (SSBS)466worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.467lb # [ 0.006424] alternatives: applying system-wide alternatives468worker2 # [ 0.002321] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)469client # [ 0.006004] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)470worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.471lb # [ 0.009541] CPU features: detected: BBM Level 2 without TLB conflict abort472client # [ 0.006008] CPU features: detected: Enhanced Virtualization Traps473worker2 # [ 0.003498] cacheinfo: Unable to detect cache hierarchy for CPU 0474worker2 # [ 0.004265] rcu: Hierarchical SRCU implementation.475worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0476client # [ 0.006011] CPU features: detected: Fine Grained Traps477worker1 # [ 0.000000] GICv3: 256 SPIs implemented478worker2 # [ 0.004270] rcu: Max phase no-delay instances is 1000.479client # [ 0.006014] CPU features: detected: Generic authentication (architected QARMA5 algorithm)480worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented481worker2 # [ 0.005559] fsl-mc MSI: its@8080000 domain created482lb # [ 0.009716] Memory: 1406756K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)483lb # [ 0.010175] devtmpfs: initialized484worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq485worker2 # [ 0.005653] EFI services will not be available.486client # [ 0.006020] CPU features: detected: RCpc load-acquire (LDAPR)487worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI488worker2 # [ 0.005742] smp: Bringing up secondary CPUs ...489client # [ 0.006023] CPU features: detected: LSE atomic instructions490lb # [ 0.012074] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)491worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0492worker2 # [ 0.005752] smp: Brought up 1 node, 1 CPU493client # [ 0.006026] CPU features: detected: Privileged Access Never494worker2 # [ 0.005755] SMP: Total of 1 processors activated.495lb # [ 0.012098] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).496worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000497client # [ 0.006028] CPU features: detected: PMUv3498worker2 # [ 0.005762] CPU: All CPU(s) started at EL1499worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]500lb # [ 0.012329] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL501client # [ 0.006031] CPU features: detected: RAS Extension Support502worker2 # [ 0.005773] CPU features: detected: Branch Target Identification503lb # [ 0.012334] 0 pages in range for non-PLT usage504client # [ 0.006034] CPU features: detected: RASv1p1 Extension Support505worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)506worker2 # [ 0.005778] CPU features: detected: ARMv8.4 Translation Table Level507lb # [ 0.012335] 508288 pages in range for PLT usage508client # [ 0.006036] CPU features: detected: Random Number Generator509lb # [ 0.012466] pinctrl core: initialized pinctrl subsystem510worker2 # [ 0.005781] CPU features: detected: Instruction cache invalidation not required for I/D coherence511client # [ 0.006039] CPU features: detected: Speculation barrier (SB)512lb # [ 0.013264] DMI not present or invalid.513worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)514client # [ 0.006042] CPU features: detected: Stage-2 Force Write-Back515lb # [ 0.017376] NET: Registered PF_NETLINK/PF_ROUTE protocol family516worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000517worker2 # [ 0.005785] CPU features: detected: Data cache clean to the PoU not required for I/D coherence518client # [ 0.006045] CPU features: detected: TLB range maintenance instructions519lb # [ 0.019791] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations520worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000521worker2 # [ 0.005789] CPU features: detected: Common not Private translations522client # [ 0.006050] CPU features: detected: Speculative Store Bypassing Safe (SSBS)523worker2 # [ 0.005792] CPU features: detected: CRC32 instructions524worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.525lb # [ 0.019970] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations526client # [ 0.006095] alternatives: applying system-wide alternatives527worker2 # [ 0.005794] CPU features: detected: Data cache clean to Point of Deep Persistence528lb # [ 0.020196] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations529client # [ 0.009231] CPU features: detected: BBM Level 2 without TLB conflict abort530worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns531worker2 # [ 0.005798] CPU features: detected: Data cache clean to Point of Persistence532lb # [ 0.020224] audit: initializing netlink subsys (disabled)533worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).534worker2 # [ 0.005801] CPU features: detected: Data independent timing control (DIT)535lb # [ 0.021249] thermal_sys: Registered thermal governor 'fair_share'536client # [ 0.009439] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)537worker2 # [ 0.005804] CPU features: detected: E0PD538lb # [ 0.021251] thermal_sys: Registered thermal governor 'bang_bang'539worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns540client # [ 0.009907] devtmpfs: initialized541worker2 # [ 0.005807] CPU features: detected: Enhanced Counter Virtualization542lb # [ 0.021254] thermal_sys: Registered thermal governor 'step_wise'543client # [ 0.011839] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)544worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns545worker2 # [ 0.005810] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)546lb # [ 0.021260] thermal_sys: Registered thermal governor 'user_space'547worker1 # [ 0.000031] arm-pv: using stolen time PV548client # [ 0.011865] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).549worker2 # [ 0.005814] CPU features: detected: Enhanced Virtualization Traps550lb # [ 0.021263] thermal_sys: Registered thermal governor 'power_allocator'551worker2 # [ 0.005816] CPU features: detected: Fine Grained Traps552client # [ 0.012080] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL553worker1 # [ 0.000434] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)554lb # [ 0.021289] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1555worker1 # [ 0.000625] Console: colour dummy device 80x25556client # [ 0.012086] 0 pages in range for non-PLT usage557lb # [ 0.021300] cpuidle: using governor ladder558worker2 # [ 0.005820] CPU features: detected: Generic authentication (architected QARMA5 algorithm)559client # [ 0.012087] 508288 pages in range for PLT usage560worker1 # [ 0.000633] printk: legacy console [tty0] enabled561lb # [ 0.021306] cpuidle: using governor menu562worker2 # [ 0.005825] CPU features: detected: RCpc load-acquire (LDAPR)563client # [ 0.012210] pinctrl core: initialized pinctrl subsystem564client # [ 0.013046] DMI not present or invalid.565worker2 # [ 0.005828] CPU features: detected: LSE atomic instructions566lb # [ 0.021501] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.567worker1 # [ 0.000831] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)568lb # [ 0.021517] ASID allocator initialised with 65536 entries569worker2 # [ 0.005831] CPU features: detected: Privileged Access Never570client # [ 0.016969] NET: Registered PF_NETLINK/PF_ROUTE protocol family571worker1 # [ 0.000838] pid_max: default: 32768 minimum: 301572worker2 # [ 0.005834] CPU features: detected: PMUv3573worker1 # [ 0.000921] LSM: initializing lsm=capability,landlock,yama,bpf,ima574lb # [ 0.022811] Serial: AMBA PL011 UART driver575client # [ 0.020318] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations576worker2 # [ 0.005837] CPU features: detected: RAS Extension Support577worker1 # [ 0.001050] landlock: Up and running.578lb # [ 0.028327] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1579worker1 # [ 0.001052] Yama: becoming mindful.580client # [ 0.020529] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations581worker2 # [ 0.005840] CPU features: detected: RASv1p1 Extension Support582lb # [ 0.028464] printk: console [ttyAMA0] enabled583worker1 # [ 0.001510] LSM support for eBPF active584worker2 # [ 0.005842] CPU features: detected: Random Number Generator585client # [ 0.020762] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations586worker1 # [ 0.001633] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)587worker2 # [ 0.005845] CPU features: detected: Speculation barrier (SB)588client # [ 0.020807] audit: initializing netlink subsys (disabled)589worker2 # [ 0.005848] CPU features: detected: Stage-2 Force Write-Back590worker1 # [ 0.001695] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)591client # [ 0.021272] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1592worker2 # [ 0.005851] CPU features: detected: TLB range maintenance instructions593worker1 # [ 0.002883] cacheinfo: Unable to detect cache hierarchy for CPU 0594client # [ 0.021465] thermal_sys: Registered thermal governor 'fair_share'595worker1 # [ 0.004132] rcu: Hierarchical SRCU implementation.596worker2 # [ 0.005856] CPU features: detected: Speculative Store Bypassing Safe (SSBS)597client # [ 0.021467] thermal_sys: Registered thermal governor 'bang_bang'598worker1 # [ 0.004138] rcu: Max phase no-delay instances is 1000.599worker2 # [ 0.005896] alternatives: applying system-wide alternatives600client # [ 0.021473] thermal_sys: Registered thermal governor 'step_wise'601worker1 # [ 0.005354] fsl-mc MSI: its@8080000 domain created602worker2 # [ 0.008997] CPU features: detected: BBM Level 2 without TLB conflict abort603worker1 # [ 0.005447] EFI services will not be available.604worker1 # [ 0.005517] smp: Bringing up secondary CPUs ...605worker1 # [ 0.005526] smp: Brought up 1 node, 1 CPU606worker2 # [ 0.009222] Memory: 1406580K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)607worker1 # [ 0.005533] SMP: Total of 1 processors activated.608worker2 # [ 0.009685] devtmpfs: initialized609client # [ 0.021476] thermal_sys: Registered thermal governor 'user_space'610worker1 # [ 0.005539] CPU: All CPU(s) started at EL1611client # [ 0.021479] thermal_sys: Registered thermal governor 'power_allocator'612worker2 # [ 0.011623] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)613worker1 # [ 0.005552] CPU features: detected: Branch Target Identification614client # [ 0.021511] cpuidle: using governor ladder615worker1 # [ 0.005557] CPU features: detected: ARMv8.4 Translation Table Level616client # [ 0.021518] cpuidle: using governor menu617worker2 # [ 0.011647] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).618worker2 # [ 0.011836] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL619client # [ 0.021721] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.620worker1 # [ 0.005560] CPU features: detected: Instruction cache invalidation not required for I/D coherence621worker2 # [ 0.011841] 0 pages in range for non-PLT usage622client # [ 0.021738] ASID allocator initialised with 65536 entries623worker2 # [ 0.011842] 508288 pages in range for PLT usage624client # [ 0.023086] Serial: AMBA PL011 UART driver625worker1 # [ 0.005563] CPU features: detected: Data cache clean to the PoU not required for I/D coherence626worker2 # [ 0.011970] pinctrl core: initialized pinctrl subsystem627worker1 # [ 0.005567] CPU features: detected: Common not Private translations628client # [ 0.028648] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1629lb # [ 0.152058] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages630worker2 # [ 0.012793] DMI not present or invalid.631worker1 # [ 0.005570] CPU features: detected: CRC32 instructions632client # [ 0.028838] printk: console [ttyAMA0] enabled633lb # [ 0.152085] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page634worker2 # [ 0.016140] NET: Registered PF_NETLINK/PF_ROUTE protocol family635worker1 # [ 0.005573] CPU features: detected: Data cache clean to Point of Deep Persistence636lb # [ 0.152090] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages637worker2 # [ 0.018541] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations638worker1 # [ 0.005577] CPU features: detected: Data cache clean to Point of Persistence639lb # [ 0.152095] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page640worker2 # [ 0.018733] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations641worker1 # [ 0.005580] CPU features: detected: Data independent timing control (DIT)642lb # [ 0.152099] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages643worker2 # [ 0.018943] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations644worker1 # [ 0.005583] CPU features: detected: E0PD645lb # [ 0.152103] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page646worker2 # [ 0.018970] audit: initializing netlink subsys (disabled)647worker1 # [ 0.005585] CPU features: detected: Enhanced Counter Virtualization648lb # [ 0.152108] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages649worker2 # [ 0.020650] thermal_sys: Registered thermal governor 'fair_share'650worker1 # [ 0.005588] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)651lb # [ 0.152113] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page652worker2 # [ 0.020652] thermal_sys: Registered thermal governor 'bang_bang'653worker1 # [ 0.005591] CPU features: detected: Enhanced Virtualization Traps654worker1 # [ 0.005594] CPU features: detected: Fine Grained Traps655client # [ 0.146648] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages656worker1 # [ 0.005598] CPU features: detected: Generic authentication (architected QARMA5 algorithm)657client # [ 0.146670] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page658lb # [ 0.159687] fbcon: Taking over console659worker2 # [ 0.020656] thermal_sys: Registered thermal governor 'step_wise'660worker1 # [ 0.005603] CPU features: detected: RCpc load-acquire (LDAPR)661lb # [ 0.159706] ACPI: Interpreter disabled.662client # [ 0.146676] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages663worker2 # [ 0.020661] thermal_sys: Registered thermal governor 'user_space'664worker1 # [ 0.005606] CPU features: detected: LSE atomic instructions665client # [ 0.146680] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page666worker1 # [ 0.005609] CPU features: detected: Privileged Access Never667worker2 # [ 0.020664] thermal_sys: Registered thermal governor 'power_allocator'668worker1 # [ 0.005612] CPU features: detected: PMUv3669client # [ 0.146684] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages670worker2 # [ 0.020692] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1671client # [ 0.146689] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page672worker2 # [ 0.020701] cpuidle: using governor ladder673worker2 # [ 0.020707] cpuidle: using governor menu674client # [ 0.146693] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages675worker2 # [ 0.020907] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.676client # [ 0.146698] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page677worker1 # [ 0.005615] CPU features: detected: RAS Extension Support678worker1 # [ 0.005618] CPU features: detected: RASv1p1 Extension Support679worker2 # [ 0.020925] ASID allocator initialised with 65536 entries680worker2 # [ 0.022184] Serial: AMBA PL011 UART driver681worker1 # [ 0.005620] CPU features: detected: Random Number Generator682worker1 # [ 0.005623] CPU features: detected: Speculation barrier (SB)683worker2 # [ 0.027595] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1684client # [ 0.154100] fbcon: Taking over console685worker1 # [ 0.005626] CPU features: detected: Stage-2 Force Write-Back686worker2 # [ 0.027741] printk: console [ttyAMA0] enabled687client # [ 0.154120] ACPI: Interpreter disabled.688worker1 # [ 0.005629] CPU features: detected: TLB range maintenance instructions689worker1 # [ 0.005634] CPU features: detected: Speculative Store Bypassing Safe (SSBS)690lb # [ 0.168837] iommu: Default domain type: Translated691worker1 # [ 0.005696] alternatives: applying system-wide alternatives692lb # [ 0.168850] iommu: DMA domain TLB invalidation policy: strict mode693worker1 # [ 0.008720] CPU features: detected: BBM Level 2 without TLB conflict abort694lb # [ 0.170604] SCSI subsystem initialized695worker1 # [ 0.008944] Memory: 1406512K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)696lb # [ 0.171305] usbcore: registered new interface driver usbfs697worker1 # [ 0.009365] devtmpfs: initialized698lb # [ 0.171336] usbcore: registered new interface driver hub699worker1 # [ 0.011273] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)700lb # [ 0.171354] usbcore: registered new device driver usb701lb # [ 0.171678] pps_core: LinuxPPS API ver. 1 registered702worker1 # [ 0.011297] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).703lb # [ 0.171684] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>704worker1 # [ 0.011492] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL705lb # [ 0.171694] PTP clock support registered706worker1 # [ 0.011497] 0 pages in range for non-PLT usage707client # [ 0.163187] iommu: Default domain type: Translated708lb # [ 0.171745] EDAC MC: Ver: 3.0.0709worker1 # [ 0.011498] 508288 pages in range for PLT usage710client # [ 0.163201] iommu: DMA domain TLB invalidation policy: strict mode711worker2 # [ 0.148571] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages712lb # [ 0.176467] scmi_core: SCMI protocol bus registered713worker1 # [ 0.011619] pinctrl core: initialized pinctrl subsystem714client # [ 0.163600] SCSI subsystem initialized715worker1 # [ 0.012352] DMI not present or invalid.716worker2 # [ 0.148597] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page717worker1 # [ 0.015579] NET: Registered PF_NETLINK/PF_ROUTE protocol family718lb # [ 0.177465] FPGA manager framework719worker2 # [ 0.148602] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages720client # [ 0.165583] usbcore: registered new interface driver usbfs721worker1 # [ 0.018857] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations722worker2 # [ 0.148607] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page723client # [ 0.165620] usbcore: registered new interface driver hub724client # [ 0.165638] usbcore: registered new device driver usb725worker1 # [ 0.019058] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations726worker2 # [ 0.148611] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages727client # [ 0.165921] pps_core: LinuxPPS API ver. 1 registered728worker2 # [ 0.148616] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page729worker1 # [ 0.019268] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations730client # [ 0.165930] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>731worker1 # [ 0.019302] audit: initializing netlink subsys (disabled)732worker2 # [ 0.148620] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages733client # [ 0.165940] PTP clock support registered734worker1 # [ 0.019971] thermal_sys: Registered thermal governor 'fair_share'735worker2 # [ 0.148624] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page736client # [ 0.165988] EDAC MC: Ver: 3.0.0737worker1 # [ 0.019973] thermal_sys: Registered thermal governor 'bang_bang'738lb # [ 0.183026] vgaarb: loaded739client # [ 0.170585] scmi_core: SCMI protocol bus registered740worker1 # [ 0.019977] thermal_sys: Registered thermal governor 'step_wise'741worker1 # [ 0.019982] thermal_sys: Registered thermal governor 'user_space'742client # [ 0.171587] FPGA manager framework743client # [ 0.172597] vgaarb: loaded744lb # [ 0.183705] clocksource: Switched to clocksource arch_sys_counter745worker1 # [ 0.019985] thermal_sys: Registered thermal governor 'power_allocator'746lb # [ 0.184407] VFS: Disk quotas dquot_6.6.0747worker2 # [ 0.156699] fbcon: Taking over console748client # [ 0.173269] clocksource: Switched to clocksource arch_sys_counter749worker2 # [ 0.156718] ACPI: Interpreter disabled.750worker1 # [ 0.020011] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1751lb # [ 0.184447] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)752worker1 # [ 0.020020] cpuidle: using governor ladder753worker1 # [ 0.020026] cpuidle: using governor menu754lb # [ 0.186796] netfs: FS-Cache loaded755lb # [ 0.186924] pnp: PnP ACPI: disabled756worker1 # [ 0.020241] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.757worker1 # [ 0.020259] ASID allocator initialised with 65536 entries758worker1 # [ 0.021515] Serial: AMBA PL011 UART driver759worker1 # [ 0.026918] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1760worker1 # [ 0.027065] printk: console [ttyAMA0] enabled761client # [ 0.178250] VFS: Disk quotas dquot_6.6.0762client # [ 0.178290] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)763worker2 # [ 0.164700] iommu: Default domain type: Translated764worker2 # [ 0.164713] iommu: DMA domain TLB invalidation policy: strict mode765worker2 # [ 0.165126] SCSI subsystem initialized766client # [ 0.182274] netfs: FS-Cache loaded767client # [ 0.182423] pnp: PnP ACPI: disabled768worker2 # [ 0.167128] usbcore: registered new interface driver usbfs769lb # [ 0.193316] NET: Registered PF_INET protocol family770worker2 # [ 0.167163] usbcore: registered new interface driver hub771lb # [ 0.193625] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)772worker2 # [ 0.167182] usbcore: registered new device driver usb773worker2 # [ 0.167494] pps_core: LinuxPPS API ver. 1 registered774worker2 # [ 0.167500] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>775worker2 # [ 0.167511] PTP clock support registered776worker1 # [ 0.148251] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages777worker2 # [ 0.167567] EDAC MC: Ver: 3.0.0778worker1 # [ 0.148272] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page779worker2 # [ 0.172346] scmi_core: SCMI protocol bus registered780worker1 # [ 0.148278] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages781worker2 # [ 0.173365] FPGA manager framework782client # [ 0.186548] NET: Registered PF_INET protocol family783worker1 # [ 0.148283] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page784worker2 # [ 0.174383] vgaarb: loaded785client # [ 0.186842] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)786worker1 # [ 0.148287] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages787worker2 # [ 0.175041] clocksource: Switched to clocksource arch_sys_counter788worker1 # [ 0.148291] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page789worker1 # [ 0.148296] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages790worker1 # [ 0.148300] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page791worker1 # [ 0.155899] fbcon: Taking over console792worker1 # [ 0.155918] ACPI: Interpreter disabled.793worker2 # [ 0.179785] VFS: Disk quotas dquot_6.6.0794worker2 # [ 0.179832] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)795worker2 # [ 0.181555] netfs: FS-Cache loaded796worker2 # [ 0.181708] pnp: PnP ACPI: disabled797worker2 # [ 0.185782] NET: Registered PF_INET protocol family798worker1 # [ 0.164563] iommu: Default domain type: Translated799worker2 # [ 0.186067] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)800worker1 # [ 0.164578] iommu: DMA domain TLB invalidation policy: strict mode801worker1 # [ 0.164978] SCSI subsystem initialized802worker1 # [ 0.167067] usbcore: registered new interface driver usbfs803worker1 # [ 0.167099] usbcore: registered new interface driver hub804worker1 # [ 0.167118] usbcore: registered new device driver usb805worker1 # [ 0.167407] pps_core: LinuxPPS API ver. 1 registered806worker1 # [ 0.167412] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>807worker1 # [ 0.167429] PTP clock support registered808worker1 # [ 0.167495] EDAC MC: Ver: 3.0.0809worker1 # [ 0.172214] scmi_core: SCMI protocol bus registered810worker1 # [ 0.173231] FPGA manager framework811worker1 # [ 0.174231] vgaarb: loaded812worker1 # [ 0.174893] clocksource: Switched to clocksource arch_sys_counter813worker1 # [ 0.179756] VFS: Disk quotas dquot_6.6.0814worker1 # [ 0.179801] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)815worker1 # [ 0.181510] netfs: FS-Cache loaded816worker1 # [ 0.181650] pnp: PnP ACPI: disabled817lb # [ 0.226347] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)818lb # [ 0.226408] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)819worker1 # [ 0.185647] NET: Registered PF_INET protocol family820client # [ 0.218533] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)821lb # [ 0.226445] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)822worker1 # [ 0.185961] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)823client # [ 0.218597] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)824lb # [ 0.226541] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)825client # [ 0.218634] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)826lb # [ 0.226687] TCP: Hash tables configured (established 16384 bind 16384)827client # [ 0.218731] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)828lb # [ 0.226798] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)829client # [ 0.218876] TCP: Hash tables configured (established 16384 bind 16384)830lb # [ 0.226862] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)831client # [ 0.218975] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)832lb # [ 0.226901] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)833client # [ 0.219015] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)834lb # [ 0.227005] NET: Registered PF_UNIX/PF_LOCAL protocol family835lb # [ 0.227054] NET: Registered PF_XDP protocol family836client # [ 0.219063] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)837lb # [ 0.227075] PCI: CLS 0 bytes, default 64838client # [ 0.219184] NET: Registered PF_UNIX/PF_LOCAL protocol family839lb # [ 0.227382] Trying to unpack rootfs image as initramfs...840client # [ 0.219207] NET: Registered PF_XDP protocol family841client # [ 0.219225] PCI: CLS 0 bytes, default 64842client # [ 0.219482] Trying to unpack rootfs image as initramfs...843client # [ 0.235035] kvm [1]: HYP mode not available844lb # [ 0.245656] kvm [1]: HYP mode not available845worker2 # [ 0.218293] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846worker2 # [ 0.218357] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847worker2 # [ 0.218392] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)848worker2 # [ 0.218485] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849worker2 # [ 0.218632] TCP: Hash tables configured (established 16384 bind 16384)850worker2 # [ 0.218738] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)851worker2 # [ 0.218778] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)852worker2 # [ 0.218816] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)853worker2 # [ 0.218919] NET: Registered PF_UNIX/PF_LOCAL protocol family854worker2 # [ 0.218947] NET: Registered PF_XDP protocol family855worker2 # [ 0.218966] PCI: CLS 0 bytes, default 64856worker2 # [ 0.219154] Trying to unpack rootfs image as initramfs...857worker1 # [ 0.218538] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)858worker2 # [ 0.237261] kvm [1]: HYP mode not available859worker1 # [ 0.218605] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)860worker1 # [ 0.218642] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)861worker1 # [ 0.218741] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)862worker1 # [ 0.218888] TCP: Hash tables configured (established 16384 bind 16384)863worker1 # [ 0.223906] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)864worker1 # [ 0.223953] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)865worker1 # [ 0.223992] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)866worker1 # [ 0.224110] NET: Registered PF_UNIX/PF_LOCAL protocol family867worker1 # [ 0.224168] NET: Registered PF_XDP protocol family868worker1 # [ 0.224189] PCI: CLS 0 bytes, default 64869worker1 # [ 0.224455] Trying to unpack rootfs image as initramfs...870worker1 # [ 0.236064] kvm [1]: HYP mode not available871lb # [ 0.404346] Initialise system trusted keyrings872lb # [ 0.405151] workingset: timestamp_bits=42 max_order=19 bucket_order=0873lb # [ 0.406500] squashfs: version 4.0 (2009/01/31) Phillip Lougher874lb # [ 0.407262] 9p: Installing v9fs 9p2000 file system support875client # [ 0.397996] Initialise system trusted keyrings876client # [ 0.398782] workingset: timestamp_bits=42 max_order=19 bucket_order=0877client # [ 0.400132] squashfs: version 4.0 (2009/01/31) Phillip Lougher878client # [ 0.400906] 9p: Installing v9fs 9p2000 file system support879lb # [ 0.436010] Key type asymmetric registered880lb # [ 0.436040] Asymmetric key parser 'x509' registered881client # [ 0.424906] Key type asymmetric registered882lb # [ 0.436141] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)883client # [ 0.424938] Asymmetric key parser 'x509' registered884lb # [ 0.438322] io scheduler mq-deadline registered885client # [ 0.425025] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)886lb # [ 0.438334] io scheduler kyber registered887worker2 # [ 0.415332] Initialise system trusted keyrings888worker2 # [ 0.416138] workingset: timestamp_bits=42 max_order=19 bucket_order=0889worker2 # [ 0.417489] squashfs: version 4.0 (2009/01/31) Phillip Lougher890worker2 # [ 0.418265] 9p: Installing v9fs 9p2000 file system support891worker1 # [ 0.397529] Initialise system trusted keyrings892lb # [ 0.447914] pl061_gpio 9030000.pl061: PL061 GPIO chip registered893worker1 # [ 0.398350] workingset: timestamp_bits=42 max_order=19 bucket_order=0894client # [ 0.433387] io scheduler mq-deadline registered895client # [ 0.433413] io scheduler kyber registered896worker1 # [ 0.399784] squashfs: version 4.0 (2009/01/31) Phillip Lougher897client # [ 0.438963] pl061_gpio 9030000.pl061: PL061 GPIO chip registered898lb # [ 0.449320] ledtrig-cpu: registered to indicate activity on CPUs899lb # [ 0.449728] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:900client # [ 0.440366] ledtrig-cpu: registered to indicate activity on CPUs901lb # [ 0.449748] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000902client # [ 0.440902] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:903lb # [ 0.449759] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000904client # [ 0.440922] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000905lb # [ 0.449768] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000906client # [ 0.440934] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000907lb # [ 0.449789] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits908worker1 # [ 0.400572] 9p: Installing v9fs 9p2000 file system support909client # [ 0.440942] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000910lb # [ 0.449821] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]911client # [ 0.440965] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits912lb # [ 0.449907] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00913client # [ 0.441000] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]914lb # [ 0.449916] pci_bus 0000:00: root bus resource [bus 00-ff]915lb # [ 0.449922] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]916client # [ 0.441085] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00917client # [ 0.441096] pci_bus 0000:00: root bus resource [bus 00-ff]918lb # [ 0.449927] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]919client # [ 0.441101] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]920lb # [ 0.449932] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]921client # [ 0.441117] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]922lb # [ 0.450030] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint923client # [ 0.441123] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]924lb # [ 0.450481] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint925client # [ 0.441229] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint926lb # [ 0.450669] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]927lb # [ 0.450686] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]928lb # [ 0.450716] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]929lb # [ 0.450732] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]930lb # [ 0.451189] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint931lb # [ 0.451375] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]932lb # [ 0.451391] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]933lb # [ 0.451421] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]934worker1 # [ 0.420543] Key type asymmetric registered935worker1 # [ 0.420569] Asymmetric key parser 'x509' registered936worker1 # [ 0.420639] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)937worker2 # [ 0.447149] Key type asymmetric registered938worker2 # [ 0.447182] Asymmetric key parser 'x509' registered939worker2 # [ 0.447271] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)940worker2 # [ 0.449484] io scheduler mq-deadline registered941worker2 # [ 0.449496] io scheduler kyber registered942client # [ 0.461859] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint943client # [ 0.462077] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]944client # [ 0.462095] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]945client # [ 0.462125] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]946lb # [ 0.476013] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint947lb # [ 0.476246] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]948client # [ 0.462142] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]949lb # [ 0.476272] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]950worker1 # [ 0.435014] io scheduler mq-deadline registered951client # [ 0.462598] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint952worker1 # [ 0.435045] io scheduler kyber registered953lb # [ 0.476302] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]954client # [ 0.462778] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]955client # [ 0.462793] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]956lb # [ 0.476781] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint957worker2 # [ 0.459234] pl061_gpio 9030000.pl061: PL061 GPIO chip registered958client # [ 0.462823] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]959lb # [ 0.476965] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]960lb # [ 0.476981] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]961client # [ 0.463299] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint962lb # [ 0.477013] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]963client # [ 0.463484] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]964client # [ 0.463500] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]965lb # [ 0.477478] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint966worker2 # [ 0.460800] ledtrig-cpu: registered to indicate activity on CPUs967client # [ 0.463530] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]968lb # [ 0.477666] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]969worker2 # [ 0.461213] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:970worker1 # [ 0.440818] pl061_gpio 9030000.pl061: PL061 GPIO chip registered971lb # [ 0.477682] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]972client # [ 0.463985] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint973worker2 # [ 0.461233] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000974client # [ 0.464185] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]975lb # [ 0.477711] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]976worker1 # [ 0.442144] ledtrig-cpu: registered to indicate activity on CPUs977client # [ 0.464201] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]978worker2 # [ 0.461246] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000979lb # [ 0.478166] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint980client # [ 0.464235] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]981worker1 # [ 0.442534] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:982lb # [ 0.478355] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]983worker2 # [ 0.461255] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000984lb # [ 0.478371] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]985client # [ 0.464707] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint986worker1 # [ 0.442552] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000987worker2 # [ 0.461278] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits988lb # [ 0.478400] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]989client # [ 0.464891] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]990worker1 # [ 0.442565] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000991client # [ 0.464907] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]992worker2 # [ 0.461312] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]993lb # [ 0.478864] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint994client # [ 0.464937] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]995lb # [ 0.479049] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]996worker1 # [ 0.442581] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000997worker2 # [ 0.461397] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00998worker2 # [ 0.461407] pci_bus 0000:00: root bus resource [bus 00-ff]999lb # [ 0.479065] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1000client # [ 0.465408] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1001worker1 # [ 0.442610] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1002client # [ 0.465595] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1003lb # [ 0.479096] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1004worker2 # [ 0.461413] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1005worker1 # [ 0.442631] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1006client # [ 0.465611] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1007lb # [ 0.479112] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1008worker2 # [ 0.461418] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1009client # [ 0.465640] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1010worker1 # [ 0.442715] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001011worker2 # [ 0.461423] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1012lb # [ 0.479620] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1013worker1 # [ 0.442725] pci_bus 0000:00: root bus resource [bus 00-ff]1014client # [ 0.466098] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1015lb # [ 0.479836] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1016worker2 # [ 0.461523] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1017worker1 # [ 0.442732] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1018client # [ 0.466285] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1019lb # [ 0.479866] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1020worker2 # [ 0.461975] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1021worker1 # [ 0.442737] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1022client # [ 0.466302] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1023lb # [ 0.480341] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1024worker2 # [ 0.462164] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1025worker1 # [ 0.442742] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1026client # [ 0.466340] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1027lb # [ 0.480534] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1028worker2 # [ 0.462181] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1029client # [ 0.466356] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1030worker1 # [ 0.442803] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1031lb # [ 0.480564] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1032worker2 # [ 0.462212] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1033client # [ 0.466851] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1034worker2 # [ 0.462228] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1035lb # [ 0.480950] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1036client # [ 0.467044] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1037lb # [ 0.481137] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1038worker2 # [ 0.462694] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1039client # [ 0.467074] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1040worker2 # [ 0.462876] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1041lb # [ 0.481393] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1042client # [ 0.467538] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1043worker2 # [ 0.462893] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1044lb # [ 0.481680] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1045client # [ 0.467728] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1046worker2 # [ 0.462923] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1047lb # [ 0.481697] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1048client # [ 0.467758] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1049lb # [ 0.481729] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1050client # [ 0.468167] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1051lb # [ 0.482200] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1052client # [ 0.468352] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1053worker2 # [ 0.481902] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1054lb # [ 0.482388] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1055worker2 # [ 0.482096] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1056lb # [ 0.482405] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1057client # [ 0.468607] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1058worker2 # [ 0.482113] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1059client # [ 0.468912] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1060lb # [ 0.482435] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1061worker2 # [ 0.482142] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1062client # [ 0.468932] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1063lb # [ 0.483037] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1064client # [ 0.468963] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1065worker2 # [ 0.482596] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1066lb # [ 0.483049] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1067worker2 # [ 0.482777] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1068lb # [ 0.483055] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1069worker2 # [ 0.482793] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1070lb # [ 0.483101] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1071worker2 # [ 0.482825] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1072lb # [ 0.483149] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1073lb # [ 0.483196] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1074lb # [ 0.483243] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1075lb # [ 0.483289] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1076lb # [ 0.483336] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1077worker1 # [ 0.463437] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1078lb # [ 0.483384] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1079worker1 # [ 0.463656] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1080lb # [ 0.483435] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1081worker1 # [ 0.463673] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1082worker1 # [ 0.463704] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1083lb # [ 0.483485] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1084worker1 # [ 0.463720] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1085lb # [ 0.483564] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1086worker1 # [ 0.464188] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1087lb # [ 0.483610] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1088worker1 # [ 0.464374] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1089lb # [ 0.483632] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1090client # [ 0.509619] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1091worker1 # [ 0.464390] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1092lb # [ 0.483654] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1093client # [ 0.509840] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1094worker1 # [ 0.464419] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1095lb # [ 0.483676] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1096client # [ 0.509859] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1097worker1 # [ 0.464879] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1098lb # [ 0.483702] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1099client # [ 0.509890] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1100worker1 # [ 0.465067] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1101client # [ 0.510526] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1102worker1 # [ 0.465083] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1103client # [ 0.510540] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1104worker2 # [ 0.495479] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1105worker1 # [ 0.465113] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1106worker2 # [ 0.495694] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1107client # [ 0.510546] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1108worker1 # [ 0.465569] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1109worker2 # [ 0.495712] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1110worker1 # [ 0.465781] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1111client # [ 0.510595] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1112worker2 # [ 0.495743] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1113worker1 # [ 0.465797] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1114client # [ 0.510643] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1115worker2 # [ 0.496224] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1116worker1 # [ 0.465832] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1117client # [ 0.510695] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1118worker2 # [ 0.496414] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1119worker1 # [ 0.466294] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1120worker2 # [ 0.496429] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1121client # [ 0.510745] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1122worker1 # [ 0.466477] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1123worker2 # [ 0.496458] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1124worker1 # [ 0.466493] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1125client # [ 0.510797] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1126worker2 # [ 0.496981] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1127worker1 # [ 0.466522] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1128client # [ 0.510846] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1129worker2 # [ 0.497170] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1130worker1 # [ 0.467029] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1131client # [ 0.510895] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1132worker2 # [ 0.497186] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1133worker1 # [ 0.467212] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1134worker2 # [ 0.497216] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1135client # [ 0.510944] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1136lb # [ 0.535834] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1137worker1 # [ 0.467229] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1138worker2 # [ 0.497233] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1139lb # [ 0.535872] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1140client # [ 0.510994] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1141worker1 # [ 0.467260] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1142worker2 # [ 0.497751] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1143lb # [ 0.535896] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1144client # [ 0.511115] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1145worker1 # [ 0.467720] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1146worker2 # [ 0.497947] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1147lb # [ 0.535919] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1148worker1 # [ 0.467904] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1149client # [ 0.511166] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1150worker2 # [ 0.497979] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1151lb # [ 0.535943] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1152worker1 # [ 0.467920] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1153client # [ 0.511188] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1154worker2 # [ 0.498440] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1155lb # [ 0.535967] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1156worker1 # [ 0.467961] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1157client # [ 0.511210] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1158worker2 # [ 0.498628] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1159lb # [ 0.535991] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1160worker1 # [ 0.467977] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1161client # [ 0.511233] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1162worker2 # [ 0.498659] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1163lb # [ 0.536017] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1164client # [ 0.511260] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1165worker1 # [ 0.468431] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1166lb # [ 0.536040] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1167worker2 # [ 0.499074] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1168worker1 # [ 0.468618] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1169client # [ 0.511283] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1170lb # [ 0.536063] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1171worker2 # [ 0.499254] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1172worker1 # [ 0.468648] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1173client # [ 0.511306] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1174lb # [ 0.536085] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1175worker2 # [ 0.499502] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1176client # [ 0.511329] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1177worker1 # [ 0.469105] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1178lb # [ 0.536108] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1179worker2 # [ 0.499795] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1180worker1 # [ 0.469296] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1181client # [ 0.511352] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1182lb # [ 0.536167] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1183worker2 # [ 0.499813] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1184client # [ 0.511374] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1185worker1 # [ 0.469326] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1186lb # [ 0.536190] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1187worker2 # [ 0.499843] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1188client # [ 0.511398] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1189lb # [ 0.536213] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1190worker1 # [ 0.469746] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1191worker2 # [ 0.500311] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1192lb # [ 0.536235] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1193client # [ 0.511426] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1194worker1 # [ 0.469929] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1195worker2 # [ 0.500507] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1196lb # [ 0.536269] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1197client # [ 0.511449] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1198worker2 # [ 0.500523] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1199worker1 # [ 0.470184] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1200client # [ 0.511473] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1201lb # [ 0.536278] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1202worker1 # [ 0.470468] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1203worker2 # [ 0.500552] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1204lb # [ 0.536283] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1205client # [ 0.511495] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1206worker1 # [ 0.470486] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1207worker2 # [ 0.501164] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1208lb # [ 0.537472] pci 0000:00:0a.0: enabling device (0000 -> 0002)1209client # [ 0.511517] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1210worker1 # [ 0.470516] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1211worker2 # [ 0.501176] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1212client # [ 0.511539] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1213client # [ 0.511561] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1214worker2 # [ 0.501182] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1215client # [ 0.511583] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1216worker2 # [ 0.501227] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1217client # [ 0.511605] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1218worker2 # [ 0.501274] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1219client # [ 0.511627] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1220worker1 # [ 0.504120] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1221client # [ 0.511655] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1222worker2 # [ 0.501321] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1223worker1 # [ 0.504314] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1224client # [ 0.511665] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1225worker2 # [ 0.501368] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1226worker1 # [ 0.504330] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1227client # [ 0.511670] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1228worker1 # [ 0.504360] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1229client # [ 0.512882] pci 0000:00:0a.0: enabling device (0000 -> 0002)1230worker2 # [ 0.501415] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1231worker1 # [ 0.505012] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1232worker2 # [ 0.501465] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1233worker1 # [ 0.505024] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1234worker2 # [ 0.501510] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1235worker1 # [ 0.505030] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1236worker2 # [ 0.501558] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1237worker1 # [ 0.505075] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1238worker2 # [ 0.501605] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1239worker1 # [ 0.505122] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1240worker2 # [ 0.501686] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1241worker1 # [ 0.505171] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1242worker2 # [ 0.501733] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1243worker2 # [ 0.501757] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1244worker1 # [ 0.505218] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1245worker2 # [ 0.501779] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1246worker1 # [ 0.505265] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1247worker2 # [ 0.501801] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1248worker1 # [ 0.505314] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1249worker2 # [ 0.501827] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1250worker1 # [ 0.505364] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1251worker2 # [ 0.501849] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1252worker1 # [ 0.505414] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1253worker2 # [ 0.501871] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1254worker2 # [ 0.501893] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1255worker1 # [ 0.505463] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1256worker2 # [ 0.501916] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1257worker1 # [ 0.505534] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1258worker2 # [ 0.501938] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1259worker1 # [ 0.505607] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1260worker2 # [ 0.501961] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1261worker1 # [ 0.505630] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1262worker2 # [ 0.501984] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1263worker1 # [ 0.505661] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1264worker2 # [ 0.502006] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1265worker1 # [ 0.505684] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1266worker2 # [ 0.502027] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1267worker1 # [ 0.505709] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1268worker2 # [ 0.502050] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1269worker1 # [ 0.505731] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1270worker2 # [ 0.502071] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1271worker1 # [ 0.505754] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1272worker2 # [ 0.502093] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1273worker1 # [ 0.505777] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1274worker2 # [ 0.502115] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1275lb # [ 0.578829] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1276worker1 # [ 0.505800] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1277worker2 # [ 0.502136] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1278worker2 # [ 0.502158] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1279worker1 # [ 0.505823] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1280client # [ 0.567532] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1281worker2 # [ 0.502181] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1282worker1 # [ 0.505847] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1283worker2 # [ 0.502208] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1284worker1 # [ 0.505871] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1285worker2 # [ 0.502218] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1286worker1 # [ 0.505893] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1287lb # [ 0.582076] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1288worker2 # [ 0.502223] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1289worker1 # [ 0.505915] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1290worker1 # [ 0.505938] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1291worker1 # [ 0.505960] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1292worker1 # [ 0.505982] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1293worker1 # [ 0.506005] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1294worker1 # [ 0.506027] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1295worker1 # [ 0.506050] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1296worker1 # [ 0.506073] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1297worker1 # [ 0.506100] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1298worker1 # [ 0.506110] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1299worker1 # [ 0.506115] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1300worker2 # [ 0.563511] pci 0000:00:0a.0: enabling device (0000 -> 0002)1301client # [ 0.578030] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1302lb # [ 0.592447] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1303lb # [ 0.594966] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1304worker1 # [ 0.547443] pci 0000:00:0a.0: enabling device (0000 -> 0002)1305lb # [ 0.598810] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1306client # [ 0.590053] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1307client # [ 0.592340] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1308lb # [ 0.607445] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1309client # [ 0.596403] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1310worker2 # [ 0.585148] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1311lb # [ 0.617594] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1312client # [ 0.607431] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1313worker1 # [ 0.574130] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1314worker2 # [ 0.595413] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1315lb # [ 0.625688] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1316worker1 # [ 0.577452] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1317worker2 # [ 0.603340] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1318worker2 # [ 0.605658] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1319worker1 # [ 0.584169] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1320lb # [ 0.636009] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1321client # [ 0.626064] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1322client # [ 0.628605] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1323client # [ 0.632890] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1324lb # [ 0.644504] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1325lb # [ 0.647127] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1326client # [ 0.635780] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1327worker2 # [ 0.619715] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1328worker2 # [ 0.622038] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1329worker2 # [ 0.624722] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1330worker1 # [ 0.603704] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1331worker1 # [ 0.605993] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1332client # [ 0.647430] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1333worker1 # [ 0.610257] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1334worker1 # [ 0.613359] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1335worker2 # [ 0.635287] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1336worker2 # [ 0.638693] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1337worker2 # [ 0.640800] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1338lb # [ 0.673408] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1339worker1 # [ 0.624562] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1340client # [ 0.669652] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1341worker2 # [ 0.651396] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1342lb # [ 0.682167] msm_serial: driver initialized1343lb # [ 0.682332] SuperH (H)SCI(F) driver initialized1344lb # [ 0.682388] STM32 USART driver initialized1345client # [ 0.672538] msm_serial: driver initialized1346client # [ 0.672704] SuperH (H)SCI(F) driver initialized1347client # [ 0.672764] STM32 USART driver initialized1348worker1 # [ 0.631202] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1349worker1 # [ 0.633231] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1350worker2 # [ 0.666171] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1351worker1 # [ 0.644440] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1352worker2 # [ 0.669001] msm_serial: driver initialized1353worker2 # [ 0.669161] SuperH (H)SCI(F) driver initialized1354worker2 # [ 0.669215] STM32 USART driver initialized1355worker1 # [ 0.653914] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1356worker1 # [ 0.660349] msm_serial: driver initialized1357worker1 # [ 0.660508] SuperH (H)SCI(F) driver initialized1358worker1 # [ 0.660563] STM32 USART driver initialized1359client # [ 0.704461] loop: module loaded1360client # [ 0.704676] virtio_blk virtio5: 1/0/0 default/read/poll queues1361lb # [ 0.717483] loop: module loaded1362client # [ 0.705486] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1363lb # [ 0.717697] virtio_blk virtio5: 1/0/0 default/read/poll queues1364lb # [ 0.718556] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1365worker2 # [ 0.711400] loop: module loaded1366client # [ 0.722103] megasas: 07.734.00.00-rc11367worker2 # [ 0.711634] virtio_blk virtio5: 1/0/0 default/read/poll queues1368client # [ 0.722934] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1369worker2 # [ 0.712637] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1370client # [ 0.725496] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001371lb # [ 0.736673] megasas: 07.734.00.00-rc11372client # [ 0.725529] Intel/Sharp Extended Query Table at 0x00311373client # [ 0.727656] Using buffer write method1374lb # [ 0.737499] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1375client # [ 0.727765] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1376lb # [ 0.739858] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001377lb # [ 0.739895] Intel/Sharp Extended Query Table at 0x00311378lb # [ 0.742670] Using buffer write method1379worker1 # [ 0.695910] loop: module loaded1380lb # [ 0.742866] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1381worker1 # [ 0.696133] virtio_blk virtio5: 1/0/0 default/read/poll queues1382client # [ 0.735074] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001383worker1 # [ 0.696964] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1384client # [ 0.735157] Intel/Sharp Extended Query Table at 0x00311385lb # [ 0.750714] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001386lb # [ 0.750777] Intel/Sharp Extended Query Table at 0x00311387client # [ 0.741329] Using buffer write method1388client # [ 0.741369] Concatenating MTD devices:1389client # [ 0.741373] (0): "0.flash"1390client # [ 0.741377] (1): "0.flash"1391lb # [ 0.754643] Using buffer write method1392client # [ 0.741381] into device "0.flash"1393lb # [ 0.754704] Concatenating MTD devices:1394lb # [ 0.754708] (0): "0.flash"1395lb # [ 0.754713] (1): "0.flash"1396lb # [ 0.754716] into device "0.flash"1397worker2 # [ 0.723862] megasas: 07.734.00.00-rc11398worker2 # [ 0.724717] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1399worker2 # [ 0.727198] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001400worker2 # [ 0.727262] Intel/Sharp Extended Query Table at 0x00311401worker2 # [ 0.729506] Using buffer write method1402worker2 # [ 0.729597] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1403worker1 # [ 0.711695] megasas: 07.734.00.00-rc11404worker1 # [ 0.712494] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1405worker2 # [ 0.745646] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001406worker2 # [ 0.745690] Intel/Sharp Extended Query Table at 0x00311407worker1 # [ 0.726959] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001408worker1 # [ 0.727005] Intel/Sharp Extended Query Table at 0x00311409worker1 # [ 0.728966] Using buffer write method1410worker1 # [ 0.729075] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1411worker2 # [ 0.764085] Using buffer write method1412worker2 # [ 0.764160] Concatenating MTD devices:1413worker2 # [ 0.764164] (0): "0.flash"1414worker2 # [ 0.764169] (1): "0.flash"1415worker2 # [ 0.764172] into device "0.flash"1416worker1 # [ 0.742943] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001417worker1 # [ 0.742987] Intel/Sharp Extended Query Table at 0x00311418worker1 # [ 0.745347] Using buffer write method1419worker1 # [ 0.745387] Concatenating MTD devices:1420worker1 # [ 0.745391] (0): "0.flash"1421worker1 # [ 0.745396] (1): "0.flash"1422worker1 # [ 0.745399] into device "0.flash"1423lb # [ 1.065065] Freeing initrd memory: 26140K1424lb # [ 1.072512] tun: Universal TUN/TAP device driver, 1.61425worker1 # [ 1.027912] Freeing initrd memory: 26148K1426lb # [ 1.078356] thunder_xcv, ver 1.01427lb # [ 1.078411] thunder_bgx, ver 1.01428lb # [ 1.078436] nicpf, ver 1.01429client # [ 1.066317] Freeing initrd memory: 26160K1430worker2 # [ 1.051468] Freeing initrd memory: 26148K1431lb # [ 1.079023] e1000: Intel(R) PRO/1000 Network Driver1432lb # [ 1.079031] e1000: Copyright (c) 1999-2006 Intel Corporation.1433lb # [ 1.079057] e1000e: Intel(R) PRO/1000 Network Driver1434lb # [ 1.079066] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1435lb # [ 1.079098] igb: Intel(R) Gigabit Ethernet Network Driver1436lb # [ 1.079104] igb: Copyright (c) 2007-2014 Intel Corporation.1437worker1 # [ 1.034191] tun: Universal TUN/TAP device driver, 1.61438client # [ 1.072601] tun: Universal TUN/TAP device driver, 1.61439lb # [ 1.079127] igbvf: Intel(R) Gigabit Virtual Function Network Driver1440worker2 # [ 1.057711] tun: Universal TUN/TAP device driver, 1.61441lb # [ 1.079133] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1442lb # [ 1.079273] sky2: driver version 1.301443worker2 # [ 1.061777] thunder_xcv, ver 1.01444lb # [ 1.088098] usbcore: registered new interface driver usb-storage1445worker2 # [ 1.061829] thunder_bgx, ver 1.01446worker2 # [ 1.061857] nicpf, ver 1.01447lb # [ 1.088287] usbcore: registered new interface driver usbserial_generic1448worker2 # [ 1.062430] e1000: Intel(R) PRO/1000 Network Driver1449lb # [ 1.088306] usbserial: USB Serial support registered for generic1450worker2 # [ 1.062437] e1000: Copyright (c) 1999-2006 Intel Corporation.1451lb # [ 1.088940] hv_vmbus: registering driver hyperv_keyboard1452worker2 # [ 1.062463] e1000e: Intel(R) PRO/1000 Network Driver1453lb # [ 1.090277] ehci-pci 0000:00:0a.0: EHCI Host Controller1454worker2 # [ 1.062471] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1455client # [ 1.077639] thunder_xcv, ver 1.01456worker1 # [ 1.039224] thunder_xcv, ver 1.01457worker2 # [ 1.062504] igb: Intel(R) Gigabit Ethernet Network Driver1458lb # [ 1.090305] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11459worker1 # [ 1.039270] thunder_bgx, ver 1.01460client # [ 1.077683] thunder_bgx, ver 1.01461client # [ 1.077705] nicpf, ver 1.01462worker1 # [ 1.039293] nicpf, ver 1.01463worker2 # [ 1.062510] igb: Copyright (c) 2007-2014 Intel Corporation.1464lb # [ 1.090614] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001465client # [ 1.078320] e1000: Intel(R) PRO/1000 Network Driver1466worker1 # [ 1.039857] e1000: Intel(R) PRO/1000 Network Driver1467worker2 # [ 1.062533] igbvf: Intel(R) Gigabit Virtual Function Network Driver1468client # [ 1.078327] e1000: Copyright (c) 1999-2006 Intel Corporation.1469worker1 # [ 1.039864] e1000: Copyright (c) 1999-2006 Intel Corporation.1470worker2 # [ 1.062539] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1471client # [ 1.078354] e1000e: Intel(R) PRO/1000 Network Driver1472worker1 # [ 1.039889] e1000e: Intel(R) PRO/1000 Network Driver1473worker2 # [ 1.062674] sky2: driver version 1.301474lb # [ 1.096204] rtc-pl031 9010000.pl031: registered as rtc01475client # [ 1.078361] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1476worker1 # [ 1.039896] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1477worker1 # [ 1.039926] igb: Intel(R) Gigabit Ethernet Network Driver1478client # [ 1.078391] igb: Intel(R) Gigabit Ethernet Network Driver1479lb # [ 1.096239] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:46:10 UTC (1789908370)1480client # [ 1.078396] igb: Copyright (c) 2007-2014 Intel Corporation.1481worker1 # [ 1.039932] igb: Copyright (c) 2007-2014 Intel Corporation.1482lb # [ 1.096623] i2c_dev: i2c /dev entries driver1483worker1 # [ 1.039957] igbvf: Intel(R) Gigabit Virtual Function Network Driver1484client # [ 1.078420] igbvf: Intel(R) Gigabit Virtual Function Network Driver1485worker1 # [ 1.039963] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1486client # [ 1.078426] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1487worker2 # [ 1.072694] ehci-pci 0000:00:0a.0: EHCI Host Controller1488client # [ 1.078562] sky2: driver version 1.301489worker1 # [ 1.040100] sky2: driver version 1.301490client # [ 1.080236] usbcore: registered new interface driver usb-storage1491worker1 # [ 1.041763] usbcore: registered new interface driver usb-storage1492worker2 # [ 1.072764] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11493worker2 # [ 1.072988] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001494client # [ 1.080300] usbcore: registered new interface driver usbserial_generic1495worker1 # [ 1.041917] usbcore: registered new interface driver usbserial_generic1496worker1 # [ 1.041932] usbserial: USB Serial support registered for generic1497client # [ 1.080315] usbserial: USB Serial support registered for generic1498worker1 # [ 1.042549] hv_vmbus: registering driver hyperv_keyboard1499client # [ 1.080912] hv_vmbus: registering driver hyperv_keyboard1500lb # [ 1.101668] sdhci: Secure Digital Host Controller Interface driver1501client # [ 1.082023] ehci-pci 0000:00:0a.0: EHCI Host Controller1502lb # [ 1.101685] sdhci: Copyright(c) Pierre Ossman1503worker2 # [ 1.075777] usbcore: registered new interface driver usb-storage1504lb # [ 1.101972] Synopsys Designware Multimedia Card Interface Driver1505worker1 # [ 1.043631] ehci-pci 0000:00:0a.0: EHCI Host Controller1506client # [ 1.082052] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11507worker2 # [ 1.075869] usbcore: registered new interface driver usbserial_generic1508worker1 # [ 1.043662] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11509lb # [ 1.102392] sdhci-pltfm: SDHCI platform and OF driver helper1510client # [ 1.082265] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001511worker2 # [ 1.075884] usbserial: USB Serial support registered for generic1512worker1 # [ 1.043935] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001513worker2 # [ 1.076561] hv_vmbus: registering driver hyperv_keyboard1514lb # [ 1.106425] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001515worker1 # [ 1.056093] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001516client # [ 1.094466] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001517lb # [ 1.106759] hub 1-0:1.0: USB hub found1518client # [ 1.094939] hub 1-0:1.0: USB hub found1519lb # [ 1.106795] hub 1-0:1.0: 6 ports detected1520client # [ 1.094960] hub 1-0:1.0: 6 ports detected1521worker1 # [ 1.056489] hub 1-0:1.0: USB hub found1522worker1 # [ 1.056510] hub 1-0:1.0: 6 ports detected1523worker2 # [ 1.080303] rtc-pl031 9010000.pl031: registered as rtc01524worker2 # [ 1.080335] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:46:10 UTC (1789908370)1525lb # [ 1.109360] hid: raw HID events driver (C) Jiri Kosina1526worker2 # [ 1.080672] i2c_dev: i2c /dev entries driver1527worker1 # [ 1.059136] rtc-pl031 9010000.pl031: registered as rtc01528client # [ 1.097602] rtc-pl031 9010000.pl031: registered as rtc01529lb # [ 1.109610] usbcore: registered new interface driver usbhid1530lb # [ 1.109616] usbhid: USB HID core driver1531worker1 # [ 1.059167] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:46:10 UTC (1789908370)1532client # [ 1.097631] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:46:10 UTC (1789908370)1533worker2 # [ 1.083723] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001534worker1 # [ 1.059507] i2c_dev: i2c /dev entries driver1535client # [ 1.098025] i2c_dev: i2c /dev entries driver1536worker2 # [ 1.084079] hub 1-0:1.0: USB hub found1537worker2 # [ 1.084100] hub 1-0:1.0: 6 ports detected1538lb # [ 1.112588] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1539lb # [ 1.114194] drop_monitor: Initializing network drop monitor service1540lb # [ 1.114358] NET: Registered PF_INET6 protocol family1541client # [ 1.102924] sdhci: Secure Digital Host Controller Interface driver1542worker1 # [ 1.064548] sdhci: Secure Digital Host Controller Interface driver1543client # [ 1.102936] sdhci: Copyright(c) Pierre Ossman1544worker1 # [ 1.064561] sdhci: Copyright(c) Pierre Ossman1545lb # [ 1.118356] Segment Routing with IPv61546client # [ 1.103203] Synopsys Designware Multimedia Card Interface Driver1547worker1 # [ 1.064830] Synopsys Designware Multimedia Card Interface Driver1548lb # [ 1.118378] In-situ OAM (IOAM) with IPv61549worker2 # [ 1.088087] sdhci: Secure Digital Host Controller Interface driver1550worker2 # [ 1.088096] sdhci: Copyright(c) Pierre Ossman1551client # [ 1.103564] sdhci-pltfm: SDHCI platform and OF driver helper1552worker1 # [ 1.065212] sdhci-pltfm: SDHCI platform and OF driver helper1553lb # [ 1.118415] NET: Registered PF_PACKET protocol family1554worker2 # [ 1.088367] Synopsys Designware Multimedia Card Interface Driver1555worker2 # [ 1.088766] sdhci-pltfm: SDHCI platform and OF driver helper1556client # [ 1.107912] hid: raw HID events driver (C) Jiri Kosina1557worker2 # [ 1.090550] hid: raw HID events driver (C) Jiri Kosina1558worker1 # [ 1.069668] hid: raw HID events driver (C) Jiri Kosina1559client # [ 1.108173] usbcore: registered new interface driver usbhid1560worker1 # [ 1.069942] usbcore: registered new interface driver usbhid1561worker2 # [ 1.090806] usbcore: registered new interface driver usbhid1562worker1 # [ 1.069949] usbhid: USB HID core driver1563client # [ 1.108180] usbhid: USB HID core driver1564worker2 # [ 1.090813] usbhid: USB HID core driver1565lb # [ 1.120102] 9pnet: Installing 9P2000 support1566lb # [ 1.122401] Key type dns_resolver registered1567worker1 # [ 1.072841] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1568worker1 # [ 1.074464] drop_monitor: Initializing network drop monitor service1569client # [ 1.111140] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1570client # [ 1.112722] drop_monitor: Initializing network drop monitor service1571worker2 # [ 1.096463] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1572worker1 # [ 1.074620] NET: Registered PF_INET6 protocol family1573client # [ 1.113529] NET: Registered PF_INET6 protocol family1574worker2 # [ 1.098038] drop_monitor: Initializing network drop monitor service1575worker1 # [ 1.077755] Segment Routing with IPv61576worker2 # [ 1.098732] NET: Registered PF_INET6 protocol family1577client # [ 1.116497] Segment Routing with IPv61578worker1 # [ 1.077775] In-situ OAM (IOAM) with IPv61579client # [ 1.116532] In-situ OAM (IOAM) with IPv61580worker1 # [ 1.077806] NET: Registered PF_PACKET protocol family1581client # [ 1.116579] NET: Registered PF_PACKET protocol family1582worker2 # [ 1.102349] Segment Routing with IPv61583worker2 # [ 1.102371] In-situ OAM (IOAM) with IPv61584worker2 # [ 1.102403] NET: Registered PF_PACKET protocol family1585lb # [ 1.129619] registered taskstats version 11586lb # [ 1.129770] Loading compiled-in X.509 certificates1587client # [ 1.118416] 9pnet: Installing 9P2000 support1588worker1 # [ 1.079651] 9pnet: Installing 9P2000 support1589client # [ 1.120690] Key type dns_resolver registered1590worker2 # [ 1.104114] 9pnet: Installing 9P2000 support1591worker2 # [ 1.106407] Key type dns_resolver registered1592worker1 # [ 1.083966] Key type dns_resolver registered1593lb # [ 1.138567] Demotion targets for Node 0: null1594lb # [ 1.138694] Key type .fscrypt registered1595lb # [ 1.138700] Key type fscrypt-provisioning registered1596lb # [ 1.138806] ima: No TPM chip found, activating TPM-bypass!1597worker1 # [ 1.090543] registered taskstats version 11598client # [ 1.127879] registered taskstats version 11599lb # [ 1.138826] ima: Allocated hash algorithm: sha11600client # [ 1.128135] Loading compiled-in X.509 certificates1601worker1 # [ 1.090704] Loading compiled-in X.509 certificates1602lb # [ 1.138854] ima: No architecture policies found1603worker2 # [ 1.113351] registered taskstats version 11604worker2 # [ 1.113507] Loading compiled-in X.509 certificates1605lb # [ 1.143138] input: gpio-keys as /devices/platform/gpio-keys/input/input01606client # [ 1.136998] Demotion targets for Node 0: null1607client # [ 1.137125] Key type .fscrypt registered1608client # [ 1.137132] Key type fscrypt-provisioning registered1609worker1 # [ 1.099536] Demotion targets for Node 0: null1610worker2 # [ 1.122293] Demotion targets for Node 0: null1611worker1 # [ 1.099676] Key type .fscrypt registered1612worker2 # [ 1.122423] Key type .fscrypt registered1613client # [ 1.137238] ima: No TPM chip found, activating TPM-bypass!1614client # [ 1.137258] ima: Allocated hash algorithm: sha11615worker1 # [ 1.099682] Key type fscrypt-provisioning registered1616worker2 # [ 1.122430] Key type fscrypt-provisioning registered1617worker1 # [ 1.099781] ima: No TPM chip found, activating TPM-bypass!1618worker2 # [ 1.122536] ima: No TPM chip found, activating TPM-bypass!1619client # [ 1.140077] ima: No architecture policies found1620worker1 # [ 1.099800] ima: Allocated hash algorithm: sha11621worker2 # [ 1.122557] ima: Allocated hash algorithm: sha11622worker2 # [ 1.122581] ima: No architecture policies found1623worker1 # [ 1.099823] ima: No architecture policies found1624client # [ 1.141377] input: gpio-keys as /devices/platform/gpio-keys/input/input01625worker1 # [ 1.103934] input: gpio-keys as /devices/platform/gpio-keys/input/input01626worker2 # [ 1.126937] input: gpio-keys as /devices/platform/gpio-keys/input/input01627worker1 # [ 1.122770] clk: Disabling unused clocks1628client # [ 1.160854] clk: Disabling unused clocks1629client # [ 1.160900] PM: genpd: Disabling unused power domains1630worker1 # [ 1.122814] PM: genpd: Disabling unused power domains1631lb # [ 1.172635] clk: Disabling unused clocks1632lb # [ 1.172674] PM: genpd: Disabling unused power domains1633client # [ 1.165191] Freeing unused kernel memory: 4736K1634lb # [ 1.177586] Freeing unused kernel memory: 4736K1635worker1 # [ 1.127203] Freeing unused kernel memory: 4736K1636client # [ 1.166012] Run /init as init process1637lb # [ 1.177789] Run /init as init process1638worker1 # [ 1.127401] Run /init as init process1639worker2 # [ 1.146437] clk: Disabling unused clocks1640worker2 # [ 1.146477] PM: genpd: Disabling unused power domains1641worker2 # [ 1.150786] Freeing unused kernel memory: 4736K1642worker2 # [ 1.150990] Run /init as init process1643worker2 # [ 1.165554] systemd[1]: Successfully made /usr/ read-only.1644lb # [ 1.194267] systemd[1]: Successfully made /usr/ read-only.1645client # [ 1.183698] systemd[1]: Successfully made /usr/ read-only.1646worker1 # [ 1.145315] systemd[1]: Successfully made /usr/ read-only.1647lb # [ 1.351859] usb 1-1: new high-speed USB device number 2 using ehci-pci1648client # [ 1.341376] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.303045] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker2 # [ 1.331224] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker2 # [ 1.479688] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652lb # [ 1.508983] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653client # [ 1.499001] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11654worker1 # [ 1.459602] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11655worker2 # [ 1.500385] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1656worker2 # [ 1.504789] systemd[1]: Detected virtualization qemu.1657lb # [ 1.529189] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1658worker2 # [ 1.505733] systemd[1]: Detected architecture arm64.1659worker1 # [ 1.480077] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1660lb # [ 1.534320] systemd[1]: Detected virtualization qemu.1661worker1 # [ 1.483919] systemd[1]: Detected virtualization qemu.1662worker2 # [ 1.506722] systemd[1]: Running in initrd.1663lb # [ 1.535057] systemd[1]: Detected architecture arm64.1664worker1 # [ 1.484617] systemd[1]: Detected architecture arm64.1665lb # [ 1.535722] systemd[1]: Running in initrd.1666worker1 # [ 1.485266] systemd[1]: Running in initrd.1667client # [ 1.520671] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1668worker2 # [ 1.508170] systemd[1]: Initializing machine ID from random generator.1669client # [ 1.524860] systemd[1]: Detected virtualization qemu.1670worker1 # [ 1.486366] systemd[1]: Initializing machine ID from random generator.1671worker2 # [ 1.509473] systemd[1]: Hostname set to <worker2>.1672worker1 # [ 1.487351] systemd[1]: Hostname set to <worker1>.1673client # [ 1.525658] systemd[1]: Detected architecture arm64.1674client # [ 1.526671] systemd[1]: Running in initrd.1675client # [ 1.527687] systemd[1]: Initializing machine ID from random generator.1676lb # [ 1.536739] systemd[1]: Initializing machine ID from random generator.1677client # [ 1.528687] systemd[1]: Hostname set to <client>.1678lb # [ 1.541337] systemd[1]: Hostname set to <lb>.1679worker2 # [ 1.583308] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01680worker1 # [ 1.579210] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681client # [ 1.622505] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682lb # [ 1.663837] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker2 # [ 1.703173] usb 1-2: new high-speed USB device number 3 using ehci-pci1684worker1 # [ 1.700688] usb 1-2: new high-speed USB device number 3 using ehci-pci1685client # [ 1.741379] usb 1-2: new high-speed USB device number 3 using ehci-pci1686lb # [ 1.788314] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker2 # [ 1.805456] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688client # [ 1.867080] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689worker1 # [ 1.820196] systemd[1]: bpf-restrict-fs: LSM BPF program attached1690lb # [ 1.888996] systemd[1]: bpf-restrict-fs: LSM BPF program attached1691client # [ 1.916427] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21692client # [ 1.918528] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01693worker2 # [ 1.903102] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21694worker2 # [ 1.905034] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01695worker1 # [ 1.907521] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696worker1 # [ 1.911377] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697worker2 # [ 1.941532] systemd[1]: Queued start job for default target Initrd Default Target.1698worker2 # [ 1.974290] systemd[1]: Created slice Slice /system/modprobe.1699worker2 # [ 1.975398] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1700worker2 # [ 1.976498] systemd[1]: Expecting device /dev/disk/by-label/nixos...1701worker2 # [ 1.977316] systemd[1]: Reached target Path Units.1702worker2 # [ 1.977938] systemd[1]: Reached target Slice Units.1703worker2 # [ 1.978565] systemd[1]: Reached target Swaps.1704worker2 # [ 1.979179] systemd[1]: Reached target Timer Units.1705worker2 # [ 1.980007] systemd[1]: Listening on D-Bus System Message Bus Socket.1706worker2 # [ 1.985538] systemd[1]: Listening on Journal Socket (/dev/log).1707worker2 # [ 1.985736] systemd[1]: Listening on Journal Sockets.1708worker2 # [ 1.985876] systemd[1]: Listening on udev Control Socket.1709worker2 # [ 1.985998] systemd[1]: Listening on udev Kernel Socket.1710worker2 # [ 1.986021] systemd[1]: Reached target Socket Units.1711worker1 # [ 1.968747] systemd[1]: Queued start job for default target Initrd Default Target.1712worker2 # [ 1.992652] systemd[1]: Starting Create List of Static Device Nodes...1713worker1 # [ 1.980339] systemd[1]: Created slice Slice /system/modprobe.1714worker1 # [ 1.981336] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1715lb # [ 2.031706] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21716worker1 # [ 1.982465] systemd[1]: Expecting device /dev/disk/by-label/nixos...1717worker2 # [ 2.003322] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1718worker2 # [ 2.003437] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1719lb # [ 2.033563] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01720worker1 # [ 1.983382] systemd[1]: Reached target Path Units.1721worker1 # [ 1.984011] systemd[1]: Reached target Slice Units.1722worker1 # [ 1.984622] systemd[1]: Reached target Swaps.1723worker1 # [ 1.985167] systemd[1]: Reached target Timer Units.1724worker1 # [ 1.986049] systemd[1]: Listening on D-Bus System Message Bus Socket.1725worker1 # [ 1.987056] systemd[1]: Listening on Journal Socket (/dev/log).1726worker1 # [ 1.987929] systemd[1]: Listening on Journal Sockets.1727worker1 # [ 1.988696] systemd[1]: Listening on udev Control Socket.1728worker1 # [ 1.989493] systemd[1]: Listening on udev Kernel Socket.1729worker2 # [ 2.012632] systemd[1]: Mounting Kernel Configuration File System...1730worker1 # [ 1.990340] systemd[1]: Reached target Socket Units.1731worker1 # [ 1.992822] systemd[1]: Starting Create List of Static Device Nodes...1732client # [ 2.037970] systemd[1]: Queued start job for default target Initrd Default Target.1733worker1 # [ 2.003214] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1734lb # [ 2.054347] systemd[1]: Queued start job for default target Initrd Default Target.1735worker1 # [ 2.004204] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1736worker1 # [ 2.008870] systemd[1]: Mounting Kernel Configuration File System...1737client # [ 2.051107] systemd[1]: Created slice Slice /system/modprobe.1738client # [ 2.052156] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1739client # [ 2.053134] systemd[1]: Expecting device /dev/disk/by-label/nixos...1740client # [ 2.054104] systemd[1]: Reached target Path Units.1741client # [ 2.054131] systemd[1]: Reached target Slice Units.1742client # [ 2.054151] systemd[1]: Reached target Swaps.1743client # [ 2.054169] systemd[1]: Reached target Timer Units.1744client # [ 2.054379] systemd[1]: Listening on D-Bus System Message Bus Socket.1745client # [ 2.054513] systemd[1]: Listening on Journal Socket (/dev/log).1746client # [ 2.054666] systemd[1]: Listening on Journal Sockets.1747client # [ 2.054812] systemd[1]: Listening on udev Control Socket.1748client # [ 2.054941] systemd[1]: Listening on udev Kernel Socket.1749client # [ 2.054960] systemd[1]: Reached target Socket Units.1750client # [ 2.062964] systemd[1]: Starting Create List of Static Device Nodes...1751lb # [ 2.066444] systemd[1]: Created slice Slice /system/modprobe.1752lb # [ 2.077920] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1753lb # [ 2.078988] systemd[1]: Expecting device /dev/disk/by-label/nixos...1754lb # [ 2.080078] systemd[1]: Reached target Path Units.1755lb # [ 2.080738] systemd[1]: Reached target Slice Units.1756lb # [ 2.081425] systemd[1]: Reached target Swaps.1757lb # [ 2.082057] systemd[1]: Reached target Timer Units.1758lb # [ 2.082943] systemd[1]: Listening on D-Bus System Message Bus Socket.1759worker1 # [ 2.034211] systemd[1]: Starting Journal Service...1760lb # [ 2.084042] systemd[1]: Listening on Journal Socket (/dev/log).1761client # [ 2.073958] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1762lb # [ 2.084224] systemd[1]: Listening on Journal Sockets.1763lb # [ 2.084353] systemd[1]: Listening on udev Control Socket.1764client # [ 2.074897] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1765lb # [ 2.084466] systemd[1]: Listening on udev Kernel Socket.1766lb # [ 2.084502] systemd[1]: Reached target Socket Units.1767client # [ 2.078215] systemd[1]: Mounting Kernel Configuration File System...1768lb # [ 2.090087] systemd[1]: Starting Create List of Static Device Nodes...1769worker2 # [ 2.060115] systemd[1]: Starting Journal Service...1770lb # [ 2.097013] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1771lb # [ 2.098012] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1772worker1 # [ 2.064289] systemd[1]: Starting Load Kernel Modules...1773worker1 # [ 2.064473] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1774worker1 # [ 2.068344] systemd[1]: Starting Coldplug All udev Devices...1775client # [ 2.105668] systemd[1]: Starting Journal Service...1776worker2 # [ 2.102518] systemd[1]: Starting Load Kernel Modules...1777worker2 # [ 2.103527] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1778worker1 # [ 2.091146] systemd[1]: Finished Create List of Static Device Nodes.1779worker2 # [ 2.119504] systemd[1]: Starting Coldplug All udev Devices...1780worker1 # [ 2.092388] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1781worker1 # [ 2.092733] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1782lb # [ 2.143064] systemd[1]: Mounting Kernel Configuration File System...1783worker2 # [ 2.125069] systemd[1]: Finished Create List of Static Device Nodes.1784client # [ 2.136194] systemd[1]: Starting Load Kernel Modules...1785client # [ 2.136390] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1786worker2 # [ 2.127403] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1787worker1 # [ 2.112332] systemd-journald[73]: Collecting audit messages is disabled.1788worker2 # [ 2.139540] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1789worker2 # [ 2.140065] systemd[1]: Mounted Kernel Configuration File System.1790lb # [ 2.168184] systemd[1]: Starting Journal Service...1791client # [ 2.158029] systemd[1]: Starting Coldplug All udev Devices...1792worker2 # [ 2.147799] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1793client # [ 2.173617] systemd[1]: Finished Create List of Static Device Nodes.1794client # [ 2.175748] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1795lb # [ 2.196707] systemd[1]: Starting Load Kernel Modules...1796lb # [ 2.199583] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1797client # [ 2.197869] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1798lb # [ 2.213453] systemd[1]: Starting Coldplug All udev Devices...1799worker1 # [ 2.163219] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1800client # [ 2.207710] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1801worker1 # [ 2.169149] systemd[1]: Mounted Kernel Configuration File System.1802lb # [ 2.224142] systemd[1]: Finished Create List of Static Device Nodes.1803client # [ 2.214243] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1804client # [ 2.214853] systemd[1]: Mounted Kernel Configuration File System.1805worker2 # [ 2.199499] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1806worker2 # [ 2.203153] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1807client # [ 2.221025] systemd-journald[73]: Collecting audit messages is disabled.1808client # [ 2.223007] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1809lb # [ 2.233428] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1810lb # [ 2.233869] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1811lb # [ 2.234266] systemd[1]: Mounted Kernel Configuration File System.1812lb # [ 2.240387] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1813worker2 # [ 2.222459] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01814worker2 # [ 2.222741] [drm] features: -virgl +edid -resource_blob -host_visible1815client # [ 2.238353] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01816worker2 # [ 2.222753] [drm] features: -context_init1817client # [ 2.238624] [drm] features: -virgl +edid -resource_blob -host_visible1818client # [ 2.238635] [drm] features: -context_init1819client # [ 2.239412] [drm] number of scanouts: 11820client # [ 2.239434] [drm] number of cap sets: 01821worker2 # [ 2.228092] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1822worker2 # [ 2.237090] [drm] number of scanouts: 11823worker2 # [ 2.237135] [drm] number of cap sets: 01824worker2 # [ 2.239007] systemd[1]: Starting Create Static Device Nodes in /dev...1825client # [ 2.261774] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1826client # [ 2.261806] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01827lb # [ 2.279344] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1828worker1 # [ 2.229250] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1829worker2 # [ 2.249928] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1830worker2 # [ 2.249963] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01831worker1 # [ 2.239195] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1832worker1 # [ 2.244568] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01833worker1 # [ 2.244842] [drm] features: -virgl +edid -resource_blob -host_visible1834worker1 # [ 2.244853] [drm] features: -context_init1835worker1 # [ 2.245692] [drm] number of scanouts: 11836worker1 # [ 2.245715] [drm] number of cap sets: 01837client # [ 2.287871] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1838worker2 # [ 2.271523] systemd-journald[73]: Collecting audit messages is disabled.1839lb # [ 2.291868] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1840client # [ 2.294327] systemd[1]: Starting Create Static Device Nodes in /dev...1841worker1 # [ 2.265324] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1842worker1 # [ 2.265363] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01843client # [ 2.310345] Console: switching to colour frame buffer device 160x501844worker1 # [ 2.275828] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1845client # [ 2.310994] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1846worker2 # [ 2.306070] Console: switching to colour frame buffer device 160x501847worker2 # [ 2.310121] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1848worker1 # [ 2.294853] systemd[1]: Starting Create Static Device Nodes in /dev...1849worker1 # [ 2.299375] Console: switching to colour frame buffer device 160x501850client # [ 2.341991] systemd[1]: Finished Load Kernel Modules.1851worker1 # [ 2.315715] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1852client # [ 2.353876] systemd[1]: Starting Apply Kernel Variables...1853worker2 # [ 2.343871] systemd[1]: Finished Load Kernel Modules.1854worker2 # [ 2.351613] systemd[1]: Starting Apply Kernel Variables...1855worker1 # [ 2.331786] systemd[1]: Finished Load Kernel Modules.1856lb # [ 2.368273] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01857lb # [ 2.368553] [drm] features: -virgl +edid -resource_blob -host_visible1858lb # [ 2.368564] [drm] features: -context_init1859lb # [ 2.369368] [drm] number of scanouts: 11860lb # [ 2.369390] [drm] number of cap sets: 01861lb # [ 2.376202] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1862lb # [ 2.376226] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01863worker1 # [ 2.351622] systemd[1]: Starting Apply Kernel Variables...1864client # [ 2.393791] systemd[1]: Finished Create Static Device Nodes in /dev.1865client # [ 2.394157] systemd[1]: Reached target Preparation for Local File Systems.1866client # [ 2.394219] systemd[1]: Reached target Local File Systems.1867client # [ 2.405924] systemd[1]: Starting Rule-based Manager for Device Events and Files...1868lb # [ 2.408214] Console: switching to colour frame buffer device 160x501869lb # [ 2.408891] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1870worker1 # [ 2.400034] systemd[1]: Finished Create Static Device Nodes in /dev.1871worker1 # [ 2.402541] systemd[1]: Reached target Preparation for Local File Systems.1872worker1 # [ 2.404907] systemd[1]: Reached target Local File Systems.1873lb # [ 2.451660] systemd[1]: Finished Load Kernel Modules.1874lb # [ 2.453366] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1875lb # [ 2.455829] systemd[1]: Starting Apply Kernel Variables...1876worker2 # [ 2.434836] systemd[1]: Finished Create Static Device Nodes in /dev.1877worker2 # [ 2.435247] systemd[1]: Reached target Preparation for Local File Systems.1878worker2 # [ 2.435292] systemd[1]: Reached target Local File Systems.1879lb # [ 2.468056] systemd[1]: Starting Create Static Device Nodes in /dev...1880worker2 # [ 2.440183] systemd[1]: Starting Rule-based Manager for Device Events and Files...1881client # [ 2.458093] systemd[1]: Finished Apply Kernel Variables.1882worker1 # [ 2.420765] systemd[1]: Starting Rule-based Manager for Device Events and Files...1883lb # [ 2.472545] systemd-journald[73]: Collecting audit messages is disabled.1884client # [ 2.452704] systemd-modules-load[74]: Inserted module 'dm_mod'1885client # [ 2.454062] systemd-modules-load[74]: Module 'virtio_balloon' is built in1886client # [ 2.455265] systemd-modules-load[74]: Module 'virtio_console' is built in[ 2.474374] systemd[1]: Started Journal Service.1887worker1 # [ 2.440834] systemd[1]: Finished Apply Kernel Variables.1888worker2 # [ 2.459436] systemd[1]: Finished Apply Kernel Variables.1889lb # [ 2.529145] systemd[1]: Finished Apply Kernel Variables.1890worker2 # [ 2.513596] systemd[1]: Started Journal Service.1891client # 1892client # [ 2.525897] systemd-modules-load[74]: Inserted module 'virtio_gpu'1893worker2 # [ 2.512582] systemd-modules-load[74]: Inserted module 'dm_mod'1894client # [ 2.527024] systemd-modules-load[74]: Module 'virtio_rng' is built in1895worker2 # [ 2.513872] systemd-modules-load[74]: Module 'virtio_balloon' is built in1896worker2 # [ 2.515329] systemd-modules-load[74]: Module 'virtio_console' is built in1897worker1 # [ 2.509395] systemd[1]: Started Journal Service.1898worker2 # [ 2.525003] systemd-modules-load[74]: Inserted module 'virtio_gpu'1899worker1 # [ 2.504567] systemd-modules-load[74]: Inserted module 'dm_mod'1900worker1 # [ 2.506083] systemd-modules-load[74]: Module 'virtio_balloon' is built in1901worker2 # [ 2.532528] systemd-modules-load[74]: Module 'virtio_rng' is built in1902client # [ 2.551386] systemd[1]: Starting Create System Files and Directories...1903worker2 # [ 2.539270] systemd[1]: Starting Create System Files and Directories...1904worker1 # [ 2.516743] systemd-modules-load[74]: Module 'virtio_console' is built in1905worker1 # [ 2.518052] systemd-modules-load[74]: Inserted module 'virtio_gpu'1906worker1 # [ 2.519104] systemd-modules-load[74]: Module 'virtio_rng' is built in1907worker1 # [ 2.532480] systemd[1]: Starting Create System Files and Directories...1908worker1 # [ 2.535251] systemd-udevd[81]: Using default interface naming scheme 'v261'.1909lb # [ 2.540215] systemd[1]: Finished Create Static Device Nodes in /dev.1910lb # [ 2.625636] systemd[1]: Reached target Preparation for Local File Systems.1911lb # [ 2.626011] systemd[1]: Reached target Local File Systems.1912lb # [ 2.647942] systemd[1]: Starting Rule-based Manager for Device Events and Files...1913client # [ 2.655385] systemd[1]: Finished Create System Files and Directories.1914worker1 # [ 2.630704] systemd[1]: Finished Create System Files and Directories.1915worker2 # [ 2.653606] systemd[1]: Finished Create System Files and Directories.1916worker1 # [ 2.652525] systemd[1]: Started Rule-based Manager for Device Events and Files.1917worker2 # [ 2.686172] systemd-udevd[80]: Using default interface naming scheme 'v261'.1918client # [ 2.715683] systemd-udevd[81]: Using default interface naming scheme 'v261'.1919lb # [ 2.755259] systemd[1]: Started Journal Service.1920worker2 # [ 2.723547] systemd[1]: Started Rule-based Manager for Device Events and Files.1921lb # [ 2.744728] systemd-modules-load[74]: Inserted module 'dm_mod'1922lb # [ 2.745956] systemd-modules-load[74]: Module 'virtio_balloon' is built in1923lb # [ 2.747182] systemd-modules-load[74]: Module 'virtio_console' is built in1924lb # [ 2.752578] systemd-modules-load[74]: Inserted module 'virtio_gpu'1925lb # [ 2.753709] systemd-modules-load[74]: Module 'virtio_rng' is built in1926lb # [ 2.755225] systemd-udevd[81]: Using default interface naming scheme 'v261'.1927lb # [ 2.767342] systemd[1]: Starting Create System Files and Directories...1928client # [ 2.780199] systemd[1]: Started Rule-based Manager for Device Events and Files.1929worker1 # [ 2.770401] systemd[1]: Starting Virtual Console Setup...1930lb # [ 2.819654] systemd[1]: Started Rule-based Manager for Device Events and Files.1931lb # [ 2.834263] systemd[1]: Finished Create System Files and Directories.1932client # [ 2.856334] systemd[1]: Starting Virtual Console Setup...1933lb # [ 2.922571] systemd[1]: Starting Virtual Console Setup...1934worker1 # [ 2.885604] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1935worker1 # [ 2.892771] systemd[1]: Finished Virtual Console Setup.1936client # [ 2.960666] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1937client # [ 2.965690] systemd[1]: Finished Virtual Console Setup.1938lb # [ 3.011605] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1939lb # [ 3.020318] systemd[1]: Finished Virtual Console Setup.1940worker2 # [ 3.018867] systemd[1]: Starting Virtual Console Setup...1941worker2 # [ 3.084610] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1942worker2 # [ 3.176648] systemd[1]: Finished Virtual Console Setup.1943worker1 # [ 3.682075] systemd[1]: Finished Coldplug All udev Devices.1944worker1 # [ 3.683777] systemd[1]: Reached target System Initialization.1945worker1 # [ 3.685176] systemd[1]: Reached target Basic System.1946client # [ 3.775785] systemd[1]: Finished Coldplug All udev Devices.1947client # [ 3.777611] systemd[1]: Reached target System Initialization.1948client # [ 3.779096] systemd[1]: Reached target Basic System.1949worker2 # [ 3.814556] systemd[1]: Finished Coldplug All udev Devices.1950worker2 # [ 3.815715] systemd[1]: Reached target System Initialization.1951worker2 # [ 3.816668] systemd[1]: Reached target Basic System.1952lb # [ 3.880730] systemd[1]: Finished Coldplug All udev Devices.1953lb # [ 3.882938] systemd[1]: Reached target System Initialization.1954lb # [ 3.889822] systemd[1]: Reached target Basic System.1955worker1 # [ 3.904577] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1956client # [ 3.991925] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1957worker1 # [ 3.958138] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1958worker1 # [ 3.962617] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1959client # [ 4.041688] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1960client # [ 4.048225] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1961worker2 # [ 4.071323] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1962worker2 # [ 4.110537] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1963worker2 # [ 4.116345] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line.1964worker1 # [ 4.097339] systemd[1]: Found device /dev/disk/by-label/nixos.1965client # [ 4.139107] systemd[1]: Found device /dev/disk/by-label/nixos.1966client # [ 4.142212] systemd[1]: Reached target Initrd Root Device.1967client # [ 4.152099] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1968worker2 # [ 4.177369] systemd[1]: Found device /dev/disk/by-label/nixos.1969worker2 # [ 4.184294] systemd[1]: Reached target Initrd Root Device.1970worker2 # [ 4.188317] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1971worker1 # [ 4.171447] systemd[1]: Reached target Initrd Root Device.1972client # [ 4.213146] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1973client # [ 4.222967] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1974lb # [ 4.241899] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1975client # [ 4.239827] systemd[1]: Mounting /sysroot...1976worker1 # [ 4.243634] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1977lb # [ 4.307034] (udev-worker)[102]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1978lb # [ 4.317200] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1979client # [ 4.365097] EXT4-fs (vda): mounted filesystem 3a622939-5152-47d5-980c-5cbc2f36a8b3 r/w with ordered data mode. Quota mode: none.1980client # [ 4.359256] systemd[1]: Mounted /sysroot.1981client # [ 4.362430] systemd[1]: Reached target Initrd Root File System.1982client # [ 4.376235] systemd[1]: Starting Mountpoints Configured in the Real Root...1983lb # [ 4.392464] systemd[1]: Found device /dev/disk/by-label/nixos.1984lb # [ 4.395746] systemd[1]: Reached target Initrd Root Device.1985lb # [ 4.398759] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1986worker2 # [ 4.390316] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1987client # [ 4.413261] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1988client # [ 4.420169] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1989worker2 # [ 4.408448] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1990worker2 # [ 4.409655] systemd[1]: Mounting /sysroot...1991client # [ 4.425662] systemd[1]: Reloading...1992worker2 # [ 4.545115] EXT4-fs (vda): mounted filesystem 3b572f61-b666-4191-94cd-36fe463a0b36 r/w with ordered data mode. Quota mode: none.1993worker2 # [ 4.537187] systemd[1]: Mounted /sysroot.1994worker2 # [ 4.539536] systemd[1]: Reached target Initrd Root File System.1995lb # [ 4.566718] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1996worker2 # [ 4.544211] systemd[1]: Starting Mountpoints Configured in the Real Root...1997worker1 # [ 4.530397] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1998worker2 # [ 4.564360] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1999worker1 # [ 4.541602] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.2000lb # [ 4.587008] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.
loading 1,374 hidden lines…
3375worker2 # [ 20.690167] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3376worker2 # [ 20.694960] systemd[1]: Stopped Virtual Console Setup.3377client # [ 20.708946] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3378worker2 # [ 20.702331] systemd[1]: Starting Virtual Console Setup...3379worker2 # [ 20.714654] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3380client # [ 20.764737] systemd-logind[451]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3381worker2 # [ 20.774825] systemd-logind[598]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3382client # [ 20.928172] systemd-vconsole-setup[670]: Configuration of first virtual console was skipped, ignoring remaining ones.3383client # [ 20.932122] systemd[1]: Finished Virtual Console Setup.3384worker1 # [ 20.899300] dhcpcd[676]: eth0: soliciting an IPv6 router3385worker1 # [ 20.900481] dhcpcd[676]: eth0: Router Advertisement from fe80::23386worker1 # [ 20.901339] dhcpcd[676]: eth0: adding address fec0::5054:ff:fe12:3456/643387worker1 # [ 20.902757] dhcpcd[676]: eth0: adding route to fec0::/643388worker1 # [ 20.903481] dhcpcd[676]: eth0: adding default route via fe80::23389worker2 # [ 21.110569] systemd-vconsole-setup[792]: Configuration of first virtual console was skipped, ignoring remaining ones.3390worker2 # [ 21.116353] systemd[1]: Finished Virtual Console Setup.3391lb # [ 21.323632] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33392lb # [ 21.344447] dhcpcd[710]: eth0: soliciting an IPv6 router3393lb # [ 21.344650] dhcpcd[710]: eth0: Router Advertisement from fe80::23394lb # [ 21.344697] dhcpcd[710]: eth0: adding address fec0::5054:ff:fe12:3456/643395lb # [ 21.344737] dhcpcd[710]: eth0: adding route to fec0::/643396lb # [ 21.344779] dhcpcd[710]: eth0: adding default route via fe80::23397worker2 # [ 21.857496] dhcpcd[738]: eth0: soliciting an IPv6 router3398lb # [ 21.877243] systemd[1]: Starting Virtual Console Setup...3399worker2 # [ 21.858667] dhcpcd[738]: eth0: Router Advertisement from fe80::23400worker2 # [ 21.859586] dhcpcd[738]: eth0: adding address fec0::5054:ff:fe12:3456/643401worker2 # [ 21.860972] dhcpcd[738]: eth0: adding route to fec0::/643402worker2 # [ 21.862143] dhcpcd[738]: eth0: adding default route via fe80::23403lb # [ 21.927321] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3404lb # [ 21.956968] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3405lb # [ 21.964426] systemd[1]: Stopped Virtual Console Setup.3406lb # [ 21.981956] systemd[1]: Starting Virtual Console Setup...3407lb # [ 22.039546] systemd-logind[545]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3408client # [ 22.104683] dhcpcd[582]: eth0: soliciting an IPv6 router3409client # [ 22.108502] dhcpcd[582]: eth0: Router Advertisement from fe80::23410client # [ 22.111192] dhcpcd[582]: eth0: adding address fec0::5054:ff:fe12:3456/643411client # [ 22.114303] dhcpcd[582]: eth0: adding route to fec0::/643412client # [ 22.116645] dhcpcd[582]: eth0: adding default route via fe80::23413lb # [ 22.433133] systemd-vconsole-setup[795]: Configuration of first virtual console was skipped, ignoring remaining ones.3414lb # [ 22.442124] systemd[1]: Finished Virtual Console Setup.3415lb # [ 22.622620] postgresql-pre-start[737]: selecting default time zone ... UTC3416lb # [ 22.626729] postgresql-pre-start[737]: creating configuration files ... ok3417lb # [ 22.918183] postgresql-pre-start[737]: running bootstrap script ... ok3418lb # [ 23.647981] postgresql-pre-start[737]: performing post-bootstrap initialization ... ok3419lb # [ 23.739994] dhcpcd[710]: eth0: leased 10.0.2.15 for 86400 seconds3420lb # [ 23.741622] dhcpcd[710]: eth0: adding route to 10.0.2.0/243421lb # [ 23.742824] dhcpcd[710]: eth0: adding default route via 10.0.2.23422lb # [ 23.866614] postgresql-pre-start[737]: syncing data to disk ... ok3423lb # [ 23.868943] postgresql-pre-start[737]: initdb: warning: enabling "trust" authentication for local connections3424lb # [ 23.871703] postgresql-pre-start[737]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3425lb # [ 23.874338] postgresql-pre-start[737]: Success. You can now start the database server using:3426lb # [ 23.875465] postgresql-pre-start[737]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3427lb # [ 23.885162] systemd[1]: Started DHCP Client.3428lb # [ 23.890940] systemd[1]: Reached target Network is Online.3429lb # [ 23.894266] systemd[1]: Started Envoy reverse proxy.3430lb # [ 23.905761] systemd[1]: Started mock-oidc.service.3431lb # [ 24.030509] mock-oidc-server[874]: Mock OIDC Server running3432lb # [ 24.032214] mock-oidc-server[874]: OIDC Address: 192.168.1.2:80803433lb # [ 24.033102] mock-oidc-server[874]: Issue Address: 0.0.0.0:80813434lb # [ 24.033952] mock-oidc-server[874]: Issuer: http://192.168.1.2:8080/oidc3435lb # [ 24.034917] mock-oidc-server[874]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3436lb # [ 24.036177] mock-oidc-server[874]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3437lb # [ 24.039230] mock-oidc-server[874]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3438lb # [ 24.100619] postgres[876]: [876] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3439lb # [ 24.106943] postgres[876]: [876] LOG: listening on IPv6 address "::1", port 54323440lb # [ 24.108512] postgres[876]: [876] LOG: listening on IPv4 address "127.0.0.1", port 54323441lb # [ 24.110469] postgres[876]: [876] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3442lb # [ 24.133872] postgres[898]: [898] LOG: database system was shut down at 2026-09-20 12:46:33 GMT3443lb # [ 24.145117] postgres[876]: [876] LOG: database system is ready to accept connections3444lb # [ 24.156695] systemd[1]: Started PostgreSQL Server.3445lb # [ 24.169224] systemd[1]: Starting PostgreSQL Setup Scripts...3446lb # [ 24.540577] postgresql-setup-start[914]: CREATE DATABASE3447lb # [ 24.617580] postgresql-setup-start[919]: CREATE ROLE3448lb # [ 24.651767] postgresql-setup-start[921]: ALTER DATABASE3449lb # [ 24.658777] systemd[1]: Finished PostgreSQL Setup Scripts.3450lb # [ 24.661557] systemd[1]: Reached target PostgreSQL.3451lb # [ 24.884297] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3452lb # [ 24.886216] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:469] statically linked extensions:3453lb # [ 24.887685] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3454lb # [ 24.893004] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3455lb # [ 24.895216] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3456lb # [ 24.897544] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3457lb # [ 24.900381] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3458lb # [ 24.902247] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3459lb # [ 24.905483] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3460lb # [ 24.907571] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23461lb # [ 24.909618] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3462lb # [ 24.912675] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3463lb # [ 24.932971] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3464lb # [ 24.939054] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3465lb # [ 24.942876] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3466lb # [ 24.950833] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3467lb # [ 24.958729] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3468lb # [ 24.960955] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3469lb # [ 24.964099] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3470lb # [ 24.966554] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3471lb # [ 24.971454] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3472lb # [ 24.974722] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3473lb # [ 24.978762] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3474lb # [ 24.981275] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3475lb # [ 24.988976] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3476lb # [ 24.991823] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3477lb # [ 24.994887] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23478lb # [ 25.000214] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3479lb # [ 25.002321] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3480lb # [ 25.005283] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3481lb # [ 25.007000] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3482lb # [ 25.010680] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3483lb # [ 25.013865] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3484lb # [ 25.015916] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3485lb # [ 25.018555] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3486lb # [ 25.021126] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3487lb # [ 25.023792] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3488lb # [ 25.025870] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3489lb # [ 25.029723] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3490lb # [ 25.032876] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3491lb # [ 25.035874] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3492lb # [ 25.038406] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3493lb # [ 25.040788] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3494lb # [ 25.042911] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3495lb # [ 25.045304] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3496lb # [ 25.047527] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3497client # [ 25.066214] dhcpcd[582]: eth0: leased 10.0.2.15 for 86400 seconds3498worker2 # [ 25.061064] dhcpcd[738]: eth0: leased 10.0.2.15 for 86400 seconds3499worker2 # [ 25.065857] dhcpcd[738]: eth0: adding route to 10.0.2.0/243500worker2 # [ 25.068768] dhcpcd[738]: eth0: adding default route via 10.0.2.23501lb # [ 25.059594] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3502lb # [ 25.092107] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3503lb # [ 25.095015] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3504lb # [ 25.097120] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3505lb # [ 25.100528] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3506lb # [ 25.102373] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3507lb # [ 25.104441] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3508lb # [ 25.106391] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3509lb # [ 25.109133] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3510worker1 # [ 25.068888] dhcpcd[676]: eth0: leased 10.0.2.15 for 86400 seconds3511lb # [ 25.111200] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3512lb # [ 25.113395] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3513worker1 # [ 25.073446] dhcpcd[676]: eth0: adding route to 10.0.2.0/243514worker1 # [ 25.076742] dhcpcd[676]: eth0: adding default route via 10.0.2.23515lb # [ 25.115576] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3516lb # [ 25.123427] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3517lb # [ 25.126530] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3518lb # [ 25.133660] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3519lb # [ 25.136793] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3520lb # [ 25.140509] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3521lb # [ 25.144541] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3522lb # [ 25.147128] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3523lb # [ 25.151650] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3524lb # [ 25.155739] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3525lb # [ 25.159052] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3526lb # [ 25.160897] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3527lb # [ 25.164207] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3528lb # [ 25.166173] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3529lb # [ 25.169304] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3530lb # [ 25.174251] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3531lb # [ 25.177196] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3532lb # [ 25.179457] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3533lb # [ 25.186534] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3534lb # [ 25.189082] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3535lb # [ 25.190943] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3536lb # [ 25.193960] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3537lb # [ 25.197260] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3538lb # [ 25.200201] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3539lb # [ 25.205251] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3540lb # [ 25.207728] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3541lb # [ 25.209719] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3542lb # [ 25.211794] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3543lb # [ 25.219724] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3544lb # [ 25.222812] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3545lb # [ 25.224853] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3546lb # [ 25.229800] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3547lb # [ 25.243828] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3548client # [ 25.070480] dhcpcd[582]: eth0: adding route to 10.0.2.0/243549client # [ 25.070721] dhcpcd[582]: eth0: adding default route via 10.0.2.23550client # [ 25.240589] systemd[1]: Started DHCP Client.3551lb # [ 25.246948] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3552client # [ 25.245058] systemd[1]: Reached target Multi-User System.3553client # [ 25.246042] systemd[1]: Startup finished in 1.153s (kernel) + 8.357s (initrd) + 15.734s (userspace) = 25.244s.3554lb # [ 25.249319] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3555worker2 # [ 25.237424] systemd[1]: Started DHCP Client.3556lb # [ 25.256505] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83557worker2 # [ 25.239464] systemd[1]: Reached target Multi-User System.3558worker2 # [ 25.240746] systemd[1]: Startup finished in 1.140s (kernel) + 8.334s (initrd) + 15.763s (userspace) = 25.239s.3559lb # [ 25.259100] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3560lb # [ 25.261795] envoy[872]: [2026-09-20 12:46:34.310][872][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3561lb # [ 25.267027] envoy[872]: [2026-09-20 12:46:34.311][872][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23562lb # [ 25.270920] envoy[872]: [2026-09-20 12:46:34.311][872][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3563lb # [ 25.274437] envoy[872]: [2026-09-20 12:46:34.311][872][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3564worker1 # [ 25.244959] systemd[1]: Started DHCP Client.3565lb # [ 25.283535] envoy[872]: [2026-09-20 12:46:34.311][872][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3566worker1 # [ 25.246802] systemd[1]: Reached target Multi-User System.3567lb # [ 25.288657] envoy[872]: [2026-09-20 12:46:34.311][872][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3568worker1 # [ 25.248569] systemd[1]: Startup finished in 1.117s (kernel) + 8.054s (initrd) + 16.076s (userspace) = 25.247s.3569lb # [ 25.291361] envoy[872]: [2026-09-20 12:46:34.311][872][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13570lb # [ 25.294312] envoy[872]: [2026-09-20 12:46:34.311][872][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3571lb # [ 25.297042] envoy[872]: [2026-09-20 12:46:34.311][872][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3572lb # [ 25.299737] envoy[872]: [2026-09-20 12:46:34.311][872][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3573lb # [ 25.305803] envoy[872]: [2026-09-20 12:46:34.311][872][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3574lb # [ 25.309516] envoy[872]: [2026-09-20 12:46:34.311][872][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3575lb # [ 25.318381] envoy[872]: [2026-09-20 12:46:34.352][872][info][main] [source/server/server.cc:531] HTTP header map info:3576lb # [ 25.321388] envoy[872]: [2026-09-20 12:46:34.354][872][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3577lb # [ 25.338097] envoy[872]: [2026-09-20 12:46:34.354][872][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3578lb # [ 25.339780] envoy[872]: [2026-09-20 12:46:34.354][872][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3579lb # [ 25.350873] envoy[872]: [2026-09-20 12:46:34.354][872][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3580lb # [ 25.353554] envoy[872]: [2026-09-20 12:46:34.550][872][info][main] [source/server/server.cc:968] runtime: {}3581lb # [ 25.355667] envoy[872]: [2026-09-20 12:46:34.578][872][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3582lb # [ 25.357759] envoy[872]: [2026-09-20 12:46:34.578][872][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013583lb # [ 25.360174] envoy[872]: [2026-09-20 12:46:34.578][872][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013584lb # [ 25.361992] envoy[872]: [2026-09-20 12:46:34.586][872][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3585lb # [ 25.363704] envoy[872]: [2026-09-20 12:46:34.586][872][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3586lb # [ 25.367235] envoy[872]: [2026-09-20 12:46:34.586][872][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3587worker2 # [ 25.370540] systemd[1]: Reached target Network is Online.3588lb # [ 25.389824] envoy[872]: [2026-09-20 12:46:34.816][872][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3589worker1 # [ 25.353122] systemd[1]: Starting Nix worker-protocol over gRPC...3590worker2 # [ 25.378905] systemd[1]: Starting scheduler-token.service...3591lb # [ 25.403761] envoy[872]: [2026-09-20 12:46:34.829][872][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3592lb # [ 25.407469] envoy[872]: [2026-09-20 12:46:34.834][872][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3593lb # [ 25.412124] envoy[872]: [2026-09-20 12:46:34.834][872][info][main] [source/server/server.cc:1077] starting main dispatch loop3594worker2 # [ 25.496737] systemd[1]: scheduler-token.service: Deactivated successfully.3595worker2 # [ 25.502872] systemd[1]: Finished scheduler-token.service.3596worker2 # [ 25.504271] systemd[1]: scheduler-token.service: Consumed 45ms CPU time over 120ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3597worker2 # [ 25.509497] systemd[1]: Starting Nix worker-protocol over gRPC...3598worker1 # [ 25.596342] nix-grpc-daemon[786]: ts=2026-09-20T12:46:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3599worker1 # [ 25.608555] nix-grpc-daemon[786]: ts=2026-09-20T12:46:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3600worker1 # [ 25.610923] nix-grpc-daemon[786]: ts=2026-09-20T12:46:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13601worker1 # [ 25.659974] nix-grpc-daemon[786]: ts=2026-09-20T12:46:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3602worker1 # [ 25.664844] systemd[1]: Started Nix worker-protocol over gRPC.3603worker1 # [ 25.697038] nix-grpc-daemon[786]: ts=2026-09-20T12:46:35Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3604lb # [ 25.738866] envoy[872]: [2026-09-20 12:46:35.165][872][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3605lb # [ 25.741852] envoy[872]: [2026-09-20 12:46:35.165][872][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3606lb # [ 25.743621] envoy[872]: [2026-09-20 12:46:35.165][872][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3607lb # [ 25.745446] envoy[872]: [2026-09-20 12:46:35.165][872][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3608worker2 # [ 25.747910] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3609worker2 # [ 25.764730] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3610worker2 # [ 25.767391] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13611worker2 # [ 25.824217] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3612worker2 # [ 25.830920] systemd[1]: Started Nix worker-protocol over gRPC.3613worker2 # [ 25.870402] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=scheduler_connected addr=lb:500513614worker2 # [ 25.876122] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3615worker1 # [ 25.897827] nix-grpc-daemon[786]: ts=2026-09-20T12:46:35Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3616worker2 # [ 26.077869] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=scheduler_connected addr=lb:500513617worker2 # [ 26.082184] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3618worker2 # [ 26.283905] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=scheduler_connected addr=lb:500513619worker2 # [ 26.289894] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3620worker1 # [ 26.298659] nix-grpc-daemon[786]: ts=2026-09-20T12:46:35Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3621worker2 # [ 26.490693] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=scheduler_connected addr=lb:500513622worker2 # [ 26.493448] nix-grpc-daemon[858]: ts=2026-09-20T12:46:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3623worker2 # [ 26.695257] nix-grpc-daemon[858]: ts=2026-09-20T12:46:36Z level=info event=scheduler_connected addr=lb:500513624worker2 # [ 26.701025] nix-grpc-daemon[858]: ts=2026-09-20T12:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3625worker2 # [ 26.902498] nix-grpc-daemon[858]: ts=2026-09-20T12:46:36Z level=info event=scheduler_connected addr=lb:500513626worker2 # [ 26.904750] nix-grpc-daemon[858]: ts=2026-09-20T12:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker2 # [ 27.106173] nix-grpc-daemon[858]: ts=2026-09-20T12:46:36Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 27.111759] nix-grpc-daemon[858]: ts=2026-09-20T12:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3629worker1 # [ 27.102041] nix-grpc-daemon[786]: ts=2026-09-20T12:46:36Z level=info event=scheduler_connected addr=lb:500513630worker1 # [ 27.102412] nix-grpc-daemon[786]: ts=2026-09-20T12:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3631worker2 # [ 27.313359] nix-grpc-daemon[858]: ts=2026-09-20T12:46:36Z level=info event=scheduler_connected addr=lb:500513632worker2 # [ 27.318840] nix-grpc-daemon[858]: ts=2026-09-20T12:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3633worker1 # [ 27.303448] nix-grpc-daemon[786]: ts=2026-09-20T12:46:36Z level=info event=scheduler_connected addr=lb:500513634worker1 # [ 27.309380] nix-grpc-daemon[786]: ts=2026-09-20T12:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker2 # [ 27.520490] nix-grpc-daemon[858]: ts=2026-09-20T12:46:36Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 27.526175] nix-grpc-daemon[858]: ts=2026-09-20T12:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3637worker1 # [ 27.510565] nix-grpc-daemon[786]: ts=2026-09-20T12:46:36Z level=info event=scheduler_connected addr=lb:500513638worker1 # [ 27.516294] nix-grpc-daemon[786]: ts=2026-09-20T12:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker2 # [ 27.728100] nix-grpc-daemon[858]: ts=2026-09-20T12:46:37Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 27.733921] nix-grpc-daemon[858]: ts=2026-09-20T12:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3641worker1 # [ 27.717203] nix-grpc-daemon[786]: ts=2026-09-20T12:46:37Z level=info event=scheduler_connected addr=lb:500513642worker1 # [ 27.722820] nix-grpc-daemon[786]: ts=2026-09-20T12:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker2 # [ 27.937720] nix-grpc-daemon[858]: ts=2026-09-20T12:46:37Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 27.941991] nix-grpc-daemon[858]: ts=2026-09-20T12:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3645worker1 # [ 27.923731] nix-grpc-daemon[786]: ts=2026-09-20T12:46:37Z level=info event=scheduler_connected addr=lb:500513646worker1 # [ 27.929405] nix-grpc-daemon[786]: ts=2026-09-20T12:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker2 # [ 28.139277] nix-grpc-daemon[858]: ts=2026-09-20T12:46:37Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 28.145106] nix-grpc-daemon[858]: ts=2026-09-20T12:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3649worker1 # [ 28.131490] nix-grpc-daemon[786]: ts=2026-09-20T12:46:37Z level=info event=scheduler_connected addr=lb:500513650worker1 # [ 28.135820] nix-grpc-daemon[786]: ts=2026-09-20T12:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker2 # [ 28.346500] nix-grpc-daemon[858]: ts=2026-09-20T12:46:37Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 28.352007] nix-grpc-daemon[858]: ts=2026-09-20T12:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3653worker1 # [ 28.331553] nix-grpc-daemon[786]: ts=2026-09-20T12:46:37Z level=info event=scheduler_connected addr=lb:500513654worker1 # [ 28.337549] nix-grpc-daemon[786]: ts=2026-09-20T12:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker2 # [ 28.553493] nix-grpc-daemon[858]: ts=2026-09-20T12:46:37Z level=info event=scheduler_connected addr=lb:500513656worker1 # [ 28.538263] nix-grpc-daemon[786]: ts=2026-09-20T12:46:37Z level=info event=scheduler_connected addr=lb:500513657worker2 # [ 28.559286] nix-grpc-daemon[858]: ts=2026-09-20T12:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3658worker1 # [ 28.542720] nix-grpc-daemon[786]: ts=2026-09-20T12:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker2 # [ 28.760445] nix-grpc-daemon[858]: ts=2026-09-20T12:46:38Z level=info event=scheduler_connected addr=lb:500513660worker2 # [ 28.763889] nix-grpc-daemon[858]: ts=2026-09-20T12:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3661worker1 # [ 28.743617] nix-grpc-daemon[786]: ts=2026-09-20T12:46:38Z level=info event=scheduler_connected addr=lb:500513662worker1 # [ 28.748445] nix-grpc-daemon[786]: ts=2026-09-20T12:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker2 # [ 28.967933] nix-grpc-daemon[858]: ts=2026-09-20T12:46:38Z level=info event=scheduler_connected addr=lb:500513664worker1 # [ 28.949362] nix-grpc-daemon[786]: ts=2026-09-20T12:46:38Z level=info event=scheduler_connected addr=lb:500513665worker2 # [ 28.972371] nix-grpc-daemon[858]: ts=2026-09-20T12:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3666worker1 # [ 28.953290] nix-grpc-daemon[786]: ts=2026-09-20T12:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker2 # [ 29.169089] nix-grpc-daemon[858]: ts=2026-09-20T12:46:38Z level=info event=scheduler_connected addr=lb:500513668worker2 # [ 29.174819] nix-grpc-daemon[858]: ts=2026-09-20T12:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3669worker1 # [ 29.156886] nix-grpc-daemon[786]: ts=2026-09-20T12:46:38Z level=info event=scheduler_connected addr=lb:500513670worker1 # [ 29.161308] nix-grpc-daemon[786]: ts=2026-09-20T12:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker2 # [ 29.376339] nix-grpc-daemon[858]: ts=2026-09-20T12:46:38Z level=info event=scheduler_connected addr=lb:500513672worker1 # [ 29.357239] nix-grpc-daemon[786]: ts=2026-09-20T12:46:38Z level=info event=scheduler_connected addr=lb:500513673worker2 # [ 29.382255] nix-grpc-daemon[858]: ts=2026-09-20T12:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3674worker1 # [ 29.361512] nix-grpc-daemon[786]: ts=2026-09-20T12:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker2 # [ 29.583644] nix-grpc-daemon[858]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500513676worker1 # [ 29.563027] nix-grpc-daemon[786]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 29.590108] nix-grpc-daemon[858]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3678worker1 # [ 29.568886] nix-grpc-daemon[786]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker2 # [ 29.791425] nix-grpc-daemon[858]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 29.769999] nix-grpc-daemon[786]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 29.795561] nix-grpc-daemon[858]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3682worker1 # [ 29.775473] nix-grpc-daemon[786]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3683worker1 # [ 29.972533] nix-grpc-daemon[786]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500513684worker2 # [ 29.999071] nix-grpc-daemon[858]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500513685worker1 # [ 29.978292] nix-grpc-daemon[786]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3686worker2 # [ 30.003654] nix-grpc-daemon[858]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3687worker2 # [ 30.200379] nix-grpc-daemon[858]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500513688worker1 # [ 30.181272] nix-grpc-daemon[786]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 30.206044] nix-grpc-daemon[858]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3690worker1 # [ 30.185673] nix-grpc-daemon[786]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3691worker1 # [ 30.381428] nix-grpc-daemon[786]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500513692worker2 # [ 30.407352] nix-grpc-daemon[858]: ts=2026-09-20T12:46:39Z level=info event=scheduler_connected addr=lb:500513693worker1 # [ 30.387188] nix-grpc-daemon[786]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3694worker2 # [ 30.413488] nix-grpc-daemon[858]: ts=2026-09-20T12:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3695worker1 # [ 30.588208] nix-grpc-daemon[786]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500513696worker2 # [ 30.614373] nix-grpc-daemon[858]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500513697worker2 # [ 30.617620] nix-grpc-daemon[858]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3698worker1 # [ 30.593811] nix-grpc-daemon[786]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3699worker1 # [ 30.795221] nix-grpc-daemon[786]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500513700worker2 # [ 30.819071] nix-grpc-daemon[858]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500513701worker1 # [ 30.800534] nix-grpc-daemon[786]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3702worker2 # [ 30.824871] nix-grpc-daemon[858]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3703worker1 # [ 30.997338] nix-grpc-daemon[786]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500513704worker1 # [ 31.002929] nix-grpc-daemon[786]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3705worker2 # [ 31.028464] nix-grpc-daemon[858]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500513706worker2 # [ 31.032690] nix-grpc-daemon[858]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3707worker1 # [ 31.205473] nix-grpc-daemon[786]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500513708worker1 # [ 31.208189] nix-grpc-daemon[786]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3709worker2 # [ 31.228883] nix-grpc-daemon[858]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500513710worker2 # [ 31.234483] nix-grpc-daemon[858]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3711worker1 # [ 31.406743] nix-grpc-daemon[786]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500513712worker1 # [ 31.412474] nix-grpc-daemon[786]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3713worker2 # [ 31.435876] nix-grpc-daemon[858]: ts=2026-09-20T12:46:40Z level=info event=scheduler_connected addr=lb:500513714worker2 # [ 31.441474] nix-grpc-daemon[858]: ts=2026-09-20T12:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3715worker1 # [ 31.613628] nix-grpc-daemon[786]: ts=2026-09-20T12:46:41Z level=info event=scheduler_connected addr=lb:500513716worker2 # [ 31.642494] nix-grpc-daemon[858]: ts=2026-09-20T12:46:41Z level=info event=scheduler_connected addr=lb:500513717worker1 # [ 31.619398] nix-grpc-daemon[786]: ts=2026-09-20T12:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3718worker2 # [ 31.648163] nix-grpc-daemon[858]: ts=2026-09-20T12:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3719worker1 # [ 31.820473] nix-grpc-daemon[786]: ts=2026-09-20T12:46:41Z level=info event=scheduler_connected addr=lb:500513720worker1 # [ 31.825959] nix-grpc-daemon[786]: ts=2026-09-20T12:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3721worker2 # [ 31.849381] nix-grpc-daemon[858]: ts=2026-09-20T12:46:41Z level=info event=scheduler_connected addr=lb:500513722worker2 # [ 31.855053] nix-grpc-daemon[858]: ts=2026-09-20T12:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3723worker1 # [ 32.027195] nix-grpc-daemon[786]: ts=2026-09-20T12:46:41Z level=info event=scheduler_connected addr=lb:500513724worker1 # [ 32.033043] nix-grpc-daemon[786]: ts=2026-09-20T12:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3725worker2 # [ 32.058066] nix-grpc-daemon[858]: ts=2026-09-20T12:46:41Z level=info event=scheduler_connected addr=lb:500513726worker2 # [ 32.063925] nix-grpc-daemon[858]: ts=2026-09-20T12:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3727lb # [ 32.229313] rustfs-bucket-start[990]: mb s3://farm3728lb # [ 32.237541] systemd[1]: Finished rustfs-bucket.service.3729lb # [ 32.247713] systemd[1]: Starting niks3 server...3730worker1 # [ 32.236312] nix-grpc-daemon[786]: ts=2026-09-20T12:46:41Z level=info event=scheduler_connected addr=lb:500513731worker1 # [ 32.240594] nix-grpc-daemon[786]: ts=2026-09-20T12:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3732worker2 # [ 32.265555] nix-grpc-daemon[858]: ts=2026-09-20T12:46:41Z level=info event=scheduler_connected addr=lb:500513733worker2 # [ 32.271170] nix-grpc-daemon[858]: ts=2026-09-20T12:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3734worker1 # [ 32.436949] nix-grpc-daemon[786]: ts=2026-09-20T12:46:41Z level=info event=scheduler_connected addr=lb:500513735worker1 # [ 32.442648] nix-grpc-daemon[786]: ts=2026-09-20T12:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3736worker2 # [ 32.472700] nix-grpc-daemon[858]: ts=2026-09-20T12:46:41Z level=info event=scheduler_connected addr=lb:500513737worker2 # [ 32.478251] nix-grpc-daemon[858]: ts=2026-09-20T12:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3738lb # [ 32.503191] postgres[1012]: [1012] ERROR: relation "goose_db_version" does not exist at character 363739lb # [ 32.508208] postgres[1012]: [1012] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3740lb # [ 32.558139] niks3-server[1006]: 2026/09/20 12:46:41 OK 20241026095416_initial_model.sql (34.8ms)3741lb # [ 32.562354] niks3-server[1006]: 2026/09/20 12:46:41 OK 20251210153512_drop_unused_gin_index.sql (4.5ms)3742lb # [ 32.572891] niks3-server[1006]: 2026/09/20 12:46:41 OK 20251218171726_add_pins.sql (9.89ms)3743lb # [ 32.579047] niks3-server[1006]: 2026/09/20 12:46:42 OK 20260628120000_add_object_size_and_stats.sql (6.6ms)3744lb # [ 32.585673] niks3-server[1006]: 2026/09/20 12:46:42 OK 20260905000000_add_claims.sql (6.64ms)3745lb # [ 32.591538] niks3-server[1006]: 2026/09/20 12:46:42 OK 20260920000000_drop_claims.sql (5.6ms)3746lb # [ 32.597129] niks3-server[1006]: 2026/09/20 12:46:42 goose: successfully migrated database to version: 202609200000003747lb # [ 32.603205] niks3-server[1006]: 2026/09/20 12:46:42 OK 1_commit_pending_closure.sql (11.73ms)3748lb # [ 32.607773] niks3-server[1006]: 2026/09/20 12:46:42 OK 2_object_stats_trigger.sql (4.42ms)3749lb # [ 32.609384] niks3-server[1006]: 2026/09/20 12:46:42 goose: up to current file version: 23750lb # [ 32.613504] niks3-server[1006]: 2026/09/20 12:46:42 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3751lb # [ 32.664158] niks3-server[1006]: 2026/09/20 12:46:42 INFO Read proxy enabled — serving cache objects from S33752lb # [ 32.666156] niks3-server[1006]: 2026/09/20 12:46:42 INFO Using socket-activated listener address=0.0.0.0:57513753lb # [ 32.672332] niks3-server[1006]: 2026/09/20 12:46:42 INFO systemd watchdog enabled interval=15s3754lb # [ 32.673477] niks3-server[1006]: 2026/09/20 12:46:42 INFO Starting HTTP server address=0.0.0.0:57513755lb # [ 32.674650] systemd[1]: Started niks3 server.3756lb # [ 32.678148] systemd[1]: Reached target Multi-User System.3757lb # [ 32.679591] systemd[1]: Startup finished in 1.159s (kernel) + 8.355s (initrd) + 23.162s (userspace) = 32.677s.3758lb # [ 32.685871] niks3-server[1006]: 2026/09/20 12:46:42 INFO lead: acquired remote=192.168.1.4:370563759worker1 # [ 32.643676] nix-grpc-daemon[786]: ts=2026-09-20T12:46:42Z level=info event=scheduler_connected addr=lb:500513760worker1 # [ 32.649675] nix-grpc-daemon[786]: ts=2026-09-20T12:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3761worker2 # [ 32.679506] nix-grpc-daemon[858]: ts=2026-09-20T12:46:42Z level=info event=scheduler_take_over3762worker2 # [ 32.684778] nix-grpc-daemon[858]: ts=2026-09-20T12:46:42Z level=info event=scheduler_connected addr=lb:500513763worker2 # [ 32.689031] nix-grpc-daemon[858]: ts=2026-09-20T12:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3764worker1 # [ 32.850972] nix-grpc-daemon[786]: ts=2026-09-20T12:46:42Z level=info event=scheduler_connected addr=lb:500513765worker1 # [ 32.857490] nix-grpc-daemon[786]: ts=2026-09-20T12:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3766worker2 # [ 32.886073] nix-grpc-daemon[858]: ts=2026-09-20T12:46:42Z level=info event=scheduler_connected addr=lb:500513767worker2 # [ 32.911712] nix-grpc-daemon[858]: ts=2026-09-20T12:46:42Z level=info event=oidc_jwks provider=mock keys=13768worker2 # [ 32.916654] nix-grpc-daemon[858]: ts=2026-09-20T12:46:42Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:479663769worker2 # [ 32.922579] nix-grpc-daemon[858]: ts=2026-09-20T12:46:42Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03770worker1 # [ 33.058246] nix-grpc-daemon[786]: ts=2026-09-20T12:46:42Z level=info event=scheduler_connected addr=lb:500513771worker2 # [ 33.084888] nix-grpc-daemon[858]: ts=2026-09-20T12:46:42Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:479663772worker2 # [ 33.088417] nix-grpc-daemon[858]: ts=2026-09-20T12:46:42Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03773lb: (finished: waiting for unit niks3.service, in 12.73 seconds)3774lb: waiting for TCP port 5751 on localhost3775lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3776lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds)3777lb: waiting for unit envoy.service3778lb: (finished: waiting for unit envoy.service, in 0.06 seconds)3779lb: waiting for TCP port 50051 on localhost3780lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3781lb # [ 33.467676] envoy[872]: conn peer=[::1]:42310 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33782lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3783worker2 # [ 33.637255] systemd[1]: Starting scheduler-token.service...3784worker2 # [ 33.735216] systemd[1]: scheduler-token.service: Deactivated successfully.3785worker2 # [ 33.739649] systemd[1]: Finished scheduler-token.service.3786worker2 # [ 33.743256] systemd[1]: scheduler-token.service: Consumed 39ms CPU time over 103ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3787lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3788lb: must succeed: curl -sf localhost:9901/clusters3789lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)3790lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds)3791subtest: one node schedules and both builders hold a WorkerSession on it3792lb: must succeed: curl -sf localhost:9901/clusters3793lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3794worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3795worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)3796lb: must succeed: curl -sf localhost:9901/clusters3797lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3798lb: must succeed: curl -sf localhost:9901/clusters3799lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3800worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'3801worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.07 seconds)3802(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.32 seconds)3803subtest: balancer auth: client cert, bearer token, nothing, unknown CN3804worker2 # [ 34.527249] nix-grpc-daemon[858]: ts=2026-09-20T12:46:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:479743805worker2 # [ 34.545308] systemd[1]: Started Nix Daemon.3806worker2 # [ 34.863675] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)3807worker2 # [ 34.902864] nix-grpc-daemon[858]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 1/5)3808worker2 # [ 34.983164] nix-grpc-daemon[858]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 112 ms (attempt 2/5)3809worker2 # [ 35.098306] nix-grpc-daemon[858]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 3/5)3810worker2 # [ 35.157400] nix-grpc-daemon[858]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 723 ms (attempt 4/5)3811worker2 # [ 35.883851] nix-grpc-daemon[858]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3812worker2 # [ 35.907522] nix-grpc-daemon[858]: ts=2026-09-20T12:46:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:479743813worker2 # [ 35.915535] nix-grpc-daemon[858]: ts=2026-09-20T12:46:45Z level=debug event=path_info_miss path=vjqwk0w01cvrc7s0v48m3lmih9i5s8yp-nixos-system-client-test error="error: path '/nix/store/vjqwk0w01cvrc7s0v48m3lmih9i5s8yp-nixos-system-client-test' is required, but there is no substituter that can build it"3814worker1 # [ 35.913136] nix-grpc-daemon[786]: ts=2026-09-20T12:46:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:588523815worker1 # [ 35.931081] systemd[1]: Started Nix Daemon.3816worker1 # [ 36.198721] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)3817worker1 # [ 36.228183] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5)3818worker1 # [ 36.292049] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 2/5)3819worker1 # [ 36.376490] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 3/5)3820worker1 # [ 36.387986] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 586 ms (attempt 4/5)3821worker1 # [ 36.985459] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3822worker1 # [ 37.001596] nix-grpc-daemon[786]: ts=2026-09-20T12:46:46Z level=debug event=path_info_miss path=vjqwk0w01cvrc7s0v48m3lmih9i5s8yp-nixos-system-client-test error="error: path '/nix/store/vjqwk0w01cvrc7s0v48m3lmih9i5s8yp-nixos-system-client-test' is required, but there is no substituter that can build it"3823client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3824client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds)3825client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3826client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds)3827worker2 # [ 37.488877] nix-grpc-daemon[858]: ts=2026-09-20T12:46:46Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:479743828worker2 # [ 37.506989] nix-grpc-daemon[858]: ts=2026-09-20T12:46:46Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:479743829worker2 # [ 37.518551] nix-grpc-daemon[858]: ts=2026-09-20T12:46:46Z level=debug event=path_info_miss path=vjqwk0w01cvrc7s0v48m3lmih9i5s8yp-nixos-system-client-test error="error: path '/nix/store/vjqwk0w01cvrc7s0v48m3lmih9i5s8yp-nixos-system-client-test' is required, but there is no substituter that can build it"3830worker1 # [ 37.511729] nix-grpc-daemon[786]: ts=2026-09-20T12:46:46Z level=info event=oidc_jwks provider=mock keys=13831worker1 # [ 37.518647] nix-grpc-daemon[786]: ts=2026-09-20T12:46:46Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:588523832worker1 # [ 37.528216] nix-grpc-daemon[786]: ts=2026-09-20T12:46:46Z level=debug event=path_info_miss path=vjqwk0w01cvrc7s0v48m3lmih9i5s8yp-nixos-system-client-test error="error: path '/nix/store/vjqwk0w01cvrc7s0v48m3lmih9i5s8yp-nixos-system-client-test' is required, but there is no substituter that can build it"3833client: must succeed: rm -r /var/lib/nix-grpc-store3834client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3835worker1 # [ 39.851190] nix-grpc-daemon[786]: ts=2026-09-20T12:46:49Z level=info event=denied method=QueryMissing cn=- role=none3836worker1 # [ 40.088914] nix-grpc-daemon[786]: ts=2026-09-20T12:46:49Z level=info event=denied method=QueryMissing cn=stranger role=none3837(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.96 seconds)3838subtest: DAG build is scheduled across workers and lands in the cache3839client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23840worker1 # [ 40.337954] nix-grpc-daemon[786]: ts=2026-09-20T12:46:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:588523841client # don't know how to build these paths:3842client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3843worker1 # [ 40.350531] nix-grpc-daemon[786]: ts=2026-09-20T12:46:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:588523844worker2 # [ 40.401621] nix-grpc-daemon[858]: ts=2026-09-20T12:46:49Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03845worker2 # [ 40.408345] nix-grpc-daemon[858]: ts=2026-09-20T12:46:49Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=13846worker2 # [ 40.459973] nix-grpc-daemon[858]: ts=2026-09-20T12:46:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479743847worker2 # [ 40.488461] nix-grpc-daemon[858]: ts=2026-09-20T12:46:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479743848client # copying 1 paths to 'lb:50051'...3849worker2 # [ 40.503205] nix-grpc-daemon[858]: ts=2026-09-20T12:46:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479743850client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3851worker2 # [ 40.535033] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)3852worker2 # [ 40.564453] nix-grpc-daemon[858]: ts=2026-09-20T12:46:49Z level=info event=niks3_push_started pid=9393853worker2 # [ 40.888467] nix-grpc-daemon[939]: time=2026-09-20T12:46:50.320Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""3854worker2 # [ 41.108590] nix-daemon[926]: accepted connection from pid 952, user nix-grpc-daemon (trusted)3855worker2 # [ 41.132374] nix-daemon[926]: reaped child process 955, status = succeeded3856worker2 # [ 41.306351] nix-daemon[926]: accepted connection from pid 957, user nix-grpc-daemon (trusted)3857worker2 # [ 41.327307] nix-daemon[926]: reaped child process 960, status = succeeded3858lb # [ 41.355169] niks3-server[1006]: 2026/09/20 12:46:50 INFO Received uploads request method=POST path=/api/pending_closures3859worker2 # [ 41.357731] nix-grpc-daemon[939]: time=2026-09-20T12:46:50.792Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3860worker2 # [ 41.361499] nix-grpc-daemon[939]: time=2026-09-20T12:46:50.794Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3861lb # [ 41.412740] niks3-server[1006]: 2026/09/20 12:46:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3862lb # [ 41.417496] niks3-server[1006]: 2026/09/20 12:46:50 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3863lb # [ 41.447068] niks3-server[1006]: 2026/09/20 12:46:50 INFO Signed narinfos id=1 count=13864worker2 # [ 41.430937] nix-grpc-daemon[939]: time=2026-09-20T12:46:50.865Z level=INFO msg="Uploading 1 narinfos"3865lb # [ 41.462776] niks3-server[1006]: 2026/09/20 12:46:50 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3866lb # [ 41.469666] niks3-server[1006]: 2026/09/20 12:46:50 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3867lb # [ 41.483542] niks3-server[1006]: 2026/09/20 12:46:50 INFO Completed upload id=13868worker2 # [ 41.465245] nix-grpc-daemon[939]: time=2026-09-20T12:46:50.899Z level=INFO msg="Upload complete. (568ms)"3869worker2 # [ 41.472766] nix-grpc-daemon[858]: ts=2026-09-20T12:46:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_in=5043870lb # [ 41.493314] niks3-server[1006]: 2026/09/20 12:46:50 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3871worker2 # [ 41.482169] nix-grpc-daemon[858]: ts=2026-09-20T12:46:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479743872worker2 # [ 41.486596] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)3873worker2 # [ 41.490640] nix-daemon[926]: reaped child process 937, status = succeeded3874client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3875worker2 # [ 41.502706] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)3876client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3877client # farm-a> LOG-farm-a-t13878worker2 # [ 42.750592] nix-daemon[926]: reaped child process 964, status = succeeded3879worker2 # [ 42.957838] nix-daemon[926]: accepted connection from pid 979, user nix-grpc-daemon (trusted)3880worker2 # [ 42.996571] nix-daemon[926]: reaped child process 982, status = succeeded3881lb # [ 43.028874] niks3-server[1006]: 2026/09/20 12:46:52 INFO Received uploads request method=POST path=/api/pending_closures3882worker2 # [ 43.028418] nix-grpc-daemon[939]: time=2026-09-20T12:46:52.462Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3883worker2 # [ 43.033188] nix-grpc-daemon[939]: time=2026-09-20T12:46:52.464Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3884lb # [ 43.093293] niks3-server[1006]: 2026/09/20 12:46:52 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3885lb # [ 43.105655] niks3-server[1006]: 2026/09/20 12:46:52 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3886lb # [ 43.114889] niks3-server[1006]: 2026/09/20 12:46:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3887worker2 # [ 43.103150] nix-grpc-daemon[939]: time=2026-09-20T12:46:52.536Z level=INFO msg="Uploading 1 narinfos"3888lb # [ 43.122527] niks3-server[1006]: 2026/09/20 12:46:52 INFO Signed narinfos id=2 count=13889lb # [ 43.128808] niks3-server[1006]: 2026/09/20 12:46:52 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3890lb # [ 43.142312] niks3-server[1006]: 2026/09/20 12:46:52 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3891lb # [ 43.149499] niks3-server[1006]: 2026/09/20 12:46:52 INFO Completed upload id=23892worker2 # [ 43.130963] nix-grpc-daemon[939]: time=2026-09-20T12:46:52.565Z level=INFO msg="Upload complete. (417ms)"3893lb # [ 43.152524] niks3-server[1006]: 2026/09/20 12:46:52 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3894worker2 # [ 43.136833] nix-grpc-daemon[858]: ts=2026-09-20T12:46:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13895worker2 # [ 43.158417] nix-daemon[926]: reaped child process 962, status = succeeded3896worker2 # [ 43.161264] nix-grpc-daemon[858]: ts=2026-09-20T12:46:52Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03897worker2 # [ 43.163525] nix-grpc-daemon[858]: ts=2026-09-20T12:46:52Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=13898worker2 # [ 43.207509] nix-grpc-daemon[858]: ts=2026-09-20T12:46:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479743899worker2 # [ 43.223575] nix-grpc-daemon[858]: ts=2026-09-20T12:46:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479743900worker2 # [ 43.240629] nix-grpc-daemon[939]: time=2026-09-20T12:46:52.675Z level=INFO msg="All 1 paths already cached"3901worker2 # [ 43.250804] nix-grpc-daemon[858]: ts=2026-09-20T12:46:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479743902client # copying 1 paths to 'lb:50051'...3903client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3904worker2 # [ 43.273505] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)3905worker2 # [ 43.479762] nix-daemon[926]: accepted connection from pid 989, user nix-grpc-daemon (trusted)3906worker2 # [ 43.504109] nix-daemon[926]: reaped child process 992, status = succeeded3907worker2 # [ 43.699406] nix-daemon[926]: accepted connection from pid 994, user nix-grpc-daemon (trusted)3908worker2 # [ 43.719633] nix-daemon[926]: reaped child process 997, status = succeeded3909lb # [ 43.752654] niks3-server[1006]: 2026/09/20 12:46:53 INFO Received uploads request method=POST path=/api/pending_closures3910worker2 # [ 43.741483] nix-grpc-daemon[939]: time=2026-09-20T12:46:53.175Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3911worker2 # [ 43.743248] nix-grpc-daemon[939]: time=2026-09-20T12:46:53.175Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3912lb # [ 43.774639] niks3-server[1006]: 2026/09/20 12:46:53 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3913lb # [ 43.784474] niks3-server[1006]: 2026/09/20 12:46:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3914worker2 # [ 43.769302] nix-grpc-daemon[939]: time=2026-09-20T12:46:53.203Z level=INFO msg="Uploading 1 narinfos"3915lb # [ 43.791578] niks3-server[1006]: 2026/09/20 12:46:53 INFO Signed narinfos id=3 count=13916lb # [ 43.795965] niks3-server[1006]: 2026/09/20 12:46:53 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3917lb # [ 43.802011] niks3-server[1006]: 2026/09/20 12:46:53 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3918lb # [ 43.813672] niks3-server[1006]: 2026/09/20 12:46:53 INFO Completed upload id=33919worker2 # [ 43.795076] nix-grpc-daemon[939]: time=2026-09-20T12:46:53.229Z level=INFO msg="Upload complete. (510ms)"3920lb # [ 43.815957] niks3-server[1006]: 2026/09/20 12:46:53 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3921worker2 # [ 43.803629] nix-grpc-daemon[858]: ts=2026-09-20T12:46:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_in=6243922worker2 # [ 43.808297] nix-grpc-daemon[858]: ts=2026-09-20T12:46:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479743923worker2 # [ 43.823621] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)3924worker2 # [ 43.826311] nix-daemon[926]: reaped child process 987, status = succeeded3925client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3926worker2 # [ 43.837425] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)3927client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3928client # farm-b> LOG-farm-b-t13929worker2 # [ 44.679606] nix-daemon[926]: reaped child process 1001, status = succeeded3930worker2 # [ 44.875068] nix-daemon[926]: accepted connection from pid 1016, user nix-grpc-daemon (trusted)3931worker2 # [ 44.898065] nix-daemon[926]: reaped child process 1019, status = succeeded3932lb # [ 44.930379] niks3-server[1006]: 2026/09/20 12:46:54 INFO Received uploads request method=POST path=/api/pending_closures3933worker2 # [ 44.929163] nix-grpc-daemon[939]: time=2026-09-20T12:46:54.362Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3934worker2 # [ 44.931068] nix-grpc-daemon[939]: time=2026-09-20T12:46:54.362Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3935lb # [ 44.976846] niks3-server[1006]: 2026/09/20 12:46:54 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3936lb # [ 44.990672] niks3-server[1006]: 2026/09/20 12:46:54 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3937lb # [ 44.998296] niks3-server[1006]: 2026/09/20 12:46:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3938worker2 # [ 44.985301] nix-grpc-daemon[939]: time=2026-09-20T12:46:54.419Z level=INFO msg="Uploading 1 narinfos"3939lb # [ 45.009941] niks3-server[1006]: 2026/09/20 12:46:54 INFO Signed narinfos id=4 count=13940lb # [ 45.016737] niks3-server[1006]: 2026/09/20 12:46:54 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3941lb # [ 45.024212] niks3-server[1006]: 2026/09/20 12:46:54 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3942worker2 # [ 45.016907] nix-grpc-daemon[939]: time=2026-09-20T12:46:54.451Z level=INFO msg="Upload complete. (363ms)"3943lb # [ 45.035457] niks3-server[1006]: 2026/09/20 12:46:54 INFO Completed upload id=43944lb # [ 45.039693] niks3-server[1006]: 2026/09/20 12:46:54 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3945worker2 # [ 45.024721] nix-grpc-daemon[858]: ts=2026-09-20T12:46:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13946worker2 # [ 45.035378] nix-daemon[926]: reaped child process 999, status = succeeded3947worker2 # [ 45.040419] nix-grpc-daemon[858]: ts=2026-09-20T12:46:54Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03948worker2 # [ 45.043146] nix-grpc-daemon[858]: ts=2026-09-20T12:46:54Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=13949worker2 # [ 45.090318] nix-grpc-daemon[858]: ts=2026-09-20T12:46:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479743950worker2 # [ 45.105222] nix-grpc-daemon[858]: ts=2026-09-20T12:46:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479743951worker2 # [ 45.117906] nix-grpc-daemon[939]: time=2026-09-20T12:46:54.552Z level=INFO msg="All 2 paths already cached"3952client # copying 1 paths to 'lb:50051'...3953worker2 # [ 45.126012] nix-grpc-daemon[858]: ts=2026-09-20T12:46:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479743954client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3955worker2 # [ 45.142397] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)3956worker2 # [ 45.339757] nix-daemon[926]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)3957worker2 # [ 45.362590] nix-daemon[926]: reaped child process 1028, status = succeeded3958lb # [ 45.389777] envoy[872]: conn peer=[2001:db8:1::1]:39598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=422 ms=25483959lb # [ 45.394248] envoy[872]: conn peer=[2001:db8:1::1]:39612 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=783960lb # [ 45.398212] envoy[872]: conn peer=[2001:db8:1::1]:39616 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=133961lb # [ 45.402194] envoy[872]: conn peer=[2001:db8:1::1]:39626 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=113962worker2 # [ 45.525597] nix-daemon[926]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)3963worker2 # [ 45.550596] nix-daemon[926]: reaped child process 1033, status = succeeded3964lb # [ 45.577000] niks3-server[1006]: 2026/09/20 12:46:55 INFO Received uploads request method=POST path=/api/pending_closures3965worker2 # [ 45.571318] nix-grpc-daemon[939]: time=2026-09-20T12:46:55.005Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3966worker2 # [ 45.573082] nix-grpc-daemon[939]: time=2026-09-20T12:46:55.005Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3967lb # [ 45.614710] niks3-server[1006]: 2026/09/20 12:46:55 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3968lb # [ 45.627191] niks3-server[1006]: 2026/09/20 12:46:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3969worker2 # [ 45.615108] nix-grpc-daemon[939]: time=2026-09-20T12:46:55.049Z level=INFO msg="Uploading 1 narinfos"3970lb # [ 45.638329] niks3-server[1006]: 2026/09/20 12:46:55 INFO Signed narinfos id=5 count=13971lb # [ 45.645354] niks3-server[1006]: 2026/09/20 12:46:55 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3972lb # [ 45.653884] niks3-server[1006]: 2026/09/20 12:46:55 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3973lb # [ 45.660879] niks3-server[1006]: 2026/09/20 12:46:55 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3974lb # [ 45.666642] niks3-server[1006]: 2026/09/20 12:46:55 INFO Completed upload id=53975worker2 # [ 45.648222] nix-grpc-daemon[939]: time=2026-09-20T12:46:55.082Z level=INFO msg="Upload complete. (496ms)"3976worker2 # [ 45.657303] nix-grpc-daemon[858]: ts=2026-09-20T12:46:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_in=7523977worker2 # [ 45.668562] nix-grpc-daemon[858]: ts=2026-09-20T12:46:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479743978worker2 # [ 45.680595] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)3979worker2 # [ 45.686504] nix-daemon[926]: reaped child process 1023, status = succeeded3980client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3981client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3982worker2 # [ 45.701632] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)3983client # farm-top> LOG-farm-top-t13984worker2 # [ 47.344475] nix-daemon[926]: reaped child process 1037, status = succeeded3985worker2 # [ 47.524635] nix-daemon[926]: accepted connection from pid 1053, user nix-grpc-daemon (trusted)3986worker2 # [ 47.549210] nix-daemon[926]: reaped child process 1056, status = succeeded3987lb # [ 47.583150] niks3-server[1006]: 2026/09/20 12:46:57 INFO Received uploads request method=POST path=/api/pending_closures3988worker2 # [ 47.577756] nix-grpc-daemon[939]: time=2026-09-20T12:46:57.011Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3989worker2 # [ 47.581344] nix-grpc-daemon[939]: time=2026-09-20T12:46:57.014Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3990lb # [ 47.637874] niks3-server[1006]: 2026/09/20 12:46:57 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3991lb # [ 47.649030] niks3-server[1006]: 2026/09/20 12:46:57 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3992lb # [ 47.658314] niks3-server[1006]: 2026/09/20 12:46:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3993worker2 # [ 47.645516] nix-grpc-daemon[939]: time=2026-09-20T12:46:57.079Z level=INFO msg="Uploading 1 narinfos"3994lb # [ 47.667972] niks3-server[1006]: 2026/09/20 12:46:57 INFO Signed narinfos id=6 count=13995lb # [ 47.675013] niks3-server[1006]: 2026/09/20 12:46:57 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3996lb # [ 47.686812] niks3-server[1006]: 2026/09/20 12:46:57 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3997worker2 # [ 47.676631] nix-grpc-daemon[939]: time=2026-09-20T12:46:57.111Z level=INFO msg="Upload complete. (361ms)"3998lb # [ 47.695367] niks3-server[1006]: 2026/09/20 12:46:57 INFO Completed upload id=63999lb # [ 47.700405] niks3-server[1006]: 2026/09/20 12:46:57 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4000worker2 # [ 47.684684] nix-grpc-daemon[858]: ts=2026-09-20T12:46:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14001worker2 # [ 47.695581] nix-daemon[926]: reaped child process 1035, status = succeeded4002client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.61 seconds)4003client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4004client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.25 seconds)4005client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4006client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4007client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4008client # copying 3 paths...4009client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4010client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4011client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4012client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)4013(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.29 seconds)4014subtest: repeat is answered Cached by the scheduler without building4015worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4016worker1 # finding garbage collector roots...4017worker1 # deleting specified paths...4018worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4019worker1 # deleting unused links...4020worker1 # note: hard linking is currently saving 0.0 KiB4021worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.35 seconds)4022worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4023worker2 # finding garbage collector roots...4024worker2 # deleting specified paths...4025worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4026worker2 # deleting unused links...4027worker2 # note: hard linking is currently saving 0.0 KiB4028worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.35 seconds)4029client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24030client # don't know how to build these paths:4031client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4032worker1 # [ 49.415977] nix-grpc-daemon[786]: ts=2026-09-20T12:46:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:588524033worker1 # [ 49.429661] nix-grpc-daemon[786]: ts=2026-09-20T12:46:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:588524034worker2 # [ 49.493110] nix-grpc-daemon[858]: ts=2026-09-20T12:46:58Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14035client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.40 seconds)4036client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4037client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds)4038lb: must succeed: curl -sf localhost:9901/clusters4039lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4040lb: must succeed: curl -sf localhost:9901/clusters4041lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4042worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4043worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4044(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.70 seconds)4045subtest: inputs already in the cache are not sent to the scheduler4046lb: must succeed: curl -sf localhost:9901/clusters4047lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4048lb: must succeed: curl -sf localhost:9901/clusters4049lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4050worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4051worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.08 seconds)4052client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24053client # don't know how to build these paths:4054client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4055worker1 # [ 50.648177] nix-grpc-daemon[786]: ts=2026-09-20T12:47:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:588524056worker2 # [ 50.677460] nix-grpc-daemon[858]: ts=2026-09-20T12:47:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744057worker2 # [ 50.693520] nix-grpc-daemon[939]: time=2026-09-20T12:47:00.126Z level=INFO msg="All 2 paths already cached"4058worker2 # [ 50.716441] nix-grpc-daemon[858]: ts=2026-09-20T12:47:00Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04059worker2 # [ 50.725053] nix-grpc-daemon[858]: ts=2026-09-20T12:47:00Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=14060worker2 # [ 50.772766] nix-grpc-daemon[858]: ts=2026-09-20T12:47:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479744061worker2 # [ 50.796448] nix-grpc-daemon[858]: ts=2026-09-20T12:47:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744062worker2 # [ 50.817228] nix-grpc-daemon[939]: time=2026-09-20T12:47:00.251Z level=INFO msg="All 2 paths already cached"4063client # copying 1 paths to 'lb:50051'...4064client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4065worker2 # [ 50.830682] nix-grpc-daemon[858]: ts=2026-09-20T12:47:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479744066worker2 # [ 50.851935] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4067worker2 # [ 51.116815] nix-daemon[926]: accepted connection from pid 1086, user nix-grpc-daemon (trusted)4068worker2 # [ 51.143467] nix-daemon[926]: reaped child process 1089, status = succeeded4069worker2 # [ 51.360376] nix-daemon[926]: accepted connection from pid 1091, user nix-grpc-daemon (trusted)4070worker2 # [ 51.381382] nix-daemon[926]: reaped child process 1094, status = succeeded4071lb # [ 51.423533] niks3-server[1006]: 2026/09/20 12:47:00 INFO Received uploads request method=POST path=/api/pending_closures4072worker2 # [ 51.417596] nix-grpc-daemon[939]: time=2026-09-20T12:47:00.851Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4073worker2 # [ 51.419256] nix-grpc-daemon[939]: time=2026-09-20T12:47:00.851Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4074lb # [ 51.473154] niks3-server[1006]: 2026/09/20 12:47:00 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4075lb # [ 51.485275] niks3-server[1006]: 2026/09/20 12:47:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4076worker2 # [ 51.475100] nix-grpc-daemon[939]: time=2026-09-20T12:47:00.909Z level=INFO msg="Uploading 1 narinfos"4077lb # [ 51.493573] niks3-server[1006]: 2026/09/20 12:47:00 INFO Signed narinfos id=7 count=14078lb # [ 51.500074] niks3-server[1006]: 2026/09/20 12:47:00 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4079lb # [ 51.511690] niks3-server[1006]: 2026/09/20 12:47:00 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4080lb # [ 51.519237] niks3-server[1006]: 2026/09/20 12:47:00 INFO Completed upload id=74081worker2 # [ 51.498390] nix-grpc-daemon[939]: time=2026-09-20T12:47:00.932Z level=INFO msg="Upload complete. (623ms)"4082lb # [ 51.522240] niks3-server[1006]: 2026/09/20 12:47:00 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4083worker2 # [ 51.508596] nix-grpc-daemon[858]: ts=2026-09-20T12:47:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_in=7524084worker2 # [ 51.524775] nix-grpc-daemon[858]: ts=2026-09-20T12:47:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479744085worker2 # [ 51.536788] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4086worker2 # [ 51.548404] nix-daemon[926]: reaped child process 1084, status = succeeded4087client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4088client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4089worker2 # [ 51.560140] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4090client # farm-top> LOG-farm-top-t1b4091worker2 # [ 53.047076] nix-daemon[926]: reaped child process 1098, status = succeeded4092worker2 # [ 53.283157] nix-daemon[926]: accepted connection from pid 1113, user nix-grpc-daemon (trusted)4093worker2 # [ 53.310168] nix-daemon[926]: reaped child process 1117, status = succeeded4094lb # [ 53.349503] niks3-server[1006]: 2026/09/20 12:47:02 INFO Received uploads request method=POST path=/api/pending_closures4095worker2 # [ 53.348355] nix-grpc-daemon[939]: time=2026-09-20T12:47:02.778Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4096worker2 # [ 53.350038] nix-grpc-daemon[939]: time=2026-09-20T12:47:02.778Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4097lb # [ 53.416761] niks3-server[1006]: 2026/09/20 12:47:02 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4098lb # [ 53.428240] niks3-server[1006]: 2026/09/20 12:47:02 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4099worker2 # [ 53.421449] nix-grpc-daemon[939]: time=2026-09-20T12:47:02.855Z level=INFO msg="Uploading 1 narinfos"4100lb # [ 53.440856] niks3-server[1006]: 2026/09/20 12:47:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4101lb # [ 53.449484] niks3-server[1006]: 2026/09/20 12:47:02 INFO Signed narinfos id=8 count=14102lb # [ 53.454551] niks3-server[1006]: 2026/09/20 12:47:02 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4103lb # [ 53.464108] niks3-server[1006]: 2026/09/20 12:47:02 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4104lb # [ 53.474880] niks3-server[1006]: 2026/09/20 12:47:02 INFO Completed upload id=84105worker2 # [ 53.456118] nix-grpc-daemon[939]: time=2026-09-20T12:47:02.890Z level=INFO msg="Upload complete. (482ms)"4106lb # [ 53.478047] niks3-server[1006]: 2026/09/20 12:47:02 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4107worker2 # [ 53.473953] nix-grpc-daemon[858]: ts=2026-09-20T12:47:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14108worker2 # [ 53.496690] nix-daemon[926]: reaped child process 1096, status = succeeded4109client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 3.15 seconds)4110client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4111client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.27 seconds)4112lb: must succeed: curl -sf localhost:9901/clusters4113lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4114lb: must succeed: curl -sf localhost:9901/clusters4115lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4116worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4117worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4118(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.87 seconds)4119subtest: two clients wanting the same drv build it once4120client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4121client # [ 54.107070] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4122client # Running as unit: dedup1.service; invocation ID: 263356e2319c427391b10ccf3a3672f84123client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.12 seconds)4124client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4125client # [ 54.394971] nix[917]: don't know how to build these paths:4126client # [ 54.396355] nix[917]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4127worker1 # [ 54.358606] nix-grpc-daemon[786]: ts=2026-09-20T12:47:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:588524128worker2 # [ 54.395132] nix-grpc-daemon[858]: ts=2026-09-20T12:47:03Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04129worker2 # [ 54.395819] nix-grpc-daemon[858]: ts=2026-09-20T12:47:03Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14130worker1 # [ 54.420349] nix-grpc-daemon[786]: ts=2026-09-20T12:47:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:588524131worker1 # [ 54.443970] nix-grpc-daemon[786]: ts=2026-09-20T12:47:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:588524132client # [ 54.500201] nix[917]: copying 1 paths to 'lb:50051'...4133worker1 # [ 54.466905] nix-grpc-daemon[786]: ts=2026-09-20T12:47:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:588524134client # [ 54.507923] nix[917]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4135worker1 # [ 54.489437] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4136worker1 # [ 54.520997] nix-grpc-daemon[786]: ts=2026-09-20T12:47:03Z level=info event=niks3_push_started pid=8704137worker1 # [ 54.816743] nix-grpc-daemon[870]: time=2026-09-20T12:47:04.270Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""4138worker1 # [ 55.038144] nix-daemon[843]: accepted connection from pid 883, user nix-grpc-daemon (trusted)4139worker1 # [ 55.064913] nix-daemon[843]: reaped child process 886, status = succeeded4140client # [ 55.233575] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4141client # Running as unit: dedup2.service; invocation ID: 58c094a6e8044e8e89af33a8a3259f794142client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.12 seconds)4143worker1 # [ 55.270882] nix-daemon[843]: accepted connection from pid 888, user nix-grpc-daemon (trusted)4144worker1 # [ 55.305774] nix-daemon[843]: reaped child process 894, status = succeeded4145lb # [ 55.355945] niks3-server[1006]: 2026/09/20 12:47:04 INFO Received uploads request method=POST path=/api/pending_closures4146worker1 # [ 55.331743] nix-grpc-daemon[870]: time=2026-09-20T12:47:04.787Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4147worker1 # [ 55.337799] nix-grpc-daemon[870]: time=2026-09-20T12:47:04.787Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4148lb # [ 55.391093] envoy[872]: conn peer=[2001:db8:1::1]:39628 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9562 tx=3819 ms=73594149lb # [ 55.406431] envoy[872]: conn peer=[2001:db8:1::1]:39434 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=814150lb # [ 55.414358] envoy[872]: conn peer=[2001:db8:1::1]:39440 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4215 tx=1747 ms=28184151lb # [ 55.437923] niks3-server[1006]: 2026/09/20 12:47:04 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4152lb # [ 55.450673] niks3-server[1006]: 2026/09/20 12:47:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4153worker1 # [ 55.417146] nix-grpc-daemon[870]: time=2026-09-20T12:47:04.872Z level=INFO msg="Uploading 1 narinfos"4154lb # [ 55.463124] niks3-server[1006]: 2026/09/20 12:47:04 INFO Signed narinfos id=9 count=14155lb # [ 55.474453] niks3-server[1006]: 2026/09/20 12:47:04 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4156lb # [ 55.487601] niks3-server[1006]: 2026/09/20 12:47:04 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4157worker1 # [ 55.453229] nix-grpc-daemon[870]: time=2026-09-20T12:47:04.908Z level=INFO msg="Upload complete. (625ms)"4158lb # [ 55.495593] niks3-server[1006]: 2026/09/20 12:47:04 INFO Completed upload id=94159lb # [ 55.500156] niks3-server[1006]: 2026/09/20 12:47:04 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4160worker1 # [ 55.461196] nix-grpc-daemon[786]: ts=2026-09-20T12:47:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58852 duration_s=0 paths=1 nar_bytes_in=4324161worker1 # [ 55.470475] nix-grpc-daemon[786]: ts=2026-09-20T12:47:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:588524162worker1 # [ 55.483019] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4163worker1 # [ 55.487693] nix-daemon[843]: reaped child process 868, status = succeeded4164worker1 # [ 55.497474] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4165client # [ 55.537076] nix[917]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4166worker2 # [ 55.595527] nix-grpc-daemon[858]: ts=2026-09-20T12:47:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:479744167client # [ 55.612245] nix[933]: don't know how to build these paths:4168client # [ 55.613199] nix[933]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4169worker2 # [ 55.615260] nix-grpc-daemon[858]: ts=2026-09-20T12:47:05Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04170worker1 # [ 55.599727] nix-grpc-daemon[786]: ts=2026-09-20T12:47:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:588524171client # [ 55.641916] nix[933]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4172client: must succeed: sleep 24173client: (finished: must succeed: sleep 2, in 2.07 seconds)4174client: waiting for success: ! systemctl is-active dedup1 dedup24175worker1 # [ 60.143499] nix-daemon[843]: reaped child process 899, status = succeeded4176worker1 # [ 60.345302] nix-daemon[843]: accepted connection from pid 928, user nix-grpc-daemon (trusted)4177worker1 # [ 60.371515] nix-daemon[843]: reaped child process 931, status = succeeded4178lb # [ 60.427789] niks3-server[1006]: 2026/09/20 12:47:09 INFO Received uploads request method=POST path=/api/pending_closures4179worker1 # [ 60.395857] nix-grpc-daemon[870]: time=2026-09-20T12:47:09.849Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4180worker1 # [ 60.398308] nix-grpc-daemon[870]: time=2026-09-20T12:47:09.849Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4181lb # [ 60.463724] niks3-server[1006]: 2026/09/20 12:47:09 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4182lb # [ 60.478629] niks3-server[1006]: 2026/09/20 12:47:09 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4183lb # [ 60.493008] niks3-server[1006]: 2026/09/20 12:47:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4184worker1 # [ 60.455979] nix-grpc-daemon[870]: time=2026-09-20T12:47:09.910Z level=INFO msg="Uploading 1 narinfos"4185lb # [ 60.498673] niks3-server[1006]: 2026/09/20 12:47:09 INFO Signed narinfos id=10 count=14186lb # [ 60.503205] niks3-server[1006]: 2026/09/20 12:47:09 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4187lb # [ 60.516332] niks3-server[1006]: 2026/09/20 12:47:09 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4188lb # [ 60.529439] niks3-server[1006]: 2026/09/20 12:47:09 INFO Completed upload id=104189worker1 # [ 60.488337] nix-grpc-daemon[870]: time=2026-09-20T12:47:09.943Z level=INFO msg="Upload complete. (370ms)"4190lb # [ 60.532088] niks3-server[1006]: 2026/09/20 12:47:09 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4191worker1 # [ 60.496951] nix-grpc-daemon[786]: ts=2026-09-20T12:47:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58852 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14192worker1 # [ 60.511292] nix-grpc-daemon[786]: ts=2026-09-20T12:47:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58852 duration_s=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14193worker1 # [ 60.515680] nix-daemon[843]: reaped child process 897, status = succeeded4194client # [ 60.605185] systemd[1]: dedup1.service: Deactivated successfully.4195client # [ 60.608753] systemd[1]: dedup1.service: Consumed 198ms CPU time over 6.501s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 8.8K outgoing IP traffic.4196client # [ 60.617814] systemd[1]: dedup2.service: Deactivated successfully.4197client # [ 60.619278] systemd[1]: dedup2.service: Consumed 219ms CPU time over 5.381s wall clock time, 33M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic.4198client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.18 seconds)4199client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4200client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.08 seconds)4201worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4202worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.09 seconds)4203worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4204worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.09 seconds)4205worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4206worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4207worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4208worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds)4209(finished: subtest: two clients wanting the same drv build it once, in 7.73 seconds)4210subtest: build hook: nix-daemon with builders = grpc://lb4211client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4212client # [ 62.017100] systemd[1]: Started Nix Daemon.4213client # [ 62.228818] nix-daemon[975]: accepted connection from pid 972, user root (trusted)4214worker2 # [ 62.442267] nix-grpc-daemon[858]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:479744215worker2 # [ 62.456632] nix-grpc-daemon[858]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744216worker2 # [ 62.482980] nix-grpc-daemon[858]: ts=2026-09-20T12:47:11Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04217worker2 # [ 62.491459] nix-grpc-daemon[858]: ts=2026-09-20T12:47:11Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14218worker2 # [ 62.534128] nix-grpc-daemon[858]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479744219worker2 # [ 62.558825] nix-grpc-daemon[858]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744220worker2 # [ 62.579107] nix-grpc-daemon[858]: ts=2026-09-20T12:47:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479744221worker2 # [ 62.592927] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4222worker2 # [ 62.827595] nix-daemon[926]: accepted connection from pid 1157, user nix-grpc-daemon (trusted)4223worker2 # [ 62.853462] nix-daemon[926]: reaped child process 1160, status = succeeded4224worker2 # [ 63.073594] nix-daemon[926]: accepted connection from pid 1162, user nix-grpc-daemon (trusted)4225worker2 # [ 63.095071] nix-daemon[926]: reaped child process 1165, status = succeeded4226lb # [ 63.131921] niks3-server[1006]: 2026/09/20 12:47:12 INFO Received uploads request method=POST path=/api/pending_closures4227worker2 # [ 63.125515] nix-grpc-daemon[939]: time=2026-09-20T12:47:12.559Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4228worker2 # [ 63.127046] nix-grpc-daemon[939]: time=2026-09-20T12:47:12.559Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4229lb # [ 63.177981] niks3-server[1006]: 2026/09/20 12:47:12 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4230lb # [ 63.189160] niks3-server[1006]: 2026/09/20 12:47:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4231worker2 # [ 63.179385] nix-grpc-daemon[939]: time=2026-09-20T12:47:12.613Z level=INFO msg="Uploading 1 narinfos"4232lb # [ 63.205518] niks3-server[1006]: 2026/09/20 12:47:12 INFO Signed narinfos id=11 count=14233lb # [ 63.212324] niks3-server[1006]: 2026/09/20 12:47:12 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4234lb # [ 63.227894] niks3-server[1006]: 2026/09/20 12:47:12 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4235worker2 # [ 63.216534] nix-grpc-daemon[939]: time=2026-09-20T12:47:12.651Z level=INFO msg="Upload complete. (613ms)"4236lb # [ 63.235287] niks3-server[1006]: 2026/09/20 12:47:12 INFO Completed upload id=114237lb # [ 63.239404] niks3-server[1006]: 2026/09/20 12:47:12 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4238worker2 # [ 63.224320] nix-grpc-daemon[858]: ts=2026-09-20T12:47:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_in=5124239worker2 # [ 63.227882] nix-grpc-daemon[858]: ts=2026-09-20T12:47:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479744240worker2 # [ 63.238605] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4241worker2 # [ 63.242440] nix-daemon[926]: reaped child process 1155, status = succeeded4242worker2 # [ 63.254070] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4243worker2 # [ 64.313421] nix-daemon[926]: reaped child process 1169, status = succeeded4244worker2 # [ 64.534143] nix-daemon[926]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)4245worker2 # [ 64.556792] nix-daemon[926]: reaped child process 1187, status = succeeded4246lb # [ 64.599650] niks3-server[1006]: 2026/09/20 12:47:14 INFO Received uploads request method=POST path=/api/pending_closures4247worker2 # [ 64.592567] nix-grpc-daemon[939]: time=2026-09-20T12:47:14.023Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4248worker2 # [ 64.594162] nix-grpc-daemon[939]: time=2026-09-20T12:47:14.023Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4249lb # [ 64.643472] niks3-server[1006]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4250lb # [ 64.656912] niks3-server[1006]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4251worker2 # [ 64.647964] nix-grpc-daemon[939]: time=2026-09-20T12:47:14.081Z level=INFO msg="Uploading 1 narinfos"4252lb # [ 64.668373] niks3-server[1006]: 2026/09/20 12:47:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4253lb # [ 64.671080] niks3-server[1006]: 2026/09/20 12:47:14 INFO Signed narinfos id=12 count=14254lb # [ 64.678937] niks3-server[1006]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4255lb # [ 64.689106] niks3-server[1006]: 2026/09/20 12:47:14 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4256lb # [ 64.696114] niks3-server[1006]: 2026/09/20 12:47:14 INFO Completed upload id=124257worker2 # [ 64.677632] nix-grpc-daemon[939]: time=2026-09-20T12:47:14.112Z level=INFO msg="Upload complete. (412ms)"4258lb # [ 64.698629] niks3-server[1006]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4259worker2 # [ 64.684991] nix-grpc-daemon[858]: ts=2026-09-20T12:47:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14260worker2 # [ 64.697316] nix-daemon[926]: reaped child process 1167, status = succeeded4261worker2 # [ 64.703464] nix-grpc-daemon[858]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:479744262worker2 # [ 64.739541] nix-grpc-daemon[858]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:479744263worker2 # [ 64.746271] nix-grpc-daemon[858]: ts=2026-09-20T12:47:14Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_out=1284264worker2 # [ 65.103393] nix-grpc-daemon[858]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:479744265worker2 # [ 65.109556] nix-grpc-daemon[858]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744266worker2 # [ 65.120374] nix-grpc-daemon[939]: time=2026-09-20T12:47:14.554Z level=INFO msg="All 1 paths already cached"4267worker2 # [ 65.141496] nix-grpc-daemon[858]: ts=2026-09-20T12:47:14Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04268worker2 # [ 65.147384] nix-grpc-daemon[858]: ts=2026-09-20T12:47:14Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14269worker2 # [ 65.155524] nix-grpc-daemon[858]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479744270worker2 # [ 65.167710] nix-grpc-daemon[858]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744271worker2 # [ 65.183540] nix-grpc-daemon[939]: time=2026-09-20T12:47:14.618Z level=INFO msg="All 1 paths already cached"4272worker2 # [ 65.195090] nix-grpc-daemon[858]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479744273worker2 # [ 65.210131] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4274lb # [ 65.388175] envoy[872]: conn peer=[2001:db8:1::1]:54138 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=49664275lb # [ 65.388728] envoy[872]: conn peer=[2001:db8:1::1]:54136 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1372 ms=61724276lb # [ 65.388882] envoy[872]: conn peer=[2001:db8:1::1]:39610 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3447 tx=1682 ms=23744277lb # [ 65.389023] envoy[872]: conn peer=[2001:db8:1::1]:39616 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=333 ms=784278worker2 # [ 65.445159] nix-daemon[926]: accepted connection from pid 1193, user nix-grpc-daemon (trusted)4279worker2 # [ 65.467234] nix-daemon[926]: reaped child process 1196, status = succeeded4280worker2 # [ 65.682869] nix-daemon[926]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)4281worker2 # [ 65.704575] nix-daemon[926]: reaped child process 1201, status = succeeded4282lb # [ 65.739506] niks3-server[1006]: 2026/09/20 12:47:15 INFO Received uploads request method=POST path=/api/pending_closures4283worker2 # [ 65.735702] nix-grpc-daemon[939]: time=2026-09-20T12:47:15.169Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4284worker2 # [ 65.737767] nix-grpc-daemon[939]: time=2026-09-20T12:47:15.169Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4285lb # [ 65.788891] niks3-server[1006]: 2026/09/20 12:47:15 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4286lb # [ 65.802696] niks3-server[1006]: 2026/09/20 12:47:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4287worker2 # [ 65.792364] nix-grpc-daemon[939]: time=2026-09-20T12:47:15.226Z level=INFO msg="Uploading 1 narinfos"4288lb # [ 65.815601] niks3-server[1006]: 2026/09/20 12:47:15 INFO Signed narinfos id=13 count=14289lb # [ 65.824707] niks3-server[1006]: 2026/09/20 12:47:15 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4290lb # [ 65.838617] niks3-server[1006]: 2026/09/20 12:47:15 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4291lb # [ 65.849147] niks3-server[1006]: 2026/09/20 12:47:15 INFO Completed upload id=134292worker2 # [ 65.830478] nix-grpc-daemon[939]: time=2026-09-20T12:47:15.264Z level=INFO msg="Upload complete. (603ms)"4293lb # [ 65.857162] niks3-server[1006]: 2026/09/20 12:47:15 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4294worker2 # [ 65.846348] nix-grpc-daemon[858]: ts=2026-09-20T12:47:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_in=6244295worker2 # [ 65.861552] nix-grpc-daemon[858]: ts=2026-09-20T12:47:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479744296worker2 # [ 65.875734] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4297worker2 # [ 65.883901] nix-daemon[926]: reaped child process 1191, status = succeeded4298worker2 # [ 65.905831] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4299worker2 # [ 66.746596] nix-daemon[926]: reaped child process 1205, status = succeeded4300worker2 # [ 66.942884] nix-daemon[926]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)4301worker2 # [ 66.966259] nix-daemon[926]: reaped child process 1223, status = succeeded4302lb # [ 67.002901] niks3-server[1006]: 2026/09/20 12:47:16 INFO Received uploads request method=POST path=/api/pending_closures4303worker2 # [ 66.996567] nix-grpc-daemon[939]: time=2026-09-20T12:47:16.429Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4304worker2 # [ 66.998199] nix-grpc-daemon[939]: time=2026-09-20T12:47:16.429Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4305lb # [ 67.052054] niks3-server[1006]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4306lb # [ 67.067834] niks3-server[1006]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4307lb # [ 67.077211] niks3-server[1006]: 2026/09/20 12:47:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4308worker2 # [ 67.061846] nix-grpc-daemon[939]: time=2026-09-20T12:47:16.496Z level=INFO msg="Uploading 1 narinfos"4309lb # [ 67.083598] niks3-server[1006]: 2026/09/20 12:47:16 INFO Signed narinfos id=14 count=14310lb # [ 67.092111] niks3-server[1006]: 2026/09/20 12:47:16 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4311worker2 # [ 67.077946] nix-grpc-daemon[939]: time=2026-09-20T12:47:16.512Z level=INFO msg="Upload complete. (358ms)"4312lb # [ 67.099951] niks3-server[1006]: 2026/09/20 12:47:16 INFO Completed upload id=144313lb # [ 67.101617] niks3-server[1006]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4314lb # [ 67.106513] niks3-server[1006]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4315worker2 # [ 67.096716] nix-grpc-daemon[858]: ts=2026-09-20T12:47:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14316worker1 # [ 67.075560] nix-grpc-daemon[786]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:588524317worker2 # [ 67.111326] nix-daemon[926]: reaped child process 1203, status = succeeded4318worker1 # [ 67.103480] nix-grpc-daemon[786]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4319worker1 # [ 67.130352] nix-grpc-daemon[786]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4320worker1 # [ 67.175817] nix-grpc-daemon[786]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:588524321worker1 # [ 67.183680] nix-grpc-daemon[786]: ts=2026-09-20T12:47:16Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58852 duration_s=0 paths=1 nar_bytes_out=1764322worker2 # [ 67.575175] nix-grpc-daemon[858]: ts=2026-09-20T12:47:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:479744323worker2 # [ 67.585093] nix-grpc-daemon[858]: ts=2026-09-20T12:47:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744324worker2 # [ 67.593947] nix-grpc-daemon[939]: time=2026-09-20T12:47:17.026Z level=INFO msg="All 2 paths already cached"4325worker2 # [ 67.618170] nix-grpc-daemon[858]: ts=2026-09-20T12:47:17Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04326worker2 # [ 67.627889] nix-grpc-daemon[858]: ts=2026-09-20T12:47:17Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14327worker2 # [ 67.639754] nix-grpc-daemon[858]: ts=2026-09-20T12:47:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479744328worker2 # [ 67.656547] nix-grpc-daemon[858]: ts=2026-09-20T12:47:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744329worker2 # [ 67.675624] nix-grpc-daemon[939]: time=2026-09-20T12:47:17.110Z level=INFO msg="All 2 paths already cached"4330worker2 # [ 67.687827] nix-grpc-daemon[858]: ts=2026-09-20T12:47:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479744331worker2 # [ 67.706430] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4332worker2 # [ 67.967348] nix-daemon[926]: accepted connection from pid 1229, user nix-grpc-daemon (trusted)4333worker2 # [ 67.996762] nix-daemon[926]: reaped child process 1232, status = succeeded4334worker2 # [ 68.210352] nix-daemon[926]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)4335worker2 # [ 68.236631] nix-daemon[926]: reaped child process 1237, status = succeeded4336lb # [ 68.270691] niks3-server[1006]: 2026/09/20 12:47:17 INFO Received uploads request method=POST path=/api/pending_closures4337worker2 # [ 68.263801] nix-grpc-daemon[939]: time=2026-09-20T12:47:17.697Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4338worker2 # [ 68.265644] nix-grpc-daemon[939]: time=2026-09-20T12:47:17.697Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4339lb # [ 68.315898] niks3-server[1006]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4340lb # [ 68.329987] niks3-server[1006]: 2026/09/20 12:47:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4341worker2 # [ 68.319280] nix-grpc-daemon[939]: time=2026-09-20T12:47:17.753Z level=INFO msg="Uploading 1 narinfos"4342lb # [ 68.340941] niks3-server[1006]: 2026/09/20 12:47:17 INFO Signed narinfos id=15 count=14343lb # [ 68.350016] niks3-server[1006]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4344lb # [ 68.364350] niks3-server[1006]: 2026/09/20 12:47:17 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4345lb # [ 68.371705] niks3-server[1006]: 2026/09/20 12:47:17 INFO Completed upload id=154346lb # [ 68.373508] niks3-server[1006]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4347worker2 # [ 68.353302] nix-grpc-daemon[939]: time=2026-09-20T12:47:17.787Z level=INFO msg="Upload complete. (628ms)"4348worker2 # [ 68.365706] nix-grpc-daemon[858]: ts=2026-09-20T12:47:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_in=7524349worker2 # [ 68.382573] nix-grpc-daemon[858]: ts=2026-09-20T12:47:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479744350worker2 # [ 68.397147] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4351worker2 # [ 68.408377] nix-daemon[926]: reaped child process 1227, status = succeeded4352worker2 # [ 68.419895] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4353worker2 # [ 70.074711] nix-daemon[926]: reaped child process 1241, status = succeeded4354worker2 # [ 70.248902] nix-daemon[926]: accepted connection from pid 1256, user nix-grpc-daemon (trusted)4355worker2 # [ 70.272485] nix-daemon[926]: reaped child process 1259, status = succeeded4356lb # [ 70.305035] niks3-server[1006]: 2026/09/20 12:47:19 INFO Received uploads request method=POST path=/api/pending_closures4357worker2 # [ 70.293559] nix-grpc-daemon[939]: time=2026-09-20T12:47:19.727Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4358worker2 # [ 70.295091] nix-grpc-daemon[939]: time=2026-09-20T12:47:19.727Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4359lb # [ 70.349434] niks3-server[1006]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4360lb # [ 70.362599] niks3-server[1006]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4361lb # [ 70.372858] niks3-server[1006]: 2026/09/20 12:47:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4362lb # [ 70.379116] niks3-server[1006]: 2026/09/20 12:47:19 INFO Signed narinfos id=16 count=14363worker2 # [ 70.359915] nix-grpc-daemon[939]: time=2026-09-20T12:47:19.793Z level=INFO msg="Uploading 1 narinfos"4364lb # [ 70.385253] niks3-server[1006]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4365lb # [ 70.397834] niks3-server[1006]: 2026/09/20 12:47:19 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4366lb # [ 70.407336] niks3-server[1006]: 2026/09/20 12:47:19 INFO Completed upload id=164367worker2 # [ 70.388727] nix-grpc-daemon[939]: time=2026-09-20T12:47:19.823Z level=INFO msg="Upload complete. (349ms)"4368lb # [ 70.410581] niks3-server[1006]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4369worker2 # [ 70.405979] nix-grpc-daemon[858]: ts=2026-09-20T12:47:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=2 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14370worker2 # [ 70.420451] nix-grpc-daemon[858]: ts=2026-09-20T12:47:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:479744371worker2 # [ 70.427695] nix-daemon[926]: reaped child process 1239, status = succeeded4372worker2 # [ 70.432449] nix-grpc-daemon[858]: ts=2026-09-20T12:47:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:479744373worker2 # [ 70.436584] nix-grpc-daemon[858]: ts=2026-09-20T12:47:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_out=2324374client # [ 70.579587] nix-daemon[975]: reaped child process 977, status = succeeded4375client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.86 seconds)4376client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4377client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4378client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4379client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds)4380client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4381client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4382(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 9.00 seconds)4383subtest: an input only one worker has still reaches the builder4384client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4385client # this derivation will be built:4386client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4387client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4388client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.49 seconds)4389client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4390client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.24 seconds)4391worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4392worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.30 seconds)4393worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4394worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4395client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24396client # [ 72.038000] nix-daemon[975]: accepted connection from pid 1057, user root (trusted)4397client # this derivation will be built:4398client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4399worker2 # [ 72.249238] nix-grpc-daemon[858]: ts=2026-09-20T12:47:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:479744400client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4401worker1 # [ 72.232871] nix-grpc-daemon[786]: ts=2026-09-20T12:47:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:588524402worker1 # [ 72.459313] nix-daemon[843]: accepted connection from pid 949, user nix-grpc-daemon (trusted)4403worker1 # [ 72.479606] nix-daemon[843]: reaped child process 952, status = succeeded4404lb # [ 72.536122] niks3-server[1006]: 2026/09/20 12:47:21 INFO Received uploads request method=POST path=/api/pending_closures4405worker1 # [ 72.514301] nix-grpc-daemon[870]: time=2026-09-20T12:47:21.969Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4406worker1 # [ 72.516645] nix-grpc-daemon[870]: time=2026-09-20T12:47:21.971Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4407lb # [ 72.574914] niks3-server[1006]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4408worker1 # [ 72.540110] nix-grpc-daemon[870]: time=2026-09-20T12:47:21.995Z level=INFO msg="Uploading 1 narinfos"4409lb # [ 72.583038] niks3-server[1006]: 2026/09/20 12:47:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4410lb # [ 72.588645] niks3-server[1006]: 2026/09/20 12:47:22 INFO Signed narinfos id=17 count=14411lb # [ 72.590189] niks3-server[1006]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4412lb # [ 72.598678] niks3-server[1006]: 2026/09/20 12:47:22 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4413lb # [ 72.603147] niks3-server[1006]: 2026/09/20 12:47:22 INFO Completed upload id=174414worker1 # [ 72.560681] nix-grpc-daemon[870]: time=2026-09-20T12:47:22.016Z level=INFO msg="Upload complete. (321ms)"4415lb # [ 72.605826] niks3-server[1006]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4416worker2 # [ 72.610688] nix-grpc-daemon[858]: ts=2026-09-20T12:47:22Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04417worker2 # [ 72.617859] nix-grpc-daemon[858]: ts=2026-09-20T12:47:22Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14418worker1 # [ 72.636849] nix-grpc-daemon[786]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:588524419worker1 # [ 72.650988] nix-grpc-daemon[786]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:588524420client # copying 2 paths to 'lb:50051'...4421client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4422worker1 # [ 72.673663] nix-grpc-daemon[786]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:588524423client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4424worker1 # [ 72.686449] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4425worker1 # [ 72.913228] nix-daemon[843]: accepted connection from pid 956, user nix-grpc-daemon (trusted)4426worker1 # [ 72.937150] nix-daemon[843]: reaped child process 959, status = succeeded4427worker1 # [ 73.128185] nix-daemon[843]: accepted connection from pid 961, user nix-grpc-daemon (trusted)4428worker1 # [ 73.149185] nix-daemon[843]: reaped child process 964, status = succeeded4429lb # [ 73.201759] niks3-server[1006]: 2026/09/20 12:47:22 INFO Received uploads request method=POST path=/api/pending_closures4430lb # [ 73.208955] niks3-server[1006]: 2026/09/20 12:47:22 INFO Received uploads request method=POST path=/api/pending_closures4431worker1 # [ 73.174607] nix-grpc-daemon[870]: time=2026-09-20T12:47:22.629Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4432worker1 # [ 73.176411] nix-grpc-daemon[870]: time=2026-09-20T12:47:22.629Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4433worker1 # [ 73.178224] nix-grpc-daemon[870]: time=2026-09-20T12:47:22.629Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4434lb # [ 73.243341] niks3-server[1006]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4435lb # [ 73.261814] niks3-server[1006]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4436lb # [ 73.273239] niks3-server[1006]: 2026/09/20 12:47:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4437lb # [ 73.275953] niks3-server[1006]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4438lb # [ 73.279863] niks3-server[1006]: 2026/09/20 12:47:22 INFO Signed narinfos id=18 count=14439worker1 # [ 73.238985] nix-grpc-daemon[870]: time=2026-09-20T12:47:22.693Z level=INFO msg="Uploading 3 narinfos"4440lb # [ 73.285039] niks3-server[1006]: 2026/09/20 12:47:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4441lb # [ 73.291632] niks3-server[1006]: 2026/09/20 12:47:22 INFO Signed narinfos id=19 count=24442lb # [ 73.294897] niks3-server[1006]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4443lb # [ 73.312368] niks3-server[1006]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4444lb # [ 73.322949] niks3-server[1006]: 2026/09/20 12:47:22 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4445lb # [ 73.325769] niks3-server[1006]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4446lb # [ 73.330886] niks3-server[1006]: 2026/09/20 12:47:22 INFO Completed upload id=194447lb # [ 73.332654] niks3-server[1006]: 2026/09/20 12:47:22 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4448lb # [ 73.335969] niks3-server[1006]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4449lb # [ 73.338907] niks3-server[1006]: 2026/09/20 12:47:22 INFO Completed upload id=184450worker1 # [ 73.297438] nix-grpc-daemon[870]: time=2026-09-20T12:47:22.753Z level=INFO msg="Upload complete. (587ms)"4451worker1 # [ 73.304822] nix-grpc-daemon[786]: ts=2026-09-20T12:47:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58852 duration_s=0 paths=2 nar_bytes_in=9844452worker1 # [ 73.314221] nix-grpc-daemon[786]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:588524453worker1 # [ 73.318813] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4454worker1 # [ 73.324279] nix-daemon[843]: reaped child process 954, status = succeeded4455client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4456worker1 # [ 73.339977] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4457client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4458worker1 # [ 74.790215] nix-daemon[843]: reaped child process 968, status = succeeded4459worker1 # [ 74.988967] nix-daemon[843]: accepted connection from pid 983, user nix-grpc-daemon (trusted)4460worker1 # [ 75.012360] nix-daemon[843]: reaped child process 986, status = succeeded4461lb # [ 75.069840] niks3-server[1006]: 2026/09/20 12:47:24 INFO Received uploads request method=POST path=/api/pending_closures4462worker1 # [ 75.040435] nix-grpc-daemon[870]: time=2026-09-20T12:47:24.495Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4463lb # [ 75.107804] niks3-server[1006]: 2026/09/20 12:47:24 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4464lb # [ 75.119347] niks3-server[1006]: 2026/09/20 12:47:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4465worker1 # [ 75.084529] nix-grpc-daemon[870]: time=2026-09-20T12:47:24.539Z level=INFO msg="Uploading 1 narinfos"4466lb # [ 75.129191] niks3-server[1006]: 2026/09/20 12:47:24 INFO Signed narinfos id=20 count=14467lb # [ 75.142667] niks3-server[1006]: 2026/09/20 12:47:24 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4468lb # [ 75.189606] niks3-server[1006]: 2026/09/20 12:47:24 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4469worker1 # [ 75.155957] nix-grpc-daemon[870]: time=2026-09-20T12:47:24.611Z level=INFO msg="Upload complete. (403ms)"4470lb # [ 75.198530] niks3-server[1006]: 2026/09/20 12:47:24 INFO Completed upload id=204471lb # [ 75.203474] niks3-server[1006]: 2026/09/20 12:47:24 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4472worker1 # [ 75.169225] nix-grpc-daemon[786]: ts=2026-09-20T12:47:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58852 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14473worker1 # [ 75.189028] nix-daemon[843]: reaped child process 966, status = succeeded4474client # copying 1 paths...4475worker1 # [ 75.221437] nix-grpc-daemon[786]: ts=2026-09-20T12:47:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:588524476client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4477worker2 # [ 75.277658] nix-grpc-daemon[858]: ts=2026-09-20T12:47:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:479744478worker2 # [ 75.298478] nix-grpc-daemon[858]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4479worker2 # [ 75.326396] nix-grpc-daemon[858]: ts=2026-09-20T12:47:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_out=1204480lb # [ 75.388670] envoy[872]: conn peer=[2001:db8:1::1]:39632 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=724481lb # [ 75.398045] envoy[872]: conn peer=[2001:db8:1::1]:39630 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3888 tx=1967 ms=21694482lb # [ 75.403476] envoy[872]: conn peer=[2001:db8:1::1]:39662 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=634483lb # [ 75.408700] envoy[872]: conn peer=[2001:db8:1::1]:39646 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4330 tx=2129 ms=29184484client # [ 75.480464] nix-daemon[975]: reaped child process 1060, status = succeeded4485client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.68 seconds)4486client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24487client # [ 75.709301] nix-daemon[975]: accepted connection from pid 1079, user root (trusted)4488client # this derivation will be built:4489client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4490worker1 # [ 75.891752] nix-grpc-daemon[786]: ts=2026-09-20T12:47:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:588524491client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4492worker2 # [ 75.919568] nix-grpc-daemon[858]: ts=2026-09-20T12:47:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744493worker2 # [ 75.950901] nix-grpc-daemon[858]: ts=2026-09-20T12:47:25Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04494worker2 # [ 75.958887] nix-grpc-daemon[858]: ts=2026-09-20T12:47:25Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14495worker2 # [ 75.969372] nix-grpc-daemon[858]: ts=2026-09-20T12:47:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479744496worker2 # [ 75.982714] nix-grpc-daemon[858]: ts=2026-09-20T12:47:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744497client # copying 1 paths to 'lb:50051'...4498client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4499worker2 # [ 76.003112] nix-grpc-daemon[858]: ts=2026-09-20T12:47:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479744500worker2 # [ 76.021137] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4501worker2 # [ 76.044602] nix-grpc-daemon[858]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 29 ms (attempt 1/5)4502worker2 # [ 76.079557] nix-grpc-daemon[858]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 2/5)4503worker2 # [ 76.088655] nix-grpc-daemon[858]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 193 ms (attempt 3/5)4504worker2 # [ 76.282896] nix-grpc-daemon[858]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 338 ms (attempt 4/5)4505worker2 # [ 76.629145] nix-grpc-daemon[858]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4506worker2 # [ 76.639270] nix-grpc-daemon[858]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4507worker2 # [ 76.897054] nix-daemon[926]: accepted connection from pid 1275, user nix-grpc-daemon (trusted)4508worker2 # [ 76.919206] nix-daemon[926]: reaped child process 1278, status = succeeded4509worker2 # [ 77.089300] nix-daemon[926]: accepted connection from pid 1280, user nix-grpc-daemon (trusted)4510worker2 # [ 77.111535] nix-daemon[926]: reaped child process 1283, status = succeeded4511lb # [ 77.143964] niks3-server[1006]: 2026/09/20 12:47:26 INFO Received uploads request method=POST path=/api/pending_closures4512worker2 # [ 77.364332] nix-grpc-daemon[939]: time=2026-09-20T12:47:26.797Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4513worker2 # [ 77.369029] nix-grpc-daemon[939]: time=2026-09-20T12:47:26.797Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4514lb # [ 77.411763] niks3-server[1006]: 2026/09/20 12:47:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4515worker2 # [ 77.400844] nix-grpc-daemon[939]: time=2026-09-20T12:47:26.834Z level=INFO msg="Uploading 1 narinfos"4516lb # [ 77.423595] niks3-server[1006]: 2026/09/20 12:47:26 INFO Signed narinfos id=21 count=14517lb # [ 77.432396] niks3-server[1006]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4518lb # [ 77.451496] niks3-server[1006]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4519lb # [ 77.456245] niks3-server[1006]: 2026/09/20 12:47:26 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4520worker2 # [ 77.442619] nix-grpc-daemon[939]: time=2026-09-20T12:47:26.877Z level=INFO msg="Upload complete. (766ms)"4521lb # [ 77.462133] niks3-server[1006]: 2026/09/20 12:47:26 INFO Completed upload id=214522lb # [ 77.465726] niks3-server[1006]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4523worker2 # [ 77.453345] nix-grpc-daemon[858]: ts=2026-09-20T12:47:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=1 paths=1 nar_bytes_in=5684524worker2 # [ 77.465256] nix-grpc-daemon[858]: ts=2026-09-20T12:47:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479744525worker2 # [ 77.481968] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4526worker2 # [ 77.487215] nix-daemon[926]: reaped child process 1269, status = succeeded4527worker2 # [ 77.496171] nix-grpc-daemon[858]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4528client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4529worker2 # [ 77.514958] nix-daemon[926]: accepted connection from pid 858, user nix-grpc-daemon (trusted)4530client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4531worker2 # [ 78.946640] nix-daemon[926]: reaped child process 1288, status = succeeded4532worker2 # [ 79.113367] nix-daemon[926]: accepted connection from pid 1303, user nix-grpc-daemon (trusted)4533worker2 # [ 79.137357] nix-daemon[926]: reaped child process 1306, status = succeeded4534lb # [ 79.170220] niks3-server[1006]: 2026/09/20 12:47:28 INFO Received uploads request method=POST path=/api/pending_closures4535worker2 # [ 79.161805] nix-grpc-daemon[939]: time=2026-09-20T12:47:28.595Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4536lb # [ 79.205293] niks3-server[1006]: 2026/09/20 12:47:28 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4537lb # [ 79.218622] niks3-server[1006]: 2026/09/20 12:47:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4538worker2 # [ 79.209086] nix-grpc-daemon[939]: time=2026-09-20T12:47:28.643Z level=INFO msg="Uploading 1 narinfos"4539lb # [ 79.233191] niks3-server[1006]: 2026/09/20 12:47:28 INFO Signed narinfos id=22 count=14540lb # [ 79.240252] niks3-server[1006]: 2026/09/20 12:47:28 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4541lb # [ 79.253179] niks3-server[1006]: 2026/09/20 12:47:28 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4542lb # [ 79.260495] niks3-server[1006]: 2026/09/20 12:47:28 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4543lb # [ 79.264943] niks3-server[1006]: 2026/09/20 12:47:28 INFO Completed upload id=224544worker2 # [ 79.246494] nix-grpc-daemon[939]: time=2026-09-20T12:47:28.681Z level=INFO msg="Upload complete. (313ms)"4545worker2 # [ 79.252731] nix-grpc-daemon[858]: ts=2026-09-20T12:47:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14546worker2 # [ 79.263388] nix-daemon[926]: reaped child process 1285, status = succeeded4547client # copying 1 paths...4548worker2 # [ 79.307277] nix-grpc-daemon[858]: ts=2026-09-20T12:47:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:479744549client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4550worker1 # [ 79.318578] nix-grpc-daemon[786]: ts=2026-09-20T12:47:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:588524551worker1 # [ 79.337012] nix-grpc-daemon[786]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4552worker1 # [ 79.361550] nix-grpc-daemon[786]: ts=2026-09-20T12:47:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58852 duration_s=0 paths=1 nar_bytes_out=1204553client # [ 79.541852] nix-daemon[975]: reaped child process 1082, status = succeeded4554client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 4.06 seconds)4555client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24556client # [ 79.772338] nix-daemon[975]: accepted connection from pid 1101, user root (trusted)4557client # this derivation will be built:4558client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4559worker1 # [ 79.955827] nix-grpc-daemon[786]: ts=2026-09-20T12:47:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:588524560client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4561worker2 # [ 79.989138] nix-grpc-daemon[858]: ts=2026-09-20T12:47:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744562worker2 # [ 80.004864] nix-grpc-daemon[939]: time=2026-09-20T12:47:29.439Z level=INFO msg="All 1 paths already cached"4563worker2 # [ 80.025504] nix-grpc-daemon[858]: ts=2026-09-20T12:47:29Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04564worker2 # [ 80.029941] nix-grpc-daemon[858]: ts=2026-09-20T12:47:29Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14565worker1 # [ 80.012183] nix-grpc-daemon[786]: ts=2026-09-20T12:47:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:588524566worker1 # [ 80.031909] nix-grpc-daemon[786]: ts=2026-09-20T12:47:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:588524567worker1 # [ 80.586306] nix-grpc-daemon[870]: time=2026-09-20T12:47:30.040Z level=INFO msg="All 1 paths already cached"4568client # copying 1 paths to 'lb:50051'...4569client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4570worker1 # [ 80.601925] nix-grpc-daemon[786]: ts=2026-09-20T12:47:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:588524571worker1 # [ 80.618171] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4572worker1 # [ 80.841678] nix-daemon[843]: accepted connection from pid 991, user nix-grpc-daemon (trusted)4573worker1 # [ 80.864269] nix-daemon[843]: reaped child process 994, status = succeeded4574worker1 # [ 81.047565] nix-daemon[843]: accepted connection from pid 996, user nix-grpc-daemon (trusted)4575worker1 # [ 81.067714] nix-daemon[843]: reaped child process 999, status = succeeded4576lb # [ 81.120919] niks3-server[1006]: 2026/09/20 12:47:30 INFO Received uploads request method=POST path=/api/pending_closures4577worker1 # [ 81.090281] nix-grpc-daemon[870]: time=2026-09-20T12:47:30.545Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4578worker1 # [ 81.092471] nix-grpc-daemon[870]: time=2026-09-20T12:47:30.547Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4579lb # [ 81.148837] niks3-server[1006]: 2026/09/20 12:47:30 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4580lb # [ 81.154895] niks3-server[1006]: 2026/09/20 12:47:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4581worker1 # [ 81.115749] nix-grpc-daemon[870]: time=2026-09-20T12:47:30.571Z level=INFO msg="Uploading 1 narinfos"4582lb # [ 81.160133] niks3-server[1006]: 2026/09/20 12:47:30 INFO Signed narinfos id=23 count=14583lb # [ 81.163999] niks3-server[1006]: 2026/09/20 12:47:30 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4584lb # [ 81.171651] niks3-server[1006]: 2026/09/20 12:47:30 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4585lb # [ 81.177472] niks3-server[1006]: 2026/09/20 12:47:30 INFO Completed upload id=234586worker1 # [ 81.136203] nix-grpc-daemon[870]: time=2026-09-20T12:47:30.591Z level=INFO msg="Upload complete. (498ms)"4587lb # [ 81.180032] niks3-server[1006]: 2026/09/20 12:47:30 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4588worker1 # [ 81.143196] nix-grpc-daemon[786]: ts=2026-09-20T12:47:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58852 duration_s=0 paths=1 nar_bytes_in=5684589worker1 # [ 81.155430] nix-grpc-daemon[786]: ts=2026-09-20T12:47:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:588524590worker1 # [ 81.160593] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4591worker1 # [ 81.164936] nix-daemon[843]: reaped child process 989, status = succeeded4592client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4593worker1 # [ 81.177525] nix-daemon[843]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4594client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4595worker1 # [ 82.802499] nix-daemon[843]: reaped child process 1003, status = succeeded4596worker1 # [ 82.971817] nix-daemon[843]: accepted connection from pid 1018, user nix-grpc-daemon (trusted)4597worker1 # [ 82.995773] nix-daemon[843]: reaped child process 1021, status = succeeded4598lb # [ 83.051196] niks3-server[1006]: 2026/09/20 12:47:32 INFO Received uploads request method=POST path=/api/pending_closures4599worker1 # [ 83.026616] nix-grpc-daemon[870]: time=2026-09-20T12:47:32.480Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4600lb # [ 83.103146] niks3-server[1006]: 2026/09/20 12:47:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4601worker1 # [ 83.068923] nix-grpc-daemon[870]: time=2026-09-20T12:47:32.524Z level=INFO msg="Uploading 1 narinfos"4602lb # [ 83.114645] niks3-server[1006]: 2026/09/20 12:47:32 INFO Signed narinfos id=24 count=14603lb # [ 83.126289] niks3-server[1006]: 2026/09/20 12:47:32 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4604lb # [ 83.153574] niks3-server[1006]: 2026/09/20 12:47:32 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4605lb # [ 83.164211] niks3-server[1006]: 2026/09/20 12:47:32 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4606worker1 # [ 83.129580] nix-grpc-daemon[870]: time=2026-09-20T12:47:32.585Z level=INFO msg="Upload complete. (341ms)"4607lb # [ 83.170909] niks3-server[1006]: 2026/09/20 12:47:32 INFO Completed upload id=244608lb # [ 83.175094] niks3-server[1006]: 2026/09/20 12:47:32 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4609worker1 # [ 83.136610] nix-grpc-daemon[786]: ts=2026-09-20T12:47:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58852 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14610worker1 # [ 83.144772] nix-daemon[843]: reaped child process 1001, status = succeeded4611client # copying 1 paths...4612worker2 # [ 83.210467] nix-grpc-daemon[858]: ts=2026-09-20T12:47:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:479744613worker2 # [ 83.226563] nix-grpc-daemon[858]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4614client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4615worker2 # [ 83.264184] nix-grpc-daemon[858]: ts=2026-09-20T12:47:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:479744616worker2 # [ 83.271178] nix-grpc-daemon[858]: ts=2026-09-20T12:47:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_out=1204617client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.86 seconds)4618(finished: subtest: an input only one worker has still reaches the builder, in 12.67 seconds)4619subtest: upload whose reference the worker lacks is completed from the cache4620client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4621client # [ 83.482598] nix-daemon[975]: reaped child process 1104, status = succeeded4622client # this derivation will be built:4623client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4624client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4625client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.49 seconds)4626client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4627client # this derivation will be built:4628client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4629client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4630client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.46 seconds)4631client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4632client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.22 seconds)4633worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4634worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.24 seconds)4635worker2 # [ 84.883615] systemd[1]: Stopping Nix worker-protocol over gRPC...4636lb # [ 85.386903] envoy[872]: conn peer=[2001:db8:1::1]:55408 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1184637lb # [ 85.392177] envoy[872]: conn peer=[2001:db8:1::1]:55396 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3863 tx=1764 ms=31414638lb # [ 85.397577] envoy[872]: conn peer=[2001:db8:1::1]:55426 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1074639lb # [ 85.402440] envoy[872]: conn peer=[2001:db8:1::1]:55424 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1804 ms=35334640lb # [ 85.407447] envoy[872]: conn peer=[2001:db8:1::1]:55438 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3717 tx=1957 ms=33534641lb # [ 85.412381] envoy[872]: conn peer=[2001:db8:1::1]:43676 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=684642worker2 # [ 85.873752] nix-grpc-daemon[858]: ts=2026-09-20T12:47:35Z level=info event=signal_exit4643worker2 # [ 86.121605] nix-grpc-daemon[858]: ts=2026-09-20T12:47:35Z level=info event=scheduler_yield4644worker1 # [ 86.103238] nix-grpc-daemon[786]: ts=2026-09-20T12:47:35Z level=info event=scheduler_restarting addr=lb:500514645lb # [ 86.146562] niks3-server[1006]: 2026/09/20 12:47:35 INFO lead: released remote=192.168.1.4:370564646worker2 # [ 86.128691] nix-grpc-daemon[858]: ts=2026-09-20T12:47:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:479664647worker2 # [ 86.133374] nix-grpc-daemon[858]: ts=2026-09-20T12:47:35Z level=info event=worker_gone addr=192.168.1.3:500514648worker2 # [ 86.139508] nix-grpc-daemon[858]: ts=2026-09-20T12:47:35Z level=info event=scheduler_restarting addr=lb:500514649worker2 # [ 86.143840] nix-grpc-daemon[858]: ts=2026-09-20T12:47:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:479664650worker2 # [ 86.148466] nix-grpc-daemon[858]: ts=2026-09-20T12:47:35Z level=info event=worker_gone addr=192.168.1.4:500514651worker2 # [ 86.329523] nix-grpc-daemon[858]: ts=2026-09-20T12:47:35Z level=info event=scheduler_connected addr=lb:500514652worker1 # [ 86.304480] nix-grpc-daemon[786]: ts=2026-09-20T12:47:35Z level=info event=scheduler_connected addr=lb:500514653worker2 # [ 86.332698] nix-grpc-daemon[858]: ts=2026-09-20T12:47:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4654worker1 # [ 86.310484] nix-grpc-daemon[786]: ts=2026-09-20T12:47:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4655worker1 # [ 86.511354] nix-grpc-daemon[786]: ts=2026-09-20T12:47:35Z level=info event=scheduler_connected addr=lb:500514656worker2 # [ 86.534200] nix-grpc-daemon[858]: ts=2026-09-20T12:47:35Z level=info event=scheduler_connected addr=lb:500514657worker1 # [ 86.516996] nix-grpc-daemon[786]: ts=2026-09-20T12:47:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4658worker2 # [ 86.539879] nix-grpc-daemon[858]: ts=2026-09-20T12:47:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4659worker2 # [ 86.741362] nix-grpc-daemon[858]: ts=2026-09-20T12:47:36Z level=info event=scheduler_connected addr=lb:500514660worker1 # [ 86.718015] nix-grpc-daemon[786]: ts=2026-09-20T12:47:36Z level=info event=scheduler_connected addr=lb:500514661worker1 # [ 86.724080] nix-grpc-daemon[786]: ts=2026-09-20T12:47:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4662worker2 # [ 86.746987] nix-grpc-daemon[858]: ts=2026-09-20T12:47:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4663worker1 # [ 86.924840] nix-grpc-daemon[786]: ts=2026-09-20T12:47:36Z level=info event=scheduler_connected addr=lb:500514664worker2 # [ 86.950176] nix-grpc-daemon[858]: ts=2026-09-20T12:47:36Z level=info event=scheduler_connected addr=lb:500514665worker1 # [ 86.930583] nix-grpc-daemon[786]: ts=2026-09-20T12:47:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4666worker2 # [ 86.954565] nix-grpc-daemon[858]: ts=2026-09-20T12:47:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4667worker2 # [ 87.128201] nix-grpc-daemon[858]: ts=2026-09-20T12:47:36Z level=info event=scheduler_restarting4668worker1 # [ 87.133058] nix-grpc-daemon[786]: ts=2026-09-20T12:47:36Z level=info event=scheduler_connected addr=lb:500514669worker1 # [ 87.138500] nix-grpc-daemon[786]: ts=2026-09-20T12:47:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4670worker2 # [ 87.181312] nix-grpc-daemon[858]: ts=2026-09-20T12:47:36Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4671worker2 # [ 87.201022] nix-daemon[926]: reaped child process 928, status = succeeded4672worker1 # [ 87.339732] nix-grpc-daemon[786]: ts=2026-09-20T12:47:36Z level=info event=scheduler_connected addr=lb:500514673worker1 # [ 87.345422] nix-grpc-daemon[786]: ts=2026-09-20T12:47:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4674worker1 # [ 87.546347] nix-grpc-daemon[786]: ts=2026-09-20T12:47:37Z level=info event=scheduler_connected addr=lb:500514675worker1 # [ 87.552093] nix-grpc-daemon[786]: ts=2026-09-20T12:47:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4676lb # [ 87.679089] niks3-server[1006]: 2026/09/20 12:47:37 INFO lead: acquired remote=192.168.1.3:494044677worker1 # [ 87.638127] nix-grpc-daemon[786]: ts=2026-09-20T12:47:37Z level=info event=scheduler_take_over4678worker1 # [ 87.753030] nix-grpc-daemon[786]: ts=2026-09-20T12:47:37Z level=info event=scheduler_connected addr=lb:500514679worker1 # [ 87.758776] nix-grpc-daemon[786]: ts=2026-09-20T12:47:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4680worker2 # [ 87.799421] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4681worker2 # [ 87.803309] systemd[1]: Stopped Nix worker-protocol over gRPC.4682worker2 # [ 87.809115] systemd[1]: nix-grpc-daemon.service: Consumed 4.106s CPU time over 1min 2.281s wall clock time, 62.9M memory peak, 87.7K incoming IP traffic, 193.4K outgoing IP traffic.4683worker2 # [ 87.822561] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4684worker2 # [ 87.826131] systemd[1]: Closed Nix worker-protocol over gRPC.4685worker2 # [ 87.828922] systemd[1]: nix-grpc-daemon.socket: Consumed 769us CPU time over 1min 10.469s wall clock time, 256K memory peak, 90.8K incoming IP traffic, 71.6K outgoing IP traffic.4686lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4687lb: must succeed: curl -sf localhost:9901/clusters4688lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4689lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4690client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24691worker1 # [ 87.959996] nix-grpc-daemon[786]: ts=2026-09-20T12:47:37Z level=info event=scheduler_connected addr=lb:500514692worker1 # [ 87.981152] nix-grpc-daemon[786]: ts=2026-09-20T12:47:37Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:390884693worker1 # [ 87.987113] nix-grpc-daemon[786]: ts=2026-09-20T12:47:37Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04694worker1 # [ 88.163290] nix-grpc-daemon[786]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:588524695client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4696worker1 # [ 88.171247] nix-grpc-daemon[786]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:588524697client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds)4698worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4699worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4700worker2 # [ 88.342524] systemd[1]: Listening on Nix worker-protocol over gRPC.4701worker1 # [ 88.406777] systemd[1]: Stopping Nix worker-protocol over gRPC...4702worker1 # [ 88.704499] nix-grpc-daemon[786]: ts=2026-09-20T12:47:38Z level=info event=signal_exit4703worker1 # [ 88.955636] nix-grpc-daemon[786]: ts=2026-09-20T12:47:38Z level=info event=scheduler_yield4704worker1 # [ 88.963633] nix-grpc-daemon[786]: ts=2026-09-20T12:47:38Z level=info event=scheduler_restarting addr=lb:500514705worker1 # [ 88.968127] nix-grpc-daemon[786]: ts=2026-09-20T12:47:38Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:390884706lb # [ 89.004845] niks3-server[1006]: 2026/09/20 12:47:38 INFO lead: released remote=192.168.1.3:494044707worker1 # [ 88.972650] nix-grpc-daemon[786]: ts=2026-09-20T12:47:38Z level=info event=worker_gone addr=192.168.1.3:500514708worker2 # [ 89.027512] systemd[1]: Starting scheduler-token.service...4709worker2 # [ 89.151804] systemd[1]: scheduler-token.service: Deactivated successfully.4710worker2 # [ 89.161669] systemd[1]: Finished scheduler-token.service.4711worker2 # [ 89.163517] systemd[1]: scheduler-token.service: Consumed 60ms CPU time over 129ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4712worker2 # [ 89.172669] systemd[1]: Starting Nix worker-protocol over gRPC...4713worker1 # [ 89.164732] nix-grpc-daemon[786]: ts=2026-09-20T12:47:38Z level=info event=scheduler_connected addr=lb:500514714worker1 # [ 89.169002] nix-grpc-daemon[786]: ts=2026-09-20T12:47:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4715worker2 # [ 89.360289] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:38Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4716worker2 # [ 89.363035] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:38Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4717worker2 # [ 89.367212] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:38Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14718worker2 # [ 89.375787] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:38Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4719worker1 # [ 89.365668] nix-grpc-daemon[786]: ts=2026-09-20T12:47:38Z level=info event=scheduler_connected addr=lb:500514720worker2 # [ 89.389489] systemd[1]: Started Nix worker-protocol over gRPC.4721worker2 # [ 89.391944] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:38Z level=info event=scheduler_take_over4722lb # [ 89.409932] niks3-server[1006]: 2026/09/20 12:47:38 INFO lead: acquired remote=192.168.1.4:391284723worker1 # [ 89.384976] nix-grpc-daemon[786]: ts=2026-09-20T12:47:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4724worker2 # [ 89.410854] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:38Z level=info event=scheduler_connected addr=lb:500514725worker2 # [ 89.412811] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4726worker1 # [ 89.586160] nix-grpc-daemon[786]: ts=2026-09-20T12:47:39Z level=info event=scheduler_connected addr=lb:500514727worker2 # [ 89.614701] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=scheduler_connected addr=lb:500514728worker1 # [ 89.591947] nix-grpc-daemon[786]: ts=2026-09-20T12:47:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4729worker2 # [ 89.620334] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4730worker1 # [ 89.792886] nix-grpc-daemon[786]: ts=2026-09-20T12:47:39Z level=info event=scheduler_connected addr=lb:500514731worker2 # [ 89.821602] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=scheduler_connected addr=lb:500514732worker1 # [ 89.798425] nix-grpc-daemon[786]: ts=2026-09-20T12:47:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4733worker2 # [ 89.827118] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4734worker1 # [ 89.962877] nix-grpc-daemon[786]: ts=2026-09-20T12:47:39Z level=info event=scheduler_restarting4735worker2 # [ 90.028464] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=scheduler_connected addr=lb:500514736worker2 # [ 90.033826] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4737worker1 # [ 90.021171] nix-daemon[843]: reaped child process 845, status = succeeded4738worker1 # [ 90.023825] nix-grpc-daemon[786]: ts=2026-09-20T12:47:39Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4739worker2 # [ 90.235096] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=scheduler_connected addr=lb:500514740worker2 # [ 90.240632] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4741worker2 # [ 90.444926] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=scheduler_connected addr=lb:500514742worker2 # [ 90.460135] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=oidc_jwks provider=mock keys=14743worker2 # [ 90.464506] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:418244744worker2 # [ 90.469816] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:39Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04745worker1 # [ 90.838613] nix-grpc-daemon[786]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4746worker1 # [ 90.843349] nix-grpc-daemon[786]: E0000 00:00:1789908460.292593 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true4747worker1 # [ 90.850014] nix-grpc-daemon[786]: E0000 00:00:1789908460.292992 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4748worker1 # [ 91.678177] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4749worker1 # [ 91.685274] systemd[1]: Stopped Nix worker-protocol over gRPC.4750worker1 # [ 91.687904] systemd[1]: nix-grpc-daemon.service: Consumed 2.159s CPU time over 1min 6.324s wall clock time, 48.5M memory peak, 50.8K incoming IP traffic, 87.2K outgoing IP traffic.4751worker1 # [ 91.704600] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4752worker1 # [ 91.706873] systemd[1]: Closed Nix worker-protocol over gRPC.4753worker1 # [ 91.715450] systemd[1]: nix-grpc-daemon.socket: Consumed 773us CPU time over 1min 15.223s wall clock time, 256K memory peak, 66K incoming IP traffic, 59.5K outgoing IP traffic.4754lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4755lb: must succeed: curl -sf localhost:9901/clusters4756lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4757lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4758client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24759worker2 # [ 92.096282] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:528284760worker2 # [ 92.105364] nix-daemon[926]: accepted connection from pid 1333, user nix-grpc-daemon (trusted)4761worker2 # [ 92.120435] nix-grpc-daemon[1333]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 1/5)4762worker2 # [ 92.190533] nix-grpc-daemon[1333]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 2/5)4763worker2 # [ 92.278390] nix-grpc-daemon[1333]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 3/5)4764worker2 # [ 92.353735] nix-grpc-daemon[1333]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 768 ms (attempt 4/5)4765worker2 # [ 93.123809] nix-grpc-daemon[1333]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4766client # copying 2 paths...4767client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4768worker2 # [ 93.154234] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:528284769client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4770worker2 # [ 93.175558] nix-daemon[926]: accepted connection from pid 1333, user nix-grpc-daemon (trusted)4771worker2 # [ 93.206780] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:42Z level=info event=niks3_push_started pid=13894772worker2 # [ 93.422887] nix-grpc-daemon[1389]: time=2026-09-20T12:47:42.856Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4773worker2 # [ 93.613389] nix-daemon[926]: accepted connection from pid 1402, user nix-grpc-daemon (trusted)4774worker2 # [ 93.634447] nix-daemon[926]: reaped child process 1405, status = succeeded4775lb # [ 93.666178] niks3-server[1006]: 2026/09/20 12:47:43 INFO Received uploads request method=POST path=/api/pending_closures4776lb # [ 93.683216] niks3-server[1006]: 2026/09/20 12:47:43 INFO Received uploads request method=POST path=/api/pending_closures4777worker2 # [ 93.674886] nix-grpc-daemon[1389]: time=2026-09-20T12:47:43.109Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4778worker2 # [ 93.680148] nix-grpc-daemon[1389]: time=2026-09-20T12:47:43.111Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4779worker2 # [ 93.682157] nix-grpc-daemon[1389]: time=2026-09-20T12:47:43.111Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4780lb # [ 93.751846] niks3-server[1006]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4781lb # [ 93.764234] niks3-server[1006]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4782lb # [ 93.773513] niks3-server[1006]: 2026/09/20 12:47:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4783lb # [ 93.780698] niks3-server[1006]: 2026/09/20 12:47:43 INFO Signed narinfos id=26 count=24784lb # [ 93.782706] niks3-server[1006]: 2026/09/20 12:47:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4785worker2 # [ 93.763070] nix-grpc-daemon[1389]: time=2026-09-20T12:47:43.195Z level=INFO msg="Uploading 3 narinfos"4786lb # [ 93.792407] niks3-server[1006]: 2026/09/20 12:47:43 INFO Signed narinfos id=25 count=14787lb # [ 93.794255] niks3-server[1006]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4788lb # [ 93.801643] niks3-server[1006]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4789lb # [ 93.814633] niks3-server[1006]: 2026/09/20 12:47:43 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4790lb # [ 93.825853] niks3-server[1006]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4791lb # [ 93.833332] niks3-server[1006]: 2026/09/20 12:47:43 INFO Completed upload id=254792lb # [ 93.834653] niks3-server[1006]: 2026/09/20 12:47:43 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4793lb # [ 93.842021] niks3-server[1006]: 2026/09/20 12:47:43 INFO Completed upload id=264794worker2 # [ 93.823661] nix-grpc-daemon[1389]: time=2026-09-20T12:47:43.258Z level=INFO msg="Upload complete. (396ms)"4795lb # [ 93.845236] niks3-server[1006]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4796lb # [ 93.854019] niks3-server[1006]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4797worker2 # [ 93.834728] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52828 duration_s=0 paths=2 nar_bytes_in=3124798worker2 # [ 93.854934] nix-daemon[926]: reaped child process 1387, status = succeeded4799client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 2.04 seconds)4800worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4801worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4802worker1 # [ 93.976923] systemd[1]: Listening on Nix worker-protocol over gRPC.4803worker1 # [ 93.986061] systemd[1]: Starting Nix worker-protocol over gRPC...4804worker1 # [ 94.188614] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:43Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4805worker1 # [ 94.190667] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4806worker1 # [ 94.194974] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14807worker1 # [ 94.203363] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4808worker1 # [ 94.212432] systemd[1]: Started Nix worker-protocol over gRPC.4809lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4810lb: must succeed: curl -sf localhost:9901/clusters4811worker1 # [ 94.231625] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:43Z level=info event=scheduler_connected addr=lb:500514812worker2 # [ 94.260408] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:43Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:418244813worker2 # [ 94.265587] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04814lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4815lb: must succeed: curl -sf localhost:9901/clusters4816lb # [ 95.391095] envoy[872]: conn peer=[2001:db8:1::4]:47398 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=31596 tx=2159 ms=612994817lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4818lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.19 seconds)4819(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.03 seconds)4820subtest: scheduler down: the other node takes the lock and keeps it4821lb: must succeed: curl -sf localhost:9901/clusters4822lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4823lb: must succeed: curl -sf localhost:9901/clusters4824lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4825lb: must succeed: curl -sf localhost:9901/clusters4826lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4827lb: must succeed: curl -sf localhost:9901/clusters4828lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4829worker2 # [ 95.697962] systemd[1]: Stopping Nix worker-protocol over gRPC...4830lb # [ 95.397228] envoy[872]: conn peer=[2001:db8:1::1]:43682 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=274831lb # [ 95.397447] envoy[872]: conn peer=[2001:db8:1::3]:35632 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6885 tx=1932 ms=634034832lb # [ 95.397586] envoy[872]: conn peer=[2001:db8:1::1]:42312 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1008 tx=282 ms=17534833worker2 # [ 96.387572] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:45Z level=info event=signal_exit4834worker2 # [ 96.600955] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=scheduler_yield4835lb # [ 96.622566] niks3-server[1006]: 2026/09/20 12:47:46 INFO lead: released remote=192.168.1.4:391284836worker1 # [ 96.588431] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:46Z level=info event=scheduler_restarting addr=lb:500514837worker2 # [ 96.618232] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:418244838worker2 # [ 96.625058] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=worker_gone addr=192.168.1.3:500514839worker2 # [ 96.629538] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=scheduler_restarting addr=lb:500514840worker2 # [ 96.633578] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:418244841worker2 # [ 96.638273] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=worker_gone addr=192.168.1.4:500514842worker1 # [ 96.788506] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:46Z level=info event=scheduler_connected addr=lb:500514843worker1 # [ 96.794135] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4844worker2 # [ 96.819765] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=scheduler_connected addr=lb:500514845worker2 # [ 96.825130] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4846worker1 # [ 96.994761] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:46Z level=info event=scheduler_connected addr=lb:500514847worker1 # [ 97.000379] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4848worker2 # [ 97.026429] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=scheduler_connected addr=lb:500514849worker2 # [ 97.031772] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4850worker1 # [ 97.201317] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:46Z level=info event=scheduler_connected addr=lb:500514851worker1 # [ 97.206949] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4852worker2 # [ 97.233082] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=scheduler_connected addr=lb:500514853worker2 # [ 97.238523] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4854worker1 # [ 97.407675] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:46Z level=info event=scheduler_connected addr=lb:500514855worker1 # [ 97.413176] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4856worker2 # [ 97.441294] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=scheduler_connected addr=lb:500514857worker2 # [ 97.445515] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4858worker2 # [ 97.606797] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:47Z level=info event=scheduler_restarting4859worker2 # [ 97.637744] nix-daemon[926]: reaped child process 1382, status = succeeded4860worker1 # [ 97.615252] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:47Z level=info event=scheduler_connected addr=lb:500514861worker1 # [ 97.620804] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4862worker2 # [ 97.659489] nix-grpc-daemon[1333]: ts=2026-09-20T12:47:47Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4863worker1 # [ 97.821746] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:47Z level=info event=scheduler_connected addr=lb:500514864worker1 # [ 97.827228] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4865worker1 # [ 98.028195] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:47Z level=info event=scheduler_connected addr=lb:500514866worker1 # [ 98.033582] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4867worker1 # [ 98.234454] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:47Z level=info event=scheduler_connected addr=lb:500514868worker1 # [ 98.239809] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4869worker2 # [ 98.424154] nix-grpc-daemon[1333]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4870worker2 # [ 98.424602] nix-grpc-daemon[1333]: E0000 00:00:1789908467.858347 1376 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4871worker2 # [ 98.424729] nix-grpc-daemon[1333]: E0000 00:00:1789908467.858632 1376 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4872worker1 # [ 98.440809] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:47Z level=info event=scheduler_connected addr=lb:500514873worker1 # [ 98.446288] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4874worker1 # [ 98.649418] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500514875worker1 # [ 98.653653] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4876worker1 # [ 98.850321] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500514877worker1 # [ 98.855793] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4878worker1 # [ 99.056899] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500514879worker1 # [ 99.062385] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4880lb # [ 99.257113] niks3-server[1006]: 2026/09/20 12:47:48 INFO lead: acquired remote=192.168.1.3:515824881worker1 # [ 99.215414] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:48Z level=info event=scheduler_take_over4882worker1 # [ 99.263277] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500514883worker1 # [ 99.268824] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4884worker2 # [ 99.413740] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4885worker2 # [ 99.417664] systemd[1]: Stopped Nix worker-protocol over gRPC.4886worker2 # [ 99.423075] systemd[1]: nix-grpc-daemon.service: Consumed 484ms CPU time over 10.237s wall clock time, 30.9M memory peak, 20.1K incoming IP traffic, 30.9K outgoing IP traffic.4887worker2 # [ 99.438160] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4888worker2 # [ 99.443261] systemd[1]: Closed Nix worker-protocol over gRPC.4889worker2 # [ 99.446956] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 11.107s wall clock time, 256K memory peak, 20.6K incoming IP traffic, 15.8K outgoing IP traffic.4890worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4891worker1 # [ 99.469789] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500514892worker1 # [ 99.475756] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4893worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.10 seconds)4894worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4895worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4896worker1 # [ 99.678266] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500514897worker1 # [ 99.682652] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4898worker1 # [ 99.879186] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500514899worker1 # [ 99.888999] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:49Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:465224900worker1 # [ 99.894638] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04901worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4902worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4903client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24904worker1 # [ 100.929720] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:474664905worker1 # [ 100.944684] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4906client # don't know how to build these paths:4907client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4908worker1 # [ 100.967851] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474664909worker1 # [ 100.985384] nix-grpc-daemon[1044]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 1/5)4910worker1 # [ 101.084285] nix-grpc-daemon[1044]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5)4911worker1 # [ 101.169763] nix-grpc-daemon[1044]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 273 ms (attempt 3/5)4912worker1 # [ 101.450681] nix-grpc-daemon[1044]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 561 ms (attempt 4/5)4913worker1 # [ 102.013838] nix-grpc-daemon[1044]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4914worker1 # [ 102.050998] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:51Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04915worker1 # [ 102.058599] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:51Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14916worker1 # [ 102.101158] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474664917worker1 # [ 102.118163] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474664918client # copying 1 paths to 'lb:50051'...4919client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4920worker1 # [ 102.134366] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474664921worker1 # [ 102.152456] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4922worker1 # [ 102.178598] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:51Z level=info event=niks3_push_started pid=11144923worker1 # [ 102.392671] nix-grpc-daemon[1114]: time=2026-09-20T12:47:51.847Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""4924worker1 # [ 102.569668] nix-daemon[843]: accepted connection from pid 1127, user nix-grpc-daemon (trusted)4925worker1 # [ 102.588622] nix-daemon[843]: reaped child process 1130, status = succeeded4926worker1 # [ 102.764992] nix-daemon[843]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)4927worker1 # [ 102.783688] nix-daemon[843]: reaped child process 1135, status = succeeded4928lb # [ 102.837531] niks3-server[1006]: 2026/09/20 12:47:52 INFO Received uploads request method=POST path=/api/pending_closures4929worker1 # [ 102.807025] nix-grpc-daemon[1114]: time=2026-09-20T12:47:52.262Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4930worker1 # [ 102.810599] nix-grpc-daemon[1114]: time=2026-09-20T12:47:52.264Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4931lb # [ 102.885083] niks3-server[1006]: 2026/09/20 12:47:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4932lb # [ 102.901038] niks3-server[1006]: 2026/09/20 12:47:52 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4933lb # [ 102.914141] niks3-server[1006]: 2026/09/20 12:47:52 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4934lb # [ 102.921593] niks3-server[1006]: 2026/09/20 12:47:52 INFO Signed narinfos id=27 count=14935worker1 # [ 102.880559] nix-grpc-daemon[1114]: time=2026-09-20T12:47:52.335Z level=INFO msg="Uploading 1 narinfos"4936lb # [ 102.930308] niks3-server[1006]: 2026/09/20 12:47:52 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4937lb # [ 102.942529] niks3-server[1006]: 2026/09/20 12:47:52 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4938lb # [ 102.951680] niks3-server[1006]: 2026/09/20 12:47:52 INFO Completed upload id=274939worker1 # [ 102.910521] nix-grpc-daemon[1114]: time=2026-09-20T12:47:52.366Z level=INFO msg="Upload complete. (513ms)"4940worker1 # [ 102.922107] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47466 duration_s=0 paths=1 nar_bytes_in=5204941worker1 # [ 102.940407] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474664942worker1 # [ 102.947738] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4943worker1 # [ 102.953907] nix-daemon[843]: reaped child process 1112, status = succeeded4944client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4945client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4946worker1 # [ 102.967782] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4947client # farm-a> LOG-farm-a-on-standby4948worker1 # [ 104.012208] nix-daemon[843]: reaped child process 1139, status = succeeded4949worker1 # [ 104.205949] nix-daemon[843]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)4950worker1 # [ 104.226997] nix-daemon[843]: reaped child process 1157, status = succeeded4951lb # [ 104.281326] niks3-server[1006]: 2026/09/20 12:47:53 INFO Received uploads request method=POST path=/api/pending_closures4952worker1 # [ 104.259273] nix-grpc-daemon[1114]: time=2026-09-20T12:47:53.711Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4953worker1 # [ 104.261613] nix-grpc-daemon[1114]: time=2026-09-20T12:47:53.711Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4954lb # [ 104.330944] niks3-server[1006]: 2026/09/20 12:47:53 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4955lb # [ 104.342302] niks3-server[1006]: 2026/09/20 12:47:53 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4956lb # [ 104.356336] niks3-server[1006]: 2026/09/20 12:47:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4957worker1 # [ 104.320996] nix-grpc-daemon[1114]: time=2026-09-20T12:47:53.775Z level=INFO msg="Uploading 1 narinfos"4958lb # [ 104.366696] niks3-server[1006]: 2026/09/20 12:47:53 INFO Signed narinfos id=28 count=14959lb # [ 104.371351] niks3-server[1006]: 2026/09/20 12:47:53 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4960lb # [ 104.380257] niks3-server[1006]: 2026/09/20 12:47:53 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4961lb # [ 104.387556] niks3-server[1006]: 2026/09/20 12:47:53 INFO Completed upload id=284962worker1 # [ 104.345830] nix-grpc-daemon[1114]: time=2026-09-20T12:47:53.801Z level=INFO msg="Upload complete. (361ms)"4963lb # [ 104.389892] niks3-server[1006]: 2026/09/20 12:47:53 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4964worker1 # [ 104.369603] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47466 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14965worker1 # [ 104.386356] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:53Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04966worker1 # [ 104.390802] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:53Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14967worker1 # [ 104.395607] nix-daemon[843]: reaped child process 1137, status = succeeded4968worker1 # [ 104.416156] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474664969worker1 # [ 104.431761] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474664970worker1 # [ 104.448667] nix-grpc-daemon[1114]: time=2026-09-20T12:47:53.904Z level=INFO msg="All 1 paths already cached"4971client # copying 1 paths to 'lb:50051'...4972client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4973worker1 # [ 104.460828] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474664974worker1 # [ 104.475923] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4975worker1 # [ 104.685762] nix-daemon[843]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)4976worker1 # [ 104.707678] nix-daemon[843]: reaped child process 1166, status = succeeded4977worker1 # [ 104.889019] nix-daemon[843]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4978worker1 # [ 104.907754] nix-daemon[843]: reaped child process 1171, status = succeeded4979lb # [ 104.960463] niks3-server[1006]: 2026/09/20 12:47:54 INFO Received uploads request method=POST path=/api/pending_closures4980worker1 # [ 104.930526] nix-grpc-daemon[1114]: time=2026-09-20T12:47:54.385Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4981worker1 # [ 104.932180] nix-grpc-daemon[1114]: time=2026-09-20T12:47:54.385Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4982lb # [ 104.992593] niks3-server[1006]: 2026/09/20 12:47:54 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4983worker1 # [ 104.966034] nix-grpc-daemon[1114]: time=2026-09-20T12:47:54.421Z level=INFO msg="Uploading 1 narinfos"4984lb # [ 105.009341] niks3-server[1006]: 2026/09/20 12:47:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4985lb # [ 105.022788] niks3-server[1006]: 2026/09/20 12:47:54 INFO Signed narinfos id=29 count=14986lb # [ 105.026997] niks3-server[1006]: 2026/09/20 12:47:54 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4987worker1 # [ 104.994580] nix-grpc-daemon[1114]: time=2026-09-20T12:47:54.450Z level=INFO msg="Upload complete. (502ms)"4988lb # [ 105.036982] niks3-server[1006]: 2026/09/20 12:47:54 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4989lb # [ 105.041634] niks3-server[1006]: 2026/09/20 12:47:54 INFO Completed upload id=294990lb # [ 105.045392] niks3-server[1006]: 2026/09/20 12:47:54 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4991worker1 # [ 105.004796] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47466 duration_s=0 paths=1 nar_bytes_in=6404992worker1 # [ 105.018814] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474664993worker1 # [ 105.026099] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4994worker1 # [ 105.032494] nix-daemon[843]: reaped child process 1161, status = succeeded4995client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4996worker1 # [ 105.044497] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4997client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4998lb # [ 105.388516] envoy[872]: conn peer=[2001:db8:1::4]:48888 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7963 tx=535 ms=82464999client # farm-b> LOG-farm-b-on-standby5000worker1 # [ 106.098374] nix-daemon[843]: reaped child process 1175, status = succeeded5001worker1 # [ 106.289131] nix-daemon[843]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)5002worker1 # [ 106.309884] nix-daemon[843]: reaped child process 1193, status = succeeded5003lb # [ 106.366176] niks3-server[1006]: 2026/09/20 12:47:55 INFO Received uploads request method=POST path=/api/pending_closures5004worker1 # [ 106.336418] nix-grpc-daemon[1114]: time=2026-09-20T12:47:55.791Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5005worker1 # [ 106.337977] nix-grpc-daemon[1114]: time=2026-09-20T12:47:55.791Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5006lb # [ 106.399852] niks3-server[1006]: 2026/09/20 12:47:55 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5007lb # [ 106.422451] niks3-server[1006]: 2026/09/20 12:47:55 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5008lb # [ 106.436248] niks3-server[1006]: 2026/09/20 12:47:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5009worker1 # [ 106.402973] nix-grpc-daemon[1114]: time=2026-09-20T12:47:55.858Z level=INFO msg="Uploading 1 narinfos"5010lb # [ 106.447913] niks3-server[1006]: 2026/09/20 12:47:55 INFO Signed narinfos id=30 count=15011lb # [ 106.454418] niks3-server[1006]: 2026/09/20 12:47:55 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5012lb # [ 106.462691] niks3-server[1006]: 2026/09/20 12:47:55 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5013lb # [ 106.470466] niks3-server[1006]: 2026/09/20 12:47:55 INFO Completed upload id=305014worker1 # [ 106.427602] nix-grpc-daemon[1114]: time=2026-09-20T12:47:55.883Z level=INFO msg="Upload complete. (365ms)"5015lb # [ 106.473313] niks3-server[1006]: 2026/09/20 12:47:55 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5016worker1 # [ 106.447336] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47466 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15017worker1 # [ 106.464410] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:55Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05018worker1 # [ 106.469730] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:55Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15019worker1 # [ 106.473873] nix-daemon[843]: reaped child process 1173, status = succeeded5020worker1 # [ 106.491576] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474665021worker1 # [ 106.508836] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474665022worker1 # [ 106.525070] nix-grpc-daemon[1114]: time=2026-09-20T12:47:55.980Z level=INFO msg="All 2 paths already cached"5023client # copying 1 paths to 'lb:50051'...5024client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5025worker1 # [ 106.536932] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474665026worker1 # [ 106.551881] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)5027worker1 # [ 106.757200] nix-daemon[843]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5028worker1 # [ 106.780278] nix-daemon[843]: reaped child process 1202, status = succeeded5029worker1 # [ 106.954487] nix-daemon[843]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5030worker1 # [ 106.974044] nix-daemon[843]: reaped child process 1207, status = succeeded5031lb # [ 107.026571] niks3-server[1006]: 2026/09/20 12:47:56 INFO Received uploads request method=POST path=/api/pending_closures5032worker1 # [ 106.995505] nix-grpc-daemon[1114]: time=2026-09-20T12:47:56.450Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5033worker1 # [ 106.997211] nix-grpc-daemon[1114]: time=2026-09-20T12:47:56.450Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5034lb # [ 107.058641] niks3-server[1006]: 2026/09/20 12:47:56 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5035worker1 # [ 107.031433] nix-grpc-daemon[1114]: time=2026-09-20T12:47:56.486Z level=INFO msg="Uploading 1 narinfos"5036lb # [ 107.076263] niks3-server[1006]: 2026/09/20 12:47:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5037lb # [ 107.087976] niks3-server[1006]: 2026/09/20 12:47:56 INFO Signed narinfos id=31 count=15038lb # [ 107.090630] niks3-server[1006]: 2026/09/20 12:47:56 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5039lb # [ 107.099844] niks3-server[1006]: 2026/09/20 12:47:56 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5040lb # [ 107.107466] niks3-server[1006]: 2026/09/20 12:47:56 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5041lb # [ 107.111758] niks3-server[1006]: 2026/09/20 12:47:56 INFO Completed upload id=315042worker1 # [ 107.070517] nix-grpc-daemon[1114]: time=2026-09-20T12:47:56.526Z level=INFO msg="Upload complete. (501ms)"5043worker1 # [ 107.079733] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47466 duration_s=0 paths=1 nar_bytes_in=7685044worker1 # [ 107.088473] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474665045worker1 # [ 107.104822] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)5046worker1 # [ 107.107630] nix-daemon[843]: reaped child process 1197, status = succeeded5047worker1 # [ 107.120606] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)5048client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5049client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5050client # farm-top> LOG-farm-top-on-standby5051worker1 # [ 108.174792] nix-daemon[843]: reaped child process 1211, status = succeeded5052worker1 # [ 108.365146] nix-daemon[843]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5053worker1 # [ 108.386220] nix-daemon[843]: reaped child process 1229, status = succeeded5054lb # [ 108.442685] niks3-server[1006]: 2026/09/20 12:47:57 INFO Received uploads request method=POST path=/api/pending_closures5055worker1 # [ 108.416489] nix-grpc-daemon[1114]: time=2026-09-20T12:47:57.870Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5056worker1 # [ 108.418183] nix-grpc-daemon[1114]: time=2026-09-20T12:47:57.870Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5057lb # [ 108.488115] niks3-server[1006]: 2026/09/20 12:47:57 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5058lb # [ 108.500395] niks3-server[1006]: 2026/09/20 12:47:57 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5059lb # [ 108.508604] niks3-server[1006]: 2026/09/20 12:47:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5060lb # [ 108.514579] niks3-server[1006]: 2026/09/20 12:47:57 INFO Signed narinfos id=32 count=15061worker1 # [ 108.474412] nix-grpc-daemon[1114]: time=2026-09-20T12:47:57.929Z level=INFO msg="Uploading 1 narinfos"5062lb # [ 108.517919] niks3-server[1006]: 2026/09/20 12:47:57 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5063lb # [ 108.529079] niks3-server[1006]: 2026/09/20 12:47:57 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5064lb # [ 108.535852] niks3-server[1006]: 2026/09/20 12:47:57 INFO Completed upload id=325065worker1 # [ 108.494333] nix-grpc-daemon[1114]: time=2026-09-20T12:47:57.949Z level=INFO msg="Upload complete. (358ms)"5066lb # [ 108.538973] niks3-server[1006]: 2026/09/20 12:47:57 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5067worker1 # [ 108.509341] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47466 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15068worker1 # [ 108.527466] nix-daemon[843]: reaped child process 1209, status = succeeded5069client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.90 seconds)5070client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5071client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.25 seconds)5072worker2 # [ 108.933319] systemd[1]: Listening on Nix worker-protocol over gRPC.5073worker2 # [ 108.940690] systemd[1]: Starting scheduler-token.service...5074worker2 # [ 109.043135] systemd[1]: scheduler-token.service: Deactivated successfully.5075worker2 # [ 109.048683] systemd[1]: Finished scheduler-token.service.5076worker2 # [ 109.049918] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 105ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5077worker2 # [ 109.057265] systemd[1]: Starting Nix worker-protocol over gRPC...5078worker2 # [ 109.239344] nix-grpc-daemon[1429]: ts=2026-09-20T12:47:58Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5079worker2 # [ 109.242341] nix-grpc-daemon[1429]: ts=2026-09-20T12:47:58Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5080worker2 # [ 109.246644] nix-grpc-daemon[1429]: ts=2026-09-20T12:47:58Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15081worker2 # [ 109.254829] nix-grpc-daemon[1429]: ts=2026-09-20T12:47:58Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5082worker2 # [ 109.263754] systemd[1]: Started Nix worker-protocol over gRPC.5083lb: must succeed: curl -sf localhost:9901/clusters5084worker2 # [ 109.283193] nix-grpc-daemon[1429]: ts=2026-09-20T12:47:58Z level=info event=scheduler_connected addr=lb:500515085worker1 # [ 109.272164] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:58Z level=info event=oidc_jwks provider=mock keys=15086worker1 # [ 109.278761] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:58Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:465225087worker1 # [ 109.284578] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:58Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05088lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5089worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5090worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5091lb: must succeed: curl -sf localhost:9901/clusters5092lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5093lb: must succeed: curl -sf localhost:9901/clusters5094lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5095worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5096worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5097(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.23 seconds)5098subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5099client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5100client # [ 109.751354] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5101client # Running as unit: rs.service; invocation ID: c368cd42d8a44ce3a693b280f669cfb65102client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds)5103client # [ 109.985834] nix[1204]: don't know how to build these paths:5104client # [ 109.987671] nix[1204]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5105worker1 # [ 109.949458] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:474665106worker1 # [ 109.963891] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:59Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05107worker1 # [ 109.971154] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:59Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15108worker1 # [ 110.011210] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474665109worker1 # [ 110.028650] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:474665110client # [ 110.080186] nix[1204]: copying 1 paths to 'lb:50051'...5111worker1 # [ 110.044654] nix-grpc-daemon[1044]: ts=2026-09-20T12:47:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:474665112client # [ 110.082633] nix[1204]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5113worker1 # [ 110.063235] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)5114worker1 # [ 110.281361] nix-daemon[843]: accepted connection from pid 1242, user nix-grpc-daemon (trusted)5115worker1 # [ 110.301984] nix-daemon[843]: reaped child process 1245, status = succeeded5116worker1 # [ 110.481176] nix-daemon[843]: accepted connection from pid 1247, user nix-grpc-daemon (trusted)5117worker1 # [ 110.500613] nix-daemon[843]: reaped child process 1250, status = succeeded5118lb # [ 110.554408] niks3-server[1006]: 2026/09/20 12:47:59 INFO Received uploads request method=POST path=/api/pending_closures5119worker1 # [ 110.524402] nix-grpc-daemon[1114]: time=2026-09-20T12:47:59.979Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5120worker1 # [ 110.526140] nix-grpc-daemon[1114]: time=2026-09-20T12:47:59.979Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5121lb # [ 110.586641] niks3-server[1006]: 2026/09/20 12:48:00 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5122lb # [ 110.605175] niks3-server[1006]: 2026/09/20 12:48:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5123worker1 # [ 110.569792] nix-grpc-daemon[1114]: time=2026-09-20T12:48:00.025Z level=INFO msg="Uploading 1 narinfos"5124lb # [ 110.617591] niks3-server[1006]: 2026/09/20 12:48:00 INFO Signed narinfos id=33 count=15125lb # [ 110.623538] niks3-server[1006]: 2026/09/20 12:48:00 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5126lb # [ 110.630810] niks3-server[1006]: 2026/09/20 12:48:00 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5127worker1 # [ 110.594928] nix-grpc-daemon[1114]: time=2026-09-20T12:48:00.050Z level=INFO msg="Upload complete. (512ms)"5128lb # [ 110.638236] niks3-server[1006]: 2026/09/20 12:48:00 INFO Completed upload id=335129lb # [ 110.641404] niks3-server[1006]: 2026/09/20 12:48:00 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5130worker1 # [ 110.604895] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47466 duration_s=0 paths=1 nar_bytes_in=4165131worker1 # [ 110.620197] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:474665132worker1 # [ 110.626657] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)5133worker1 # [ 110.631848] nix-daemon[843]: reaped child process 1240, status = succeeded5134worker1 # [ 110.644560] nix-daemon[843]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)5135client # [ 110.679120] nix[1204]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5136lb: must succeed: curl -sf localhost:9901/clusters5137lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5138lb: must succeed: curl -sf localhost:9901/clusters5139lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5140lb: must succeed: curl -sf localhost:9901/clusters5141lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5142lb: must succeed: curl -sf localhost:9901/clusters5143lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5144worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5145worker2 # [ 112.745223] systemd-journald[288]: Received client request to rotate journal, rotating.5146worker2 # [ 112.771753] systemd-journald[288]: Vacuuming done, freed 0B of archived journals from /var/log/journal/c3c001a2bf1749878498bb0331c74b41.5147worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.11 seconds)5148worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5149worker1 # [ 112.810420] systemd[1]: Stopping Nix worker-protocol over gRPC...5150worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5151client: must succeed: sleep 5.05152worker1 # [ 113.225416] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:02Z level=info event=draining5153lb # [ 115.390494] envoy[872]: conn peer=[2001:db8:1::1]:53602 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9623 tx=3909 ms=76005154client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5155worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5156worker1 # [ 118.305350] nix-daemon[843]: reaped child process 1254, status = succeeded5157worker1 # [ 118.480303] nix-daemon[843]: accepted connection from pid 1294, user nix-grpc-daemon (trusted)5158worker1 # [ 118.501705] nix-daemon[843]: reaped child process 1297, status = succeeded5159lb # [ 118.558023] niks3-server[1006]: 2026/09/20 12:48:07 INFO Received uploads request method=POST path=/api/pending_closures5160worker1 # [ 118.527854] nix-grpc-daemon[1114]: time=2026-09-20T12:48:07.983Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5161worker1 # [ 118.532832] nix-grpc-daemon[1114]: time=2026-09-20T12:48:07.985Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5162lb # [ 118.609055] niks3-server[1006]: 2026/09/20 12:48:08 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5163worker1 # [ 118.578499] nix-grpc-daemon[1114]: time=2026-09-20T12:48:08.033Z level=INFO msg="Uploading 1 narinfos"5164lb # [ 118.620591] niks3-server[1006]: 2026/09/20 12:48:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5165lb # [ 118.623903] niks3-server[1006]: 2026/09/20 12:48:08 INFO Signed narinfos id=34 count=15166lb # [ 118.635600] niks3-server[1006]: 2026/09/20 12:48:08 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5167lb # [ 118.642362] niks3-server[1006]: 2026/09/20 12:48:08 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5168lb # [ 118.650756] niks3-server[1006]: 2026/09/20 12:48:08 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5169worker1 # [ 118.608771] nix-grpc-daemon[1114]: time=2026-09-20T12:48:08.064Z level=INFO msg="Upload complete. (343ms)"5170lb # [ 118.653470] niks3-server[1006]: 2026/09/20 12:48:08 INFO Completed upload id=345171lb # [ 118.654938] niks3-server[1006]: 2026/09/20 12:48:08 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5172worker1 # [ 118.625253] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47466 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15173worker1 # [ 118.642078] nix-daemon[843]: reaped child process 1252, status = succeeded5174client # [ 118.705813] systemd[1]: rs.service: Deactivated successfully.5175client # [ 118.710496] systemd[1]: rs.service: Consumed 159ms CPU time over 8.958s wall clock time, 37M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5176worker1 # [ 119.226593] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:08Z level=info event=signal_exit5177worker1 # [ 119.241140] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:08Z level=info event=scheduler_yield5178lb # [ 119.286465] niks3-server[1006]: 2026/09/20 12:48:08 INFO lead: released remote=192.168.1.3:515825179worker2 # [ 119.269323] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:08Z level=info event=scheduler_restarting addr=lb:500515180worker1 # [ 119.247435] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:465225181worker1 # [ 119.254225] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:08Z level=info event=worker_gone addr=192.168.1.4:500515182worker1 # [ 119.258449] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:08Z level=info event=scheduler_restarting addr=lb:500515183worker1 # [ 119.262525] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:465225184worker1 # [ 119.266995] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:08Z level=info event=worker_gone addr=192.168.1.3:500515185worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.13 seconds)5186client: waiting for success: ! systemctl is-active rs5187client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5188client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5189worker2 # [ 119.469014] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:08Z level=info event=scheduler_connected addr=lb:500515190worker2 # [ 119.474786] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5191worker1 # [ 119.454078] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:08Z level=info event=scheduler_connected addr=lb:500515192client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5193client: must fail: journalctl -u rs | grep -q 'reconnecting'5194worker1 # [ 119.460772] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5195client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5196lb: must succeed: curl -sf localhost:9901/clusters5197lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5198worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5199worker2 # [ 119.676291] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:09Z level=info event=scheduler_connected addr=lb:500515200worker2 # [ 119.681894] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5201worker1 # [ 119.667232] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:09Z level=info event=scheduler_connected addr=lb:500515202worker1 # [ 119.671571] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5203worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)5204worker2 # [ 119.883238] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:09Z level=info event=scheduler_connected addr=lb:500515205worker2 # [ 119.888809] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5206worker1 # [ 119.868230] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:09Z level=info event=scheduler_connected addr=lb:500515207worker1 # [ 119.873645] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5208worker2 # [ 120.090094] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:09Z level=info event=scheduler_connected addr=lb:500515209worker2 # [ 120.095447] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5210worker1 # [ 120.074606] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:09Z level=info event=scheduler_connected addr=lb:500515211worker1 # [ 120.080173] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5212worker1 # [ 120.247125] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:09Z level=info event=scheduler_restarting5213worker2 # [ 120.298437] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:09Z level=info event=scheduler_connected addr=lb:500515214worker2 # [ 120.302703] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5215worker1 # [ 120.279055] nix-daemon[843]: reaped child process 1105, status = succeeded5216worker1 # [ 120.302060] nix-grpc-daemon[1044]: ts=2026-09-20T12:48:09Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5217worker2 # [ 120.499632] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:09Z level=info event=scheduler_connected addr=lb:500515218worker2 # [ 120.505281] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5219lb: must succeed: curl -sf localhost:9901/clusters5220worker2 # [ 120.706415] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:10Z level=info event=scheduler_connected addr=lb:500515221worker2 # [ 120.711881] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5222worker1 # [ 120.734247] nix-grpc-daemon[1044]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5223worker1 # [ 120.738904] nix-grpc-daemon[1044]: E0000 00:00:1789908490.188139 1087 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5224worker1 # [ 120.745484] nix-grpc-daemon[1044]: E0000 00:00:1789908490.188615 1087 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5225lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5226worker2 # [ 120.913307] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:10Z level=info event=scheduler_connected addr=lb:500515227worker2 # [ 120.918719] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5228worker2 # [ 121.120130] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:10Z level=info event=scheduler_connected addr=lb:500515229worker2 # [ 121.125680] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5230worker2 # [ 121.329303] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:10Z level=info event=scheduler_connected addr=lb:500515231worker2 # [ 121.333563] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5232worker2 # [ 121.530375] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:10Z level=info event=scheduler_connected addr=lb:500515233worker2 # [ 121.535923] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5234worker1 # [ 121.704774] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5235worker1 # [ 121.708877] systemd[1]: Stopped Nix worker-protocol over gRPC.5236worker1 # [ 121.711428] systemd[1]: nix-grpc-daemon.service: Consumed 1.933s CPU time over 27.715s wall clock time, 34.3M memory peak, 49.5K incoming IP traffic, 99.8K outgoing IP traffic.5237worker2 # [ 121.737366] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:11Z level=info event=scheduler_connected addr=lb:500515238worker2 # [ 121.743160] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5239worker1 # [ 121.732361] systemd[1]: Starting Nix worker-protocol over gRPC...5240lb: must succeed: curl -sf localhost:9901/clusters5241lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5242worker2 # [ 121.944474] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:11Z level=info event=scheduler_connected addr=lb:500515243worker2 # [ 121.949507] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5244worker1 # [ 121.934164] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:11Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5245worker1 # [ 121.936858] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5246worker1 # [ 121.941119] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15247worker1 # [ 121.949594] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:11Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5248worker1 # [ 121.951390] systemd[1]: Started Nix worker-protocol over gRPC.5249worker1 # [ 121.958888] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:11Z level=info event=scheduler_take_over5250lb # [ 122.001566] niks3-server[1006]: 2026/09/20 12:48:11 INFO lead: acquired remote=192.168.1.3:609745251worker1 # [ 121.973634] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:11Z level=info event=scheduler_connected addr=lb:500515252worker1 # [ 121.975517] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5253worker2 # [ 122.150907] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:11Z level=info event=scheduler_connected addr=lb:500515254worker2 # [ 122.156594] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5255worker1 # [ 122.176752] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:11Z level=info event=scheduler_connected addr=lb:500515256worker1 # [ 122.181970] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5257worker2 # [ 122.359567] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:11Z level=info event=scheduler_connected addr=lb:500515258worker2 # [ 122.363865] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5259worker1 # [ 122.383026] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:11Z level=info event=scheduler_connected addr=lb:500515260worker1 # [ 122.388665] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5261worker2 # [ 122.560974] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:11Z level=info event=scheduler_connected addr=lb:500515262worker2 # [ 122.566264] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5263worker1 # [ 122.589733] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:12Z level=info event=scheduler_connected addr=lb:500515264worker1 # [ 122.595185] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5265worker2 # [ 122.767371] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:12Z level=info event=scheduler_connected addr=lb:500515266worker1 # [ 122.757495] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:12Z level=info event=oidc_jwks provider=mock keys=15267worker1 # [ 122.763427] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:12Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:399505268worker1 # [ 122.768873] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:12Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05269worker1 # [ 122.795968] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:12Z level=info event=scheduler_connected addr=lb:500515270worker1 # [ 122.801512] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:12Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:399505271worker1 # [ 122.806476] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:12Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05272lb: must succeed: curl -sf localhost:9901/clusters5273lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5274worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5275worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5276(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.37 seconds)5277subtest: scheduler restart mid-build: build finishes, no double build5278client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5279client # [ 123.121097] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5280client # Running as unit: mid.service; invocation ID: 84de0cafb9974f0b941457f9fe2f39c45281client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5282worker2 # [ 123.366180] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:570705283worker2 # [ 123.381966] nix-daemon[926]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)5284client # [ 123.414342] nix[1240]: don't know how to build these paths:5285client # [ 123.417220] nix[1240]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5286worker1 # [ 123.397038] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:12Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05287worker1 # [ 123.402604] nix-grpc-daemon[1307]: ts=2026-09-20T12:48:12Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15288worker2 # [ 123.466645] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570705289worker2 # [ 123.485652] nix-grpc-daemon[1429]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5)5290worker2 # [ 123.553530] nix-grpc-daemon[1429]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 70 ms (attempt 2/5)5291worker2 # [ 123.631311] nix-grpc-daemon[1429]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 290 ms (attempt 3/5)5292worker2 # [ 123.929373] nix-grpc-daemon[1429]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 328 ms (attempt 4/5)5293worker2 # [ 124.265987] nix-grpc-daemon[1429]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5294worker2 # [ 124.290813] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570705295client # [ 124.320195] nix[1240]: copying 1 paths to 'lb:50051'...5296worker2 # [ 124.306531] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570705297client # [ 124.320616] nix[1240]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5298worker2 # [ 124.321774] nix-daemon[926]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)5299worker2 # [ 124.349970] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:13Z level=info event=niks3_push_started pid=15335300worker2 # [ 124.585436] nix-grpc-daemon[1533]: time=2026-09-20T12:48:14.019Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""5301worker2 # [ 124.763294] nix-daemon[926]: accepted connection from pid 1550, user nix-grpc-daemon (trusted)5302worker2 # [ 124.782212] nix-daemon[926]: reaped child process 1553, status = succeeded5303worker2 # [ 124.960495] nix-daemon[926]: accepted connection from pid 1555, user nix-grpc-daemon (trusted)5304worker2 # [ 124.978647] nix-daemon[926]: reaped child process 1558, status = succeeded5305lb # [ 125.010417] niks3-server[1006]: 2026/09/20 12:48:14 INFO Received uploads request method=POST path=/api/pending_closures5306worker2 # [ 125.002989] nix-grpc-daemon[1533]: time=2026-09-20T12:48:14.436Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5307worker2 # [ 125.004768] nix-grpc-daemon[1533]: time=2026-09-20T12:48:14.436Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5308lb # [ 125.046523] niks3-server[1006]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5309worker2 # [ 125.040641] nix-grpc-daemon[1533]: time=2026-09-20T12:48:14.475Z level=INFO msg="Uploading 1 narinfos"5310lb # [ 125.059596] niks3-server[1006]: 2026/09/20 12:48:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5311lb # [ 125.067504] niks3-server[1006]: 2026/09/20 12:48:14 INFO Signed narinfos id=35 count=15312lb # [ 125.083646] niks3-server[1006]: 2026/09/20 12:48:14 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5313worker2 # [ 125.072783] nix-grpc-daemon[1533]: time=2026-09-20T12:48:14.507Z level=INFO msg="Upload complete. (483ms)"5314lb # [ 125.096983] niks3-server[1006]: 2026/09/20 12:48:14 INFO Completed upload id=355315worker2 # [ 125.080807] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57070 duration_s=0 paths=1 nar_bytes_in=4245316lb # [ 125.104307] niks3-server[1006]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5317worker2 # [ 125.095769] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570705318worker2 # [ 125.099921] nix-grpc-daemon[1533]: time=2026-09-20T12:48:14.534Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n"5319worker2 # [ 125.109714] nix-daemon[926]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)5320worker2 # [ 125.112371] nix-daemon[926]: reaped child process 1531, status = succeeded5321worker2 # [ 125.124181] nix-daemon[926]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)5322client # [ 125.135601] nix[1240]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5323lb # [ 125.389653] envoy[872]: conn peer=[2001:db8:1::1]:53614 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1349 ms=86885324lb # [ 125.394762] envoy[872]: conn peer=[2001:db8:1::3]:41584 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4025 tx=1293 ms=260655325lb: must succeed: curl -sf localhost:9901/clusters5326lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5327lb: must succeed: curl -sf localhost:9901/clusters5328lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5329worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5330worker1 # [ 127.125453] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1307 (nix-grpc-daemon) on client request.5331worker1 # [ 127.146648] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5332lb # [ 127.190618] niks3-server[1006]: 2026/09/20 12:48:16 INFO lead: released remote=192.168.1.3:609745333worker2 # [ 127.185985] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:16Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5334client # [ 127.200871] nix[1240]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5335worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.11 seconds)5336client: must succeed: sleep 5.05337worker1 # [ 127.190955] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5338worker1 # [ 127.196786] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5339worker1 # [ 127.198787] systemd[1]: nix-grpc-daemon.service: Consumed 195ms CPU time over 5.457s wall clock time, 11.3M memory peak, 9.9K incoming IP traffic, 10K outgoing IP traffic.5340worker2 # [ 127.386319] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:16Z level=info event=scheduler_connected addr=lb:500515341worker1 # [ 127.368295] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5342worker1 # [ 127.381209] systemd[1]: Starting Nix worker-protocol over gRPC...5343worker1 # [ 127.597272] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5344worker1 # [ 127.599858] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5345worker1 # [ 127.604311] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15346worker1 # [ 127.612280] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5347worker1 # [ 127.614094] systemd[1]: Started Nix worker-protocol over gRPC.5348worker1 # [ 127.626792] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:17Z level=info event=scheduler_take_over5349lb # [ 127.668334] niks3-server[1006]: 2026/09/20 12:48:17 INFO lead: acquired remote=192.168.1.3:609845350worker1 # [ 127.638479] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:17Z level=info event=oidc_jwks provider=mock keys=15351worker1 # [ 127.643347] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:399565352worker1 # [ 127.646365] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=15353worker1 # [ 127.648762] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:17Z level=info event=scheduler_connected addr=lb:500515354worker1 # [ 127.650097] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:399565355worker1 # [ 127.651595] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05356client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5357client: waiting for success: ! systemctl is-active mid5358worker2 # [ 132.778624] nix-daemon[926]: reaped child process 1562, status = succeeded5359worker2 # [ 132.958189] nix-daemon[926]: accepted connection from pid 1598, user nix-grpc-daemon (trusted)5360worker2 # [ 132.979669] nix-daemon[926]: reaped child process 1601, status = succeeded5361lb # [ 133.011694] niks3-server[1006]: 2026/09/20 12:48:22 INFO Received uploads request method=POST path=/api/pending_closures5362worker2 # [ 133.006189] nix-grpc-daemon[1533]: time=2026-09-20T12:48:22.439Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5363worker2 # [ 133.007721] nix-grpc-daemon[1533]: time=2026-09-20T12:48:22.439Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5364lb # [ 133.061229] niks3-server[1006]: 2026/09/20 12:48:22 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5365lb # [ 133.071887] niks3-server[1006]: 2026/09/20 12:48:22 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5366lb # [ 133.083134] niks3-server[1006]: 2026/09/20 12:48:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5367lb # [ 133.089576] niks3-server[1006]: 2026/09/20 12:48:22 INFO Signed narinfos id=36 count=15368worker2 # [ 133.071681] nix-grpc-daemon[1533]: time=2026-09-20T12:48:22.503Z level=INFO msg="Uploading 1 narinfos"5369lb # [ 133.100336] niks3-server[1006]: 2026/09/20 12:48:22 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5370lb # [ 133.180857] niks3-server[1006]: 2026/09/20 12:48:22 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5371worker2 # [ 133.167802] nix-grpc-daemon[1533]: time=2026-09-20T12:48:22.602Z level=INFO msg="Upload complete. (425ms)"5372lb # [ 133.188657] niks3-server[1006]: 2026/09/20 12:48:22 INFO Completed upload id=365373lb # [ 133.198994] niks3-server[1006]: 2026/09/20 12:48:22 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5374worker2 # [ 133.181662] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57070 duration_s=8 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15375worker2 # [ 133.201337] nix-daemon[926]: reaped child process 1560, status = succeeded5376client # [ 133.245389] systemd[1]: mid.service: Deactivated successfully.5377client # [ 133.249860] systemd[1]: mid.service: Consumed 172ms CPU time over 10.128s wall clock time, 39.2M memory peak, 8.9K incoming IP traffic, 9.3K outgoing IP traffic.5378client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5379client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5380client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5381(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.74 seconds)5382subtest: interrupting the client stops the build on the worker5383client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5384client # [ 133.830267] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5385client # Running as unit: intr.service; invocation ID: a61ac66892454ffb90b80f0ec0eea4675386client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5387worker1 # [ 134.021020] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:533145388worker1 # [ 134.036365] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5389client # [ 134.090643] nix[1276]: don't know how to build these paths:5390client # [ 134.091867] nix[1276]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5391worker1 # [ 134.069196] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:23Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05392worker1 # [ 134.075933] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:23Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15393worker1 # [ 134.115527] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145394worker1 # [ 134.133266] nix-grpc-daemon[1388]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 1/5)5395worker1 # [ 134.164942] nix-grpc-daemon[1388]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 2/5)5396worker1 # [ 134.356823] nix-grpc-daemon[1388]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 3/5)5397worker1 # [ 134.456112] nix-grpc-daemon[1388]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 4/5)5398worker1 # [ 134.601903] nix-grpc-daemon[1388]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5399worker1 # [ 134.624928] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145400client # [ 134.676195] nix[1276]: copying 1 paths to 'lb:50051'...5401worker1 # [ 134.640719] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533145402client # [ 134.676509] nix[1276]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5403worker1 # [ 134.653405] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5404worker1 # [ 134.686084] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:24Z level=info event=niks3_push_started pid=14585405worker1 # [ 134.904854] nix-grpc-daemon[1458]: time=2026-09-20T12:48:24.359Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5406worker1 # [ 135.113050] nix-daemon[843]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)5407worker1 # [ 135.132712] nix-daemon[843]: reaped child process 1478, status = succeeded5408worker1 # [ 135.307372] nix-daemon[843]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5409worker1 # [ 135.328939] nix-daemon[843]: reaped child process 1483, status = succeeded5410lb # [ 135.382575] niks3-server[1006]: 2026/09/20 12:48:24 INFO Received uploads request method=POST path=/api/pending_closures5411lb # [ 135.393453] envoy[872]: conn peer=[2001:db8:1::3]:46932 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=972 tx=385 ms=51975412lb # [ 135.401180] envoy[872]: conn peer=[2001:db8:1::1]:41394 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3052 tx=1440 ms=98525413worker1 # [ 135.367442] nix-grpc-daemon[1458]: time=2026-09-20T12:48:24.821Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5414worker1 # [ 135.369716] nix-grpc-daemon[1458]: time=2026-09-20T12:48:24.822Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5415worker1 # [ 135.410188] nix-grpc-daemon[1458]: time=2026-09-20T12:48:24.865Z level=INFO msg="Uploading 1 narinfos"5416lb # [ 135.440827] niks3-server[1006]: 2026/09/20 12:48:24 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5417lb # [ 135.461205] niks3-server[1006]: 2026/09/20 12:48:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5418lb # [ 135.470207] niks3-server[1006]: 2026/09/20 12:48:24 INFO Signed narinfos id=37 count=15419lb # [ 135.473649] niks3-server[1006]: 2026/09/20 12:48:24 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5420lb # [ 135.484913] niks3-server[1006]: 2026/09/20 12:48:24 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5421lb # [ 135.490037] niks3-server[1006]: 2026/09/20 12:48:24 INFO Completed upload id=375422worker1 # [ 135.448891] nix-grpc-daemon[1458]: time=2026-09-20T12:48:24.904Z level=INFO msg="Upload complete. (539ms)"5423lb # [ 135.493014] niks3-server[1006]: 2026/09/20 12:48:24 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5424worker1 # [ 135.457074] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=4245425worker1 # [ 135.475842] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145426worker1 # [ 135.483193] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5427worker1 # [ 135.489328] nix-daemon[843]: reaped child process 1456, status = succeeded5428worker1 # [ 135.502248] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5429client # [ 135.537523] nix[1276]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5430client: must succeed: systemctl kill -s INT intr5431client # [ 137.553191] systemd[1]: intr.service: Sent signal SIGINT to main process 1276 (nix) on client request.5432worker1 # [ 137.526835] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:26Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5433client # [ 137.563368] nix[1276]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5434client # [ 137.573080] nix[1276]: error: interrupted by the user5435client: (finished: must succeed: systemctl kill -s INT intr, in 0.09 seconds)5436client # [ 137.606016] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5437client # [ 137.610882] systemd[1]: intr.service: Failed with result 'exit-code'.5438client # [ 137.613278] systemd[1]: intr.service: Consumed 146ms CPU time over 3.778s wall clock time, 39.2M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5439worker1 # [ 137.735639] nix-daemon[843]: reaped child process 1485, status = succeeded5440worker1 # [ 137.740683] nix-daemon[1487]: unexpected Nix daemon error: error: interrupted by the user5441worker1 # [ 137.748164] nix-daemon[843]: reaped child process 1487, status = failed with exit code 15442(finished: subtest: interrupting the client stops the build on the worker, in 5.12 seconds)5443subtest: a deploy mid-build drains: the build finishes, the new generation takes over5444client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5445client # [ 138.981741] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5446client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds)5447client # Running as unit: sw.service; invocation ID: ca24928720d84023b8f30bb5892fc2255448client # [ 139.225600] nix[1296]: don't know how to build these paths:5449client # [ 139.227494] nix[1296]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5450worker1 # [ 139.188984] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:533145451worker1 # [ 139.204160] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:28Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05452worker1 # [ 139.210684] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:28Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15453worker2 # [ 139.279638] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570705454worker2 # [ 139.297706] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570705455client # [ 139.324167] nix[1296]: copying 1 paths to 'lb:50051'...5456client # [ 139.328932] nix[1296]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5457worker2 # [ 139.316436] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570705458worker2 # [ 139.331734] nix-daemon[926]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)5459worker2 # [ 139.549258] nix-daemon[926]: accepted connection from pid 1633, user nix-grpc-daemon (trusted)5460worker2 # [ 139.571885] nix-daemon[926]: reaped child process 1636, status = succeeded5461worker2 # [ 139.751277] nix-daemon[926]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5462worker2 # [ 139.772626] nix-daemon[926]: reaped child process 1641, status = succeeded5463lb # [ 139.806529] niks3-server[1006]: 2026/09/20 12:48:29 INFO Received uploads request method=POST path=/api/pending_closures5464worker2 # [ 139.797417] nix-grpc-daemon[1533]: time=2026-09-20T12:48:29.231Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5465worker2 # [ 139.798911] nix-grpc-daemon[1533]: time=2026-09-20T12:48:29.231Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5466lb # [ 139.837839] niks3-server[1006]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5467worker2 # [ 139.843157] nix-grpc-daemon[1533]: time=2026-09-20T12:48:29.277Z level=INFO msg="Uploading 1 narinfos"5468lb # [ 139.854872] niks3-server[1006]: 2026/09/20 12:48:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5469lb # [ 139.867692] niks3-server[1006]: 2026/09/20 12:48:29 INFO Signed narinfos id=38 count=15470lb # [ 139.874454] niks3-server[1006]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5471lb # [ 139.885731] niks3-server[1006]: 2026/09/20 12:48:29 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5472lb # [ 139.891439] niks3-server[1006]: 2026/09/20 12:48:29 INFO Completed upload id=385473lb # [ 139.894601] niks3-server[1006]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5474worker2 # [ 139.872763] nix-grpc-daemon[1533]: time=2026-09-20T12:48:29.307Z level=INFO msg="Upload complete. (523ms)"5475worker2 # [ 139.884349] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57070 duration_s=0 paths=1 nar_bytes_in=4165476worker2 # [ 139.892439] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570705477worker2 # [ 139.908232] nix-daemon[926]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)5478worker2 # [ 139.911012] nix-daemon[926]: reaped child process 1631, status = succeeded5479client # [ 139.935193] nix[1296]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5480worker2 # [ 139.924249] nix-daemon[926]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)5481worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25482worker2 # Checking switch inhibitors... done5483worker2 # [ 142.469148] nixos[1676]: switching to system configuration /nix/store/ca3mrsym8mshjh6rixbc4b80lnrin4gl-nixos-system-worker2-test5484worker2 # [ 142.472695] systemd[1]: Stopped target Local File Systems.5485worker2 # activating the configuration...5486worker2 # [ 142.476147] systemd[1]: Stopped target Remote File Systems.5487worker2 # setting up /etc...5488worker2 # [ 143.268864] systemd[1]: Reload requested from client PID 1676 ('.switch-to-conf') (unit backdoor.service)...5489worker2 # [ 143.271178] systemd[1]: Reloading...5490worker2 # [ 144.180556] systemd[1]: Reloading finished in 905 ms.5491worker2 # restarting sysinit-reactivation.target5492worker2 # [ 144.258994] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5493worker2 # [ 144.418013] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5494worker2 # [ 144.419198] systemd[1]: Reached target Reactivate sysinit units.5495worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5496worker2 # [ 144.426367] systemd[1]: Reloading D-Bus System Message Bus...5497worker2 # [ 144.429854] dbus-broker-launch[588]: Caught SIGHUP, trigger reload.5498worker2 # [ 144.432582] systemd[1]: Reloading Nix worker-protocol over gRPC...5499worker2 # [ 144.465207] dbus-broker-launch[588]: Looking up NSS user entry for 'systemd-timesync'...5500worker2 # [ 144.467201] dbus-broker-launch[588]: NSS returned no entry for 'systemd-timesync'5501worker2 # [ 144.475852] dbus-broker-launch[588]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5502worker2 # [ 144.494208] systemd[1]: Reloaded Nix worker-protocol over gRPC.5503worker2 # [ 144.515208] systemd[1]: Reloaded D-Bus System Message Bus.5504worker2 # [ 144.525304] systemd[1]: Reached target Local File Systems.5505worker2 # [ 144.529818] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5506worker2 # [ 144.537229] systemd[1]: Starting Create SUID/SGID Wrappers...5507worker2 # [ 144.538105] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5508worker2 # [ 144.539281] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675509worker2 # [ 144.555141] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5510worker2 # [ 144.561108] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5511worker2 # [ 144.562554] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5512worker2 # [ 144.563724] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5513worker2 # [ 144.569173] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5514worker2 # [ 144.570800] systemd[1]: Reached target Remote File Systems.5515worker2 # [ 145.058262] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5516worker2 # [ 145.061466] systemd[1]: Finished Create SUID/SGID Wrappers.5517worker2 # [ 145.064568] systemd[1]: Starting linger-users.service...5518worker2 # [ 145.116690] systemd[1]: linger-users.service: Deactivated successfully.5519worker2 # [ 145.124135] systemd[1]: Finished linger-users.service.5520worker2 # [ 145.272355] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:34Z level=info event=draining5521worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5522lb # [ 145.390411] envoy[872]: conn peer=[2001:db8:1::1]:55078 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=731 ms=35325523worker2 # [ 145.375433] nixos[1676]: finished switching to system configuration /nix/store/ca3mrsym8mshjh6rixbc4b80lnrin4gl-nixos-system-worker2-test5524worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.73 seconds)5525worker2: must succeed: pgrep -f 'read -t [9]0 x'5526worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.07 seconds)5527client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25528client # don't know how to build these paths:5529client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5530worker1 # [ 145.688808] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:533145531worker1 # [ 145.695955] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145532worker1 # [ 145.721744] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:35Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05533worker1 # [ 145.729166] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:35Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15534worker1 # [ 145.767907] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145535worker1 # [ 145.787252] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145536client # copying 1 paths to 'lb:50051'...5537worker1 # [ 145.806637] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533145538client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5539worker1 # [ 145.831639] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5540worker1 # [ 146.048006] nix-daemon[843]: accepted connection from pid 1541, user nix-grpc-daemon (trusted)5541worker1 # [ 146.069666] nix-daemon[843]: reaped child process 1544, status = succeeded5542worker1 # [ 146.250754] nix-daemon[843]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5543worker1 # [ 146.272676] nix-daemon[843]: reaped child process 1549, status = succeeded5544lb # [ 146.326914] niks3-server[1006]: 2026/09/20 12:48:35 INFO Received uploads request method=POST path=/api/pending_closures5545worker1 # [ 146.314244] nix-grpc-daemon[1458]: time=2026-09-20T12:48:35.769Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5546worker1 # [ 146.315840] nix-grpc-daemon[1458]: time=2026-09-20T12:48:35.769Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5547lb # [ 146.376880] niks3-server[1006]: 2026/09/20 12:48:35 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5548worker1 # [ 146.349990] nix-grpc-daemon[1458]: time=2026-09-20T12:48:35.805Z level=INFO msg="Uploading 1 narinfos"5549lb # [ 146.391551] niks3-server[1006]: 2026/09/20 12:48:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5550lb # [ 146.403455] niks3-server[1006]: 2026/09/20 12:48:35 INFO Signed narinfos id=39 count=15551lb # [ 146.409536] niks3-server[1006]: 2026/09/20 12:48:35 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5552lb # [ 146.418285] niks3-server[1006]: 2026/09/20 12:48:35 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5553lb # [ 146.425721] niks3-server[1006]: 2026/09/20 12:48:35 INFO Completed upload id=395554worker1 # [ 146.384264] nix-grpc-daemon[1458]: time=2026-09-20T12:48:35.839Z level=INFO msg="Upload complete. (532ms)"5555lb # [ 146.428200] niks3-server[1006]: 2026/09/20 12:48:35 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5556worker1 # [ 146.394907] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=5285557worker1 # [ 146.411010] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145558worker1 # [ 146.418027] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5559worker1 # [ 146.424318] nix-daemon[843]: reaped child process 1539, status = succeeded5560client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5561client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5562worker1 # [ 146.439906] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5563client # farm-a> LOG-farm-a-during-drain5564worker1 # [ 147.282639] nix-daemon[843]: reaped child process 1553, status = succeeded5565worker1 # [ 147.465682] nix-daemon[843]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)5566worker1 # [ 147.486180] nix-daemon[843]: reaped child process 1571, status = succeeded5567lb # [ 147.539738] niks3-server[1006]: 2026/09/20 12:48:36 INFO Received uploads request method=POST path=/api/pending_closures5568worker1 # [ 147.629097] nix-grpc-daemon[1458]: time=2026-09-20T12:48:37.082Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5569worker1 # [ 147.645544] nix-grpc-daemon[1458]: time=2026-09-20T12:48:37.082Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5570lb # [ 147.711421] niks3-server[1006]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5571lb # [ 147.734395] niks3-server[1006]: 2026/09/20 12:48:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5572worker1 # [ 147.700315] nix-grpc-daemon[1458]: time=2026-09-20T12:48:37.155Z level=INFO msg="Uploading 1 narinfos"5573lb # [ 147.742563] niks3-server[1006]: 2026/09/20 12:48:37 INFO Signed narinfos id=40 count=15574lb # [ 147.746139] niks3-server[1006]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5575lb # [ 147.766196] niks3-server[1006]: 2026/09/20 12:48:37 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5576lb # [ 147.778804] niks3-server[1006]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5577lb # [ 147.784053] niks3-server[1006]: 2026/09/20 12:48:37 INFO Completed upload id=405578worker1 # [ 147.742811] nix-grpc-daemon[1458]: time=2026-09-20T12:48:37.198Z level=INFO msg="Upload complete. (490ms)"5579lb # [ 147.786872] niks3-server[1006]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5580worker1 # [ 147.765501] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=15581worker1 # [ 147.785677] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:37Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05582worker1 # [ 147.792560] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:37Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15583worker1 # [ 147.798492] nix-daemon[843]: reaped child process 1551, status = succeeded5584worker1 # [ 147.813649] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145585worker1 # [ 147.831311] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145586worker1 # [ 147.855524] nix-grpc-daemon[1458]: time=2026-09-20T12:48:37.311Z level=INFO msg="All 1 paths already cached"5587client # copying 1 paths to 'lb:50051'...5588worker1 # [ 147.866596] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533145589client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5590worker1 # [ 147.889948] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5591worker1 # [ 148.109202] nix-daemon[843]: accepted connection from pid 1577, user nix-grpc-daemon (trusted)5592worker1 # [ 148.129492] nix-daemon[843]: reaped child process 1580, status = succeeded5593worker1 # [ 148.304712] nix-daemon[843]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)5594worker1 # [ 148.322683] nix-daemon[843]: reaped child process 1585, status = succeeded5595lb # [ 148.379798] niks3-server[1006]: 2026/09/20 12:48:37 INFO Received uploads request method=POST path=/api/pending_closures5596worker1 # [ 148.452146] nix-grpc-daemon[1458]: time=2026-09-20T12:48:37.907Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5597worker1 # [ 148.457743] nix-grpc-daemon[1458]: time=2026-09-20T12:48:37.907Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5598worker1 # [ 148.492265] nix-grpc-daemon[1458]: time=2026-09-20T12:48:37.947Z level=INFO msg="Uploading 1 narinfos"5599lb # [ 148.526552] niks3-server[1006]: 2026/09/20 12:48:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5600lb # [ 148.542434] niks3-server[1006]: 2026/09/20 12:48:37 INFO Signed narinfos id=41 count=15601lb # [ 148.556460] niks3-server[1006]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5602lb # [ 148.562882] niks3-server[1006]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5603worker1 # [ 148.526404] nix-grpc-daemon[1458]: time=2026-09-20T12:48:37.981Z level=INFO msg="Upload complete. (617ms)"5604lb # [ 148.568583] niks3-server[1006]: 2026/09/20 12:48:37 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5605lb # [ 148.573262] niks3-server[1006]: 2026/09/20 12:48:37 INFO Completed upload id=415606lb # [ 148.576581] niks3-server[1006]: 2026/09/20 12:48:38 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5607worker1 # [ 148.541211] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=6405608worker1 # [ 148.556671] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145609worker1 # [ 148.566467] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5610worker1 # [ 148.573516] nix-daemon[843]: reaped child process 1575, status = succeeded5611client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5612worker1 # [ 148.587757] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5613client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5614client # farm-b> LOG-farm-b-during-drain5615worker1 # [ 150.026985] nix-daemon[843]: reaped child process 1589, status = succeeded5616worker1 # [ 150.193366] nix-daemon[843]: accepted connection from pid 1604, user nix-grpc-daemon (trusted)5617worker1 # [ 150.215756] nix-daemon[843]: reaped child process 1607, status = succeeded5618lb # [ 150.270438] niks3-server[1006]: 2026/09/20 12:48:39 INFO Received uploads request method=POST path=/api/pending_closures5619worker1 # [ 150.239403] nix-grpc-daemon[1458]: time=2026-09-20T12:48:39.693Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5620worker1 # [ 150.241196] nix-grpc-daemon[1458]: time=2026-09-20T12:48:39.694Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5621lb # [ 150.303211] niks3-server[1006]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5622lb # [ 150.323677] niks3-server[1006]: 2026/09/20 12:48:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5623worker1 # [ 150.289435] nix-grpc-daemon[1458]: time=2026-09-20T12:48:39.744Z level=INFO msg="Uploading 1 narinfos"5624lb # [ 150.334064] niks3-server[1006]: 2026/09/20 12:48:39 INFO Signed narinfos id=42 count=15625lb # [ 150.338882] niks3-server[1006]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5626lb # [ 150.351643] niks3-server[1006]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5627lb # [ 150.357130] niks3-server[1006]: 2026/09/20 12:48:39 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5628worker1 # [ 150.315324] nix-grpc-daemon[1458]: time=2026-09-20T12:48:39.770Z level=INFO msg="Upload complete. (310ms)"5629lb # [ 150.360053] niks3-server[1006]: 2026/09/20 12:48:39 INFO Completed upload id=425630lb # [ 150.362268] niks3-server[1006]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5631worker1 # [ 150.331287] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=15632worker1 # [ 150.353889] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:39Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05633worker1 # [ 150.358538] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:39Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15634worker1 # [ 150.363180] nix-daemon[843]: reaped child process 1587, status = succeeded5635worker1 # [ 150.398214] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145636worker1 # [ 150.416086] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145637worker1 # [ 151.046769] nix-grpc-daemon[1458]: time=2026-09-20T12:48:40.502Z level=INFO msg="All 2 paths already cached"5638client # copying 1 paths to 'lb:50051'...5639worker1 # [ 151.057862] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533145640client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5641worker1 # [ 151.084558] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5642worker1 # [ 151.296616] nix-daemon[843]: accepted connection from pid 1613, user nix-grpc-daemon (trusted)5643worker1 # [ 151.318015] nix-daemon[843]: reaped child process 1616, status = succeeded5644worker1 # [ 151.495685] nix-daemon[843]: accepted connection from pid 1618, user nix-grpc-daemon (trusted)5645worker1 # [ 151.516691] nix-daemon[843]: reaped child process 1621, status = succeeded5646lb # [ 151.571883] niks3-server[1006]: 2026/09/20 12:48:40 INFO Received uploads request method=POST path=/api/pending_closures5647worker1 # [ 151.540855] nix-grpc-daemon[1458]: time=2026-09-20T12:48:40.995Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5648worker1 # [ 151.542403] nix-grpc-daemon[1458]: time=2026-09-20T12:48:40.995Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5649lb # [ 151.601646] niks3-server[1006]: 2026/09/20 12:48:41 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5650lb # [ 151.616510] niks3-server[1006]: 2026/09/20 12:48:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5651worker1 # [ 151.582768] nix-grpc-daemon[1458]: time=2026-09-20T12:48:41.038Z level=INFO msg="Uploading 1 narinfos"5652lb # [ 151.628601] niks3-server[1006]: 2026/09/20 12:48:41 INFO Signed narinfos id=43 count=15653lb # [ 151.636846] niks3-server[1006]: 2026/09/20 12:48:41 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5654lb # [ 151.649661] niks3-server[1006]: 2026/09/20 12:48:41 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5655worker1 # [ 151.613824] nix-grpc-daemon[1458]: time=2026-09-20T12:48:41.069Z level=INFO msg="Upload complete. (509ms)"5656lb # [ 151.656579] niks3-server[1006]: 2026/09/20 12:48:41 INFO Completed upload id=435657lb # [ 151.659659] niks3-server[1006]: 2026/09/20 12:48:41 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5658worker1 # [ 151.623837] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=7685659worker1 # [ 151.637408] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145660worker1 # [ 151.649963] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5661worker1 # [ 151.654018] nix-daemon[843]: reaped child process 1611, status = succeeded5662client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5663client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5664worker1 # [ 151.669045] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5665client # farm-top> LOG-farm-top-during-drain5666worker1 # [ 152.904284] nix-daemon[843]: reaped child process 1625, status = succeeded5667worker1 # [ 153.078627] nix-daemon[843]: accepted connection from pid 1640, user nix-grpc-daemon (trusted)5668worker1 # [ 153.099081] nix-daemon[843]: reaped child process 1643, status = succeeded5669lb # [ 153.158127] niks3-server[1006]: 2026/09/20 12:48:42 INFO Received uploads request method=POST path=/api/pending_closures5670worker1 # [ 153.143559] nix-grpc-daemon[1458]: time=2026-09-20T12:48:42.597Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5671worker1 # [ 153.145453] nix-grpc-daemon[1458]: time=2026-09-20T12:48:42.597Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5672lb # [ 153.215430] niks3-server[1006]: 2026/09/20 12:48:42 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5673lb # [ 153.229164] niks3-server[1006]: 2026/09/20 12:48:42 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5674lb # [ 153.239573] niks3-server[1006]: 2026/09/20 12:48:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5675worker1 # [ 153.204005] nix-grpc-daemon[1458]: time=2026-09-20T12:48:42.658Z level=INFO msg="Uploading 1 narinfos"5676lb # [ 153.246867] niks3-server[1006]: 2026/09/20 12:48:42 INFO Signed narinfos id=44 count=15677lb # [ 153.253148] niks3-server[1006]: 2026/09/20 12:48:42 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5678lb # [ 153.261327] niks3-server[1006]: 2026/09/20 12:48:42 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5679lb # [ 153.271541] niks3-server[1006]: 2026/09/20 12:48:42 INFO Completed upload id=445680worker1 # [ 153.229124] nix-grpc-daemon[1458]: time=2026-09-20T12:48:42.684Z level=INFO msg="Upload complete. (348ms)"5681lb # [ 153.274881] niks3-server[1006]: 2026/09/20 12:48:42 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5682worker1 # [ 153.245461] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=15683worker1 # [ 153.263809] nix-daemon[843]: reaped child process 1623, status = succeeded5684client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 7.87 seconds)5685client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5686client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.25 seconds)5687worker2: must succeed: pkill -f 'read -t [9]0 x'5688worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.07 seconds)5689client: waiting for success: ! systemctl is-active sw5690worker2 # [ 153.782785] nix-daemon[926]: reaped child process 1645, status = succeeded5691worker2 # [ 153.969456] nix-daemon[926]: accepted connection from pid 1816, user nix-grpc-daemon (trusted)5692worker2 # [ 153.993094] nix-daemon[926]: reaped child process 1819, status = succeeded5693lb # [ 154.024504] niks3-server[1006]: 2026/09/20 12:48:43 INFO Received uploads request method=POST path=/api/pending_closures5694worker2 # [ 154.019832] nix-grpc-daemon[1533]: time=2026-09-20T12:48:43.454Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5695worker2 # [ 154.022488] nix-grpc-daemon[1533]: time=2026-09-20T12:48:43.456Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5696lb # [ 154.077639] niks3-server[1006]: 2026/09/20 12:48:43 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5697worker2 # [ 154.070685] nix-grpc-daemon[1533]: time=2026-09-20T12:48:43.504Z level=INFO msg="Uploading 1 narinfos"5698lb # [ 154.094249] niks3-server[1006]: 2026/09/20 12:48:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5699lb # [ 154.104090] niks3-server[1006]: 2026/09/20 12:48:43 INFO Signed narinfos id=45 count=15700lb # [ 154.106325] niks3-server[1006]: 2026/09/20 12:48:43 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5701lb # [ 154.111337] niks3-server[1006]: 2026/09/20 12:48:43 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5702lb # [ 154.119380] niks3-server[1006]: 2026/09/20 12:48:43 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5703lb # [ 154.123335] niks3-server[1006]: 2026/09/20 12:48:43 INFO Completed upload id=455704worker2 # [ 154.104239] nix-grpc-daemon[1533]: time=2026-09-20T12:48:43.538Z level=INFO msg="Upload complete. (350ms)"5705lb # [ 154.125745] niks3-server[1006]: 2026/09/20 12:48:43 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5706worker2 # [ 154.117271] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57070 duration_s=14 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=15707worker2 # [ 154.135722] nix-daemon[926]: reaped child process 1643, status = succeeded5708client # [ 154.179009] systemd[1]: sw.service: Deactivated successfully.5709client # [ 154.184131] systemd[1]: sw.service: Consumed 167ms CPU time over 15.198s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 8.8K outgoing IP traffic.5710worker2 # [ 154.275494] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:43Z level=info event=signal_exit5711client: (finished: waiting for success: ! systemctl is-active sw, in 1.15 seconds)5712client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5713client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5714worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5715worker2 # [ 154.943637] systemd[1]: Starting scheduler-token.service...5716worker2 # [ 155.030017] systemd[1]: scheduler-token.service: Deactivated successfully.5717worker2 # [ 155.033961] systemd[1]: Finished scheduler-token.service.5718worker2 # [ 155.035218] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 89ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5719lb # [ 155.393908] envoy[872]: conn peer=[2001:db8:1::1]:60102 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9642 tx=3875 ms=75735720lb # [ 155.399148] envoy[872]: conn peer=[2001:db8:1::1]:55080 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2939 tx=1352 ms=149215721worker2 # [ 155.518187] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:44Z level=info event=scheduler_restarting5722worker1 # [ 155.495886] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:399565723worker1 # [ 155.500967] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:44Z level=info event=worker_gone addr=192.168.1.4:500515724worker2 # [ 155.542998] nix-grpc-daemon[1429]: ts=2026-09-20T12:48:44Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5725worker2 # [ 155.551106] nix-grpc-daemon[1429]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5726worker2 # [ 155.557468] nix-grpc-daemon[1429]: E0000 00:00:1789908524.984010 1472 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5727worker2 # [ 155.567345] nix-grpc-daemon[1429]: E0000 00:00:1789908524.984490 1472 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5728worker2 # [ 155.589872] nix-daemon[926]: reaped child process 1526, status = succeeded5729worker2 # [ 155.750822] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5730worker2 # [ 155.756887] systemd[1]: nix-grpc-daemon.service: Consumed 1.199s CPU time over 46.691s wall clock time, 31.5M memory peak, 28.6K incoming IP traffic, 53.3K outgoing IP traffic.5731worker2 # [ 155.778081] systemd[1]: Starting Nix worker-protocol over gRPC...5732worker2 # [ 155.977906] nix-grpc-daemon[1836]: ts=2026-09-20T12:48:45Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5733worker2 # [ 155.980737] nix-grpc-daemon[1836]: ts=2026-09-20T12:48:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5734worker2 # [ 155.984931] nix-grpc-daemon[1836]: ts=2026-09-20T12:48:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15735worker2 # [ 155.992972] nix-grpc-daemon[1836]: ts=2026-09-20T12:48:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5736worker2 # [ 155.995046] systemd[1]: Started Nix worker-protocol over gRPC.5737worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.16 seconds)5738lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5739lb: must succeed: curl -sf localhost:9901/clusters5740worker2 # [ 156.016554] nix-grpc-daemon[1836]: ts=2026-09-20T12:48:45Z level=info event=scheduler_connected addr=lb:500515741worker1 # [ 155.997934] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:45Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:399565742worker1 # [ 156.004704] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:45Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05743lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5744lb: must succeed: curl -sf localhost:9901/clusters5745lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5746lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds)5747lb: must succeed: curl -sf localhost:9901/clusters5748lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5749worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5750worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5751(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 18.44 seconds)5752subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5753client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15754worker1 # [ 157.588312] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:533145755worker1 # [ 157.595479] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145756worker1 # [ 157.660197] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:47Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05757worker1 # [ 157.667144] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:47Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15758worker1 # [ 157.674711] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:47Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05759worker1 # [ 157.680258] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:47Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05760worker1 # [ 157.715745] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145761worker1 # [ 157.732919] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145762worker1 # [ 157.749131] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533145763worker1 # [ 157.765274] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5764worker1 # [ 157.984375] nix-daemon[843]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)5765worker1 # [ 158.005705] nix-daemon[843]: reaped child process 1655, status = succeeded5766worker1 # [ 158.187900] nix-daemon[843]: accepted connection from pid 1657, user nix-grpc-daemon (trusted)5767worker1 # [ 158.206285] nix-daemon[843]: reaped child process 1660, status = succeeded5768lb # [ 158.261988] niks3-server[1006]: 2026/09/20 12:48:47 INFO Received uploads request method=POST path=/api/pending_closures5769worker1 # [ 158.231012] nix-grpc-daemon[1458]: time=2026-09-20T12:48:47.685Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5770worker1 # [ 158.232687] nix-grpc-daemon[1458]: time=2026-09-20T12:48:47.686Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5771lb # [ 158.299882] niks3-server[1006]: 2026/09/20 12:48:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5772worker1 # [ 158.267403] nix-grpc-daemon[1458]: time=2026-09-20T12:48:47.722Z level=INFO msg="Uploading 1 narinfos"5773lb # [ 158.314451] niks3-server[1006]: 2026/09/20 12:48:47 INFO Signed narinfos id=46 count=15774lb # [ 158.320138] niks3-server[1006]: 2026/09/20 12:48:47 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5775lb # [ 158.331122] niks3-server[1006]: 2026/09/20 12:48:47 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5776lb # [ 158.342256] niks3-server[1006]: 2026/09/20 12:48:47 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5777worker1 # [ 158.300241] nix-grpc-daemon[1458]: time=2026-09-20T12:48:47.755Z level=INFO msg="Upload complete. (516ms)"5778lb # [ 158.345501] niks3-server[1006]: 2026/09/20 12:48:47 INFO Completed upload id=465779lb # [ 158.347992] niks3-server[1006]: 2026/09/20 12:48:47 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5780worker1 # [ 158.308348] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=5125781worker1 # [ 158.324396] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145782worker1 # [ 158.332808] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5783worker1 # [ 158.338333] nix-daemon[843]: reaped child process 1650, status = succeeded5784worker1 # [ 158.350192] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5785worker1 # [ 159.396650] nix-daemon[843]: reaped child process 1664, status = succeeded5786worker1 # [ 159.578180] nix-daemon[843]: accepted connection from pid 1679, user nix-grpc-daemon (trusted)5787worker1 # [ 159.598543] nix-daemon[843]: reaped child process 1682, status = succeeded5788lb # [ 159.653474] niks3-server[1006]: 2026/09/20 12:48:49 INFO Received uploads request method=POST path=/api/pending_closures5789worker1 # [ 159.624456] nix-grpc-daemon[1458]: time=2026-09-20T12:48:49.078Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5790worker1 # [ 159.625986] nix-grpc-daemon[1458]: time=2026-09-20T12:48:49.078Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5791lb # [ 159.701248] niks3-server[1006]: 2026/09/20 12:48:49 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5792worker1 # [ 159.672254] nix-grpc-daemon[1458]: time=2026-09-20T12:48:49.127Z level=INFO msg="Uploading 1 narinfos"5793lb # [ 159.714997] niks3-server[1006]: 2026/09/20 12:48:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5794lb # [ 159.723307] niks3-server[1006]: 2026/09/20 12:48:49 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5795lb # [ 159.729233] niks3-server[1006]: 2026/09/20 12:48:49 INFO Signed narinfos id=47 count=15796lb # [ 159.734852] niks3-server[1006]: 2026/09/20 12:48:49 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5797lb # [ 159.738127] niks3-server[1006]: 2026/09/20 12:48:49 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5798lb # [ 159.742316] niks3-server[1006]: 2026/09/20 12:48:49 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5799lb # [ 159.746040] niks3-server[1006]: 2026/09/20 12:48:49 INFO Completed upload id=475800worker1 # [ 159.704498] nix-grpc-daemon[1458]: time=2026-09-20T12:48:49.160Z level=INFO msg="Upload complete. (340ms)"5801worker1 # [ 159.721123] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=15802worker1 # [ 159.735528] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:49Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15803worker1 # [ 159.747884] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145804worker1 # [ 159.751865] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:49Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05805worker1 # [ 159.756823] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145806worker1 # [ 159.768283] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533145807worker1 # [ 159.775362] nix-daemon[843]: reaped child process 1662, status = succeeded5808worker1 # [ 159.778806] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5809worker1 # [ 159.962853] nix-daemon[843]: accepted connection from pid 1688, user nix-grpc-daemon (trusted)5810worker1 # [ 159.981610] nix-daemon[843]: reaped child process 1691, status = succeeded5811worker1 # [ 160.156112] nix-daemon[843]: accepted connection from pid 1693, user nix-grpc-daemon (trusted)5812worker1 # [ 160.174117] nix-daemon[843]: reaped child process 1696, status = succeeded5813lb # [ 160.226446] niks3-server[1006]: 2026/09/20 12:48:49 INFO Received uploads request method=POST path=/api/pending_closures5814worker1 # [ 160.201939] nix-grpc-daemon[1458]: time=2026-09-20T12:48:49.657Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5815worker1 # [ 160.203430] nix-grpc-daemon[1458]: time=2026-09-20T12:48:49.657Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5816lb # [ 160.261297] niks3-server[1006]: 2026/09/20 12:48:49 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5817worker1 # [ 160.234382] nix-grpc-daemon[1458]: time=2026-09-20T12:48:49.689Z level=INFO msg="Uploading 1 narinfos"5818lb # [ 160.277372] niks3-server[1006]: 2026/09/20 12:48:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5819lb # [ 160.286210] niks3-server[1006]: 2026/09/20 12:48:49 INFO Signed narinfos id=48 count=15820lb # [ 160.295853] niks3-server[1006]: 2026/09/20 12:48:49 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5821worker1 # [ 160.258972] nix-grpc-daemon[1458]: time=2026-09-20T12:48:49.714Z level=INFO msg="Upload complete. (475ms)"5822lb # [ 160.302684] niks3-server[1006]: 2026/09/20 12:48:49 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5823lb # [ 160.307532] niks3-server[1006]: 2026/09/20 12:48:49 INFO Completed upload id=485824worker1 # [ 160.266192] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=5125825lb # [ 160.310530] niks3-server[1006]: 2026/09/20 12:48:49 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5826worker1 # [ 160.280307] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145827worker1 # [ 160.286808] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5828worker1 # [ 160.291876] nix-daemon[843]: reaped child process 1686, status = succeeded5829worker1 # [ 160.303801] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5830worker1 # [ 161.354025] nix-daemon[843]: reaped child process 1700, status = succeeded5831worker1 # [ 161.535599] nix-daemon[843]: accepted connection from pid 1715, user nix-grpc-daemon (trusted)5832worker1 # [ 161.555083] nix-daemon[843]: reaped child process 1718, status = succeeded5833lb # [ 161.613519] niks3-server[1006]: 2026/09/20 12:48:51 INFO Received uploads request method=POST path=/api/pending_closures5834worker1 # [ 161.584491] nix-grpc-daemon[1458]: time=2026-09-20T12:48:51.037Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5835worker1 # [ 161.586385] nix-grpc-daemon[1458]: time=2026-09-20T12:48:51.037Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5836lb # [ 161.653469] niks3-server[1006]: 2026/09/20 12:48:51 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5837lb # [ 161.669549] niks3-server[1006]: 2026/09/20 12:48:51 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5838lb # [ 161.681556] niks3-server[1006]: 2026/09/20 12:48:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5839worker1 # [ 161.645564] nix-grpc-daemon[1458]: time=2026-09-20T12:48:51.100Z level=INFO msg="Uploading 1 narinfos"5840lb # [ 161.688817] niks3-server[1006]: 2026/09/20 12:48:51 INFO Signed narinfos id=49 count=15841lb # [ 161.694235] niks3-server[1006]: 2026/09/20 12:48:51 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5842worker1 # [ 161.666072] nix-grpc-daemon[1458]: time=2026-09-20T12:48:51.121Z level=INFO msg="Upload complete. (349ms)"5843lb # [ 161.707463] niks3-server[1006]: 2026/09/20 12:48:51 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5844lb # [ 161.711993] niks3-server[1006]: 2026/09/20 12:48:51 INFO Completed upload id=495845lb # [ 161.715131] niks3-server[1006]: 2026/09/20 12:48:51 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5846worker1 # [ 161.679848] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=15847worker1 # [ 161.696303] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:51Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15848worker1 # [ 161.702121] nix-daemon[843]: reaped child process 1698, status = succeeded5849worker1 # [ 161.723118] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145850worker1 # [ 161.731513] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:51Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05851worker1 # [ 161.743849] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145852worker1 # [ 161.759624] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533145853worker1 # [ 161.773956] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5854worker1 # [ 161.979543] nix-daemon[843]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5855worker1 # [ 161.999680] nix-daemon[843]: reaped child process 1727, status = succeeded5856worker1 # [ 162.172913] nix-daemon[843]: accepted connection from pid 1729, user nix-grpc-daemon (trusted)5857worker1 # [ 162.190787] nix-daemon[843]: reaped child process 1732, status = succeeded5858lb # [ 162.244245] niks3-server[1006]: 2026/09/20 12:48:51 INFO Received uploads request method=POST path=/api/pending_closures5859worker1 # [ 162.212096] nix-grpc-daemon[1458]: time=2026-09-20T12:48:51.667Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5860worker1 # [ 162.214053] nix-grpc-daemon[1458]: time=2026-09-20T12:48:51.667Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5861lb # [ 162.274181] niks3-server[1006]: 2026/09/20 12:48:51 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5862lb # [ 162.291203] niks3-server[1006]: 2026/09/20 12:48:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5863worker1 # [ 162.256598] nix-grpc-daemon[1458]: time=2026-09-20T12:48:51.711Z level=INFO msg="Uploading 1 narinfos"5864lb # [ 162.304353] niks3-server[1006]: 2026/09/20 12:48:51 INFO Signed narinfos id=50 count=15865lb # [ 162.307550] niks3-server[1006]: 2026/09/20 12:48:51 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5866lb # [ 162.321395] niks3-server[1006]: 2026/09/20 12:48:51 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5867lb # [ 162.326580] niks3-server[1006]: 2026/09/20 12:48:51 INFO Completed upload id=505868worker1 # [ 162.284331] nix-grpc-daemon[1458]: time=2026-09-20T12:48:51.739Z level=INFO msg="Upload complete. (494ms)"5869lb # [ 162.329563] niks3-server[1006]: 2026/09/20 12:48:51 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5870worker1 # [ 162.292200] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=5125871worker1 # [ 162.308225] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145872worker1 # [ 162.315860] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5873worker1 # [ 162.321580] nix-daemon[843]: reaped child process 1722, status = succeeded5874worker1 # [ 162.336450] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5875worker1 # [ 163.787563] nix-daemon[843]: reaped child process 1736, status = succeeded5876worker1 # [ 163.975563] nix-daemon[843]: accepted connection from pid 1751, user nix-grpc-daemon (trusted)5877worker1 # [ 163.992934] nix-daemon[843]: reaped child process 1754, status = succeeded5878lb # [ 164.049802] niks3-server[1006]: 2026/09/20 12:48:53 INFO Received uploads request method=POST path=/api/pending_closures5879worker1 # [ 164.019211] nix-grpc-daemon[1458]: time=2026-09-20T12:48:53.473Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5880worker1 # [ 164.020793] nix-grpc-daemon[1458]: time=2026-09-20T12:48:53.473Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5881lb # [ 164.089010] niks3-server[1006]: 2026/09/20 12:48:53 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5882lb # [ 164.103277] niks3-server[1006]: 2026/09/20 12:48:53 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5883lb # [ 164.112504] niks3-server[1006]: 2026/09/20 12:48:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5884worker1 # [ 164.076927] nix-grpc-daemon[1458]: time=2026-09-20T12:48:53.532Z level=INFO msg="Uploading 1 narinfos"5885lb # [ 164.121932] niks3-server[1006]: 2026/09/20 12:48:53 INFO Signed narinfos id=51 count=15886lb # [ 164.127699] niks3-server[1006]: 2026/09/20 12:48:53 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5887lb # [ 164.136121] niks3-server[1006]: 2026/09/20 12:48:53 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5888lb # [ 164.142892] niks3-server[1006]: 2026/09/20 12:48:53 INFO Completed upload id=515889worker1 # [ 164.101271] nix-grpc-daemon[1458]: time=2026-09-20T12:48:53.556Z level=INFO msg="Upload complete. (347ms)"5890lb # [ 164.145587] niks3-server[1006]: 2026/09/20 12:48:53 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5891worker1 # [ 164.119152] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=15892worker1 # [ 164.136880] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:53Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15893worker1 # [ 164.145261] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145894worker1 # [ 164.150143] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:53Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05895worker1 # [ 164.154523] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145896worker1 # [ 164.157857] nix-daemon[843]: reaped child process 1734, status = succeeded5897worker1 # [ 164.160400] nix-grpc-daemon[1458]: time=2026-09-20T12:48:53.609Z level=INFO msg="All 1 paths already cached"5898worker1 # [ 164.162732] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533145899worker1 # [ 164.173816] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5900worker1 # [ 164.358032] nix-daemon[843]: accepted connection from pid 1760, user nix-grpc-daemon (trusted)5901worker1 # [ 164.377589] nix-daemon[843]: reaped child process 1763, status = succeeded5902worker1 # [ 164.551751] nix-daemon[843]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)5903worker1 # [ 164.569282] nix-daemon[843]: reaped child process 1768, status = succeeded5904lb # [ 164.625348] niks3-server[1006]: 2026/09/20 12:48:54 INFO Received uploads request method=POST path=/api/pending_closures5905worker1 # [ 164.597143] nix-grpc-daemon[1458]: time=2026-09-20T12:48:54.052Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5906worker1 # [ 164.598661] nix-grpc-daemon[1458]: time=2026-09-20T12:48:54.052Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5907lb # [ 164.664204] niks3-server[1006]: 2026/09/20 12:48:54 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5908lb # [ 164.676290] niks3-server[1006]: 2026/09/20 12:48:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5909worker1 # [ 164.640659] nix-grpc-daemon[1458]: time=2026-09-20T12:48:54.096Z level=INFO msg="Uploading 1 narinfos"5910lb # [ 164.686712] niks3-server[1006]: 2026/09/20 12:48:54 INFO Signed narinfos id=52 count=15911lb # [ 164.692295] niks3-server[1006]: 2026/09/20 12:48:54 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5912lb # [ 164.697825] niks3-server[1006]: 2026/09/20 12:48:54 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5913lb # [ 164.706862] niks3-server[1006]: 2026/09/20 12:48:54 INFO Completed upload id=525914worker1 # [ 164.665568] nix-grpc-daemon[1458]: time=2026-09-20T12:48:54.121Z level=INFO msg="Upload complete. (479ms)"5915lb # [ 164.710555] niks3-server[1006]: 2026/09/20 12:48:54 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5916worker1 # [ 164.675953] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=6245917worker1 # [ 164.688448] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145918worker1 # [ 164.694189] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5919worker1 # [ 164.698969] nix-daemon[843]: reaped child process 1758, status = succeeded5920worker1 # [ 164.712255] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5921lb # [ 165.395406] envoy[872]: conn peer=[2001:db8:1::4]:52130 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=15284 tx=1014 ms=462485922worker1 # [ 165.737949] nix-daemon[843]: reaped child process 1772, status = succeeded5923worker1 # [ 165.906965] nix-daemon[843]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)5924worker1 # [ 165.925321] nix-daemon[843]: reaped child process 1790, status = succeeded5925lb # [ 165.981298] niks3-server[1006]: 2026/09/20 12:48:55 INFO Received uploads request method=POST path=/api/pending_closures5926worker1 # [ 165.952466] nix-grpc-daemon[1458]: time=2026-09-20T12:48:55.404Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5927worker1 # [ 165.953990] nix-grpc-daemon[1458]: time=2026-09-20T12:48:55.405Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5928lb # [ 166.020097] niks3-server[1006]: 2026/09/20 12:48:55 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5929lb # [ 166.041137] niks3-server[1006]: 2026/09/20 12:48:55 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5930lb # [ 166.052311] niks3-server[1006]: 2026/09/20 12:48:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5931worker1 # [ 166.015331] nix-grpc-daemon[1458]: time=2026-09-20T12:48:55.470Z level=INFO msg="Uploading 1 narinfos"5932lb # [ 166.061742] niks3-server[1006]: 2026/09/20 12:48:55 INFO Signed narinfos id=53 count=15933lb # [ 166.066980] niks3-server[1006]: 2026/09/20 12:48:55 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5934lb # [ 166.076663] niks3-server[1006]: 2026/09/20 12:48:55 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5935lb # [ 166.084514] niks3-server[1006]: 2026/09/20 12:48:55 INFO Completed upload id=535936worker1 # [ 166.042975] nix-grpc-daemon[1458]: time=2026-09-20T12:48:55.498Z level=INFO msg="Upload complete. (320ms)"5937lb # [ 166.087088] niks3-server[1006]: 2026/09/20 12:48:55 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5938worker1 # [ 166.057240] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=15939worker1 # [ 166.073530] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:55Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15940worker1 # [ 166.078156] nix-daemon[843]: reaped child process 1770, status = succeeded5941worker1 # [ 166.098307] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145942worker1 # [ 166.105785] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:55Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05943worker1 # [ 166.117027] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145944worker1 # [ 166.131241] nix-grpc-daemon[1458]: time=2026-09-20T12:48:55.586Z level=INFO msg="All 1 paths already cached"5945worker1 # [ 166.140505] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533145946worker1 # [ 166.154456] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5947worker1 # [ 166.363635] nix-daemon[843]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)5948worker1 # [ 166.383124] nix-daemon[843]: reaped child process 1799, status = succeeded5949worker1 # [ 166.559709] nix-daemon[843]: accepted connection from pid 1801, user nix-grpc-daemon (trusted)5950worker1 # [ 166.577870] nix-daemon[843]: reaped child process 1804, status = succeeded5951lb # [ 166.631918] niks3-server[1006]: 2026/09/20 12:48:56 INFO Received uploads request method=POST path=/api/pending_closures5952worker1 # [ 166.599103] nix-grpc-daemon[1458]: time=2026-09-20T12:48:56.054Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5953worker1 # [ 166.600808] nix-grpc-daemon[1458]: time=2026-09-20T12:48:56.054Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5954lb # [ 166.658973] niks3-server[1006]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5955worker1 # [ 166.631136] nix-grpc-daemon[1458]: time=2026-09-20T12:48:56.086Z level=INFO msg="Uploading 1 narinfos"5956lb # [ 166.674173] niks3-server[1006]: 2026/09/20 12:48:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5957lb # [ 166.684108] niks3-server[1006]: 2026/09/20 12:48:56 INFO Signed narinfos id=54 count=15958lb # [ 166.691720] niks3-server[1006]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5959worker1 # [ 166.660374] nix-grpc-daemon[1458]: time=2026-09-20T12:48:56.116Z level=INFO msg="Upload complete. (490ms)"5960lb # [ 166.701738] niks3-server[1006]: 2026/09/20 12:48:56 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5961lb # [ 166.707415] niks3-server[1006]: 2026/09/20 12:48:56 INFO Completed upload id=545962worker1 # [ 166.668120] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=6245963lb # [ 166.710815] niks3-server[1006]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5964worker1 # [ 166.676710] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145965worker1 # [ 166.688178] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5966worker1 # [ 166.691188] nix-daemon[843]: reaped child process 1794, status = succeeded5967worker1 # [ 166.704222] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5968worker1 # [ 168.329941] nix-daemon[843]: reaped child process 1808, status = succeeded5969worker1 # [ 168.499093] nix-daemon[843]: accepted connection from pid 1823, user nix-grpc-daemon (trusted)5970worker1 # [ 168.517626] nix-daemon[843]: reaped child process 1826, status = succeeded5971lb # [ 168.571454] niks3-server[1006]: 2026/09/20 12:48:57 INFO Received uploads request method=POST path=/api/pending_closures5972worker1 # [ 168.540427] nix-grpc-daemon[1458]: time=2026-09-20T12:48:57.994Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5973worker1 # [ 168.541960] nix-grpc-daemon[1458]: time=2026-09-20T12:48:57.994Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5974lb # [ 168.614604] niks3-server[1006]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5975worker1 # [ 168.584714] nix-grpc-daemon[1458]: time=2026-09-20T12:48:58.040Z level=INFO msg="Uploading 1 narinfos"5976lb # [ 168.628288] niks3-server[1006]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5977lb # [ 168.638880] niks3-server[1006]: 2026/09/20 12:48:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5978lb # [ 168.644154] niks3-server[1006]: 2026/09/20 12:48:58 INFO Signed narinfos id=55 count=15979lb # [ 168.650200] niks3-server[1006]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5980lb # [ 168.653563] niks3-server[1006]: 2026/09/20 12:48:58 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5981lb # [ 168.657555] niks3-server[1006]: 2026/09/20 12:48:58 INFO Completed upload id=555982worker1 # [ 168.615745] nix-grpc-daemon[1458]: time=2026-09-20T12:48:58.071Z level=INFO msg="Upload complete. (301ms)"5983lb # [ 168.660030] niks3-server[1006]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5984worker1 # [ 168.633300] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=15985worker1 # [ 168.654242] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:58Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15986worker1 # [ 168.658153] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533145987worker1 # [ 168.662261] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:58Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05988worker1 # [ 168.667472] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533145989worker1 # [ 168.671700] nix-daemon[843]: reaped child process 1806, status = succeeded5990worker1 # [ 168.673623] nix-grpc-daemon[1458]: time=2026-09-20T12:48:58.126Z level=INFO msg="All 1 paths already cached"5991worker1 # [ 168.676935] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533145992worker1 # [ 168.687021] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5993worker1 # [ 168.873927] nix-daemon[843]: accepted connection from pid 1832, user nix-grpc-daemon (trusted)5994worker1 # [ 168.892469] nix-daemon[843]: reaped child process 1835, status = succeeded5995worker1 # [ 169.069770] nix-daemon[843]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)5996worker1 # [ 169.089033] nix-daemon[843]: reaped child process 1840, status = succeeded5997lb # [ 169.141668] niks3-server[1006]: 2026/09/20 12:48:58 INFO Received uploads request method=POST path=/api/pending_closures5998worker1 # [ 169.108785] nix-grpc-daemon[1458]: time=2026-09-20T12:48:58.564Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5999worker1 # [ 169.110726] nix-grpc-daemon[1458]: time=2026-09-20T12:48:58.566Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6000lb # [ 169.173582] niks3-server[1006]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6001lb # [ 169.187080] niks3-server[1006]: 2026/09/20 12:48:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6002worker1 # [ 169.153111] nix-grpc-daemon[1458]: time=2026-09-20T12:48:58.608Z level=INFO msg="Uploading 1 narinfos"6003lb # [ 169.195011] niks3-server[1006]: 2026/09/20 12:48:58 INFO Signed narinfos id=56 count=16004lb # [ 169.202364] niks3-server[1006]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6005lb # [ 169.213705] niks3-server[1006]: 2026/09/20 12:48:58 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6006lb # [ 169.219580] niks3-server[1006]: 2026/09/20 12:48:58 INFO Completed upload id=566007worker1 # [ 169.177582] nix-grpc-daemon[1458]: time=2026-09-20T12:48:58.633Z level=INFO msg="Upload complete. (479ms)"6008lb # [ 169.222503] niks3-server[1006]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6009worker1 # [ 169.184441] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=6246010worker1 # [ 169.199432] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533146011worker1 # [ 169.206533] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6012worker1 # [ 169.212255] nix-daemon[843]: reaped child process 1830, status = succeeded6013worker1 # [ 169.224186] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6014worker1 # [ 169.868577] nix-daemon[843]: reaped child process 1844, status = succeeded6015worker1 # [ 170.057329] nix-daemon[843]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)6016worker1 # [ 170.076260] nix-daemon[843]: reaped child process 1862, status = succeeded6017lb # [ 170.134395] niks3-server[1006]: 2026/09/20 12:48:59 INFO Received uploads request method=POST path=/api/pending_closures6018worker1 # [ 170.104463] nix-grpc-daemon[1458]: time=2026-09-20T12:48:59.557Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6019worker1 # [ 170.106182] nix-grpc-daemon[1458]: time=2026-09-20T12:48:59.557Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6020lb # [ 170.172124] niks3-server[1006]: 2026/09/20 12:48:59 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6021lb # [ 170.184873] niks3-server[1006]: 2026/09/20 12:48:59 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6022lb # [ 170.192794] niks3-server[1006]: 2026/09/20 12:48:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6023worker1 # [ 170.155955] nix-grpc-daemon[1458]: time=2026-09-20T12:48:59.611Z level=INFO msg="Uploading 1 narinfos"6024lb # [ 170.202003] niks3-server[1006]: 2026/09/20 12:48:59 INFO Signed narinfos id=57 count=16025lb # [ 170.207604] niks3-server[1006]: 2026/09/20 12:48:59 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6026lb # [ 170.219744] niks3-server[1006]: 2026/09/20 12:48:59 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6027lb # [ 170.224245] niks3-server[1006]: 2026/09/20 12:48:59 INFO Completed upload id=576028worker1 # [ 170.183129] nix-grpc-daemon[1458]: time=2026-09-20T12:48:59.638Z level=INFO msg="Upload complete. (345ms)"6029lb # [ 170.227796] niks3-server[1006]: 2026/09/20 12:48:59 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6030worker1 # [ 170.201612] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=16031worker1 # [ 170.219405] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:59Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16032worker1 # [ 170.232843] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533146033worker1 # [ 170.246349] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:59Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06034worker1 # [ 170.255173] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533146035worker1 # [ 170.260164] nix-daemon[843]: reaped child process 1842, status = succeeded6036worker1 # [ 170.263240] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6037worker1 # [ 170.266141] nix-grpc-daemon[1458]: time=2026-09-20T12:48:59.687Z level=INFO msg="All 2 paths already cached"6038worker1 # [ 170.269002] nix-grpc-daemon[1388]: ts=2026-09-20T12:48:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533146039worker1 # [ 170.453967] nix-daemon[843]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)6040worker1 # [ 170.473935] nix-daemon[843]: reaped child process 1871, status = succeeded6041worker1 # [ 170.653249] nix-daemon[843]: accepted connection from pid 1873, user nix-grpc-daemon (trusted)6042worker1 # [ 170.673731] nix-daemon[843]: reaped child process 1876, status = succeeded6043lb # [ 170.729927] niks3-server[1006]: 2026/09/20 12:49:00 INFO Received uploads request method=POST path=/api/pending_closures6044worker1 # [ 170.700420] nix-grpc-daemon[1458]: time=2026-09-20T12:49:00.155Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6045worker1 # [ 170.703016] nix-grpc-daemon[1458]: time=2026-09-20T12:49:00.155Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6046lb # [ 170.759688] niks3-server[1006]: 2026/09/20 12:49:00 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6047worker1 # [ 170.731026] nix-grpc-daemon[1458]: time=2026-09-20T12:49:00.186Z level=INFO msg="Uploading 1 narinfos"6048lb # [ 170.776372] niks3-server[1006]: 2026/09/20 12:49:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6049lb # [ 170.786304] niks3-server[1006]: 2026/09/20 12:49:00 INFO Signed narinfos id=58 count=16050lb # [ 170.791189] niks3-server[1006]: 2026/09/20 12:49:00 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6051worker1 # [ 170.757169] nix-grpc-daemon[1458]: time=2026-09-20T12:49:00.212Z level=INFO msg="Upload complete. (491ms)"6052lb # [ 170.799024] niks3-server[1006]: 2026/09/20 12:49:00 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6053worker1 # [ 170.763619] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=7526054lb # [ 170.807588] niks3-server[1006]: 2026/09/20 12:49:00 INFO Completed upload id=586055lb # [ 170.810167] niks3-server[1006]: 2026/09/20 12:49:00 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6056worker1 # [ 170.772582] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533146057worker1 # [ 170.784220] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6058worker1 # [ 170.786829] nix-daemon[843]: reaped child process 1866, status = succeeded6059worker1 # [ 170.799972] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6060worker1 # [ 171.638687] nix-daemon[843]: reaped child process 1880, status = succeeded6061worker1 # [ 171.813919] nix-daemon[843]: accepted connection from pid 1895, user nix-grpc-daemon (trusted)6062worker1 # [ 171.833086] nix-daemon[843]: reaped child process 1898, status = succeeded6063lb # [ 171.893075] niks3-server[1006]: 2026/09/20 12:49:01 INFO Received uploads request method=POST path=/api/pending_closures6064worker1 # [ 171.862528] nix-grpc-daemon[1458]: time=2026-09-20T12:49:01.316Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6065worker1 # [ 171.864235] nix-grpc-daemon[1458]: time=2026-09-20T12:49:01.316Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6066lb # [ 171.932188] niks3-server[1006]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6067worker1 # [ 171.905429] nix-grpc-daemon[1458]: time=2026-09-20T12:49:01.360Z level=INFO msg="Uploading 1 narinfos"6068lb # [ 171.948395] niks3-server[1006]: 2026/09/20 12:49:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6069lb # [ 171.958419] niks3-server[1006]: 2026/09/20 12:49:01 INFO Signed narinfos id=59 count=16070lb # [ 171.963365] niks3-server[1006]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6071worker1 # [ 171.929317] nix-grpc-daemon[1458]: time=2026-09-20T12:49:01.384Z level=INFO msg="Upload complete. (318ms)"6072lb # [ 171.972281] niks3-server[1006]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6073lb # [ 171.977203] niks3-server[1006]: 2026/09/20 12:49:01 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6074lb # [ 171.980818] niks3-server[1006]: 2026/09/20 12:49:01 INFO Completed upload id=596075lb # [ 171.983150] niks3-server[1006]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6076worker1 # [ 171.940624] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=16077worker1 # [ 171.955777] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:01Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16078worker1 # [ 171.960578] nix-daemon[843]: reaped child process 1878, status = succeeded6079worker1 # [ 171.982708] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533146080worker1 # [ 171.997525] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533146081worker1 # [ 172.010941] nix-grpc-daemon[1458]: time=2026-09-20T12:49:01.466Z level=INFO msg="All 2 paths already cached"6082worker1 # [ 172.020136] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533146083worker1 # [ 172.033516] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6084worker1 # [ 172.232393] nix-daemon[843]: accepted connection from pid 1902, user nix-grpc-daemon (trusted)6085worker1 # [ 172.252055] nix-daemon[843]: reaped child process 1905, status = succeeded6086worker1 # [ 172.427998] nix-daemon[843]: accepted connection from pid 1907, user nix-grpc-daemon (trusted)6087worker1 # [ 172.444592] nix-daemon[843]: reaped child process 1910, status = succeeded6088lb # [ 172.500350] niks3-server[1006]: 2026/09/20 12:49:01 INFO Received uploads request method=POST path=/api/pending_closures6089worker1 # [ 172.467832] nix-grpc-daemon[1458]: time=2026-09-20T12:49:01.923Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6090worker1 # [ 172.469515] nix-grpc-daemon[1458]: time=2026-09-20T12:49:01.923Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6091lb # [ 172.529389] niks3-server[1006]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6092lb # [ 172.541540] niks3-server[1006]: 2026/09/20 12:49:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6093worker1 # [ 172.506684] nix-grpc-daemon[1458]: time=2026-09-20T12:49:01.962Z level=INFO msg="Uploading 1 narinfos"6094lb # [ 172.551915] niks3-server[1006]: 2026/09/20 12:49:01 INFO Signed narinfos id=60 count=16095lb # [ 172.558294] niks3-server[1006]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6096lb # [ 172.566675] niks3-server[1006]: 2026/09/20 12:49:01 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6097lb # [ 172.573335] niks3-server[1006]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6098lb # [ 172.577524] niks3-server[1006]: 2026/09/20 12:49:02 INFO Completed upload id=606099worker1 # [ 172.535853] nix-grpc-daemon[1458]: time=2026-09-20T12:49:01.991Z level=INFO msg="Upload complete. (486ms)"6100worker1 # [ 172.544678] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=7526101worker1 # [ 172.558239] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533146102worker1 # [ 172.564364] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6103worker1 # [ 172.568981] nix-daemon[843]: reaped child process 1900, status = succeeded6104worker1 # [ 172.582160] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6105worker1 # [ 174.025709] nix-daemon[843]: reaped child process 1914, status = succeeded6106worker1 # [ 174.204612] nix-daemon[843]: accepted connection from pid 1929, user nix-grpc-daemon (trusted)6107worker1 # [ 174.222699] nix-daemon[843]: reaped child process 1932, status = succeeded6108lb # [ 174.277911] niks3-server[1006]: 2026/09/20 12:49:03 INFO Received uploads request method=POST path=/api/pending_closures6109worker1 # [ 174.247585] nix-grpc-daemon[1458]: time=2026-09-20T12:49:03.701Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6110worker1 # [ 174.249337] nix-grpc-daemon[1458]: time=2026-09-20T12:49:03.701Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6111lb # [ 174.310395] niks3-server[1006]: 2026/09/20 12:49:03 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6112lb # [ 174.327032] niks3-server[1006]: 2026/09/20 12:49:03 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6113worker1 # [ 174.295612] nix-grpc-daemon[1458]: time=2026-09-20T12:49:03.750Z level=INFO msg="Uploading 1 narinfos"6114lb # [ 174.339285] niks3-server[1006]: 2026/09/20 12:49:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6115lb # [ 174.349670] niks3-server[1006]: 2026/09/20 12:49:03 INFO Signed narinfos id=61 count=16116worker1 # [ 174.309998] nix-grpc-daemon[1458]: time=2026-09-20T12:49:03.763Z level=INFO msg="Upload complete. (315ms)"6117lb # [ 174.353885] niks3-server[1006]: 2026/09/20 12:49:03 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6118lb # [ 174.357813] niks3-server[1006]: 2026/09/20 12:49:03 INFO Completed upload id=616119lb # [ 174.360057] niks3-server[1006]: 2026/09/20 12:49:03 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6120worker1 # [ 174.319443] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=16121worker1 # [ 174.333153] nix-grpc-daemon[1458]: time=2026-09-20T12:49:03.769Z level=WARN msg="Failed to register uploaded object" key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo error="server returned 404: object is not pending upload\n"6122worker1 # [ 174.338121] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:03Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16123worker1 # [ 174.341612] nix-daemon[843]: reaped child process 1912, status = succeeded6124worker1 # [ 174.363558] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533146125worker1 # [ 174.378131] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533146126worker1 # [ 174.391642] nix-grpc-daemon[1458]: time=2026-09-20T12:49:03.847Z level=INFO msg="All 2 paths already cached"6127worker1 # [ 174.400180] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533146128worker1 # [ 174.412863] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6129worker1 # [ 174.608530] nix-daemon[843]: accepted connection from pid 1936, user nix-grpc-daemon (trusted)6130worker1 # [ 174.626931] nix-daemon[843]: reaped child process 1939, status = succeeded6131worker1 # [ 174.803509] nix-daemon[843]: accepted connection from pid 1941, user nix-grpc-daemon (trusted)6132worker1 # [ 174.820872] nix-daemon[843]: reaped child process 1944, status = succeeded6133lb # [ 174.876713] niks3-server[1006]: 2026/09/20 12:49:04 INFO Received uploads request method=POST path=/api/pending_closures6134worker1 # [ 174.844062] nix-grpc-daemon[1458]: time=2026-09-20T12:49:04.299Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6135worker1 # [ 174.845542] nix-grpc-daemon[1458]: time=2026-09-20T12:49:04.299Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6136lb # [ 174.910076] niks3-server[1006]: 2026/09/20 12:49:04 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6137lb # [ 174.922179] niks3-server[1006]: 2026/09/20 12:49:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6138worker1 # [ 174.887077] nix-grpc-daemon[1458]: time=2026-09-20T12:49:04.342Z level=INFO msg="Uploading 1 narinfos"6139lb # [ 174.933692] niks3-server[1006]: 2026/09/20 12:49:04 INFO Signed narinfos id=62 count=16140lb # [ 174.941009] niks3-server[1006]: 2026/09/20 12:49:04 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6141lb # [ 174.949693] niks3-server[1006]: 2026/09/20 12:49:04 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6142lb # [ 174.956846] niks3-server[1006]: 2026/09/20 12:49:04 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6143lb # [ 174.962703] niks3-server[1006]: 2026/09/20 12:49:04 INFO Completed upload id=626144worker1 # [ 174.921391] nix-grpc-daemon[1458]: time=2026-09-20T12:49:04.377Z level=INFO msg="Upload complete. (492ms)"6145worker1 # [ 174.929731] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=0 paths=1 nar_bytes_in=7526146worker1 # [ 174.943990] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:533146147worker1 # [ 174.951095] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6148worker1 # [ 174.956001] nix-daemon[843]: reaped child process 1934, status = succeeded6149worker1 # [ 174.970315] nix-daemon[843]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6150worker1 # [ 175.991611] nix-daemon[843]: reaped child process 1948, status = succeeded6151worker1 # [ 176.160468] nix-daemon[843]: accepted connection from pid 1963, user nix-grpc-daemon (trusted)6152worker1 # [ 176.185385] nix-daemon[843]: reaped child process 1966, status = succeeded6153lb # [ 176.239455] niks3-server[1006]: 2026/09/20 12:49:05 INFO Received uploads request method=POST path=/api/pending_closures6154worker1 # [ 176.210948] nix-grpc-daemon[1458]: time=2026-09-20T12:49:05.665Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6155worker1 # [ 176.212558] nix-grpc-daemon[1458]: time=2026-09-20T12:49:05.665Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6156lb # [ 176.282038] niks3-server[1006]: 2026/09/20 12:49:05 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6157lb # [ 176.293916] niks3-server[1006]: 2026/09/20 12:49:05 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6158worker1 # [ 176.260176] nix-grpc-daemon[1458]: time=2026-09-20T12:49:05.715Z level=INFO msg="Uploading 1 narinfos"6159lb # [ 176.304327] niks3-server[1006]: 2026/09/20 12:49:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6160lb # [ 176.307417] niks3-server[1006]: 2026/09/20 12:49:05 INFO Signed narinfos id=63 count=16161lb # [ 176.315402] niks3-server[1006]: 2026/09/20 12:49:05 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6162lb # [ 176.321953] niks3-server[1006]: 2026/09/20 12:49:05 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6163lb # [ 176.325845] niks3-server[1006]: 2026/09/20 12:49:05 INFO Completed upload id=636164worker1 # [ 176.284503] nix-grpc-daemon[1458]: time=2026-09-20T12:49:05.740Z level=INFO msg="Upload complete. (304ms)"6165lb # [ 176.328364] niks3-server[1006]: 2026/09/20 12:49:05 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6166worker1 # [ 176.296935] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53314 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=16167worker1 # [ 176.311532] nix-daemon[843]: reaped child process 1946, status = succeeded6168client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.06 seconds)6169worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6170worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6171client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16172worker2 # [ 176.721358] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:368766173worker2 # [ 176.738242] nix-daemon[926]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6174worker2 # [ 176.759457] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:368766175worker2 # [ 176.776201] nix-grpc-daemon[1836]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 1/5)6176worker2 # [ 176.872096] nix-grpc-daemon[1836]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 38 ms (attempt 2/5)6177worker2 # [ 176.917704] nix-grpc-daemon[1836]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 247 ms (attempt 3/5)6178worker2 # [ 177.172429] nix-grpc-daemon[1836]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 4/5)6179worker2 # [ 177.232672] nix-grpc-daemon[1836]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6180worker1 # [ 177.244392] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:06Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06181lb # [ 185.396904] envoy[872]: conn peer=[2001:db8:1::1]:33672 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27200 tx=10728 ms=187296182client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.84 seconds)6183(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 49.98 seconds)6184subtest: low disk drains a worker and builds go to the other6185worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6186worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.11 seconds)6187worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6188worker1 # [ 208.667829] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:38Z level=info event=unhealthy reason=min_free6189worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds)6190client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26191client # don't know how to build these paths:6192client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6193worker2 # [ 209.801584] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:368766194worker1 # [ 209.785344] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533146195worker1 # [ 209.809727] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:39Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06196worker1 # [ 209.815511] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:39Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16197worker2 # [ 209.878950] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:368766198worker2 # [ 209.896693] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:368766199client # copying 1 paths to 'lb:50051'...6200client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6201worker2 # [ 209.914922] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:368766202worker2 # [ 209.932436] nix-daemon[926]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6203worker2 # [ 209.960131] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:39Z level=info event=niks3_push_started pid=18926204worker2 # [ 210.173324] nix-grpc-daemon[1892]: time=2026-09-20T12:49:39.607Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""6205worker2 # [ 210.350703] nix-daemon[926]: accepted connection from pid 1905, user nix-grpc-daemon (trusted)6206worker2 # [ 210.369441] nix-daemon[926]: reaped child process 1908, status = succeeded6207worker2 # [ 210.543467] nix-daemon[926]: accepted connection from pid 1910, user nix-grpc-daemon (trusted)6208worker2 # [ 210.563562] nix-daemon[926]: reaped child process 1913, status = succeeded6209lb # [ 210.595211] niks3-server[1006]: 2026/09/20 12:49:40 INFO Received uploads request method=POST path=/api/pending_closures6210worker2 # [ 210.587967] nix-grpc-daemon[1892]: time=2026-09-20T12:49:40.021Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6211worker2 # [ 210.589476] nix-grpc-daemon[1892]: time=2026-09-20T12:49:40.021Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6212lb # [ 210.636374] niks3-server[1006]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6213worker2 # [ 210.635856] nix-grpc-daemon[1892]: time=2026-09-20T12:49:40.069Z level=INFO msg="Uploading 1 narinfos"6214lb # [ 210.648187] niks3-server[1006]: 2026/09/20 12:49:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6215lb # [ 210.658083] niks3-server[1006]: 2026/09/20 12:49:40 INFO Signed narinfos id=64 count=16216lb # [ 210.666793] niks3-server[1006]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6217lb # [ 210.679847] niks3-server[1006]: 2026/09/20 12:49:40 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6218lb # [ 210.685070] niks3-server[1006]: 2026/09/20 12:49:40 INFO Completed upload id=646219worker2 # [ 210.665803] nix-grpc-daemon[1892]: time=2026-09-20T12:49:40.100Z level=INFO msg="Upload complete. (488ms)"6220lb # [ 210.687798] niks3-server[1006]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6221worker2 # [ 210.676309] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36876 duration_s=0 paths=1 nar_bytes_in=5126222worker2 # [ 210.690069] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:368766223worker2 # [ 210.697644] nix-daemon[926]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6224worker2 # [ 210.702821] nix-daemon[926]: reaped child process 1890, status = succeeded6225client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6226worker2 # [ 210.713372] nix-daemon[926]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6227client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6228client # farm-a> LOG-farm-a-drain6229worker2 # [ 211.959210] nix-daemon[926]: reaped child process 1917, status = succeeded6230worker2 # [ 212.143473] nix-daemon[926]: accepted connection from pid 1932, user nix-grpc-daemon (trusted)6231worker2 # [ 212.161724] nix-daemon[926]: reaped child process 1935, status = succeeded6232lb # [ 212.194294] niks3-server[1006]: 2026/09/20 12:49:41 INFO Received uploads request method=POST path=/api/pending_closures6233worker2 # [ 212.184483] nix-grpc-daemon[1892]: time=2026-09-20T12:49:41.617Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6234worker2 # [ 212.186339] nix-grpc-daemon[1892]: time=2026-09-20T12:49:41.617Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6235lb # [ 212.234911] niks3-server[1006]: 2026/09/20 12:49:41 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6236lb # [ 212.250161] niks3-server[1006]: 2026/09/20 12:49:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6237worker2 # [ 212.233414] nix-grpc-daemon[1892]: time=2026-09-20T12:49:41.666Z level=INFO msg="Uploading 1 narinfos"6238lb # [ 212.263364] niks3-server[1006]: 2026/09/20 12:49:41 INFO Signed narinfos id=65 count=16239lb # [ 212.269136] niks3-server[1006]: 2026/09/20 12:49:41 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6240lb # [ 212.275464] niks3-server[1006]: 2026/09/20 12:49:41 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6241lb # [ 212.284350] niks3-server[1006]: 2026/09/20 12:49:41 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6242lb # [ 212.289775] niks3-server[1006]: 2026/09/20 12:49:41 INFO Completed upload id=656243worker2 # [ 212.271195] nix-grpc-daemon[1892]: time=2026-09-20T12:49:41.705Z level=INFO msg="Upload complete. (344ms)"6244lb # [ 212.292939] niks3-server[1006]: 2026/09/20 12:49:41 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6245worker2 # [ 212.285191] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36876 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=16246worker1 # [ 212.267371] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:41Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06247worker1 # [ 212.273545] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:41Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16248worker2 # [ 212.305123] nix-daemon[926]: reaped child process 1915, status = succeeded6249worker2 # [ 212.335627] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:368766250worker2 # [ 212.352428] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:368766251worker2 # [ 212.367338] nix-grpc-daemon[1892]: time=2026-09-20T12:49:41.801Z level=INFO msg="All 1 paths already cached"6252client # copying 1 paths to 'lb:50051'...6253client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6254worker2 # [ 212.378929] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:368766255worker2 # [ 212.393828] nix-daemon[926]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6256worker2 # [ 212.597113] nix-daemon[926]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)6257worker2 # [ 212.617022] nix-daemon[926]: reaped child process 1942, status = succeeded6258worker2 # [ 212.791066] nix-daemon[926]: accepted connection from pid 1944, user nix-grpc-daemon (trusted)6259worker2 # [ 212.810838] nix-daemon[926]: reaped child process 1947, status = succeeded6260lb # [ 212.840359] niks3-server[1006]: 2026/09/20 12:49:42 INFO Received uploads request method=POST path=/api/pending_closures6261worker2 # [ 212.831088] nix-grpc-daemon[1892]: time=2026-09-20T12:49:42.265Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6262worker2 # [ 212.832776] nix-grpc-daemon[1892]: time=2026-09-20T12:49:42.265Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6263lb # [ 212.868506] niks3-server[1006]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6264worker2 # [ 212.863082] nix-grpc-daemon[1892]: time=2026-09-20T12:49:42.297Z level=INFO msg="Uploading 1 narinfos"6265lb # [ 212.886172] niks3-server[1006]: 2026/09/20 12:49:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6266lb # [ 212.895844] niks3-server[1006]: 2026/09/20 12:49:42 INFO Signed narinfos id=66 count=16267lb # [ 212.901410] niks3-server[1006]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6268worker2 # [ 212.889763] nix-grpc-daemon[1892]: time=2026-09-20T12:49:42.324Z level=INFO msg="Upload complete. (478ms)"6269lb # [ 212.909705] niks3-server[1006]: 2026/09/20 12:49:42 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6270lb # [ 212.914182] niks3-server[1006]: 2026/09/20 12:49:42 INFO Completed upload id=666271lb # [ 212.917002] niks3-server[1006]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6272worker2 # [ 212.896247] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36876 duration_s=0 paths=1 nar_bytes_in=6326273worker2 # [ 212.905105] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:368766274worker2 # [ 212.916334] nix-daemon[926]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6275worker2 # [ 212.921222] nix-daemon[926]: reaped child process 1937, status = succeeded6276client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6277worker2 # [ 212.933789] nix-daemon[926]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6278client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6279client # farm-b> LOG-farm-b-drain6280worker2 # [ 214.378765] nix-daemon[926]: reaped child process 1951, status = succeeded6281worker2 # [ 214.556687] nix-daemon[926]: accepted connection from pid 1966, user nix-grpc-daemon (trusted)6282worker2 # [ 214.574701] nix-daemon[926]: reaped child process 1969, status = succeeded6283lb # [ 214.607924] niks3-server[1006]: 2026/09/20 12:49:44 INFO Received uploads request method=POST path=/api/pending_closures6284worker2 # [ 214.599422] nix-grpc-daemon[1892]: time=2026-09-20T12:49:44.033Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6285worker2 # [ 214.601042] nix-grpc-daemon[1892]: time=2026-09-20T12:49:44.033Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6286lb # [ 214.643201] niks3-server[1006]: 2026/09/20 12:49:44 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6287lb # [ 214.655622] niks3-server[1006]: 2026/09/20 12:49:44 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6288lb # [ 214.667017] niks3-server[1006]: 2026/09/20 12:49:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6289worker2 # [ 214.654319] nix-grpc-daemon[1892]: time=2026-09-20T12:49:44.088Z level=INFO msg="Uploading 1 narinfos"6290lb # [ 214.675206] niks3-server[1006]: 2026/09/20 12:49:44 INFO Signed narinfos id=67 count=16291lb # [ 214.680723] niks3-server[1006]: 2026/09/20 12:49:44 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6292lb # [ 214.689612] niks3-server[1006]: 2026/09/20 12:49:44 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6293lb # [ 214.697532] niks3-server[1006]: 2026/09/20 12:49:44 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6294lb # [ 214.702351] niks3-server[1006]: 2026/09/20 12:49:44 INFO Completed upload id=676295worker2 # [ 214.683379] nix-grpc-daemon[1892]: time=2026-09-20T12:49:44.117Z level=INFO msg="Upload complete. (338ms)"6296worker2 # [ 214.697161] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36876 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=16297worker1 # [ 214.677416] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:44Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06298worker1 # [ 214.683636] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:44Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16299worker2 # [ 214.715708] nix-daemon[926]: reaped child process 1949, status = succeeded6300worker2 # [ 214.754041] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:368766301worker2 # [ 214.770790] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:368766302worker2 # [ 214.785309] nix-grpc-daemon[1892]: time=2026-09-20T12:49:44.219Z level=INFO msg="All 2 paths already cached"6303client # copying 1 paths to 'lb:50051'...6304client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6305worker2 # [ 214.795895] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:368766306worker2 # [ 214.811765] nix-daemon[926]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6307worker2 # [ 215.012662] nix-daemon[926]: accepted connection from pid 1973, user nix-grpc-daemon (trusted)6308worker2 # [ 215.032824] nix-daemon[926]: reaped child process 1976, status = succeeded6309worker2 # [ 215.206962] nix-daemon[926]: accepted connection from pid 1978, user nix-grpc-daemon (trusted)6310worker2 # [ 215.226377] nix-daemon[926]: reaped child process 1981, status = succeeded6311lb # [ 215.257848] niks3-server[1006]: 2026/09/20 12:49:44 INFO Received uploads request method=POST path=/api/pending_closures6312worker2 # [ 215.248885] nix-grpc-daemon[1892]: time=2026-09-20T12:49:44.683Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6313worker2 # [ 215.250364] nix-grpc-daemon[1892]: time=2026-09-20T12:49:44.683Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6314lb # [ 215.285127] niks3-server[1006]: 2026/09/20 12:49:44 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6315lb # [ 215.300826] niks3-server[1006]: 2026/09/20 12:49:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6316worker2 # [ 215.289574] nix-grpc-daemon[1892]: time=2026-09-20T12:49:44.723Z level=INFO msg="Uploading 1 narinfos"6317lb # [ 215.314513] niks3-server[1006]: 2026/09/20 12:49:44 INFO Signed narinfos id=68 count=16318lb # [ 215.321226] niks3-server[1006]: 2026/09/20 12:49:44 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6319lb # [ 215.332319] niks3-server[1006]: 2026/09/20 12:49:44 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6320worker2 # [ 215.319596] nix-grpc-daemon[1892]: time=2026-09-20T12:49:44.754Z level=INFO msg="Upload complete. (489ms)"6321lb # [ 215.340392] niks3-server[1006]: 2026/09/20 12:49:44 INFO Completed upload id=686322lb # [ 215.343951] niks3-server[1006]: 2026/09/20 12:49:44 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6323worker2 # [ 215.328257] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36876 duration_s=0 paths=1 nar_bytes_in=7606324worker2 # [ 215.340300] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:368766325worker2 # [ 215.348449] nix-daemon[926]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6326worker2 # [ 215.353782] nix-daemon[926]: reaped child process 1971, status = succeeded6327client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6328client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6329worker2 # [ 215.368209] nix-daemon[926]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6330lb # [ 215.397813] envoy[872]: conn peer=[2001:db8:1::1]:55992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=914 tx=518 ms=305716331client # farm-top> LOG-farm-top-drain6332worker2 # [ 216.598339] nix-daemon[926]: reaped child process 1985, status = succeeded6333worker2 # [ 216.767843] nix-daemon[926]: accepted connection from pid 2000, user nix-grpc-daemon (trusted)6334worker2 # [ 216.786657] nix-daemon[926]: reaped child process 2003, status = succeeded6335lb # [ 216.819295] niks3-server[1006]: 2026/09/20 12:49:46 INFO Received uploads request method=POST path=/api/pending_closures6336worker2 # [ 216.813580] nix-grpc-daemon[1892]: time=2026-09-20T12:49:46.246Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6337worker2 # [ 216.815845] nix-grpc-daemon[1892]: time=2026-09-20T12:49:46.246Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6338lb # [ 216.859605] niks3-server[1006]: 2026/09/20 12:49:46 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6339worker2 # [ 216.851484] nix-grpc-daemon[1892]: time=2026-09-20T12:49:46.285Z level=INFO msg="Uploading 1 narinfos"6340lb # [ 216.871284] niks3-server[1006]: 2026/09/20 12:49:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6341lb # [ 216.882189] niks3-server[1006]: 2026/09/20 12:49:46 INFO Signed narinfos id=69 count=16342lb # [ 216.886828] niks3-server[1006]: 2026/09/20 12:49:46 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6343lb # [ 216.895933] niks3-server[1006]: 2026/09/20 12:49:46 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6344lb # [ 216.899763] niks3-server[1006]: 2026/09/20 12:49:46 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6345worker2 # [ 216.881003] nix-grpc-daemon[1892]: time=2026-09-20T12:49:46.315Z level=INFO msg="Upload complete. (302ms)"6346lb # [ 216.903056] niks3-server[1006]: 2026/09/20 12:49:46 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6347lb # [ 216.906896] niks3-server[1006]: 2026/09/20 12:49:46 INFO Completed upload id=696348worker2 # [ 216.893005] nix-grpc-daemon[1836]: ts=2026-09-20T12:49:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36876 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=16349worker2 # [ 216.907198] nix-daemon[926]: reaped child process 1983, status = succeeded6350client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.40 seconds)6351client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6352client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds)6353worker1: must succeed: rm /nix/.rw-store/fill6354worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6355worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6356worker1 # [ 217.672128] nix-grpc-daemon[1388]: ts=2026-09-20T12:49:47Z level=info event=healthy reason=min_free6357worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6358(finished: subtest: low disk drains a worker and builds go to the other, in 11.24 seconds)6359(finished: run the VM test script, in 219.98 seconds)6360test script finished in 220.26s6361cleanup6362kill QemuMachine (pid 49)6363client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6364kill QemuMachine (pid 50)6365lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6366kill QemuMachine (pid 51)6367worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6368kill QemuMachine (pid 52)6369worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6370(finished: cleanup, in 1.24 seconds)6371additionally exposed symbols:6372 client, lb, worker1, worker2,6373 vlan1,6374 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh