vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #252
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13worker1 # Disk image does not exist, creating the virtualisation disk image...14lb # Formatting '/build/vm-state-lb/tmp.g18mrXc5v0', fmt=raw size=107374182415worker1: QEMU running (pid 51)16lb: QEMU running (pid 49)17client: QEMU running (pid 50)18worker2: QEMU running (pid 52)19client # Disk image does not exist, creating the virtualisation disk image...20worker2 # Disk image does not exist, creating the virtualisation disk image...21worker1 # Formatting '/build/vm-state-worker1/tmp.7x2e3GSkEQ', fmt=raw size=107374182422lb # mke2fs 1.47.4 (6-Mar-2025)23worker2 # Formatting '/build/vm-state-worker2/tmp.zGw0JpvJP7', fmt=raw size=107374182424worker1 # mke2fs 1.47.4 (6-Mar-2025)25lb # Discarding device blocks: 0/262144 done26worker2 # mke2fs 1.47.4 (6-Mar-2025)27worker1 # Discarding device blocks: 0/262144 done28lb # Creating filesystem with 262144 4k blocks and 65536 inodes29worker2 # Discarding device blocks: 0/262144 done30worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes31lb # Filesystem UUID: 4f75b336-8d7d-49d1-b1a4-94fe6ba23d3c32worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes33worker1 # Filesystem UUID: afd9c186-e06a-494b-9e51-b3967e96212834lb # Superblock backups stored on blocks:35worker2 # Filesystem UUID: 5b66058c-331d-46db-96d6-ff1e17e4febc36worker1 # Superblock backups stored on blocks:37lb # 32768, 98304, 163840, 22937638worker2 # Superblock backups stored on blocks:39worker1 # 32768, 98304, 163840, 22937640lb # 41worker2 # 32768, 98304, 163840, 22937642worker1 # 43lb # Allocating group tables: 0/8 done44worker2 # 45worker1 # Allocating group tables: 0/8 done46lb # Writing inode tables: 0/8 done47worker2 # Allocating group tables: 0/8 done48worker1 # Writing inode tables: 0/8 done49lb # Creating journal (8192 blocks): done50worker2 # Writing inode tables: 0/8 done51worker1 # Creating journal (8192 blocks): done52lb # Writing superblocks and filesystem accounting information: 0/8 done53worker2 # Creating journal (8192 blocks): done54worker1 # Writing superblocks and filesystem accounting information: 0/8 done55lb # 56worker2 # Writing superblocks and filesystem accounting information: 0/8 done57worker1 # 58lb # Virtualisation disk image created.59worker2 # 60worker1 # Virtualisation disk image created.61client # Formatting '/build/vm-state-client/tmp.ibGnI2GUby', fmt=raw size=107374182462(finished: start all VMs, in 0.46 seconds)63client # mke2fs 1.47.4 (6-Mar-2025)64client: waiting for unit network-addresses-eth1.service65client # Discarding device blocks: 0/262144 done66client: waiting for the VM to finish booting67client # Creating filesystem with 262144 4k blocks and 65536 inodes68worker2 # Virtualisation disk image created.69client # Filesystem UUID: 3663c7e9-b89b-4ccc-bd5f-cb3d9c71276a70client # Superblock backups stored on blocks:71client # 32768, 98304, 163840, 22937672client # 73client # Allocating group tables: 0/8 done74client # Writing inode tables: 0/8 done75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker2 # [ 0.000000] KASLR enabled82worker2 # [ 0.000000] random: crng init done83worker2 # [ 0.000000] Machine model: linux,dummy-virt84worker2 # [ 0.000000] efi: UEFI not found.85worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88worker2 # [ 0.000000] Zone ranges:89worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90worker2 # [ 0.000000] DMA32 empty91worker2 # [ 0.000000] Normal empty92worker2 # [ 0.000000] Device empty93worker2 # [ 0.000000] Movable zone start for each node94lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]95worker2 # [ 0.000000] Early memory node ranges96worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]97lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202698lb # [ 0.000000] KASLR enabled99worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]100lb # [ 0.000000] random: crng init done101worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000102lb # [ 0.000000] Machine model: linux,dummy-virt103worker2 # [ 0.000000] psci: probing for conduit method from DT.104lb # [ 0.000000] efi: UEFI not found.105worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.106lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT107worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs108lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]109worker2 # [ 0.000000] psci: Trusted OS migration not required110worker2 # [ 0.000000] psci: SMC Calling Convention v1.1111lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]112lb # [ 0.000000] Zone ranges:113worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)114lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]115lb # [ 0.000000] DMA32 empty116worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296117lb # [ 0.000000] Normal empty118lb # [ 0.000000] Device empty119worker2 # [ 0.000000] Detected PIPT I-cache on CPU0120lb # [ 0.000000] Movable zone start for each node121lb # [ 0.000000] Early memory node ranges122worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)123lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]124worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface125worker2 # [ 0.000000] CPU features: detected: Spectre-v4126lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]127worker2 # [ 0.000000] CPU features: detected: Spectre-BHB128lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000129worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38130lb # [ 0.000000] psci: probing for conduit method from DT.131worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23132lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.133worker2 # [ 0.000000] alternatives: applying boot alternatives134lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs135lb # [ 0.000000] psci: Trusted OS migration not required136lb # [ 0.000000] psci: SMC Calling Convention v1.1137lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)138lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296139lb # [ 0.000000] Detected PIPT I-cache on CPU0140worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/r1ia2y0cy1xis9is5mlx80jsgf16xnyi-nixos-system-worker2-test/init regInfo=/nix/store/5cnh0jbr8izzvkvwcahk9cyrkcpp1wz6-closure-info/registration console=ttyAMA0,115200n8 console=tty0141lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)142lb # [ 0.000000] CPU features: detected: GICv3 CPU interface143worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/5cnh0jbr8izzvkvwcahk9cyrkcpp1wz6-closure-info/registration", will be passed to user space.144lb # [ 0.000000] CPU features: detected: Spectre-v4145lb # [ 0.000000] CPU features: detected: Spectre-BHB146worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes147lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38148worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)149lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23150lb # [ 0.000000] alternatives: applying boot alternatives151worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)152worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB153worker2 # [ 0.000000] software IO TLB: area num 1.154worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB155worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)156client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]157worker2 # [ 0.000000] Fallback order for Node 0: 0158worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]159lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0160worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216161worker2 # [ 0.000000] Policy zone: DMA162client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026163worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026164client # [ 0.000000] KASLR enabled165worker1 # [ 0.000000] KASLR enabled166worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off167client # [ 0.000000] random: crng init done168worker1 # [ 0.000000] random: crng init done169lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.170client # [ 0.000000] Machine model: linux,dummy-virt171worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1172worker1 # [ 0.000000] Machine model: linux,dummy-virt173client # [ 0.000000] efi: UEFI not found.174worker1 # [ 0.000000] efi: UEFI not found.175worker2 # [ 0.000000] allocated 3145728 bytes of page_ext176lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes177client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT178worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages179worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT180lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)181worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups182client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]183worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]184worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.185lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)186client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]187worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]188worker2 # [ 0.000000] rcu: RCU event tracing is enabled.189client # [ 0.000000] Zone ranges:190worker1 # [ 0.000000] Zone ranges:191lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB192worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.193client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]194lb # [ 0.000000] software IO TLB: area num 1.195worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]196client # [ 0.000000] DMA32 empty197worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.198worker1 # [ 0.000000] DMA32 empty199client # [ 0.000000] Normal empty200lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB201worker1 # [ 0.000000] Normal empty202client # [ 0.000000] Device empty203worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.204worker1 # [ 0.000000] Device empty205client # [ 0.000000] Movable zone start for each node206worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.207lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)208worker1 # [ 0.000000] Movable zone start for each node209client # [ 0.000000] Early memory node ranges210worker1 # [ 0.000000] Early memory node ranges211lb # [ 0.000000] Fallback order for Node 0: 0212worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.213client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]214worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]215lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216216lb # [ 0.000000] Policy zone: DMA217worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1218client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]219worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]220client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000221lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off222worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000223worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.224client # [ 0.000000] psci: probing for conduit method from DT.225worker1 # [ 0.000000] psci: probing for conduit method from DT.226lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1227client # [ 0.000000] psci: PSCIv1.3 detected in firmware.228worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.229lb # [ 0.000000] allocated 3145728 bytes of page_ext230client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs231worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.232worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs233lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages234client # [ 0.000000] psci: Trusted OS migration not required235worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.236worker1 # [ 0.000000] psci: Trusted OS migration not required237lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups238client # [ 0.000000] psci: SMC Calling Convention v1.1239worker1 # [ 0.000000] psci: SMC Calling Convention v1.1240worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0241lb # [ 0.000000] rcu: Hierarchical RCU implementation.242worker2 # [ 0.000000] GICv3: 256 SPIs implemented243client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)244lb # [ 0.000000] rcu: RCU event tracing is enabled.245worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented246worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)247lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.248worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq249client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296250worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296251client # [ 0.000000] Detected PIPT I-cache on CPU0252lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.253worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI254worker1 # [ 0.000000] Detected PIPT I-cache on CPU0255lb # [ 0.000000] Rude variant of Tasks RCU enabled.256worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0257client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)258lb # [ 0.000000] Tracing variant of Tasks RCU enabled.259worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)260worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000261client # [ 0.000000] CPU features: detected: GICv3 CPU interface262worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface263worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]264client # [ 0.000000] CPU features: detected: Spectre-v4265lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.266worker1 # [ 0.000000] CPU features: detected: Spectre-v4267client # [ 0.000000] CPU features: detected: Spectre-BHB268lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1269worker1 # [ 0.000000] CPU features: detected: Spectre-BHB270worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)271client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38272worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38273lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.274client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23275worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23276worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)277client # [ 0.000000] alternatives: applying boot alternatives278worker1 # [ 0.000000] alternatives: applying boot alternatives279worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000280lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.281worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000282lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.283worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.284lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0285lb # [ 0.000000] GICv3: 256 SPIs implemented286lb # [ 0.000000] GICv3: 0 Extended SPIs implemented287worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns288lb # [ 0.000000] Root IRQ handler: gic_handle_irq289client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xhp7hdmnyckpg762n4vd2n1aspzkff7a-nixos-system-client-test/init regInfo=/nix/store/x78jf20gad0ij66h5k5b9a75x5gwxfc4-closure-info/registration console=ttyAMA0,115200n8 console=tty0290worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).291worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vwj97rlfz3wvxkwi4x07w9a0jsf1swbn-nixos-system-worker1-test/init regInfo=/nix/store/br0dl2xrji3kkcw2qx931i1wbccmjm7l-closure-info/registration console=ttyAMA0,115200n8 console=tty0292lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI293lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0294worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns295client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/x78jf20gad0ij66h5k5b9a75x5gwxfc4-closure-info/registration", will be passed to user space.296lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000297worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/br0dl2xrji3kkcw2qx931i1wbccmjm7l-closure-info/registration", will be passed to user space.298lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]299worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns300client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes301worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes302worker2 # [ 0.000032] arm-pv: using stolen time PV303client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)304lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)305worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)306worker2 # [ 0.000526] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)307client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)308lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)309worker2 # [ 0.000708] Console: colour dummy device 80x25310worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)311client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB312worker2 # [ 0.000716] printk: legacy console [tty0] enabled313lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000314worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB315client # [ 0.000000] software IO TLB: area num 1.316worker1 # [ 0.000000] software IO TLB: area num 1.317client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB318lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000319worker2 # [ 0.000940] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)320worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB321lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.322worker2 # [ 0.000947] pid_max: default: 32768 minimum: 301323client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)324worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)325client # [ 0.000000] Fallback order for Node 0: 0326worker2 # [ 0.001023] LSM: initializing lsm=capability,landlock,yama,bpf,ima327worker1 # [ 0.000000] Fallback order for Node 0: 0328lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns329worker2 # [ 0.001176] landlock: Up and running.330client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216331worker2 # [ 0.001179] Yama: becoming mindful.332client # [ 0.000000] Policy zone: DMA333lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).334worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216335worker2 # [ 0.001746] LSM support for eBPF active336worker1 # [ 0.000000] Policy zone: DMA337client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off338worker2 # [ 0.001874] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)339worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off340lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns341client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1342worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1343client # [ 0.000000] allocated 3145728 bytes of page_ext344worker2 # [ 0.001910] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)345lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns346worker1 # [ 0.000000] allocated 3145728 bytes of page_ext347client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages348lb # [ 0.000032] arm-pv: using stolen time PV349worker2 # [ 0.003093] cacheinfo: Unable to detect cache hierarchy for CPU 0350worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages351client # [ 0.000000] ftrace: allocated 294 pages with 4 groups352worker2 # [ 0.003923] rcu: Hierarchical SRCU implementation.353worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups354client # [ 0.000000] rcu: Hierarchical RCU implementation.355lb # [ 0.000505] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)356worker2 # [ 0.003927] rcu: Max phase no-delay instances is 1000.357client # [ 0.000000] rcu: RCU event tracing is enabled.358worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.359lb # [ 0.000671] Console: colour dummy device 80x25360worker2 # [ 0.005157] fsl-mc MSI: its@8080000 domain created361worker1 # [ 0.000000] rcu: RCU event tracing is enabled.362lb # [ 0.000678] printk: legacy console [tty0] enabled363client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.364worker2 # [ 0.005248] EFI services will not be available.365worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.366worker2 # [ 0.005330] smp: Bringing up secondary CPUs ...367client # [ 0.000000] Trampoline variant of Tasks RCU enabled.368worker2 # [ 0.005337] smp: Brought up 1 node, 1 CPU369client # [ 0.000000] Rude variant of Tasks RCU enabled.370lb # [ 0.000867] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)371worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.372worker2 # [ 0.005340] SMP: Total of 1 processors activated.373worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.374lb # [ 0.000874] pid_max: default: 32768 minimum: 301375client # [ 0.000000] Tracing variant of Tasks RCU enabled.376worker2 # [ 0.005346] CPU: All CPU(s) started at EL1377worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.378lb # [ 0.000945] LSM: initializing lsm=capability,landlock,yama,bpf,ima379client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.380worker2 # [ 0.005357] CPU features: detected: Branch Target Identification381lb # [ 0.001107] landlock: Up and running.382worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.383lb # [ 0.001110] Yama: becoming mindful.384client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1385worker2 # [ 0.005361] CPU features: detected: ARMv8.4 Translation Table Level386lb # [ 0.001642] LSM support for eBPF active387worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1388client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.389worker2 # [ 0.005365] CPU features: detected: Instruction cache invalidation not required for I/D coherence390lb # [ 0.001790] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)391worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.392client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.393worker2 # [ 0.005368] CPU features: detected: Data cache clean to the PoU not required for I/D coherence394lb # [ 0.001832] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)395worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.396lb # [ 0.003082] cacheinfo: Unable to detect cache hierarchy for CPU 0397worker2 # [ 0.005372] CPU features: detected: Common not Private translations398client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.399lb # [ 0.003831] rcu: Hierarchical SRCU implementation.400worker2 # [ 0.005375] CPU features: detected: CRC32 instructions401worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.402client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0403lb # [ 0.003835] rcu: Max phase no-delay instances is 1000.404worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0405client # [ 0.000000] GICv3: 256 SPIs implemented406worker2 # [ 0.005378] CPU features: detected: Data cache clean to Point of Deep Persistence407lb # [ 0.005087] fsl-mc MSI: its@8080000 domain created408worker1 # [ 0.000000] GICv3: 256 SPIs implemented409client # [ 0.000000] GICv3: 0 Extended SPIs implemented410worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented411lb # [ 0.005186] EFI services will not be available.412client # [ 0.000000] Root IRQ handler: gic_handle_irq413worker2 # [ 0.005382] CPU features: detected: Data cache clean to Point of Persistence414worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq415lb # [ 0.005268] smp: Bringing up secondary CPUs ...416client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI417worker2 # [ 0.005385] CPU features: detected: Data independent timing control (DIT)418lb # [ 0.005276] smp: Brought up 1 node, 1 CPU419worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI420client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0421worker2 # [ 0.005388] CPU features: detected: E0PD422lb # [ 0.005279] SMP: Total of 1 processors activated.423worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0424client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000425worker2 # [ 0.005391] CPU features: detected: Enhanced Counter Virtualization426lb # [ 0.005284] CPU: All CPU(s) started at EL1427worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000428client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]429lb # [ 0.005295] CPU features: detected: Branch Target Identification430worker2 # [ 0.005394] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)431worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]432lb # [ 0.005301] CPU features: detected: ARMv8.4 Translation Table Level433worker2 # [ 0.005397] CPU features: detected: Enhanced Virtualization Traps434client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)435worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)436worker2 # [ 0.005400] CPU features: detected: Fine Grained Traps437lb # [ 0.005304] CPU features: detected: Instruction cache invalidation not required for I/D coherence438client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)439worker2 # [ 0.005405] CPU features: detected: Generic authentication (architected QARMA5 algorithm)440worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)441client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000442lb # [ 0.005308] CPU features: detected: Data cache clean to the PoU not required for I/D coherence443worker2 # [ 0.005410] CPU features: detected: RCpc load-acquire (LDAPR)444worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000445client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000446lb # [ 0.005311] CPU features: detected: Common not Private translations447worker2 # [ 0.005413] CPU features: detected: LSE atomic instructions448worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000449lb # [ 0.005314] CPU features: detected: CRC32 instructions450client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.451worker2 # [ 0.005416] CPU features: detected: Privileged Access Never452worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.453worker2 # [ 0.005418] CPU features: detected: PMUv3454lb # [ 0.005317] CPU features: detected: Data cache clean to Point of Deep Persistence455client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns456worker2 # [ 0.005421] CPU features: detected: RAS Extension Support457worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns458client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).459worker2 # [ 0.005424] CPU features: detected: RASv1p1 Extension Support460worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).461worker2 # [ 0.005427] CPU features: detected: Random Number Generator462client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns463worker2 # [ 0.005429] CPU features: detected: Speculation barrier (SB)464worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns465worker2 # [ 0.005432] CPU features: detected: Stage-2 Force Write-Back466client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns467client # [ 0.000027] arm-pv: using stolen time PV468worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns469worker2 # [ 0.005435] CPU features: detected: TLB range maintenance instructions470worker1 # [ 0.000030] arm-pv: using stolen time PV471worker2 # [ 0.005440] CPU features: detected: Speculative Store Bypassing Safe (SSBS)472client # [ 0.000382] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)473worker2 # [ 0.005479] alternatives: applying system-wide alternatives474client # [ 0.000498] Console: colour dummy device 80x25475worker1 # [ 0.000398] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)476client # [ 0.000505] printk: legacy console [tty0] enabled477worker1 # [ 0.000598] Console: colour dummy device 80x25478worker2 # [ 0.008506] CPU features: detected: BBM Level 2 without TLB conflict abort479worker1 # [ 0.000606] printk: legacy console [tty0] enabled480client # [ 0.000693] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)481client # [ 0.000700] pid_max: default: 32768 minimum: 301482worker1 # [ 0.000804] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)483worker2 # [ 0.008720] Memory: 1406544K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)484worker2 # [ 0.009116] devtmpfs: initialized485worker1 # [ 0.000810] pid_max: default: 32768 minimum: 301486client # [ 0.000767] LSM: initializing lsm=capability,landlock,yama,bpf,ima487client # [ 0.000930] landlock: Up and running.488lb # [ 0.005321] CPU features: detected: Data cache clean to Point of Persistence489worker2 # [ 0.010972] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)490worker1 # [ 0.000876] LSM: initializing lsm=capability,landlock,yama,bpf,ima491client # [ 0.000932] Yama: becoming mindful.492worker1 # [ 0.000999] landlock: Up and running.493client # [ 0.001374] LSM support for eBPF active494lb # [ 0.005324] CPU features: detected: Data independent timing control (DIT)495worker1 # [ 0.001001] Yama: becoming mindful.496worker2 # [ 0.010996] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).497lb # [ 0.005327] CPU features: detected: E0PD498worker1 # [ 0.001436] LSM support for eBPF active499client # [ 0.001512] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)500worker2 # [ 0.011190] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL501lb # [ 0.005330] CPU features: detected: Enhanced Counter Virtualization502worker1 # [ 0.001584] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)503worker2 # [ 0.011195] 0 pages in range for non-PLT usage504client # [ 0.001548] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)505lb # [ 0.005333] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)506worker2 # [ 0.011196] 508288 pages in range for PLT usage507worker1 # [ 0.001617] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)508client # [ 0.002639] cacheinfo: Unable to detect cache hierarchy for CPU 0509lb # [ 0.005336] CPU features: detected: Enhanced Virtualization Traps510worker2 # [ 0.011312] pinctrl core: initialized pinctrl subsystem511client # [ 0.003332] rcu: Hierarchical SRCU implementation.512worker1 # [ 0.002675] cacheinfo: Unable to detect cache hierarchy for CPU 0513worker2 # [ 0.012167] DMI not present or invalid.514lb # [ 0.005339] CPU features: detected: Fine Grained Traps515client # [ 0.003335] rcu: Max phase no-delay instances is 1000.516worker1 # [ 0.003367] rcu: Hierarchical SRCU implementation.517worker2 # [ 0.015885] NET: Registered PF_NETLINK/PF_ROUTE protocol family518client # [ 0.004507] fsl-mc MSI: its@8080000 domain created519lb # [ 0.005343] CPU features: detected: Generic authentication (architected QARMA5 algorithm)520worker1 # [ 0.003371] rcu: Max phase no-delay instances is 1000.521client # [ 0.004595] EFI services will not be available.522worker1 # [ 0.004556] fsl-mc MSI: its@8080000 domain created523worker2 # [ 0.018203] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations524lb # [ 0.005348] CPU features: detected: RCpc load-acquire (LDAPR)525client # [ 0.004705] smp: Bringing up secondary CPUs ...526worker1 # [ 0.004645] EFI services will not be available.527lb # [ 0.005351] CPU features: detected: LSE atomic instructions528worker2 # [ 0.018404] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations529client # [ 0.004713] smp: Brought up 1 node, 1 CPU530worker1 # [ 0.004727] smp: Bringing up secondary CPUs ...531client # [ 0.004716] SMP: Total of 1 processors activated.532lb # [ 0.005354] CPU features: detected: Privileged Access Never533worker1 # [ 0.004736] smp: Brought up 1 node, 1 CPU534worker2 # [ 0.018608] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations535client # [ 0.004722] CPU: All CPU(s) started at EL1536lb # [ 0.005357] CPU features: detected: PMUv3537worker1 # [ 0.004739] SMP: Total of 1 processors activated.538worker2 # [ 0.018630] audit: initializing netlink subsys (disabled)539worker1 # [ 0.004744] CPU: All CPU(s) started at EL1540client # [ 0.004733] CPU features: detected: Branch Target Identification541lb # [ 0.005359] CPU features: detected: RAS Extension Support542worker2 # [ 0.019224] thermal_sys: Registered thermal governor 'fair_share'543worker1 # [ 0.004755] CPU features: detected: Branch Target Identification544client # [ 0.004738] CPU features: detected: ARMv8.4 Translation Table Level545lb # [ 0.005362] CPU features: detected: RASv1p1 Extension Support546worker2 # [ 0.019226] thermal_sys: Registered thermal governor 'bang_bang'547worker1 # [ 0.004760] CPU features: detected: ARMv8.4 Translation Table Level548lb # [ 0.005365] CPU features: detected: Random Number Generator549client # [ 0.004741] CPU features: detected: Instruction cache invalidation not required for I/D coherence550worker2 # [ 0.019230] thermal_sys: Registered thermal governor 'step_wise'551lb # [ 0.005367] CPU features: detected: Speculation barrier (SB)552worker1 # [ 0.004763] CPU features: detected: Instruction cache invalidation not required for I/D coherence553worker2 # [ 0.019235] thermal_sys: Registered thermal governor 'user_space'554lb # [ 0.005370] CPU features: detected: Stage-2 Force Write-Back555client # [ 0.004744] CPU features: detected: Data cache clean to the PoU not required for I/D coherence556worker1 # [ 0.004767] CPU features: detected: Data cache clean to the PoU not required for I/D coherence557lb # [ 0.005373] CPU features: detected: TLB range maintenance instructions558worker2 # [ 0.019238] thermal_sys: Registered thermal governor 'power_allocator'559client # [ 0.004748] CPU features: detected: Common not Private translations560client # [ 0.004751] CPU features: detected: CRC32 instructions561worker1 # [ 0.004771] CPU features: detected: Common not Private translations562lb # [ 0.005378] CPU features: detected: Speculative Store Bypassing Safe (SSBS)563worker2 # [ 0.019265] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1564worker1 # [ 0.004774] CPU features: detected: CRC32 instructions565worker2 # [ 0.019274] cpuidle: using governor ladder566lb # [ 0.005415] alternatives: applying system-wide alternatives567client # [ 0.004754] CPU features: detected: Data cache clean to Point of Deep Persistence568worker2 # [ 0.019279] cpuidle: using governor menu569worker1 # [ 0.004777] CPU features: detected: Data cache clean to Point of Deep Persistence570lb # [ 0.008426] CPU features: detected: BBM Level 2 without TLB conflict abort571client # [ 0.004758] CPU features: detected: Data cache clean to Point of Persistence572worker2 # [ 0.019469] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.573worker1 # [ 0.004780] CPU features: detected: Data cache clean to Point of Persistence574client # [ 0.004761] CPU features: detected: Data independent timing control (DIT)575worker2 # [ 0.019484] ASID allocator initialised with 65536 entries576client # [ 0.004764] CPU features: detected: E0PD577worker2 # [ 0.020775] Serial: AMBA PL011 UART driver578worker1 # [ 0.004783] CPU features: detected: Data independent timing control (DIT)579lb # [ 0.008630] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)580worker1 # [ 0.004786] CPU features: detected: E0PD581client # [ 0.004767] CPU features: detected: Enhanced Counter Virtualization582lb # [ 0.009043] devtmpfs: initialized583worker2 # [ 0.026071] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1584worker1 # [ 0.004789] CPU features: detected: Enhanced Counter Virtualization585client # [ 0.004770] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)586lb # [ 0.010922] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)587worker2 # [ 0.026202] printk: console [ttyAMA0] enabled588worker1 # [ 0.004792] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)589client # [ 0.004773] CPU features: detected: Enhanced Virtualization Traps590lb # [ 0.010945] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).591client # [ 0.004776] CPU features: detected: Fine Grained Traps592worker1 # [ 0.004795] CPU features: detected: Enhanced Virtualization Traps593lb # [ 0.011138] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL594worker1 # [ 0.004798] CPU features: detected: Fine Grained Traps595client # [ 0.004780] CPU features: detected: Generic authentication (architected QARMA5 algorithm)596lb # [ 0.011143] 0 pages in range for non-PLT usage597client # [ 0.004785] CPU features: detected: RCpc load-acquire (LDAPR)598lb # [ 0.011144] 508288 pages in range for PLT usage599worker1 # [ 0.004801] CPU features: detected: Generic authentication (architected QARMA5 algorithm)600client # [ 0.004788] CPU features: detected: LSE atomic instructions601lb # [ 0.011237] pinctrl core: initialized pinctrl subsystem602worker1 # [ 0.004806] CPU features: detected: RCpc load-acquire (LDAPR)603lb # [ 0.012024] DMI not present or invalid.604client # [ 0.004791] CPU features: detected: Privileged Access Never605worker1 # [ 0.004809] CPU features: detected: LSE atomic instructions606client # [ 0.004794] CPU features: detected: PMUv3607lb # [ 0.015478] NET: Registered PF_NETLINK/PF_ROUTE protocol family608worker1 # [ 0.004812] CPU features: detected: Privileged Access Never609client # [ 0.004797] CPU features: detected: RAS Extension Support610worker1 # [ 0.004814] CPU features: detected: PMUv3611lb # [ 0.017672] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations612client # [ 0.004799] CPU features: detected: RASv1p1 Extension Support613worker1 # [ 0.004817] CPU features: detected: RAS Extension Support614lb # [ 0.017846] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations615client # [ 0.004802] CPU features: detected: Random Number Generator616worker1 # [ 0.004820] CPU features: detected: RASv1p1 Extension Support617worker2 # [ 0.144124] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages618client # [ 0.004805] CPU features: detected: Speculation barrier (SB)619worker1 # [ 0.004822] CPU features: detected: Random Number Generator620lb # [ 0.018043] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations621worker2 # [ 0.144139] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page622client # [ 0.004808] CPU features: detected: Stage-2 Force Write-Back623worker1 # [ 0.004825] CPU features: detected: Speculation barrier (SB)624lb # [ 0.018064] audit: initializing netlink subsys (disabled)625worker2 # [ 0.144145] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages626client # [ 0.004811] CPU features: detected: TLB range maintenance instructions627worker1 # [ 0.004828] CPU features: detected: Stage-2 Force Write-Back628lb # [ 0.018625] thermal_sys: Registered thermal governor 'fair_share'629worker2 # [ 0.144150] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page630worker1 # [ 0.004831] CPU features: detected: TLB range maintenance instructions631client # [ 0.004815] CPU features: detected: Speculative Store Bypassing Safe (SSBS)632lb # [ 0.018627] thermal_sys: Registered thermal governor 'bang_bang'633lb # [ 0.018631] thermal_sys: Registered thermal governor 'step_wise'634worker2 # [ 0.144154] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages635client # [ 0.004898] alternatives: applying system-wide alternatives636worker1 # [ 0.004836] CPU features: detected: Speculative Store Bypassing Safe (SSBS)637worker1 # [ 0.004870] alternatives: applying system-wide alternatives638lb # [ 0.018635] thermal_sys: Registered thermal governor 'user_space'639worker2 # [ 0.144158] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page640client # [ 0.007712] CPU features: detected: BBM Level 2 without TLB conflict abort641lb # [ 0.018638] thermal_sys: Registered thermal governor 'power_allocator'642worker1 # [ 0.007714] CPU features: detected: BBM Level 2 without TLB conflict abort643worker2 # [ 0.144163] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages644worker2 # [ 0.144167] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page645client # [ 0.007868] Memory: 1406552K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)646lb # [ 0.018663] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1647client # [ 0.008265] devtmpfs: initialized648lb # [ 0.018671] cpuidle: using governor ladder649worker1 # [ 0.007904] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)650lb # [ 0.018677] cpuidle: using governor menu651worker1 # [ 0.008323] devtmpfs: initialized652client # [ 0.010196] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)653lb # [ 0.018870] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.654worker1 # [ 0.010010] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)655client # [ 0.010218] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).656worker2 # [ 0.151311] fbcon: Taking over console657lb # [ 0.018885] ASID allocator initialised with 65536 entries658worker2 # [ 0.151326] ACPI: Interpreter disabled.659client # [ 0.010405] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL660lb # [ 0.020084] Serial: AMBA PL011 UART driver661worker1 # [ 0.010031] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).662worker1 # [ 0.010207] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL663lb # [ 0.025241] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1664client # [ 0.010409] 0 pages in range for non-PLT usage665lb # [ 0.025363] printk: console [ttyAMA0] enabled666client # [ 0.010410] 508288 pages in range for PLT usage667worker1 # [ 0.010212] 0 pages in range for non-PLT usage668client # [ 0.010503] pinctrl core: initialized pinctrl subsystem669worker1 # [ 0.010213] 508288 pages in range for PLT usage670client # [ 0.011233] DMI not present or invalid.671lb # [ 0.146036] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages672worker1 # [ 0.010315] pinctrl core: initialized pinctrl subsystem673client # [ 0.014145] NET: Registered PF_NETLINK/PF_ROUTE protocol family674worker1 # [ 0.011005] DMI not present or invalid.675lb # [ 0.146052] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page676client # [ 0.016322] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations677worker1 # [ 0.014198] NET: Registered PF_NETLINK/PF_ROUTE protocol family678lb # [ 0.146058] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages679worker1 # [ 0.016358] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations680client # [ 0.016492] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations681lb # [ 0.146062] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page682worker1 # [ 0.016548] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations683lb # [ 0.146066] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages684client # [ 0.016685] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations685client # [ 0.016705] audit: initializing netlink subsys (disabled)686lb # [ 0.146071] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page687worker1 # [ 0.016741] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations688client # [ 0.017288] thermal_sys: Registered thermal governor 'fair_share'689worker1 # [ 0.016762] audit: initializing netlink subsys (disabled)690lb # [ 0.146075] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages691worker2 # [ 0.160294] iommu: Default domain type: Translated692client # [ 0.017290] thermal_sys: Registered thermal governor 'bang_bang'693lb # [ 0.146079] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page694worker1 # [ 0.017340] thermal_sys: Registered thermal governor 'fair_share'695worker2 # [ 0.160304] iommu: DMA domain TLB invalidation policy: strict mode696client # [ 0.017294] thermal_sys: Registered thermal governor 'step_wise'697worker1 # [ 0.017343] thermal_sys: Registered thermal governor 'bang_bang'698worker2 # [ 0.160655] SCSI subsystem initialized699client # [ 0.017299] thermal_sys: Registered thermal governor 'user_space'700worker1 # [ 0.017347] thermal_sys: Registered thermal governor 'step_wise'701client # [ 0.017302] thermal_sys: Registered thermal governor 'power_allocator'702worker1 # [ 0.017352] thermal_sys: Registered thermal governor 'user_space'703worker2 # [ 0.162570] usbcore: registered new interface driver usbfs704lb # [ 0.153285] fbcon: Taking over console705client # [ 0.017324] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1706worker2 # [ 0.162600] usbcore: registered new interface driver hub707worker1 # [ 0.017354] thermal_sys: Registered thermal governor 'power_allocator'708lb # [ 0.153299] ACPI: Interpreter disabled.709client # [ 0.017333] cpuidle: using governor ladder710worker2 # [ 0.162618] usbcore: registered new device driver usb711client # [ 0.017339] cpuidle: using governor menu712worker1 # [ 0.017376] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1713worker2 # [ 0.162891] pps_core: LinuxPPS API ver. 1 registered714worker1 # [ 0.017386] cpuidle: using governor ladder715client # [ 0.017525] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.716worker1 # [ 0.017392] cpuidle: using governor menu717worker2 # [ 0.162897] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>718client # [ 0.017539] ASID allocator initialised with 65536 entries719worker1 # [ 0.017568] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.720worker2 # [ 0.162907] PTP clock support registered721client # [ 0.018720] Serial: AMBA PL011 UART driver722worker2 # [ 0.162954] EDAC MC: Ver: 3.0.0723worker1 # [ 0.017583] ASID allocator initialised with 65536 entries724worker1 # [ 0.018742] Serial: AMBA PL011 UART driver725client # [ 0.023794] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1726worker2 # [ 0.167431] scmi_core: SCMI protocol bus registered727client # [ 0.023942] printk: console [ttyAMA0] enabled728worker1 # [ 0.023750] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1729worker2 # [ 0.168403] FPGA manager framework730lb # [ 0.159587] iommu: Default domain type: Translated731worker1 # [ 0.023911] printk: console [ttyAMA0] enabled732worker2 # [ 0.169337] vgaarb: loaded733lb # [ 0.159596] iommu: DMA domain TLB invalidation policy: strict mode734worker2 # [ 0.169943] clocksource: Switched to clocksource arch_sys_counter735lb # [ 0.161259] SCSI subsystem initialized736lb # [ 0.161943] usbcore: registered new interface driver usbfs737lb # [ 0.161975] usbcore: registered new interface driver hub738lb # [ 0.162000] usbcore: registered new device driver usb739lb # [ 0.162295] pps_core: LinuxPPS API ver. 1 registered740lb # [ 0.162301] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>741lb # [ 0.162319] PTP clock support registered742client # [ 0.139735] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages743lb # [ 0.162370] EDAC MC: Ver: 3.0.0744worker1 # [ 0.139724] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages745client # [ 0.139750] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page746lb # [ 0.166899] scmi_core: SCMI protocol bus registered747worker1 # [ 0.139740] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page748worker2 # [ 0.176442] VFS: Disk quotas dquot_6.6.0749client # [ 0.139755] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages750worker1 # [ 0.139745] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages751worker2 # [ 0.176481] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)752lb # [ 0.167851] FPGA manager framework753client # [ 0.139759] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page754worker1 # [ 0.139749] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page755lb # [ 0.168772] vgaarb: loaded756worker2 # [ 0.178078] netfs: FS-Cache loaded757client # [ 0.139764] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages758worker2 # [ 0.178197] pnp: PnP ACPI: disabled759worker1 # [ 0.139754] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages760lb # [ 0.169385] clocksource: Switched to clocksource arch_sys_counter761client # [ 0.139768] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page762worker1 # [ 0.139758] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page763client # [ 0.139772] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages764worker1 # [ 0.139762] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages765client # [ 0.139777] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page766worker1 # [ 0.139767] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page767client # [ 0.146953] fbcon: Taking over console768worker1 # [ 0.146980] fbcon: Taking over console769client # [ 0.146968] ACPI: Interpreter disabled.770worker1 # [ 0.146994] ACPI: Interpreter disabled.771lb # [ 0.173225] VFS: Disk quotas dquot_6.6.0772lb # [ 0.173262] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)773worker2 # [ 0.182045] NET: Registered PF_INET protocol family774lb # [ 0.176862] netfs: FS-Cache loaded775lb # [ 0.176986] pnp: PnP ACPI: disabled776worker2 # [ 0.182291] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)777lb # [ 0.180777] NET: Registered PF_INET protocol family778lb # [ 0.181045] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)779client # [ 0.155917] iommu: Default domain type: Translated780worker1 # [ 0.155962] iommu: Default domain type: Translated781client # [ 0.155926] iommu: DMA domain TLB invalidation policy: strict mode782worker1 # [ 0.155973] iommu: DMA domain TLB invalidation policy: strict mode783client # [ 0.156365] SCSI subsystem initialized784worker1 # [ 0.156280] SCSI subsystem initialized785client # [ 0.158312] usbcore: registered new interface driver usbfs786worker1 # [ 0.158229] usbcore: registered new interface driver usbfs787client # [ 0.158349] usbcore: registered new interface driver hub788worker1 # [ 0.158261] usbcore: registered new interface driver hub789client # [ 0.158367] usbcore: registered new device driver usb790worker1 # [ 0.158279] usbcore: registered new device driver usb791client # [ 0.158643] pps_core: LinuxPPS API ver. 1 registered792worker1 # [ 0.158561] pps_core: LinuxPPS API ver. 1 registered793client # [ 0.158649] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>794worker1 # [ 0.158567] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>795client # [ 0.158659] PTP clock support registered796worker1 # [ 0.158577] PTP clock support registered797client # [ 0.158711] EDAC MC: Ver: 3.0.0798worker1 # [ 0.158626] EDAC MC: Ver: 3.0.0799client # [ 0.163272] scmi_core: SCMI protocol bus registered800worker1 # [ 0.163272] scmi_core: SCMI protocol bus registered801client # [ 0.164244] FPGA manager framework802worker1 # [ 0.164202] FPGA manager framework803client # [ 0.165220] vgaarb: loaded804worker1 # [ 0.165126] vgaarb: loaded805client # [ 0.165833] clocksource: Switched to clocksource arch_sys_counter806worker1 # [ 0.165747] clocksource: Switched to clocksource arch_sys_counter807client # [ 0.169192] VFS: Disk quotas dquot_6.6.0808worker1 # [ 0.169616] VFS: Disk quotas dquot_6.6.0809client # [ 0.169227] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)810worker1 # [ 0.169657] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)811client # [ 0.172774] netfs: FS-Cache loaded812client # [ 0.172902] pnp: PnP ACPI: disabled813worker1 # [ 0.173179] netfs: FS-Cache loaded814worker1 # [ 0.173283] pnp: PnP ACPI: disabled815client # [ 0.176668] NET: Registered PF_INET protocol family816worker1 # [ 0.177144] NET: Registered PF_INET protocol family817client # [ 0.176934] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)818worker1 # [ 0.177408] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)819worker2 # [ 0.210312] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)820worker2 # [ 0.210351] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)821worker2 # [ 0.210377] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)822worker2 # [ 0.210450] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)823worker2 # [ 0.210594] TCP: Hash tables configured (established 16384 bind 16384)824worker2 # [ 0.210667] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)825worker2 # [ 0.210699] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)826worker2 # [ 0.210744] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)827worker2 # [ 0.210842] NET: Registered PF_UNIX/PF_LOCAL protocol family828worker2 # [ 0.210869] NET: Registered PF_XDP protocol family829worker2 # [ 0.210886] PCI: CLS 0 bytes, default 64830worker2 # [ 0.211109] Trying to unpack rootfs image as initramfs...831lb # [ 0.210016] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)832lb # [ 0.210058] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)833lb # [ 0.210086] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)834lb # [ 0.210161] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)835lb # [ 0.210305] TCP: Hash tables configured (established 16384 bind 16384)836lb # [ 0.210379] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)837lb # [ 0.210412] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)838lb # [ 0.210448] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)839worker2 # [ 0.227685] kvm [1]: HYP mode not available840lb # [ 0.210540] NET: Registered PF_UNIX/PF_LOCAL protocol family841lb # [ 0.210562] NET: Registered PF_XDP protocol family842lb # [ 0.210578] PCI: CLS 0 bytes, default 64843lb # [ 0.210827] Trying to unpack rootfs image as initramfs...844client # [ 0.205502] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)845client # [ 0.205546] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)846lb # [ 0.227109] kvm [1]: HYP mode not available847client # [ 0.205573] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)848client # [ 0.205643] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849client # [ 0.205787] TCP: Hash tables configured (established 16384 bind 16384)850worker1 # [ 0.205914] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)851worker1 # [ 0.205960] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)852worker1 # [ 0.205989] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)853worker1 # [ 0.206064] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)854worker1 # [ 0.206208] TCP: Hash tables configured (established 16384 bind 16384)855client # [ 0.210514] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)856worker1 # [ 0.206288] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)857client # [ 0.210552] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)858worker1 # [ 0.206322] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)859client # [ 0.210587] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)860client # [ 0.210676] NET: Registered PF_UNIX/PF_LOCAL protocol family861worker1 # [ 0.206358] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)862client # [ 0.210723] NET: Registered PF_XDP protocol family863worker1 # [ 0.206466] NET: Registered PF_UNIX/PF_LOCAL protocol family864client # [ 0.210743] PCI: CLS 0 bytes, default 64865worker1 # [ 0.206487] NET: Registered PF_XDP protocol family866client # [ 0.210962] Trying to unpack rootfs image as initramfs...867worker1 # [ 0.206503] PCI: CLS 0 bytes, default 64868worker1 # [ 0.206741] Trying to unpack rootfs image as initramfs...869client # [ 0.222826] kvm [1]: HYP mode not available870worker1 # [ 0.223477] kvm [1]: HYP mode not available871worker2 # [ 0.318489] Initialise system trusted keyrings872worker2 # [ 0.319237] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker2 # [ 0.320489] squashfs: version 4.0 (2009/01/31) Phillip Lougher874worker2 # [ 0.321252] 9p: Installing v9fs 9p2000 file system support875lb # [ 0.317924] Initialise system trusted keyrings876lb # [ 0.318653] workingset: timestamp_bits=42 max_order=19 bucket_order=0877lb # [ 0.319925] squashfs: version 4.0 (2009/01/31) Phillip Lougher878lb # [ 0.320697] 9p: Installing v9fs 9p2000 file system support879worker2 # [ 0.345185] Key type asymmetric registered880worker2 # [ 0.345215] Asymmetric key parser 'x509' registered881worker2 # [ 0.345293] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)882client # [ 0.314371] Initialise system trusted keyrings883worker1 # [ 0.314293] Initialise system trusted keyrings884lb # [ 0.341348] Key type asymmetric registered885client # [ 0.315102] workingset: timestamp_bits=42 max_order=19 bucket_order=0886worker1 # [ 0.315013] workingset: timestamp_bits=42 max_order=19 bucket_order=0887lb # [ 0.341373] Asymmetric key parser 'x509' registered888client # [ 0.316330] squashfs: version 4.0 (2009/01/31) Phillip Lougher889worker1 # [ 0.316250] squashfs: version 4.0 (2009/01/31) Phillip Lougher890client # [ 0.317096] 9p: Installing v9fs 9p2000 file system support891worker1 # [ 0.317015] 9p: Installing v9fs 9p2000 file system support892worker2 # [ 0.353999] io scheduler mq-deadline registered893worker2 # [ 0.354017] io scheduler kyber registered894lb # [ 0.349475] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)895lb # [ 0.350509] io scheduler mq-deadline registered896worker2 # [ 0.359175] pl061_gpio 9030000.pl061: PL061 GPIO chip registered897lb # [ 0.350519] io scheduler kyber registered898worker2 # [ 0.360476] ledtrig-cpu: registered to indicate activity on CPUs899worker2 # [ 0.360852] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:900worker2 # [ 0.360868] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000901worker2 # [ 0.360880] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000902worker2 # [ 0.360888] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000903worker2 # [ 0.360908] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits904lb # [ 0.361528] pl061_gpio 9030000.pl061: PL061 GPIO chip registered905worker2 # [ 0.360929] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]906client # [ 0.337626] Key type asymmetric registered907worker1 # [ 0.337584] Key type asymmetric registered908worker2 # [ 0.360999] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00909client # [ 0.337648] Asymmetric key parser 'x509' registered910worker1 # [ 0.337607] Asymmetric key parser 'x509' registered911worker2 # [ 0.361008] pci_bus 0000:00: root bus resource [bus 00-ff]912client # [ 0.337706] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)913worker1 # [ 0.337669] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)914worker2 # [ 0.361014] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]915lb # [ 0.362944] ledtrig-cpu: registered to indicate activity on CPUs916worker2 # [ 0.361019] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]917lb # [ 0.363320] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:918worker2 # [ 0.361024] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]919lb # [ 0.363337] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000920worker2 # [ 0.361080] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint921lb # [ 0.363350] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000922worker2 # [ 0.361519] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint923lb # [ 0.363358] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000924worker2 # [ 0.361703] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]925worker2 # [ 0.361720] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]926lb # [ 0.363390] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits927worker2 # [ 0.361749] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]928client # [ 0.345911] io scheduler mq-deadline registered929lb # [ 0.363416] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]930worker1 # [ 0.345818] io scheduler mq-deadline registered931worker2 # [ 0.361765] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]932client # [ 0.345928] io scheduler kyber registered933worker1 # [ 0.345835] io scheduler kyber registered934lb # [ 0.363491] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00935worker2 # [ 0.362240] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint936lb # [ 0.363501] pci_bus 0000:00: root bus resource [bus 00-ff]937worker2 # [ 0.362421] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]938lb # [ 0.363507] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]939worker2 # [ 0.362437] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]940lb # [ 0.363512] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]941worker2 # [ 0.362466] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]942lb # [ 0.363518] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]943worker2 # [ 0.362906] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint944lb # [ 0.363577] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint945worker2 # [ 0.363084] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]946worker1 # [ 0.350851] pl061_gpio 9030000.pl061: PL061 GPIO chip registered947worker2 # [ 0.363099] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]948lb # [ 0.364034] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint949lb # [ 0.364230] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]950worker2 # [ 0.363128] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]951lb # [ 0.364248] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]952worker2 # [ 0.363570] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint953lb # [ 0.364278] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]954worker2 # [ 0.363748] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]955client # [ 0.353967] pl061_gpio 9030000.pl061: PL061 GPIO chip registered956lb # [ 0.364295] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]957worker2 # [ 0.363763] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]958worker2 # [ 0.363795] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]959lb # [ 0.364760] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint960lb # [ 0.364948] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]961worker2 # [ 0.364263] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint962lb # [ 0.364963] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]963worker2 # [ 0.364442] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]964client # [ 0.355241] ledtrig-cpu: registered to indicate activity on CPUs965lb # [ 0.364994] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]966worker2 # [ 0.364458] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]967client # [ 0.355624] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:968worker2 # [ 0.364487] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]969lb # [ 0.384722] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint970client # [ 0.355641] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000971worker2 # [ 0.364926] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint972lb # [ 0.384910] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]973worker2 # [ 0.365106] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]974client # [ 0.355652] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000975lb # [ 0.384926] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]976worker2 # [ 0.365122] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]977lb # [ 0.384955] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]978client # [ 0.355660] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000979worker2 # [ 0.365151] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]980client # [ 0.355680] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits981worker2 # [ 0.365643] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint982worker2 # [ 0.365824] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]983lb # [ 0.388499] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint984client # [ 0.355702] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]985lb # [ 0.388686] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]986worker2 # [ 0.365839] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]987client # [ 0.355771] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00988lb # [ 0.388702] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]989worker2 # [ 0.365868] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]990client # [ 0.355780] pci_bus 0000:00: root bus resource [bus 00-ff]991lb # [ 0.388734] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]992worker2 # [ 0.365884] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]993worker1 # [ 0.357777] ledtrig-cpu: registered to indicate activity on CPUs994client # [ 0.355786] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]995lb # [ 0.389200] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint996client # [ 0.355791] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]997worker1 # [ 0.358200] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:998client # [ 0.355796] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]999worker1 # [ 0.358219] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001000client # [ 0.355886] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1001worker1 # [ 0.358238] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001002client # [ 0.356321] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1003worker1 # [ 0.358247] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001004client # [ 0.356506] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1005client # [ 0.356522] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1006worker1 # [ 0.358268] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1007client # [ 0.356551] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1008worker1 # [ 0.358290] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1009client # [ 0.356568] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1010worker1 # [ 0.358377] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001011client # [ 0.357038] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1012worker1 # [ 0.358386] pci_bus 0000:00: root bus resource [bus 00-ff]1013client # [ 0.357221] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1014worker1 # [ 0.358393] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1015client # [ 0.357237] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1016worker1 # [ 0.358398] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1017client # [ 0.357267] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1018worker1 # [ 0.358403] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1019client # [ 0.357712] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1020worker1 # [ 0.358474] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1021worker1 # [ 0.358910] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1022worker1 # [ 0.359099] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1023worker1 # [ 0.359115] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1024worker1 # [ 0.359145] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1025worker1 # [ 0.359161] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1026worker1 # [ 0.359613] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1027worker1 # [ 0.359799] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1028lb # [ 0.401399] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1029worker1 # [ 0.359815] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1030lb # [ 0.401440] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1031worker1 # [ 0.359844] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1032lb # [ 0.401471] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1033worker1 # [ 0.360300] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1034lb # [ 0.401944] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1035worker1 # [ 0.360484] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1036lb # [ 0.402131] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1037worker2 # [ 0.414423] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1038worker1 # [ 0.360499] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1039lb # [ 0.402147] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1040worker2 # [ 0.414630] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1041worker1 # [ 0.360528] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1042lb # [ 0.402177] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1043worker2 # [ 0.414661] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1044worker1 # [ 0.360985] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1045worker1 # [ 0.361168] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1046worker2 # [ 0.415118] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1047lb # [ 0.402631] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1048lb # [ 0.402823] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1049worker1 # [ 0.361183] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1050worker2 # [ 0.415306] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1051client # [ 0.381914] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1052client # [ 0.381937] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1053lb # [ 0.402839] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1054worker1 # [ 0.361216] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1055worker2 # [ 0.415335] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1056client # [ 0.381967] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1057lb # [ 0.402868] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1058worker1 # [ 0.361667] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1059worker2 # [ 0.415722] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1060lb # [ 0.402884] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1061worker1 # [ 0.361870] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1062client # [ 0.382429] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1063worker2 # [ 0.415904] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1064client # [ 0.382621] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1065worker1 # [ 0.361886] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1066lb # [ 0.403370] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1067worker2 # [ 0.416159] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1068client # [ 0.382637] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1069worker1 # [ 0.361916] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1070lb # [ 0.403557] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1071worker2 # [ 0.416433] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1072client # [ 0.382669] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1073lb # [ 0.403587] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1074worker1 # [ 0.362372] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1075worker2 # [ 0.416450] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1076worker1 # [ 0.362556] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1077client # [ 0.383128] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1078worker2 # [ 0.416480] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1079lb # [ 0.404044] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1080client # [ 0.383309] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1081worker1 # [ 0.362571] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1082lb # [ 0.404231] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1083worker2 # [ 0.416941] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1084client # [ 0.383324] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1085worker1 # [ 0.362600] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1086worker2 # [ 0.417125] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1087lb # [ 0.404261] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1088client # [ 0.383354] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1089worker1 # [ 0.363055] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1090worker2 # [ 0.417141] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1091lb # [ 0.404647] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1092worker1 # [ 0.363240] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1093client # [ 0.383810] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1094worker2 # [ 0.417170] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1095lb # [ 0.404831] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1096worker1 # [ 0.363255] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1097client # [ 0.383993] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1098worker2 # [ 0.417742] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1099client # [ 0.384009] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1100worker1 # [ 0.363285] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1101lb # [ 0.405074] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1102worker2 # [ 0.417753] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1103client # [ 0.384039] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1104worker1 # [ 0.363300] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1105lb # [ 0.405326] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1106lb # [ 0.405343] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1107worker2 # [ 0.417758] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1108client # [ 0.384490] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1109worker1 # [ 0.363789] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1110lb # [ 0.405372] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1111client # [ 0.384674] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1112worker2 # [ 0.417803] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1113worker1 # [ 0.363978] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1114client # [ 0.384689] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1115lb # [ 0.405854] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1116worker1 # [ 0.364008] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1117worker2 # [ 0.417850] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1118client # [ 0.384719] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1119lb # [ 0.406038] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1120worker1 # [ 0.364459] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1121worker2 # [ 0.417897] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1122lb # [ 0.406054] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1123client # [ 0.384735] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1124worker1 # [ 0.364650] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1125lb # [ 0.406083] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1126worker2 # [ 0.417989] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1127client # [ 0.385226] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1128worker1 # [ 0.364679] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1129client # [ 0.385418] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1130lb # [ 0.406664] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1131worker2 # [ 0.418055] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1132worker1 # [ 0.365072] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1133client # [ 0.385448] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1134lb # [ 0.406675] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1135worker2 # [ 0.418106] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1136worker1 # [ 0.365255] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1137client # [ 0.385913] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1138lb # [ 0.406681] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1139worker2 # [ 0.418153] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1140worker1 # [ 0.365496] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1141client # [ 0.386099] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1142lb # [ 0.406726] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1143worker2 # [ 0.418200] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1144client # [ 0.386128] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1145lb # [ 0.406773] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1146worker2 # [ 0.418246] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1147client # [ 0.386530] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1148lb # [ 0.406828] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1149worker2 # [ 0.418308] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1150client # [ 0.386712] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1151worker2 # [ 0.418354] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1152lb # [ 0.406876] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1153client # [ 0.386961] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1154worker2 # [ 0.418376] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1155client # [ 0.387229] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1156lb # [ 0.406923] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1157worker2 # [ 0.418398] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1158client # [ 0.387247] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1159lb # [ 0.406969] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1160worker2 # [ 0.418419] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1161client # [ 0.387277] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1162lb # [ 0.407016] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1163worker2 # [ 0.418443] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1164client # [ 0.387733] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1165lb # [ 0.407062] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1166worker2 # [ 0.418465] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1167client # [ 0.387916] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1168client # [ 0.387932] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1169worker2 # [ 0.418487] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1170lb # [ 0.407109] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1171client # [ 0.387962] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1172worker2 # [ 0.418509] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1173lb # [ 0.407182] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1174client # [ 0.388519] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1175worker2 # [ 0.418531] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1176lb # [ 0.407228] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1177worker1 # [ 0.413824] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1178client # [ 0.388531] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1179worker2 # [ 0.418553] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1180lb # [ 0.407250] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1181worker1 # [ 0.413848] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1182worker2 # [ 0.418575] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1183client # [ 0.388537] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1184lb # [ 0.407271] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1185worker1 # [ 0.413877] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1186worker2 # [ 0.418598] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1187client # [ 0.388580] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1188lb # [ 0.407293] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1189worker1 # [ 0.414348] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1190worker2 # [ 0.418619] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1191lb # [ 0.407317] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1192client # [ 0.388626] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1193worker1 # [ 0.414535] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1194worker2 # [ 0.418644] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1195lb # [ 0.407339] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1196worker1 # [ 0.414551] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1197worker2 # [ 0.418667] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1198client # [ 0.388672] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1199lb # [ 0.407361] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1200worker1 # [ 0.414581] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1201worker2 # [ 0.418690] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1202client # [ 0.388718] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1203lb # [ 0.407383] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1204worker1 # [ 0.415146] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1205worker2 # [ 0.418712] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1206client # [ 0.388765] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1207lb # [ 0.407405] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1208worker2 # [ 0.418735] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1209worker1 # [ 0.415158] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1210client # [ 0.388812] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1211worker2 # [ 0.418757] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1212lb # [ 0.407427] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1213worker1 # [ 0.415164] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1214worker2 # [ 0.418780] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1215lb # [ 0.407450] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1216client # [ 0.388865] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1217worker1 # [ 0.415209] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1218worker2 # [ 0.418802] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1219lb # [ 0.407473] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1220client # [ 0.388912] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1221worker2 # [ 0.418828] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1222worker1 # [ 0.415255] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1223lb # [ 0.407494] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1224worker2 # [ 0.418838] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1225client # [ 0.388959] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1226lb # [ 0.407516] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1227worker1 # [ 0.415303] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1228worker2 # [ 0.418843] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1229client # [ 0.389018] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1230lb # [ 0.407537] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1231worker1 # [ 0.415350] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1232worker2 # [ 0.420015] pci 0000:00:0a.0: enabling device (0000 -> 0002)1233client # [ 0.389064] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1234lb # [ 0.407559] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1235worker1 # [ 0.415396] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1236lb # [ 0.407580] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1237client # [ 0.389086] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1238lb # [ 0.407602] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1239worker1 # [ 0.415444] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1240client # [ 0.389107] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1241lb # [ 0.407624] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1242client # [ 0.389129] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1243worker1 # [ 0.415491] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1244lb # [ 0.407645] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1245client # [ 0.389153] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1246worker1 # [ 0.415538] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1247lb # [ 0.407667] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1248client # [ 0.389175] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1249worker1 # [ 0.415585] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1250lb # [ 0.407694] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1251client # [ 0.389197] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1252lb # [ 0.407704] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1253worker1 # [ 0.415670] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1254client # [ 0.389219] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1255lb # [ 0.407709] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1256worker1 # [ 0.415718] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1257client # [ 0.389241] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1258lb # [ 0.408872] pci 0000:00:0a.0: enabling device (0000 -> 0002)1259worker1 # [ 0.415739] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1260client # [ 0.389264] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1261worker1 # [ 0.415760] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1262client # [ 0.389286] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1263worker1 # [ 0.415782] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1264client # [ 0.389309] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1265worker1 # [ 0.415806] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1266client # [ 0.389330] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1267worker1 # [ 0.415828] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1268client # [ 0.389352] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1269client # [ 0.389373] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1270worker1 # [ 0.415850] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1271client # [ 0.389395] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1272worker1 # [ 0.415871] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1273client # [ 0.389417] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1274worker1 # [ 0.415893] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1275client # [ 0.389439] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1276worker1 # [ 0.415915] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1277client # [ 0.389461] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1278worker1 # [ 0.415938] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1279client # [ 0.389483] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1280worker1 # [ 0.415960] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1281client # [ 0.389505] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1282worker1 # [ 0.415981] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1283client # [ 0.389531] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1284worker1 # [ 0.416002] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1285client # [ 0.389540] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1286worker1 # [ 0.416024] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1287client # [ 0.389545] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1288worker1 # [ 0.416045] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1289worker1 # [ 0.416067] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1290worker1 # [ 0.416088] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1291worker1 # [ 0.416109] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1292worker1 # [ 0.416131] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1293worker1 # [ 0.416153] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1294worker1 # [ 0.416179] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1295worker1 # [ 0.416188] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1296worker1 # [ 0.416193] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1297worker1 # [ 0.417350] pci 0000:00:0a.0: enabling device (0000 -> 0002)1298worker2 # [ 0.487381] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1299worker2 # [ 0.489721] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1300client # [ 0.454777] pci 0000:00:0a.0: enabling device (0000 -> 0002)1301lb # [ 0.484821] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1302worker1 # [ 0.461876] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 43486 usecs1303worker2 # [ 0.500557] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1304worker2 # [ 0.503391] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1305lb # [ 0.494726] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1306worker2 # [ 0.505325] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1307client # [ 0.475108] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1308client # [ 0.477349] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1309lb # [ 0.498954] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1310lb # [ 0.500888] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1311lb # [ 0.502930] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1312lb # [ 0.505052] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1313worker2 # [ 0.515357] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1314worker2 # [ 0.517461] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1315worker1 # [ 0.482126] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1316worker1 # [ 0.484363] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1317client # [ 0.488327] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1318worker2 # [ 0.528961] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1319worker1 # [ 0.494303] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1320worker1 # [ 0.496451] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1321worker2 # [ 0.531901] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1322lb # [ 0.522896] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1323worker2 # [ 0.533658] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1324lb # [ 0.525009] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1325lb # [ 0.528715] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1326client # [ 0.498033] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1327client # [ 0.501963] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1328client # [ 0.503939] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1329worker2 # [ 0.543431] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1330lb # [ 0.537242] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1331worker1 # [ 0.506467] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1332worker1 # [ 0.509033] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1333worker1 # [ 0.511029] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1334worker1 # [ 0.513147] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1335client # [ 0.513988] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1336client # [ 0.516733] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1337worker2 # [ 0.558112] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1338lb # [ 0.546791] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1339worker2 # [ 0.560628] msm_serial: driver initialized1340worker1 # [ 0.523452] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1341worker2 # [ 0.560813] SuperH (H)SCI(F) driver initialized1342worker2 # [ 0.560868] STM32 USART driver initialized1343worker1 # [ 0.525432] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1344client # [ 0.526986] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1345client # [ 0.528967] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1346lb # [ 0.560500] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1347worker1 # [ 0.536827] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1348lb # [ 0.563072] msm_serial: driver initialized1349lb # [ 0.563258] SuperH (H)SCI(F) driver initialized1350lb # [ 0.563315] STM32 USART driver initialized1351client # [ 0.540603] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1352client # [ 0.551036] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1353worker1 # [ 0.550919] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1354client # [ 0.553584] msm_serial: driver initialized1355worker1 # [ 0.553386] msm_serial: driver initialized1356client # [ 0.553729] SuperH (H)SCI(F) driver initialized1357worker1 # [ 0.553522] SuperH (H)SCI(F) driver initialized1358worker2 # [ 0.588732] loop: module loaded1359client # [ 0.553783] STM32 USART driver initialized1360worker1 # [ 0.553575] STM32 USART driver initialized1361worker2 # [ 0.588908] virtio_blk virtio5: 1/0/0 default/read/poll queues1362worker2 # [ 0.589605] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1363lb # [ 0.597635] loop: module loaded1364lb # [ 0.597816] virtio_blk virtio5: 1/0/0 default/read/poll queues1365worker2 # [ 0.602510] megasas: 07.734.00.00-rc11366lb # [ 0.598572] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1367worker2 # [ 0.603244] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1368worker2 # [ 0.605527] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001369worker2 # [ 0.605554] Intel/Sharp Extended Query Table at 0x00311370worker2 # [ 0.606998] Using buffer write method1371worker2 # [ 0.607067] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1372worker2 # [ 0.608712] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001373worker2 # [ 0.608745] Intel/Sharp Extended Query Table at 0x00311374lb # [ 0.605966] megasas: 07.734.00.00-rc11375lb # [ 0.606665] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1376lb # [ 0.608857] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001377worker1 # [ 0.584461] loop: module loaded1378client # [ 0.584763] loop: module loaded1379lb # [ 0.608882] Intel/Sharp Extended Query Table at 0x00311380worker1 # [ 0.584640] virtio_blk virtio5: 1/0/0 default/read/poll queues1381client # [ 0.584975] virtio_blk virtio5: 1/0/0 default/read/poll queues1382worker1 # [ 0.585331] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1383client # [ 0.585708] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1384lb # [ 0.613649] Using buffer write method1385worker2 # [ 0.626489] Using buffer write method1386worker2 # [ 0.626522] Concatenating MTD devices:1387worker2 # [ 0.626526] (0): "0.flash"1388lb # [ 0.613728] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1389worker2 # [ 0.626531] (1): "0.flash"1390worker2 # [ 0.626534] into device "0.flash"1391worker1 # [ 0.590279] megasas: 07.734.00.00-rc11392client # [ 0.590370] megasas: 07.734.00.00-rc11393lb # [ 0.615428] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001394lb # [ 0.615458] Intel/Sharp Extended Query Table at 0x00311395worker1 # [ 0.590942] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1396client # [ 0.591049] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1397lb # [ 0.617022] Using buffer write method1398lb # [ 0.617047] Concatenating MTD devices:1399lb # [ 0.617052] (0): "0.flash"1400lb # [ 0.617055] (1): "0.flash"1401lb # [ 0.617059] into device "0.flash"1402client # [ 0.601868] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001403client # [ 0.601908] Intel/Sharp Extended Query Table at 0x00311404worker1 # [ 0.602362] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001405client # [ 0.604519] Using buffer write method1406worker1 # [ 0.602410] Intel/Sharp Extended Query Table at 0x00311407worker1 # [ 0.604098] Using buffer write method1408client # [ 0.604578] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1409worker1 # [ 0.604174] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1410client # [ 0.614400] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001411client # [ 0.614424] Intel/Sharp Extended Query Table at 0x00311412client # [ 0.617082] Using buffer write method1413client # [ 0.617106] Concatenating MTD devices:1414client # [ 0.617110] (0): "0.flash"1415client # [ 0.617114] (1): "0.flash"1416client # [ 0.617117] into device "0.flash"1417worker1 # [ 0.619391] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001418worker1 # [ 0.619418] Intel/Sharp Extended Query Table at 0x00311419worker1 # [ 0.620943] Using buffer write method1420worker1 # [ 0.620968] Concatenating MTD devices:1421worker1 # [ 0.620972] (0): "0.flash"1422worker1 # [ 0.620976] (1): "0.flash"1423worker1 # [ 0.620980] into device "0.flash"1424worker2 # [ 0.848547] Freeing initrd memory: 26148K1425worker2 # [ 0.854635] tun: Universal TUN/TAP device driver, 1.61426lb # [ 0.849764] Freeing initrd memory: 26140K1427worker2 # [ 0.858328] thunder_xcv, ver 1.01428worker2 # [ 0.858366] thunder_bgx, ver 1.01429worker2 # [ 0.858388] nicpf, ver 1.01430worker2 # [ 0.858945] e1000: Intel(R) PRO/1000 Network Driver1431worker2 # [ 0.858952] e1000: Copyright (c) 1999-2006 Intel Corporation.1432worker2 # [ 0.858977] e1000e: Intel(R) PRO/1000 Network Driver1433lb # [ 0.855686] tun: Universal TUN/TAP device driver, 1.61434worker2 # [ 0.858985] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1435worker2 # [ 0.859013] igb: Intel(R) Gigabit Ethernet Network Driver1436worker2 # [ 0.859019] igb: Copyright (c) 2007-2014 Intel Corporation.1437worker2 # [ 0.859043] igbvf: Intel(R) Gigabit Virtual Function Network Driver1438client # [ 0.832212] Freeing initrd memory: 26160K1439worker2 # [ 0.859049] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1440worker2 # [ 0.859185] sky2: driver version 1.301441worker2 # [ 0.860798] usbcore: registered new interface driver usb-storage1442worker2 # [ 0.860912] usbcore: registered new interface driver usbserial_generic1443lb # [ 0.859389] thunder_xcv, ver 1.01444worker2 # [ 0.860927] usbserial: USB Serial support registered for generic1445lb # [ 0.859435] thunder_bgx, ver 1.01446lb # [ 0.859458] nicpf, ver 1.01447worker2 # [ 0.861525] hv_vmbus: registering driver hyperv_keyboard1448lb # [ 0.860015] e1000: Intel(R) PRO/1000 Network Driver1449lb # [ 0.860023] e1000: Copyright (c) 1999-2006 Intel Corporation.1450lb # [ 0.860048] e1000e: Intel(R) PRO/1000 Network Driver1451client # [ 0.838062] tun: Universal TUN/TAP device driver, 1.61452worker2 # [ 0.872939] ehci-pci 0000:00:0a.0: EHCI Host Controller1453lb # [ 0.860057] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1454worker2 # [ 0.872969] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11455lb # [ 0.860087] igb: Intel(R) Gigabit Ethernet Network Driver1456worker2 # [ 0.873286] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001457lb # [ 0.860093] igb: Copyright (c) 2007-2014 Intel Corporation.1458lb # [ 0.860118] igbvf: Intel(R) Gigabit Virtual Function Network Driver1459lb # [ 0.860123] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1460client # [ 0.841593] thunder_xcv, ver 1.01461lb # [ 0.860262] sky2: driver version 1.301462worker2 # [ 0.875906] rtc-pl031 9010000.pl031: registered as rtc01463client # [ 0.841638] thunder_bgx, ver 1.01464client # [ 0.841660] nicpf, ver 1.01465worker2 # [ 0.875935] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:08 UTC (1789895048)1466lb # [ 0.868952] usbcore: registered new interface driver usb-storage1467worker2 # [ 0.876346] i2c_dev: i2c /dev entries driver1468lb # [ 0.869040] usbcore: registered new interface driver usbserial_generic1469worker1 # [ 0.842013] Freeing initrd memory: 26148K1470lb # [ 0.869058] usbserial: USB Serial support registered for generic1471client # [ 0.843367] e1000: Intel(R) PRO/1000 Network Driver1472client # [ 0.843379] e1000: Copyright (c) 1999-2006 Intel Corporation.1473lb # [ 0.872273] ehci-pci 0000:00:0a.0: EHCI Host Controller1474worker2 # [ 0.881407] sdhci: Secure Digital Host Controller Interface driver1475client # [ 0.843405] e1000e: Intel(R) PRO/1000 Network Driver1476worker2 # [ 0.881417] sdhci: Copyright(c) Pierre Ossman1477lb # [ 0.872306] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11478client # [ 0.843414] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1479worker2 # [ 0.881686] Synopsys Designware Multimedia Card Interface Driver1480worker1 # [ 0.847823] tun: Universal TUN/TAP device driver, 1.61481lb # [ 0.872504] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001482client # [ 0.843446] igb: Intel(R) Gigabit Ethernet Network Driver1483worker2 # [ 0.883879] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001484client # [ 0.843452] igb: Copyright (c) 2007-2014 Intel Corporation.1485worker2 # [ 0.884889] hub 1-0:1.0: USB hub found1486lb # [ 0.875079] hv_vmbus: registering driver hyperv_keyboard1487client # [ 0.843476] igbvf: Intel(R) Gigabit Virtual Function Network Driver1488worker2 # [ 0.885367] hub 1-0:1.0: 6 ports detected1489client # [ 0.843481] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1490client # [ 0.843617] sky2: driver version 1.301491lb # [ 0.876557] rtc-pl031 9010000.pl031: registered as rtc01492client # [ 0.845250] usbcore: registered new interface driver usb-storage1493client # [ 0.845364] usbcore: registered new interface driver usbserial_generic1494lb # [ 0.876582] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:08 UTC (1789895048)1495lb # [ 0.876869] i2c_dev: i2c /dev entries driver1496client # [ 0.845378] usbserial: USB Serial support registered for generic1497worker1 # [ 0.851286] thunder_xcv, ver 1.01498worker2 # [ 0.886398] sdhci-pltfm: SDHCI platform and OF driver helper1499worker1 # [ 0.851325] thunder_bgx, ver 1.01500worker1 # [ 0.851346] nicpf, ver 1.01501worker2 # [ 0.888108] hid: raw HID events driver (C) Jiri Kosina1502worker1 # [ 0.851889] e1000: Intel(R) PRO/1000 Network Driver1503worker2 # [ 0.888353] usbcore: registered new interface driver usbhid1504client # [ 0.854012] hv_vmbus: registering driver hyperv_keyboard1505worker1 # [ 0.851896] e1000: Copyright (c) 1999-2006 Intel Corporation.1506worker2 # [ 0.888359] usbhid: USB HID core driver1507client # [ 0.855313] ehci-pci 0000:00:0a.0: EHCI Host Controller1508worker1 # [ 0.851919] e1000e: Intel(R) PRO/1000 Network Driver1509client # [ 0.855338] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11510worker1 # [ 0.851927] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1511worker1 # [ 0.851953] igb: Intel(R) Gigabit Ethernet Network Driver1512client # [ 0.855577] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001513worker1 # [ 0.851959] igb: Copyright (c) 2007-2014 Intel Corporation.1514worker2 # [ 0.891979] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1515worker1 # [ 0.851979] igbvf: Intel(R) Gigabit Virtual Function Network Driver1516lb # [ 0.881792] sdhci: Secure Digital Host Controller Interface driver1517worker2 # [ 0.893503] drop_monitor: Initializing network drop monitor service1518client # [ 0.858770] rtc-pl031 9010000.pl031: registered as rtc01519worker1 # [ 0.851985] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1520lb # [ 0.881801] sdhci: Copyright(c) Pierre Ossman1521worker2 # [ 0.893639] NET: Registered PF_INET6 protocol family1522worker1 # [ 0.852120] sky2: driver version 1.301523lb # [ 0.882065] Synopsys Designware Multimedia Card Interface Driver1524client # [ 0.858797] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:08 UTC (1789895048)1525worker1 # [ 0.853726] usbcore: registered new interface driver usb-storage1526client # [ 0.859112] i2c_dev: i2c /dev entries driver1527worker2 # [ 0.896675] Segment Routing with IPv61528lb # [ 0.882449] sdhci-pltfm: SDHCI platform and OF driver helper1529worker2 # [ 0.896706] In-situ OAM (IOAM) with IPv61530lb # [ 0.884107] hid: raw HID events driver (C) Jiri Kosina1531worker2 # [ 0.896736] NET: Registered PF_PACKET protocol family1532worker1 # [ 0.862088] ehci-pci 0000:00:0a.0: EHCI Host Controller1533lb # [ 0.884363] usbcore: registered new interface driver usbhid1534lb # [ 0.884370] usbhid: USB HID core driver1535worker1 # [ 0.862115] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11536lb # [ 0.889872] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001537worker1 # [ 0.862336] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001538lb # [ 0.890901] hub 1-0:1.0: USB hub found1539lb # [ 0.891392] hub 1-0:1.0: 6 ports detected1540client # [ 0.863861] sdhci: Secure Digital Host Controller Interface driver1541worker1 # [ 0.864702] usbcore: registered new interface driver usbserial_generic1542client # [ 0.863876] sdhci: Copyright(c) Pierre Ossman1543worker2 # [ 0.898427] 9pnet: Installing 9P2000 support1544worker1 # [ 0.864722] usbserial: USB Serial support registered for generic1545worker2 # [ 0.900524] Key type dns_resolver registered1546client # [ 0.864136] Synopsys Designware Multimedia Card Interface Driver1547worker1 # [ 0.865345] hv_vmbus: registering driver hyperv_keyboard1548client # [ 0.864496] sdhci-pltfm: SDHCI platform and OF driver helper1549lb # [ 0.892321] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1550client # [ 0.868466] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001551client # [ 0.869478] hub 1-0:1.0: USB hub found1552lb # [ 0.894921] drop_monitor: Initializing network drop monitor service1553worker1 # [ 0.868275] rtc-pl031 9010000.pl031: registered as rtc01554lb # [ 0.895087] NET: Registered PF_INET6 protocol family1555client # [ 0.870017] hub 1-0:1.0: 6 ports detected1556worker1 # [ 0.868302] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:04:08 UTC (1789895048)1557lb # [ 0.896956] Segment Routing with IPv61558worker1 # [ 0.868603] i2c_dev: i2c /dev entries driver1559lb # [ 0.896986] In-situ OAM (IOAM) with IPv61560lb # [ 0.897015] NET: Registered PF_PACKET protocol family1561client # [ 0.871180] hid: raw HID events driver (C) Jiri Kosina1562client # [ 0.871432] usbcore: registered new interface driver usbhid1563client # [ 0.871438] usbhid: USB HID core driver1564worker1 # [ 0.873427] sdhci: Secure Digital Host Controller Interface driver1565worker2 # [ 0.907529] registered taskstats version 11566worker1 # [ 0.873438] sdhci: Copyright(c) Pierre Ossman1567lb # [ 0.898657] 9pnet: Installing 9P2000 support1568worker2 # [ 0.907670] Loading compiled-in X.509 certificates1569lb # [ 0.900727] Key type dns_resolver registered1570worker1 # [ 0.873704] Synopsys Designware Multimedia Card Interface Driver1571client # [ 0.874321] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1572worker1 # [ 0.873784] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001573worker1 # [ 0.874083] hub 1-0:1.0: USB hub found1574client # [ 0.875818] drop_monitor: Initializing network drop monitor service1575worker1 # [ 0.874103] hub 1-0:1.0: 6 ports detected1576client # [ 0.875982] NET: Registered PF_INET6 protocol family1577client # [ 0.878921] Segment Routing with IPv61578client # [ 0.878940] In-situ OAM (IOAM) with IPv61579client # [ 0.878969] NET: Registered PF_PACKET protocol family1580worker2 # [ 0.916468] Demotion targets for Node 0: null1581worker1 # [ 0.878409] sdhci-pltfm: SDHCI platform and OF driver helper1582client # [ 0.880581] 9pnet: Installing 9P2000 support1583worker2 # [ 0.916577] Key type .fscrypt registered1584worker1 # [ 0.880039] hid: raw HID events driver (C) Jiri Kosina1585worker2 # [ 0.916584] Key type fscrypt-provisioning registered1586worker1 # [ 0.880291] usbcore: registered new interface driver usbhid1587lb # [ 0.907556] registered taskstats version 11588worker2 # [ 0.916672] ima: No TPM chip found, activating TPM-bypass!1589worker1 # [ 0.880297] usbhid: USB HID core driver1590worker2 # [ 0.916691] ima: Allocated hash algorithm: sha11591lb # [ 0.907705] Loading compiled-in X.509 certificates1592worker2 # [ 0.916713] ima: No architecture policies found1593worker2 # [ 0.920671] input: gpio-keys as /devices/platform/gpio-keys/input/input01594client # [ 0.883133] Key type dns_resolver registered1595worker1 # [ 0.883837] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1596worker1 # [ 0.885347] drop_monitor: Initializing network drop monitor service1597worker1 # [ 0.885480] NET: Registered PF_INET6 protocol family1598worker1 # [ 0.888563] Segment Routing with IPv61599worker1 # [ 0.888582] In-situ OAM (IOAM) with IPv61600client # [ 0.889452] registered taskstats version 11601worker1 # [ 0.888613] NET: Registered PF_PACKET protocol family1602client # [ 0.889600] Loading compiled-in X.509 certificates1603lb # [ 0.916382] Demotion targets for Node 0: null1604lb # [ 0.916485] Key type .fscrypt registered1605lb # [ 0.916492] Key type fscrypt-provisioning registered1606lb # [ 0.916585] ima: No TPM chip found, activating TPM-bypass!1607lb # [ 0.916604] ima: Allocated hash algorithm: sha11608lb # [ 0.916623] ima: No architecture policies found1609worker1 # [ 0.890297] 9pnet: Installing 9P2000 support1610worker1 # [ 0.892373] Key type dns_resolver registered1611lb # [ 0.920591] input: gpio-keys as /devices/platform/gpio-keys/input/input01612client # [ 0.898243] Demotion targets for Node 0: null1613client # [ 0.898350] Key type .fscrypt registered1614client # [ 0.898356] Key type fscrypt-provisioning registered1615client # [ 0.898446] ima: No TPM chip found, activating TPM-bypass!1616client # [ 0.898465] ima: Allocated hash algorithm: sha11617client # [ 0.898487] ima: No architecture policies found1618worker1 # [ 0.899098] registered taskstats version 11619client # [ 0.902553] input: gpio-keys as /devices/platform/gpio-keys/input/input01620worker1 # [ 0.899255] Loading compiled-in X.509 certificates1621worker2 # [ 0.938716] clk: Disabling unused clocks1622worker2 # [ 0.938739] PM: genpd: Disabling unused power domains1623worker2 # [ 0.942941] Freeing unused kernel memory: 4736K1624worker2 # [ 0.943133] Run /init as init process1625worker1 # [ 0.907949] Demotion targets for Node 0: null1626worker1 # [ 0.908048] Key type .fscrypt registered1627worker1 # [ 0.908054] Key type fscrypt-provisioning registered1628worker1 # [ 0.908142] ima: No TPM chip found, activating TPM-bypass!1629worker1 # [ 0.908161] ima: Allocated hash algorithm: sha11630worker1 # [ 0.908183] ima: No architecture policies found1631worker1 # [ 0.912207] input: gpio-keys as /devices/platform/gpio-keys/input/input01632lb # [ 0.938402] clk: Disabling unused clocks1633lb # [ 0.938423] PM: genpd: Disabling unused power domains1634lb # [ 0.942620] Freeing unused kernel memory: 4736K1635lb # [ 0.942807] Run /init as init process1636client # [ 0.919366] clk: Disabling unused clocks1637client # [ 0.919388] PM: genpd: Disabling unused power domains1638client # [ 0.923569] Freeing unused kernel memory: 4736K1639client # [ 0.923771] Run /init as init process1640worker2 # [ 0.960160] systemd[1]: Successfully made /usr/ read-only.1641worker1 # [ 0.929276] clk: Disabling unused clocks1642worker1 # [ 0.929298] PM: genpd: Disabling unused power domains1643lb # [ 0.959603] systemd[1]: Successfully made /usr/ read-only.1644worker1 # [ 0.933451] Freeing unused kernel memory: 4736K1645worker1 # [ 0.933640] Run /init as init process1646client # [ 0.939980] systemd[1]: Successfully made /usr/ read-only.1647worker1 # [ 0.947839] systemd[1]: Successfully made /usr/ read-only.1648worker2 # [ 1.134013] usb 1-1: new high-speed USB device number 2 using ehci-pci1649lb # [ 1.137459] usb 1-1: new high-speed USB device number 2 using ehci-pci1650client # [ 1.121913] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker1 # [ 1.125826] usb 1-1: new high-speed USB device number 2 using ehci-pci1652worker2 # [ 1.286168] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653lb # [ 1.289641] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11654worker2 # [ 1.294871] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1655worker2 # [ 1.307089] systemd[1]: Detected virtualization qemu.1656worker2 # [ 1.309141] systemd[1]: Detected architecture arm64.1657worker2 # [ 1.311098] systemd[1]: Running in initrd.1658client # [ 1.274087] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659worker2 # [ 1.313625] systemd[1]: Initializing machine ID from random generator.1660lb # [ 1.295619] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1661worker2 # [ 1.316580] systemd[1]: Hostname set to <worker2>.1662worker1 # [ 1.278055] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11663lb # [ 1.307812] systemd[1]: Detected virtualization qemu.1664lb # [ 1.307899] systemd[1]: Detected architecture arm64.1665lb # [ 1.307924] systemd[1]: Running in initrd.1666lb # [ 1.308744] systemd[1]: Initializing machine ID from random generator.1667client # [ 1.279986] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1668lb # [ 1.308989] systemd[1]: Hostname set to <lb>.1669client # [ 1.291559] systemd[1]: Detected virtualization qemu.1670worker1 # [ 1.283631] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1671client # [ 1.291638] systemd[1]: Detected architecture arm64.1672worker1 # [ 1.283684] systemd[1]: Detected virtualization qemu.1673client # [ 1.291661] systemd[1]: Running in initrd.1674worker1 # [ 1.283747] systemd[1]: Detected architecture arm64.1675client # [ 1.292496] systemd[1]: Initializing machine ID from random generator.1676worker1 # [ 1.283769] systemd[1]: Running in initrd.1677client # [ 1.292756] systemd[1]: Hostname set to <client>.1678worker1 # [ 1.284596] systemd[1]: Initializing machine ID from random generator.1679worker1 # [ 1.304367] systemd[1]: Hostname set to <worker1>.1680worker2 # [ 1.378188] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681lb # [ 1.373612] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682client # [ 1.358056] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker1 # [ 1.357968] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01684worker2 # [ 1.498034] usb 1-2: new high-speed USB device number 3 using ehci-pci1685lb # [ 1.493465] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker1 # [ 1.477818] usb 1-2: new high-speed USB device number 3 using ehci-pci1687client # [ 1.477882] usb 1-2: new high-speed USB device number 3 using ehci-pci1688worker2 # [ 1.607060] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689lb # [ 1.611150] systemd[1]: bpf-restrict-fs: LSM BPF program attached1690client # [ 1.595773] systemd[1]: bpf-restrict-fs: LSM BPF program attached1691worker1 # [ 1.605831] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692lb # [ 1.648653] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21693worker2 # [ 1.661092] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21694lb # [ 1.653376] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01695worker2 # [ 1.665182] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01696client # [ 1.633172] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21697client # [ 1.637905] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01698worker1 # [ 1.637393] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21699worker1 # [ 1.642590] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01700worker2 # [ 1.718789] systemd[1]: Queued start job for default target Initrd Default Target.1701worker2 # [ 1.728467] systemd[1]: Created slice Slice /system/modprobe.1702worker2 # [ 1.729829] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1703worker2 # [ 1.731383] systemd[1]: Expecting device /dev/disk/by-label/nixos...1704worker2 # [ 1.732539] systemd[1]: Reached target Path Units.1705worker2 # [ 1.733425] systemd[1]: Reached target Slice Units.1706worker2 # [ 1.734379] systemd[1]: Reached target Swaps.1707worker2 # [ 1.735193] systemd[1]: Reached target Timer Units.1708lb # [ 1.725625] systemd[1]: Queued start job for default target Initrd Default Target.1709worker2 # [ 1.736293] systemd[1]: Listening on D-Bus System Message Bus Socket.1710worker2 # [ 1.737624] systemd[1]: Listening on Journal Socket (/dev/log).1711worker2 # [ 1.738954] systemd[1]: Listening on Journal Sockets.1712worker2 # [ 1.739109] systemd[1]: Listening on udev Control Socket.1713worker2 # [ 1.739230] systemd[1]: Listening on udev Kernel Socket.1714worker2 # [ 1.739254] systemd[1]: Reached target Socket Units.1715worker2 # [ 1.744576] systemd[1]: Starting Create List of Static Device Nodes...1716lb # [ 1.735772] systemd[1]: Created slice Slice /system/modprobe.1717client # [ 1.709829] systemd[1]: Queued start job for default target Initrd Default Target.1718lb # [ 1.737010] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1719lb # [ 1.738466] systemd[1]: Expecting device /dev/disk/by-label/nixos...1720lb # [ 1.739560] systemd[1]: Reached target Path Units.1721lb # [ 1.740395] systemd[1]: Reached target Slice Units.1722lb # [ 1.741247] systemd[1]: Reached target Swaps.1723lb # [ 1.742167] systemd[1]: Reached target Timer Units.1724worker2 # [ 1.751634] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1725lb # [ 1.743233] systemd[1]: Listening on D-Bus System Message Bus Socket.1726worker2 # [ 1.752869] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1727lb # [ 1.744513] systemd[1]: Listening on Journal Socket (/dev/log).1728lb # [ 1.745733] systemd[1]: Listening on Journal Sockets.1729client # [ 1.720299] systemd[1]: Created slice Slice /system/modprobe.1730lb # [ 1.746764] systemd[1]: Listening on udev Control Socket.1731worker1 # [ 1.720638] systemd[1]: Queued start job for default target Initrd Default Target.1732lb # [ 1.747834] systemd[1]: Listening on udev Kernel Socket.1733client # [ 1.721537] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1734lb # [ 1.748780] systemd[1]: Reached target Socket Units.1735client # [ 1.723011] systemd[1]: Expecting device /dev/disk/by-label/nixos...1736client # [ 1.724119] systemd[1]: Reached target Path Units.1737client # [ 1.724966] systemd[1]: Reached target Slice Units.1738client # [ 1.725821] systemd[1]: Reached target Swaps.1739client # [ 1.726703] systemd[1]: Reached target Timer Units.1740lb # [ 1.751315] systemd[1]: Starting Create List of Static Device Nodes...1741client # [ 1.727753] systemd[1]: Listening on D-Bus System Message Bus Socket.1742client # [ 1.729023] systemd[1]: Listening on Journal Socket (/dev/log).1743worker2 # [ 1.762150] systemd[1]: Mounting Kernel Configuration File System...1744client # [ 1.730233] systemd[1]: Listening on Journal Sockets.1745client # [ 1.730382] systemd[1]: Listening on udev Control Socket.1746worker1 # [ 1.732229] systemd[1]: Created slice Slice /system/modprobe.1747client # [ 1.730515] systemd[1]: Listening on udev Kernel Socket.1748worker1 # [ 1.733465] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1749client # [ 1.730540] systemd[1]: Reached target Socket Units.1750worker2 # [ 1.770121] systemd[1]: Starting Journal Service...1751worker1 # [ 1.734923] systemd[1]: Expecting device /dev/disk/by-label/nixos...1752lb # [ 1.761586] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1753worker1 # [ 1.736011] systemd[1]: Reached target Path Units.1754worker1 # [ 1.736849] systemd[1]: Reached target Slice Units.1755client # [ 1.735676] systemd[1]: Starting Create List of Static Device Nodes...1756lb # [ 1.762837] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1757worker1 # [ 1.737693] systemd[1]: Reached target Swaps.1758worker1 # [ 1.738541] systemd[1]: Reached target Timer Units.1759worker1 # [ 1.739564] systemd[1]: Listening on D-Bus System Message Bus Socket.1760worker1 # [ 1.740838] systemd[1]: Listening on Journal Socket (/dev/log).1761worker1 # [ 1.742087] systemd[1]: Listening on Journal Sockets.1762lb # [ 1.769672] systemd[1]: Mounting Kernel Configuration File System...1763worker1 # [ 1.742232] systemd[1]: Listening on udev Control Socket.1764worker1 # [ 1.742357] systemd[1]: Listening on udev Kernel Socket.1765worker1 # [ 1.742381] systemd[1]: Reached target Socket Units.1766client # [ 1.745998] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1767worker1 # [ 1.747460] systemd[1]: Starting Create List of Static Device Nodes...1768client # [ 1.746084] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1769client # [ 1.750477] systemd[1]: Mounting Kernel Configuration File System...1770worker1 # [ 1.757915] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1771worker2 # [ 1.795369] systemd[1]: Starting Load Kernel Modules...1772worker1 # [ 1.759095] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1773client # [ 1.761749] systemd[1]: Starting Journal Service...1774worker1 # [ 1.762515] systemd[1]: Mounting Kernel Configuration File System...1775worker2 # [ 1.798178] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1776worker2 # [ 1.809475] systemd[1]: Starting Coldplug All udev Devices...1777lb # [ 1.801528] systemd[1]: Starting Journal Service...1778worker2 # [ 1.812754] systemd-journald[73]: Collecting audit messages is disabled.1779client # [ 1.782838] systemd[1]: Starting Load Kernel Modules...1780lb # [ 1.809190] systemd[1]: Starting Load Kernel Modules...1781worker1 # [ 1.782189] systemd[1]: Starting Journal Service...1782lb # [ 1.810345] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1783client # [ 1.786037] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1784lb # [ 1.823103] systemd[1]: Starting Coldplug All udev Devices...1785worker1 # [ 1.798887] systemd[1]: Starting Load Kernel Modules...1786worker1 # [ 1.799892] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1787worker2 # [ 1.834204] systemd[1]: Finished Create List of Static Device Nodes.1788worker2 # [ 1.835114] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1789worker2 # [ 1.835402] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1790worker2 # [ 1.835630] systemd[1]: Mounted Kernel Configuration File System.1791worker2 # [ 1.842334] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1792client # [ 1.810043] systemd[1]: Starting Coldplug All udev Devices...1793client # [ 1.813996] systemd[1]: Finished Create List of Static Device Nodes.1794lb # [ 1.837674] systemd[1]: Finished Create List of Static Device Nodes.1795lb # [ 1.838738] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1796client # [ 1.815606] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1797lb # [ 1.839093] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1798lb # [ 1.839335] systemd[1]: Mounted Kernel Configuration File System.1799client # [ 1.822384] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1800client # [ 1.822663] systemd[1]: Mounted Kernel Configuration File System.1801client # [ 1.825367] systemd-journald[73]: Collecting audit messages is disabled.1802worker1 # [ 1.826276] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1803lb # [ 1.857043] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1804client # [ 1.830158] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1805worker1 # [ 1.833920] systemd[1]: Starting Coldplug All udev Devices...1806worker1 # [ 1.837849] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1807worker1 # [ 1.839126] systemd[1]: Finished Create List of Static Device Nodes.1808worker1 # [ 1.840927] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1809lb # [ 1.861743] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1810lb # [ 1.868909] systemd-journald[73]: Collecting audit messages is disabled.1811worker2 # [ 1.877835] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1812worker1 # [ 1.846317] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1813lb # [ 1.875837] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1814worker2 # [ 1.888750] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1815worker1 # [ 1.857086] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01816worker1 # [ 1.857318] [drm] features: -virgl +edid -resource_blob -host_visible1817worker1 # [ 1.857327] [drm] features: -context_init1818worker1 # [ 1.866189] [drm] number of scanouts: 11819worker1 # [ 1.866216] [drm] number of cap sets: 01820lb # [ 1.889676] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01821client # [ 1.866451] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1822worker2 # [ 1.897798] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01823lb # [ 1.889903] [drm] features: -virgl +edid -resource_blob -host_visible1824worker1 # [ 1.867562] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1825lb # [ 1.889912] [drm] features: -context_init1826worker2 # [ 1.902107] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1827lb # [ 1.890596] [drm] number of scanouts: 11828worker1 # [ 1.868026] systemd[1]: Mounted Kernel Configuration File System.1829lb # [ 1.890614] [drm] number of cap sets: 01830client # [ 1.868799] systemd[1]: Starting Create Static Device Nodes in /dev...1831worker2 # [ 1.905303] systemd[1]: Starting Create Static Device Nodes in /dev...1832lb # [ 1.902029] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1833lb # [ 1.905750] systemd[1]: Starting Create Static Device Nodes in /dev...1834worker2 # [ 1.914118] [drm] features: -virgl +edid -resource_blob -host_visible1835worker2 # [ 1.914135] [drm] features: -context_init1836worker2 # [ 1.914853] [drm] number of scanouts: 11837worker2 # [ 1.914872] [drm] number of cap sets: 01838worker1 # [ 1.875634] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1839worker1 # [ 1.875654] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01840client # [ 1.883625] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1841worker2 # [ 1.922359] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1842client # [ 1.893901] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1843lb # [ 1.913829] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1844worker2 # [ 1.922376] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01845lb # [ 1.913849] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01846worker1 # [ 1.896228] systemd-journald[73]: Collecting audit messages is disabled.1847worker1 # [ 1.905872] Console: switching to colour frame buffer device 160x501848worker1 # [ 1.912225] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1849client # [ 1.914074] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01850lb # [ 1.933705] Console: switching to colour frame buffer device 160x501851client # [ 1.914408] [drm] features: -virgl +edid -resource_blob -host_visible1852client # [ 1.914419] [drm] features: -context_init1853lb # [ 1.940157] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1854client # [ 1.915109] [drm] number of scanouts: 11855client # [ 1.915127] [drm] number of cap sets: 01856worker1 # [ 1.918379] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1857worker2 # [ 1.954650] systemd[1]: Finished Create Static Device Nodes in /dev.1858worker2 # [ 1.954992] systemd[1]: Reached target Preparation for Local File Systems.1859worker2 # [ 1.955022] systemd[1]: Reached target Local File Systems.1860worker1 # [ 1.921692] systemd[1]: Starting Create Static Device Nodes in /dev...1861client # [ 1.922478] systemd[1]: Finished Create Static Device Nodes in /dev.1862client # [ 1.922834] systemd[1]: Reached target Preparation for Local File Systems.1863client # [ 1.922864] systemd[1]: Reached target Local File Systems.1864client # [ 1.926624] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1865client # [ 1.926640] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01866worker2 # [ 1.958880] Console: switching to colour frame buffer device 160x501867client # [ 1.931958] systemd[1]: Starting Rule-based Manager for Device Events and Files...1868worker2 # [ 1.965442] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1869worker2 # [ 1.968700] systemd[1]: Starting Rule-based Manager for Device Events and Files...1870lb # [ 1.965994] systemd[1]: Finished Create Static Device Nodes in /dev.1871lb # [ 1.966211] systemd[1]: Reached target Preparation for Local File Systems.1872lb # [ 1.966246] systemd[1]: Reached target Local File Systems.1873lb # [ 1.971365] systemd[1]: Starting Rule-based Manager for Device Events and Files...1874worker1 # [ 1.949953] systemd[1]: Finished Load Kernel Modules.1875worker1 # [ 1.952997] systemd[1]: Starting Apply Kernel Variables...1876worker2 # [ 1.998217] systemd[1]: Finished Load Kernel Modules.1877lb # [ 1.989909] systemd[1]: Finished Load Kernel Modules.1878worker2 # [ 2.001399] systemd[1]: Starting Apply Kernel Variables...1879client # [ 1.962179] Console: switching to colour frame buffer device 160x501880client # [ 1.969614] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1881worker1 # [ 1.974359] systemd[1]: Finished Create Static Device Nodes in /dev.1882worker1 # [ 1.974533] systemd[1]: Reached target Preparation for Local File Systems.1883worker1 # [ 1.974566] systemd[1]: Reached target Local File Systems.1884worker2 # [ 2.014110] systemd[1]: Started Journal Service.1885worker2 # [ 2.005006] systemd-modules-load[75]: Inserted module 'dm_mod'1886worker1 # [ 1.982188] systemd[1]: Starting Rule-based Manager for Device Events and Files...1887worker2 # [ 2.008373] systemd-modules-load[75]: Module 'virtio_balloon' is built in1888lb # [ 2.009541] systemd[1]: Starting Apply Kernel Variables...1889worker2 # [ 2.016416] systemd-modules-load[75]: Module 'virtio_console' is built in1890worker2 # [ 2.025248] systemd-modules-load[75]: Inserted module 'virtio_gpu'1891client # [ 2.002423] systemd[1]: Finished Load Kernel Modules.1892worker1 # [ 2.003259] systemd[1]: Finished Apply Kernel Variables.1893worker2 # [ 2.026341] systemd-modules-load[75]: Module 'virtio_rng' is built in1894worker2 # [ 2.027305] systemd[1]: Starting Create System Files and Directories...1895client # [ 2.005521] systemd[1]: Starting Apply Kernel Variables...1896lb # [ 2.041567] systemd[1]: Finished Apply Kernel Variables.1897client # [ 2.004281] systemd-modules-load[74]: Inserted module 'dm_mod'1898client # [ 2.005345] systemd-modules-load[74]: Module 'virtio_balloon' is built in1899client # [ 2.020139] systemd[1]: Started Journal Service.1900lb # [ 2.037286] systemd-modules-load[74]: Inserted module 'dm_mod'1901lb # [ 2.038371] systemd-modules-load[74]: Module 'virtio_balloon' is built in1902client # [ 2.013291] systemd-modules-load[74]: Module 'virtio_console' is built in1903lb # [ 2.053619] systemd[1]: Started Journal Service.1904client # [ 2.016432] systemd-modules-load[74]: Inserted module 'virtio_gpu'1905worker2 # [ 2.052602] systemd[1]: Finished Apply Kernel Variables.1906client # [ 2.020282] systemd-modules-load[74]: Module 'virtio_rng' is built in1907lb # [ 2.048095] systemd-modules-load[74]: Module 'virtio_console' is built in1908worker2 # [ 2.057616] systemd-udevd[79]: Using default interface naming scheme 'v261'.1909lb # [ 2.052308] systemd-modules-load[74]: Inserted module 'virtio_gpu'1910client # [ 2.028579] systemd-udevd[80]: Using default interface naming scheme 'v261'.1911lb # [ 2.056289] systemd-modules-load[74]: Module 'virtio_rng' is built in1912client # [ 2.032279] systemd[1]: Starting Create System Files and Directories...1913worker2 # [ 2.070994] systemd[1]: Finished Create System Files and Directories.1914lb # [ 2.064639] systemd[1]: Starting Create System Files and Directories...1915worker1 # [ 2.053399] systemd[1]: Started Journal Service.1916lb # [ 2.077784] systemd-udevd[79]: Using default interface naming scheme 'v261'.1917worker1 # [ 2.052269] systemd-modules-load[74]: Inserted module 'dm_mod'1918worker1 # [ 2.053372] systemd-modules-load[74]: Module 'virtio_balloon' is built in1919worker1 # [ 2.054441] systemd-modules-load[74]: Module 'virtio_console' is built in1920worker1 # [ 2.055501] systemd-modules-load[74]: Inserted module 'virtio_gpu'1921client # [ 2.057450] systemd[1]: Finished Apply Kernel Variables.1922lb # [ 2.085209] systemd[1]: Finished Create System Files and Directories.1923worker2 # [ 2.093945] systemd[1]: Started Rule-based Manager for Device Events and Files.1924worker1 # [ 2.063415] systemd-modules-load[74]: Module 'virtio_rng' is built in1925client # [ 2.069319] systemd[1]: Finished Create System Files and Directories.1926worker1 # [ 2.073578] systemd[1]: Starting Create System Files and Directories...1927worker1 # [ 2.080597] systemd-udevd[80]: Using default interface naming scheme 'v261'.1928client # [ 2.080960] systemd[1]: Started Rule-based Manager for Device Events and Files.1929lb # [ 2.110074] systemd[1]: Started Rule-based Manager for Device Events and Files.1930worker1 # [ 2.088291] systemd[1]: Finished Create System Files and Directories.1931worker1 # [ 2.105011] systemd[1]: Started Rule-based Manager for Device Events and Files.1932worker2 # [ 2.144091] systemd[1]: Starting Virtual Console Setup...1933lb # [ 2.160988] systemd[1]: Starting Virtual Console Setup...1934client # [ 2.136093] systemd[1]: Starting Virtual Console Setup...1935worker1 # [ 2.159754] systemd[1]: Starting Virtual Console Setup...1936worker2 # [ 2.200456] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1937worker2 # [ 2.203916] systemd[1]: Finished Virtual Console Setup.1938client # [ 2.176820] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1939client # [ 2.180106] systemd[1]: Finished Virtual Console Setup.1940lb # [ 2.212405] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1941lb # [ 2.215794] systemd[1]: Finished Virtual Console Setup.1942worker1 # [ 2.204434] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1943worker1 # [ 2.207682] systemd[1]: Finished Virtual Console Setup.1944worker2 # [ 2.827196] systemd[1]: Finished Coldplug All udev Devices.1945lb # [ 2.819114] systemd[1]: Finished Coldplug All udev Devices.1946worker2 # [ 2.828177] systemd[1]: Reached target System Initialization.1947lb # [ 2.820134] systemd[1]: Reached target System Initialization.1948worker2 # [ 2.829002] systemd[1]: Reached target Basic System.1949lb # [ 2.820970] systemd[1]: Reached target Basic System.1950worker1 # [ 2.801450] systemd[1]: Finished Coldplug All udev Devices.1951client # [ 2.802443] systemd[1]: Finished Coldplug All udev Devices.1952worker1 # [ 2.802422] systemd[1]: Reached target System Initialization.1953worker1 # [ 2.803242] systemd[1]: Reached target Basic System.1954client # [ 2.803405] systemd[1]: Reached target System Initialization.1955client # [ 2.808210] systemd[1]: Reached target Basic System.1956worker2 # [ 2.979703] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1957lb # [ 2.978898] (udev-worker)[105]: Network interface NamePolicy= disabled on kernel command line.1958worker1 # [ 2.952705] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1959client # [ 2.956394] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1960lb # [ 2.982763] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1961lb # [ 2.988288] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1962worker2 # [ 3.003677] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1963worker2 # [ 3.006432] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1964worker1 # [ 2.974108] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1965client # [ 2.978552] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1966worker1 # [ 2.980381] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1967client # [ 2.984252] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1968lb # [ 3.053132] systemd[1]: Found device /dev/disk/by-label/nixos.1969client # [ 3.029275] systemd[1]: Found device /dev/disk/by-label/nixos.1970lb # [ 3.055970] systemd[1]: Reached target Initrd Root Device.1971client # [ 3.031756] systemd[1]: Reached target Initrd Root Device.1972lb # [ 3.060597] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1973client # [ 3.035465] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1974worker1 # [ 3.037128] systemd[1]: Found device /dev/disk/by-label/nixos.1975worker1 # [ 3.044085] systemd[1]: Reached target Initrd Root Device.1976worker1 # [ 3.049733] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1977worker2 # [ 3.085420] systemd[1]: Found device /dev/disk/by-label/nixos.1978worker2 # [ 3.087073] systemd[1]: Reached target Initrd Root Device.1979worker2 # [ 3.091743] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1980client # [ 3.084472] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1981lb # [ 3.112371] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1982client # [ 3.089972] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1983lb # [ 3.120617] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1984client # [ 3.096815] systemd[1]: Mounting /sysroot...1985lb # [ 3.123879] systemd[1]: Mounting /sysroot...1986worker1 # [ 3.097239] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1987worker2 # [ 3.136817] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1988worker1 # [ 3.104184] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1989worker1 # [ 3.107183] systemd[1]: Mounting /sysroot...1990worker2 # [ 3.147084] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1991worker2 # [ 3.152107] systemd[1]: Mounting /sysroot...1992client # [ 3.142281] EXT4-fs (vda): mounted filesystem 3663c7e9-b89b-4ccc-bd5f-cb3d9c71276a r/w with ordered data mode. Quota mode: none.1993client # [ 3.134496] systemd[1]: Mounted /sysroot.1994lb # [ 3.172429] EXT4-fs (vda): mounted filesystem 4f75b336-8d7d-49d1-b1a4-94fe6ba23d3c r/w with ordered data mode. Quota mode: none.1995client # [ 3.135369] systemd[1]: Reached target Initrd Root File System.1996lb # [ 3.165852] systemd[1]: Mounted /sysroot.1997client # [ 3.140163] systemd[1]: Starting Mountpoints Configured in the Real Root...1998worker1 # [ 3.153793] EXT4-fs (vda): mounted filesystem afd9c186-e06a-494b-9e51-b3967e962128 r/w with ordered data mode. Quota mode: none.1999lb # [ 3.168587] systemd[1]: Reached target Initrd Root File System.2000lb # [ 3.172978] systemd[1]: Starting Mountpoints Configured in the Real Root...
loading 1,388 hidden lines…
3389lb # [ 14.923038] systemd[1]: Starting Virtual Console Setup...3390lb # [ 14.982199] systemd-logind[526]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3391lb # [ 15.031879] dhcpcd[668]: eth0: soliciting an IPv6 router3392lb # [ 15.034030] dhcpcd[668]: eth0: Router Advertisement from fe80::23393lb # [ 15.036157] dhcpcd[668]: eth0: adding address fec0::5054:ff:fe12:3456/643394lb # [ 15.037974] dhcpcd[668]: eth0: adding route to fec0::/643395lb # [ 15.040139] dhcpcd[668]: eth0: adding default route via fe80::23396lb # [ 15.411352] systemd-vconsole-setup[774]: Configuration of first virtual console was skipped, ignoring remaining ones.3397lb # [ 15.416420] systemd[1]: Finished Virtual Console Setup.3398lb # [ 15.852375] postgresql-pre-start[699]: selecting default time zone ... UTC3399lb # [ 15.859223] postgresql-pre-start[699]: creating configuration files ... ok3400lb # [ 16.247782] postgresql-pre-start[699]: running bootstrap script ... ok3401lb # [ 17.072732] postgresql-pre-start[699]: performing post-bootstrap initialization ... ok3402lb # [ 17.232219] postgresql-pre-start[699]: syncing data to disk ... ok3403lb # [ 17.234960] postgresql-pre-start[699]: initdb: warning: enabling "trust" authentication for local connections3404lb # [ 17.236482] postgresql-pre-start[699]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3405lb # [ 17.238692] postgresql-pre-start[699]: Success. You can now start the database server using:3406lb # [ 17.240292] postgresql-pre-start[699]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3407lb # [ 17.388584] postgres[808]: [808] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3408lb # [ 17.392911] postgres[808]: [808] LOG: listening on IPv6 address "::1", port 54323409lb # [ 17.394260] postgres[808]: [808] LOG: listening on IPv4 address "127.0.0.1", port 54323410lb # [ 17.395906] postgres[808]: [808] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3411lb # [ 17.411150] postgres[817]: [817] LOG: database system was shut down at 2026-09-20 09:04:24 GMT3412lb # [ 17.416502] postgres[808]: [808] LOG: database system is ready to accept connections3413lb # [ 17.421082] systemd[1]: Started PostgreSQL Server.3414lb # [ 17.430805] systemd[1]: Starting PostgreSQL Setup Scripts...3415worker1 # [ 17.655243] dhcpcd[634]: eth0: leased 10.0.2.15 for 86400 seconds3416worker1 # [ 17.660504] dhcpcd[634]: eth0: adding route to 10.0.2.0/243417worker1 # [ 17.664550] dhcpcd[634]: eth0: adding default route via 10.0.2.23418lb # [ 17.719670] postgresql-setup-start[828]: CREATE DATABASE3419lb # [ 17.782981] postgresql-setup-start[833]: CREATE ROLE3420lb # [ 17.808669] postgresql-setup-start[835]: ALTER DATABASE3421lb # [ 17.816962] systemd[1]: Finished PostgreSQL Setup Scripts.3422lb # [ 17.818940] systemd[1]: Reached target PostgreSQL.3423worker1 # [ 17.887612] systemd[1]: Started DHCP Client.3424worker1 # [ 17.890069] systemd[1]: Reached target Multi-User System.3425worker1 # [ 17.890890] systemd[1]: Startup finished in 924ms (kernel) + 4.559s (initrd) + 12.405s (userspace) = 17.889s.3426client # [ 18.362844] dhcpcd[533]: eth0: leased 10.0.2.15 for 86400 seconds3427client # [ 18.368485] dhcpcd[533]: eth0: adding route to 10.0.2.0/243428client # [ 18.370956] dhcpcd[533]: eth0: adding default route via 10.0.2.23429worker2 # [ 18.581744] dhcpcd[637]: eth0: leased 10.0.2.15 for 86400 seconds3430client # [ 18.551089] systemd[1]: Started DHCP Client.3431client # [ 18.554717] systemd[1]: Reached target Multi-User System.3432worker2 # [ 18.588659] dhcpcd[637]: eth0: adding route to 10.0.2.0/243433client # [ 18.556737] systemd[1]: Startup finished in 914ms (kernel) + 4.551s (initrd) + 13.090s (userspace) = 18.555s.3434worker2 # [ 18.591091] dhcpcd[637]: eth0: adding default route via 10.0.2.23435worker2 # [ 18.846281] systemd[1]: Started DHCP Client.3436worker2 # [ 18.848915] systemd[1]: Reached target Multi-User System.3437worker2 # [ 18.850546] systemd[1]: Startup finished in 933ms (kernel) + 4.571s (initrd) + 13.345s (userspace) = 18.849s.3438lb # [ 19.766984] dhcpcd[668]: eth0: leased 10.0.2.15 for 86400 seconds3439lb # [ 19.772367] dhcpcd[668]: eth0: adding route to 10.0.2.0/243440lb # [ 19.774767] dhcpcd[668]: eth0: adding default route via 10.0.2.23441lb # [ 19.975996] systemd[1]: Started DHCP Client.3442lb # [ 19.979116] systemd[1]: Reached target Network is Online.3443lb # [ 19.984740] systemd[1]: Started Envoy reverse proxy.3444lb # [ 19.993636] systemd[1]: Started mock-oidc.service.3445lb # [ 20.113670] mock-oidc-server[913]: Mock OIDC Server running3446lb # [ 20.114878] mock-oidc-server[913]: OIDC Address: 192.168.1.2:80803447lb # [ 20.117173] mock-oidc-server[913]: Issue Address: 0.0.0.0:80813448lb # [ 20.119482] mock-oidc-server[913]: Issuer: http://192.168.1.2:8080/oidc3449lb # [ 20.120771] mock-oidc-server[913]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3450lb # [ 20.122893] mock-oidc-server[913]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3451lb # [ 20.125295] mock-oidc-server[913]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3452lb # [ 20.780424] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3453lb # [ 20.780745] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:469] statically linked extensions:3454lb # [ 20.780853] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3455lb # [ 20.780913] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3456lb # [ 20.780959] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3457lb # [ 20.780991] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3458lb # [ 20.781029] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3459lb # [ 20.781075] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3460lb # [ 20.781108] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3461lb # [ 20.781191] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3462lb # [ 20.842679] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3463lb # [ 20.856534] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3464lb # [ 20.859255] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3465lb # [ 20.861702] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3466lb # [ 20.864252] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3467lb # [ 20.871471] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3468lb # [ 20.875535] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3469lb # [ 20.877869] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3470lb # [ 20.879657] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3471lb # [ 20.883019] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3472lb # [ 20.885128] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3473lb # [ 20.892335] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3474lb # [ 20.896127] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3475lb # [ 20.902253] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23476lb # [ 20.904197] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3477lb # [ 20.907986] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3478lb # [ 20.910548] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3479lb # [ 20.914246] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3480lb # [ 20.916851] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3481lb # [ 20.919512] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3482lb # [ 20.922670] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3483lb # [ 20.924811] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3484lb # [ 20.930238] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3485lb # [ 20.933518] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3486lb # [ 20.938877] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3487lb # [ 20.945734] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23488lb # [ 20.947547] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3489lb # [ 20.952144] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13490lb # [ 20.955097] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3491lb # [ 20.958390] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3492lb # [ 20.962036] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3493lb # [ 20.963998] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3494lb # [ 20.966016] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3495lb # [ 20.967948] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3496lb # [ 20.970820] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3497lb # [ 20.972952] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3498lb # [ 20.975954] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3499lb # [ 20.978450] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3500lb # [ 20.983421] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3501lb # [ 20.987478] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3502lb # [ 20.990253] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3503lb # [ 20.991951] envoy[912]: [2026-09-20 09:04:28.415][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3504lb # [ 20.994540] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3505lb # [ 21.008336] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3506lb # [ 21.016185] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3507lb # [ 21.018979] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3508lb # [ 21.021027] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3509lb # [ 21.023302] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3510lb # [ 21.025650] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3511lb # [ 21.027919] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3512lb # [ 21.035135] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3513lb # [ 21.037007] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3514lb # [ 21.044541] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3515lb # [ 21.049634] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3516lb # [ 21.052385] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3517lb # [ 21.054341] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3518lb # [ 21.057496] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3519lb # [ 21.064844] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3520lb # [ 21.067196] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3521lb # [ 21.073578] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3522lb # [ 21.076958] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3523lb # [ 21.082299] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3524lb # [ 21.085242] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3525lb # [ 21.087235] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3526lb # [ 21.099769] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3527lb # [ 21.102300] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3528lb # [ 21.104065] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3529lb # [ 21.106251] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3530lb # [ 21.109970] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3531lb # [ 21.111791] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3532lb # [ 21.114148] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3533lb # [ 21.117235] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3534lb # [ 21.119685] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3535lb # [ 21.121929] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3536lb # [ 21.124329] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23537lb # [ 21.126633] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3538lb # [ 21.128481] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3539lb # [ 21.130934] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3540lb # [ 21.133345] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3541lb # [ 21.137240] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3542lb # [ 21.139088] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3543lb # [ 21.141079] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3544lb # [ 21.143811] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3545lb # [ 21.146944] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3546lb # [ 21.149918] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3547lb # [ 21.151960] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3548lb # [ 21.154991] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3549lb # [ 21.157753] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83550lb # [ 21.159772] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3551lb # [ 21.162255] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3552lb # [ 21.168273] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3553lb # [ 21.171151] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3554lb # [ 21.173593] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3555lb # [ 21.175494] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3556lb # [ 21.179055] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3557lb # [ 21.188389] envoy[912]: [2026-09-20 09:04:28.416][912][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3558lb # [ 21.190733] envoy[912]: [2026-09-20 09:04:28.474][912][info][main] [source/server/server.cc:531] HTTP header map info:3559lb # [ 21.192754] envoy[912]: [2026-09-20 09:04:28.476][912][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3560lb # [ 21.208936] envoy[912]: [2026-09-20 09:04:28.476][912][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3561lb # [ 21.210596] envoy[912]: [2026-09-20 09:04:28.476][912][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3562lb # [ 21.220291] envoy[912]: [2026-09-20 09:04:28.476][912][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3563lb # [ 21.222206] envoy[912]: [2026-09-20 09:04:28.694][912][info][main] [source/server/server.cc:968] runtime: {}3564lb # [ 21.223580] envoy[912]: [2026-09-20 09:04:28.718][912][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3565lb # [ 21.225830] envoy[912]: [2026-09-20 09:04:28.718][912][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013566lb # [ 21.227613] envoy[912]: [2026-09-20 09:04:28.718][912][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013567lb # [ 21.229536] envoy[912]: [2026-09-20 09:04:28.723][912][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3568lb # [ 21.231224] envoy[912]: [2026-09-20 09:04:28.723][912][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3569lb # [ 21.233336] envoy[912]: [2026-09-20 09:04:28.723][912][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3570lb # [ 21.254853] envoy[912]: [2026-09-20 09:04:28.890][912][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3571lb # [ 21.264575] envoy[912]: [2026-09-20 09:04:28.901][912][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3572lb # [ 21.267631] envoy[912]: [2026-09-20 09:04:28.904][912][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3573lb # [ 21.271304] envoy[912]: [2026-09-20 09:04:28.904][912][info][main] [source/server/server.cc:1077] starting main dispatch loop3574worker2 # [ 21.286064] systemd[1]: Starting Nix worker-protocol over gRPC...3575worker1 # [ 21.256188] systemd[1]: Starting Nix worker-protocol over gRPC...3576worker2 # [ 21.556433] nix-grpc-daemon[778]: ts=2026-09-20T09:04:29Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3577worker1 # [ 21.530699] nix-grpc-daemon[774]: ts=2026-09-20T09:04:29Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3578worker2 # [ 21.569311] nix-grpc-daemon[778]: ts=2026-09-20T09:04:29Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13579worker1 # [ 21.544279] nix-grpc-daemon[774]: ts=2026-09-20T09:04:29Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13580worker2 # [ 21.614969] nix-grpc-daemon[778]: ts=2026-09-20T09:04:29Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3581worker2 # [ 21.619784] systemd[1]: Started Nix worker-protocol over gRPC.3582worker1 # [ 21.590084] nix-grpc-daemon[774]: ts=2026-09-20T09:04:29Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3583worker1 # [ 21.595129] systemd[1]: Started Nix worker-protocol over gRPC.3584lb # [ 21.649999] envoy[912]: [2026-09-20 09:04:29.286][912][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3585lb # [ 21.658155] envoy[912]: [2026-09-20 09:04:29.286][912][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3586worker2 # [ 21.688133] nix-grpc-daemon[778]: ts=2026-09-20T09:04:29Z level=info event=scheduler_connected addr=lb:500513587lb # [ 21.669917] envoy[912]: [2026-09-20 09:04:29.286][912][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3588lb # [ 21.682695] envoy[912]: [2026-09-20 09:04:29.286][912][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3589worker1 # [ 21.668946] nix-grpc-daemon[774]: ts=2026-09-20T09:04:29Z level=info event=scheduler_connected addr=lb:500513590worker2 # [ 21.708114] nix-grpc-daemon[778]: ts=2026-09-20T09:04:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3591worker1 # [ 21.683923] nix-grpc-daemon[774]: ts=2026-09-20T09:04:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3592worker2 # [ 21.909515] nix-grpc-daemon[778]: ts=2026-09-20T09:04:29Z level=info event=scheduler_connected addr=lb:500513593worker2 # [ 21.915783] nix-grpc-daemon[778]: ts=2026-09-20T09:04:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3594worker1 # [ 21.885569] nix-grpc-daemon[774]: ts=2026-09-20T09:04:29Z level=info event=scheduler_connected addr=lb:500513595worker1 # [ 21.892385] nix-grpc-daemon[774]: ts=2026-09-20T09:04:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3596worker2 # [ 22.116332] nix-grpc-daemon[778]: ts=2026-09-20T09:04:29Z level=info event=scheduler_connected addr=lb:500513597worker2 # [ 22.120809] nix-grpc-daemon[778]: ts=2026-09-20T09:04:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3598worker1 # [ 22.093644] nix-grpc-daemon[774]: ts=2026-09-20T09:04:29Z level=info event=scheduler_connected addr=lb:500513599worker1 # [ 22.098852] nix-grpc-daemon[774]: ts=2026-09-20T09:04:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3600worker2 # [ 22.321747] nix-grpc-daemon[778]: ts=2026-09-20T09:04:29Z level=info event=scheduler_connected addr=lb:500513601worker2 # [ 22.327082] nix-grpc-daemon[778]: ts=2026-09-20T09:04:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3602worker1 # [ 22.300138] nix-grpc-daemon[774]: ts=2026-09-20T09:04:29Z level=info event=scheduler_connected addr=lb:500513603worker1 # [ 22.305224] nix-grpc-daemon[774]: ts=2026-09-20T09:04:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3604worker2 # [ 22.527867] nix-grpc-daemon[778]: ts=2026-09-20T09:04:30Z level=info event=scheduler_connected addr=lb:500513605worker2 # [ 22.533215] nix-grpc-daemon[778]: ts=2026-09-20T09:04:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3606worker1 # [ 22.505908] nix-grpc-daemon[774]: ts=2026-09-20T09:04:30Z level=info event=scheduler_connected addr=lb:500513607worker1 # [ 22.511162] nix-grpc-daemon[774]: ts=2026-09-20T09:04:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3608worker2 # [ 22.735227] nix-grpc-daemon[778]: ts=2026-09-20T09:04:30Z level=info event=scheduler_connected addr=lb:500513609worker2 # [ 22.740535] nix-grpc-daemon[778]: ts=2026-09-20T09:04:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3610worker1 # [ 22.713347] nix-grpc-daemon[774]: ts=2026-09-20T09:04:30Z level=info event=scheduler_connected addr=lb:500513611worker1 # [ 22.718571] nix-grpc-daemon[774]: ts=2026-09-20T09:04:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3612worker2 # [ 22.941216] nix-grpc-daemon[778]: ts=2026-09-20T09:04:30Z level=info event=scheduler_connected addr=lb:500513613worker2 # [ 22.946503] nix-grpc-daemon[778]: ts=2026-09-20T09:04:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3614worker1 # [ 22.919138] nix-grpc-daemon[774]: ts=2026-09-20T09:04:30Z level=info event=scheduler_connected addr=lb:500513615worker1 # [ 22.924579] nix-grpc-daemon[774]: ts=2026-09-20T09:04:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3616worker2 # [ 23.147263] nix-grpc-daemon[778]: ts=2026-09-20T09:04:30Z level=info event=scheduler_connected addr=lb:500513617worker2 # [ 23.152685] nix-grpc-daemon[778]: ts=2026-09-20T09:04:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3618worker1 # [ 23.125492] nix-grpc-daemon[774]: ts=2026-09-20T09:04:30Z level=info event=scheduler_connected addr=lb:500513619worker1 # [ 23.130747] nix-grpc-daemon[774]: ts=2026-09-20T09:04:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3620worker2 # [ 23.353522] nix-grpc-daemon[778]: ts=2026-09-20T09:04:30Z level=info event=scheduler_connected addr=lb:500513621worker2 # [ 23.358784] nix-grpc-daemon[778]: ts=2026-09-20T09:04:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3622worker1 # [ 23.331415] nix-grpc-daemon[774]: ts=2026-09-20T09:04:30Z level=info event=scheduler_connected addr=lb:500513623worker1 # [ 23.336805] nix-grpc-daemon[774]: ts=2026-09-20T09:04:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3624worker2 # [ 23.559700] nix-grpc-daemon[778]: ts=2026-09-20T09:04:31Z level=info event=scheduler_connected addr=lb:500513625worker2 # [ 23.565059] nix-grpc-daemon[778]: ts=2026-09-20T09:04:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3626worker1 # [ 23.537578] nix-grpc-daemon[774]: ts=2026-09-20T09:04:31Z level=info event=scheduler_connected addr=lb:500513627worker1 # [ 23.542939] nix-grpc-daemon[774]: ts=2026-09-20T09:04:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3628worker2 # [ 23.766933] nix-grpc-daemon[778]: ts=2026-09-20T09:04:31Z level=info event=scheduler_connected addr=lb:500513629worker2 # [ 23.772106] nix-grpc-daemon[778]: ts=2026-09-20T09:04:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3630worker1 # [ 23.744904] nix-grpc-daemon[774]: ts=2026-09-20T09:04:31Z level=info event=scheduler_connected addr=lb:500513631worker1 # [ 23.750048] nix-grpc-daemon[774]: ts=2026-09-20T09:04:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3632worker2 # [ 23.973087] nix-grpc-daemon[778]: ts=2026-09-20T09:04:31Z level=info event=scheduler_connected addr=lb:500513633worker2 # [ 23.978324] nix-grpc-daemon[778]: ts=2026-09-20T09:04:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3634worker1 # [ 23.951015] nix-grpc-daemon[774]: ts=2026-09-20T09:04:31Z level=info event=scheduler_connected addr=lb:500513635worker1 # [ 23.956393] nix-grpc-daemon[774]: ts=2026-09-20T09:04:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3636worker2 # [ 24.179078] nix-grpc-daemon[778]: ts=2026-09-20T09:04:31Z level=info event=scheduler_connected addr=lb:500513637worker2 # [ 24.185760] nix-grpc-daemon[778]: ts=2026-09-20T09:04:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3638worker1 # [ 24.157040] nix-grpc-daemon[774]: ts=2026-09-20T09:04:31Z level=info event=scheduler_connected addr=lb:500513639worker1 # [ 24.162315] nix-grpc-daemon[774]: ts=2026-09-20T09:04:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3640worker2 # [ 24.385288] nix-grpc-daemon[778]: ts=2026-09-20T09:04:32Z level=info event=scheduler_connected addr=lb:500513641worker2 # [ 24.391298] nix-grpc-daemon[778]: ts=2026-09-20T09:04:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3642worker1 # [ 24.363133] nix-grpc-daemon[774]: ts=2026-09-20T09:04:32Z level=info event=scheduler_connected addr=lb:500513643worker1 # [ 24.368533] nix-grpc-daemon[774]: ts=2026-09-20T09:04:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3644worker2 # [ 24.591410] nix-grpc-daemon[778]: ts=2026-09-20T09:04:32Z level=info event=scheduler_connected addr=lb:500513645worker2 # [ 24.596915] nix-grpc-daemon[778]: ts=2026-09-20T09:04:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3646worker1 # [ 24.569226] nix-grpc-daemon[774]: ts=2026-09-20T09:04:32Z level=info event=scheduler_connected addr=lb:500513647worker1 # [ 24.574466] nix-grpc-daemon[774]: ts=2026-09-20T09:04:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3648worker2 # [ 24.798983] nix-grpc-daemon[778]: ts=2026-09-20T09:04:32Z level=info event=scheduler_connected addr=lb:500513649worker2 # [ 24.804280] nix-grpc-daemon[778]: ts=2026-09-20T09:04:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3650worker1 # [ 24.777638] nix-grpc-daemon[774]: ts=2026-09-20T09:04:32Z level=info event=scheduler_connected addr=lb:500513651worker1 # [ 24.782884] nix-grpc-daemon[774]: ts=2026-09-20T09:04:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3652worker2 # [ 25.004929] nix-grpc-daemon[778]: ts=2026-09-20T09:04:32Z level=info event=scheduler_connected addr=lb:500513653worker2 # [ 25.010181] nix-grpc-daemon[778]: ts=2026-09-20T09:04:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3654worker1 # [ 24.983493] nix-grpc-daemon[774]: ts=2026-09-20T09:04:32Z level=info event=scheduler_connected addr=lb:500513655worker1 # [ 24.989223] nix-grpc-daemon[774]: ts=2026-09-20T09:04:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3656worker2 # [ 25.211059] nix-grpc-daemon[778]: ts=2026-09-20T09:04:32Z level=info event=scheduler_connected addr=lb:500513657worker2 # [ 25.216445] nix-grpc-daemon[778]: ts=2026-09-20T09:04:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3658worker1 # [ 25.189893] nix-grpc-daemon[774]: ts=2026-09-20T09:04:32Z level=info event=scheduler_connected addr=lb:500513659worker1 # [ 25.195355] nix-grpc-daemon[774]: ts=2026-09-20T09:04:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3660worker2 # [ 25.417121] nix-grpc-daemon[778]: ts=2026-09-20T09:04:33Z level=info event=scheduler_connected addr=lb:500513661worker2 # [ 25.420789] nix-grpc-daemon[778]: ts=2026-09-20T09:04:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3662worker1 # [ 25.395868] nix-grpc-daemon[774]: ts=2026-09-20T09:04:33Z level=info event=scheduler_connected addr=lb:500513663worker1 # [ 25.400973] nix-grpc-daemon[774]: ts=2026-09-20T09:04:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3664worker2 # [ 25.621983] nix-grpc-daemon[778]: ts=2026-09-20T09:04:33Z level=info event=scheduler_connected addr=lb:500513665worker2 # [ 25.627544] nix-grpc-daemon[778]: ts=2026-09-20T09:04:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3666worker1 # [ 25.601628] nix-grpc-daemon[774]: ts=2026-09-20T09:04:33Z level=info event=scheduler_connected addr=lb:500513667worker1 # [ 25.606914] nix-grpc-daemon[774]: ts=2026-09-20T09:04:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3668worker2 # [ 25.829904] nix-grpc-daemon[778]: ts=2026-09-20T09:04:33Z level=info event=scheduler_connected addr=lb:500513669worker2 # [ 25.835397] nix-grpc-daemon[778]: ts=2026-09-20T09:04:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3670worker1 # [ 25.809005] nix-grpc-daemon[774]: ts=2026-09-20T09:04:33Z level=info event=scheduler_connected addr=lb:500513671worker1 # [ 25.814265] nix-grpc-daemon[774]: ts=2026-09-20T09:04:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3672worker2 # [ 26.036252] nix-grpc-daemon[778]: ts=2026-09-20T09:04:33Z level=info event=scheduler_connected addr=lb:500513673worker2 # [ 26.041888] nix-grpc-daemon[778]: ts=2026-09-20T09:04:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3674worker1 # [ 26.014884] nix-grpc-daemon[774]: ts=2026-09-20T09:04:33Z level=info event=scheduler_connected addr=lb:500513675worker1 # [ 26.020461] nix-grpc-daemon[774]: ts=2026-09-20T09:04:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3676worker2 # [ 26.242514] nix-grpc-daemon[778]: ts=2026-09-20T09:04:33Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 26.247978] nix-grpc-daemon[778]: ts=2026-09-20T09:04:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3678worker1 # [ 26.220888] nix-grpc-daemon[774]: ts=2026-09-20T09:04:33Z level=info event=scheduler_connected addr=lb:500513679worker1 # [ 26.226190] nix-grpc-daemon[774]: ts=2026-09-20T09:04:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3680worker2 # [ 26.448910] nix-grpc-daemon[778]: ts=2026-09-20T09:04:34Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 26.454282] nix-grpc-daemon[778]: ts=2026-09-20T09:04:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3682worker1 # [ 26.427158] nix-grpc-daemon[774]: ts=2026-09-20T09:04:34Z level=info event=scheduler_connected addr=lb:500513683worker1 # [ 26.432652] nix-grpc-daemon[774]: ts=2026-09-20T09:04:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3684worker2 # [ 26.655038] nix-grpc-daemon[778]: ts=2026-09-20T09:04:34Z level=info event=scheduler_connected addr=lb:500513685worker2 # [ 26.660542] nix-grpc-daemon[778]: ts=2026-09-20T09:04:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3686worker1 # [ 26.633148] nix-grpc-daemon[774]: ts=2026-09-20T09:04:34Z level=info event=scheduler_connected addr=lb:500513687worker1 # [ 26.638632] nix-grpc-daemon[774]: ts=2026-09-20T09:04:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3688worker2 # [ 26.862719] nix-grpc-daemon[778]: ts=2026-09-20T09:04:34Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 26.867991] nix-grpc-daemon[778]: ts=2026-09-20T09:04:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3690worker1 # [ 26.840884] nix-grpc-daemon[774]: ts=2026-09-20T09:04:34Z level=info event=scheduler_connected addr=lb:500513691worker1 # [ 26.845953] nix-grpc-daemon[774]: ts=2026-09-20T09:04:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3692worker2 # [ 27.068813] nix-grpc-daemon[778]: ts=2026-09-20T09:04:34Z level=info event=scheduler_connected addr=lb:500513693worker2 # [ 27.074139] nix-grpc-daemon[778]: ts=2026-09-20T09:04:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3694worker1 # [ 27.046726] nix-grpc-daemon[774]: ts=2026-09-20T09:04:34Z level=info event=scheduler_connected addr=lb:500513695worker1 # [ 27.051997] nix-grpc-daemon[774]: ts=2026-09-20T09:04:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3696worker2 # [ 27.274961] nix-grpc-daemon[778]: ts=2026-09-20T09:04:34Z level=info event=scheduler_connected addr=lb:500513697worker2 # [ 27.280474] nix-grpc-daemon[778]: ts=2026-09-20T09:04:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3698worker1 # [ 27.252853] nix-grpc-daemon[774]: ts=2026-09-20T09:04:34Z level=info event=scheduler_connected addr=lb:500513699worker1 # [ 27.257994] nix-grpc-daemon[774]: ts=2026-09-20T09:04:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3700worker2 # [ 27.481263] nix-grpc-daemon[778]: ts=2026-09-20T09:04:35Z level=info event=scheduler_connected addr=lb:500513701worker2 # [ 27.486618] nix-grpc-daemon[778]: ts=2026-09-20T09:04:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3702worker1 # [ 27.458818] nix-grpc-daemon[774]: ts=2026-09-20T09:04:35Z level=info event=scheduler_connected addr=lb:500513703worker1 # [ 27.464476] nix-grpc-daemon[774]: ts=2026-09-20T09:04:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3704worker2 # [ 27.687737] nix-grpc-daemon[778]: ts=2026-09-20T09:04:35Z level=info event=scheduler_connected addr=lb:500513705worker2 # [ 27.693497] nix-grpc-daemon[778]: ts=2026-09-20T09:04:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3706worker1 # [ 27.665404] nix-grpc-daemon[774]: ts=2026-09-20T09:04:35Z level=info event=scheduler_connected addr=lb:500513707worker1 # [ 27.670758] nix-grpc-daemon[774]: ts=2026-09-20T09:04:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3708worker2 # [ 27.895934] nix-grpc-daemon[778]: ts=2026-09-20T09:04:35Z level=info event=scheduler_connected addr=lb:500513709worker2 # [ 27.901228] nix-grpc-daemon[778]: ts=2026-09-20T09:04:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3710worker1 # [ 27.872861] nix-grpc-daemon[774]: ts=2026-09-20T09:04:35Z level=info event=scheduler_connected addr=lb:500513711worker1 # [ 27.878022] nix-grpc-daemon[774]: ts=2026-09-20T09:04:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3712worker2 # [ 28.102085] nix-grpc-daemon[778]: ts=2026-09-20T09:04:35Z level=info event=scheduler_connected addr=lb:500513713worker2 # [ 28.107648] nix-grpc-daemon[778]: ts=2026-09-20T09:04:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3714worker1 # [ 28.078974] nix-grpc-daemon[774]: ts=2026-09-20T09:04:35Z level=info event=scheduler_connected addr=lb:500513715worker1 # [ 28.084346] nix-grpc-daemon[774]: ts=2026-09-20T09:04:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3716worker2 # [ 28.308527] nix-grpc-daemon[778]: ts=2026-09-20T09:04:35Z level=info event=scheduler_connected addr=lb:500513717worker2 # [ 28.313897] nix-grpc-daemon[778]: ts=2026-09-20T09:04:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3718worker1 # [ 28.284910] nix-grpc-daemon[774]: ts=2026-09-20T09:04:35Z level=info event=scheduler_connected addr=lb:500513719worker1 # [ 28.290262] nix-grpc-daemon[774]: ts=2026-09-20T09:04:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3720worker2 # [ 28.515029] nix-grpc-daemon[778]: ts=2026-09-20T09:04:36Z level=info event=scheduler_connected addr=lb:500513721worker2 # [ 28.520992] nix-grpc-daemon[778]: ts=2026-09-20T09:04:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3722worker1 # [ 28.491046] nix-grpc-daemon[774]: ts=2026-09-20T09:04:36Z level=info event=scheduler_connected addr=lb:500513723worker1 # [ 28.496665] nix-grpc-daemon[774]: ts=2026-09-20T09:04:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3724worker2 # [ 28.721455] nix-grpc-daemon[778]: ts=2026-09-20T09:04:36Z level=info event=scheduler_connected addr=lb:500513725worker2 # [ 28.725844] nix-grpc-daemon[778]: ts=2026-09-20T09:04:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3726worker1 # [ 28.697458] nix-grpc-daemon[774]: ts=2026-09-20T09:04:36Z level=info event=scheduler_connected addr=lb:500513727worker1 # [ 28.708365] nix-grpc-daemon[774]: ts=2026-09-20T09:04:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3728worker2 # [ 28.928315] nix-grpc-daemon[778]: ts=2026-09-20T09:04:36Z level=info event=scheduler_connected addr=lb:500513729worker2 # [ 28.933616] nix-grpc-daemon[778]: ts=2026-09-20T09:04:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3730worker1 # [ 28.905600] nix-grpc-daemon[774]: ts=2026-09-20T09:04:36Z level=info event=scheduler_connected addr=lb:500513731worker1 # [ 28.911374] nix-grpc-daemon[774]: ts=2026-09-20T09:04:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3732worker2 # [ 29.134350] nix-grpc-daemon[778]: ts=2026-09-20T09:04:36Z level=info event=scheduler_connected addr=lb:500513733worker2 # [ 29.140576] nix-grpc-daemon[778]: ts=2026-09-20T09:04:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3734worker1 # [ 29.112220] nix-grpc-daemon[774]: ts=2026-09-20T09:04:36Z level=info event=scheduler_connected addr=lb:500513735worker1 # [ 29.117752] nix-grpc-daemon[774]: ts=2026-09-20T09:04:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3736worker2 # [ 29.341745] nix-grpc-daemon[778]: ts=2026-09-20T09:04:36Z level=info event=scheduler_connected addr=lb:500513737worker2 # [ 29.347197] nix-grpc-daemon[778]: ts=2026-09-20T09:04:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3738worker1 # [ 29.318624] nix-grpc-daemon[774]: ts=2026-09-20T09:04:36Z level=info event=scheduler_connected addr=lb:500513739worker1 # [ 29.323874] nix-grpc-daemon[774]: ts=2026-09-20T09:04:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3740worker2 # [ 29.547784] nix-grpc-daemon[778]: ts=2026-09-20T09:04:37Z level=info event=scheduler_connected addr=lb:500513741worker2 # [ 29.551307] nix-grpc-daemon[778]: ts=2026-09-20T09:04:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3742worker1 # [ 29.524577] nix-grpc-daemon[774]: ts=2026-09-20T09:04:37Z level=info event=scheduler_connected addr=lb:500513743worker1 # [ 29.529985] nix-grpc-daemon[774]: ts=2026-09-20T09:04:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3744worker2 # [ 29.752631] nix-grpc-daemon[778]: ts=2026-09-20T09:04:37Z level=info event=scheduler_connected addr=lb:500513745worker2 # [ 29.757883] nix-grpc-daemon[778]: ts=2026-09-20T09:04:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3746worker1 # [ 29.730519] nix-grpc-daemon[774]: ts=2026-09-20T09:04:37Z level=info event=scheduler_connected addr=lb:500513747worker1 # [ 29.735988] nix-grpc-daemon[774]: ts=2026-09-20T09:04:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3748worker2 # [ 29.960230] nix-grpc-daemon[778]: ts=2026-09-20T09:04:37Z level=info event=scheduler_connected addr=lb:500513749worker2 # [ 29.965534] nix-grpc-daemon[778]: ts=2026-09-20T09:04:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3750worker1 # [ 29.938619] nix-grpc-daemon[774]: ts=2026-09-20T09:04:37Z level=info event=scheduler_connected addr=lb:500513751worker1 # [ 29.944364] nix-grpc-daemon[774]: ts=2026-09-20T09:04:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3752worker2 # [ 30.166526] nix-grpc-daemon[778]: ts=2026-09-20T09:04:37Z level=info event=scheduler_connected addr=lb:500513753worker2 # [ 30.171911] nix-grpc-daemon[778]: ts=2026-09-20T09:04:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3754worker1 # [ 30.145229] nix-grpc-daemon[774]: ts=2026-09-20T09:04:37Z level=info event=scheduler_connected addr=lb:500513755worker1 # [ 30.151025] nix-grpc-daemon[774]: ts=2026-09-20T09:04:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3756worker2 # [ 30.372713] nix-grpc-daemon[778]: ts=2026-09-20T09:04:38Z level=info event=scheduler_connected addr=lb:500513757worker2 # [ 30.378602] nix-grpc-daemon[778]: ts=2026-09-20T09:04:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3758worker1 # [ 30.351543] nix-grpc-daemon[774]: ts=2026-09-20T09:04:37Z level=info event=scheduler_connected addr=lb:500513759worker1 # [ 30.357008] nix-grpc-daemon[774]: ts=2026-09-20T09:04:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3760worker2 # [ 30.579484] nix-grpc-daemon[778]: ts=2026-09-20T09:04:38Z level=info event=scheduler_connected addr=lb:500513761worker2 # [ 30.584978] nix-grpc-daemon[778]: ts=2026-09-20T09:04:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3762worker1 # [ 30.557869] nix-grpc-daemon[774]: ts=2026-09-20T09:04:38Z level=info event=scheduler_connected addr=lb:500513763worker1 # [ 30.563177] nix-grpc-daemon[774]: ts=2026-09-20T09:04:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3764worker2 # [ 30.785686] nix-grpc-daemon[778]: ts=2026-09-20T09:04:38Z level=info event=scheduler_connected addr=lb:500513765worker2 # [ 30.790977] nix-grpc-daemon[778]: ts=2026-09-20T09:04:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3766worker1 # [ 30.763601] nix-grpc-daemon[774]: ts=2026-09-20T09:04:38Z level=info event=scheduler_connected addr=lb:500513767worker1 # [ 30.769096] nix-grpc-daemon[774]: ts=2026-09-20T09:04:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3768worker2 # [ 30.993248] nix-grpc-daemon[778]: ts=2026-09-20T09:04:38Z level=info event=scheduler_connected addr=lb:500513769worker2 # [ 30.998398] nix-grpc-daemon[778]: ts=2026-09-20T09:04:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3770worker1 # [ 30.971233] nix-grpc-daemon[774]: ts=2026-09-20T09:04:38Z level=info event=scheduler_connected addr=lb:500513771worker1 # [ 30.976577] nix-grpc-daemon[774]: ts=2026-09-20T09:04:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3772worker2 # [ 31.199384] nix-grpc-daemon[778]: ts=2026-09-20T09:04:38Z level=info event=scheduler_connected addr=lb:500513773worker2 # [ 31.204971] nix-grpc-daemon[778]: ts=2026-09-20T09:04:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3774worker1 # [ 31.177269] nix-grpc-daemon[774]: ts=2026-09-20T09:04:38Z level=info event=scheduler_connected addr=lb:500513775worker1 # [ 31.182652] nix-grpc-daemon[774]: ts=2026-09-20T09:04:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3776worker2 # [ 31.405820] nix-grpc-daemon[778]: ts=2026-09-20T09:04:39Z level=info event=scheduler_connected addr=lb:500513777worker2 # [ 31.411213] nix-grpc-daemon[778]: ts=2026-09-20T09:04:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3778worker1 # [ 31.383477] nix-grpc-daemon[774]: ts=2026-09-20T09:04:39Z level=info event=scheduler_connected addr=lb:500513779worker1 # [ 31.388857] nix-grpc-daemon[774]: ts=2026-09-20T09:04:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3780worker2 # [ 31.611999] nix-grpc-daemon[778]: ts=2026-09-20T09:04:39Z level=info event=scheduler_connected addr=lb:500513781worker2 # [ 31.617541] nix-grpc-daemon[778]: ts=2026-09-20T09:04:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3782worker1 # [ 31.589472] nix-grpc-daemon[774]: ts=2026-09-20T09:04:39Z level=info event=scheduler_connected addr=lb:500513783worker1 # [ 31.594849] nix-grpc-daemon[774]: ts=2026-09-20T09:04:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3784worker2 # [ 31.818444] nix-grpc-daemon[778]: ts=2026-09-20T09:04:39Z level=info event=scheduler_connected addr=lb:500513785worker2 # [ 31.824186] nix-grpc-daemon[778]: ts=2026-09-20T09:04:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3786worker1 # [ 31.795970] nix-grpc-daemon[774]: ts=2026-09-20T09:04:39Z level=info event=scheduler_connected addr=lb:500513787worker1 # [ 31.801551] nix-grpc-daemon[774]: ts=2026-09-20T09:04:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3788worker2 # [ 32.027211] nix-grpc-daemon[778]: ts=2026-09-20T09:04:39Z level=info event=scheduler_connected addr=lb:500513789worker1 # [ 32.006245] nix-grpc-daemon[774]: ts=2026-09-20T09:04:39Z level=info event=scheduler_connected addr=lb:500513790worker2 # [ 32.041367] nix-grpc-daemon[778]: ts=2026-09-20T09:04:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3791worker1 # [ 32.017887] nix-grpc-daemon[774]: ts=2026-09-20T09:04:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3792worker2 # [ 32.236080] nix-grpc-daemon[778]: ts=2026-09-20T09:04:39Z level=info event=scheduler_connected addr=lb:500513793worker1 # [ 32.207167] nix-grpc-daemon[774]: ts=2026-09-20T09:04:39Z level=info event=scheduler_connected addr=lb:500513794worker2 # [ 32.242307] nix-grpc-daemon[778]: ts=2026-09-20T09:04:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3795worker1 # [ 32.216410] nix-grpc-daemon[774]: ts=2026-09-20T09:04:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3796worker2 # [ 32.443691] nix-grpc-daemon[778]: ts=2026-09-20T09:04:40Z level=info event=scheduler_connected addr=lb:500513797worker2 # [ 32.450199] nix-grpc-daemon[778]: ts=2026-09-20T09:04:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3798worker1 # [ 32.418341] nix-grpc-daemon[774]: ts=2026-09-20T09:04:40Z level=info event=scheduler_connected addr=lb:500513799worker1 # [ 32.426928] nix-grpc-daemon[774]: ts=2026-09-20T09:04:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3800worker2 # [ 32.651020] nix-grpc-daemon[778]: ts=2026-09-20T09:04:40Z level=info event=scheduler_connected addr=lb:500513801worker2 # [ 32.656945] nix-grpc-daemon[778]: ts=2026-09-20T09:04:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3802worker1 # [ 32.628298] nix-grpc-daemon[774]: ts=2026-09-20T09:04:40Z level=info event=scheduler_connected addr=lb:500513803worker1 # [ 32.634393] nix-grpc-daemon[774]: ts=2026-09-20T09:04:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3804worker2 # [ 32.858022] nix-grpc-daemon[778]: ts=2026-09-20T09:04:40Z level=info event=scheduler_connected addr=lb:500513805worker2 # [ 32.863910] nix-grpc-daemon[778]: ts=2026-09-20T09:04:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3806worker1 # [ 32.835651] nix-grpc-daemon[774]: ts=2026-09-20T09:04:40Z level=info event=scheduler_connected addr=lb:500513807worker1 # [ 32.841414] nix-grpc-daemon[774]: ts=2026-09-20T09:04:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3808worker2 # [ 33.066028] nix-grpc-daemon[778]: ts=2026-09-20T09:04:40Z level=info event=scheduler_connected addr=lb:500513809worker2 # [ 33.071182] nix-grpc-daemon[778]: ts=2026-09-20T09:04:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3810worker1 # [ 33.043963] nix-grpc-daemon[774]: ts=2026-09-20T09:04:40Z level=info event=scheduler_connected addr=lb:500513811worker1 # [ 33.049428] nix-grpc-daemon[774]: ts=2026-09-20T09:04:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3812worker2 # [ 33.272140] nix-grpc-daemon[778]: ts=2026-09-20T09:04:40Z level=info event=scheduler_connected addr=lb:500513813worker2 # [ 33.277494] nix-grpc-daemon[778]: ts=2026-09-20T09:04:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3814worker1 # [ 33.246035] nix-grpc-daemon[774]: ts=2026-09-20T09:04:40Z level=info event=scheduler_connected addr=lb:500513815worker1 # [ 33.251824] nix-grpc-daemon[774]: ts=2026-09-20T09:04:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3816lb # [ 33.321648] rustfs-bucket-start[1040]: mb s3://farm3817lb # [ 33.332840] systemd[1]: Finished rustfs-bucket.service.3818lb # [ 33.348744] systemd[1]: Starting niks3 server...3819worker2 # [ 33.478594] nix-grpc-daemon[778]: ts=2026-09-20T09:04:41Z level=info event=scheduler_connected addr=lb:500513820worker2 # [ 33.483882] nix-grpc-daemon[778]: ts=2026-09-20T09:04:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3821worker1 # [ 33.452909] nix-grpc-daemon[774]: ts=2026-09-20T09:04:41Z level=info event=scheduler_connected addr=lb:500513822worker1 # [ 33.458405] nix-grpc-daemon[774]: ts=2026-09-20T09:04:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3823lb # [ 33.565289] postgres[1056]: [1056] ERROR: relation "goose_db_version" does not exist at character 363824lb # [ 33.566600] postgres[1056]: [1056] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3825lb # [ 33.596946] niks3-server[1051]: 2026/09/20 09:04:41 OK 20241026095416_initial_model.sql (18.31ms)3826lb # [ 33.600352] niks3-server[1051]: 2026/09/20 09:04:41 OK 20251210153512_drop_unused_gin_index.sql (1.87ms)3827lb # [ 33.606039] niks3-server[1051]: 2026/09/20 09:04:41 OK 20251218171726_add_pins.sql (5.63ms)3828lb # [ 33.612242] niks3-server[1051]: 2026/09/20 09:04:41 OK 20260628120000_add_object_size_and_stats.sql (6.16ms)3829lb # [ 33.620192] niks3-server[1051]: 2026/09/20 09:04:41 OK 20260905000000_add_claims.sql (7.72ms)3830lb # [ 33.629822] niks3-server[1051]: 2026/09/20 09:04:41 OK 20260920000000_drop_claims.sql (7.95ms)3831lb # [ 33.631722] niks3-server[1051]: 2026/09/20 09:04:41 goose: successfully migrated database to version: 202609200000003832lb # [ 33.637815] niks3-server[1051]: 2026/09/20 09:04:41 OK 1_commit_pending_closure.sql (9.11ms)3833lb # [ 33.640051] niks3-server[1051]: 2026/09/20 09:04:41 OK 2_object_stats_trigger.sql (2.59ms)3834lb # [ 33.641614] niks3-server[1051]: 2026/09/20 09:04:41 goose: up to current file version: 23835lb # [ 33.646591] niks3-server[1051]: 2026/09/20 09:04:41 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3836worker2 # [ 33.684698] nix-grpc-daemon[778]: ts=2026-09-20T09:04:41Z level=info event=scheduler_connected addr=lb:500513837worker2 # [ 33.691211] nix-grpc-daemon[778]: ts=2026-09-20T09:04:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3838worker1 # [ 33.658939] nix-grpc-daemon[774]: ts=2026-09-20T09:04:41Z level=info event=scheduler_connected addr=lb:500513839worker1 # [ 33.665450] nix-grpc-daemon[774]: ts=2026-09-20T09:04:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3840lb # [ 33.702399] niks3-server[1051]: 2026/09/20 09:04:41 INFO Read proxy enabled — serving cache objects from S33841lb # [ 33.704461] niks3-server[1051]: 2026/09/20 09:04:41 INFO Using socket-activated listener address=0.0.0.0:57513842lb # [ 33.708481] niks3-server[1051]: 2026/09/20 09:04:41 INFO systemd watchdog enabled interval=15s3843lb # [ 33.712042] systemd[1]: Started niks3 server.3844lb # [ 33.712738] niks3-server[1051]: 2026/09/20 09:04:41 INFO Starting HTTP server address=0.0.0.0:57513845lb # [ 33.716627] systemd[1]: Reached target Multi-User System.3846lb # [ 33.720879] systemd[1]: Startup finished in 933ms (kernel) + 5.446s (initrd) + 27.330s (userspace) = 33.710s.3847lb # [ 33.722235] niks3-server[1051]: 2026/09/20 09:04:41 INFO lead: acquired remote=192.168.1.3:435663848worker1 # [ 33.694047] nix-grpc-daemon[774]: ts=2026-09-20T09:04:41Z level=info event=scheduler_take_over3849worker2 # [ 33.891975] nix-grpc-daemon[778]: ts=2026-09-20T09:04:41Z level=info event=scheduler_connected addr=lb:500513850worker1 # [ 33.860509] nix-grpc-daemon[774]: ts=2026-09-20T09:04:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03851worker1 # [ 33.866744] nix-grpc-daemon[774]: ts=2026-09-20T09:04:41Z level=info event=scheduler_connected addr=lb:500513852worker1 # [ 33.871968] nix-grpc-daemon[774]: ts=2026-09-20T09:04:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3853worker1 # [ 34.075731] nix-grpc-daemon[774]: ts=2026-09-20T09:04:41Z level=info event=scheduler_connected addr=lb:500513854worker1 # [ 34.080150] nix-grpc-daemon[774]: ts=2026-09-20T09:04:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03855lb: (finished: waiting for unit niks3.service, in 21.49 seconds)3856lb: waiting for TCP port 5751 on localhost3857lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3858lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds)3859lb: waiting for unit envoy.service3860lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3861lb: waiting for TCP port 50051 on localhost3862lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3863lb # [ 35.013976] envoy[912]: conn peer=[::1]:58296 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33864lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3865lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3866lb: must succeed: curl -sf localhost:9901/clusters3867lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3868lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)3869subtest: one node schedules and both builders hold a WorkerSession on it3870lb: must succeed: curl -sf localhost:9901/clusters3871lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3872worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3873worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.12 seconds)3874lb: must succeed: curl -sf localhost:9901/clusters3875lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3876lb: must succeed: curl -sf localhost:9901/clusters3877lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3878worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true3879worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.09 seconds)3880lb: must succeed: curl -sf localhost:9901/clusters3881lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3882lb: must succeed: curl -sf localhost:9901/clusters3883lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3884worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true3885worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.10 seconds)3886worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true3887worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true, in 0.10 seconds)3888worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true3889worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true, in 0.06 seconds)3890worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true3891worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true, in 0.05 seconds)3892(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.86 seconds)3893subtest: balancer auth: client cert, bearer token, nothing, unknown CN3894worker2 # [ 36.545564] nix-grpc-daemon[778]: ts=2026-09-20T09:04:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:486363895worker2 # [ 36.557371] systemd[1]: Started Nix Daemon.3896worker2 # [ 36.846436] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3897worker2 # [ 36.890603] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5)3898worker2 # [ 36.969071] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 2/5)3899worker2 # [ 36.988473] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 151 ms (attempt 3/5)3900worker2 # [ 37.147069] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 395 ms (attempt 4/5)3901worker2 # [ 37.553205] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3902worker1 # [ 37.561799] nix-grpc-daemon[774]: ts=2026-09-20T09:04:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552683903worker1 # [ 37.574613] systemd[1]: Started Nix Daemon.3904worker1 # [ 37.857433] nix-daemon[861]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3905worker1 # [ 37.888294] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 1/5)3906worker1 # [ 37.947631] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 104 ms (attempt 2/5)3907worker1 # [ 38.052152] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 3/5)3908worker1 # [ 38.151715] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 438 ms (attempt 4/5)3909worker1 # [ 38.601720] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3910worker1 # [ 38.618552] nix-grpc-daemon[774]: ts=2026-09-20T09:04:46Z level=debug event=path_info_miss path=xhp7hdmnyckpg762n4vd2n1aspzkff7a-nixos-system-client-test error="error: path '/nix/store/xhp7hdmnyckpg762n4vd2n1aspzkff7a-nixos-system-client-test' is required, but there is no substituter that can build it"3911worker1 # [ 38.637962] nix-grpc-daemon[774]: ts=2026-09-20T09:04:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552683912worker1 # [ 38.648818] nix-grpc-daemon[774]: ts=2026-09-20T09:04:46Z level=debug event=path_info_miss path=xhp7hdmnyckpg762n4vd2n1aspzkff7a-nixos-system-client-test error="error: path '/nix/store/xhp7hdmnyckpg762n4vd2n1aspzkff7a-nixos-system-client-test' is required, but there is no substituter that can build it"3913client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3914client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)3915client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3916client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds)3917worker1 # [ 39.110604] nix-grpc-daemon[774]: ts=2026-09-20T09:04:46Z level=info event=oidc_jwks provider=mock keys=13918worker1 # [ 39.117213] nix-grpc-daemon[774]: ts=2026-09-20T09:04:46Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:552683919worker2 # [ 39.193301] nix-grpc-daemon[778]: ts=2026-09-20T09:04:46Z level=info event=oidc_jwks provider=mock keys=13920worker2 # [ 39.199420] nix-grpc-daemon[778]: ts=2026-09-20T09:04:46Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:486363921worker1 # [ 39.185084] nix-grpc-daemon[774]: ts=2026-09-20T09:04:46Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:552683922worker2 # [ 39.215005] nix-grpc-daemon[778]: ts=2026-09-20T09:04:46Z level=debug event=path_info_miss path=xhp7hdmnyckpg762n4vd2n1aspzkff7a-nixos-system-client-test error="error: path '/nix/store/xhp7hdmnyckpg762n4vd2n1aspzkff7a-nixos-system-client-test' is required, but there is no substituter that can build it"3923worker1 # [ 39.198710] nix-grpc-daemon[774]: ts=2026-09-20T09:04:46Z level=debug event=path_info_miss path=xhp7hdmnyckpg762n4vd2n1aspzkff7a-nixos-system-client-test error="error: path '/nix/store/xhp7hdmnyckpg762n4vd2n1aspzkff7a-nixos-system-client-test' is required, but there is no substituter that can build it"3924lb # [ 41.255590] envoy[912]: conn peer=[2001:db8:1::1]:33006 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=21973925client: must succeed: rm -r /var/lib/nix-grpc-store3926client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3927worker1 # [ 41.564918] nix-grpc-daemon[774]: ts=2026-09-20T09:04:49Z level=info event=denied method=QueryMissing cn=- role=none3928worker1 # [ 41.809999] nix-grpc-daemon[774]: ts=2026-09-20T09:04:49Z level=info event=denied method=QueryMissing cn=stranger role=none3929(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.70 seconds)3930subtest: DAG build is scheduled across workers and lands in the cache3931client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23932lb # [ 41.261136] envoy[912]: conn peer=[2001:db8:1::1]:33018 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1153933worker1 # [ 42.055140] nix-grpc-daemon[774]: ts=2026-09-20T09:04:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552683934client # don't know how to build these paths:3935client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3936worker1 # [ 42.068981] nix-grpc-daemon[774]: ts=2026-09-20T09:04:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552683937worker1 # [ 42.100203] nix-grpc-daemon[774]: ts=2026-09-20T09:04:49Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03938worker1 # [ 42.103791] nix-grpc-daemon[774]: ts=2026-09-20T09:04:49Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=13939worker2 # [ 42.193223] nix-grpc-daemon[778]: ts=2026-09-20T09:04:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486363940worker2 # [ 42.214345] nix-grpc-daemon[778]: ts=2026-09-20T09:04:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486363941client # copying 1 paths to 'lb:50051'...3942worker2 # [ 42.231302] nix-grpc-daemon[778]: ts=2026-09-20T09:04:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486363943client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3944worker2 # [ 42.258093] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3945worker2 # [ 42.296560] nix-grpc-daemon[778]: ts=2026-09-20T09:04:49Z level=info event=niks3_push_started pid=8533946worker2 # [ 42.775331] nix-daemon[842]: accepted connection from pid 866, user nix-grpc-daemon (trusted)3947worker2 # [ 42.795011] nix-daemon[842]: reaped child process 869, status = succeeded3948worker2 # [ 42.973546] nix-daemon[842]: accepted connection from pid 871, user nix-grpc-daemon (trusted)3949worker2 # [ 42.991698] nix-daemon[842]: reaped child process 874, status = succeeded3950lb # [ 42.997295] niks3-server[1051]: 2026/09/20 09:04:50 INFO Received uploads request method=POST path=/api/pending_closures3951worker2 # [ 43.034239] nix-grpc-daemon[853]: time=2026-09-20T09:04:50.669Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3952worker2 # [ 43.035930] nix-grpc-daemon[853]: time=2026-09-20T09:04:50.669Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3953lb # [ 43.075127] niks3-server[1051]: 2026/09/20 09:04:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3954lb # [ 43.083738] niks3-server[1051]: 2026/09/20 09:04:50 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3955lb # [ 43.116344] niks3-server[1051]: 2026/09/20 09:04:50 INFO Signed narinfos id=1 count=13956worker2 # [ 43.128135] nix-grpc-daemon[853]: time=2026-09-20T09:04:50.765Z level=INFO msg="Uploading 1 narinfos"3957lb # [ 43.129736] niks3-server[1051]: 2026/09/20 09:04:50 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3958lb # [ 43.134510] niks3-server[1051]: 2026/09/20 09:04:50 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3959lb # [ 43.145652] niks3-server[1051]: 2026/09/20 09:04:50 INFO Completed upload id=13960worker2 # [ 43.154961] nix-grpc-daemon[853]: time=2026-09-20T09:04:50.792Z level=INFO msg="Upload complete. (569ms)"3961lb # [ 43.153048] niks3-server[1051]: 2026/09/20 09:04:50 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3962worker2 # [ 43.166633] nix-grpc-daemon[778]: ts=2026-09-20T09:04:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_in=5043963worker2 # [ 43.181089] nix-grpc-daemon[778]: ts=2026-09-20T09:04:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486363964worker2 # [ 43.194014] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3965worker2 # [ 43.200964] nix-daemon[842]: reaped child process 851, status = succeeded3966client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3967client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3968worker2 # [ 43.214865] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3969client # farm-a> LOG-farm-a-t13970worker2 # [ 44.661078] nix-daemon[842]: reaped child process 878, status = succeeded3971worker2 # [ 44.838369] nix-daemon[842]: accepted connection from pid 893, user nix-grpc-daemon (trusted)3972worker2 # [ 44.858666] nix-daemon[842]: reaped child process 896, status = succeeded3973lb # [ 44.863008] niks3-server[1051]: 2026/09/20 09:04:52 INFO Received uploads request method=POST path=/api/pending_closures3974worker2 # [ 44.888146] nix-grpc-daemon[853]: time=2026-09-20T09:04:52.524Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3975worker2 # [ 44.890162] nix-grpc-daemon[853]: time=2026-09-20T09:04:52.524Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3976lb # [ 44.910356] niks3-server[1051]: 2026/09/20 09:04:52 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3977lb # [ 44.922229] niks3-server[1051]: 2026/09/20 09:04:52 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3978lb # [ 44.943915] niks3-server[1051]: 2026/09/20 09:04:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3979lb # [ 44.950469] niks3-server[1051]: 2026/09/20 09:04:52 INFO Signed narinfos id=2 count=13980worker2 # [ 44.960157] nix-grpc-daemon[853]: time=2026-09-20T09:04:52.596Z level=INFO msg="Uploading 1 narinfos"3981lb # [ 44.955509] niks3-server[1051]: 2026/09/20 09:04:52 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3982lb # [ 44.968593] niks3-server[1051]: 2026/09/20 09:04:52 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3983lb # [ 44.983488] niks3-server[1051]: 2026/09/20 09:04:52 INFO Completed upload id=23984worker2 # [ 44.992638] nix-grpc-daemon[853]: time=2026-09-20T09:04:52.630Z level=INFO msg="Upload complete. (365ms)"3985lb # [ 44.986990] niks3-server[1051]: 2026/09/20 09:04:52 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3986worker2 # [ 45.005298] nix-grpc-daemon[778]: ts=2026-09-20T09:04:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13987worker1 # [ 44.983273] nix-grpc-daemon[774]: ts=2026-09-20T09:04:52Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03988worker2 # [ 45.025809] nix-daemon[842]: reaped child process 876, status = succeeded3989worker1 # [ 44.989447] nix-grpc-daemon[774]: ts=2026-09-20T09:04:52Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=13990worker2 # [ 45.071053] nix-grpc-daemon[778]: ts=2026-09-20T09:04:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486363991worker2 # [ 45.087250] nix-grpc-daemon[778]: ts=2026-09-20T09:04:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486363992worker2 # [ 45.102805] nix-grpc-daemon[853]: time=2026-09-20T09:04:52.740Z level=INFO msg="All 1 paths already cached"3993client # copying 1 paths to 'lb:50051'...3994worker2 # [ 45.113042] nix-grpc-daemon[778]: ts=2026-09-20T09:04:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486363995client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3996worker2 # [ 45.135432] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3997worker2 # [ 45.373067] nix-daemon[842]: accepted connection from pid 900, user nix-grpc-daemon (trusted)3998worker2 # [ 45.402860] nix-daemon[842]: reaped child process 903, status = succeeded3999worker2 # [ 45.583889] nix-daemon[842]: accepted connection from pid 905, user nix-grpc-daemon (trusted)4000worker2 # [ 45.602544] nix-daemon[842]: reaped child process 909, status = succeeded4001lb # [ 45.606830] niks3-server[1051]: 2026/09/20 09:04:53 INFO Received uploads request method=POST path=/api/pending_closures4002worker2 # [ 45.628075] nix-grpc-daemon[853]: time=2026-09-20T09:04:53.265Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4003worker2 # [ 45.629561] nix-grpc-daemon[853]: time=2026-09-20T09:04:53.265Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"4004lb # [ 45.637273] niks3-server[1051]: 2026/09/20 09:04:53 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst4005lb # [ 45.651786] niks3-server[1051]: 2026/09/20 09:04:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4006worker2 # [ 45.667220] nix-grpc-daemon[853]: time=2026-09-20T09:04:53.304Z level=INFO msg="Uploading 1 narinfos"4007lb # [ 45.664388] niks3-server[1051]: 2026/09/20 09:04:53 INFO Signed narinfos id=3 count=14008lb # [ 45.670269] niks3-server[1051]: 2026/09/20 09:04:53 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls4009lb # [ 45.679912] niks3-server[1051]: 2026/09/20 09:04:53 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4010worker2 # [ 45.693265] nix-grpc-daemon[853]: time=2026-09-20T09:04:53.331Z level=INFO msg="Upload complete. (540ms)"4011lb # [ 45.685056] niks3-server[1051]: 2026/09/20 09:04:53 INFO Completed upload id=34012lb # [ 45.688640] niks3-server[1051]: 2026/09/20 09:04:53 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo4013worker2 # [ 45.700297] nix-grpc-daemon[778]: ts=2026-09-20T09:04:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_in=6244014worker2 # [ 45.708688] nix-grpc-daemon[778]: ts=2026-09-20T09:04:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364015worker2 # [ 45.722929] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4016worker2 # [ 45.726377] nix-daemon[842]: reaped child process 898, status = succeeded4017client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...4018worker2 # [ 45.737447] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4019client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4020client # farm-b> LOG-farm-b-t14021worker2 # [ 46.961773] nix-daemon[842]: reaped child process 913, status = succeeded4022worker2 # [ 47.124753] nix-daemon[842]: accepted connection from pid 928, user nix-grpc-daemon (trusted)4023worker2 # [ 47.145657] nix-daemon[842]: reaped child process 931, status = succeeded4024lb # [ 47.149695] niks3-server[1051]: 2026/09/20 09:04:54 INFO Received uploads request method=POST path=/api/pending_closures4025worker2 # [ 47.169785] nix-grpc-daemon[853]: time=2026-09-20T09:04:54.806Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4026worker2 # [ 47.171298] nix-grpc-daemon[853]: time=2026-09-20T09:04:54.806Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"4027lb # [ 47.190919] niks3-server[1051]: 2026/09/20 09:04:54 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4028worker2 # [ 47.212553] nix-grpc-daemon[853]: time=2026-09-20T09:04:54.850Z level=INFO msg="Uploading 1 narinfos"4029lb # [ 47.206933] niks3-server[1051]: 2026/09/20 09:04:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4030lb # [ 47.216190] niks3-server[1051]: 2026/09/20 09:04:54 INFO Signed narinfos id=4 count=14031lb # [ 47.218495] niks3-server[1051]: 2026/09/20 09:04:54 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst4032lb # [ 47.224255] niks3-server[1051]: 2026/09/20 09:04:54 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls4033lb # [ 47.231751] niks3-server[1051]: 2026/09/20 09:04:54 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4034lb # [ 47.236295] niks3-server[1051]: 2026/09/20 09:04:54 INFO Completed upload id=44035worker2 # [ 47.244372] nix-grpc-daemon[853]: time=2026-09-20T09:04:54.882Z level=INFO msg="Upload complete. (295ms)"4036lb # [ 47.239006] niks3-server[1051]: 2026/09/20 09:04:54 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo4037worker2 # [ 47.257005] nix-grpc-daemon[778]: ts=2026-09-20T09:04:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=14038worker1 # [ 47.229177] nix-grpc-daemon[774]: ts=2026-09-20T09:04:54Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=04039worker2 # [ 47.272259] nix-daemon[842]: reaped child process 911, status = succeeded4040worker1 # [ 47.229605] nix-grpc-daemon[774]: ts=2026-09-20T09:04:54Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=14041worker2 # [ 47.310311] nix-grpc-daemon[778]: ts=2026-09-20T09:04:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364042worker2 # [ 47.326576] nix-grpc-daemon[778]: ts=2026-09-20T09:04:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486364043worker2 # [ 47.342337] nix-grpc-daemon[853]: time=2026-09-20T09:04:54.980Z level=INFO msg="All 2 paths already cached"4044client # copying 1 paths to 'lb:50051'...4045worker2 # [ 47.352853] nix-grpc-daemon[778]: ts=2026-09-20T09:04:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486364046client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4047worker2 # [ 47.382027] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4048worker2 # [ 47.596271] nix-daemon[842]: accepted connection from pid 935, user nix-grpc-daemon (trusted)4049worker2 # [ 47.614838] nix-daemon[842]: reaped child process 938, status = succeeded4050worker2 # [ 47.792175] nix-daemon[842]: accepted connection from pid 940, user nix-grpc-daemon (trusted)4051worker2 # [ 47.809929] nix-daemon[842]: reaped child process 943, status = succeeded4052lb # [ 47.814323] niks3-server[1051]: 2026/09/20 09:04:55 INFO Received uploads request method=POST path=/api/pending_closures4053worker2 # [ 47.834772] nix-grpc-daemon[853]: time=2026-09-20T09:04:55.472Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4054worker2 # [ 47.836363] nix-grpc-daemon[853]: time=2026-09-20T09:04:55.472Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4055lb # [ 47.844665] niks3-server[1051]: 2026/09/20 09:04:55 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4056worker2 # [ 47.868104] nix-grpc-daemon[853]: time=2026-09-20T09:04:55.505Z level=INFO msg="Uploading 1 narinfos"4057lb # [ 47.858946] niks3-server[1051]: 2026/09/20 09:04:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4058lb # [ 47.870953] niks3-server[1051]: 2026/09/20 09:04:55 INFO Signed narinfos id=5 count=14059lb # [ 47.878366] niks3-server[1051]: 2026/09/20 09:04:55 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4060lb # [ 47.886691] niks3-server[1051]: 2026/09/20 09:04:55 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4061lb # [ 47.894525] niks3-server[1051]: 2026/09/20 09:04:55 INFO Completed upload id=54062worker2 # [ 47.903307] nix-grpc-daemon[853]: time=2026-09-20T09:04:55.541Z level=INFO msg="Upload complete. (503ms)"4063lb # [ 47.897237] niks3-server[1051]: 2026/09/20 09:04:55 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4064worker2 # [ 47.912346] nix-grpc-daemon[778]: ts=2026-09-20T09:04:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_in=7524065worker2 # [ 47.926511] nix-grpc-daemon[778]: ts=2026-09-20T09:04:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364066worker2 # [ 47.932895] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4067worker2 # [ 47.938140] nix-daemon[842]: reaped child process 933, status = succeeded4068client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4069client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4070worker2 # [ 47.952721] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4071client # farm-top> LOG-farm-top-t14072worker2 # [ 49.002221] nix-daemon[842]: reaped child process 947, status = succeeded4073worker2 # [ 49.179691] nix-daemon[842]: accepted connection from pid 962, user nix-grpc-daemon (trusted)4074worker2 # [ 49.198362] nix-daemon[842]: reaped child process 965, status = succeeded4075worker2 # [ 49.224494] nix-grpc-daemon[853]: time=2026-09-20T09:04:56.860Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4076worker2 # [ 49.226338] nix-grpc-daemon[853]: time=2026-09-20T09:04:56.860Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4077lb # [ 49.203913] niks3-server[1051]: 2026/09/20 09:04:56 INFO Received uploads request method=POST path=/api/pending_closures4078worker2 # [ 49.264401] nix-grpc-daemon[853]: time=2026-09-20T09:04:56.902Z level=INFO msg="Uploading 1 narinfos"4079lb # [ 49.247136] niks3-server[1051]: 2026/09/20 09:04:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4080lb # [ 49.265065] niks3-server[1051]: 2026/09/20 09:04:56 INFO Signed narinfos id=6 count=14081lb # [ 49.274278] niks3-server[1051]: 2026/09/20 09:04:56 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4082lb # [ 49.283096] niks3-server[1051]: 2026/09/20 09:04:56 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4083lb # [ 49.291266] niks3-server[1051]: 2026/09/20 09:04:56 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4084worker2 # [ 49.304283] nix-grpc-daemon[853]: time=2026-09-20T09:04:56.942Z level=INFO msg="Upload complete. (340ms)"4085lb # [ 49.297160] niks3-server[1051]: 2026/09/20 09:04:56 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4086lb # [ 49.302596] niks3-server[1051]: 2026/09/20 09:04:56 INFO Completed upload id=64087lb # [ 49.305412] niks3-server[1051]: 2026/09/20 09:04:56 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4088worker2 # [ 49.317160] nix-grpc-daemon[778]: ts=2026-09-20T09:04:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14089worker2 # [ 49.331350] nix-daemon[842]: reaped child process 945, status = succeeded4090client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.50 seconds)4091client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4092client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds)4093client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4094client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4095client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4096client # copying 3 paths...4097client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4098client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4099client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4100client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4101(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.16 seconds)4102subtest: repeat is answered Cached by the scheduler without building4103worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4104worker1 # finding garbage collector roots...4105worker1 # deleting specified paths...4106worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4107worker1 # deleting unused links...4108worker1 # note: hard linking is currently saving 0.0 KiB4109worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)4110worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4111worker2 # finding garbage collector roots...4112worker2 # deleting specified paths...4113worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4114worker2 # deleting unused links...4115worker2 # note: hard linking is currently saving 0.0 KiB4116worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)4117client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24118client # don't know how to build these paths:4119client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4120worker1 # [ 50.836287] nix-grpc-daemon[774]: ts=2026-09-20T09:04:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552684121worker1 # [ 50.844457] nix-grpc-daemon[774]: ts=2026-09-20T09:04:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552684122worker1 # [ 50.873647] nix-grpc-daemon[774]: ts=2026-09-20T09:04:58Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14123client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.33 seconds)4124client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4125client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds)4126lb # [ 51.254999] envoy[912]: conn peer=[2001:db8:1::1]:41500 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=124127lb # [ 51.259881] envoy[912]: conn peer=[2001:db8:1::1]:41510 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=124128lb # [ 51.264832] envoy[912]: conn peer=[2001:db8:1::1]:41514 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9523 tx=3836 ms=72534129lb # [ 51.269596] envoy[912]: conn peer=[2001:db8:1::1]:57304 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=604130lb: must succeed: curl -sf localhost:9901/clusters4131lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4132lb: must succeed: curl -sf localhost:9901/clusters4133lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4134worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4135worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds)4136(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.48 seconds)4137subtest: inputs already in the cache are not sent to the scheduler4138lb: must succeed: curl -sf localhost:9901/clusters4139lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4140lb: must succeed: curl -sf localhost:9901/clusters4141lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4142worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4143worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4144client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24145worker2 # [ 51.963618] nix-grpc-daemon[778]: ts=2026-09-20T09:04:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:486364146client # don't know how to build these paths:4147client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4148worker1 # [ 51.939314] nix-grpc-daemon[774]: ts=2026-09-20T09:04:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552684149worker1 # [ 51.953233] nix-grpc-daemon[774]: ts=2026-09-20T09:04:59Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04150worker1 # [ 51.957229] nix-grpc-daemon[774]: ts=2026-09-20T09:04:59Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=14151worker2 # [ 51.991923] nix-grpc-daemon[778]: ts=2026-09-20T09:04:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364152worker2 # [ 52.007490] nix-grpc-daemon[778]: ts=2026-09-20T09:04:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486364153worker2 # [ 52.023274] nix-grpc-daemon[853]: time=2026-09-20T09:04:59.660Z level=INFO msg="All 2 paths already cached"4154client # copying 1 paths to 'lb:50051'...4155client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4156worker2 # [ 52.033284] nix-grpc-daemon[778]: ts=2026-09-20T09:04:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486364157worker2 # [ 52.049262] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4158worker2 # [ 52.257156] nix-daemon[842]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4159worker2 # [ 52.278439] nix-daemon[842]: reaped child process 985, status = succeeded4160worker2 # [ 52.455801] nix-daemon[842]: accepted connection from pid 987, user nix-grpc-daemon (trusted)4161worker2 # [ 52.476409] nix-daemon[842]: reaped child process 990, status = succeeded4162lb # [ 52.479969] niks3-server[1051]: 2026/09/20 09:05:00 INFO Received uploads request method=POST path=/api/pending_closures4163worker2 # [ 52.500083] nix-grpc-daemon[853]: time=2026-09-20T09:05:00.137Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4164worker2 # [ 52.501648] nix-grpc-daemon[853]: time=2026-09-20T09:05:00.137Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4165lb # [ 52.508667] niks3-server[1051]: 2026/09/20 09:05:00 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4166worker2 # [ 52.532448] nix-grpc-daemon[853]: time=2026-09-20T09:05:00.170Z level=INFO msg="Uploading 1 narinfos"4167lb # [ 52.524219] niks3-server[1051]: 2026/09/20 09:05:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4168lb # [ 52.536359] niks3-server[1051]: 2026/09/20 09:05:00 INFO Signed narinfos id=7 count=14169lb # [ 52.544473] niks3-server[1051]: 2026/09/20 09:05:00 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4170lb # [ 52.552205] niks3-server[1051]: 2026/09/20 09:05:00 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4171worker2 # [ 52.569168] nix-grpc-daemon[853]: time=2026-09-20T09:05:00.207Z level=INFO msg="Upload complete. (501ms)"4172lb # [ 52.560695] niks3-server[1051]: 2026/09/20 09:05:00 INFO Completed upload id=74173lb # [ 52.564802] niks3-server[1051]: 2026/09/20 09:05:00 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4174worker2 # [ 52.576158] nix-grpc-daemon[778]: ts=2026-09-20T09:05:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_in=7524175worker2 # [ 52.590943] nix-grpc-daemon[778]: ts=2026-09-20T09:05:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364176worker2 # [ 52.597800] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4177worker2 # [ 52.602653] nix-daemon[842]: reaped child process 980, status = succeeded4178client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4179worker2 # [ 52.616290] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4180client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4181client # farm-top> LOG-farm-top-t1b4182worker2 # [ 53.867693] nix-daemon[842]: reaped child process 994, status = succeeded4183worker2 # [ 54.043274] nix-daemon[842]: accepted connection from pid 1009, user nix-grpc-daemon (trusted)4184worker2 # [ 54.063501] nix-daemon[842]: reaped child process 1012, status = succeeded4185lb # [ 54.067125] niks3-server[1051]: 2026/09/20 09:05:01 INFO Received uploads request method=POST path=/api/pending_closures4186worker2 # [ 54.086276] nix-grpc-daemon[853]: time=2026-09-20T09:05:01.723Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4187worker2 # [ 54.090705] nix-grpc-daemon[853]: time=2026-09-20T09:05:01.725Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4188lb # [ 54.107246] niks3-server[1051]: 2026/09/20 09:05:01 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4189lb # [ 54.119338] niks3-server[1051]: 2026/09/20 09:05:01 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4190worker2 # [ 54.139429] nix-grpc-daemon[853]: time=2026-09-20T09:05:01.776Z level=INFO msg="Uploading 1 narinfos"4191lb # [ 54.134328] niks3-server[1051]: 2026/09/20 09:05:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4192lb # [ 54.141964] niks3-server[1051]: 2026/09/20 09:05:01 INFO Signed narinfos id=8 count=14193lb # [ 54.149992] niks3-server[1051]: 2026/09/20 09:05:01 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4194lb # [ 54.155044] niks3-server[1051]: 2026/09/20 09:05:01 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4195worker2 # [ 54.164401] nix-grpc-daemon[853]: time=2026-09-20T09:05:01.802Z level=INFO msg="Upload complete. (336ms)"4196lb # [ 54.158541] niks3-server[1051]: 2026/09/20 09:05:01 INFO Completed upload id=84197lb # [ 54.161924] niks3-server[1051]: 2026/09/20 09:05:01 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4198worker2 # [ 54.177073] nix-grpc-daemon[778]: ts=2026-09-20T09:05:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14199worker2 # [ 54.191058] nix-daemon[842]: reaped child process 992, status = succeeded4200client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.51 seconds)4201client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4202client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds)4203lb: must succeed: curl -sf localhost:9901/clusters4204lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4205lb: must succeed: curl -sf localhost:9901/clusters4206lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4207worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4208worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.08 seconds)4209(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.17 seconds)4210subtest: two clients wanting the same drv build it once4211client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4212client # [ 54.737269] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4213client # Running as unit: dedup1.service; invocation ID: 5ad5e4c9614747c682eba5a04c8eb6554214client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4215client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4216client # [ 54.999869] nix[884]: don't know how to build these paths:4217client # [ 55.001019] nix[884]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4218worker2 # [ 55.033333] nix-grpc-daemon[778]: ts=2026-09-20T09:05:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:486364219worker1 # [ 55.017261] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04220worker1 # [ 55.017706] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14221worker1 # [ 55.031626] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552684222worker1 # [ 55.053104] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552684223client # [ 55.068274] nix[884]: copying 1 paths to 'lb:50051'...4224client # [ 55.071767] nix[884]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4225worker1 # [ 55.069448] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552684226worker1 # [ 55.087024] nix-daemon[861]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4227worker1 # [ 55.119019] nix-grpc-daemon[774]: ts=2026-09-20T09:05:02Z level=info event=niks3_push_started pid=9144228worker1 # [ 55.605750] nix-daemon[861]: accepted connection from pid 927, user nix-grpc-daemon (trusted)4229worker1 # [ 55.626138] nix-daemon[861]: reaped child process 930, status = succeeded4230worker1 # [ 55.810218] nix-daemon[861]: accepted connection from pid 932, user nix-grpc-daemon (trusted)4231worker1 # [ 55.829119] nix-daemon[861]: reaped child process 935, status = succeeded4232lb # [ 55.869932] niks3-server[1051]: 2026/09/20 09:05:03 INFO Received uploads request method=POST path=/api/pending_closures4233worker1 # [ 55.858198] nix-grpc-daemon[914]: time=2026-09-20T09:05:03.501Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4234worker1 # [ 55.859806] nix-grpc-daemon[914]: time=2026-09-20T09:05:03.501Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4235client # [ 55.861788] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4236client # Running as unit: dedup2.service; invocation ID: 6b83676e56e34c9f97d34cf0bcac1b114237client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds)4238lb # [ 55.923369] niks3-server[1051]: 2026/09/20 09:05:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4239worker1 # [ 55.905324] nix-grpc-daemon[914]: time=2026-09-20T09:05:03.550Z level=INFO msg="Uploading 1 narinfos"4240lb # [ 55.934571] niks3-server[1051]: 2026/09/20 09:05:03 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4241lb # [ 55.944701] niks3-server[1051]: 2026/09/20 09:05:03 INFO Signed narinfos id=9 count=14242lb # [ 55.950288] niks3-server[1051]: 2026/09/20 09:05:03 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4243lb # [ 55.956922] niks3-server[1051]: 2026/09/20 09:05:03 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4244lb # [ 55.965679] niks3-server[1051]: 2026/09/20 09:05:03 INFO Completed upload id=94245worker1 # [ 55.942558] nix-grpc-daemon[914]: time=2026-09-20T09:05:03.584Z level=INFO msg="Upload complete. (532ms)"4246lb # [ 55.969201] niks3-server[1051]: 2026/09/20 09:05:03 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4247worker1 # [ 55.944709] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55268 duration_s=0 paths=1 nar_bytes_in=4324248worker1 # [ 55.952604] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552684249worker1 # [ 55.959820] nix-daemon[861]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4250worker1 # [ 55.970148] nix-daemon[861]: reaped child process 912, status = succeeded4251client # [ 55.978243] nix[884]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4252worker1 # [ 55.981530] nix-daemon[861]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4253worker1 # [ 56.177350] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552684254client # [ 56.195387] nix[900]: this derivation will be built:4255worker2 # [ 56.234885] nix-grpc-daemon[778]: ts=2026-09-20T09:05:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:486364256worker2 # [ 56.250307] nix-grpc-daemon[778]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' from 'http://lb:5751'...4257client # [ 56.240140] nix[900]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4258worker1 # [ 56.254944] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04259worker1 # [ 56.265004] nix-grpc-daemon[774]: ts=2026-09-20T09:05:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552684260client # [ 56.273182] nix[900]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4261client: must succeed: sleep 24262client: (finished: must succeed: sleep 2, in 2.07 seconds)4263client: waiting for success: ! systemctl is-active dedup1 dedup24264worker1 # [ 60.851810] nix-daemon[861]: reaped child process 943, status = succeeded4265worker1 # [ 61.031881] nix-daemon[861]: accepted connection from pid 974, user nix-grpc-daemon (trusted)4266worker1 # [ 61.054352] nix-daemon[861]: reaped child process 977, status = succeeded4267lb # [ 61.094991] niks3-server[1051]: 2026/09/20 09:05:08 INFO Received uploads request method=POST path=/api/pending_closures4268worker1 # [ 61.085766] nix-grpc-daemon[914]: time=2026-09-20T09:05:08.729Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4269worker1 # [ 61.087779] nix-grpc-daemon[914]: time=2026-09-20T09:05:08.729Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4270lb # [ 61.159185] niks3-server[1051]: 2026/09/20 09:05:08 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4271lb # [ 61.170411] niks3-server[1051]: 2026/09/20 09:05:08 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4272lb # [ 61.180348] niks3-server[1051]: 2026/09/20 09:05:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4273worker1 # [ 61.155470] nix-grpc-daemon[914]: time=2026-09-20T09:05:08.798Z level=INFO msg="Uploading 1 narinfos"4274lb # [ 61.184228] niks3-server[1051]: 2026/09/20 09:05:08 INFO Signed narinfos id=10 count=14275lb # [ 61.190807] niks3-server[1051]: 2026/09/20 09:05:08 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4276lb # [ 61.198886] niks3-server[1051]: 2026/09/20 09:05:08 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4277lb # [ 61.207948] niks3-server[1051]: 2026/09/20 09:05:08 INFO Completed upload id=104278worker1 # [ 61.181385] nix-grpc-daemon[914]: time=2026-09-20T09:05:08.826Z level=INFO msg="Upload complete. (380ms)"4279lb # [ 61.211158] niks3-server[1051]: 2026/09/20 09:05:08 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4280worker1 # [ 61.195566] nix-grpc-daemon[774]: ts=2026-09-20T09:05:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55268 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14281worker1 # [ 61.212491] nix-grpc-daemon[774]: ts=2026-09-20T09:05:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55268 duration_s=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14282worker1 # [ 61.219244] nix-daemon[861]: reaped child process 941, status = succeeded4283lb # [ 61.257161] envoy[912]: conn peer=[2001:db8:1::1]:57308 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4185 tx=1705 ms=22264284lb # [ 61.262306] envoy[912]: conn peer=[2001:db8:1::1]:57322 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1579 tx=1487 ms=50414285client # [ 61.240470] systemd[1]: dedup2.service: Deactivated successfully.4286client # [ 61.247028] systemd[1]: dedup2.service: Consumed 189ms CPU time over 5.383s wall clock time, 30.9M memory peak, 7.8K incoming IP traffic, 6.7K outgoing IP traffic.4287client # [ 61.297446] systemd[1]: dedup1.service: Deactivated successfully.4288client # [ 61.300709] systemd[1]: dedup1.service: Consumed 162ms CPU time over 6.564s wall clock time, 37.2M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.4289client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds)4290client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4291client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4292worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4293worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4294worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4295worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4296worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4297worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4298worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4299worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.10 seconds)4300(finished: subtest: two clients wanting the same drv build it once, in 7.63 seconds)4301subtest: build hook: nix-daemon with builders = grpc://lb4302client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4303client # [ 62.534674] systemd[1]: Started Nix Daemon.4304client # [ 62.736139] nix-daemon[942]: accepted connection from pid 939, user root (trusted)4305worker1 # [ 62.953031] nix-grpc-daemon[774]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:552684306worker1 # [ 62.960201] nix-grpc-daemon[774]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552684307worker1 # [ 62.982229] nix-grpc-daemon[774]: ts=2026-09-20T09:05:10Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04308worker1 # [ 62.988978] nix-grpc-daemon[774]: ts=2026-09-20T09:05:10Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14309worker2 # [ 63.031763] nix-grpc-daemon[778]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364310worker2 # [ 63.051528] nix-grpc-daemon[778]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486364311worker2 # [ 63.070500] nix-grpc-daemon[778]: ts=2026-09-20T09:05:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486364312worker2 # [ 63.088807] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4313worker2 # [ 63.337583] nix-daemon[842]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4314worker2 # [ 63.360173] nix-daemon[842]: reaped child process 1047, status = succeeded4315worker2 # [ 63.547931] nix-daemon[842]: accepted connection from pid 1049, user nix-grpc-daemon (trusted)4316worker2 # [ 63.566671] nix-daemon[842]: reaped child process 1052, status = succeeded4317lb # [ 63.573030] niks3-server[1051]: 2026/09/20 09:05:11 INFO Received uploads request method=POST path=/api/pending_closures4318worker2 # [ 63.594143] nix-grpc-daemon[853]: time=2026-09-20T09:05:11.230Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4319worker2 # [ 63.595664] nix-grpc-daemon[853]: time=2026-09-20T09:05:11.230Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4320lb # [ 63.607344] niks3-server[1051]: 2026/09/20 09:05:11 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4321lb # [ 63.623939] niks3-server[1051]: 2026/09/20 09:05:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4322worker2 # [ 63.640439] nix-grpc-daemon[853]: time=2026-09-20T09:05:11.278Z level=INFO msg="Uploading 1 narinfos"4323lb # [ 63.637454] niks3-server[1051]: 2026/09/20 09:05:11 INFO Signed narinfos id=11 count=14324lb # [ 63.644594] niks3-server[1051]: 2026/09/20 09:05:11 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4325lb # [ 63.655301] niks3-server[1051]: 2026/09/20 09:05:11 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4326lb # [ 63.661247] niks3-server[1051]: 2026/09/20 09:05:11 INFO Completed upload id=114327worker2 # [ 63.669512] nix-grpc-daemon[853]: time=2026-09-20T09:05:11.307Z level=INFO msg="Upload complete. (560ms)"4328lb # [ 63.664269] niks3-server[1051]: 2026/09/20 09:05:11 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4329worker2 # [ 63.681332] nix-grpc-daemon[778]: ts=2026-09-20T09:05:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_in=5124330worker2 # [ 63.688320] nix-grpc-daemon[778]: ts=2026-09-20T09:05:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364331worker2 # [ 63.700729] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4332worker2 # [ 63.706086] nix-daemon[842]: reaped child process 1042, status = succeeded4333worker2 # [ 63.720607] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4334worker2 # [ 65.169033] nix-daemon[842]: reaped child process 1056, status = succeeded4335worker2 # [ 65.351153] nix-daemon[842]: accepted connection from pid 1071, user nix-grpc-daemon (trusted)4336worker2 # [ 65.368433] nix-daemon[842]: reaped child process 1074, status = succeeded4337lb # [ 65.372814] niks3-server[1051]: 2026/09/20 09:05:13 INFO Received uploads request method=POST path=/api/pending_closures4338worker2 # [ 65.396491] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.032Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4339worker2 # [ 65.398470] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.032Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4340lb # [ 65.420406] niks3-server[1051]: 2026/09/20 09:05:13 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4341lb # [ 65.431901] niks3-server[1051]: 2026/09/20 09:05:13 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4342lb # [ 65.440798] niks3-server[1051]: 2026/09/20 09:05:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4343lb # [ 65.446667] niks3-server[1051]: 2026/09/20 09:05:13 INFO Signed narinfos id=12 count=14344worker2 # [ 65.456096] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.093Z level=INFO msg="Uploading 1 narinfos"4345lb # [ 65.449946] niks3-server[1051]: 2026/09/20 09:05:13 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4346lb # [ 65.461101] niks3-server[1051]: 2026/09/20 09:05:13 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4347lb # [ 65.469868] niks3-server[1051]: 2026/09/20 09:05:13 INFO Completed upload id=124348worker2 # [ 65.477502] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.115Z level=INFO msg="Upload complete. (344ms)"4349lb # [ 65.472921] niks3-server[1051]: 2026/09/20 09:05:13 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4350worker2 # [ 65.489141] nix-grpc-daemon[778]: ts=2026-09-20T09:05:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14351worker2 # [ 65.508333] nix-grpc-daemon[778]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:486364352worker2 # [ 65.514682] nix-daemon[842]: reaped child process 1054, status = succeeded4353worker2 # [ 65.533935] nix-grpc-daemon[778]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:486364354worker2 # [ 65.541955] nix-grpc-daemon[778]: ts=2026-09-20T09:05:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_out=1284355worker2 # [ 65.857393] nix-grpc-daemon[778]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:486364356worker2 # [ 65.864620] nix-grpc-daemon[778]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486364357worker2 # [ 65.871132] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.508Z level=INFO msg="All 1 paths already cached"4358worker1 # [ 65.850952] nix-grpc-daemon[774]: ts=2026-09-20T09:05:13Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04359worker1 # [ 65.857169] nix-grpc-daemon[774]: ts=2026-09-20T09:05:13Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14360worker2 # [ 65.929198] nix-grpc-daemon[778]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364361worker2 # [ 65.944798] nix-grpc-daemon[778]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486364362worker2 # [ 65.958897] nix-grpc-daemon[853]: time=2026-09-20T09:05:13.596Z level=INFO msg="All 1 paths already cached"4363worker2 # [ 65.967938] nix-grpc-daemon[778]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486364364worker2 # [ 65.983311] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4365worker2 # [ 66.190203] nix-daemon[842]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)4366worker2 # [ 66.209422] nix-daemon[842]: reaped child process 1081, status = succeeded4367worker2 # [ 66.385336] nix-daemon[842]: accepted connection from pid 1083, user nix-grpc-daemon (trusted)4368worker2 # [ 66.404545] nix-daemon[842]: reaped child process 1086, status = succeeded4369lb # [ 66.407660] niks3-server[1051]: 2026/09/20 09:05:14 INFO Received uploads request method=POST path=/api/pending_closures4370worker2 # [ 66.426874] nix-grpc-daemon[853]: time=2026-09-20T09:05:14.064Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4371worker2 # [ 66.428399] nix-grpc-daemon[853]: time=2026-09-20T09:05:14.064Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4372lb # [ 66.436428] niks3-server[1051]: 2026/09/20 09:05:14 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4373lb # [ 66.451557] niks3-server[1051]: 2026/09/20 09:05:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4374worker2 # [ 66.466060] nix-grpc-daemon[853]: time=2026-09-20T09:05:14.103Z level=INFO msg="Uploading 1 narinfos"4375lb # [ 66.463549] niks3-server[1051]: 2026/09/20 09:05:14 INFO Signed narinfos id=13 count=14376lb # [ 66.468707] niks3-server[1051]: 2026/09/20 09:05:14 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4377lb # [ 66.477167] niks3-server[1051]: 2026/09/20 09:05:14 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4378lb # [ 66.482098] niks3-server[1051]: 2026/09/20 09:05:14 INFO Completed upload id=134379worker2 # [ 66.491056] nix-grpc-daemon[853]: time=2026-09-20T09:05:14.128Z level=INFO msg="Upload complete. (489ms)"4380lb # [ 66.484899] niks3-server[1051]: 2026/09/20 09:05:14 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4381worker2 # [ 66.500834] nix-grpc-daemon[778]: ts=2026-09-20T09:05:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_in=6244382worker2 # [ 66.512003] nix-grpc-daemon[778]: ts=2026-09-20T09:05:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364383worker2 # [ 66.518905] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4384worker2 # [ 66.523644] nix-daemon[842]: reaped child process 1076, status = succeeded4385worker2 # [ 66.536795] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4386worker2 # [ 67.783686] nix-daemon[842]: reaped child process 1090, status = succeeded4387worker2 # [ 67.970732] nix-daemon[842]: accepted connection from pid 1105, user nix-grpc-daemon (trusted)4388worker2 # [ 67.988450] nix-daemon[842]: reaped child process 1108, status = succeeded4389lb # [ 67.991689] niks3-server[1051]: 2026/09/20 09:05:15 INFO Received uploads request method=POST path=/api/pending_closures4390worker2 # [ 68.012423] nix-grpc-daemon[853]: time=2026-09-20T09:05:15.648Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4391worker2 # [ 68.013996] nix-grpc-daemon[853]: time=2026-09-20T09:05:15.648Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4392lb # [ 68.034329] niks3-server[1051]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4393lb # [ 68.047007] niks3-server[1051]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4394worker2 # [ 68.067117] nix-grpc-daemon[853]: time=2026-09-20T09:05:15.704Z level=INFO msg="Uploading 1 narinfos"4395lb # [ 68.060345] niks3-server[1051]: 2026/09/20 09:05:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4396lb # [ 68.063633] niks3-server[1051]: 2026/09/20 09:05:15 INFO Signed narinfos id=14 count=14397lb # [ 68.073075] niks3-server[1051]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4398lb # [ 68.079362] niks3-server[1051]: 2026/09/20 09:05:15 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4399lb # [ 68.085065] niks3-server[1051]: 2026/09/20 09:05:15 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4400lb # [ 68.088311] niks3-server[1051]: 2026/09/20 09:05:15 INFO Completed upload id=144401worker2 # [ 68.097184] nix-grpc-daemon[853]: time=2026-09-20T09:05:15.735Z level=INFO msg="Upload complete. (349ms)"4402worker2 # [ 68.108603] nix-grpc-daemon[778]: ts=2026-09-20T09:05:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14403worker2 # [ 68.128519] nix-grpc-daemon[778]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:486364404worker2 # [ 68.133592] nix-daemon[842]: reaped child process 1088, status = succeeded4405worker1 # [ 68.115347] nix-grpc-daemon[774]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:552684406worker1 # [ 68.139584] nix-grpc-daemon[774]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4407worker1 # [ 68.163103] nix-grpc-daemon[774]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4408worker1 # [ 68.180163] nix-grpc-daemon[774]: ts=2026-09-20T09:05:15Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55268 duration_s=0 paths=1 nar_bytes_out=1764409worker2 # [ 68.516572] nix-grpc-daemon[778]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:486364410worker1 # [ 68.485540] nix-grpc-daemon[774]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552684411worker1 # [ 68.498774] nix-grpc-daemon[914]: time=2026-09-20T09:05:16.143Z level=INFO msg="All 2 paths already cached"4412worker1 # [ 68.517962] nix-grpc-daemon[774]: ts=2026-09-20T09:05:16Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04413worker2 # [ 68.556842] nix-grpc-daemon[778]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364414worker1 # [ 68.524105] nix-grpc-daemon[774]: ts=2026-09-20T09:05:16Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14415worker2 # [ 68.572551] nix-grpc-daemon[778]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486364416worker2 # [ 68.587671] nix-grpc-daemon[853]: time=2026-09-20T09:05:16.225Z level=INFO msg="All 2 paths already cached"4417worker2 # [ 68.597130] nix-grpc-daemon[778]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486364418worker2 # [ 68.611374] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4419worker2 # [ 68.822350] nix-daemon[842]: accepted connection from pid 1112, user nix-grpc-daemon (trusted)4420worker2 # [ 68.842283] nix-daemon[842]: reaped child process 1115, status = succeeded4421worker2 # [ 69.015840] nix-daemon[842]: accepted connection from pid 1117, user nix-grpc-daemon (trusted)4422worker2 # [ 69.032318] nix-daemon[842]: reaped child process 1120, status = succeeded4423lb # [ 69.038600] niks3-server[1051]: 2026/09/20 09:05:16 INFO Received uploads request method=POST path=/api/pending_closures4424worker2 # [ 69.059065] nix-grpc-daemon[853]: time=2026-09-20T09:05:16.696Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4425worker2 # [ 69.060638] nix-grpc-daemon[853]: time=2026-09-20T09:05:16.696Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4426lb # [ 69.071209] niks3-server[1051]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4427worker2 # [ 69.091895] nix-grpc-daemon[853]: time=2026-09-20T09:05:16.729Z level=INFO msg="Uploading 1 narinfos"4428lb # [ 69.085402] niks3-server[1051]: 2026/09/20 09:05:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4429lb # [ 69.096282] niks3-server[1051]: 2026/09/20 09:05:16 INFO Signed narinfos id=15 count=14430lb # [ 69.098974] niks3-server[1051]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4431lb # [ 69.109577] niks3-server[1051]: 2026/09/20 09:05:16 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4432lb # [ 69.114698] niks3-server[1051]: 2026/09/20 09:05:16 INFO Completed upload id=154433worker2 # [ 69.123665] nix-grpc-daemon[853]: time=2026-09-20T09:05:16.761Z level=INFO msg="Upload complete. (494ms)"4434lb # [ 69.117279] niks3-server[1051]: 2026/09/20 09:05:16 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4435worker2 # [ 69.132820] nix-grpc-daemon[778]: ts=2026-09-20T09:05:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_in=7524436worker2 # [ 69.145356] nix-grpc-daemon[778]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364437worker2 # [ 69.151244] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4438worker2 # [ 69.156111] nix-daemon[842]: reaped child process 1110, status = succeeded4439worker2 # [ 69.170208] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4440worker2 # [ 70.410988] nix-daemon[842]: reaped child process 1124, status = succeeded4441worker2 # [ 70.593423] nix-daemon[842]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)4442worker2 # [ 70.610986] nix-daemon[842]: reaped child process 1142, status = succeeded4443lb # [ 70.615217] niks3-server[1051]: 2026/09/20 09:05:18 INFO Received uploads request method=POST path=/api/pending_closures4444worker2 # [ 70.636394] nix-grpc-daemon[853]: time=2026-09-20T09:05:18.272Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4445worker2 # [ 70.637941] nix-grpc-daemon[853]: time=2026-09-20T09:05:18.272Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4446lb # [ 70.660481] niks3-server[1051]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4447lb # [ 70.671054] niks3-server[1051]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4448worker2 # [ 70.689097] nix-grpc-daemon[853]: time=2026-09-20T09:05:18.326Z level=INFO msg="Uploading 1 narinfos"4449lb # [ 70.681674] niks3-server[1051]: 2026/09/20 09:05:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4450lb # [ 70.689967] niks3-server[1051]: 2026/09/20 09:05:18 INFO Signed narinfos id=16 count=14451lb # [ 70.695049] niks3-server[1051]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4452lb # [ 70.702399] niks3-server[1051]: 2026/09/20 09:05:18 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4453lb # [ 70.710118] niks3-server[1051]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4454lb # [ 70.714672] niks3-server[1051]: 2026/09/20 09:05:18 INFO Completed upload id=164455worker2 # [ 70.723331] nix-grpc-daemon[853]: time=2026-09-20T09:05:18.361Z level=INFO msg="Upload complete. (342ms)"4456worker1 # [ 70.702735] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552684457worker2 # [ 70.737163] nix-grpc-daemon[778]: ts=2026-09-20T09:05:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14458worker2 # [ 70.751913] nix-daemon[842]: reaped child process 1122, status = succeeded4459worker1 # [ 70.717799] nix-grpc-daemon[774]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4460worker1 # [ 70.766882] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:552684461worker1 # [ 70.772626] nix-grpc-daemon[774]: ts=2026-09-20T09:05:18Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55268 duration_s=0 paths=1 nar_bytes_out=2324462client # [ 70.902730] nix-daemon[942]: reaped child process 944, status = succeeded4463client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.63 seconds)4464client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4465client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4466client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4467client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4468client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4469client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4470(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.77 seconds)4471subtest: an input only one worker has still reaches the builder4472client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4473lb # [ 71.255664] envoy[912]: conn peer=[2001:db8:1::1]:57314 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1372 ms=62714474lb # [ 71.260722] envoy[912]: conn peer=[2001:db8:1::1]:55994 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=334 ms=744475client # this derivation will be built:4476lb # [ 71.265506] envoy[912]: conn peer=[2001:db8:1::1]:55992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3416 tx=1639 ms=26204477client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4478lb # [ 71.270293] envoy[912]: conn peer=[2001:db8:1::1]:56020 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=1314479lb # [ 71.275676] envoy[912]: conn peer=[2001:db8:1::1]:56010 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3905 tx=1872 ms=24174480lb # [ 71.280503] envoy[912]: conn peer=[2001:db8:1::1]:56036 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=654481lb # [ 71.285040] envoy[912]: conn peer=[2001:db8:1::1]:56032 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4352 tx=2225 ms=23464482client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4483client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds)4484client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4485client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds)4486worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4487worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.27 seconds)4488worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4489worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4490client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24491client # [ 72.216590] nix-daemon[942]: accepted connection from pid 1025, user root (trusted)4492client # this derivation will be built:4493client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4494worker1 # [ 72.417465] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:552684495client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4496worker2 # [ 72.458608] nix-grpc-daemon[778]: ts=2026-09-20T09:05:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486364497client # copying 1 paths...4498client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4499worker1 # [ 72.439155] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552684500worker1 # [ 72.455712] nix-daemon[861]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4501worker1 # [ 72.669339] nix-daemon[861]: accepted connection from pid 1006, user nix-grpc-daemon (trusted)4502worker1 # [ 72.688812] nix-daemon[861]: reaped child process 1009, status = succeeded4503lb # [ 72.731705] niks3-server[1051]: 2026/09/20 09:05:20 INFO Received uploads request method=POST path=/api/pending_closures4504worker1 # [ 72.715923] nix-grpc-daemon[914]: time=2026-09-20T09:05:20.360Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4505worker1 # [ 72.718316] nix-grpc-daemon[914]: time=2026-09-20T09:05:20.360Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4506lb # [ 72.766608] niks3-server[1051]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4507worker1 # [ 72.754267] nix-grpc-daemon[914]: time=2026-09-20T09:05:20.399Z level=INFO msg="Uploading 1 narinfos"4508lb # [ 72.781445] niks3-server[1051]: 2026/09/20 09:05:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4509lb # [ 72.792611] niks3-server[1051]: 2026/09/20 09:05:20 INFO Signed narinfos id=17 count=14510lb # [ 72.798153] niks3-server[1051]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4511worker1 # [ 72.777451] nix-grpc-daemon[914]: time=2026-09-20T09:05:20.422Z level=INFO msg="Upload complete. (306ms)"4512lb # [ 72.804366] niks3-server[1051]: 2026/09/20 09:05:20 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4513lb # [ 72.810915] niks3-server[1051]: 2026/09/20 09:05:20 INFO Completed upload id=174514lb # [ 72.813734] niks3-server[1051]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4515worker1 # [ 72.787359] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55268 duration_s=0 paths=1 nar_bytes_in=1204516worker1 # [ 72.808268] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04517worker1 # [ 72.812450] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14518worker1 # [ 72.818107] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552684519worker1 # [ 72.823147] nix-daemon[861]: reaped child process 1004, status = succeeded4520worker1 # [ 72.826881] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552684521client # copying 2 paths to 'lb:50051'...4522worker1 # [ 72.843018] nix-grpc-daemon[774]: ts=2026-09-20T09:05:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552684523client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4524client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4525worker1 # [ 72.857154] nix-daemon[861]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4526worker1 # [ 73.056264] nix-daemon[861]: accepted connection from pid 1015, user nix-grpc-daemon (trusted)4527worker1 # [ 73.074187] nix-daemon[861]: reaped child process 1018, status = succeeded4528worker1 # [ 73.252565] nix-daemon[861]: accepted connection from pid 1020, user nix-grpc-daemon (trusted)4529worker1 # [ 73.269809] nix-daemon[861]: reaped child process 1023, status = succeeded4530lb # [ 73.307946] niks3-server[1051]: 2026/09/20 09:05:20 INFO Received uploads request method=POST path=/api/pending_closures4531lb # [ 73.317781] niks3-server[1051]: 2026/09/20 09:05:20 INFO Received uploads request method=POST path=/api/pending_closures4532worker1 # [ 73.300069] nix-grpc-daemon[914]: time=2026-09-20T09:05:20.945Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4533worker1 # [ 73.301583] nix-grpc-daemon[914]: time=2026-09-20T09:05:20.945Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4534worker1 # [ 73.303293] nix-grpc-daemon[914]: time=2026-09-20T09:05:20.945Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4535lb # [ 73.360921] niks3-server[1051]: 2026/09/20 09:05:20 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4536lb # [ 73.370738] niks3-server[1051]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4537lb # [ 73.383344] niks3-server[1051]: 2026/09/20 09:05:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4538lb # [ 73.389124] niks3-server[1051]: 2026/09/20 09:05:21 INFO Signed narinfos id=18 count=14539worker1 # [ 73.361891] nix-grpc-daemon[914]: time=2026-09-20T09:05:21.005Z level=INFO msg="Uploading 3 narinfos"4540lb # [ 73.390865] niks3-server[1051]: 2026/09/20 09:05:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4541lb # [ 73.398968] niks3-server[1051]: 2026/09/20 09:05:21 INFO Signed narinfos id=19 count=24542lb # [ 73.402852] niks3-server[1051]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4543lb # [ 73.407822] niks3-server[1051]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4544lb # [ 73.414419] niks3-server[1051]: 2026/09/20 09:05:21 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4545lb # [ 73.422480] niks3-server[1051]: 2026/09/20 09:05:21 INFO Completed upload id=184546lb # [ 73.423626] niks3-server[1051]: 2026/09/20 09:05:21 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4547lb # [ 73.425736] niks3-server[1051]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4548lb # [ 73.428514] niks3-server[1051]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4549lb # [ 73.430438] niks3-server[1051]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4550lb # [ 73.432867] niks3-server[1051]: 2026/09/20 09:05:21 INFO Completed upload id=194551worker1 # [ 73.406672] nix-grpc-daemon[914]: time=2026-09-20T09:05:21.051Z level=INFO msg="Upload complete. (534ms)"4552worker1 # [ 73.421279] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55268 duration_s=0 paths=2 nar_bytes_in=9844553worker1 # [ 73.435770] nix-grpc-daemon[774]: ts=2026-09-20T09:05:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552684554worker1 # [ 73.445417] nix-daemon[861]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4555worker1 # [ 73.455381] nix-daemon[861]: reaped child process 1013, status = succeeded4556client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4557client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4558worker1 # [ 73.464911] nix-daemon[861]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4559worker1 # [ 74.688227] nix-daemon[861]: reaped child process 1027, status = succeeded4560worker1 # [ 74.849342] nix-daemon[861]: accepted connection from pid 1042, user nix-grpc-daemon (trusted)4561worker1 # [ 74.873419] nix-daemon[861]: reaped child process 1045, status = succeeded4562lb # [ 74.913042] niks3-server[1051]: 2026/09/20 09:05:22 INFO Received uploads request method=POST path=/api/pending_closures4563worker1 # [ 74.896403] nix-grpc-daemon[914]: time=2026-09-20T09:05:22.541Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4564lb # [ 74.948154] niks3-server[1051]: 2026/09/20 09:05:22 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4565worker1 # [ 74.929708] nix-grpc-daemon[914]: time=2026-09-20T09:05:22.574Z level=INFO msg="Uploading 1 narinfos"4566lb # [ 74.960704] niks3-server[1051]: 2026/09/20 09:05:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4567lb # [ 74.972132] niks3-server[1051]: 2026/09/20 09:05:22 INFO Signed narinfos id=20 count=14568lb # [ 74.975060] niks3-server[1051]: 2026/09/20 09:05:22 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4569lb # [ 74.985395] niks3-server[1051]: 2026/09/20 09:05:22 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4570worker1 # [ 74.964648] nix-grpc-daemon[914]: time=2026-09-20T09:05:22.609Z level=INFO msg="Upload complete. (287ms)"4571lb # [ 74.991108] niks3-server[1051]: 2026/09/20 09:05:22 INFO Completed upload id=204572lb # [ 74.994495] niks3-server[1051]: 2026/09/20 09:05:22 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4573worker1 # [ 74.973501] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55268 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14574worker1 # [ 74.987585] nix-daemon[861]: reaped child process 1025, status = succeeded4575client # copying 1 paths...4576worker1 # [ 75.022772] nix-grpc-daemon[774]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552684577client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4578worker2 # [ 75.094759] nix-grpc-daemon[778]: ts=2026-09-20T09:05:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:486364579worker2 # [ 75.111993] nix-grpc-daemon[778]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4580worker2 # [ 75.130048] nix-grpc-daemon[778]: ts=2026-09-20T09:05:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_out=1204581client # [ 75.224240] nix-daemon[942]: reaped child process 1028, status = succeeded4582client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.25 seconds)4583client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24584client # [ 75.447289] nix-daemon[942]: accepted connection from pid 1047, user root (trusted)4585client # this derivation will be built:4586client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4587worker2 # [ 75.677794] nix-grpc-daemon[778]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:486364588client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4589worker2 # [ 75.685375] nix-grpc-daemon[778]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486364590worker1 # [ 75.670862] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04591worker1 # [ 75.671227] nix-grpc-daemon[774]: ts=2026-09-20T09:05:23Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14592worker2 # [ 75.752768] nix-grpc-daemon[778]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364593worker2 # [ 75.768424] nix-grpc-daemon[778]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486364594client # copying 1 paths to 'lb:50051'...4595client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4596worker2 # [ 75.793749] nix-grpc-daemon[778]: ts=2026-09-20T09:05:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486364597worker2 # [ 75.810344] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4598worker2 # [ 75.832870] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5)4599worker2 # [ 75.865402] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 2/5)4600worker2 # [ 75.888814] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 105 ms (attempt 3/5)4601worker2 # [ 76.003783] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 4/5)4602worker2 # [ 76.088549] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4603worker2 # [ 76.100951] nix-grpc-daemon[778]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4604worker2 # [ 76.323676] nix-daemon[842]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)4605worker2 # [ 76.341970] nix-daemon[842]: reaped child process 1157, status = succeeded4606worker2 # [ 76.519021] nix-daemon[842]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)4607worker2 # [ 76.535394] nix-daemon[842]: reaped child process 1162, status = succeeded4608lb # [ 76.539268] niks3-server[1051]: 2026/09/20 09:05:24 INFO Received uploads request method=POST path=/api/pending_closures4609worker2 # [ 76.557705] nix-grpc-daemon[853]: time=2026-09-20T09:05:24.195Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4610worker2 # [ 76.559150] nix-grpc-daemon[853]: time=2026-09-20T09:05:24.195Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4611lb # [ 76.570945] niks3-server[1051]: 2026/09/20 09:05:24 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4612lb # [ 76.585694] niks3-server[1051]: 2026/09/20 09:05:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4613worker2 # [ 76.600880] nix-grpc-daemon[853]: time=2026-09-20T09:05:24.238Z level=INFO msg="Uploading 1 narinfos"4614lb # [ 76.598328] niks3-server[1051]: 2026/09/20 09:05:24 INFO Signed narinfos id=21 count=14615lb # [ 76.605038] niks3-server[1051]: 2026/09/20 09:05:24 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4616lb # [ 76.614309] niks3-server[1051]: 2026/09/20 09:05:24 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4617lb # [ 76.619216] niks3-server[1051]: 2026/09/20 09:05:24 INFO Completed upload id=214618worker2 # [ 76.627594] nix-grpc-daemon[853]: time=2026-09-20T09:05:24.265Z level=INFO msg="Upload complete. (513ms)"4619lb # [ 76.622165] niks3-server[1051]: 2026/09/20 09:05:24 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4620worker2 # [ 76.636325] nix-grpc-daemon[778]: ts=2026-09-20T09:05:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_in=5684621worker2 # [ 76.647134] nix-grpc-daemon[778]: ts=2026-09-20T09:05:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486364622worker2 # [ 76.657730] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4623worker2 # [ 76.668323] nix-daemon[842]: reaped child process 1148, status = succeeded4624worker2 # [ 76.673368] nix-grpc-daemon[778]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4625client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4626worker2 # [ 76.688340] nix-daemon[842]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4627client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4628worker2 # [ 77.531366] nix-daemon[842]: reaped child process 1167, status = succeeded4629worker2 # [ 77.721264] nix-daemon[842]: accepted connection from pid 1182, user nix-grpc-daemon (trusted)4630worker2 # [ 77.741035] nix-daemon[842]: reaped child process 1185, status = succeeded4631lb # [ 77.744608] niks3-server[1051]: 2026/09/20 09:05:25 INFO Received uploads request method=POST path=/api/pending_closures4632worker2 # [ 77.762587] nix-grpc-daemon[853]: time=2026-09-20T09:05:25.400Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4633worker2 # [ 77.795981] nix-grpc-daemon[853]: time=2026-09-20T09:05:25.433Z level=INFO msg="Uploading 1 narinfos"4634lb # [ 77.777096] niks3-server[1051]: 2026/09/20 09:05:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4635lb # [ 77.791750] niks3-server[1051]: 2026/09/20 09:05:25 INFO Signed narinfos id=22 count=14636lb # [ 77.800352] niks3-server[1051]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4637lb # [ 77.815410] niks3-server[1051]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4638lb # [ 77.821347] niks3-server[1051]: 2026/09/20 09:05:25 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4639worker2 # [ 77.835088] nix-grpc-daemon[853]: time=2026-09-20T09:05:25.472Z level=INFO msg="Upload complete. (333ms)"4640lb # [ 77.826456] niks3-server[1051]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4641lb # [ 77.831257] niks3-server[1051]: 2026/09/20 09:05:25 INFO Completed upload id=224642worker2 # [ 77.845367] nix-grpc-daemon[778]: ts=2026-09-20T09:05:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14643worker2 # [ 77.861204] nix-daemon[842]: reaped child process 1164, status = succeeded4644client # copying 1 paths...4645worker1 # [ 77.855433] nix-grpc-daemon[774]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552684646worker1 # [ 77.869865] nix-grpc-daemon[774]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4647client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4648worker2 # [ 77.951802] nix-grpc-daemon[778]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:486364649worker2 # [ 77.957464] nix-grpc-daemon[778]: ts=2026-09-20T09:05:25Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_out=1204650client # [ 77.999165] nix-daemon[942]: reaped child process 1050, status = succeeded4651client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.77 seconds)4652client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24653client # [ 78.223411] nix-daemon[942]: accepted connection from pid 1069, user root (trusted)4654client # this derivation will be built:4655client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4656worker2 # [ 78.458829] nix-grpc-daemon[778]: ts=2026-09-20T09:05:26Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:486364657client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4658worker1 # [ 78.427345] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552684659worker1 # [ 78.439414] nix-grpc-daemon[914]: time=2026-09-20T09:05:26.083Z level=INFO msg="All 1 paths already cached"4660worker1 # [ 78.456968] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04661worker1 # [ 78.464679] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14662worker1 # [ 78.501767] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552684663worker1 # [ 78.517478] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:552684664worker1 # [ 78.533077] nix-grpc-daemon[914]: time=2026-09-20T09:05:26.178Z level=INFO msg="All 1 paths already cached"4665client # copying 1 paths to 'lb:50051'...4666client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4667worker1 # [ 78.543909] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:552684668worker1 # [ 78.560203] nix-daemon[861]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4669worker1 # [ 78.778636] nix-daemon[861]: accepted connection from pid 1054, user nix-grpc-daemon (trusted)4670worker1 # [ 78.796657] nix-daemon[861]: reaped child process 1057, status = succeeded4671worker1 # [ 78.980463] nix-daemon[861]: accepted connection from pid 1059, user nix-grpc-daemon (trusted)4672worker1 # [ 78.998305] nix-daemon[861]: reaped child process 1062, status = succeeded4673lb # [ 79.039121] niks3-server[1051]: 2026/09/20 09:05:26 INFO Received uploads request method=POST path=/api/pending_closures4674worker1 # [ 79.024419] nix-grpc-daemon[914]: time=2026-09-20T09:05:26.669Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4675worker1 # [ 79.025918] nix-grpc-daemon[914]: time=2026-09-20T09:05:26.669Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4676lb # [ 79.068759] niks3-server[1051]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4677lb # [ 79.083359] niks3-server[1051]: 2026/09/20 09:05:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4678worker1 # [ 79.063342] nix-grpc-daemon[914]: time=2026-09-20T09:05:26.708Z level=INFO msg="Uploading 1 narinfos"4679lb # [ 79.092299] niks3-server[1051]: 2026/09/20 09:05:26 INFO Signed narinfos id=23 count=14680lb # [ 79.104319] niks3-server[1051]: 2026/09/20 09:05:26 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4681worker1 # [ 79.083422] nix-grpc-daemon[914]: time=2026-09-20T09:05:26.728Z level=INFO msg="Upload complete. (505ms)"4682lb # [ 79.112422] niks3-server[1051]: 2026/09/20 09:05:26 INFO Completed upload id=234683lb # [ 79.115764] niks3-server[1051]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4684lb # [ 79.119943] niks3-server[1051]: 2026/09/20 09:05:26 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4685worker1 # [ 79.092845] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55268 duration_s=0 paths=1 nar_bytes_in=5684686worker1 # [ 79.103457] nix-grpc-daemon[774]: ts=2026-09-20T09:05:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:552684687worker1 # [ 79.112367] nix-daemon[861]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4688worker1 # [ 79.114858] nix-daemon[861]: reaped child process 1052, status = succeeded4689client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4690worker1 # [ 79.127924] nix-daemon[861]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4691client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4692worker1 # [ 80.379040] nix-daemon[861]: reaped child process 1066, status = succeeded4693worker1 # [ 80.560213] nix-daemon[861]: accepted connection from pid 1081, user nix-grpc-daemon (trusted)4694worker1 # [ 80.581009] nix-daemon[861]: reaped child process 1084, status = succeeded4695lb # [ 80.621644] niks3-server[1051]: 2026/09/20 09:05:28 INFO Received uploads request method=POST path=/api/pending_closures4696worker1 # [ 80.604455] nix-grpc-daemon[914]: time=2026-09-20T09:05:28.248Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4697lb # [ 80.651476] niks3-server[1051]: 2026/09/20 09:05:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4698worker1 # [ 80.634232] nix-grpc-daemon[914]: time=2026-09-20T09:05:28.279Z level=INFO msg="Uploading 1 narinfos"4699lb # [ 80.664402] niks3-server[1051]: 2026/09/20 09:05:28 INFO Signed narinfos id=24 count=14700lb # [ 80.667684] niks3-server[1051]: 2026/09/20 09:05:28 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4701lb # [ 80.681282] niks3-server[1051]: 2026/09/20 09:05:28 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4702worker1 # [ 80.662553] nix-grpc-daemon[914]: time=2026-09-20T09:05:28.307Z level=INFO msg="Upload complete. (324ms)"4703lb # [ 80.689442] niks3-server[1051]: 2026/09/20 09:05:28 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4704lb # [ 80.694720] niks3-server[1051]: 2026/09/20 09:05:28 INFO Completed upload id=244705lb # [ 80.697492] niks3-server[1051]: 2026/09/20 09:05:28 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4706worker1 # [ 80.673582] nix-grpc-daemon[774]: ts=2026-09-20T09:05:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55268 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14707worker1 # [ 80.686994] nix-daemon[861]: reaped child process 1064, status = succeeded4708client # copying 1 paths...4709worker1 # [ 80.718755] nix-grpc-daemon[774]: ts=2026-09-20T09:05:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552684710client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4711worker2 # [ 80.790408] nix-grpc-daemon[778]: ts=2026-09-20T09:05:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:486364712worker2 # [ 80.805098] nix-grpc-daemon[778]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4713worker2 # [ 80.822953] nix-grpc-daemon[778]: ts=2026-09-20T09:05:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48636 duration_s=0 paths=1 nar_bytes_out=1204714client # [ 80.915912] nix-daemon[942]: reaped child process 1072, status = succeeded4715client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.92 seconds)4716(finished: subtest: an input only one worker has still reaches the builder, in 9.88 seconds)4717subtest: upload whose reference the worker lacks is completed from the cache4718client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4719client # this derivation will be built:4720client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4721lb # [ 81.256289] envoy[912]: conn peer=[2001:db8:1::1]:41696 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1024722lb # [ 81.256622] envoy[912]: conn peer=[2001:db8:1::1]:41686 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4231 tx=1753 ms=27404723lb # [ 81.256768] envoy[912]: conn peer=[2001:db8:1::1]:41724 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=234724lb # [ 81.256870] envoy[912]: conn peer=[2001:db8:1::1]:41712 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3729 tx=1933 ms=22914725lb # [ 81.256998] envoy[912]: conn peer=[2001:db8:1::1]:41736 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3755 tx=1820 ms=24234726lb # [ 81.257161] envoy[912]: conn peer=[2001:db8:1::1]:41742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=974727client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4728client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds)4729client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4730client # this derivation will be built:4731client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4732client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4733client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.44 seconds)4734client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4735client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4736worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4737worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.27 seconds)4738worker2 # [ 82.401703] systemd[1]: Stopping Nix worker-protocol over gRPC...4739worker2 # [ 82.656888] nix-grpc-daemon[778]: ts=2026-09-20T09:05:30Z level=info event=signal_exit4740worker1 # [ 83.695722] nix-grpc-daemon[774]: ts=2026-09-20T09:05:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:438884741worker1 # [ 83.701066] nix-grpc-daemon[774]: ts=2026-09-20T09:05:31Z level=info event=worker_gone addr=192.168.1.4:500514742worker2 # [ 83.756349] nix-grpc-daemon[778]: ts=2026-09-20T09:05:31Z level=info event=scheduler_restarting4743worker2 # [ 83.765858] nix-grpc-daemon[778]: ts=2026-09-20T09:05:31Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4744worker2 # [ 83.782374] nix-daemon[842]: reaped child process 844, status = succeeded4745worker2 # [ 83.816423] nix-grpc-daemon[778]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4746worker2 # [ 83.821614] nix-grpc-daemon[778]: E0000 00:00:1789895131.454125 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4747worker2 # [ 83.828094] nix-grpc-daemon[778]: E0000 00:00:1789895131.459372 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4748worker2 # [ 84.378663] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4749worker2 # [ 84.385717] systemd[1]: Stopped Nix worker-protocol over gRPC.4750worker2 # [ 84.392671] systemd[1]: nix-grpc-daemon.service: Consumed 3.699s CPU time over 1min 3.100s wall clock time, 59M memory peak, 86.3K incoming IP traffic, 156.9K outgoing IP traffic.4751worker2 # [ 84.411807] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4752worker2 # [ 84.414240] systemd[1]: Closed Nix worker-protocol over gRPC.4753worker2 # [ 84.418599] systemd[1]: nix-grpc-daemon.socket: Consumed 586us CPU time over 1min 13.698s wall clock time, 256K memory peak, 104.1K incoming IP traffic, 85.8K outgoing IP traffic.4754lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4755lb: must succeed: curl -sf localhost:9901/clusters4756lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4757lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4758client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24759worker1 # [ 84.710216] nix-grpc-daemon[774]: ts=2026-09-20T09:05:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:552684760worker1 # [ 84.717213] nix-grpc-daemon[774]: ts=2026-09-20T09:05:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:552684761client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4762client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds)4763worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4764worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4765worker2 # [ 84.902590] systemd[1]: Listening on Nix worker-protocol over gRPC.4766worker1 # [ 84.953846] systemd[1]: Stopping Nix worker-protocol over gRPC...4767worker2 # [ 85.368346] systemd[1]: Starting Nix worker-protocol over gRPC...4768worker2 # [ 85.582968] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4769worker2 # [ 85.585501] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14770worker2 # [ 85.593031] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4771worker2 # [ 85.595045] systemd[1]: Started Nix worker-protocol over gRPC.4772worker2 # [ 85.636782] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:33Z level=info event=scheduler_connected addr=lb:500514773worker1 # [ 85.604066] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04774worker1 # [ 85.635975] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=signal_exit4775worker1 # [ 85.879422] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=scheduler_yield4776worker2 # [ 85.923278] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:33Z level=info event=scheduler_restarting addr=lb:500514777lb # [ 85.915336] niks3-server[1051]: 2026/09/20 09:05:33 INFO lead: released remote=192.168.1.3:435664778worker1 # [ 85.890415] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:438884779worker1 # [ 85.897872] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=worker_gone addr=192.168.1.4:500514780worker1 # [ 85.902054] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=scheduler_restarting addr=lb:500514781worker1 # [ 85.906063] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:438884782worker1 # [ 85.910504] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=worker_gone addr=192.168.1.3:500514783worker2 # [ 86.124405] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:33Z level=info event=scheduler_connected addr=lb:500514784worker1 # [ 86.097540] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=scheduler_connected addr=lb:500514785worker2 # [ 86.135507] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4786worker1 # [ 86.117934] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4787worker2 # [ 86.336663] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:33Z level=info event=scheduler_connected addr=lb:500514788worker2 # [ 86.344123] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4789worker1 # [ 86.319272] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=scheduler_connected addr=lb:500514790worker1 # [ 86.326857] nix-grpc-daemon[774]: ts=2026-09-20T09:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4791worker2 # [ 86.550711] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500514792worker2 # [ 86.557265] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4793worker1 # [ 86.527978] nix-grpc-daemon[774]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500514794worker1 # [ 86.534702] nix-grpc-daemon[774]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4795worker2 # [ 86.760278] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500514796worker2 # [ 86.765269] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4797worker1 # [ 86.735699] nix-grpc-daemon[774]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500514798worker1 # [ 86.742308] nix-grpc-daemon[774]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4799worker1 # [ 86.885379] nix-grpc-daemon[774]: ts=2026-09-20T09:05:34Z level=info event=scheduler_restarting4800worker1 # [ 86.920820] nix-daemon[861]: reaped child process 863, status = succeeded4801worker2 # [ 86.966068] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500514802worker2 # [ 86.972762] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4803worker1 # [ 86.967703] nix-grpc-daemon[774]: ts=2026-09-20T09:05:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4804worker2 # [ 87.173886] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:34Z level=info event=scheduler_connected addr=lb:500514805worker1 # [ 87.141103] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4806worker1 # [ 87.145694] nix-grpc-daemon[774]: E0000 00:00:1789895134.786082 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true4807worker1 # [ 87.766209] nix-grpc-daemon[774]: E0000 00:00:1789895135.411331 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4808worker1 # [ 87.773677] nix-grpc-daemon[774]: E0000 00:00:1789895135.418711 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4809worker2 # [ 88.264728] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:35Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4810worker1 # [ 88.251874] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4811worker1 # [ 88.259789] systemd[1]: Stopped Nix worker-protocol over gRPC.4812worker1 # [ 88.264894] systemd[1]: nix-grpc-daemon.service: Consumed 2.194s CPU time over 1min 7.000s wall clock time, 55.3M memory peak, 62.6K incoming IP traffic, 130.4K outgoing IP traffic.4813worker1 # [ 88.281424] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4814worker1 # [ 88.284466] systemd[1]: Closed Nix worker-protocol over gRPC.4815worker1 # [ 88.286100] systemd[1]: nix-grpc-daemon.socket: Consumed 509us CPU time over 1min 17.686s wall clock time, 256K memory peak, 109.7K incoming IP traffic, 92.2K outgoing IP traffic.4816lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4817lb: must succeed: curl -sf localhost:9901/clusters4818lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4819lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4820client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24821worker2 # [ 88.464684] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=info event=scheduler_connected addr=lb:500514822worker2 # [ 88.471739] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4823worker2 # [ 88.663909] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:538524824worker2 # [ 88.680350] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=info event=scheduler_connected addr=lb:500514825worker2 # [ 88.685469] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4826worker2 # [ 88.706929] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)4827worker2 # [ 88.718368] nix-grpc-daemon[1207]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5)4828worker2 # [ 88.746924] nix-grpc-daemon[1207]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 19 ms (attempt 2/5)4829worker2 # [ 88.773425] nix-grpc-daemon[1207]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 232 ms (attempt 3/5)4830worker2 # [ 88.877033] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=info event=scheduler_connected addr=lb:500514831worker2 # [ 88.883837] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4832worker2 # [ 89.013000] nix-grpc-daemon[1207]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 160 ms (attempt 4/5)4833worker2 # [ 89.085005] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=info event=scheduler_connected addr=lb:500514834worker2 # [ 89.090506] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4835worker2 # [ 89.181036] nix-grpc-daemon[1207]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4836client # copying 2 paths...4837client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4838worker2 # [ 89.206853] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:538524839client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4840worker2 # [ 89.224754] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)4841worker2 # [ 89.252899] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=info event=niks3_push_started pid=12634842worker2 # [ 89.293758] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=info event=scheduler_connected addr=lb:500514843worker2 # [ 89.298313] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4844worker2 # [ 89.498101] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500514845worker2 # [ 89.501226] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:37Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4846worker2 # [ 89.671310] nix-daemon[842]: accepted connection from pid 1276, user nix-grpc-daemon (trusted)4847worker2 # [ 89.689082] nix-daemon[842]: reaped child process 1279, status = succeeded4848worker2 # [ 89.701803] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500514849worker2 # [ 89.705038] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4850lb # [ 89.700810] niks3-server[1051]: 2026/09/20 09:05:37 INFO Received uploads request method=POST path=/api/pending_closures4851lb # [ 89.711133] niks3-server[1051]: 2026/09/20 09:05:37 INFO Received uploads request method=POST path=/api/pending_closures4852worker2 # [ 89.730772] nix-grpc-daemon[1263]: time=2026-09-20T09:05:37.366Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4853worker2 # [ 89.733394] nix-grpc-daemon[1263]: time=2026-09-20T09:05:37.366Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4854worker2 # [ 89.735393] nix-grpc-daemon[1263]: time=2026-09-20T09:05:37.366Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4855lb # [ 89.763068] niks3-server[1051]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4856lb # [ 89.774578] niks3-server[1051]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4857lb # [ 89.785539] niks3-server[1051]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4858lb # [ 89.792784] niks3-server[1051]: 2026/09/20 09:05:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4859lb # [ 89.798619] niks3-server[1051]: 2026/09/20 09:05:37 INFO Signed narinfos id=25 count=14860worker2 # [ 89.808107] nix-grpc-daemon[1263]: time=2026-09-20T09:05:37.445Z level=INFO msg="Uploading 3 narinfos"4861lb # [ 89.800809] niks3-server[1051]: 2026/09/20 09:05:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4862lb # [ 89.803388] niks3-server[1051]: 2026/09/20 09:05:37 INFO Signed narinfos id=26 count=24863lb # [ 89.810631] niks3-server[1051]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4864lb # [ 89.826386] niks3-server[1051]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4865lb # [ 89.834168] niks3-server[1051]: 2026/09/20 09:05:37 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4866lb # [ 89.841185] niks3-server[1051]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4867lb # [ 89.843513] niks3-server[1051]: 2026/09/20 09:05:37 INFO Completed upload id=254868lb # [ 89.846372] niks3-server[1051]: 2026/09/20 09:05:37 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4869worker2 # [ 89.855375] nix-grpc-daemon[1263]: time=2026-09-20T09:05:37.493Z level=INFO msg="Upload complete. (367ms)"4870lb # [ 89.849218] niks3-server[1051]: 2026/09/20 09:05:37 INFO Completed upload id=264871lb # [ 89.851014] niks3-server[1051]: 2026/09/20 09:05:37 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4872worker2 # [ 89.867370] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53852 duration_s=0 paths=2 nar_bytes_in=3124873worker2 # [ 89.884183] nix-daemon[842]: reaped child process 1261, status = succeeded4874client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.50 seconds)4875worker2 # [ 89.906107] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500514876worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4877worker2 # [ 89.911047] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:37Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4878worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4879worker1 # [ 89.998573] systemd[1]: Listening on Nix worker-protocol over gRPC.4880worker1 # [ 90.007895] systemd[1]: Starting Nix worker-protocol over gRPC...4881worker2 # [ 90.111864] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500514882worker2 # [ 90.118644] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4883worker1 # [ 90.205014] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4884worker1 # [ 90.207752] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14885worker1 # [ 90.219452] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4886worker1 # [ 90.224260] systemd[1]: Started Nix worker-protocol over gRPC.4887lb # [ 90.254727] niks3-server[1051]: 2026/09/20 09:05:37 INFO lead: acquired remote=192.168.1.3:337884888lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4889lb: must succeed: curl -sf localhost:9901/clusters4890worker1 # [ 90.240160] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:37Z level=info event=scheduler_take_over4891worker1 # [ 90.271001] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500514892worker1 # [ 90.275571] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:37Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04893worker1 # [ 90.285599] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:37Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04894worker2 # [ 90.320890] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:37Z level=info event=scheduler_connected addr=lb:500514895lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4896lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)4897(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.41 seconds)4898subtest: scheduler down: the other node takes the lock and keeps it4899lb: must succeed: curl -sf localhost:9901/clusters4900lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4901lb: must succeed: curl -sf localhost:9901/clusters4902lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4903lb: must succeed: curl -sf localhost:9901/clusters4904lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4905lb: must succeed: curl -sf localhost:9901/clusters4906lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4907worker1 # [ 90.607504] systemd[1]: Stopping Nix worker-protocol over gRPC...4908worker1 # [ 91.220846] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:38Z level=info event=signal_exit4909lb # [ 91.256939] envoy[912]: conn peer=[2001:db8:1::4]:36090 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9674 tx=2817 ms=620614910lb # [ 91.261965] envoy[912]: conn peer=[2001:db8:1::1]:37170 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=523 ms=334911lb # [ 91.266644] envoy[912]: conn peer=[2001:db8:1::3]:54408 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9799 tx=2655 ms=652934912lb # [ 91.271636] envoy[912]: conn peer=[2001:db8:1::1]:37174 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1008 tx=305 ms=12184913worker1 # [ 91.427320] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=scheduler_yield4914lb # [ 91.457314] niks3-server[1051]: 2026/09/20 09:05:39 INFO lead: released remote=192.168.1.3:337884915worker2 # [ 91.472995] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:39Z level=info event=scheduler_restarting addr=lb:500514916worker1 # [ 91.442934] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:362884917worker1 # [ 91.450325] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=worker_gone addr=192.168.1.4:500514918worker1 # [ 91.454600] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=scheduler_restarting addr=lb:500514919worker1 # [ 91.458659] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:362884920worker1 # [ 91.463441] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=worker_gone addr=192.168.1.3:500514921worker2 # [ 91.672774] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:39Z level=info event=scheduler_connected addr=lb:500514922worker2 # [ 91.680004] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4923worker1 # [ 91.649977] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=scheduler_connected addr=lb:500514924worker1 # [ 91.656376] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4925worker2 # [ 91.881107] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:39Z level=info event=scheduler_connected addr=lb:500514926worker2 # [ 91.886372] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4927worker1 # [ 91.857239] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=scheduler_connected addr=lb:500514928worker1 # [ 91.863609] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4929worker2 # [ 92.087230] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:39Z level=info event=scheduler_connected addr=lb:500514930worker2 # [ 92.092531] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4931worker1 # [ 92.064569] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=scheduler_connected addr=lb:500514932worker1 # [ 92.070965] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4933worker2 # [ 92.293410] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:39Z level=info event=scheduler_connected addr=lb:500514934worker2 # [ 92.298628] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4935worker1 # [ 92.273183] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=scheduler_connected addr=lb:500514936worker1 # [ 92.278340] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4937worker1 # [ 92.432999] nix-grpc-daemon[1107]: ts=2026-09-20T09:05:40Z level=info event=scheduler_restarting4938worker2 # [ 92.500654] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:40Z level=info event=scheduler_connected addr=lb:500514939worker1 # [ 92.466083] nix-grpc-daemon[1107]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4940worker1 # [ 92.470629] nix-grpc-daemon[1107]: E0000 00:00:1789895140.111140 1150 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4941worker1 # [ 93.256586] nix-grpc-daemon[1107]: E0000 00:00:1789895140.901629 1150 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4942worker1 # [ 93.256960] nix-grpc-daemon[1107]: E0000 00:00:1789895140.901900 1150 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4943worker2 # [ 94.264669] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:41Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4944worker1 # [ 94.250546] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4945worker1 # [ 94.256202] systemd[1]: Stopped Nix worker-protocol over gRPC.4946worker1 # [ 94.262934] systemd[1]: nix-grpc-daemon.service: Consumed 201ms CPU time over 4.244s wall clock time, 13.3M memory peak, 7.3K incoming IP traffic, 7.1K outgoing IP traffic.4947worker1 # [ 94.278773] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4948worker1 # [ 94.285217] systemd[1]: Closed Nix worker-protocol over gRPC.4949worker1 # [ 94.287045] systemd[1]: nix-grpc-daemon.socket: Consumed 866us CPU time over 4.293s wall clock time, 256K memory peak, 19K incoming IP traffic, 13.5K outgoing IP traffic.4950worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4951worker2 # [ 94.464528] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:42Z level=info event=scheduler_connected addr=lb:500514952worker2 # [ 94.471369] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4953worker2 # [ 94.672443] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:42Z level=info event=scheduler_connected addr=lb:500514954worker2 # [ 94.677927] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4955worker2 # [ 94.878735] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:42Z level=info event=scheduler_connected addr=lb:500514956worker2 # [ 94.885393] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4957worker2 # [ 95.086433] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:42Z level=info event=scheduler_connected addr=lb:500514958worker2 # [ 95.091693] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4959worker2 # [ 95.294849] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:42Z level=info event=scheduler_connected addr=lb:500514960worker2 # [ 95.300159] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4961worker2 # [ 95.501106] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:43Z level=info event=scheduler_connected addr=lb:500514962worker2 # [ 95.506261] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:43Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4963lb # [ 95.603202] niks3-server[1051]: 2026/09/20 09:05:43 INFO lead: acquired remote=192.168.1.4:356724964worker2 # [ 95.613029] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:43Z level=info event=scheduler_take_over4965worker2 # [ 95.705566] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:43Z level=info event=scheduler_connected addr=lb:500514966worker2 # [ 95.711739] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04967worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.26 seconds)4968worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4969worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)4970client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24971worker2 # [ 96.901740] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:538524972client # don't know how to build these paths:4973client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4974worker2 # [ 96.912823] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:538524975worker2 # [ 96.938340] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:44Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04976worker2 # [ 96.945647] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:44Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=14977worker2 # [ 96.985156] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:538524978worker2 # [ 97.000974] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:538524979client # copying 1 paths to 'lb:50051'...4980client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4981worker2 # [ 97.017035] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:538524982worker2 # [ 97.033021] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)4983worker2 # [ 97.239131] nix-daemon[842]: accepted connection from pid 1311, user nix-grpc-daemon (trusted)4984worker2 # [ 97.258643] nix-daemon[842]: reaped child process 1314, status = succeeded4985worker2 # [ 97.440415] nix-daemon[842]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)4986worker2 # [ 97.458571] nix-daemon[842]: reaped child process 1319, status = succeeded4987lb # [ 97.463594] niks3-server[1051]: 2026/09/20 09:05:45 INFO Received uploads request method=POST path=/api/pending_closures4988worker2 # [ 97.487263] nix-grpc-daemon[1263]: time=2026-09-20T09:05:45.124Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4989worker2 # [ 97.489043] nix-grpc-daemon[1263]: time=2026-09-20T09:05:45.124Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4990lb # [ 97.510726] niks3-server[1051]: 2026/09/20 09:05:45 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4991lb # [ 97.529672] niks3-server[1051]: 2026/09/20 09:05:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4992lb # [ 97.544625] niks3-server[1051]: 2026/09/20 09:05:45 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4993lb # [ 97.556050] niks3-server[1051]: 2026/09/20 09:05:45 INFO Signed narinfos id=27 count=14994worker2 # [ 97.565528] nix-grpc-daemon[1263]: time=2026-09-20T09:05:45.202Z level=INFO msg="Uploading 1 narinfos"4995lb # [ 97.564161] niks3-server[1051]: 2026/09/20 09:05:45 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4996lb # [ 97.570875] niks3-server[1051]: 2026/09/20 09:05:45 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4997lb # [ 97.581978] niks3-server[1051]: 2026/09/20 09:05:45 INFO Completed upload id=274998worker2 # [ 97.593201] nix-grpc-daemon[1263]: time=2026-09-20T09:05:45.231Z level=INFO msg="Upload complete. (544ms)"4999worker2 # [ 97.609073] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53852 duration_s=0 paths=1 nar_bytes_in=5205000worker2 # [ 97.627906] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:538525001worker2 # [ 97.640466] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5002worker2 # [ 97.655253] nix-daemon[842]: reaped child process 1309, status = succeeded5003client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5004worker2 # [ 97.665520] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5005client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5006client # farm-a> LOG-farm-a-on-standby5007worker2 # [ 98.500734] nix-daemon[842]: reaped child process 1323, status = succeeded5008worker2 # [ 98.685753] nix-daemon[842]: accepted connection from pid 1338, user nix-grpc-daemon (trusted)5009worker2 # [ 98.706808] nix-daemon[842]: reaped child process 1341, status = succeeded5010lb # [ 98.713445] niks3-server[1051]: 2026/09/20 09:05:46 INFO Received uploads request method=POST path=/api/pending_closures5011worker2 # [ 98.736869] nix-grpc-daemon[1263]: time=2026-09-20T09:05:46.374Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5012worker2 # [ 98.740672] nix-grpc-daemon[1263]: time=2026-09-20T09:05:46.376Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5013lb # [ 98.765854] niks3-server[1051]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5014lb # [ 98.777125] niks3-server[1051]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5015lb # [ 98.785494] niks3-server[1051]: 2026/09/20 09:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5016lb # [ 98.792161] niks3-server[1051]: 2026/09/20 09:05:46 INFO Signed narinfos id=28 count=15017worker2 # [ 98.801687] nix-grpc-daemon[1263]: time=2026-09-20T09:05:46.438Z level=INFO msg="Uploading 1 narinfos"5018lb # [ 98.797101] niks3-server[1051]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5019lb # [ 98.805581] niks3-server[1051]: 2026/09/20 09:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5020lb # [ 98.815757] niks3-server[1051]: 2026/09/20 09:05:46 INFO Completed upload id=285021worker2 # [ 98.824810] nix-grpc-daemon[1263]: time=2026-09-20T09:05:46.462Z level=INFO msg="Upload complete. (347ms)"5022lb # [ 98.818748] niks3-server[1051]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5023worker2 # [ 98.850277] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53852 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15024worker2 # [ 98.867430] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:46Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05025worker2 # [ 98.870912] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:46Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=15026worker2 # [ 98.874612] nix-daemon[842]: reaped child process 1321, status = succeeded5027worker2 # [ 98.894338] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:538525028worker2 # [ 98.910874] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:538525029worker2 # [ 98.926876] nix-grpc-daemon[1263]: time=2026-09-20T09:05:46.564Z level=INFO msg="All 1 paths already cached"5030client # copying 1 paths to 'lb:50051'...5031client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5032worker2 # [ 98.936130] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:538525033worker2 # [ 98.952353] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5034worker2 # [ 99.165362] nix-daemon[842]: accepted connection from pid 1347, user nix-grpc-daemon (trusted)5035worker2 # [ 99.185591] nix-daemon[842]: reaped child process 1350, status = succeeded5036worker2 # [ 99.369711] nix-daemon[842]: accepted connection from pid 1352, user nix-grpc-daemon (trusted)5037worker2 # [ 99.389065] nix-daemon[842]: reaped child process 1355, status = succeeded5038lb # [ 99.394370] niks3-server[1051]: 2026/09/20 09:05:47 INFO Received uploads request method=POST path=/api/pending_closures5039worker2 # [ 99.414154] nix-grpc-daemon[1263]: time=2026-09-20T09:05:47.051Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5040worker2 # [ 99.415920] nix-grpc-daemon[1263]: time=2026-09-20T09:05:47.051Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5041lb # [ 99.427992] niks3-server[1051]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5042worker2 # [ 99.448487] nix-grpc-daemon[1263]: time=2026-09-20T09:05:47.086Z level=INFO msg="Uploading 1 narinfos"5043lb # [ 99.445324] niks3-server[1051]: 2026/09/20 09:05:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5044lb # [ 99.457903] niks3-server[1051]: 2026/09/20 09:05:47 INFO Signed narinfos id=29 count=15045lb # [ 99.468467] niks3-server[1051]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5046worker2 # [ 99.482042] nix-grpc-daemon[1263]: time=2026-09-20T09:05:47.119Z level=INFO msg="Upload complete. (512ms)"5047lb # [ 99.473633] niks3-server[1051]: 2026/09/20 09:05:47 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5048lb # [ 99.479120] niks3-server[1051]: 2026/09/20 09:05:47 INFO Completed upload id=295049lb # [ 99.482686] niks3-server[1051]: 2026/09/20 09:05:47 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5050worker2 # [ 99.492266] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53852 duration_s=0 paths=1 nar_bytes_in=6405051worker2 # [ 99.505725] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:538525052worker2 # [ 99.512713] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5053worker2 # [ 99.517539] nix-daemon[842]: reaped child process 1345, status = succeeded5054client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5055client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5056worker2 # [ 99.531002] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5057client # farm-b> LOG-farm-b-on-standby5058worker2 # [ 100.172676] nix-daemon[842]: reaped child process 1359, status = succeeded5059worker2 # [ 100.373655] nix-daemon[842]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5060worker2 # [ 100.394772] nix-daemon[842]: reaped child process 1377, status = succeeded5061lb # [ 100.400765] niks3-server[1051]: 2026/09/20 09:05:48 INFO Received uploads request method=POST path=/api/pending_closures5062worker2 # [ 100.420418] nix-grpc-daemon[1263]: time=2026-09-20T09:05:48.057Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5063worker2 # [ 100.421942] nix-grpc-daemon[1263]: time=2026-09-20T09:05:48.057Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5064lb # [ 100.440472] niks3-server[1051]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5065lb # [ 100.454319] niks3-server[1051]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5066lb # [ 100.470522] niks3-server[1051]: 2026/09/20 09:05:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5067worker2 # [ 100.485126] nix-grpc-daemon[1263]: time=2026-09-20T09:05:48.122Z level=INFO msg="Uploading 1 narinfos"5068lb # [ 100.482055] niks3-server[1051]: 2026/09/20 09:05:48 INFO Signed narinfos id=30 count=15069lb # [ 100.488270] niks3-server[1051]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5070lb # [ 100.495176] niks3-server[1051]: 2026/09/20 09:05:48 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5071lb # [ 100.504722] niks3-server[1051]: 2026/09/20 09:05:48 INFO Completed upload id=305072lb # [ 100.507617] niks3-server[1051]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5073worker2 # [ 100.513902] nix-grpc-daemon[1263]: time=2026-09-20T09:05:48.151Z level=INFO msg="Upload complete. (372ms)"5074worker2 # [ 100.529488] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53852 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15075worker2 # [ 100.546815] nix-daemon[842]: reaped child process 1357, status = succeeded5076worker2 # [ 100.571937] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:48Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05077worker2 # [ 100.579044] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:48Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=15078worker2 # [ 100.617196] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:538525079worker2 # [ 100.632778] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:538525080worker2 # [ 100.647777] nix-grpc-daemon[1263]: time=2026-09-20T09:05:48.285Z level=INFO msg="All 2 paths already cached"5081client # copying 1 paths to 'lb:50051'...5082client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5083worker2 # [ 100.658804] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:538525084worker2 # [ 100.673826] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5085worker2 # [ 100.874040] nix-daemon[842]: accepted connection from pid 1383, user nix-grpc-daemon (trusted)5086worker2 # [ 100.893290] nix-daemon[842]: reaped child process 1386, status = succeeded5087worker2 # [ 101.073338] nix-daemon[842]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5088worker2 # [ 101.091553] nix-daemon[842]: reaped child process 1391, status = succeeded5089lb # [ 101.095965] niks3-server[1051]: 2026/09/20 09:05:48 INFO Received uploads request method=POST path=/api/pending_closures5090worker2 # [ 101.115937] nix-grpc-daemon[1263]: time=2026-09-20T09:05:48.753Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5091worker2 # [ 101.117672] nix-grpc-daemon[1263]: time=2026-09-20T09:05:48.753Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5092lb # [ 101.123287] niks3-server[1051]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5093lb # [ 101.136737] niks3-server[1051]: 2026/09/20 09:05:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5094worker2 # [ 101.152449] nix-grpc-daemon[1263]: time=2026-09-20T09:05:48.790Z level=INFO msg="Uploading 1 narinfos"5095lb # [ 101.146423] niks3-server[1051]: 2026/09/20 09:05:48 INFO Signed narinfos id=31 count=15096lb # [ 101.156856] niks3-server[1051]: 2026/09/20 09:05:48 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5097worker2 # [ 101.177411] nix-grpc-daemon[1263]: time=2026-09-20T09:05:48.815Z level=INFO msg="Upload complete. (485ms)"5098lb # [ 101.168690] niks3-server[1051]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5099worker2 # [ 101.184198] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53852 duration_s=0 paths=1 nar_bytes_in=7685100lb # [ 101.180133] niks3-server[1051]: 2026/09/20 09:05:48 INFO Completed upload id=315101worker2 # [ 101.196719] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:538525102worker2 # [ 101.200393] nix-grpc-daemon[1263]: time=2026-09-20T09:05:48.838Z level=WARN msg="Failed to register uploaded object" key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo error="server returned 404: object is not pending upload\n"5103worker2 # [ 101.209901] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5104worker2 # [ 101.213801] nix-daemon[842]: reaped child process 1381, status = succeeded5105client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5106worker2 # [ 101.225044] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5107client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5108lb # [ 101.254065] envoy[912]: conn peer=[2001:db8:1::3]:50214 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1028 tx=362 ms=22225109client # farm-top> LOG-farm-top-on-standby5110worker2 # [ 102.447840] nix-daemon[842]: reaped child process 1395, status = succeeded5111worker2 # [ 102.613175] nix-daemon[842]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5112worker2 # [ 102.632969] nix-daemon[842]: reaped child process 1413, status = succeeded5113lb # [ 102.637360] niks3-server[1051]: 2026/09/20 09:05:50 INFO Received uploads request method=POST path=/api/pending_closures5114worker2 # [ 102.664529] nix-grpc-daemon[1263]: time=2026-09-20T09:05:50.301Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5115worker2 # [ 102.666070] nix-grpc-daemon[1263]: time=2026-09-20T09:05:50.301Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5116lb # [ 102.701635] niks3-server[1051]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5117lb # [ 102.713266] niks3-server[1051]: 2026/09/20 09:05:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5118worker2 # [ 102.722307] nix-grpc-daemon[1263]: time=2026-09-20T09:05:50.359Z level=INFO msg="Uploading 1 narinfos"5119lb # [ 102.721805] niks3-server[1051]: 2026/09/20 09:05:50 INFO Signed narinfos id=32 count=15120lb # [ 102.726852] niks3-server[1051]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5121lb # [ 102.738111] niks3-server[1051]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5122lb # [ 102.742844] niks3-server[1051]: 2026/09/20 09:05:50 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5123lb # [ 102.747740] niks3-server[1051]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5124worker2 # [ 102.756496] nix-grpc-daemon[1263]: time=2026-09-20T09:05:50.394Z level=INFO msg="Upload complete. (322ms)"5125lb # [ 102.751537] niks3-server[1051]: 2026/09/20 09:05:50 INFO Completed upload id=325126worker2 # [ 102.769331] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53852 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15127worker2 # [ 102.790000] nix-daemon[842]: reaped child process 1393, status = succeeded5128client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.16 seconds)5129client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5130client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds)5131worker1 # [ 103.102692] systemd[1]: Listening on Nix worker-protocol over gRPC.5132worker1 # [ 103.112185] systemd[1]: Starting Nix worker-protocol over gRPC...5133worker1 # [ 103.311091] nix-grpc-daemon[1171]: ts=2026-09-20T09:05:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5134worker1 # [ 103.314104] nix-grpc-daemon[1171]: ts=2026-09-20T09:05:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15135worker1 # [ 103.322222] nix-grpc-daemon[1171]: ts=2026-09-20T09:05:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5136worker1 # [ 103.323976] systemd[1]: Started Nix worker-protocol over gRPC.5137lb: must succeed: curl -sf localhost:9901/clusters5138worker1 # [ 103.376439] nix-grpc-daemon[1171]: ts=2026-09-20T09:05:51Z level=info event=scheduler_connected addr=lb:500515139worker2 # [ 103.414942] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05140lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5141worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5142worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5143lb: must succeed: curl -sf localhost:9901/clusters5144lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5145lb: must succeed: curl -sf localhost:9901/clusters5146lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5147worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5148worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5149(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.42 seconds)5150subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5151client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5152client # [ 103.839873] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5153client # Running as unit: rs.service; invocation ID: 8b247b6dc61d4ad694437b92cccbee025154client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5155worker2 # [ 104.116991] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:538525156client # [ 104.089406] nix[1173]: don't know how to build these paths:5157client # [ 104.090581] nix[1173]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5158worker2 # [ 104.136786] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:51Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05159worker2 # [ 104.143852] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:51Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=15160worker2 # [ 104.187492] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:538525161worker2 # [ 104.203768] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:538525162client # [ 104.181164] nix[1173]: copying 1 paths to 'lb:50051'...5163client # [ 104.185719] nix[1173]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5164worker2 # [ 104.221690] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:538525165worker2 # [ 104.236903] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5166worker2 # [ 104.446514] nix-daemon[842]: accepted connection from pid 1428, user nix-grpc-daemon (trusted)5167worker2 # [ 104.464495] nix-daemon[842]: reaped child process 1431, status = succeeded5168worker2 # [ 104.639615] nix-daemon[842]: accepted connection from pid 1433, user nix-grpc-daemon (trusted)5169worker2 # [ 104.655853] nix-daemon[842]: reaped child process 1436, status = succeeded5170lb # [ 104.663394] niks3-server[1051]: 2026/09/20 09:05:52 INFO Received uploads request method=POST path=/api/pending_closures5171worker2 # [ 104.682969] nix-grpc-daemon[1263]: time=2026-09-20T09:05:52.320Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5172worker2 # [ 104.684570] nix-grpc-daemon[1263]: time=2026-09-20T09:05:52.320Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5173lb # [ 104.699707] niks3-server[1051]: 2026/09/20 09:05:52 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5174lb # [ 104.713413] niks3-server[1051]: 2026/09/20 09:05:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5175worker2 # [ 104.727912] nix-grpc-daemon[1263]: time=2026-09-20T09:05:52.365Z level=INFO msg="Uploading 1 narinfos"5176lb # [ 104.720560] niks3-server[1051]: 2026/09/20 09:05:52 INFO Signed narinfos id=33 count=15177lb # [ 104.727844] niks3-server[1051]: 2026/09/20 09:05:52 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5178lb # [ 104.737155] niks3-server[1051]: 2026/09/20 09:05:52 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5179lb # [ 104.744767] niks3-server[1051]: 2026/09/20 09:05:52 INFO Completed upload id=335180worker2 # [ 104.753784] nix-grpc-daemon[1263]: time=2026-09-20T09:05:52.391Z level=INFO msg="Upload complete. (500ms)"5181lb # [ 104.747897] niks3-server[1051]: 2026/09/20 09:05:52 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5182worker2 # [ 104.764767] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53852 duration_s=0 paths=1 nar_bytes_in=4165183worker2 # [ 104.777649] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:538525184worker2 # [ 104.784456] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5185worker2 # [ 104.789591] nix-daemon[842]: reaped child process 1426, status = succeeded5186client # [ 104.764324] nix[1173]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5187worker2 # [ 104.803840] nix-daemon[842]: accepted connection from pid 1207, user nix-grpc-daemon (trusted)5188lb: must succeed: curl -sf localhost:9901/clusters5189lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5190lb: must succeed: curl -sf localhost:9901/clusters5191lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5192lb: must succeed: curl -sf localhost:9901/clusters5193lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5194lb: must succeed: curl -sf localhost:9901/clusters5195lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5196worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5197worker1 # [ 106.824557] systemd-journald[267]: Received client request to rotate journal, rotating.5198worker1 # [ 106.851222] systemd-journald[267]: Vacuuming done, freed 0B of archived journals from /var/log/journal/cad87e779db0493c8abbf36fa8e1bcef.5199worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5200worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5201worker2 # [ 106.942471] systemd[1]: Stopping Nix worker-protocol over gRPC...5202worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5203client: must succeed: sleep 5.05204worker2 # [ 107.608126] nix-grpc-daemon[1207]: ts=2026-09-20T09:05:55Z level=info event=draining5205lb # [ 111.253900] envoy[912]: conn peer=[2001:db8:1::1]:35536 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9610 tx=3842 ms=58825206client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5207worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5208worker2 # [ 112.438440] nix-daemon[842]: reaped child process 1440, status = succeeded5209worker2 # [ 112.610447] nix-daemon[842]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5210worker2 # [ 112.627952] nix-daemon[842]: reaped child process 1483, status = succeeded5211worker2 # [ 112.652423] nix-grpc-daemon[1263]: time=2026-09-20T09:06:00.288Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5212worker2 # [ 112.654029] nix-grpc-daemon[1263]: time=2026-09-20T09:06:00.288Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5213lb # [ 112.631909] niks3-server[1051]: 2026/09/20 09:06:00 INFO Received uploads request method=POST path=/api/pending_closures5214lb # [ 112.681136] niks3-server[1051]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5215lb # [ 112.692906] niks3-server[1051]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5216lb # [ 112.703411] niks3-server[1051]: 2026/09/20 09:06:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5217worker2 # [ 112.718884] nix-grpc-daemon[1263]: time=2026-09-20T09:06:00.356Z level=INFO msg="Uploading 1 narinfos"5218lb # [ 112.709797] niks3-server[1051]: 2026/09/20 09:06:00 INFO Signed narinfos id=34 count=15219lb # [ 112.714711] niks3-server[1051]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5220lb # [ 112.725806] niks3-server[1051]: 2026/09/20 09:06:00 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5221lb # [ 112.733411] niks3-server[1051]: 2026/09/20 09:06:00 INFO Completed upload id=345222lb # [ 112.735945] niks3-server[1051]: 2026/09/20 09:06:00 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5223worker2 # [ 112.740628] nix-grpc-daemon[1263]: time=2026-09-20T09:06:00.378Z level=INFO msg="Upload complete. (321ms)"5224worker2 # [ 112.754038] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53852 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15225worker2 # [ 112.772807] nix-daemon[842]: reaped child process 1438, status = succeeded5226client # [ 112.763088] systemd[1]: rs.service: Deactivated successfully.5227client # [ 112.767550] systemd[1]: rs.service: Consumed 164ms CPU time over 8.926s wall clock time, 39.2M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.5228worker2 # [ 113.608824] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:01Z level=info event=signal_exit5229worker2 # [ 113.836711] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:01Z level=info event=scheduler_yield5230lb # [ 113.829366] niks3-server[1051]: 2026/09/20 09:06:01 INFO lead: released remote=192.168.1.4:356725231worker2 # [ 113.843747] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:01Z level=info event=scheduler_restarting addr=lb:500515232worker1 # [ 113.810108] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:01Z level=info event=scheduler_restarting addr=lb:500515233worker2 # [ 113.849641] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:538425234worker2 # [ 113.855440] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:01Z level=info event=worker_gone addr=192.168.1.4:500515235worker2 # [ 113.859762] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:538425236worker2 # [ 113.864365] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:01Z level=info event=worker_gone addr=192.168.1.3:500515237worker2 # [ 114.044937] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515238worker1 # [ 114.010056] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515239worker1 # [ 114.021215] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5240worker2 # [ 114.065783] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5241worker1 # [ 114.222388] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515242worker1 # [ 114.228129] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5243worker2 # [ 114.266660] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515244worker2 # [ 114.271885] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5245worker1 # [ 114.428797] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515246worker1 # [ 114.434188] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5247worker2 # [ 114.472798] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515248worker2 # [ 114.478442] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5249worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.24 seconds)5250client: waiting for success: ! systemctl is-active rs5251client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5252client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5253worker1 # [ 114.635354] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515254worker1 # [ 114.640933] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5255worker2 # [ 114.679057] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515256worker2 # [ 114.684446] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5257client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5258client: must fail: journalctl -u rs | grep -q 'reconnecting'5259client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5260lb: must succeed: curl -sf localhost:9901/clusters5261lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5262worker2 # [ 114.846724] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:02Z level=info event=scheduler_restarting5263worker2 # [ 114.875398] nix-daemon[842]: reaped child process 1256, status = succeeded5264worker1 # [ 114.842932] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515265worker2 # [ 114.879477] nix-grpc-daemon[1207]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5266worker2 # [ 114.884296] nix-grpc-daemon[1207]: E0000 00:00:1789895162.516947 1250 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5267worker2 # [ 114.911372] nix-grpc-daemon[1207]: ts=2026-09-20T09:06:02Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5268worker1 # [ 115.562312] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5269worker2 # [ 115.621265] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5270worker2 # [ 115.625275] systemd[1]: Stopped Nix worker-protocol over gRPC.5271worker2 # [ 115.627751] systemd[1]: nix-grpc-daemon.service: Consumed 2.036s CPU time over 30.251s wall clock time, 36.1M memory peak, 58.2K incoming IP traffic, 112.1K outgoing IP traffic.5272worker2 # [ 115.647087] systemd[1]: Starting Nix worker-protocol over gRPC...5273worker1 # [ 115.763311] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500515274worker1 # [ 115.770578] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5275lb: must succeed: curl -sf localhost:9901/clusters5276worker2 # [ 115.858094] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5277worker2 # [ 115.861304] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15278worker2 # [ 115.870346] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5279lb # [ 115.876926] niks3-server[1051]: 2026/09/20 09:06:03 INFO lead: acquired remote=192.168.1.4:334745280worker2 # [ 115.892255] systemd[1]: Started Nix worker-protocol over gRPC.5281worker2 # [ 115.901254] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:03Z level=info event=scheduler_take_over5282lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5283worker2 # [ 115.911118] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500515284worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5285worker2 # [ 115.916002] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05286worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5287worker2 # [ 116.008455] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05288worker1 # [ 115.973011] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500515289lb: must succeed: curl -sf localhost:9901/clusters5290lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5291worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5292worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5293(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.33 seconds)5294subtest: scheduler restart mid-build: build finishes, no double build5295client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5296client # [ 117.168769] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5297client # Running as unit: mid.service; invocation ID: 62dabe78096f4a88a97842160ef1e4be5298client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5299worker1 # [ 117.424815] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:405305300worker1 # [ 117.440223] nix-daemon[861]: accepted connection from pid 1171, user nix-grpc-daemon (trusted)5301client # [ 117.460605] nix[1209]: don't know how to build these paths:5302client # [ 117.464710] nix[1209]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5303worker2 # [ 117.514398] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:05Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05304worker2 # [ 117.514700] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:05Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15305worker2 # [ 117.573784] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564025306worker2 # [ 117.588467] nix-daemon[842]: accepted connection from pid 1490, user nix-grpc-daemon (trusted)5307worker2 # [ 117.611634] nix-grpc-daemon[1490]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 1/5)5308worker2 # [ 117.618107] nix-grpc-daemon[1490]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 2/5)5309worker2 # [ 117.714075] nix-grpc-daemon[1490]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 296 ms (attempt 3/5)5310worker2 # [ 118.017699] nix-grpc-daemon[1490]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 278 ms (attempt 4/5)5311worker2 # [ 118.303909] nix-grpc-daemon[1490]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5312worker2 # [ 118.325587] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564025313client # [ 118.304244] nix[1209]: copying 1 paths to 'lb:50051'...5314client # [ 118.310134] nix[1209]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5315worker2 # [ 118.344816] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564025316worker2 # [ 118.359465] nix-daemon[842]: accepted connection from pid 1490, user nix-grpc-daemon (trusted)5317worker2 # [ 118.389051] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:06Z level=info event=niks3_push_started pid=15625318worker2 # [ 118.806082] nix-daemon[842]: accepted connection from pid 1579, user nix-grpc-daemon (trusted)5319worker2 # [ 118.823173] nix-daemon[842]: reaped child process 1582, status = succeeded5320worker2 # [ 119.000578] nix-daemon[842]: accepted connection from pid 1584, user nix-grpc-daemon (trusted)5321worker2 # [ 119.017308] nix-daemon[842]: reaped child process 1587, status = succeeded5322lb # [ 119.022771] niks3-server[1051]: 2026/09/20 09:06:06 INFO Received uploads request method=POST path=/api/pending_closures5323worker2 # [ 119.042808] nix-grpc-daemon[1562]: time=2026-09-20T09:06:06.679Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5324worker2 # [ 119.044491] nix-grpc-daemon[1562]: time=2026-09-20T09:06:06.679Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5325lb # [ 119.066141] niks3-server[1051]: 2026/09/20 09:06:06 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5326worker2 # [ 119.088335] nix-grpc-daemon[1562]: time=2026-09-20T09:06:06.725Z level=INFO msg="Uploading 1 narinfos"5327lb # [ 119.078384] niks3-server[1051]: 2026/09/20 09:06:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5328lb # [ 119.088215] niks3-server[1051]: 2026/09/20 09:06:06 INFO Signed narinfos id=35 count=15329lb # [ 119.096348] niks3-server[1051]: 2026/09/20 09:06:06 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5330lb # [ 119.104565] niks3-server[1051]: 2026/09/20 09:06:06 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5331lb # [ 119.112535] niks3-server[1051]: 2026/09/20 09:06:06 INFO Completed upload id=355332worker2 # [ 119.120652] nix-grpc-daemon[1562]: time=2026-09-20T09:06:06.758Z level=INFO msg="Upload complete. (491ms)"5333lb # [ 119.115494] niks3-server[1051]: 2026/09/20 09:06:06 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5334worker2 # [ 119.128875] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56402 duration_s=0 paths=1 nar_bytes_in=4245335worker2 # [ 119.144708] nix-grpc-daemon[1490]: ts=2026-09-20T09:06:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564025336worker2 # [ 119.154840] nix-daemon[842]: accepted connection from pid 1490, user nix-grpc-daemon (trusted)5337worker2 # [ 119.157211] nix-daemon[842]: reaped child process 1560, status = succeeded5338client # [ 119.133442] nix[1209]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5339worker2 # [ 119.171513] nix-daemon[842]: accepted connection from pid 1490, user nix-grpc-daemon (trusted)5340lb: must succeed: curl -sf localhost:9901/clusters5341lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5342lb: must succeed: curl -sf localhost:9901/clusters5343lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5344worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5345worker2 # [ 121.237459] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1490 (nix-grpc-daemon) on client request.5346worker2 # [ 121.239163] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5347client # [ 121.210923] nix[1209]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5348worker1 # [ 121.210717] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:08Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5349client # [ 121.217311] nix[1209]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5350lb # [ 121.243959] niks3-server[1051]: 2026/09/20 09:06:08 INFO lead: released remote=192.168.1.4:334745351lb # [ 121.254271] envoy[912]: conn peer=[2001:db8:1::1]:43436 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1327 ms=86535352worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5353client: must succeed: sleep 5.05354lb # [ 121.259279] envoy[912]: conn peer=[2001:db8:1::4]:35954 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5536 tx=1796 ms=292635355lb # [ 121.265556] envoy[912]: conn peer=[2001:db8:1::4]:55638 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=470 tx=226 ms=53375356worker2 # [ 121.284235] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5357worker2 # [ 121.285816] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5358worker2 # [ 121.287013] systemd[1]: nix-grpc-daemon.service: Consumed 529ms CPU time over 5.627s wall clock time, 34.2M memory peak, 12.2K incoming IP traffic, 19.2K outgoing IP traffic.5359worker2 # [ 121.292813] nix-daemon[842]: reaped child process 1555, status = succeeded5360worker2 # [ 121.294447] nix-daemon[842]: reaped child process 1589, status = succeeded5361worker2 # [ 121.304564] nix-daemon[1591]: unexpected Nix daemon error: error: interrupted by the user5362worker2 # [ 121.310632] nix-daemon[842]: reaped child process 1591, status = failed with exit code 15363worker2 # [ 121.428293] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5364worker2 # [ 121.433137] systemd[1]: Starting Nix worker-protocol over gRPC...5365worker1 # [ 121.410412] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:09Z level=info event=scheduler_connected addr=lb:500515366worker2 # [ 121.634142] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5367worker2 # [ 121.637208] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15368worker2 # [ 121.644787] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5369worker2 # [ 121.646555] systemd[1]: Started Nix worker-protocol over gRPC.5370worker2 # [ 121.659365] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:09Z level=info event=scheduler_take_over5371lb # [ 121.649000] niks3-server[1051]: 2026/09/20 09:06:09 INFO lead: acquired remote=192.168.1.4:444445372worker2 # [ 121.673834] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05373worker2 # [ 121.687231] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:09Z level=info event=scheduler_connected addr=lb:500515374worker2 # [ 121.689179] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05375worker2 # [ 121.754756] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:09Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05376worker2 # [ 121.759709] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:09Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15377worker1 # [ 121.766767] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405305378worker1 # [ 121.784614] nix-grpc-daemon[1171]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 1/5)5379worker1 # [ 121.805177] nix-grpc-daemon[1171]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 105 ms (attempt 2/5)5380worker1 # [ 121.917978] nix-grpc-daemon[1171]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 225 ms (attempt 3/5)5381worker1 # [ 122.143490] nix-grpc-daemon[1171]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 117 ms (attempt 4/5)5382worker1 # [ 122.262452] nix-grpc-daemon[1171]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5383worker1 # [ 122.282113] nix-grpc-daemon[1171]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5384worker1 # [ 122.313249] nix-daemon[861]: accepted connection from pid 1171, user nix-grpc-daemon (trusted)5385client # [ 122.332371] nix[1209]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5386worker1 # [ 122.336677] nix-daemon[861]: accepted connection from pid 1171, user nix-grpc-daemon (trusted)5387client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5388worker1 # [ 126.556888] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:14Z level=info event=niks3_push_started pid=13245389worker1 # [ 126.575317] nix-daemon[861]: reaped child process 1300, status = succeeded5390client: waiting for success: ! systemctl is-active mid5391worker1 # [ 126.930551] nix-daemon[861]: accepted connection from pid 1337, user nix-grpc-daemon (trusted)5392worker1 # [ 126.949136] nix-daemon[861]: reaped child process 1340, status = succeeded5393lb # [ 126.990785] niks3-server[1051]: 2026/09/20 09:06:14 INFO Received uploads request method=POST path=/api/pending_closures5394worker1 # [ 126.976148] nix-grpc-daemon[1324]: time=2026-09-20T09:06:14.618Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5395worker1 # [ 126.977701] nix-grpc-daemon[1324]: time=2026-09-20T09:06:14.619Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5396lb # [ 127.031833] niks3-server[1051]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5397lb # [ 127.047744] niks3-server[1051]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5398lb # [ 127.060094] niks3-server[1051]: 2026/09/20 09:06:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5399worker1 # [ 127.040109] nix-grpc-daemon[1324]: time=2026-09-20T09:06:14.684Z level=INFO msg="Uploading 1 narinfos"5400lb # [ 127.068124] niks3-server[1051]: 2026/09/20 09:06:14 INFO Signed narinfos id=36 count=15401lb # [ 127.072738] niks3-server[1051]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5402lb # [ 127.083079] niks3-server[1051]: 2026/09/20 09:06:14 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5403lb # [ 127.089729] niks3-server[1051]: 2026/09/20 09:06:14 INFO Completed upload id=365404worker1 # [ 127.063259] nix-grpc-daemon[1324]: time=2026-09-20T09:06:14.708Z level=INFO msg="Upload complete. (309ms)"5405worker1 # [ 127.076287] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40530 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15406worker1 # [ 127.088985] nix-grpc-daemon[1324]: time=2026-09-20T09:06:14.728Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5407worker1 # [ 127.094913] nix-daemon[861]: reaped child process 1298, status = succeeded5408client # [ 127.118623] systemd[1]: mid.service: Deactivated successfully.5409client # [ 127.122801] systemd[1]: mid.service: Consumed 170ms CPU time over 9.953s wall clock time, 37.2M memory peak, 9.6K incoming IP traffic, 10.5K outgoing IP traffic.5410client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5411client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5412client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)5413(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.70 seconds)5414subtest: interrupting the client stops the build on the worker5415client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5416client # [ 127.847140] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5417client # Running as unit: intr.service; invocation ID: 5d77b0ecccd14d3a835ff245d3abac885418client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5419worker1 # [ 128.071147] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:405305420client # [ 128.078870] nix[1245]: don't know how to build these paths:5421client # [ 128.079861] nix[1245]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5422worker2 # [ 128.132292] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:15Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05423worker2 # [ 128.137721] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:15Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15424worker2 # [ 128.182211] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340725425worker2 # [ 128.197309] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5426worker2 # [ 128.220876] nix-grpc-daemon[1627]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 70 ms (attempt 1/5)5427worker2 # [ 128.297315] nix-grpc-daemon[1627]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 2/5)5428worker2 # [ 128.316783] nix-grpc-daemon[1627]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 360 ms (attempt 3/5)5429worker2 # [ 128.684346] nix-grpc-daemon[1627]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 543 ms (attempt 4/5)5430worker2 # [ 129.236433] nix-grpc-daemon[1627]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5431worker2 # [ 129.252699] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340725432client # [ 129.229356] nix[1245]: copying 1 paths to 'lb:50051'...5433worker2 # [ 129.264968] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:340725434client # [ 129.234747] nix[1245]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5435worker2 # [ 129.278491] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5436worker2 # [ 129.301641] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:16Z level=info event=niks3_push_started pid=17035437worker2 # [ 129.677918] nix-daemon[842]: accepted connection from pid 1716, user nix-grpc-daemon (trusted)5438worker2 # [ 129.695153] nix-daemon[842]: reaped child process 1719, status = succeeded5439worker2 # [ 129.870008] nix-daemon[842]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)5440worker2 # [ 129.887027] nix-daemon[842]: reaped child process 1724, status = succeeded5441lb # [ 129.890002] niks3-server[1051]: 2026/09/20 09:06:17 INFO Received uploads request method=POST path=/api/pending_closures5442worker2 # [ 129.914820] nix-grpc-daemon[1703]: time=2026-09-20T09:06:17.551Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5443worker2 # [ 129.916599] nix-grpc-daemon[1703]: time=2026-09-20T09:06:17.551Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5444lb # [ 129.943714] niks3-server[1051]: 2026/09/20 09:06:17 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5445worker2 # [ 129.961625] nix-grpc-daemon[1703]: time=2026-09-20T09:06:17.598Z level=INFO msg="Uploading 1 narinfos"5446lb # [ 129.956087] niks3-server[1051]: 2026/09/20 09:06:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5447lb # [ 129.965705] niks3-server[1051]: 2026/09/20 09:06:17 INFO Signed narinfos id=37 count=15448worker2 # [ 129.984637] nix-grpc-daemon[1703]: time=2026-09-20T09:06:17.622Z level=INFO msg="Upload complete. (476ms)"5449lb # [ 129.976833] niks3-server[1051]: 2026/09/20 09:06:17 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5450lb # [ 129.981918] niks3-server[1051]: 2026/09/20 09:06:17 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5451worker2 # [ 129.992120] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=0 paths=1 nar_bytes_in=4245452lb # [ 129.985786] niks3-server[1051]: 2026/09/20 09:06:17 INFO Completed upload id=375453lb # [ 129.987841] niks3-server[1051]: 2026/09/20 09:06:17 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5454worker2 # [ 130.005214] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340725455worker2 # [ 130.008467] nix-daemon[842]: reaped child process 1701, status = succeeded5456worker2 # [ 130.013419] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5457client # [ 129.989289] nix[1245]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5458worker2 # [ 130.027750] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5459lb # [ 131.254375] envoy[912]: conn peer=[2001:db8:1::1]:36706 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3841 tx=1685 ms=96775460client: must succeed: systemctl kill -s INT intr5461client # [ 131.604970] systemd[1]: intr.service: Sent signal SIGINT to main process 1245 (nix) on client request.5462worker2 # [ 131.652198] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:19Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5463client # [ 131.615204] nix[1245]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5464client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5465client # [ 131.626784] nix[1245]: error: interrupted by the user5466client # [ 131.661022] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5467client # [ 131.665640] systemd[1]: intr.service: Failed with result 'exit-code'.5468client # [ 131.667698] systemd[1]: intr.service: Consumed 145ms CPU time over 3.816s wall clock time, 39.2M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5469worker2 # [ 131.853252] nix-daemon[1728]: unexpected Nix daemon error: error: interrupted by the user5470worker2 # [ 131.860502] nix-daemon[842]: reaped child process 1726, status = succeeded5471worker2 # [ 131.863403] nix-daemon[842]: reaped child process 1728, status = failed with exit code 15472(finished: subtest: interrupting the client stops the build on the worker, in 5.15 seconds)5473subtest: a deploy mid-build drains: the build finishes, the new generation takes over5474client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5475client # [ 133.023151] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5476client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds)5477client # Running as unit: sw.service; invocation ID: 54ae468105a14459b282e0ed3fae732b5478client # [ 133.257140] nix[1266]: don't know how to build these paths:5479client # [ 133.259030] nix[1266]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5480worker2 # [ 133.291161] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:340725481worker2 # [ 133.306473] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:20Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05482worker2 # [ 133.312537] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:20Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15483worker1 # [ 133.321440] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405305484worker1 # [ 133.337507] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405305485client # [ 133.351539] nix[1266]: copying 1 paths to 'lb:50051'...5486client # [ 133.356388] nix[1266]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5487worker1 # [ 133.356824] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:405305488worker1 # [ 133.372547] nix-daemon[861]: accepted connection from pid 1171, user nix-grpc-daemon (trusted)5489worker1 # [ 133.588979] nix-daemon[861]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)5490worker1 # [ 133.607856] nix-daemon[861]: reaped child process 1375, status = succeeded5491worker1 # [ 133.786474] nix-daemon[861]: accepted connection from pid 1377, user nix-grpc-daemon (trusted)5492worker1 # [ 133.803678] nix-daemon[861]: reaped child process 1380, status = succeeded5493lb # [ 133.842339] niks3-server[1051]: 2026/09/20 09:06:21 INFO Received uploads request method=POST path=/api/pending_closures5494worker1 # [ 133.826163] nix-grpc-daemon[1324]: time=2026-09-20T09:06:21.470Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5495worker1 # [ 133.827635] nix-grpc-daemon[1324]: time=2026-09-20T09:06:21.470Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5496lb # [ 133.873740] niks3-server[1051]: 2026/09/20 09:06:21 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5497worker1 # [ 133.862816] nix-grpc-daemon[1324]: time=2026-09-20T09:06:21.507Z level=INFO msg="Uploading 1 narinfos"5498lb # [ 133.889491] niks3-server[1051]: 2026/09/20 09:06:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5499lb # [ 133.897721] niks3-server[1051]: 2026/09/20 09:06:21 INFO Signed narinfos id=38 count=15500lb # [ 133.904134] niks3-server[1051]: 2026/09/20 09:06:21 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5501lb # [ 133.912309] niks3-server[1051]: 2026/09/20 09:06:21 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5502lb # [ 133.919940] niks3-server[1051]: 2026/09/20 09:06:21 INFO Completed upload id=385503worker1 # [ 133.893608] nix-grpc-daemon[1324]: time=2026-09-20T09:06:21.538Z level=INFO msg="Upload complete. (503ms)"5504lb # [ 133.922704] niks3-server[1051]: 2026/09/20 09:06:21 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5505worker1 # [ 133.900218] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40530 duration_s=0 paths=1 nar_bytes_in=4165506worker1 # [ 133.913961] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405305507worker1 # [ 133.922134] nix-daemon[861]: accepted connection from pid 1171, user nix-grpc-daemon (trusted)5508worker1 # [ 133.927166] nix-daemon[861]: reaped child process 1370, status = succeeded5509worker1 # [ 133.938876] nix-daemon[861]: accepted connection from pid 1171, user nix-grpc-daemon (trusted)5510client # [ 133.937759] nix[1266]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5511worker1: must succeed: systemctl reload nix-grpc-daemon.service5512worker1 # [ 136.895313] systemd[1]: Reloading Nix worker-protocol over gRPC...5513worker1 # [ 136.951022] systemd[1]: Reloaded Nix worker-protocol over gRPC.5514worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5515worker1: must succeed: pgrep -f 'read -t [9]0 x'5516worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5517client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25518client # don't know how to build these paths:5519client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5520worker1 # [ 137.274273] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405305521worker2 # [ 137.306081] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:340725522worker2 # [ 137.331616] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:24Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05523worker2 # [ 137.339323] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:24Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15524worker1 # [ 137.346648] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:24Z level=info event=draining5525worker2 # [ 137.384414] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340725526worker2 # [ 137.399229] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340725527client # copying 1 paths to 'lb:50051'...5528worker2 # [ 137.414893] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:340725529client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5530worker2 # [ 137.439149] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5531worker2 # [ 137.644707] nix-daemon[842]: accepted connection from pid 1786, user nix-grpc-daemon (trusted)5532worker2 # [ 137.664728] nix-daemon[842]: reaped child process 1789, status = succeeded5533worker2 # [ 137.837659] nix-daemon[842]: accepted connection from pid 1791, user nix-grpc-daemon (trusted)5534worker2 # [ 137.855871] nix-daemon[842]: reaped child process 1794, status = succeeded5535lb # [ 137.863204] niks3-server[1051]: 2026/09/20 09:06:25 INFO Received uploads request method=POST path=/api/pending_closures5536worker2 # [ 137.884574] nix-grpc-daemon[1703]: time=2026-09-20T09:06:25.521Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5537worker2 # [ 137.886412] nix-grpc-daemon[1703]: time=2026-09-20T09:06:25.521Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5538lb # [ 137.894990] niks3-server[1051]: 2026/09/20 09:06:25 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5539worker2 # [ 137.918182] nix-grpc-daemon[1703]: time=2026-09-20T09:06:25.555Z level=INFO msg="Uploading 1 narinfos"5540lb # [ 137.909077] niks3-server[1051]: 2026/09/20 09:06:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5541lb # [ 137.923143] niks3-server[1051]: 2026/09/20 09:06:25 INFO Signed narinfos id=39 count=15542lb # [ 137.930005] niks3-server[1051]: 2026/09/20 09:06:25 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5543lb # [ 137.939684] niks3-server[1051]: 2026/09/20 09:06:25 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5544lb # [ 137.945368] niks3-server[1051]: 2026/09/20 09:06:25 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5545lb # [ 137.949769] niks3-server[1051]: 2026/09/20 09:06:25 INFO Completed upload id=395546worker2 # [ 137.958764] nix-grpc-daemon[1703]: time=2026-09-20T09:06:25.596Z level=INFO msg="Upload complete. (501ms)"5547worker2 # [ 137.967625] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=0 paths=1 nar_bytes_in=5285548worker2 # [ 137.984414] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340725549worker2 # [ 137.991355] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5550worker2 # [ 137.996750] nix-daemon[842]: reaped child process 1784, status = succeeded5551client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5552worker2 # [ 138.008889] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5553client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5554client # farm-a> LOG-farm-a-during-drain5555worker2 # [ 139.460993] nix-daemon[842]: reaped child process 1798, status = succeeded5556worker2 # [ 139.639832] nix-daemon[842]: accepted connection from pid 1813, user nix-grpc-daemon (trusted)5557worker2 # [ 139.657486] nix-daemon[842]: reaped child process 1816, status = succeeded5558lb # [ 139.662252] niks3-server[1051]: 2026/09/20 09:06:27 INFO Received uploads request method=POST path=/api/pending_closures5559worker2 # [ 139.686865] nix-grpc-daemon[1703]: time=2026-09-20T09:06:27.321Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5560worker2 # [ 139.689188] nix-grpc-daemon[1703]: time=2026-09-20T09:06:27.321Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5561lb # [ 139.710740] niks3-server[1051]: 2026/09/20 09:06:27 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5562worker2 # [ 139.742209] nix-grpc-daemon[1703]: time=2026-09-20T09:06:27.378Z level=INFO msg="Uploading 1 narinfos"5563lb # [ 139.725906] niks3-server[1051]: 2026/09/20 09:06:27 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5564lb # [ 139.739658] niks3-server[1051]: 2026/09/20 09:06:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5565lb # [ 139.752263] niks3-server[1051]: 2026/09/20 09:06:27 INFO Signed narinfos id=40 count=15566lb # [ 139.754476] niks3-server[1051]: 2026/09/20 09:06:27 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5567worker2 # [ 139.772888] nix-grpc-daemon[1703]: time=2026-09-20T09:06:27.410Z level=INFO msg="Upload complete. (349ms)"5568lb # [ 139.767120] niks3-server[1051]: 2026/09/20 09:06:27 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5569lb # [ 139.775149] niks3-server[1051]: 2026/09/20 09:06:27 INFO Completed upload id=405570worker2 # [ 139.787368] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15571worker2 # [ 139.807555] nix-grpc-daemon[1703]: time=2026-09-20T09:06:27.422Z level=WARN msg="Failed to register uploaded object" key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo error="server returned 404: object is not pending upload\n"5572worker2 # [ 139.813935] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:27Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05573worker2 # [ 139.817990] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:27Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15574worker2 # [ 139.821976] nix-daemon[842]: reaped child process 1796, status = succeeded5575worker2 # [ 139.847369] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340725576worker2 # [ 139.857584] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340725577worker2 # [ 139.875473] nix-grpc-daemon[1703]: time=2026-09-20T09:06:27.513Z level=INFO msg="All 1 paths already cached"5578client # copying 1 paths to 'lb:50051'...5579worker2 # [ 139.886328] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:340725580client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5581worker2 # [ 139.909647] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5582worker2 # [ 140.113580] nix-daemon[842]: accepted connection from pid 1822, user nix-grpc-daemon (trusted)5583worker2 # [ 140.132555] nix-daemon[842]: reaped child process 1825, status = succeeded5584worker2 # [ 140.304816] nix-daemon[842]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)5585worker2 # [ 140.323833] nix-daemon[842]: reaped child process 1830, status = succeeded5586lb # [ 140.327078] niks3-server[1051]: 2026/09/20 09:06:27 INFO Received uploads request method=POST path=/api/pending_closures5587worker2 # [ 140.350848] nix-grpc-daemon[1703]: time=2026-09-20T09:06:27.988Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5588worker2 # [ 140.352477] nix-grpc-daemon[1703]: time=2026-09-20T09:06:27.988Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5589worker2 # [ 140.391403] nix-grpc-daemon[1703]: time=2026-09-20T09:06:28.029Z level=INFO msg="Uploading 1 narinfos"5590lb # [ 140.376515] niks3-server[1051]: 2026/09/20 09:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5591lb # [ 140.390575] niks3-server[1051]: 2026/09/20 09:06:28 INFO Signed narinfos id=41 count=15592lb # [ 140.394888] niks3-server[1051]: 2026/09/20 09:06:28 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5593lb # [ 140.401059] niks3-server[1051]: 2026/09/20 09:06:28 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5594lb # [ 140.408927] niks3-server[1051]: 2026/09/20 09:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5595lb # [ 140.415221] niks3-server[1051]: 2026/09/20 09:06:28 INFO Completed upload id=415596worker2 # [ 140.424226] nix-grpc-daemon[1703]: time=2026-09-20T09:06:28.062Z level=INFO msg="Upload complete. (497ms)"5597lb # [ 140.417865] niks3-server[1051]: 2026/09/20 09:06:28 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5598worker2 # [ 140.433608] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=0 paths=1 nar_bytes_in=6405599worker2 # [ 140.444854] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340725600worker2 # [ 140.458315] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5601worker2 # [ 140.465031] nix-daemon[842]: reaped child process 1820, status = succeeded5602client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5603client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5604worker2 # [ 140.480767] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5605lb # [ 141.254972] envoy[912]: conn peer=[2001:db8:1::1]:60462 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=753 ms=35665606client # farm-b> LOG-farm-b-during-drain5607worker2 # [ 141.304331] nix-daemon[842]: reaped child process 1834, status = succeeded5608worker2 # [ 141.465138] nix-daemon[842]: accepted connection from pid 1849, user nix-grpc-daemon (trusted)5609worker2 # [ 141.484549] nix-daemon[842]: reaped child process 1852, status = succeeded5610lb # [ 141.489322] niks3-server[1051]: 2026/09/20 09:06:29 INFO Received uploads request method=POST path=/api/pending_closures5611worker2 # [ 141.508703] nix-grpc-daemon[1703]: time=2026-09-20T09:06:29.145Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5612worker2 # [ 141.510189] nix-grpc-daemon[1703]: time=2026-09-20T09:06:29.145Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5613lb # [ 141.519705] niks3-server[1051]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5614lb # [ 141.537047] niks3-server[1051]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5615worker2 # [ 141.555800] nix-grpc-daemon[1703]: time=2026-09-20T09:06:29.193Z level=INFO msg="Uploading 1 narinfos"5616lb # [ 141.546574] niks3-server[1051]: 2026/09/20 09:06:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5617lb # [ 141.556713] niks3-server[1051]: 2026/09/20 09:06:29 INFO Signed narinfos id=42 count=15618lb # [ 141.559230] niks3-server[1051]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5619lb # [ 141.569589] niks3-server[1051]: 2026/09/20 09:06:29 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5620lb # [ 141.576639] niks3-server[1051]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5621lb # [ 141.582401] niks3-server[1051]: 2026/09/20 09:06:29 INFO Completed upload id=425622worker2 # [ 141.591415] nix-grpc-daemon[1703]: time=2026-09-20T09:06:29.229Z level=INFO msg="Upload complete. (300ms)"5623worker2 # [ 141.609112] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15624worker2 # [ 141.623829] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:29Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05625worker2 # [ 141.627658] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:29Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15626worker2 # [ 141.631619] nix-daemon[842]: reaped child process 1832, status = succeeded5627worker2 # [ 141.653242] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340725628worker2 # [ 141.668651] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340725629worker2 # [ 141.683058] nix-grpc-daemon[1703]: time=2026-09-20T09:06:29.320Z level=INFO msg="All 2 paths already cached"5630client # copying 1 paths to 'lb:50051'...5631client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5632worker2 # [ 141.693491] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:340725633worker2 # [ 141.711654] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5634worker2 # [ 141.911785] nix-daemon[842]: accepted connection from pid 1858, user nix-grpc-daemon (trusted)5635worker2 # [ 141.931864] nix-daemon[842]: reaped child process 1861, status = succeeded5636worker2 # [ 142.105766] nix-daemon[842]: accepted connection from pid 1863, user nix-grpc-daemon (trusted)5637worker2 # [ 142.123604] nix-daemon[842]: reaped child process 1866, status = succeeded5638lb # [ 142.126325] niks3-server[1051]: 2026/09/20 09:06:29 INFO Received uploads request method=POST path=/api/pending_closures5639worker2 # [ 142.144246] nix-grpc-daemon[1703]: time=2026-09-20T09:06:29.782Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5640worker2 # [ 142.146163] nix-grpc-daemon[1703]: time=2026-09-20T09:06:29.783Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5641lb # [ 142.155338] niks3-server[1051]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5642worker2 # [ 142.177032] nix-grpc-daemon[1703]: time=2026-09-20T09:06:29.814Z level=INFO msg="Uploading 1 narinfos"5643lb # [ 142.172382] niks3-server[1051]: 2026/09/20 09:06:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5644lb # [ 142.183320] niks3-server[1051]: 2026/09/20 09:06:29 INFO Signed narinfos id=43 count=15645lb # [ 142.188568] niks3-server[1051]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5646worker2 # [ 142.206036] nix-grpc-daemon[1703]: time=2026-09-20T09:06:29.843Z level=INFO msg="Upload complete. (477ms)"5647lb # [ 142.197665] niks3-server[1051]: 2026/09/20 09:06:29 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5648lb # [ 142.202496] niks3-server[1051]: 2026/09/20 09:06:29 INFO Completed upload id=435649lb # [ 142.206373] niks3-server[1051]: 2026/09/20 09:06:29 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5650worker2 # [ 142.215709] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=0 paths=1 nar_bytes_in=7685651worker2 # [ 142.226335] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340725652worker2 # [ 142.232475] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5653worker2 # [ 142.237086] nix-daemon[842]: reaped child process 1856, status = succeeded5654client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5655client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5656worker2 # [ 142.249612] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)5657worker2 # [ 143.071246] nix-daemon[842]: reaped child process 1870, status = succeeded5658client # farm-top> LOG-farm-top-during-drain5659worker2 # [ 143.235077] nix-daemon[842]: accepted connection from pid 1885, user nix-grpc-daemon (trusted)5660worker2 # [ 143.252830] nix-daemon[842]: reaped child process 1888, status = succeeded5661lb # [ 143.259513] niks3-server[1051]: 2026/09/20 09:06:30 INFO Received uploads request method=POST path=/api/pending_closures5662worker2 # [ 143.280077] nix-grpc-daemon[1703]: time=2026-09-20T09:06:30.916Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5663worker2 # [ 143.281618] nix-grpc-daemon[1703]: time=2026-09-20T09:06:30.916Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5664lb # [ 143.302281] niks3-server[1051]: 2026/09/20 09:06:30 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5665worker2 # [ 143.323946] nix-grpc-daemon[1703]: time=2026-09-20T09:06:30.961Z level=INFO msg="Uploading 1 narinfos"5666lb # [ 143.314730] niks3-server[1051]: 2026/09/20 09:06:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5667lb # [ 143.325774] niks3-server[1051]: 2026/09/20 09:06:30 INFO Signed narinfos id=44 count=15668lb # [ 143.331617] niks3-server[1051]: 2026/09/20 09:06:30 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5669lb # [ 143.337602] niks3-server[1051]: 2026/09/20 09:06:30 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5670lb # [ 143.346974] niks3-server[1051]: 2026/09/20 09:06:30 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5671lb # [ 143.352031] niks3-server[1051]: 2026/09/20 09:06:30 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5672lb # [ 143.356490] niks3-server[1051]: 2026/09/20 09:06:30 INFO Completed upload id=445673worker2 # [ 143.365487] nix-grpc-daemon[1703]: time=2026-09-20T09:06:31.003Z level=INFO msg="Upload complete. (307ms)"5674worker2 # [ 143.377361] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15675worker2 # [ 143.395767] nix-daemon[842]: reaped child process 1868, status = succeeded5676client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.37 seconds)5677client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5678client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5679worker1: must succeed: pkill -f 'read -t [9]0 x'5680worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5681client: waiting for success: ! systemctl is-active sw5682worker1 # [ 143.775298] nix-daemon[861]: reaped child process 1384, status = succeeded5683worker1 # [ 143.947110] nix-daemon[861]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)5684worker1 # [ 143.968214] nix-daemon[861]: reaped child process 1432, status = succeeded5685lb # [ 144.005988] niks3-server[1051]: 2026/09/20 09:06:31 INFO Received uploads request method=POST path=/api/pending_closures5686worker1 # [ 143.989905] nix-grpc-daemon[1324]: time=2026-09-20T09:06:31.634Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5687worker1 # [ 143.991462] nix-grpc-daemon[1324]: time=2026-09-20T09:06:31.634Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5688lb # [ 144.038164] niks3-server[1051]: 2026/09/20 09:06:31 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5689lb # [ 144.052273] niks3-server[1051]: 2026/09/20 09:06:31 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5690lb # [ 144.063692] niks3-server[1051]: 2026/09/20 09:06:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5691lb # [ 144.070247] niks3-server[1051]: 2026/09/20 09:06:31 INFO Signed narinfos id=45 count=15692worker1 # [ 144.044136] nix-grpc-daemon[1324]: time=2026-09-20T09:06:31.688Z level=INFO msg="Uploading 1 narinfos"5693lb # [ 144.076500] niks3-server[1051]: 2026/09/20 09:06:31 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5694lb # [ 144.087754] niks3-server[1051]: 2026/09/20 09:06:31 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5695lb # [ 144.094283] niks3-server[1051]: 2026/09/20 09:06:31 INFO Completed upload id=455696lb # [ 144.097900] niks3-server[1051]: 2026/09/20 09:06:31 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5697worker1 # [ 144.067932] nix-grpc-daemon[1324]: time=2026-09-20T09:06:31.713Z level=INFO msg="Upload complete. (308ms)"5698worker1 # [ 144.080839] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40530 duration_s=10 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15699worker1 # [ 144.095598] nix-daemon[861]: reaped child process 1382, status = succeeded5700client # [ 144.123035] systemd[1]: sw.service: Deactivated successfully.5701client # [ 144.127549] systemd[1]: sw.service: Consumed 155ms CPU time over 11.103s wall clock time, 39.2M memory peak, 8.3K incoming IP traffic, 8.7K outgoing IP traffic.5702worker1 # [ 144.349039] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:31Z level=info event=signal_exit5703client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds)5704client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5705client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5706worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5707worker2 # [ 145.624594] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:340625708worker1 # [ 145.596981] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:33Z level=info event=scheduler_restarting5709worker1 # [ 145.614678] nix-grpc-daemon[1171]: ts=2026-09-20T09:06:33Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5710worker1 # [ 145.639894] nix-daemon[861]: reaped child process 1276, status = succeeded5711worker1 # [ 145.853067] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5712worker1 # [ 145.860602] systemd[1]: nix-grpc-daemon.service: Consumed 927ms CPU time over 42.740s wall clock time, 33.5M memory peak, 22.9K incoming IP traffic, 31.7K outgoing IP traffic.5713worker1 # [ 145.882985] systemd[1]: Starting Nix worker-protocol over gRPC...5714worker1 # [ 146.089208] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5715worker1 # [ 146.091888] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15716worker1 # [ 146.100121] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5717worker1 # [ 146.101937] systemd[1]: Started Nix worker-protocol over gRPC.5718worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.26 seconds)5719lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5720lb: must succeed: curl -sf localhost:9901/clusters5721worker1 # [ 146.145014] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:33Z level=info event=scheduler_connected addr=lb:500515722worker2 # [ 145.630062] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:33Z level=info event=worker_gone addr=192.168.1.3:500515723worker2 # [ 146.183590] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:33Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05724lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5725lb: must succeed: curl -sf localhost:9901/clusters5726lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5727lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds)5728lb: must succeed: curl -sf localhost:9901/clusters5729lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5730worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5731worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5732(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.50 seconds)5733subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5734client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15735worker1 # [ 147.707254] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592305736worker1 # [ 147.723332] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5737worker1 # [ 147.746983] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592305738worker1 # [ 147.763009] nix-grpc-daemon[1446]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 1/5)5739worker1 # [ 147.816918] nix-grpc-daemon[1446]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 2/5)5740worker1 # [ 147.874444] nix-grpc-daemon[1446]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 299 ms (attempt 3/5)5741worker1 # [ 148.181283] nix-grpc-daemon[1446]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 347 ms (attempt 4/5)5742worker1 # [ 148.529255] nix-grpc-daemon[1446]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5743worker2 # [ 148.618917] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:36Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05744worker2 # [ 148.624908] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:36Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15745worker2 # [ 148.630736] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:36Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05746worker2 # [ 148.636136] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:36Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05747worker1 # [ 148.630318] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592305748worker1 # [ 148.646643] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592305749worker1 # [ 148.661706] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592305750worker1 # [ 148.676881] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5751worker1 # [ 148.713794] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:36Z level=info event=niks3_push_started pid=15025752worker1 # [ 149.106862] nix-daemon[861]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5753worker1 # [ 149.125086] nix-daemon[861]: reaped child process 1518, status = succeeded5754worker1 # [ 149.303339] nix-daemon[861]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5755worker1 # [ 149.319973] nix-daemon[861]: reaped child process 1523, status = succeeded5756lb # [ 149.361754] niks3-server[1051]: 2026/09/20 09:06:36 INFO Received uploads request method=POST path=/api/pending_closures5757worker1 # [ 149.346522] nix-grpc-daemon[1502]: time=2026-09-20T09:06:36.990Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5758worker1 # [ 149.348217] nix-grpc-daemon[1502]: time=2026-09-20T09:06:36.990Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5759lb # [ 149.396405] niks3-server[1051]: 2026/09/20 09:06:37 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5760lb # [ 149.409419] niks3-server[1051]: 2026/09/20 09:06:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5761worker1 # [ 149.389679] nix-grpc-daemon[1502]: time=2026-09-20T09:06:37.034Z level=INFO msg="Uploading 1 narinfos"5762lb # [ 149.421786] niks3-server[1051]: 2026/09/20 09:06:37 INFO Signed narinfos id=46 count=15763lb # [ 149.429006] niks3-server[1051]: 2026/09/20 09:06:37 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5764lb # [ 149.439259] niks3-server[1051]: 2026/09/20 09:06:37 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5765lb # [ 149.446988] niks3-server[1051]: 2026/09/20 09:06:37 INFO Completed upload id=465766worker1 # [ 149.420686] nix-grpc-daemon[1502]: time=2026-09-20T09:06:37.066Z level=INFO msg="Upload complete. (489ms)"5767lb # [ 149.449899] niks3-server[1051]: 2026/09/20 09:06:37 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5768worker1 # [ 149.428149] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=0 paths=1 nar_bytes_in=5125769worker1 # [ 149.442251] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592305770worker1 # [ 149.448838] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5771worker1 # [ 149.453818] nix-daemon[861]: reaped child process 1500, status = succeeded5772worker1 # [ 149.468899] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5773worker1 # [ 150.519511] nix-daemon[861]: reaped child process 1527, status = succeeded5774worker1 # [ 150.712261] nix-daemon[861]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)5775worker1 # [ 150.730702] nix-daemon[861]: reaped child process 1545, status = succeeded5776lb # [ 150.770799] niks3-server[1051]: 2026/09/20 09:06:38 INFO Received uploads request method=POST path=/api/pending_closures5777worker1 # [ 150.756439] nix-grpc-daemon[1502]: time=2026-09-20T09:06:38.401Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5778worker1 # [ 150.757951] nix-grpc-daemon[1502]: time=2026-09-20T09:06:38.401Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5779lb # [ 150.816611] niks3-server[1051]: 2026/09/20 09:06:38 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5780lb # [ 150.826619] niks3-server[1051]: 2026/09/20 09:06:38 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5781worker1 # [ 150.812145] nix-grpc-daemon[1502]: time=2026-09-20T09:06:38.456Z level=INFO msg="Uploading 1 narinfos"5782lb # [ 150.838330] niks3-server[1051]: 2026/09/20 09:06:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5783lb # [ 150.846157] niks3-server[1051]: 2026/09/20 09:06:38 INFO Signed narinfos id=47 count=15784lb # [ 150.852338] niks3-server[1051]: 2026/09/20 09:06:38 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5785lb # [ 150.862354] niks3-server[1051]: 2026/09/20 09:06:38 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5786lb # [ 150.867496] niks3-server[1051]: 2026/09/20 09:06:38 INFO Completed upload id=475787worker1 # [ 150.841284] nix-grpc-daemon[1502]: time=2026-09-20T09:06:38.486Z level=INFO msg="Upload complete. (359ms)"5788lb # [ 150.870318] niks3-server[1051]: 2026/09/20 09:06:38 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5789worker2 # [ 150.890707] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:38Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15790worker1 # [ 150.857147] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15791worker2 # [ 150.898544] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:38Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05792worker1 # [ 150.871645] nix-daemon[861]: reaped child process 1525, status = succeeded5793worker1 # [ 150.899178] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592305794worker1 # [ 150.913262] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592305795worker1 # [ 150.924603] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592305796worker1 # [ 150.939604] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5797worker1 # [ 151.149061] nix-daemon[861]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5798worker1 # [ 151.169050] nix-daemon[861]: reaped child process 1552, status = succeeded5799lb # [ 151.254768] envoy[912]: conn peer=[2001:db8:1::1]:50670 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9621 tx=3856 ms=60885800lb # [ 151.260686] envoy[912]: conn peer=[2001:db8:1::1]:50668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2922 tx=1333 ms=108415801lb # [ 151.267360] envoy[912]: conn peer=[2001:db8:1::3]:40418 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1987 tx=810 ms=422325802worker1 # [ 151.348217] nix-daemon[861]: accepted connection from pid 1554, user nix-grpc-daemon (trusted)5803worker1 # [ 151.368613] nix-daemon[861]: reaped child process 1557, status = succeeded5804lb # [ 151.405871] niks3-server[1051]: 2026/09/20 09:06:39 INFO Received uploads request method=POST path=/api/pending_closures5805worker1 # [ 151.389901] nix-grpc-daemon[1502]: time=2026-09-20T09:06:39.034Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5806worker1 # [ 151.391437] nix-grpc-daemon[1502]: time=2026-09-20T09:06:39.034Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5807lb # [ 151.436389] niks3-server[1051]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5808worker1 # [ 151.423918] nix-grpc-daemon[1502]: time=2026-09-20T09:06:39.069Z level=INFO msg="Uploading 1 narinfos"5809lb # [ 151.450900] niks3-server[1051]: 2026/09/20 09:06:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5810lb # [ 151.458772] niks3-server[1051]: 2026/09/20 09:06:39 INFO Signed narinfos id=48 count=15811lb # [ 151.464940] niks3-server[1051]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5812lb # [ 151.473833] niks3-server[1051]: 2026/09/20 09:06:39 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5813lb # [ 151.480388] niks3-server[1051]: 2026/09/20 09:06:39 INFO Completed upload id=485814worker1 # [ 151.453789] nix-grpc-daemon[1502]: time=2026-09-20T09:06:39.099Z level=INFO msg="Upload complete. (498ms)"5815lb # [ 151.482889] niks3-server[1051]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5816worker1 # [ 151.461014] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=0 paths=1 nar_bytes_in=5125817worker1 # [ 151.476229] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592305818worker1 # [ 151.483023] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5819worker1 # [ 151.487920] nix-daemon[861]: reaped child process 1547, status = succeeded5820worker1 # [ 151.499968] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5821worker1 # [ 152.934358] nix-daemon[861]: reaped child process 1561, status = succeeded5822worker1 # [ 153.111161] nix-daemon[861]: accepted connection from pid 1576, user nix-grpc-daemon (trusted)5823worker1 # [ 153.132931] nix-daemon[861]: reaped child process 1579, status = succeeded5824lb # [ 153.171703] niks3-server[1051]: 2026/09/20 09:06:40 INFO Received uploads request method=POST path=/api/pending_closures5825worker1 # [ 153.155986] nix-grpc-daemon[1502]: time=2026-09-20T09:06:40.800Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5826worker1 # [ 153.157833] nix-grpc-daemon[1502]: time=2026-09-20T09:06:40.800Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5827lb # [ 153.205880] niks3-server[1051]: 2026/09/20 09:06:40 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5828lb # [ 153.218118] niks3-server[1051]: 2026/09/20 09:06:40 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5829lb # [ 153.231839] niks3-server[1051]: 2026/09/20 09:06:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5830worker1 # [ 153.211863] nix-grpc-daemon[1502]: time=2026-09-20T09:06:40.856Z level=INFO msg="Uploading 1 narinfos"5831lb # [ 153.241770] niks3-server[1051]: 2026/09/20 09:06:40 INFO Signed narinfos id=49 count=15832lb # [ 153.247760] niks3-server[1051]: 2026/09/20 09:06:40 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5833lb # [ 153.256665] niks3-server[1051]: 2026/09/20 09:06:40 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5834lb # [ 153.263345] niks3-server[1051]: 2026/09/20 09:06:40 INFO Completed upload id=495835worker1 # [ 153.235622] nix-grpc-daemon[1502]: time=2026-09-20T09:06:40.880Z level=INFO msg="Upload complete. (321ms)"5836lb # [ 153.266444] niks3-server[1051]: 2026/09/20 09:06:40 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5837worker1 # [ 153.248749] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15838worker2 # [ 153.286368] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:40Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15839worker2 # [ 153.294189] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:40Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05840worker1 # [ 153.272119] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592305841worker1 # [ 153.278687] nix-daemon[861]: reaped child process 1559, status = succeeded5842worker1 # [ 153.287234] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592305843worker1 # [ 153.301162] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592305844worker1 # [ 153.314347] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5845worker1 # [ 153.522041] nix-daemon[861]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)5846worker1 # [ 153.541418] nix-daemon[861]: reaped child process 1586, status = succeeded5847worker1 # [ 153.721563] nix-daemon[861]: accepted connection from pid 1588, user nix-grpc-daemon (trusted)5848worker1 # [ 153.740895] nix-daemon[861]: reaped child process 1591, status = succeeded5849lb # [ 153.778472] niks3-server[1051]: 2026/09/20 09:06:41 INFO Received uploads request method=POST path=/api/pending_closures5850worker1 # [ 153.761254] nix-grpc-daemon[1502]: time=2026-09-20T09:06:41.406Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5851worker1 # [ 153.762815] nix-grpc-daemon[1502]: time=2026-09-20T09:06:41.406Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5852lb # [ 153.806693] niks3-server[1051]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5853worker1 # [ 153.793990] nix-grpc-daemon[1502]: time=2026-09-20T09:06:41.439Z level=INFO msg="Uploading 1 narinfos"5854lb # [ 153.824262] niks3-server[1051]: 2026/09/20 09:06:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5855lb # [ 153.835097] niks3-server[1051]: 2026/09/20 09:06:41 INFO Signed narinfos id=50 count=15856lb # [ 153.840886] niks3-server[1051]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5857lb # [ 153.849240] niks3-server[1051]: 2026/09/20 09:06:41 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5858lb # [ 153.853915] niks3-server[1051]: 2026/09/20 09:06:41 INFO Completed upload id=505859worker1 # [ 153.826694] nix-grpc-daemon[1502]: time=2026-09-20T09:06:41.472Z level=INFO msg="Upload complete. (497ms)"5860lb # [ 153.856621] niks3-server[1051]: 2026/09/20 09:06:41 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5861worker1 # [ 153.837025] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=0 paths=1 nar_bytes_in=5125862worker1 # [ 153.844283] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592305863worker1 # [ 153.856361] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5864worker1 # [ 153.858874] nix-daemon[861]: reaped child process 1581, status = succeeded5865worker1 # [ 153.871939] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5866worker1 # [ 155.317906] nix-daemon[861]: reaped child process 1595, status = succeeded5867worker1 # [ 155.502966] nix-daemon[861]: accepted connection from pid 1610, user nix-grpc-daemon (trusted)5868worker1 # [ 155.523309] nix-daemon[861]: reaped child process 1613, status = succeeded5869lb # [ 155.562912] niks3-server[1051]: 2026/09/20 09:06:43 INFO Received uploads request method=POST path=/api/pending_closures5870worker1 # [ 155.545826] nix-grpc-daemon[1502]: time=2026-09-20T09:06:43.190Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5871worker1 # [ 155.549103] nix-grpc-daemon[1502]: time=2026-09-20T09:06:43.192Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5872lb # [ 155.609042] niks3-server[1051]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5873worker1 # [ 155.593140] nix-grpc-daemon[1502]: time=2026-09-20T09:06:43.238Z level=INFO msg="Uploading 1 narinfos"5874lb # [ 155.617487] niks3-server[1051]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5875lb # [ 155.631074] niks3-server[1051]: 2026/09/20 09:06:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5876lb # [ 155.635434] niks3-server[1051]: 2026/09/20 09:06:43 INFO Signed narinfos id=51 count=15877lb # [ 155.641805] niks3-server[1051]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5878lb # [ 155.645201] niks3-server[1051]: 2026/09/20 09:06:43 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5879worker1 # [ 155.615269] nix-grpc-daemon[1502]: time=2026-09-20T09:06:43.260Z level=INFO msg="Upload complete. (332ms)"5880lb # [ 155.649312] niks3-server[1051]: 2026/09/20 09:06:43 INFO Completed upload id=515881lb # [ 155.651795] niks3-server[1051]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5882worker1 # [ 155.625271] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15883worker2 # [ 155.664502] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:43Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15884worker1 # [ 155.644276] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592305885worker1 # [ 155.650820] nix-daemon[861]: reaped child process 1593, status = succeeded5886worker1 # [ 155.654937] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592305887worker1 # [ 155.662225] nix-grpc-daemon[1502]: time=2026-09-20T09:06:43.307Z level=INFO msg="All 1 paths already cached"5888worker1 # [ 155.669220] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592305889worker1 # [ 155.679946] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5890worker1 # [ 155.880246] nix-daemon[861]: accepted connection from pid 1617, user nix-grpc-daemon (trusted)5891worker1 # [ 155.897856] nix-daemon[861]: reaped child process 1620, status = succeeded5892worker1 # [ 156.075531] nix-daemon[861]: accepted connection from pid 1622, user nix-grpc-daemon (trusted)5893worker1 # [ 156.092394] nix-daemon[861]: reaped child process 1625, status = succeeded5894lb # [ 156.132616] niks3-server[1051]: 2026/09/20 09:06:43 INFO Received uploads request method=POST path=/api/pending_closures5895worker1 # [ 156.115835] nix-grpc-daemon[1502]: time=2026-09-20T09:06:43.760Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5896worker1 # [ 156.117589] nix-grpc-daemon[1502]: time=2026-09-20T09:06:43.760Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5897lb # [ 156.160698] niks3-server[1051]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5898lb # [ 156.174726] niks3-server[1051]: 2026/09/20 09:06:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5899worker1 # [ 156.155501] nix-grpc-daemon[1502]: time=2026-09-20T09:06:43.800Z level=INFO msg="Uploading 1 narinfos"5900lb # [ 156.188185] niks3-server[1051]: 2026/09/20 09:06:43 INFO Signed narinfos id=52 count=15901lb # [ 156.195012] niks3-server[1051]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5902lb # [ 156.204985] niks3-server[1051]: 2026/09/20 09:06:43 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5903lb # [ 156.209741] niks3-server[1051]: 2026/09/20 09:06:43 INFO Completed upload id=525904worker1 # [ 156.182792] nix-grpc-daemon[1502]: time=2026-09-20T09:06:43.828Z level=INFO msg="Upload complete. (489ms)"5905lb # [ 156.212484] niks3-server[1051]: 2026/09/20 09:06:43 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5906worker1 # [ 156.192288] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=0 paths=1 nar_bytes_in=6245907worker1 # [ 156.203207] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592305908worker1 # [ 156.210204] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5909worker1 # [ 156.214893] nix-daemon[861]: reaped child process 1615, status = succeeded5910worker1 # [ 156.226938] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5911worker2 # [ 155.673721] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:43Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05912worker1 # [ 157.060481] nix-daemon[861]: reaped child process 1629, status = succeeded5913worker1 # [ 157.229770] nix-daemon[861]: accepted connection from pid 1644, user nix-grpc-daemon (trusted)5914worker1 # [ 157.248491] nix-daemon[861]: reaped child process 1647, status = succeeded5915lb # [ 157.287418] niks3-server[1051]: 2026/09/20 09:06:44 INFO Received uploads request method=POST path=/api/pending_closures5916worker1 # [ 157.272423] nix-grpc-daemon[1502]: time=2026-09-20T09:06:44.916Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5917worker1 # [ 157.273944] nix-grpc-daemon[1502]: time=2026-09-20T09:06:44.916Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5918lb # [ 157.324483] niks3-server[1051]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5919lb # [ 157.338256] niks3-server[1051]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5920lb # [ 157.353642] niks3-server[1051]: 2026/09/20 09:06:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5921worker1 # [ 157.331682] nix-grpc-daemon[1502]: time=2026-09-20T09:06:44.976Z level=INFO msg="Uploading 1 narinfos"5922lb # [ 157.362925] niks3-server[1051]: 2026/09/20 09:06:44 INFO Signed narinfos id=53 count=15923lb # [ 157.369595] niks3-server[1051]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5924lb # [ 157.376178] niks3-server[1051]: 2026/09/20 09:06:45 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5925lb # [ 157.383486] niks3-server[1051]: 2026/09/20 09:06:45 INFO Completed upload id=535926worker1 # [ 157.357699] nix-grpc-daemon[1502]: time=2026-09-20T09:06:45.002Z level=INFO msg="Upload complete. (318ms)"5927lb # [ 157.387215] niks3-server[1051]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5928worker2 # [ 157.402964] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:45Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15929worker1 # [ 157.370391] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15930worker2 # [ 157.416252] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:45Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05931worker1 # [ 157.388947] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592305932worker1 # [ 157.396336] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592305933worker1 # [ 157.402926] nix-daemon[861]: reaped child process 1627, status = succeeded5934worker1 # [ 157.406114] nix-grpc-daemon[1502]: time=2026-09-20T09:06:45.050Z level=INFO msg="All 1 paths already cached"5935worker1 # [ 157.409808] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592305936worker1 # [ 157.421119] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5937worker1 # [ 157.613274] nix-daemon[861]: accepted connection from pid 1651, user nix-grpc-daemon (trusted)5938worker1 # [ 157.632575] nix-daemon[861]: reaped child process 1654, status = succeeded5939worker1 # [ 157.812495] nix-daemon[861]: accepted connection from pid 1656, user nix-grpc-daemon (trusted)5940worker1 # [ 157.829232] nix-daemon[861]: reaped child process 1659, status = succeeded5941lb # [ 157.868443] niks3-server[1051]: 2026/09/20 09:06:45 INFO Received uploads request method=POST path=/api/pending_closures5942worker1 # [ 157.858764] nix-grpc-daemon[1502]: time=2026-09-20T09:06:45.503Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5943worker1 # [ 157.860331] nix-grpc-daemon[1502]: time=2026-09-20T09:06:45.503Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5944lb # [ 157.908312] niks3-server[1051]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5945worker1 # [ 157.894964] nix-grpc-daemon[1502]: time=2026-09-20T09:06:45.540Z level=INFO msg="Uploading 1 narinfos"5946lb # [ 157.925913] niks3-server[1051]: 2026/09/20 09:06:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5947lb # [ 157.935318] niks3-server[1051]: 2026/09/20 09:06:45 INFO Signed narinfos id=54 count=15948lb # [ 157.945676] niks3-server[1051]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5949lb # [ 157.949058] niks3-server[1051]: 2026/09/20 09:06:45 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5950lb # [ 157.954172] niks3-server[1051]: 2026/09/20 09:06:45 INFO Completed upload id=545951worker1 # [ 157.927853] nix-grpc-daemon[1502]: time=2026-09-20T09:06:45.573Z level=INFO msg="Upload complete. (495ms)"5952lb # [ 157.956813] niks3-server[1051]: 2026/09/20 09:06:45 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5953worker1 # [ 157.937171] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=0 paths=1 nar_bytes_in=6245954worker1 # [ 157.949895] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592305955worker1 # [ 157.956811] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5956worker1 # [ 157.961945] nix-daemon[861]: reaped child process 1649, status = succeeded5957worker1 # [ 157.977479] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5958worker1 # [ 159.026543] nix-daemon[861]: reaped child process 1663, status = succeeded5959worker1 # [ 159.212244] nix-daemon[861]: accepted connection from pid 1678, user nix-grpc-daemon (trusted)5960worker1 # [ 159.229320] nix-daemon[861]: reaped child process 1681, status = succeeded5961lb # [ 159.270087] niks3-server[1051]: 2026/09/20 09:06:46 INFO Received uploads request method=POST path=/api/pending_closures5962worker1 # [ 159.255180] nix-grpc-daemon[1502]: time=2026-09-20T09:06:46.898Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5963worker1 # [ 159.257404] nix-grpc-daemon[1502]: time=2026-09-20T09:06:46.898Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5964lb # [ 159.308424] niks3-server[1051]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5965worker1 # [ 159.293188] nix-grpc-daemon[1502]: time=2026-09-20T09:06:46.937Z level=INFO msg="Uploading 1 narinfos"5966lb # [ 159.322552] niks3-server[1051]: 2026/09/20 09:06:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5967lb # [ 159.334690] niks3-server[1051]: 2026/09/20 09:06:46 INFO Signed narinfos id=55 count=15968lb # [ 159.340829] niks3-server[1051]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5969worker1 # [ 159.322522] nix-grpc-daemon[1502]: time=2026-09-20T09:06:46.967Z level=INFO msg="Upload complete. (331ms)"5970lb # [ 159.350292] niks3-server[1051]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5971lb # [ 159.356477] niks3-server[1051]: 2026/09/20 09:06:46 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5972lb # [ 159.361532] niks3-server[1051]: 2026/09/20 09:06:46 INFO Completed upload id=555973worker2 # [ 159.366814] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:47Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15974lb # [ 159.365038] niks3-server[1051]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5975worker1 # [ 159.336821] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15976worker2 # [ 159.381594] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:47Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05977worker1 # [ 159.356411] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592305978worker1 # [ 159.363379] nix-daemon[861]: reaped child process 1661, status = succeeded5979worker1 # [ 159.367930] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592305980worker1 # [ 159.376461] nix-grpc-daemon[1502]: time=2026-09-20T09:06:47.021Z level=INFO msg="All 1 paths already cached"5981worker1 # [ 159.383816] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592305982worker1 # [ 159.396421] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5983worker1 # [ 159.591304] nix-daemon[861]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)5984worker1 # [ 159.609469] nix-daemon[861]: reaped child process 1688, status = succeeded5985worker1 # [ 159.788111] nix-daemon[861]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)5986worker1 # [ 159.804851] nix-daemon[861]: reaped child process 1693, status = succeeded5987lb # [ 159.845984] niks3-server[1051]: 2026/09/20 09:06:47 INFO Received uploads request method=POST path=/api/pending_closures5988worker1 # [ 159.833828] nix-grpc-daemon[1502]: time=2026-09-20T09:06:47.478Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5989worker1 # [ 159.835365] nix-grpc-daemon[1502]: time=2026-09-20T09:06:47.478Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5990lb # [ 159.882966] niks3-server[1051]: 2026/09/20 09:06:47 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5991worker1 # [ 159.867629] nix-grpc-daemon[1502]: time=2026-09-20T09:06:47.512Z level=INFO msg="Uploading 1 narinfos"5992lb # [ 159.897741] niks3-server[1051]: 2026/09/20 09:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5993lb # [ 159.905617] niks3-server[1051]: 2026/09/20 09:06:47 INFO Signed narinfos id=56 count=15994lb # [ 159.907813] niks3-server[1051]: 2026/09/20 09:06:47 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5995lb # [ 159.913772] niks3-server[1051]: 2026/09/20 09:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5996lb # [ 159.919951] niks3-server[1051]: 2026/09/20 09:06:47 INFO Completed upload id=565997worker1 # [ 159.892943] nix-grpc-daemon[1502]: time=2026-09-20T09:06:47.538Z level=INFO msg="Upload complete. (481ms)"5998lb # [ 159.922420] niks3-server[1051]: 2026/09/20 09:06:47 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5999worker1 # [ 159.900210] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=0 paths=1 nar_bytes_in=6246000worker1 # [ 159.916123] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592306001worker1 # [ 159.924436] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)6002worker1 # [ 159.929957] nix-daemon[861]: reaped child process 1683, status = succeeded6003worker1 # [ 159.941689] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)6004worker1 # [ 160.784467] nix-daemon[861]: reaped child process 1697, status = succeeded6005worker1 # [ 160.957082] nix-daemon[861]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)6006worker1 # [ 160.975761] nix-daemon[861]: reaped child process 1715, status = succeeded6007lb # [ 161.014596] niks3-server[1051]: 2026/09/20 09:06:48 INFO Received uploads request method=POST path=/api/pending_closures6008worker1 # [ 161.000218] nix-grpc-daemon[1502]: time=2026-09-20T09:06:48.643Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6009worker1 # [ 161.002374] nix-grpc-daemon[1502]: time=2026-09-20T09:06:48.643Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6010lb # [ 161.051183] niks3-server[1051]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6011lb # [ 161.062412] niks3-server[1051]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6012lb # [ 161.073477] niks3-server[1051]: 2026/09/20 09:06:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6013worker1 # [ 161.052681] nix-grpc-daemon[1502]: time=2026-09-20T09:06:48.697Z level=INFO msg="Uploading 1 narinfos"6014lb # [ 161.081490] niks3-server[1051]: 2026/09/20 09:06:48 INFO Signed narinfos id=57 count=16015lb # [ 161.083990] niks3-server[1051]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6016lb # [ 161.096882] niks3-server[1051]: 2026/09/20 09:06:48 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6017lb # [ 161.104635] niks3-server[1051]: 2026/09/20 09:06:48 INFO Completed upload id=576018worker1 # [ 161.077529] nix-grpc-daemon[1502]: time=2026-09-20T09:06:48.722Z level=INFO msg="Upload complete. (323ms)"6019lb # [ 161.107855] niks3-server[1051]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6020worker1 # [ 161.090041] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16021worker2 # [ 161.128084] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:48Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16022worker2 # [ 161.135605] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:48Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06023worker1 # [ 161.113037] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592306024worker1 # [ 161.120498] nix-daemon[861]: reaped child process 1695, status = succeeded6025worker1 # [ 161.124878] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592306026worker1 # [ 161.133637] nix-grpc-daemon[1502]: time=2026-09-20T09:06:48.778Z level=INFO msg="All 2 paths already cached"6027worker1 # [ 161.141261] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592306028worker1 # [ 161.154140] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)6029worker1 # [ 161.355914] nix-daemon[861]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)6030worker1 # [ 161.377021] nix-daemon[861]: reaped child process 1722, status = succeeded6031worker1 # [ 161.554769] nix-daemon[861]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6032worker1 # [ 161.572198] nix-daemon[861]: reaped child process 1727, status = succeeded6033lb # [ 161.609760] niks3-server[1051]: 2026/09/20 09:06:49 INFO Received uploads request method=POST path=/api/pending_closures6034worker1 # [ 161.592789] nix-grpc-daemon[1502]: time=2026-09-20T09:06:49.237Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6035worker1 # [ 161.594299] nix-grpc-daemon[1502]: time=2026-09-20T09:06:49.237Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6036lb # [ 161.639046] niks3-server[1051]: 2026/09/20 09:06:49 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6037worker1 # [ 161.626943] nix-grpc-daemon[1502]: time=2026-09-20T09:06:49.272Z level=INFO msg="Uploading 1 narinfos"6038lb # [ 161.654726] niks3-server[1051]: 2026/09/20 09:06:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6039lb # [ 161.666226] niks3-server[1051]: 2026/09/20 09:06:49 INFO Signed narinfos id=58 count=16040lb # [ 161.672353] niks3-server[1051]: 2026/09/20 09:06:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6041lb # [ 161.678882] niks3-server[1051]: 2026/09/20 09:06:49 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6042lb # [ 161.685802] niks3-server[1051]: 2026/09/20 09:06:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6043lb # [ 161.689815] niks3-server[1051]: 2026/09/20 09:06:49 INFO Completed upload id=586044worker1 # [ 161.663523] nix-grpc-daemon[1502]: time=2026-09-20T09:06:49.308Z level=INFO msg="Upload complete. (494ms)"6045worker1 # [ 161.671566] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=0 paths=1 nar_bytes_in=7526046worker1 # [ 161.686427] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592306047worker1 # [ 161.692826] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)6048worker1 # [ 161.697921] nix-daemon[861]: reaped child process 1717, status = succeeded6049worker1 # [ 161.714583] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)6050worker1 # [ 162.535916] nix-daemon[861]: reaped child process 1731, status = succeeded6051worker1 # [ 162.694541] nix-daemon[861]: accepted connection from pid 1746, user nix-grpc-daemon (trusted)6052worker1 # [ 162.713958] nix-daemon[861]: reaped child process 1749, status = succeeded6053lb # [ 162.754471] niks3-server[1051]: 2026/09/20 09:06:50 INFO Received uploads request method=POST path=/api/pending_closures6054worker1 # [ 162.738633] nix-grpc-daemon[1502]: time=2026-09-20T09:06:50.382Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6055worker1 # [ 162.743179] nix-grpc-daemon[1502]: time=2026-09-20T09:06:50.382Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6056lb # [ 162.793765] niks3-server[1051]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6057lb # [ 162.805145] niks3-server[1051]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6058worker1 # [ 162.790293] nix-grpc-daemon[1502]: time=2026-09-20T09:06:50.435Z level=INFO msg="Uploading 1 narinfos"6059lb # [ 162.819694] niks3-server[1051]: 2026/09/20 09:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6060lb # [ 162.826899] niks3-server[1051]: 2026/09/20 09:06:50 INFO Signed narinfos id=59 count=16061lb # [ 162.831166] niks3-server[1051]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6062worker1 # [ 162.810169] nix-grpc-daemon[1502]: time=2026-09-20T09:06:50.455Z level=INFO msg="Upload complete. (285ms)"6063lb # [ 162.838243] niks3-server[1051]: 2026/09/20 09:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6064lb # [ 162.842061] niks3-server[1051]: 2026/09/20 09:06:50 INFO Completed upload id=596065lb # [ 162.844921] niks3-server[1051]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6066worker2 # [ 162.853203] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:50Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16067worker1 # [ 162.819640] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16068worker1 # [ 162.834944] nix-daemon[861]: reaped child process 1729, status = succeeded6069worker1 # [ 162.862752] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592306070worker1 # [ 162.879457] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592306071worker1 # [ 162.894938] nix-grpc-daemon[1502]: time=2026-09-20T09:06:50.540Z level=INFO msg="All 2 paths already cached"6072worker1 # [ 162.904403] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592306073worker1 # [ 162.919082] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)6074worker1 # [ 163.125123] nix-daemon[861]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)6075worker1 # [ 163.144691] nix-daemon[861]: reaped child process 1756, status = succeeded6076worker1 # [ 163.323114] nix-daemon[861]: accepted connection from pid 1758, user nix-grpc-daemon (trusted)6077worker1 # [ 163.339246] nix-daemon[861]: reaped child process 1761, status = succeeded6078lb # [ 163.381052] niks3-server[1051]: 2026/09/20 09:06:51 INFO Received uploads request method=POST path=/api/pending_closures6079worker1 # [ 163.363553] nix-grpc-daemon[1502]: time=2026-09-20T09:06:51.008Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6080worker1 # [ 163.365181] nix-grpc-daemon[1502]: time=2026-09-20T09:06:51.008Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6081lb # [ 163.407937] niks3-server[1051]: 2026/09/20 09:06:51 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6082lb # [ 163.422361] niks3-server[1051]: 2026/09/20 09:06:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6083worker1 # [ 163.402111] nix-grpc-daemon[1502]: time=2026-09-20T09:06:51.047Z level=INFO msg="Uploading 1 narinfos"6084lb # [ 163.434815] niks3-server[1051]: 2026/09/20 09:06:51 INFO Signed narinfos id=60 count=16085lb # [ 163.441459] niks3-server[1051]: 2026/09/20 09:06:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6086worker1 # [ 163.423319] nix-grpc-daemon[1502]: time=2026-09-20T09:06:51.068Z level=INFO msg="Upload complete. (485ms)"6087lb # [ 163.450375] niks3-server[1051]: 2026/09/20 09:06:51 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6088lb # [ 163.455810] niks3-server[1051]: 2026/09/20 09:06:51 INFO Completed upload id=606089lb # [ 163.459441] niks3-server[1051]: 2026/09/20 09:06:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6090worker1 # [ 163.432229] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=0 paths=1 nar_bytes_in=7526091worker1 # [ 163.442046] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592306092worker1 # [ 163.448976] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)6093worker1 # [ 163.453543] nix-daemon[861]: reaped child process 1751, status = succeeded6094worker1 # [ 163.467209] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)6095worker1 # [ 164.689008] nix-daemon[861]: reaped child process 1765, status = succeeded6096worker1 # [ 164.852257] nix-daemon[861]: accepted connection from pid 1780, user nix-grpc-daemon (trusted)6097worker1 # [ 164.871872] nix-daemon[861]: reaped child process 1783, status = succeeded6098lb # [ 164.910899] niks3-server[1051]: 2026/09/20 09:06:52 INFO Received uploads request method=POST path=/api/pending_closures6099worker1 # [ 164.895295] nix-grpc-daemon[1502]: time=2026-09-20T09:06:52.539Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6100worker1 # [ 164.896881] nix-grpc-daemon[1502]: time=2026-09-20T09:06:52.539Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6101lb # [ 164.944554] niks3-server[1051]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6102lb # [ 164.961854] niks3-server[1051]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6103worker1 # [ 164.950346] nix-grpc-daemon[1502]: time=2026-09-20T09:06:52.595Z level=INFO msg="Uploading 1 narinfos"6104lb # [ 164.971162] niks3-server[1051]: 2026/09/20 09:06:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6105lb # [ 164.981920] niks3-server[1051]: 2026/09/20 09:06:52 INFO Signed narinfos id=61 count=16106lb # [ 164.987735] niks3-server[1051]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6107lb # [ 164.995666] niks3-server[1051]: 2026/09/20 09:06:52 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6108lb # [ 165.003352] niks3-server[1051]: 2026/09/20 09:06:52 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6109lb # [ 165.007987] niks3-server[1051]: 2026/09/20 09:06:52 INFO Completed upload id=616110worker1 # [ 164.981387] nix-grpc-daemon[1502]: time=2026-09-20T09:06:52.626Z level=INFO msg="Upload complete. (303ms)"6111worker2 # [ 165.024860] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:52Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16112worker1 # [ 164.993133] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16113worker1 # [ 165.009971] nix-daemon[861]: reaped child process 1763, status = succeeded6114worker1 # [ 165.034246] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592306115worker1 # [ 165.049627] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592306116worker1 # [ 165.063726] nix-grpc-daemon[1502]: time=2026-09-20T09:06:52.709Z level=INFO msg="All 2 paths already cached"6117worker1 # [ 165.073174] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592306118worker1 # [ 165.088108] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)6119worker1 # [ 165.294660] nix-daemon[861]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)6120worker1 # [ 165.312743] nix-daemon[861]: reaped child process 1790, status = succeeded6121worker1 # [ 165.487250] nix-daemon[861]: accepted connection from pid 1792, user nix-grpc-daemon (trusted)6122worker1 # [ 165.504474] nix-daemon[861]: reaped child process 1795, status = succeeded6123lb # [ 165.542403] niks3-server[1051]: 2026/09/20 09:06:53 INFO Received uploads request method=POST path=/api/pending_closures6124worker1 # [ 165.525990] nix-grpc-daemon[1502]: time=2026-09-20T09:06:53.171Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6125worker1 # [ 165.527473] nix-grpc-daemon[1502]: time=2026-09-20T09:06:53.171Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6126lb # [ 165.569665] niks3-server[1051]: 2026/09/20 09:06:53 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6127worker1 # [ 165.556426] nix-grpc-daemon[1502]: time=2026-09-20T09:06:53.201Z level=INFO msg="Uploading 1 narinfos"6128lb # [ 165.584139] niks3-server[1051]: 2026/09/20 09:06:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6129lb # [ 165.593704] niks3-server[1051]: 2026/09/20 09:06:53 INFO Signed narinfos id=62 count=16130lb # [ 165.602111] niks3-server[1051]: 2026/09/20 09:06:53 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6131worker1 # [ 165.583474] nix-grpc-daemon[1502]: time=2026-09-20T09:06:53.228Z level=INFO msg="Upload complete. (477ms)"6132lb # [ 165.610145] niks3-server[1051]: 2026/09/20 09:06:53 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6133lb # [ 165.616233] niks3-server[1051]: 2026/09/20 09:06:53 INFO Completed upload id=626134worker1 # [ 165.592211] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=0 paths=1 nar_bytes_in=7526135lb # [ 165.620238] niks3-server[1051]: 2026/09/20 09:06:53 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6136worker1 # [ 165.603444] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592306137worker1 # [ 165.608852] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)6138worker1 # [ 165.613390] nix-daemon[861]: reaped child process 1785, status = succeeded6139worker1 # [ 165.625486] nix-daemon[861]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)6140worker1 # [ 167.065302] nix-daemon[861]: reaped child process 1799, status = succeeded6141worker1 # [ 167.257027] nix-daemon[861]: accepted connection from pid 1814, user nix-grpc-daemon (trusted)6142worker1 # [ 167.276339] nix-daemon[861]: reaped child process 1817, status = succeeded6143lb # [ 167.318395] niks3-server[1051]: 2026/09/20 09:06:54 INFO Received uploads request method=POST path=/api/pending_closures6144worker1 # [ 167.304478] nix-grpc-daemon[1502]: time=2026-09-20T09:06:54.946Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6145worker1 # [ 167.305983] nix-grpc-daemon[1502]: time=2026-09-20T09:06:54.946Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6146lb # [ 167.359160] niks3-server[1051]: 2026/09/20 09:06:54 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6147lb # [ 167.370853] niks3-server[1051]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6148worker1 # [ 167.358769] nix-grpc-daemon[1502]: time=2026-09-20T09:06:55.003Z level=INFO msg="Uploading 1 narinfos"6149lb # [ 167.384776] niks3-server[1051]: 2026/09/20 09:06:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6150lb # [ 167.394021] niks3-server[1051]: 2026/09/20 09:06:55 INFO Signed narinfos id=63 count=16151lb # [ 167.399219] niks3-server[1051]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6152lb # [ 167.405659] niks3-server[1051]: 2026/09/20 09:06:55 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6153lb # [ 167.413547] niks3-server[1051]: 2026/09/20 09:06:55 INFO Completed upload id=636154worker1 # [ 167.386631] nix-grpc-daemon[1502]: time=2026-09-20T09:06:55.031Z level=INFO msg="Upload complete. (349ms)"6155lb # [ 167.416799] niks3-server[1051]: 2026/09/20 09:06:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6156worker1 # [ 167.397436] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59230 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16157worker1 # [ 167.415192] nix-daemon[861]: reaped child process 1797, status = succeeded6158client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.06 seconds)6159worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6160worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.09 seconds)6161client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]'6162client # [ 167.677921] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6163client # Running as unit: gpu.service; invocation ID: 1483d2381af946f7afbcec4c5b4c14396164client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds)6165lb: must succeed: curl -sf localhost:9901/clusters6166lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6167lb: must succeed: curl -sf localhost:9901/clusters6168lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6169worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true6170worker1 # [ 167.915619] nix-grpc-daemon[1446]: ts=2026-09-20T09:06:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592306171client # [ 167.923806] nix[1345]: don't know how to build these paths:6172client # [ 167.924983] nix[1345]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv6173worker2 # [ 167.966204] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340726174worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true, in 0.10 seconds)6175worker2 # [ 167.990256] nix-grpc-daemon[1627]: ts=2026-09-20T09:06:55Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06176client # [ 167.956106] nix[1345]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker6177lb: must succeed: curl -sf localhost:9901/clusters6178lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)6179lb: must succeed: curl -sf localhost:9901/clusters6180lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6181worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true6182worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true, in 0.08 seconds)6183client: waiting for success: systemctl show -p Result gpu | grep -q exit-code6184lb # [ 171.256514] envoy[912]: conn peer=[2001:db8:1::1]:33096 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27118 tx=10724 ms=197606185client # [ 197.958162] nix[1345]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}6186client # [ 197.970026] nix[1345]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed6187client # [ 198.010946] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE6188client # [ 198.018915] systemd[1]: gpu.service: Failed with result 'exit-code'.6189client # [ 198.022770] systemd[1]: gpu.service: Consumed 157ms CPU time over 30.338s wall clock time, 33.2M memory peak, 6.6K incoming IP traffic, 5.8K outgoing IP traffic.6190client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.30 seconds)6191client: must succeed: journalctl -u gpu -o cat6192client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds)6193lb: must succeed: curl -sf localhost:9901/clusters6194lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6195lb: must succeed: curl -sf localhost:9901/clusters6196lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6197worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true6198worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true, in 0.08 seconds)6199(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.29 seconds)6200subtest: low disk drains a worker and builds go to the other6201worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6202worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.34 seconds)6203worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6204worker1 # [ 200.137214] nix-grpc-daemon[1446]: ts=2026-09-20T09:07:27Z level=info event=unhealthy reason=min_free6205worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6206client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26207client # don't know how to build these paths:6208client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6209worker2 # [ 201.491448] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:340726210worker2 # [ 201.501073] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340726211worker2 # [ 201.519852] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:29Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06212worker2 # [ 201.526943] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:29Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16213worker2 # [ 201.564980] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340726214worker2 # [ 201.579660] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340726215client # copying 1 paths to 'lb:50051'...6216client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6217worker2 # [ 201.595480] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:340726218worker2 # [ 201.611325] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)6219worker2 # [ 201.820696] nix-daemon[842]: accepted connection from pid 1930, user nix-grpc-daemon (trusted)6220worker2 # [ 201.841057] nix-daemon[842]: reaped child process 1933, status = succeeded6221lb # [ 201.259906] envoy[912]: conn peer=[2001:db8:1::1]:48828 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=300636222worker2 # [ 202.017722] nix-daemon[842]: accepted connection from pid 1935, user nix-grpc-daemon (trusted)6223worker2 # [ 202.035296] nix-daemon[842]: reaped child process 1938, status = succeeded6224lb # [ 202.039301] niks3-server[1051]: 2026/09/20 09:07:29 INFO Received uploads request method=POST path=/api/pending_closures6225worker2 # [ 202.057866] nix-grpc-daemon[1703]: time=2026-09-20T09:07:29.695Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6226worker2 # [ 202.059368] nix-grpc-daemon[1703]: time=2026-09-20T09:07:29.695Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6227lb # [ 202.072659] niks3-server[1051]: 2026/09/20 09:07:29 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6228worker2 # [ 202.103044] nix-grpc-daemon[1703]: time=2026-09-20T09:07:29.740Z level=INFO msg="Uploading 1 narinfos"6229lb # [ 202.088320] niks3-server[1051]: 2026/09/20 09:07:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6230lb # [ 202.098694] niks3-server[1051]: 2026/09/20 09:07:29 INFO Signed narinfos id=64 count=16231lb # [ 202.104093] niks3-server[1051]: 2026/09/20 09:07:29 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6232lb # [ 202.111017] niks3-server[1051]: 2026/09/20 09:07:29 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6233worker2 # [ 202.126189] nix-grpc-daemon[1703]: time=2026-09-20T09:07:29.764Z level=INFO msg="Upload complete. (497ms)"6234lb # [ 202.118840] niks3-server[1051]: 2026/09/20 09:07:29 INFO Completed upload id=646235lb # [ 202.122378] niks3-server[1051]: 2026/09/20 09:07:29 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6236worker2 # [ 202.136418] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=0 paths=1 nar_bytes_in=5126237worker2 # [ 202.147807] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340726238worker2 # [ 202.154105] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)6239worker2 # [ 202.158831] nix-daemon[842]: reaped child process 1928, status = succeeded6240client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6241client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6242worker2 # [ 202.172585] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)6243client # farm-a> LOG-farm-a-drain6244worker2 # [ 203.206422] nix-daemon[842]: reaped child process 1942, status = succeeded6245worker2 # [ 203.371339] nix-daemon[842]: accepted connection from pid 1957, user nix-grpc-daemon (trusted)6246worker2 # [ 203.391030] nix-daemon[842]: reaped child process 1960, status = succeeded6247lb # [ 203.394780] niks3-server[1051]: 2026/09/20 09:07:31 INFO Received uploads request method=POST path=/api/pending_closures6248worker2 # [ 203.415954] nix-grpc-daemon[1703]: time=2026-09-20T09:07:31.051Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6249worker2 # [ 203.417610] nix-grpc-daemon[1703]: time=2026-09-20T09:07:31.051Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6250lb # [ 203.428574] niks3-server[1051]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6251lb # [ 203.448744] niks3-server[1051]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6252lb # [ 203.461517] niks3-server[1051]: 2026/09/20 09:07:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6253worker2 # [ 203.474427] nix-grpc-daemon[1703]: time=2026-09-20T09:07:31.112Z level=INFO msg="Uploading 1 narinfos"6254lb # [ 203.468211] niks3-server[1051]: 2026/09/20 09:07:31 INFO Signed narinfos id=65 count=16255lb # [ 203.470207] niks3-server[1051]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6256lb # [ 203.482015] niks3-server[1051]: 2026/09/20 09:07:31 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6257lb # [ 203.487440] niks3-server[1051]: 2026/09/20 09:07:31 INFO Completed upload id=656258worker2 # [ 203.495173] nix-grpc-daemon[1703]: time=2026-09-20T09:07:31.133Z level=INFO msg="Upload complete. (312ms)"6259lb # [ 203.494443] niks3-server[1051]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6260worker2 # [ 203.516466] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16261worker2 # [ 203.528100] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:31Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06262worker2 # [ 203.531710] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:31Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16263worker2 # [ 203.535608] nix-daemon[842]: reaped child process 1940, status = succeeded6264worker2 # [ 203.556791] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340726265worker2 # [ 203.570530] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340726266worker2 # [ 203.583883] nix-grpc-daemon[1703]: time=2026-09-20T09:07:31.221Z level=INFO msg="All 1 paths already cached"6267client # copying 1 paths to 'lb:50051'...6268client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6269worker2 # [ 203.594799] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:340726270worker2 # [ 203.608815] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)6271worker2 # [ 203.813803] nix-daemon[842]: accepted connection from pid 1966, user nix-grpc-daemon (trusted)6272worker2 # [ 203.835185] nix-daemon[842]: reaped child process 1969, status = succeeded6273worker2 # [ 204.016751] nix-daemon[842]: accepted connection from pid 1971, user nix-grpc-daemon (trusted)6274worker2 # [ 204.034442] nix-daemon[842]: reaped child process 1974, status = succeeded6275lb # [ 204.038961] niks3-server[1051]: 2026/09/20 09:07:31 INFO Received uploads request method=POST path=/api/pending_closures6276worker2 # [ 204.057421] nix-grpc-daemon[1703]: time=2026-09-20T09:07:31.695Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6277worker2 # [ 204.058989] nix-grpc-daemon[1703]: time=2026-09-20T09:07:31.695Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6278lb # [ 204.067854] niks3-server[1051]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6279worker2 # [ 204.090948] nix-grpc-daemon[1703]: time=2026-09-20T09:07:31.728Z level=INFO msg="Uploading 1 narinfos"6280lb # [ 204.083491] niks3-server[1051]: 2026/09/20 09:07:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6281lb # [ 204.095004] niks3-server[1051]: 2026/09/20 09:07:31 INFO Signed narinfos id=66 count=16282lb # [ 204.105008] niks3-server[1051]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6283worker2 # [ 204.118653] nix-grpc-daemon[1703]: time=2026-09-20T09:07:31.756Z level=INFO msg="Upload complete. (493ms)"6284lb # [ 204.110513] niks3-server[1051]: 2026/09/20 09:07:31 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6285lb # [ 204.115920] niks3-server[1051]: 2026/09/20 09:07:31 INFO Completed upload id=666286lb # [ 204.119185] niks3-server[1051]: 2026/09/20 09:07:31 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6287worker2 # [ 204.129062] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=0 paths=1 nar_bytes_in=6326288worker2 # [ 204.138515] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340726289worker2 # [ 204.145731] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)6290worker2 # [ 204.150809] nix-daemon[842]: reaped child process 1964, status = succeeded6291client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6292worker2 # [ 204.162140] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)6293client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6294client # farm-b> LOG-farm-b-drain6295worker2 # [ 205.615000] nix-daemon[842]: reaped child process 1978, status = succeeded6296worker2 # [ 205.793676] nix-daemon[842]: accepted connection from pid 1993, user nix-grpc-daemon (trusted)6297worker2 # [ 205.813249] nix-daemon[842]: reaped child process 1996, status = succeeded6298lb # [ 205.819416] niks3-server[1051]: 2026/09/20 09:07:33 INFO Received uploads request method=POST path=/api/pending_closures6299worker2 # [ 205.839532] nix-grpc-daemon[1703]: time=2026-09-20T09:07:33.475Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6300worker2 # [ 205.843917] nix-grpc-daemon[1703]: time=2026-09-20T09:07:33.476Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6301lb # [ 205.856401] niks3-server[1051]: 2026/09/20 09:07:33 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6302lb # [ 205.872309] niks3-server[1051]: 2026/09/20 09:07:33 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6303lb # [ 205.883767] niks3-server[1051]: 2026/09/20 09:07:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6304worker2 # [ 205.898141] nix-grpc-daemon[1703]: time=2026-09-20T09:07:33.535Z level=INFO msg="Uploading 1 narinfos"6305lb # [ 205.892565] niks3-server[1051]: 2026/09/20 09:07:33 INFO Signed narinfos id=67 count=16306lb # [ 205.895083] niks3-server[1051]: 2026/09/20 09:07:33 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6307lb # [ 205.909410] niks3-server[1051]: 2026/09/20 09:07:33 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6308lb # [ 205.916914] niks3-server[1051]: 2026/09/20 09:07:33 INFO Completed upload id=676309worker2 # [ 205.924631] nix-grpc-daemon[1703]: time=2026-09-20T09:07:33.562Z level=INFO msg="Upload complete. (347ms)"6310lb # [ 205.918843] niks3-server[1051]: 2026/09/20 09:07:33 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6311worker2 # [ 205.941742] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16312worker2 # [ 205.958937] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:33Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06313worker2 # [ 205.962980] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:33Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16314worker2 # [ 205.967088] nix-daemon[842]: reaped child process 1976, status = succeeded6315worker2 # [ 205.985094] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340726316worker2 # [ 206.001199] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:340726317worker2 # [ 206.014960] nix-grpc-daemon[1703]: time=2026-09-20T09:07:33.652Z level=INFO msg="All 2 paths already cached"6318client # copying 1 paths to 'lb:50051'...6319client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6320worker2 # [ 206.025130] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:340726321worker2 # [ 206.039082] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)6322worker2 # [ 206.243248] nix-daemon[842]: accepted connection from pid 2002, user nix-grpc-daemon (trusted)6323worker2 # [ 206.260978] nix-daemon[842]: reaped child process 2005, status = succeeded6324worker2 # [ 206.434551] nix-daemon[842]: accepted connection from pid 2007, user nix-grpc-daemon (trusted)6325worker2 # [ 206.450872] nix-daemon[842]: reaped child process 2010, status = succeeded6326lb # [ 206.457559] niks3-server[1051]: 2026/09/20 09:07:34 INFO Received uploads request method=POST path=/api/pending_closures6327worker2 # [ 206.475667] nix-grpc-daemon[1703]: time=2026-09-20T09:07:34.113Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6328worker2 # [ 206.477408] nix-grpc-daemon[1703]: time=2026-09-20T09:07:34.113Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6329lb # [ 206.485948] niks3-server[1051]: 2026/09/20 09:07:34 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6330worker2 # [ 206.508314] nix-grpc-daemon[1703]: time=2026-09-20T09:07:34.146Z level=INFO msg="Uploading 1 narinfos"6331lb # [ 206.503702] niks3-server[1051]: 2026/09/20 09:07:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6332lb # [ 206.514326] niks3-server[1051]: 2026/09/20 09:07:34 INFO Signed narinfos id=68 count=16333lb # [ 206.518246] niks3-server[1051]: 2026/09/20 09:07:34 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6334lb # [ 206.526316] niks3-server[1051]: 2026/09/20 09:07:34 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6335worker2 # [ 206.539680] nix-grpc-daemon[1703]: time=2026-09-20T09:07:34.177Z level=INFO msg="Upload complete. (482ms)"6336lb # [ 206.531385] niks3-server[1051]: 2026/09/20 09:07:34 INFO Completed upload id=686337lb # [ 206.535259] niks3-server[1051]: 2026/09/20 09:07:34 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6338worker2 # [ 206.548229] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=0 paths=1 nar_bytes_in=7606339worker2 # [ 206.559524] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:340726340worker2 # [ 206.565961] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)6341worker2 # [ 206.570873] nix-daemon[842]: reaped child process 2000, status = succeeded6342client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6343worker2 # [ 206.582315] nix-daemon[842]: accepted connection from pid 1627, user nix-grpc-daemon (trusted)6344client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6345client # farm-top> LOG-farm-top-drain6346worker2 # [ 207.627893] nix-daemon[842]: reaped child process 2014, status = succeeded6347worker2 # [ 207.806304] nix-daemon[842]: accepted connection from pid 2029, user nix-grpc-daemon (trusted)6348worker2 # [ 207.823317] nix-daemon[842]: reaped child process 2032, status = succeeded6349lb # [ 207.826749] niks3-server[1051]: 2026/09/20 09:07:35 INFO Received uploads request method=POST path=/api/pending_closures6350worker2 # [ 207.846009] nix-grpc-daemon[1703]: time=2026-09-20T09:07:35.482Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6351worker2 # [ 207.847825] nix-grpc-daemon[1703]: time=2026-09-20T09:07:35.482Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6352lb # [ 207.858374] niks3-server[1051]: 2026/09/20 09:07:35 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6353lb # [ 207.870176] niks3-server[1051]: 2026/09/20 09:07:35 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6354worker2 # [ 207.895097] nix-grpc-daemon[1703]: time=2026-09-20T09:07:35.532Z level=INFO msg="Uploading 1 narinfos"6355lb # [ 207.885812] niks3-server[1051]: 2026/09/20 09:07:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6356lb # [ 207.895332] niks3-server[1051]: 2026/09/20 09:07:35 INFO Signed narinfos id=69 count=16357lb # [ 207.901200] niks3-server[1051]: 2026/09/20 09:07:35 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6358lb # [ 207.911820] niks3-server[1051]: 2026/09/20 09:07:35 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6359lb # [ 207.915946] niks3-server[1051]: 2026/09/20 09:07:35 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6360lb # [ 207.919906] niks3-server[1051]: 2026/09/20 09:07:35 INFO Completed upload id=696361worker2 # [ 207.928810] nix-grpc-daemon[1703]: time=2026-09-20T09:07:35.566Z level=INFO msg="Upload complete. (334ms)"6362worker2 # [ 207.941136] nix-grpc-daemon[1627]: ts=2026-09-20T09:07:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34072 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16363worker2 # [ 207.957534] nix-daemon[842]: reaped child process 2012, status = succeeded6364client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.79 seconds)6365client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6366client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds)6367worker1: must succeed: rm /nix/.rw-store/fill6368worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6369worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6370worker1 # [ 209.145734] nix-grpc-daemon[1446]: ts=2026-09-20T09:07:36Z level=info event=healthy reason=min_free6371worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.13 seconds)6372(finished: subtest: low disk drains a worker and builds go to the other, in 10.88 seconds)6373(finished: run the VM test script, in 210.51 seconds)6374test script finished in 210.80s6375cleanup6376kill QemuMachine (pid 50)6377client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6378kill QemuMachine (pid 49)6379lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6380kill QemuMachine (pid 51)6381worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6382kill QemuMachine (pid 52)6383worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6384(finished: cleanup, in 1.05 seconds)6385additionally exposed symbols:6386 client, lb, worker1, worker2,6387 vlan1,6388 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh