vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #251
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2 # Formatting '/build/vm-state-worker2/tmp.HpoS1Df5V1', fmt=raw size=107374182414lb # Disk image does not exist, creating the virtualisation disk image...15worker2: QEMU running (pid 52)16lb # Formatting '/build/vm-state-lb/tmp.xEvmmXm14N', fmt=raw size=107374182417lb: QEMU running (pid 50)18worker2 # mke2fs 1.47.4 (6-Mar-2025)19client # Disk image does not exist, creating the virtualisation disk image...20lb # mke2fs 1.47.4 (6-Mar-2025)21worker1 # Disk image does not exist, creating the virtualisation disk image...22worker1: QEMU running (pid 51)23client: QEMU running (pid 49)24worker2 # Discarding device blocks: 0/262144 done25client # Formatting '/build/vm-state-client/tmp.DGJhy25YYp', fmt=raw size=107374182426worker1 # Formatting '/build/vm-state-worker1/tmp.ogTKBDIQcN', fmt=raw size=107374182427lb # Discarding device blocks: 0/262144 done28worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes29client # mke2fs 1.47.4 (6-Mar-2025)30worker1 # mke2fs 1.47.4 (6-Mar-2025)31worker2 # Filesystem UUID: 060788c8-0131-4c31-8649-3a1a7e17d97932client # Discarding device blocks: 0/262144 done33worker1 # Discarding device blocks: 0/262144 done34worker2 # Superblock backups stored on blocks:35client # Creating filesystem with 262144 4k blocks and 65536 inodes36worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes37worker2 # 32768, 98304, 163840, 22937638client # Filesystem UUID: 13d9ebb8-e2b9-4041-b729-3df7a598e50339worker1 # Filesystem UUID: 4e9a7da8-ed1e-4b6b-9e9b-5a4e4b65b61340worker2 # 41client # Superblock backups stored on blocks:42worker1 # Superblock backups stored on blocks:43worker2 # Allocating group tables: 0/8 done44client # 32768, 98304, 163840, 22937645worker1 # 32768, 98304, 163840, 22937646worker2 # Writing inode tables: 0/8 done47client # 48worker1 # 49worker2 # Creating journal (8192 blocks): done50client # Allocating group tables: 0/8 done51worker1 # Allocating group tables: 0/8 done52worker2 # Writing superblocks and filesystem accounting information: 0/8 done53client # Writing inode tables: 0/8 done54worker1 # Writing inode tables: 0/8 done55worker2 # 56client # Creating journal (8192 blocks): done57worker1 # Creating journal (8192 blocks): done58worker2 # Virtualisation disk image created.59client # Writing superblocks and filesystem accounting information: 0/8 done60worker1 # Writing superblocks and filesystem accounting information: 0/8 done61lb # Creating filesystem with 262144 4k blocks and 65536 inodes62(finished: start all VMs, in 0.62 seconds)63client # 64worker1 # 65client: waiting for unit network-addresses-eth1.service66client # Virtualisation disk image created.67lb # Filesystem UUID: 905c8082-9db5-4c4c-a498-e77c00303cfe68client: waiting for the VM to finish booting69worker1 # Virtualisation disk image created.70lb # Superblock backups stored on blocks:71lb # 32768, 98304, 163840, 22937672lb # 73lb # Allocating group tables: 0/8 done74lb # Writing inode tables: 0/8 done75lb # Creating journal (8192 blocks): done76lb # Writing superblocks and filesystem accounting information: 0/8 done77lb # 78lb # Virtualisation disk image created.79worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker1 # [ 0.000000] KASLR enabled82worker1 # [ 0.000000] random: crng init done83worker1 # [ 0.000000] Machine model: linux,dummy-virt84worker1 # [ 0.000000] efi: UEFI not found.85worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88worker1 # [ 0.000000] Zone ranges:89lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]90worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]91worker1 # [ 0.000000] DMA32 empty92worker1 # [ 0.000000] Normal empty93lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202694worker1 # [ 0.000000] Device empty95lb # [ 0.000000] KASLR enabled96worker1 # [ 0.000000] Movable zone start for each node97lb # [ 0.000000] random: crng init done98worker1 # [ 0.000000] Early memory node ranges99lb # [ 0.000000] Machine model: linux,dummy-virt100lb # [ 0.000000] efi: UEFI not found.101worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]102lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT103worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]104worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000105lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]106worker1 # [ 0.000000] psci: probing for conduit method from DT.107lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]108lb # [ 0.000000] Zone ranges:109worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.110worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs111lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]112lb # [ 0.000000] DMA32 empty113worker1 # [ 0.000000] psci: Trusted OS migration not required114lb # [ 0.000000] Normal empty115lb # [ 0.000000] Device empty116worker1 # [ 0.000000] psci: SMC Calling Convention v1.1117lb # [ 0.000000] Movable zone start for each node118lb # [ 0.000000] Early memory node ranges119worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)120lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]121worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296122worker1 # [ 0.000000] Detected PIPT I-cache on CPU0123lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]124lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000125worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)126lb # [ 0.000000] psci: probing for conduit method from DT.127worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface128lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.129worker1 # [ 0.000000] CPU features: detected: Spectre-v4130lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs131worker1 # [ 0.000000] CPU features: detected: Spectre-BHB132lb # [ 0.000000] psci: Trusted OS migration not required133worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38134lb # [ 0.000000] psci: SMC Calling Convention v1.1135worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23136lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)137worker1 # [ 0.000000] alternatives: applying boot alternatives138lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296139lb # [ 0.000000] Detected PIPT I-cache on CPU0140lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)141lb # [ 0.000000] CPU features: detected: GICv3 CPU interface142lb # [ 0.000000] CPU features: detected: Spectre-v4143worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gy3k7x527c38djcmpycpycfhnskkzynp-nixos-system-worker1-test/init regInfo=/nix/store/b4g7ngbiscxlrax8kca3f93vbr2k88bd-closure-info/registration console=ttyAMA0,115200n8 console=tty0144lb # [ 0.000000] CPU features: detected: Spectre-BHB145lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38146lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23147worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/b4g7ngbiscxlrax8kca3f93vbr2k88bd-closure-info/registration", will be passed to user space.148lb # [ 0.000000] alternatives: applying boot alternatives149worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes150worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)151worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)152worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB153worker1 # [ 0.000000] software IO TLB: area num 1.154lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0155worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB156worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)157lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.158worker1 # [ 0.000000] Fallback order for Node 0: 0159lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes160worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216161worker1 # [ 0.000000] Policy zone: DMA162lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)163worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off164lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)165worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1166worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]167lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB168worker1 # [ 0.000000] allocated 3145728 bytes of page_ext169lb # [ 0.000000] software IO TLB: area num 1.170worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages171lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB172worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026173worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups174worker2 # [ 0.000000] KASLR enabled175client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]176worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.177worker2 # [ 0.000000] random: crng init done178lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)179worker1 # [ 0.000000] rcu: RCU event tracing is enabled.180worker2 # [ 0.000000] Machine model: linux,dummy-virt181lb # [ 0.000000] Fallback order for Node 0: 0182client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026183worker2 # [ 0.000000] efi: UEFI not found.184worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.185client # [ 0.000000] KASLR enabled186lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216187worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT188client # [ 0.000000] random: crng init done189worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.190lb # [ 0.000000] Policy zone: DMA191client # [ 0.000000] Machine model: linux,dummy-virt192worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.193lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off194worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]195client # [ 0.000000] efi: UEFI not found.196worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.197worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]198lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1199worker2 # [ 0.000000] Zone ranges:200client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT201lb # [ 0.000000] allocated 3145728 bytes of page_ext202worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.203worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]204client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]205lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages206worker2 # [ 0.000000] DMA32 empty207worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1208worker2 # [ 0.000000] Normal empty209lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups210client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]211client # [ 0.000000] Zone ranges:212worker2 # [ 0.000000] Device empty213lb # [ 0.000000] rcu: Hierarchical RCU implementation.214worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.215worker2 # [ 0.000000] Movable zone start for each node216client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]217lb # [ 0.000000] rcu: RCU event tracing is enabled.218worker2 # [ 0.000000] Early memory node ranges219client # [ 0.000000] DMA32 empty220client # [ 0.000000] Normal empty221worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.222lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.223worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]224client # [ 0.000000] Device empty225lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.226client # [ 0.000000] Movable zone start for each node227worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]228worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.229lb # [ 0.000000] Rude variant of Tasks RCU enabled.230client # [ 0.000000] Early memory node ranges231worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000232worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0233lb # [ 0.000000] Tracing variant of Tasks RCU enabled.234client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]235worker1 # [ 0.000000] GICv3: 256 SPIs implemented236worker2 # [ 0.000000] psci: probing for conduit method from DT.237lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.238client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]239worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.240worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented241worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq242client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000243worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs244lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1245worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI246worker2 # [ 0.000000] psci: Trusted OS migration not required247client # [ 0.000000] psci: probing for conduit method from DT.248worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0249worker2 # [ 0.000000] psci: SMC Calling Convention v1.1250lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.251client # [ 0.000000] psci: PSCIv1.3 detected in firmware.252client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs253worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000254worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)255lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.256client # [ 0.000000] psci: Trusted OS migration not required257worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]258client # [ 0.000000] psci: SMC Calling Convention v1.1259worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296260lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.261worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)262worker2 # [ 0.000000] Detected PIPT I-cache on CPU0263client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)264lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0265lb # [ 0.000000] GICv3: 256 SPIs implemented266worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)267worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)268client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296269lb # [ 0.000000] GICv3: 0 Extended SPIs implemented270client # [ 0.000000] Detected PIPT I-cache on CPU0271worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface272worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000273lb # [ 0.000000] Root IRQ handler: gic_handle_irq274worker2 # [ 0.000000] CPU features: detected: Spectre-v4275lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI276client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)277worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000278worker2 # [ 0.000000] CPU features: detected: Spectre-BHB279lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0280client # [ 0.000000] CPU features: detected: GICv3 CPU interface281worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38282worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.283lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000284client # [ 0.000000] CPU features: detected: Spectre-v4285worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23286client # [ 0.000000] CPU features: detected: Spectre-BHB287lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]288worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns289worker2 # [ 0.000000] alternatives: applying boot alternatives290client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38291worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).292lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)293client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23294client # [ 0.000000] alternatives: applying boot alternatives295lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)296worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns297lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000298worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns299lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000300worker1 # [ 0.000033] arm-pv: using stolen time PV301worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jzdfkj5rn54mxddyl2kfg84vs1zgm4ba-nixos-system-worker2-test/init regInfo=/nix/store/a861za859qjzvnmb0mjbxjbnm95qmjfq-closure-info/registration console=ttyAMA0,115200n8 console=tty0302lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.303worker1 # [ 0.000545] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)304worker1 # [ 0.000714] Console: colour dummy device 80x25305client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test/init regInfo=/nix/store/kw37kf8y651cwikgpy10xp7y2ldijiqs-closure-info/registration console=ttyAMA0,115200n8 console=tty0306lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns307worker1 # [ 0.000723] printk: legacy console [tty0] enabled308lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).309worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/a861za859qjzvnmb0mjbxjbnm95qmjfq-closure-info/registration", will be passed to user space.310worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes311worker1 # [ 0.000918] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)312client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/kw37kf8y651cwikgpy10xp7y2ldijiqs-closure-info/registration", will be passed to user space.313lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns314worker1 # [ 0.000924] pid_max: default: 32768 minimum: 301315worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)316lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns317worker1 # [ 0.000994] LSM: initializing lsm=capability,landlock,yama,bpf,ima318client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes319worker1 # [ 0.001151] landlock: Up and running.320worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)321lb # [ 0.000032] arm-pv: using stolen time PV322worker1 # [ 0.001154] Yama: becoming mindful.323client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)324worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB325worker1 # [ 0.001741] LSM support for eBPF active326lb # [ 0.000558] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)327worker2 # [ 0.000000] software IO TLB: area num 1.328client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)329lb # [ 0.000735] Console: colour dummy device 80x25330worker1 # [ 0.001932] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)331worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB332lb # [ 0.000743] printk: legacy console [tty0] enabled333client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB334worker1 # [ 0.001967] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)335worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)336client # [ 0.000000] software IO TLB: area num 1.337worker1 # [ 0.003096] cacheinfo: Unable to detect cache hierarchy for CPU 0338worker2 # [ 0.000000] Fallback order for Node 0: 0339lb # [ 0.000957] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)340client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB341worker1 # [ 0.003878] rcu: Hierarchical SRCU implementation.342lb # [ 0.000964] pid_max: default: 32768 minimum: 301343worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216344worker2 # [ 0.000000] Policy zone: DMA345worker1 # [ 0.003882] rcu: Max phase no-delay instances is 1000.346client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)347lb # [ 0.001036] LSM: initializing lsm=capability,landlock,yama,bpf,ima348client # [ 0.000000] Fallback order for Node 0: 0349lb # [ 0.001197] landlock: Up and running.350worker1 # [ 0.005136] fsl-mc MSI: its@8080000 domain created351worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off352lb # [ 0.001199] Yama: becoming mindful.353worker1 # [ 0.005228] EFI services will not be available.354client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216355lb # [ 0.001737] LSM support for eBPF active356worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1357client # [ 0.000000] Policy zone: DMA358worker1 # [ 0.005302] smp: Bringing up secondary CPUs ...359worker2 # [ 0.000000] allocated 3145728 bytes of page_ext360worker1 # [ 0.005311] smp: Brought up 1 node, 1 CPU361lb # [ 0.001877] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)362client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off363worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages364worker1 # [ 0.005314] SMP: Total of 1 processors activated.365lb # [ 0.001912] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)366client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1367worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups368worker1 # [ 0.005320] CPU: All CPU(s) started at EL1369client # [ 0.000000] allocated 3145728 bytes of page_ext370worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.371worker1 # [ 0.005331] CPU features: detected: Branch Target Identification372lb # [ 0.003148] cacheinfo: Unable to detect cache hierarchy for CPU 0373worker2 # [ 0.000000] rcu: RCU event tracing is enabled.374client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages375lb # [ 0.003917] rcu: Hierarchical SRCU implementation.376worker1 # [ 0.005336] CPU features: detected: ARMv8.4 Translation Table Level377client # [ 0.000000] ftrace: allocated 294 pages with 4 groups378lb # [ 0.003921] rcu: Max phase no-delay instances is 1000.379worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.380client # [ 0.000000] rcu: Hierarchical RCU implementation.381lb # [ 0.005133] fsl-mc MSI: its@8080000 domain created382worker1 # [ 0.005340] CPU features: detected: Instruction cache invalidation not required for I/D coherence383worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.384client # [ 0.000000] rcu: RCU event tracing is enabled.385lb # [ 0.005232] EFI services will not be available.386worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.387lb # [ 0.005313] smp: Bringing up secondary CPUs ...388worker1 # [ 0.005343] CPU features: detected: Data cache clean to the PoU not required for I/D coherence389worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.390client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.391lb # [ 0.005322] smp: Brought up 1 node, 1 CPU392client # [ 0.000000] Trampoline variant of Tasks RCU enabled.393worker1 # [ 0.005347] CPU features: detected: Common not Private translations394worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.395lb # [ 0.005325] SMP: Total of 1 processors activated.396client # [ 0.000000] Rude variant of Tasks RCU enabled.397worker1 # [ 0.005350] CPU features: detected: CRC32 instructions398lb # [ 0.005330] CPU: All CPU(s) started at EL1399worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1400client # [ 0.000000] Tracing variant of Tasks RCU enabled.401lb # [ 0.005342] CPU features: detected: Branch Target Identification402worker1 # [ 0.005353] CPU features: detected: Data cache clean to Point of Deep Persistence403client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.404worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.405lb # [ 0.005346] CPU features: detected: ARMv8.4 Translation Table Level406worker1 # [ 0.005357] CPU features: detected: Data cache clean to Point of Persistence407client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1408worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.409worker1 # [ 0.005360] CPU features: detected: Data independent timing control (DIT)410lb # [ 0.005350] CPU features: detected: Instruction cache invalidation not required for I/D coherence411worker1 # [ 0.005363] CPU features: detected: E0PD412client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.413worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.414lb # [ 0.005354] CPU features: detected: Data cache clean to the PoU not required for I/D coherence415worker1 # [ 0.005365] CPU features: detected: Enhanced Counter Virtualization416client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.417worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0418lb # [ 0.005357] CPU features: detected: Common not Private translations419worker1 # [ 0.005369] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)420worker2 # [ 0.000000] GICv3: 256 SPIs implemented421lb # [ 0.005360] CPU features: detected: CRC32 instructions422worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented423client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.424worker1 # [ 0.005372] CPU features: detected: Enhanced Virtualization Traps425worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq426lb # [ 0.005363] CPU features: detected: Data cache clean to Point of Deep Persistence427worker1 # [ 0.005375] CPU features: detected: Fine Grained Traps428client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0429worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI430client # [ 0.000000] GICv3: 256 SPIs implemented431lb # [ 0.005367] CPU features: detected: Data cache clean to Point of Persistence432worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0433worker1 # [ 0.005378] CPU features: detected: Generic authentication (architected QARMA5 algorithm)434client # [ 0.000000] GICv3: 0 Extended SPIs implemented435client # [ 0.000000] Root IRQ handler: gic_handle_irq436lb # [ 0.005371] CPU features: detected: Data independent timing control (DIT)437worker1 # [ 0.005383] CPU features: detected: RCpc load-acquire (LDAPR)438worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000439lb # [ 0.005373] CPU features: detected: E0PD440client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI441worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]442worker1 # [ 0.005386] CPU features: detected: LSE atomic instructions443client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0444lb # [ 0.005376] CPU features: detected: Enhanced Counter Virtualization445worker1 # [ 0.005389] CPU features: detected: Privileged Access Never446worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)447worker1 # [ 0.005392] CPU features: detected: PMUv3448lb # [ 0.005379] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)449client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000450client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]451worker1 # [ 0.005395] CPU features: detected: RAS Extension Support452lb # [ 0.005382] CPU features: detected: Enhanced Virtualization Traps453worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)454worker1 # [ 0.005397] CPU features: detected: RASv1p1 Extension Support455lb # [ 0.005385] CPU features: detected: Fine Grained Traps456client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)457worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000458worker1 # [ 0.005400] CPU features: detected: Random Number Generator459lb # [ 0.005389] CPU features: detected: Generic authentication (architected QARMA5 algorithm)460worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000461worker1 # [ 0.005403] CPU features: detected: Speculation barrier (SB)462client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)463lb # [ 0.005394] CPU features: detected: RCpc load-acquire (LDAPR)464worker1 # [ 0.005406] CPU features: detected: Stage-2 Force Write-Back465worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.466client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000467lb # [ 0.005396] CPU features: detected: LSE atomic instructions468worker1 # [ 0.005409] CPU features: detected: TLB range maintenance instructions469lb # [ 0.005399] CPU features: detected: Privileged Access Never470client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000471worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns472lb # [ 0.005402] CPU features: detected: PMUv3473worker1 # [ 0.005413] CPU features: detected: Speculative Store Bypassing Safe (SSBS)474client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.475worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).476lb # [ 0.005405] CPU features: detected: RAS Extension Support477worker1 # [ 0.005453] alternatives: applying system-wide alternatives478lb # [ 0.005408] CPU features: detected: RASv1p1 Extension Support479client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns480worker1 # [ 0.008485] CPU features: detected: BBM Level 2 without TLB conflict abort481worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns482lb # [ 0.005410] CPU features: detected: Random Number Generator483client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).484worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns485worker1 # [ 0.008717] Memory: 1406544K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)486worker2 # [ 0.000031] arm-pv: using stolen time PV487lb # [ 0.005413] CPU features: detected: Speculation barrier (SB)488client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns489worker1 # [ 0.009170] devtmpfs: initialized490lb # [ 0.005416] CPU features: detected: Stage-2 Force Write-Back491client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns492worker2 # [ 0.000427] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)493worker1 # [ 0.011021] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)494client # [ 0.000030] arm-pv: using stolen time PV495lb # [ 0.005419] CPU features: detected: TLB range maintenance instructions496worker2 # [ 0.000600] Console: colour dummy device 80x25497worker2 # [ 0.000628] printk: legacy console [tty0] enabled498worker1 # [ 0.011052] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).499lb # [ 0.005423] CPU features: detected: Speculative Store Bypassing Safe (SSBS)500client # [ 0.000442] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)501worker1 # [ 0.011261] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL502lb # [ 0.005463] alternatives: applying system-wide alternatives503client # [ 0.000629] Console: colour dummy device 80x25504worker2 # [ 0.000817] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)505worker1 # [ 0.011265] 0 pages in range for non-PLT usage506client # [ 0.000637] printk: legacy console [tty0] enabled507lb # [ 0.008436] CPU features: detected: BBM Level 2 without TLB conflict abort508worker2 # [ 0.000824] pid_max: default: 32768 minimum: 301509worker1 # [ 0.011266] 508288 pages in range for PLT usage510worker1 # [ 0.011384] pinctrl core: initialized pinctrl subsystem511worker2 # [ 0.000893] LSM: initializing lsm=capability,landlock,yama,bpf,ima512client # [ 0.000835] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)513worker1 # [ 0.012156] DMI not present or invalid.514worker2 # [ 0.001065] landlock: Up and running.515lb # [ 0.008637] Memory: 1406556K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)516client # [ 0.000843] pid_max: default: 32768 minimum: 301517worker2 # [ 0.001068] Yama: becoming mindful.518lb # [ 0.009078] devtmpfs: initialized519worker1 # [ 0.015807] NET: Registered PF_NETLINK/PF_ROUTE protocol family520worker2 # [ 0.001549] LSM support for eBPF active521client # [ 0.000937] LSM: initializing lsm=capability,landlock,yama,bpf,ima522lb # [ 0.010875] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)523worker1 # [ 0.018212] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations524client # [ 0.001065] landlock: Up and running.525worker2 # [ 0.001704] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)526client # [ 0.001067] Yama: becoming mindful.527worker1 # [ 0.018394] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations528client # [ 0.001520] LSM support for eBPF active529lb # [ 0.010897] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).530worker2 # [ 0.001738] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)531lb # [ 0.011077] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL532worker2 # [ 0.002898] cacheinfo: Unable to detect cache hierarchy for CPU 0533client # [ 0.001675] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)534worker1 # [ 0.018605] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations535lb # [ 0.011081] 0 pages in range for non-PLT usage536worker2 # [ 0.003616] rcu: Hierarchical SRCU implementation.537worker1 # [ 0.018627] audit: initializing netlink subsys (disabled)538client # [ 0.001707] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)539lb # [ 0.011082] 508288 pages in range for PLT usage540worker2 # [ 0.003621] rcu: Max phase no-delay instances is 1000.541worker1 # [ 0.019239] thermal_sys: Registered thermal governor 'fair_share'542lb # [ 0.011208] pinctrl core: initialized pinctrl subsystem543client # [ 0.002875] cacheinfo: Unable to detect cache hierarchy for CPU 0544worker2 # [ 0.004849] fsl-mc MSI: its@8080000 domain created545worker1 # [ 0.019241] thermal_sys: Registered thermal governor 'bang_bang'546lb # [ 0.012005] DMI not present or invalid.547client # [ 0.003597] rcu: Hierarchical SRCU implementation.548worker2 # [ 0.004936] EFI services will not be available.549lb # [ 0.015495] NET: Registered PF_NETLINK/PF_ROUTE protocol family550worker1 # [ 0.019245] thermal_sys: Registered thermal governor 'step_wise'551worker2 # [ 0.005003] smp: Bringing up secondary CPUs ...552client # [ 0.003602] rcu: Max phase no-delay instances is 1000.553client # [ 0.004818] fsl-mc MSI: its@8080000 domain created554worker2 # [ 0.005012] smp: Brought up 1 node, 1 CPU555worker1 # [ 0.019250] thermal_sys: Registered thermal governor 'user_space'556lb # [ 0.017836] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations557worker2 # [ 0.005015] SMP: Total of 1 processors activated.558client # [ 0.004908] EFI services will not be available.559worker1 # [ 0.019253] thermal_sys: Registered thermal governor 'power_allocator'560worker2 # [ 0.005020] CPU: All CPU(s) started at EL1561lb # [ 0.018032] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations562client # [ 0.004987] smp: Bringing up secondary CPUs ...563client # [ 0.004995] smp: Brought up 1 node, 1 CPU564worker2 # [ 0.005032] CPU features: detected: Branch Target Identification565worker1 # [ 0.019280] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1566lb # [ 0.018237] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations567client # [ 0.004999] SMP: Total of 1 processors activated.568worker1 # [ 0.019288] cpuidle: using governor ladder569worker2 # [ 0.005037] CPU features: detected: ARMv8.4 Translation Table Level570client # [ 0.005004] CPU: All CPU(s) started at EL1571lb # [ 0.018259] audit: initializing netlink subsys (disabled)572worker1 # [ 0.019294] cpuidle: using governor menu573client # [ 0.005016] CPU features: detected: Branch Target Identification574lb # [ 0.018840] thermal_sys: Registered thermal governor 'fair_share'575worker2 # [ 0.005040] CPU features: detected: Instruction cache invalidation not required for I/D coherence576worker1 # [ 0.019504] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.577client # [ 0.005021] CPU features: detected: ARMv8.4 Translation Table Level578lb # [ 0.018842] thermal_sys: Registered thermal governor 'bang_bang'579worker1 # [ 0.019522] ASID allocator initialised with 65536 entries580worker2 # [ 0.005043] CPU features: detected: Data cache clean to the PoU not required for I/D coherence581lb # [ 0.018846] thermal_sys: Registered thermal governor 'step_wise'582worker1 # [ 0.020759] Serial: AMBA PL011 UART driver583client # [ 0.005024] CPU features: detected: Instruction cache invalidation not required for I/D coherence584worker2 # [ 0.005047] CPU features: detected: Common not Private translations585lb # [ 0.018851] thermal_sys: Registered thermal governor 'user_space'586worker1 # [ 0.026171] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1587worker2 # [ 0.005050] CPU features: detected: CRC32 instructions588client # [ 0.005027] CPU features: detected: Data cache clean to the PoU not required for I/D coherence589lb # [ 0.018854] thermal_sys: Registered thermal governor 'power_allocator'590worker1 # [ 0.026302] printk: console [ttyAMA0] enabled591worker2 # [ 0.005053] CPU features: detected: Data cache clean to Point of Deep Persistence592client # [ 0.005031] CPU features: detected: Common not Private translations593lb # [ 0.018880] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1594client # [ 0.005034] CPU features: detected: CRC32 instructions595lb # [ 0.018888] cpuidle: using governor ladder596worker2 # [ 0.005056] CPU features: detected: Data cache clean to Point of Persistence597lb # [ 0.018894] cpuidle: using governor menu598client # [ 0.005037] CPU features: detected: Data cache clean to Point of Deep Persistence599worker2 # [ 0.005060] CPU features: detected: Data independent timing control (DIT)600lb # [ 0.019096] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.601worker2 # [ 0.005063] CPU features: detected: E0PD602client # [ 0.005040] CPU features: detected: Data cache clean to Point of Persistence603lb # [ 0.019113] ASID allocator initialised with 65536 entries604worker2 # [ 0.005065] CPU features: detected: Enhanced Counter Virtualization605client # [ 0.005043] CPU features: detected: Data independent timing control (DIT)606lb # [ 0.020426] Serial: AMBA PL011 UART driver607client # [ 0.005046] CPU features: detected: E0PD608worker2 # [ 0.005068] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)609lb # [ 0.026054] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1610client # [ 0.005049] CPU features: detected: Enhanced Counter Virtualization611worker2 # [ 0.005071] CPU features: detected: Enhanced Virtualization Traps612lb # [ 0.026212] printk: console [ttyAMA0] enabled613worker2 # [ 0.005074] CPU features: detected: Fine Grained Traps614client # [ 0.005052] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)615client # [ 0.005055] CPU features: detected: Enhanced Virtualization Traps616worker2 # [ 0.005077] CPU features: detected: Generic authentication (architected QARMA5 algorithm)617client # [ 0.005058] CPU features: detected: Fine Grained Traps618worker2 # [ 0.005083] CPU features: detected: RCpc load-acquire (LDAPR)619worker2 # [ 0.005086] CPU features: detected: LSE atomic instructions620worker1 # [ 0.145746] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages621client # [ 0.005061] CPU features: detected: Generic authentication (architected QARMA5 algorithm)622worker2 # [ 0.005089] CPU features: detected: Privileged Access Never623client # [ 0.005067] CPU features: detected: RCpc load-acquire (LDAPR)624worker1 # [ 0.145764] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page625worker2 # [ 0.005092] CPU features: detected: PMUv3626client # [ 0.005069] CPU features: detected: LSE atomic instructions627worker1 # [ 0.145769] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages628worker2 # [ 0.005094] CPU features: detected: RAS Extension Support629client # [ 0.005072] CPU features: detected: Privileged Access Never630worker1 # [ 0.145788] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page631worker2 # [ 0.005097] CPU features: detected: RASv1p1 Extension Support632client # [ 0.005075] CPU features: detected: PMUv3633worker2 # [ 0.005100] CPU features: detected: Random Number Generator634worker1 # [ 0.145794] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages635client # [ 0.005078] CPU features: detected: RAS Extension Support636client # [ 0.005081] CPU features: detected: RASv1p1 Extension Support637worker1 # [ 0.145798] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page638worker2 # [ 0.005102] CPU features: detected: Speculation barrier (SB)639lb # [ 0.143523] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages640client # [ 0.005083] CPU features: detected: Random Number Generator641worker2 # [ 0.005105] CPU features: detected: Stage-2 Force Write-Back642worker1 # [ 0.145803] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages643lb # [ 0.143539] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page644worker2 # [ 0.005108] CPU features: detected: TLB range maintenance instructions645client # [ 0.005086] CPU features: detected: Speculation barrier (SB)646worker1 # [ 0.145807] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page647lb # [ 0.143545] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages648client # [ 0.005089] CPU features: detected: Stage-2 Force Write-Back649worker2 # [ 0.005113] CPU features: detected: Speculative Store Bypassing Safe (SSBS)650lb # [ 0.143549] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page651worker2 # [ 0.005149] alternatives: applying system-wide alternatives652client # [ 0.005092] CPU features: detected: TLB range maintenance instructions653lb # [ 0.143554] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages654client # [ 0.005096] CPU features: detected: Speculative Store Bypassing Safe (SSBS)655worker2 # [ 0.008150] CPU features: detected: BBM Level 2 without TLB conflict abort656worker1 # [ 0.153292] fbcon: Taking over console657lb # [ 0.143558] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page658client # [ 0.005133] alternatives: applying system-wide alternatives659worker1 # [ 0.153308] ACPI: Interpreter disabled.660lb # [ 0.143562] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages661client # [ 0.008087] CPU features: detected: BBM Level 2 without TLB conflict abort662worker2 # [ 0.008358] Memory: 1406544K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)663lb # [ 0.143567] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page664worker2 # [ 0.008756] devtmpfs: initialized665worker2 # [ 0.010587] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)666client # [ 0.008248] Memory: 1406532K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)667client # [ 0.008619] devtmpfs: initialized668worker2 # [ 0.010611] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).669lb # [ 0.150702] fbcon: Taking over console670client # [ 0.010450] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)671lb # [ 0.150717] ACPI: Interpreter disabled.672worker2 # [ 0.010785] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL673client # [ 0.010473] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).674worker2 # [ 0.010790] 0 pages in range for non-PLT usage675worker2 # [ 0.010791] 508288 pages in range for PLT usage676client # [ 0.010670] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL677worker2 # [ 0.010883] pinctrl core: initialized pinctrl subsystem678client # [ 0.010675] 0 pages in range for non-PLT usage679worker2 # [ 0.011597] DMI not present or invalid.680client # [ 0.010676] 508288 pages in range for PLT usage681worker2 # [ 0.015016] NET: Registered PF_NETLINK/PF_ROUTE protocol family682client # [ 0.010788] pinctrl core: initialized pinctrl subsystem683client # [ 0.011604] DMI not present or invalid.684worker2 # [ 0.017300] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations685worker1 # [ 0.162288] iommu: Default domain type: Translated686client # [ 0.014683] NET: Registered PF_NETLINK/PF_ROUTE protocol family687worker2 # [ 0.017494] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations688worker1 # [ 0.162298] iommu: DMA domain TLB invalidation policy: strict mode689client # [ 0.016984] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations690worker1 # [ 0.162661] SCSI subsystem initialized691worker2 # [ 0.017697] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations692client # [ 0.017162] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations693worker2 # [ 0.017723] audit: initializing netlink subsys (disabled)694worker1 # [ 0.164619] usbcore: registered new interface driver usbfs695worker2 # [ 0.018316] thermal_sys: Registered thermal governor 'fair_share'696client # [ 0.017358] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations697worker1 # [ 0.164650] usbcore: registered new interface driver hub698client # [ 0.017379] audit: initializing netlink subsys (disabled)699worker2 # [ 0.018318] thermal_sys: Registered thermal governor 'bang_bang'700worker1 # [ 0.164667] usbcore: registered new device driver usb701lb # [ 0.159757] iommu: Default domain type: Translated702worker2 # [ 0.018322] thermal_sys: Registered thermal governor 'step_wise'703client # [ 0.017940] thermal_sys: Registered thermal governor 'fair_share'704worker1 # [ 0.164905] pps_core: LinuxPPS API ver. 1 registered705lb # [ 0.159766] iommu: DMA domain TLB invalidation policy: strict mode706lb # [ 0.160148] SCSI subsystem initialized707client # [ 0.017941] thermal_sys: Registered thermal governor 'bang_bang'708worker2 # [ 0.018327] thermal_sys: Registered thermal governor 'user_space'709worker1 # [ 0.164911] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>710client # [ 0.017945] thermal_sys: Registered thermal governor 'step_wise'711worker1 # [ 0.164921] PTP clock support registered712worker1 # [ 0.164972] EDAC MC: Ver: 3.0.0713lb # [ 0.162064] usbcore: registered new interface driver usbfs714client # [ 0.017950] thermal_sys: Registered thermal governor 'user_space'715lb # [ 0.162097] usbcore: registered new interface driver hub716worker1 # [ 0.169538] scmi_core: SCMI protocol bus registered717lb # [ 0.162123] usbcore: registered new device driver usb718lb # [ 0.162397] pps_core: LinuxPPS API ver. 1 registered719worker1 # [ 0.170508] FPGA manager framework720worker1 # [ 0.171445] vgaarb: loaded721lb # [ 0.162403] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>722worker1 # [ 0.172067] clocksource: Switched to clocksource arch_sys_counter723lb # [ 0.162414] PTP clock support registered724lb # [ 0.162471] EDAC MC: Ver: 3.0.0725lb # [ 0.167105] scmi_core: SCMI protocol bus registered726lb # [ 0.168108] FPGA manager framework727lb # [ 0.169070] vgaarb: loaded728worker1 # [ 0.175741] VFS: Disk quotas dquot_6.6.0729lb # [ 0.169705] clocksource: Switched to clocksource arch_sys_counter730worker2 # [ 0.018329] thermal_sys: Registered thermal governor 'power_allocator'731worker1 # [ 0.175777] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)732worker2 # [ 0.018353] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1733client # [ 0.017953] thermal_sys: Registered thermal governor 'power_allocator'734worker2 # [ 0.018362] cpuidle: using governor ladder735worker2 # [ 0.018368] cpuidle: using governor menu736client # [ 0.017977] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1737worker2 # [ 0.018552] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.738client # [ 0.017985] cpuidle: using governor ladder739worker1 # [ 0.179451] netfs: FS-Cache loaded740client # [ 0.017991] cpuidle: using governor menu741worker2 # [ 0.018568] ASID allocator initialised with 65536 entries742worker1 # [ 0.179579] pnp: PnP ACPI: disabled743worker2 # [ 0.019780] Serial: AMBA PL011 UART driver744client # [ 0.018171] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.745client # [ 0.018187] ASID allocator initialised with 65536 entries746worker2 # [ 0.025035] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1747client # [ 0.019415] Serial: AMBA PL011 UART driver748worker2 # [ 0.025199] printk: console [ttyAMA0] enabled749lb # [ 0.175725] VFS: Disk quotas dquot_6.6.0750client # [ 0.024593] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1751lb # [ 0.175773] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)752worker2 # [ 0.145551] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages753client # [ 0.024713] printk: console [ttyAMA0] enabled754lb # [ 0.177399] netfs: FS-Cache loaded755worker2 # [ 0.145570] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page756worker1 # [ 0.183341] NET: Registered PF_INET protocol family757lb # [ 0.177527] pnp: PnP ACPI: disabled758client # [ 0.144765] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages759worker2 # [ 0.145575] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages760worker1 # [ 0.183609] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)761client # [ 0.144783] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page762worker2 # [ 0.145580] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page763client # [ 0.144788] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages764worker2 # [ 0.145584] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages765client # [ 0.144793] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page766worker2 # [ 0.145589] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page767client # [ 0.144797] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages768worker2 # [ 0.145594] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages769lb # [ 0.181481] NET: Registered PF_INET protocol family770client # [ 0.144802] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page771worker2 # [ 0.145598] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page772client # [ 0.144806] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages773client # [ 0.144810] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page774worker2 # [ 0.153120] fbcon: Taking over console775worker2 # [ 0.153136] ACPI: Interpreter disabled.776worker2 # [ 0.154954] iommu: Default domain type: Translated777lb # [ 0.182361] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)778client # [ 0.152219] fbcon: Taking over console779client # [ 0.152232] ACPI: Interpreter disabled.780worker2 # [ 0.154964] iommu: DMA domain TLB invalidation policy: strict mode781client # [ 0.154086] iommu: Default domain type: Translated782worker2 # [ 0.156704] SCSI subsystem initialized783client # [ 0.154095] iommu: DMA domain TLB invalidation policy: strict mode784client # [ 0.162599] SCSI subsystem initialized785worker2 # [ 0.164254] usbcore: registered new interface driver usbfs786worker2 # [ 0.164292] usbcore: registered new interface driver hub787client # [ 0.163284] usbcore: registered new interface driver usbfs788worker2 # [ 0.164310] usbcore: registered new device driver usb789worker2 # [ 0.164623] pps_core: LinuxPPS API ver. 1 registered790client # [ 0.163316] usbcore: registered new interface driver hub791client # [ 0.163341] usbcore: registered new device driver usb792worker2 # [ 0.164628] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>793client # [ 0.163642] pps_core: LinuxPPS API ver. 1 registered794worker2 # [ 0.164639] PTP clock support registered795worker2 # [ 0.164688] EDAC MC: Ver: 3.0.0796client # [ 0.163648] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>797client # [ 0.163658] PTP clock support registered798worker2 # [ 0.169380] scmi_core: SCMI protocol bus registered799client # [ 0.163699] EDAC MC: Ver: 3.0.0800worker2 # [ 0.170333] FPGA manager framework801client # [ 0.168411] scmi_core: SCMI protocol bus registered802worker2 # [ 0.171337] vgaarb: loaded803client # [ 0.169359] FPGA manager framework804client # [ 0.170388] vgaarb: loaded805worker2 # [ 0.171983] clocksource: Switched to clocksource arch_sys_counter806worker2 # [ 0.173459] VFS: Disk quotas dquot_6.6.0807client # [ 0.171033] clocksource: Switched to clocksource arch_sys_counter808worker2 # [ 0.173491] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)809client # [ 0.171616] VFS: Disk quotas dquot_6.6.0810worker2 # [ 0.175061] netfs: FS-Cache loaded811client # [ 0.171641] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)812worker2 # [ 0.175182] pnp: PnP ACPI: disabled813client # [ 0.174023] netfs: FS-Cache loaded814client # [ 0.174137] pnp: PnP ACPI: disabled815worker1 # [ 0.212596] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)816worker2 # [ 0.181302] NET: Registered PF_INET protocol family817worker1 # [ 0.212643] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)818worker2 # [ 0.181585] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)819worker1 # [ 0.212669] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)820client # [ 0.180086] NET: Registered PF_INET protocol family821worker1 # [ 0.212742] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)822client # [ 0.180364] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)823worker1 # [ 0.212885] TCP: Hash tables configured (established 16384 bind 16384)824lb # [ 0.210987] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)825worker1 # [ 0.212970] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)826lb # [ 0.211033] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)827worker1 # [ 0.213008] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)828lb # [ 0.211061] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)829worker1 # [ 0.213043] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)830lb # [ 0.211138] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)831worker1 # [ 0.213152] NET: Registered PF_UNIX/PF_LOCAL protocol family832lb # [ 0.211282] TCP: Hash tables configured (established 16384 bind 16384)833worker1 # [ 0.213175] NET: Registered PF_XDP protocol family834worker1 # [ 0.213194] PCI: CLS 0 bytes, default 64835lb # [ 0.211365] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)836worker1 # [ 0.213446] Trying to unpack rootfs image as initramfs...837lb # [ 0.211400] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)838lb # [ 0.211437] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)839lb # [ 0.211563] NET: Registered PF_UNIX/PF_LOCAL protocol family840lb # [ 0.211586] NET: Registered PF_XDP protocol family841lb # [ 0.211605] PCI: CLS 0 bytes, default 64842lb # [ 0.211839] Trying to unpack rootfs image as initramfs...843worker1 # [ 0.229984] kvm [1]: HYP mode not available844lb # [ 0.227413] kvm [1]: HYP mode not available845worker2 # [ 0.212243] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846worker2 # [ 0.212299] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847client # [ 0.209847] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)848worker2 # [ 0.212332] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)849client # [ 0.209901] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)850worker2 # [ 0.212422] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)851client # [ 0.209931] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)852worker2 # [ 0.212568] TCP: Hash tables configured (established 16384 bind 16384)853client # [ 0.210020] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)854worker2 # [ 0.212690] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)855client # [ 0.210163] TCP: Hash tables configured (established 16384 bind 16384)856worker2 # [ 0.212728] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)857client # [ 0.210254] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)858worker2 # [ 0.212766] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)859client # [ 0.210292] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)860worker2 # [ 0.212885] NET: Registered PF_UNIX/PF_LOCAL protocol family861client # [ 0.210328] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)862worker2 # [ 0.212908] NET: Registered PF_XDP protocol family863worker2 # [ 0.212927] PCI: CLS 0 bytes, default 64864client # [ 0.210443] NET: Registered PF_UNIX/PF_LOCAL protocol family865worker2 # [ 0.213174] Trying to unpack rootfs image as initramfs...866client # [ 0.210467] NET: Registered PF_XDP protocol family867client # [ 0.210486] PCI: CLS 0 bytes, default 64868client # [ 0.210736] Trying to unpack rootfs image as initramfs...869worker2 # [ 0.229919] kvm [1]: HYP mode not available870client # [ 0.228945] kvm [1]: HYP mode not available871worker1 # [ 0.327350] Initialise system trusted keyrings872worker1 # [ 0.328142] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker1 # [ 0.329458] squashfs: version 4.0 (2009/01/31) Phillip Lougher874lb # [ 0.324391] Initialise system trusted keyrings875lb # [ 0.325199] workingset: timestamp_bits=42 max_order=19 bucket_order=0876worker1 # [ 0.330276] 9p: Installing v9fs 9p2000 file system support877lb # [ 0.326615] squashfs: version 4.0 (2009/01/31) Phillip Lougher878lb # [ 0.327400] 9p: Installing v9fs 9p2000 file system support879lb # [ 0.347361] Key type asymmetric registered880lb # [ 0.347392] Asymmetric key parser 'x509' registered881worker1 # [ 0.354214] Key type asymmetric registered882worker1 # [ 0.354245] Asymmetric key parser 'x509' registered883lb # [ 0.347463] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)884worker1 # [ 0.354319] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)885lb # [ 0.353762] io scheduler mq-deadline registered886lb # [ 0.353784] io scheduler kyber registered887client # [ 0.324073] Initialise system trusted keyrings888worker1 # [ 0.360127] io scheduler mq-deadline registered889worker1 # [ 0.360147] io scheduler kyber registered890client # [ 0.324837] workingset: timestamp_bits=42 max_order=19 bucket_order=0891client # [ 0.326133] squashfs: version 4.0 (2009/01/31) Phillip Lougher892client # [ 0.326935] 9p: Installing v9fs 9p2000 file system support893worker2 # [ 0.332585] Initialise system trusted keyrings894worker2 # [ 0.333401] workingset: timestamp_bits=42 max_order=19 bucket_order=0895worker2 # [ 0.334673] squashfs: version 4.0 (2009/01/31) Phillip Lougher896lb # [ 0.365881] pl061_gpio 9030000.pl061: PL061 GPIO chip registered897worker2 # [ 0.335423] 9p: Installing v9fs 9p2000 file system support898lb # [ 0.367327] ledtrig-cpu: registered to indicate activity on CPUs899lb # [ 0.367740] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:900lb # [ 0.367766] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000901lb # [ 0.367779] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000902worker1 # [ 0.372229] pl061_gpio 9030000.pl061: PL061 GPIO chip registered903lb # [ 0.367787] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000904worker1 # [ 0.372892] ledtrig-cpu: registered to indicate activity on CPUs905lb # [ 0.367809] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits906worker1 # [ 0.373263] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:907lb # [ 0.367834] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]908worker1 # [ 0.373280] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000909lb # [ 0.367910] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00910lb # [ 0.367919] pci_bus 0000:00: root bus resource [bus 00-ff]911worker1 # [ 0.373292] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000912lb # [ 0.367925] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]913worker1 # [ 0.373301] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000914lb # [ 0.367930] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]915worker1 # [ 0.373323] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits916lb # [ 0.367936] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]917worker1 # [ 0.373349] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]918lb # [ 0.368032] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint919worker1 # [ 0.373432] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00920lb # [ 0.368468] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint921worker1 # [ 0.373441] pci_bus 0000:00: root bus resource [bus 00-ff]922lb # [ 0.368653] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]923worker1 # [ 0.373447] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]924lb # [ 0.368669] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]925worker1 # [ 0.373452] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]926lb # [ 0.368699] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]927worker1 # [ 0.373458] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]928lb # [ 0.368715] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]929lb # [ 0.369179] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint930worker1 # [ 0.373532] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint931lb # [ 0.369361] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]932worker1 # [ 0.373998] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint933lb # [ 0.369377] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]934worker1 # [ 0.374184] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]935lb # [ 0.369406] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]936worker1 # [ 0.374201] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]937client # [ 0.355591] Key type asymmetric registered938client # [ 0.355618] Asymmetric key parser 'x509' registered939worker1 # [ 0.374230] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]940worker1 # [ 0.374246] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]941client # [ 0.355692] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)942client # [ 0.357814] io scheduler mq-deadline registered943worker1 # [ 0.374699] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint944client # [ 0.357825] io scheduler kyber registered945worker1 # [ 0.374885] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]946worker1 # [ 0.374901] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]947worker1 # [ 0.374931] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]948worker1 # [ 0.375379] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint949worker1 # [ 0.375562] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]950worker2 # [ 0.364070] Key type asymmetric registered951worker2 # [ 0.364101] Asymmetric key parser 'x509' registered952worker1 # [ 0.375578] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]953worker2 # [ 0.364176] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)954worker1 # [ 0.375607] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]955worker2 # [ 0.366339] io scheduler mq-deadline registered956worker1 # [ 0.376062] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint957worker2 # [ 0.366352] io scheduler kyber registered958lb # [ 0.393967] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint959worker1 # [ 0.376269] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]960lb # [ 0.394180] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]961worker1 # [ 0.376285] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]962lb # [ 0.394197] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]963worker1 # [ 0.376318] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]964lb # [ 0.394227] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]965worker1 # [ 0.376777] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint966client # [ 0.367195] pl061_gpio 9030000.pl061: PL061 GPIO chip registered967lb # [ 0.394690] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint968worker1 # [ 0.376960] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]969lb # [ 0.394871] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]970worker1 # [ 0.376976] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]971lb # [ 0.394887] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]972worker1 # [ 0.377005] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]973lb # [ 0.394919] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]974worker1 # [ 0.377466] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint975client # [ 0.368628] ledtrig-cpu: registered to indicate activity on CPUs976lb # [ 0.395378] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint977worker1 # [ 0.377651] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]978lb # [ 0.395582] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]979client # [ 0.369051] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:980worker1 # [ 0.377666] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]981lb # [ 0.395598] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]982worker1 # [ 0.377696] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]983client # [ 0.369069] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000984lb # [ 0.395627] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]985worker1 # [ 0.378204] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint986client # [ 0.369083] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000987lb # [ 0.396092] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint988worker2 # [ 0.376118] pl061_gpio 9030000.pl061: PL061 GPIO chip registered989worker1 # [ 0.378391] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]990lb # [ 0.396275] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]991client # [ 0.369092] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000992worker1 # [ 0.378407] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]993lb # [ 0.396290] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]994worker1 # [ 0.378436] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]995client # [ 0.369119] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits996lb # [ 0.396320] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]997worker1 # [ 0.378452] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]998client # [ 0.369148] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]999lb # [ 0.396778] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1000worker1 # [ 0.378912] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1001worker2 # [ 0.377446] ledtrig-cpu: registered to indicate activity on CPUs1002client # [ 0.369230] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001003lb # [ 0.396961] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1004worker1 # [ 0.379102] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1005client # [ 0.369239] pci_bus 0000:00: root bus resource [bus 00-ff]1006worker2 # [ 0.377873] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1007lb # [ 0.396976] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1008worker1 # [ 0.379133] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1009client # [ 0.369245] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1010lb # [ 0.397006] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1011worker2 # [ 0.377892] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001012client # [ 0.369250] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1013worker1 # [ 0.379586] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1014lb # [ 0.397022] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1015worker2 # [ 0.377913] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001016worker1 # [ 0.379776] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1017client # [ 0.369256] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1018lb # [ 0.397516] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1019worker1 # [ 0.379806] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1020lb # [ 0.397701] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1021worker2 # [ 0.377923] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001022client # [ 0.369314] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1023worker2 # [ 0.377942] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1024client # [ 0.369760] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1025client # [ 0.369952] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1026worker2 # [ 0.377966] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1027client # [ 0.369969] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1028lb # [ 0.415666] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1029worker2 # [ 0.378057] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001030client # [ 0.369998] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1031worker2 # [ 0.378066] pci_bus 0000:00: root bus resource [bus 00-ff]1032lb # [ 0.416141] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1033client # [ 0.370015] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1034worker2 # [ 0.378072] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1035lb # [ 0.416334] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1036client # [ 0.370502] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1037worker2 # [ 0.378078] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1038lb # [ 0.416365] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1039client # [ 0.370688] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1040worker2 # [ 0.378082] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1041lb # [ 0.416766] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1042client # [ 0.370704] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1043lb # [ 0.416948] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1044worker2 # [ 0.378140] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1045client # [ 0.370734] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1046lb # [ 0.417193] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1047worker2 # [ 0.378578] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1048lb # [ 0.417488] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1049worker2 # [ 0.378764] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1050lb # [ 0.417505] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1051worker2 # [ 0.378780] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1052client # [ 0.389822] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1053lb # [ 0.417535] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1054client # [ 0.390011] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1055worker2 # [ 0.378812] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1056client # [ 0.390026] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1057worker2 # [ 0.378828] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1058worker1 # [ 0.428316] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1059client # [ 0.390056] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1060worker2 # [ 0.379284] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1061worker1 # [ 0.428517] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1062worker2 # [ 0.379467] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1063client # [ 0.390513] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1064worker1 # [ 0.428774] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1065worker2 # [ 0.379483] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1066client # [ 0.390695] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1067worker1 # [ 0.429073] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1068client # [ 0.390711] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1069worker2 # [ 0.379513] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1070worker1 # [ 0.429090] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1071client # [ 0.390743] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1072worker2 # [ 0.379969] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1073worker1 # [ 0.429120] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1074worker2 # [ 0.399865] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1075worker1 # [ 0.429583] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1076worker2 # [ 0.399886] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1077worker1 # [ 0.429770] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1078worker1 # [ 0.429799] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1079worker2 # [ 0.399916] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1080worker1 # [ 0.429829] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1081lb # [ 0.430076] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1082worker1 # [ 0.430429] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1083lb # [ 0.430272] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1084worker1 # [ 0.430440] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1085worker2 # [ 0.402580] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1086lb # [ 0.430289] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1087worker2 # [ 0.402767] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1088worker1 # [ 0.430446] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1089lb # [ 0.430317] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1090worker2 # [ 0.402783] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1091worker1 # [ 0.430492] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1092lb # [ 0.430906] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1093worker2 # [ 0.402816] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1094worker1 # [ 0.430539] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1095lb # [ 0.430917] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1096worker2 # [ 0.403280] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1097worker1 # [ 0.430587] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1098lb # [ 0.430923] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1099worker2 # [ 0.403464] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1100worker2 # [ 0.403481] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1101worker1 # [ 0.430634] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1102lb # [ 0.430969] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1103worker2 # [ 0.403510] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1104worker1 # [ 0.430682] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1105lb # [ 0.431016] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1106worker2 # [ 0.403957] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1107lb # [ 0.431063] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1108worker1 # [ 0.430731] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1109lb # [ 0.431110] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1110worker1 # [ 0.430779] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1111lb # [ 0.431160] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1112worker1 # [ 0.430828] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1113lb # [ 0.431207] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1114worker1 # [ 0.430882] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1115client # [ 0.403256] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1116client # [ 0.403454] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1117lb # [ 0.431254] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1118worker1 # [ 0.430956] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1119client # [ 0.403470] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1120worker1 # [ 0.431003] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1121lb # [ 0.431301] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1122client # [ 0.403500] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1123worker1 # [ 0.431025] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1124lb # [ 0.431350] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1125client # [ 0.403961] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1126worker1 # [ 0.431047] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1127lb # [ 0.431455] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1128client # [ 0.404145] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1129worker1 # [ 0.431069] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1130lb # [ 0.431512] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1131client # [ 0.404163] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1132worker1 # [ 0.431095] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1133lb # [ 0.431534] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1134client # [ 0.404192] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1135worker1 # [ 0.431117] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1136lb # [ 0.431556] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1137worker2 # [ 0.416177] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1138client # [ 0.404646] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1139worker1 # [ 0.431139] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1140worker2 # [ 0.416199] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1141lb # [ 0.431577] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1142client # [ 0.404835] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1143worker1 # [ 0.431160] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1144client # [ 0.404851] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1145worker2 # [ 0.416229] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1146lb # [ 0.431603] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1147worker1 # [ 0.431183] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1148lb # [ 0.431625] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1149client # [ 0.404883] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1150worker2 # [ 0.416700] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1151worker1 # [ 0.431205] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1152client # [ 0.404899] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1153lb # [ 0.431647] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1154worker2 # [ 0.416884] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1155worker1 # [ 0.431228] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1156worker2 # [ 0.416900] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1157lb # [ 0.431670] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1158client # [ 0.405407] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1159worker1 # [ 0.431251] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1160lb # [ 0.431692] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1161worker2 # [ 0.416929] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1162client # [ 0.405598] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1163worker1 # [ 0.431272] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1164worker2 # [ 0.416945] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1165lb # [ 0.431714] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1166client # [ 0.405627] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1167worker1 # [ 0.431297] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1168lb # [ 0.431737] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1169worker2 # [ 0.417402] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1170client # [ 0.406083] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1171worker1 # [ 0.431319] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1172worker2 # [ 0.417590] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1173lb # [ 0.431760] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1174client # [ 0.406271] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1175worker1 # [ 0.431340] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1176lb # [ 0.431781] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1177worker2 # [ 0.417619] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1178client # [ 0.406301] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1179worker1 # [ 0.431362] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1180lb # [ 0.431802] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1181worker1 # [ 0.431383] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1182worker2 # [ 0.418066] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1183client # [ 0.406698] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1184lb # [ 0.431824] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1185worker1 # [ 0.431405] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1186worker2 # [ 0.418250] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1187client # [ 0.406883] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1188lb # [ 0.431845] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1189worker1 # [ 0.431427] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1190worker2 # [ 0.418279] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1191lb # [ 0.431866] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1192client # [ 0.407141] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1193worker1 # [ 0.431450] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1194client # [ 0.407430] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1195lb # [ 0.431888] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1196worker2 # [ 0.418679] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1197worker1 # [ 0.431476] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1198client # [ 0.407447] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1199worker2 # [ 0.418861] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1200lb # [ 0.431909] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1201worker1 # [ 0.431486] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1202lb # [ 0.431931] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1203client # [ 0.407476] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1204worker2 # [ 0.419111] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1205worker1 # [ 0.431491] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1206lb # [ 0.431953] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1207worker2 # [ 0.419380] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1208client # [ 0.407950] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1209lb # [ 0.431980] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1210worker2 # [ 0.419397] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1211client # [ 0.408144] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1212lb # [ 0.431989] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1213worker2 # [ 0.419426] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1214client # [ 0.408160] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1215worker1 # [ 0.471271] pci 0000:00:0a.0: enabling device (0000 -> 0002)1216lb # [ 0.431994] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1217client # [ 0.408190] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1218worker2 # [ 0.419880] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1219lb # [ 0.433150] pci 0000:00:0a.0: enabling device (0000 -> 0002)1220client # [ 0.408764] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1221client # [ 0.408775] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1222client # [ 0.408780] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1223client # [ 0.408826] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1224client # [ 0.408876] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1225client # [ 0.408927] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1226client # [ 0.408973] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1227client # [ 0.409019] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1228client # [ 0.409066] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1229worker2 # [ 0.440124] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1230client # [ 0.409113] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1231worker2 # [ 0.440152] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1232client # [ 0.409160] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1233worker2 # [ 0.440182] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1234worker2 # [ 0.440824] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1235client # [ 0.409207] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1236worker2 # [ 0.440836] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1237client # [ 0.409284] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1238client # [ 0.409330] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1239worker2 # [ 0.440842] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1240client # [ 0.409352] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1241worker2 # [ 0.440889] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1242client # [ 0.409373] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1243worker2 # [ 0.440937] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1244client # [ 0.409395] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1245worker2 # [ 0.440985] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1246client # [ 0.409419] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1247worker2 # [ 0.441032] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1248client # [ 0.409441] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1249client # [ 0.409463] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1250worker2 # [ 0.441079] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1251client # [ 0.409485] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1252worker2 # [ 0.441127] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1253client # [ 0.409507] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1254worker2 # [ 0.441174] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1255client # [ 0.409529] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1256worker2 # [ 0.441222] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1257client # [ 0.409551] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1258worker2 # [ 0.441269] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1259client # [ 0.409574] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1260client # [ 0.409595] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1261worker2 # [ 0.441385] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1262worker1 # [ 0.495021] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1263client # [ 0.409617] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1264worker2 # [ 0.441432] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1265client # [ 0.409638] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1266worker2 # [ 0.441454] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1267client # [ 0.409660] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1268worker2 # [ 0.441475] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1269client # [ 0.409681] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1270worker2 # [ 0.441496] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1271client # [ 0.409703] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1272worker2 # [ 0.441520] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1273client # [ 0.409725] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1274worker2 # [ 0.441542] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1275client # [ 0.409747] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1276client # [ 0.409769] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1277worker2 # [ 0.441564] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1278client # [ 0.409795] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1279worker2 # [ 0.441585] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1280client # [ 0.409805] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1281worker2 # [ 0.441607] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1282client # [ 0.409810] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1283lb # [ 0.493850] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1284worker1 # [ 0.501362] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1285worker2 # [ 0.441629] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1286client # [ 0.410980] pci 0000:00:0a.0: enabling device (0000 -> 0002)1287lb # [ 0.495999] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1288worker2 # [ 0.441652] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1289worker1 # [ 0.503351] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1290worker2 # [ 0.441675] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1291worker2 # [ 0.441696] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1292worker2 # [ 0.441718] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1293worker2 # [ 0.441739] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1294worker2 # [ 0.441760] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1295worker2 # [ 0.441781] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1296worker2 # [ 0.441802] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1297worker2 # [ 0.441824] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1298worker2 # [ 0.441845] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1299client # [ 0.471161] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58775 usecs1300worker2 # [ 0.441867] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1301worker2 # [ 0.441893] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1302worker2 # [ 0.441903] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1303worker2 # [ 0.441908] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1304worker2 # [ 0.443058] pci 0000:00:0a.0: enabling device (0000 -> 0002)1305lb # [ 0.505940] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1306worker1 # [ 0.513597] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1307lb # [ 0.508716] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1308worker1 # [ 0.515604] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1309lb # [ 0.520025] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1310worker1 # [ 0.527294] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1311client # [ 0.491934] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1312client # [ 0.494078] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1313lb # [ 0.526326] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1314worker1 # [ 0.533418] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1315worker1 # [ 0.535555] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1316lb # [ 0.528411] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1317worker2 # [ 0.502359] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1318client # [ 0.504481] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1319client # [ 0.506549] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1320lb # [ 0.539112] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1321lb # [ 0.541162] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1322worker1 # [ 0.545861] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1323worker2 # [ 0.508712] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1324worker1 # [ 0.547928] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1325worker2 # [ 0.511102] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1326lb # [ 0.544640] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1327worker1 # [ 0.551857] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1328client # [ 0.516351] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1329client # [ 0.518417] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1330lb # [ 0.553354] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1331worker2 # [ 0.521586] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1332worker2 # [ 0.523760] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1333client # [ 0.529762] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1334worker2 # [ 0.535118] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1335client # [ 0.533026] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1336worker2 # [ 0.538391] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1337worker1 # [ 0.573577] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1338worker1 # [ 0.575556] msm_serial: driver initialized1339worker1 # [ 0.575705] SuperH (H)SCI(F) driver initialized1340worker1 # [ 0.575756] STM32 USART driver initialized1341lb # [ 0.570951] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1342lb # [ 0.572811] msm_serial: driver initialized1343lb # [ 0.572965] SuperH (H)SCI(F) driver initialized1344lb # [ 0.573022] STM32 USART driver initialized1345client # [ 0.543283] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1346worker2 # [ 0.544633] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1347client # [ 0.545224] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1348worker2 # [ 0.547933] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1349client # [ 0.555687] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1350client # [ 0.562212] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1351worker2 # [ 0.565590] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1352worker1 # [ 0.606650] loop: module loaded1353worker1 # [ 0.606857] virtio_blk virtio5: 1/0/0 default/read/poll queues1354worker2 # [ 0.568897] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1355worker1 # [ 0.607667] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1356client # [ 0.568324] msm_serial: driver initialized1357client # [ 0.568506] SuperH (H)SCI(F) driver initialized1358client # [ 0.568559] STM32 USART driver initialized1359lb # [ 0.608189] loop: module loaded1360lb # [ 0.608391] virtio_blk virtio5: 1/0/0 default/read/poll queues1361lb # [ 0.609183] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1362worker1 # [ 0.612720] megasas: 07.734.00.00-rc11363worker1 # [ 0.613415] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1364worker2 # [ 0.581288] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1365worker2 # [ 0.583980] msm_serial: driver initialized1366worker2 # [ 0.584715] SuperH (H)SCI(F) driver initialized1367worker2 # [ 0.584775] STM32 USART driver initialized1368lb # [ 0.622409] megasas: 07.734.00.00-rc11369worker1 # [ 0.633489] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001370lb # [ 0.623147] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1371worker1 # [ 0.633567] Intel/Sharp Extended Query Table at 0x00311372worker1 # [ 0.635254] Using buffer write method1373lb # [ 0.625212] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001374worker1 # [ 0.635352] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1375lb # [ 0.625267] Intel/Sharp Extended Query Table at 0x00311376lb # [ 0.627021] Using buffer write method1377lb # [ 0.627090] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1378lb # [ 0.629075] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001379lb # [ 0.629105] Intel/Sharp Extended Query Table at 0x00311380worker1 # [ 0.640512] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001381client # [ 0.603632] loop: module loaded1382worker1 # [ 0.640548] Intel/Sharp Extended Query Table at 0x00311383client # [ 0.603827] virtio_blk virtio5: 1/0/0 default/read/poll queues1384worker1 # [ 0.642657] Using buffer write method1385worker1 # [ 0.642687] Concatenating MTD devices:1386worker1 # [ 0.642691] (0): "0.flash"1387client # [ 0.604601] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1388worker1 # [ 0.642695] (1): "0.flash"1389worker1 # [ 0.642698] into device "0.flash"1390worker2 # [ 0.616656] loop: module loaded1391lb # [ 0.649338] Using buffer write method1392worker2 # [ 0.616895] virtio_blk virtio5: 1/0/0 default/read/poll queues1393lb # [ 0.649382] Concatenating MTD devices:1394lb # [ 0.649387] (0): "0.flash"1395lb # [ 0.649391] (1): "0.flash"1396worker2 # [ 0.617654] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1397lb # [ 0.649394] into device "0.flash"1398client # [ 0.611755] megasas: 07.734.00.00-rc11399client # [ 0.612479] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1400client # [ 0.615986] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001401client # [ 0.616012] Intel/Sharp Extended Query Table at 0x00311402client # [ 0.617852] Using buffer write method1403client # [ 0.617944] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1404worker2 # [ 0.624663] megasas: 07.734.00.00-rc11405worker2 # [ 0.625375] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1406worker2 # [ 0.627474] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001407worker2 # [ 0.627499] Intel/Sharp Extended Query Table at 0x00311408client # [ 0.631765] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001409client # [ 0.631827] Intel/Sharp Extended Query Table at 0x00311410client # [ 0.633358] Using buffer write method1411client # [ 0.633385] Concatenating MTD devices:1412client # [ 0.633389] (0): "0.flash"1413client # [ 0.633393] (1): "0.flash"1414worker2 # [ 0.637278] Using buffer write method1415client # [ 0.633397] into device "0.flash"1416worker2 # [ 0.637352] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1417worker2 # [ 0.639036] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001418worker2 # [ 0.639090] Intel/Sharp Extended Query Table at 0x00311419worker2 # [ 0.648954] Using buffer write method1420worker2 # [ 0.649011] Concatenating MTD devices:1421worker2 # [ 0.649015] (0): "0.flash"1422worker2 # [ 0.649020] (1): "0.flash"1423worker2 # [ 0.649023] into device "0.flash"1424worker1 # [ 0.902735] Freeing initrd memory: 26148K1425lb # [ 0.900905] Freeing initrd memory: 26140K1426worker1 # [ 0.908862] tun: Universal TUN/TAP device driver, 1.61427lb # [ 0.906929] tun: Universal TUN/TAP device driver, 1.61428worker1 # [ 0.912826] thunder_xcv, ver 1.01429worker1 # [ 0.912871] thunder_bgx, ver 1.01430worker1 # [ 0.912893] nicpf, ver 1.01431worker1 # [ 0.913423] e1000: Intel(R) PRO/1000 Network Driver1432worker1 # [ 0.913431] e1000: Copyright (c) 1999-2006 Intel Corporation.1433worker1 # [ 0.913456] e1000e: Intel(R) PRO/1000 Network Driver1434worker1 # [ 0.913465] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1435lb # [ 0.910810] thunder_xcv, ver 1.01436worker1 # [ 0.913498] igb: Intel(R) Gigabit Ethernet Network Driver1437lb # [ 0.910855] thunder_bgx, ver 1.01438lb # [ 0.910879] nicpf, ver 1.01439worker1 # [ 0.913503] igb: Copyright (c) 2007-2014 Intel Corporation.1440lb # [ 0.911437] e1000: Intel(R) PRO/1000 Network Driver1441worker1 # [ 0.913526] igbvf: Intel(R) Gigabit Virtual Function Network Driver1442lb # [ 0.911445] e1000: Copyright (c) 1999-2006 Intel Corporation.1443worker1 # [ 0.913531] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1444lb # [ 0.911470] e1000e: Intel(R) PRO/1000 Network Driver1445worker1 # [ 0.913660] sky2: driver version 1.301446lb # [ 0.911479] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1447worker1 # [ 0.915204] usbcore: registered new interface driver usb-storage1448lb # [ 0.911523] igb: Intel(R) Gigabit Ethernet Network Driver1449worker1 # [ 0.915310] usbcore: registered new interface driver usbserial_generic1450lb # [ 0.911529] igb: Copyright (c) 2007-2014 Intel Corporation.1451worker1 # [ 0.915323] usbserial: USB Serial support registered for generic1452lb # [ 0.911553] igbvf: Intel(R) Gigabit Virtual Function Network Driver1453worker1 # [ 0.915887] hv_vmbus: registering driver hyperv_keyboard1454lb # [ 0.911559] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1455worker1 # [ 0.916833] ehci-pci 0000:00:0a.0: EHCI Host Controller1456lb # [ 0.911695] sky2: driver version 1.301457worker1 # [ 0.916865] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11458lb # [ 0.913311] usbcore: registered new interface driver usb-storage1459client # [ 0.889094] Freeing initrd memory: 26160K1460lb # [ 0.913424] usbcore: registered new interface driver usbserial_generic1461worker1 # [ 0.917092] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001462lb # [ 0.913440] usbserial: USB Serial support registered for generic1463worker1 # [ 0.928829] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001464lb # [ 0.914477] ehci-pci 0000:00:0a.0: EHCI Host Controller1465worker1 # [ 0.929206] hub 1-0:1.0: USB hub found1466worker1 # [ 0.929221] hub 1-0:1.0: 6 ports detected1467lb # [ 0.914504] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11468lb # [ 0.914756] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001469lb # [ 0.926413] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001470worker1 # [ 0.932731] rtc-pl031 9010000.pl031: registered as rtc01471lb # [ 0.926792] hub 1-0:1.0: USB hub found1472lb # [ 0.926849] hub 1-0:1.0: 6 ports detected1473client # [ 0.895165] tun: Universal TUN/TAP device driver, 1.61474worker1 # [ 0.932761] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:00:25 UTC (1789894825)1475worker1 # [ 0.933060] i2c_dev: i2c /dev entries driver1476lb # [ 0.929451] hv_vmbus: registering driver hyperv_keyboard1477client # [ 0.898968] thunder_xcv, ver 1.01478lb # [ 0.931056] rtc-pl031 9010000.pl031: registered as rtc01479client # [ 0.899015] thunder_bgx, ver 1.01480lb # [ 0.931085] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:00:25 UTC (1789894825)1481lb # [ 0.931397] i2c_dev: i2c /dev entries driver1482worker1 # [ 0.938046] sdhci: Secure Digital Host Controller Interface driver1483worker1 # [ 0.938055] sdhci: Copyright(c) Pierre Ossman1484worker1 # [ 0.938313] Synopsys Designware Multimedia Card Interface Driver1485worker1 # [ 0.938677] sdhci-pltfm: SDHCI platform and OF driver helper1486worker2 # [ 0.903519] Freeing initrd memory: 26148K1487client # [ 0.899935] nicpf, ver 1.01488client # [ 0.900507] e1000: Intel(R) PRO/1000 Network Driver1489worker1 # [ 0.943122] hid: raw HID events driver (C) Jiri Kosina1490lb # [ 0.936387] sdhci: Secure Digital Host Controller Interface driver1491client # [ 0.900514] e1000: Copyright (c) 1999-2006 Intel Corporation.1492lb # [ 0.936399] sdhci: Copyright(c) Pierre Ossman1493worker1 # [ 0.943364] usbcore: registered new interface driver usbhid1494worker1 # [ 0.943371] usbhid: USB HID core driver1495client # [ 0.900538] e1000e: Intel(R) PRO/1000 Network Driver1496lb # [ 0.936679] Synopsys Designware Multimedia Card Interface Driver1497client # [ 0.900549] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1498lb # [ 0.937064] sdhci-pltfm: SDHCI platform and OF driver helper1499client # [ 0.900577] igb: Intel(R) Gigabit Ethernet Network Driver1500worker2 # [ 0.909504] tun: Universal TUN/TAP device driver, 1.61501client # [ 0.900583] igb: Copyright (c) 2007-2014 Intel Corporation.1502lb # [ 0.941468] hid: raw HID events driver (C) Jiri Kosina1503client # [ 0.900605] igbvf: Intel(R) Gigabit Virtual Function Network Driver1504worker1 # [ 0.946192] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1505client # [ 0.900612] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1506client # [ 0.900745] sky2: driver version 1.301507worker1 # [ 0.947656] drop_monitor: Initializing network drop monitor service1508lb # [ 0.942362] usbcore: registered new interface driver usbhid1509client # [ 0.902330] usbcore: registered new interface driver usb-storage1510worker1 # [ 0.947838] NET: Registered PF_INET6 protocol family1511lb # [ 0.942372] usbhid: USB HID core driver1512client # [ 0.902473] usbcore: registered new interface driver usbserial_generic1513worker1 # [ 0.950952] Segment Routing with IPv61514worker1 # [ 0.950972] In-situ OAM (IOAM) with IPv61515client # [ 0.902488] usbserial: USB Serial support registered for generic1516client # [ 0.903788] ehci-pci 0000:00:0a.0: EHCI Host Controller1517worker1 # [ 0.951002] NET: Registered PF_PACKET protocol family1518lb # [ 0.944641] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1519client # [ 0.903813] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11520client # [ 0.904110] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001521lb # [ 0.947285] drop_monitor: Initializing network drop monitor service1522worker2 # [ 0.913255] thunder_xcv, ver 1.01523worker2 # [ 0.913298] thunder_bgx, ver 1.01524lb # [ 0.947475] NET: Registered PF_INET6 protocol family1525worker2 # [ 0.913322] nicpf, ver 1.01526client # [ 0.914901] hv_vmbus: registering driver hyperv_keyboard1527worker2 # [ 0.913862] e1000: Intel(R) PRO/1000 Network Driver1528lb # [ 0.949443] Segment Routing with IPv61529client # [ 0.915084] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001530worker1 # [ 0.952874] 9pnet: Installing 9P2000 support1531worker2 # [ 0.913870] e1000: Copyright (c) 1999-2006 Intel Corporation.1532lb # [ 0.949460] In-situ OAM (IOAM) with IPv61533client # [ 0.915414] hub 1-0:1.0: USB hub found1534worker1 # [ 0.955054] Key type dns_resolver registered1535worker2 # [ 0.913893] e1000e: Intel(R) PRO/1000 Network Driver1536lb # [ 0.949491] NET: Registered PF_PACKET protocol family1537client # [ 0.915435] hub 1-0:1.0: 6 ports detected1538worker2 # [ 0.913901] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1539worker2 # [ 0.913933] igb: Intel(R) Gigabit Ethernet Network Driver1540client # [ 0.918782] rtc-pl031 9010000.pl031: registered as rtc01541worker2 # [ 0.913939] igb: Copyright (c) 2007-2014 Intel Corporation.1542worker2 # [ 0.913962] igbvf: Intel(R) Gigabit Virtual Function Network Driver1543client # [ 0.918810] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:00:25 UTC (1789894825)1544lb # [ 0.951275] 9pnet: Installing 9P2000 support1545worker2 # [ 0.913968] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1546lb # [ 0.953503] Key type dns_resolver registered1547worker2 # [ 0.914097] sky2: driver version 1.301548client # [ 0.920932] i2c_dev: i2c /dev entries driver1549worker2 # [ 0.915670] usbcore: registered new interface driver usb-storage1550worker2 # [ 0.915787] usbcore: registered new interface driver usbserial_generic1551worker2 # [ 0.915801] usbserial: USB Serial support registered for generic1552worker2 # [ 0.916772] ehci-pci 0000:00:0a.0: EHCI Host Controller1553worker1 # [ 0.961746] registered taskstats version 11554worker2 # [ 0.916798] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11555worker1 # [ 0.961986] Loading compiled-in X.509 certificates1556worker2 # [ 0.917033] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001557client # [ 0.924160] sdhci: Secure Digital Host Controller Interface driver1558worker2 # [ 0.928708] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001559client # [ 0.924170] sdhci: Copyright(c) Pierre Ossman1560worker2 # [ 0.929043] hub 1-0:1.0: USB hub found1561worker2 # [ 0.929116] hub 1-0:1.0: 6 ports detected1562client # [ 0.924435] Synopsys Designware Multimedia Card Interface Driver1563lb # [ 0.960668] registered taskstats version 11564lb # [ 0.960833] Loading compiled-in X.509 certificates1565client # [ 0.924808] sdhci-pltfm: SDHCI platform and OF driver helper1566client # [ 0.926479] hid: raw HID events driver (C) Jiri Kosina1567worker2 # [ 0.931618] hv_vmbus: registering driver hyperv_keyboard1568client # [ 0.926722] usbcore: registered new interface driver usbhid1569client # [ 0.926728] usbhid: USB HID core driver1570worker1 # [ 0.970682] Demotion targets for Node 0: null1571worker2 # [ 0.933211] rtc-pl031 9010000.pl031: registered as rtc01572worker1 # [ 0.970793] Key type .fscrypt registered1573worker1 # [ 0.970800] Key type fscrypt-provisioning registered1574worker2 # [ 0.933241] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:00:25 UTC (1789894825)1575worker1 # [ 0.970895] ima: No TPM chip found, activating TPM-bypass!1576worker2 # [ 0.933578] i2c_dev: i2c /dev entries driver1577worker1 # [ 0.970914] ima: Allocated hash algorithm: sha11578worker1 # [ 0.970936] ima: No architecture policies found1579client # [ 0.932385] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1580client # [ 0.933883] drop_monitor: Initializing network drop monitor service1581worker1 # [ 0.975177] input: gpio-keys as /devices/platform/gpio-keys/input/input01582client # [ 0.934068] NET: Registered PF_INET6 protocol family1583lb # [ 0.969388] Demotion targets for Node 0: null1584lb # [ 0.969502] Key type .fscrypt registered1585client # [ 0.937442] Segment Routing with IPv61586lb # [ 0.969509] Key type fscrypt-provisioning registered1587worker2 # [ 0.938430] sdhci: Secure Digital Host Controller Interface driver1588client # [ 0.937469] In-situ OAM (IOAM) with IPv61589worker2 # [ 0.938443] sdhci: Copyright(c) Pierre Ossman1590lb # [ 0.969608] ima: No TPM chip found, activating TPM-bypass!1591client # [ 0.937497] NET: Registered PF_PACKET protocol family1592lb # [ 0.969627] ima: Allocated hash algorithm: sha11593worker2 # [ 0.938706] Synopsys Designware Multimedia Card Interface Driver1594lb # [ 0.969647] ima: No architecture policies found1595worker2 # [ 0.939074] sdhci-pltfm: SDHCI platform and OF driver helper1596lb # [ 0.973930] input: gpio-keys as /devices/platform/gpio-keys/input/input01597worker2 # [ 0.943443] hid: raw HID events driver (C) Jiri Kosina1598worker2 # [ 0.943676] usbcore: registered new interface driver usbhid1599worker2 # [ 0.943683] usbhid: USB HID core driver1600client # [ 0.939309] 9pnet: Installing 9P2000 support1601client # [ 0.941477] Key type dns_resolver registered1602worker2 # [ 0.946587] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1603worker2 # [ 0.949202] drop_monitor: Initializing network drop monitor service1604worker2 # [ 0.949359] NET: Registered PF_INET6 protocol family1605worker2 # [ 0.951348] Segment Routing with IPv61606worker2 # [ 0.951367] In-situ OAM (IOAM) with IPv61607worker2 # [ 0.951395] NET: Registered PF_PACKET protocol family1608client # [ 0.948500] registered taskstats version 11609client # [ 0.948643] Loading compiled-in X.509 certificates1610worker2 # [ 0.953293] 9pnet: Installing 9P2000 support1611worker2 # [ 0.955457] Key type dns_resolver registered1612worker1 # [ 0.992838] clk: Disabling unused clocks1613worker1 # [ 0.992873] PM: genpd: Disabling unused power domains1614client # [ 0.957405] Demotion targets for Node 0: null1615worker1 # [ 0.997193] Freeing unused kernel memory: 4736K1616client # [ 0.957520] Key type .fscrypt registered1617worker1 # [ 0.997368] Run /init as init process1618client # [ 0.957527] Key type fscrypt-provisioning registered1619client # [ 0.957624] ima: No TPM chip found, activating TPM-bypass!1620client # [ 0.957645] ima: Allocated hash algorithm: sha11621lb # [ 0.991333] clk: Disabling unused clocks1622client # [ 0.957670] ima: No architecture policies found1623lb # [ 0.991366] PM: genpd: Disabling unused power domains1624worker2 # [ 0.962246] registered taskstats version 11625client # [ 0.961832] input: gpio-keys as /devices/platform/gpio-keys/input/input01626worker2 # [ 0.962389] Loading compiled-in X.509 certificates1627lb # [ 0.995674] Freeing unused kernel memory: 4736K1628lb # [ 0.995856] Run /init as init process1629worker2 # [ 0.971171] Demotion targets for Node 0: null1630worker2 # [ 0.971285] Key type .fscrypt registered1631worker2 # [ 0.971292] Key type fscrypt-provisioning registered1632worker2 # [ 0.971398] ima: No TPM chip found, activating TPM-bypass!1633worker2 # [ 0.971417] ima: Allocated hash algorithm: sha11634worker2 # [ 0.971439] ima: No architecture policies found1635worker2 # [ 0.975625] input: gpio-keys as /devices/platform/gpio-keys/input/input01636worker1 # [ 1.014473] systemd[1]: Successfully made /usr/ read-only.1637lb # [ 1.012044] systemd[1]: Successfully made /usr/ read-only.1638client # [ 0.979323] clk: Disabling unused clocks1639client # [ 0.979354] PM: genpd: Disabling unused power domains1640client # [ 0.983634] Freeing unused kernel memory: 4736K1641client # [ 0.983835] Run /init as init process1642worker2 # [ 0.993679] clk: Disabling unused clocks1643worker2 # [ 0.993717] PM: genpd: Disabling unused power domains1644worker2 # [ 0.998020] Freeing unused kernel memory: 4736K1645worker2 # [ 0.998226] Run /init as init process1646client # [ 1.001386] systemd[1]: Successfully made /usr/ read-only.1647worker2 # [ 1.014326] systemd[1]: Successfully made /usr/ read-only.1648worker1 # [ 1.176098] usb 1-1: new high-speed USB device number 2 using ehci-pci1649lb # [ 1.173757] usb 1-1: new high-speed USB device number 2 using ehci-pci1650client # [ 1.163100] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker2 # [ 1.176093] usb 1-1: new high-speed USB device number 2 using ehci-pci1652lb # [ 1.323559] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653worker1 # [ 1.328519] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11654client # [ 1.312944] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11655lb # [ 1.346733] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1656lb # [ 1.351735] systemd[1]: Detected virtualization qemu.1657lb # [ 1.352577] systemd[1]: Detected architecture arm64.1658lb # [ 1.353363] systemd[1]: Running in initrd.1659worker1 # [ 1.349446] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1660lb # [ 1.354567] systemd[1]: Initializing machine ID from random generator.1661lb # [ 1.355716] systemd[1]: Hostname set to <lb>.1662worker1 # [ 1.361519] systemd[1]: Detected virtualization qemu.1663worker1 # [ 1.363629] systemd[1]: Detected architecture arm64.1664worker1 # [ 1.365632] systemd[1]: Running in initrd.1665worker1 # [ 1.368389] systemd[1]: Initializing machine ID from random generator.1666worker2 # [ 1.328487] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11667worker1 # [ 1.371290] systemd[1]: Hostname set to <worker1>.1668client # [ 1.336131] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1669client # [ 1.341306] systemd[1]: Detected virtualization qemu.1670client # [ 1.342167] systemd[1]: Detected architecture arm64.1671client # [ 1.343002] systemd[1]: Running in initrd.1672client # [ 1.344219] systemd[1]: Initializing machine ID from random generator.1673client # [ 1.345455] systemd[1]: Hostname set to <client>.1674worker2 # [ 1.349212] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1675worker2 # [ 1.361444] systemd[1]: Detected virtualization qemu.1676worker2 # [ 1.363425] systemd[1]: Detected architecture arm64.1677worker2 # [ 1.365426] systemd[1]: Running in initrd.1678worker2 # [ 1.368094] systemd[1]: Initializing machine ID from random generator.1679worker2 # [ 1.370957] systemd[1]: Hostname set to <worker2>.1680lb # [ 1.417967] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681worker1 # [ 1.424364] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682client # [ 1.407259] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker2 # [ 1.416318] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01684lb # [ 1.537774] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker1 # [ 1.548140] usb 1-2: new high-speed USB device number 3 using ehci-pci1686client # [ 1.527122] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker2 # [ 1.540086] usb 1-2: new high-speed USB device number 3 using ehci-pci1688lb # [ 1.620161] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689client # [ 1.630625] systemd[1]: bpf-restrict-fs: LSM BPF program attached1690lb # [ 1.680341] systemd[1]: Queued start job for default target Initrd Default Target.1691lb # [ 1.685413] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21692worker1 # [ 1.692353] systemd[1]: bpf-restrict-fs: LSM BPF program attached1693lb # [ 1.687532] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01694lb # [ 1.691901] systemd[1]: Created slice Slice /system/modprobe.1695lb # [ 1.692918] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1696lb # [ 1.694033] systemd[1]: Expecting device /dev/disk/by-label/nixos...1697lb # [ 1.694980] systemd[1]: Reached target Path Units.1698lb # [ 1.695665] systemd[1]: Reached target Slice Units.1699lb # [ 1.696468] systemd[1]: Reached target Swaps.1700lb # [ 1.697153] systemd[1]: Reached target Timer Units.1701lb # [ 1.698030] systemd[1]: Listening on D-Bus System Message Bus Socket.1702lb # [ 1.699060] systemd[1]: Listening on Journal Socket (/dev/log).1703lb # [ 1.699977] systemd[1]: Listening on Journal Sockets.1704lb # [ 1.700096] systemd[1]: Listening on udev Control Socket.1705lb # [ 1.700198] systemd[1]: Listening on udev Kernel Socket.1706lb # [ 1.700217] systemd[1]: Reached target Socket Units.1707lb # [ 1.704473] systemd[1]: Starting Create List of Static Device Nodes...1708worker1 # [ 1.708467] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21709worker1 # [ 1.714094] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01710worker2 # [ 1.679797] systemd[1]: bpf-restrict-fs: LSM BPF program attached1711lb # [ 1.714754] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1712lb # [ 1.714835] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1713client # [ 1.683189] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21714client # [ 1.687233] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01715lb # [ 1.725884] systemd[1]: Mounting Kernel Configuration File System...1716worker2 # [ 1.700680] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21717lb # [ 1.741972] systemd[1]: Starting Journal Service...1718worker2 # [ 1.708295] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01719lb # [ 1.752515] systemd[1]: Starting Load Kernel Modules...1720lb # [ 1.753423] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1721client # [ 1.729687] systemd[1]: Queued start job for default target Initrd Default Target.1722lb # [ 1.762971] systemd[1]: Starting Coldplug All udev Devices...1723client # [ 1.742322] systemd[1]: Created slice Slice /system/modprobe.1724client # [ 1.743704] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1725client # [ 1.745079] systemd[1]: Expecting device /dev/disk/by-label/nixos...1726client # [ 1.746201] systemd[1]: Reached target Path Units.1727client # [ 1.747113] systemd[1]: Reached target Slice Units.1728client # [ 1.747983] systemd[1]: Reached target Swaps.1729client # [ 1.748836] systemd[1]: Reached target Timer Units.1730client # [ 1.749913] systemd[1]: Listening on D-Bus System Message Bus Socket.1731client # [ 1.751244] systemd[1]: Listening on Journal Socket (/dev/log).1732client # [ 1.752432] systemd[1]: Listening on Journal Sockets.1733client # [ 1.753470] systemd[1]: Listening on udev Control Socket.1734client # [ 1.754555] systemd[1]: Listening on udev Kernel Socket.1735lb # [ 1.785894] systemd[1]: Finished Create List of Static Device Nodes.1736client # [ 1.755551] systemd[1]: Reached target Socket Units.1737lb # [ 1.786826] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1738lb # [ 1.787123] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1739lb # [ 1.787363] systemd[1]: Mounted Kernel Configuration File System.1740client # [ 1.758100] systemd[1]: Starting Create List of Static Device Nodes...1741lb # [ 1.794659] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1742worker1 # [ 1.805762] systemd[1]: Queued start job for default target Initrd Default Target.1743client # [ 1.767236] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1744client # [ 1.767327] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1745lb # [ 1.804162] systemd-journald[73]: Collecting audit messages is disabled.1746worker1 # [ 1.814427] systemd[1]: Created slice Slice /system/modprobe.1747client # [ 1.775310] systemd[1]: Mounting Kernel Configuration File System...1748worker1 # [ 1.815639] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1749worker1 # [ 1.817038] systemd[1]: Expecting device /dev/disk/by-label/nixos...1750worker1 # [ 1.818096] systemd[1]: Reached target Path Units.1751worker1 # [ 1.818888] systemd[1]: Reached target Slice Units.1752lb # [ 1.812071] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1753worker1 # [ 1.819702] systemd[1]: Reached target Swaps.1754worker1 # [ 1.820476] systemd[1]: Reached target Timer Units.1755worker1 # [ 1.821461] systemd[1]: Listening on D-Bus System Message Bus Socket.1756worker1 # [ 1.822677] systemd[1]: Listening on Journal Socket (/dev/log).1757worker1 # [ 1.823837] systemd[1]: Listening on Journal Sockets.1758worker1 # [ 1.824907] systemd[1]: Listening on udev Control Socket.1759worker1 # [ 1.825021] systemd[1]: Listening on udev Kernel Socket.1760worker1 # [ 1.825044] systemd[1]: Reached target Socket Units.1761worker1 # [ 1.829302] systemd[1]: Starting Create List of Static Device Nodes...1762worker2 # [ 1.793814] systemd[1]: Queued start job for default target Initrd Default Target.1763client # [ 1.791479] systemd[1]: Starting Journal Service...1764lb # [ 1.825815] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1765worker1 # [ 1.839383] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1766worker2 # [ 1.802477] systemd[1]: Created slice Slice /system/modprobe.1767worker2 # [ 1.803755] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1768worker2 # [ 1.805221] systemd[1]: Expecting device /dev/disk/by-label/nixos...1769worker1 # [ 1.840646] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1770worker2 # [ 1.806415] systemd[1]: Reached target Path Units.1771worker1 # [ 1.844068] systemd[1]: Mounting Kernel Configuration File System...1772worker2 # [ 1.807244] systemd[1]: Reached target Slice Units.1773worker2 # [ 1.808163] systemd[1]: Reached target Swaps.1774lb # [ 1.838066] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01775worker2 # [ 1.808947] systemd[1]: Reached target Timer Units.1776lb # [ 1.838310] [drm] features: -virgl +edid -resource_blob -host_visible1777lb # [ 1.838319] [drm] features: -context_init1778lb # [ 1.839056] [drm] number of scanouts: 11779worker2 # [ 1.810014] systemd[1]: Listening on D-Bus System Message Bus Socket.1780lb # [ 1.839074] [drm] number of cap sets: 01781worker2 # [ 1.811326] systemd[1]: Listening on Journal Socket (/dev/log).1782worker2 # [ 1.812510] systemd[1]: Listening on Journal Sockets.1783worker2 # [ 1.813557] systemd[1]: Listening on udev Control Socket.1784client # [ 1.811523] systemd[1]: Starting Load Kernel Modules...1785worker2 # [ 1.814614] systemd[1]: Listening on udev Kernel Socket.1786client # [ 1.812447] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1787worker2 # [ 1.815551] systemd[1]: Reached target Socket Units.1788worker1 # [ 1.855045] systemd[1]: Starting Journal Service...1789worker2 # [ 1.818213] systemd[1]: Starting Create List of Static Device Nodes...1790client # [ 1.822622] systemd[1]: Starting Coldplug All udev Devices...1791worker2 # [ 1.825423] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1792worker2 # [ 1.826599] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1793lb # [ 1.862035] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1794worker2 # [ 1.836183] systemd[1]: Mounting Kernel Configuration File System...1795lb # [ 1.862062] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01796client # [ 1.839362] systemd[1]: Finished Create List of Static Device Nodes.1797client # [ 1.840463] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1798client # [ 1.840751] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1799worker2 # [ 1.846090] systemd[1]: Starting Journal Service...1800client # [ 1.840974] systemd[1]: Mounted Kernel Configuration File System.1801worker1 # [ 1.884324] systemd[1]: Starting Load Kernel Modules...1802worker1 # [ 1.885173] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1803lb # [ 1.878412] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1804lb # [ 1.881135] systemd[1]: Starting Create Static Device Nodes in /dev...1805client # [ 1.851547] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1806lb # [ 1.889423] Console: switching to colour frame buffer device 160x501807worker1 # [ 1.903547] systemd[1]: Starting Coldplug All udev Devices...1808worker1 # [ 1.905067] systemd-journald[73]: Collecting audit messages is disabled.1809worker2 # [ 1.875715] systemd[1]: Starting Load Kernel Modules...1810worker1 # [ 1.913745] systemd[1]: Finished Create List of Static Device Nodes.1811worker2 # [ 1.876967] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1812worker1 # [ 1.914531] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1813client # [ 1.877213] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1814worker1 # [ 1.920243] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1815client # [ 1.882253] systemd-journald[73]: Collecting audit messages is disabled.1816worker1 # [ 1.920667] systemd[1]: Mounted Kernel Configuration File System.1817lb # [ 1.922534] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1818worker2 # [ 1.894229] systemd[1]: Starting Coldplug All udev Devices...1819worker2 # [ 1.898342] systemd-journald[73]: Collecting audit messages is disabled.1820worker1 # [ 1.934740] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1821client # [ 1.903036] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1822lb # [ 1.935588] systemd[1]: Finished Load Kernel Modules.1823lb # [ 1.939081] systemd[1]: Starting Apply Kernel Variables...1824worker2 # [ 1.909327] systemd[1]: Finished Create List of Static Device Nodes.1825worker2 # [ 1.911015] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1826client # [ 1.907745] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1827client # [ 1.910392] systemd[1]: Starting Create Static Device Nodes in /dev...1828lb # [ 1.954026] systemd[1]: Finished Create Static Device Nodes in /dev.1829lb # [ 1.956504] systemd[1]: Reached target Preparation for Local File Systems.1830lb # [ 1.956551] systemd[1]: Reached target Local File Systems.1831client # [ 1.925310] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01832client # [ 1.925552] [drm] features: -virgl +edid -resource_blob -host_visible1833client # [ 1.925563] [drm] features: -context_init1834client # [ 1.926269] [drm] number of scanouts: 11835worker2 # [ 1.928948] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1836client # [ 1.926286] [drm] number of cap sets: 01837worker2 # [ 1.929382] systemd[1]: Mounted Kernel Configuration File System.1838worker1 # [ 1.970031] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1839worker2 # [ 1.936367] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1840lb # [ 1.970080] systemd[1]: Starting Rule-based Manager for Device Events and Files...1841client # [ 1.935746] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1842worker1 # [ 1.981782] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1843client # [ 1.935770] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01844worker1 # [ 1.984446] systemd[1]: Starting Create Static Device Nodes in /dev...1845lb # [ 1.978179] systemd-modules-load[74]: Inserted module 'dm_mod'1846worker1 # [ 1.992211] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1847worker1 # [ 1.996927] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01848worker1 # [ 1.997169] [drm] features: -virgl +edid -resource_blob -host_visible1849lb # [ 1.993096] systemd[1]: Started Journal Service.1850worker1 # [ 1.997177] [drm] features: -context_init1851worker1 # [ 1.997909] [drm] number of scanouts: 11852worker1 # [ 1.997927] [drm] number of cap sets: 01853lb # [ 1.984669] systemd-modules-load[74]: Module 'virtio_balloon' is built in1854lb # [ 1.996414] systemd-modules-load[74]: Module 'virtio_console' is built in1855client # [ 1.967724] systemd[1]: Finished Create Static Device Nodes in /dev.1856worker2 # [ 1.979064] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1857client # [ 1.967936] systemd[1]: Reached target Preparation for Local File Systems.1858lb # [ 1.997545] systemd-modules-load[74]: Inserted module 'virtio_gpu'1859client # [ 1.967962] systemd[1]: Reached target Local File Systems.1860client # [ 1.969453] Console: switching to colour frame buffer device 160x501861client # [ 1.976136] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1862lb # [ 2.001978] systemd-modules-load[74]: Module 'virtio_rng' is built in1863client # [ 1.981435] systemd[1]: Starting Rule-based Manager for Device Events and Files...1864worker2 # [ 1.988047] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1865worker1 # [ 2.024973] systemd[1]: Finished Create Static Device Nodes in /dev.1866worker1 # [ 2.025363] systemd[1]: Reached target Preparation for Local File Systems.1867lb # [ 2.008268] systemd[1]: Finished Apply Kernel Variables.1868worker1 # [ 2.025391] systemd[1]: Reached target Local File Systems.1869lb # [ 2.013772] systemd[1]: Starting Create System Files and Directories...1870worker2 # [ 1.996971] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01871worker2 # [ 1.997219] [drm] features: -virgl +edid -resource_blob -host_visible1872worker1 # [ 2.029166] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1873worker2 # [ 1.997229] [drm] features: -context_init1874worker2 # [ 1.998058] [drm] number of scanouts: 11875worker1 # [ 2.029191] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01876worker2 # [ 1.998076] [drm] number of cap sets: 01877worker2 # [ 2.002099] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1878worker1 # [ 2.038598] systemd[1]: Starting Rule-based Manager for Device Events and Files...1879client # [ 2.011327] systemd[1]: Finished Load Kernel Modules.1880worker2 # [ 2.013014] systemd[1]: Starting Create Static Device Nodes in /dev...1881client # [ 2.014970] systemd[1]: Starting Apply Kernel Variables...1882worker2 # [ 2.017320] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1883worker2 # [ 2.017344] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01884worker1 # [ 2.057184] Console: switching to colour frame buffer device 160x501885lb # [ 2.049194] systemd[1]: Finished Create System Files and Directories.1886lb # [ 2.060687] systemd-udevd[81]: Using default interface naming scheme 'v261'.1887worker2 # [ 2.048669] Console: switching to colour frame buffer device 160x501888worker1 # [ 2.096697] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1889client # [ 2.063563] systemd[1]: Finished Apply Kernel Variables.1890lb # [ 2.085014] systemd[1]: Started Rule-based Manager for Device Events and Files.1891worker1 # [ 2.105439] systemd[1]: Finished Load Kernel Modules.1892worker1 # [ 2.094451] systemd-modules-load[74]: Inserted module 'dm_mod'1893worker2 # [ 2.077097] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1894worker1 # [ 2.114697] systemd[1]: Starting Apply Kernel Variables...1895worker2 # [ 2.078967] systemd[1]: Started Journal Service.1896worker1 # [ 2.114835] systemd[1]: Started Journal Service.1897worker1 # [ 2.102701] systemd-modules-load[74]: Module 'virtio_balloon' is built in1898worker2 # [ 2.065859] systemd-modules-load[75]: Inserted module 'dm_mod'1899worker2 # [ 2.069196] systemd-modules-load[75]: Module 'virtio_balloon' is built in1900client # [ 2.083472] systemd[1]: Started Journal Service.1901worker2 # [ 2.073542] systemd-modules-load[75]: Module 'virtio_console' is built in1902client # [ 2.072301] systemd-modules-load[74]: Inserted module 'dm_mod'1903worker1 # [ 2.113959] systemd-modules-load[74]: Module 'virtio_console' is built in1904worker1 # [ 2.116369] systemd-modules-load[74]: Inserted module 'virtio_gpu'1905client # [ 2.079009] systemd-modules-load[74]: Module 'virtio_balloon' is built in1906worker2 # [ 2.080374] systemd[1]: Finished Create Static Device Nodes in /dev.1907worker1 # [ 2.118196] systemd-modules-load[74]: Module 'virtio_rng' is built in1908client # [ 2.081288] systemd-modules-load[74]: Module 'virtio_console' is built in1909worker2 # [ 2.084355] systemd[1]: Reached target Preparation for Local File Systems.1910worker2 # [ 2.085501] systemd[1]: Reached target Local File Systems.1911client # [ 2.084247] systemd-modules-load[74]: Inserted module 'virtio_gpu'1912worker2 # [ 2.086435] systemd-modules-load[75]: Inserted module 'virtio_gpu'1913worker2 # [ 2.092303] systemd-modules-load[75]: Module 'virtio_rng' is built in1914worker1 # [ 2.129451] systemd[1]: Starting Create System Files and Directories...1915client # [ 2.093409] systemd-modules-load[74]: Module 'virtio_rng' is built in1916worker1 # [ 2.131756] systemd-udevd[80]: Using default interface naming scheme 'v261'.1917worker2 # [ 2.096176] systemd[1]: Starting Create System Files and Directories...1918client # [ 2.095234] systemd-udevd[79]: Using default interface naming scheme 'v261'.1919worker2 # [ 2.101133] systemd[1]: Starting Rule-based Manager for Device Events and Files...1920client # [ 2.101625] systemd[1]: Starting Create System Files and Directories...1921worker2 # [ 2.103123] systemd[1]: Finished Load Kernel Modules.1922lb # [ 2.140131] systemd[1]: Starting Virtual Console Setup...1923client # [ 2.117038] systemd[1]: Finished Create System Files and Directories.1924worker2 # [ 2.128167] systemd[1]: Starting Apply Kernel Variables...1925worker1 # [ 2.168859] systemd[1]: Finished Apply Kernel Variables.1926client # [ 2.133436] systemd[1]: Started Rule-based Manager for Device Events and Files.1927worker2 # [ 2.144958] systemd[1]: Finished Create System Files and Directories.1928worker1 # [ 2.182704] systemd[1]: Finished Create System Files and Directories.1929worker1 # [ 2.188502] systemd[1]: Started Rule-based Manager for Device Events and Files.1930lb # [ 2.192560] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1931lb # [ 2.196174] systemd[1]: Finished Virtual Console Setup.1932worker2 # [ 2.173372] systemd[1]: Finished Apply Kernel Variables.1933worker2 # [ 2.181334] systemd-udevd[80]: Using default interface naming scheme 'v261'.1934client # [ 2.193473] systemd[1]: Starting Virtual Console Setup...1935worker2 # [ 2.210184] systemd[1]: Started Rule-based Manager for Device Events and Files.1936worker1 # [ 2.256110] systemd[1]: Starting Virtual Console Setup...1937client # [ 2.244480] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1938client # [ 2.248050] systemd[1]: Finished Virtual Console Setup.1939worker2 # [ 2.265563] systemd[1]: Starting Virtual Console Setup...1940worker1 # [ 2.304544] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1941worker1 # [ 2.308067] systemd[1]: Finished Virtual Console Setup.1942worker2 # [ 2.320519] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1943worker2 # [ 2.323875] systemd[1]: Finished Virtual Console Setup.1944lb # [ 2.797293] systemd[1]: Finished Coldplug All udev Devices.1945lb # [ 2.798300] systemd[1]: Reached target System Initialization.1946lb # [ 2.800095] systemd[1]: Reached target Basic System.1947client # [ 2.842872] systemd[1]: Finished Coldplug All udev Devices.1948client # [ 2.848550] systemd[1]: Reached target System Initialization.1949client # [ 2.849434] systemd[1]: Reached target Basic System.1950worker1 # [ 2.899993] systemd[1]: Finished Coldplug All udev Devices.1951worker1 # [ 2.900971] systemd[1]: Reached target System Initialization.1952worker1 # [ 2.901988] systemd[1]: Reached target Basic System.1953lb # [ 2.919997] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1954worker2 # [ 2.894730] systemd[1]: Finished Coldplug All udev Devices.1955worker2 # [ 2.895684] systemd[1]: Reached target System Initialization.1956worker2 # [ 2.900165] systemd[1]: Reached target Basic System.1957lb # [ 2.974321] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958lb # [ 2.977282] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1959lb # [ 3.030076] systemd[1]: Found device /dev/disk/by-label/nixos.1960lb # [ 3.033120] systemd[1]: Reached target Initrd Root Device.1961lb # [ 3.036975] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1962client # [ 3.005945] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1963worker1 # [ 3.048321] (udev-worker)[106]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1964worker1 # [ 3.066699] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1965client # [ 3.033937] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1966client # [ 3.038899] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1967worker1 # [ 3.089720] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1968lb # [ 3.092765] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1969lb # [ 3.100163] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1970worker2 # [ 3.067157] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1971lb # [ 3.104241] systemd[1]: Mounting /sysroot...1972worker2 # [ 3.080626] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1973worker2 # [ 3.086412] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1974worker1 # [ 3.144290] systemd[1]: Found device /dev/disk/by-label/nixos.1975client # [ 3.108521] systemd[1]: Found device /dev/disk/by-label/nixos.1976worker1 # [ 3.147237] systemd[1]: Reached target Initrd Root Device.1977lb # [ 3.156030] EXT4-fs (vda): mounted filesystem 905c8082-9db5-4c4c-a498-e77c00303cfe r/w with ordered data mode. Quota mode: none.1978worker1 # [ 3.149560] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1979client # [ 3.112631] systemd[1]: Reached target Initrd Root Device.1980lb # [ 3.151105] systemd[1]: Mounted /sysroot.1981client # [ 3.116896] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1982lb # [ 3.152837] systemd[1]: Reached target Initrd Root File System.1983lb # [ 3.160222] systemd[1]: Starting Mountpoints Configured in the Real Root...1984lb # [ 3.183093] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1985lb # [ 3.189246] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1986lb # [ 3.192130] systemd[1]: Reloading...1987worker2 # [ 3.160653] systemd[1]: Found device /dev/disk/by-label/nixos.1988worker1 # [ 3.201339] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1989worker2 # [ 3.166274] systemd[1]: Reached target Initrd Root Device.1990client # [ 3.165259] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1991worker2 # [ 3.169242] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1992client # [ 3.173314] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1993worker1 # [ 3.211683] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1994client # [ 3.175919] systemd[1]: Mounting /sysroot...1995worker1 # [ 3.217738] systemd[1]: Mounting /sysroot...1996client # [ 3.225680] EXT4-fs (vda): mounted filesystem 13d9ebb8-e2b9-4041-b729-3df7a598e503 r/w with ordered data mode. Quota mode: none.1997worker1 # [ 3.266016] EXT4-fs (vda): mounted filesystem 4e9a7da8-ed1e-4b6b-9e9b-5a4e4b65b613 r/w with ordered data mode. Quota mode: none.1998worker2 # [ 3.217125] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1999client # [ 3.216942] systemd[1]: Mounted /sysroot.2000worker1 # [ 3.256848] systemd[1]: Mounted /sysroot.
loading 1,213 hidden lines…
3214worker2 # [ 12.574549] systemd[1]: Finished Extra networking commands..3215lb # [ 12.621699] cfg80211: Loading compiled-in X.509 certificates for regulatory database3216worker2 # [ 12.579122] systemd[1]: Reached target Network.3217worker2 # [ 12.583577] systemd[1]: Starting Permit User Sessions...3218client # [ 12.598710] network-addresses-eth1-start[547]: adding address 2001:db8:1::1/64... done3219lb # [ 12.633160] (udev-worker)[372]: Network interface NamePolicy= disabled on kernel command line.3220worker2 # [ 12.601107] systemd[1]: Condition check resulted in Virtio network device being skipped.3221worker2 # [ 12.606802] systemd[1]: Starting Address configuration of eth1...3222lb # [ 12.674850] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3223lb # [ 12.675360] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3224client # [ 12.633145] systemd[1]: Finished Address configuration of eth1.3225lb # [ 12.680745] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23226lb # [ 12.681082] cfg80211: failed to load regulatory.db3227client # [ 12.646494] dhcpcd[580]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (552) - Operation not permitted3228worker1 # [ 12.687357] systemd[1]: Condition check resulted in Virtio network device being skipped.3229lb # [ 12.682645] (udev-worker)[384]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3230worker1 # [ 12.692113] systemd[1]: Starting Address configuration of eth1...3231client # [ 12.651183] dhcpcd[580]: .resolvconf-wrapped: clearing stale lock pid 5523232worker2 # [ 12.674925] cfg80211: Loading compiled-in X.509 certificates for regulatory database3233lb # [ 12.691264] (udev-worker)[384]: Network interface NamePolicy= disabled on kernel command line.3234worker2 # [ 12.701332] systemd[1]: Finished Permit User Sessions.3235client # [ 12.716444] 8021q: adding VLAN 0 to HW filter on device eth03236worker2 # [ 12.719322] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3237worker2 # [ 12.719848] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3238client # [ 12.706265] dhcpcd[542]: eth0: waiting for carrier3239client # [ 12.708289] dhcpcd[542]: eth0: carrier acquired3240worker2 # [ 12.725564] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23241worker2 # [ 12.725921] cfg80211: failed to load regulatory.db3242worker2 # [ 12.717262] systemd[1]: Started Getty on tty1.3243worker2 # [ 12.718067] systemd[1]: Reached target Login Prompts.3244client # [ 12.725825] dhcpcd[542]: DUID 00:01:00:01:32:42:5d:35:52:54:00:12:34:563245client # [ 12.727636] dhcpcd[542]: eth0: IAID 00:12:34:563246client # [ 12.730732] dhcpcd[542]: eth0: adding address fe80::5054:ff:fe12:34563247client # [ 12.747591] systemd[1]: Finished Extra networking commands..3248client # [ 12.752436] systemd[1]: Reached target Network.3249client # [ 12.758012] systemd[1]: Starting Permit User Sessions...3250worker1 # [ 12.812750] 8021q: adding VLAN 0 to HW filter on device eth03251lb # [ 12.808033] 8021q: adding VLAN 0 to HW filter on device eth03252worker1 # [ 12.800715] dhcpcd[636]: eth0: waiting for carrier3253lb # [ 12.796856] dhcpcd[669]: eth0: waiting for carrier3254worker1 # [ 12.802562] dhcpcd[636]: eth0: carrier acquired3255lb # [ 12.800780] dhcpcd[669]: libudev: received NULL device3256worker2 # [ 12.784606] 8021q: adding VLAN 0 to HW filter on device eth13257lb # [ 12.805595] dhcpcd[669]: libudev: received NULL device3258lb # [ 12.811555] dhcpcd[669]: eth0: carrier acquired3259worker1 # [ 12.831152] 8021q: adding VLAN 0 to HW filter on device eth13260worker1 # [ 12.823443] dhcpcd[636]: DUID 00:01:00:01:32:42:5d:35:52:54:00:12:34:563261worker1 # [ 12.826897] dhcpcd[636]: eth0: IAID 00:12:34:563262worker1 # [ 12.827589] dhcpcd[636]: eth0: adding address fe80::5054:ff:fe12:34563263lb # [ 12.831954] dhcpcd[669]: DUID 00:01:00:01:32:42:5d:35:52:54:00:12:34:563264worker2 # [ 12.798745] network-addresses-eth1-start[659]: adding address 192.168.1.4/24... done3265lb # [ 12.836930] dhcpcd[669]: eth0: IAID 00:12:34:563266worker1 # [ 12.842197] network-addresses-eth1-start[681]: adding address 192.168.1.3/24... done3267lb # [ 12.840921] dhcpcd[669]: eth0: adding address fe80::5054:ff:fe12:34563268client # [ 12.808795] systemd[1]: Finished Permit User Sessions.3269worker1 # [ 12.847189] systemd-logind[508]: Watching system buttons on /dev/input/event0 (gpio-keys)3270lb # [ 12.843881] systemd[1]: Condition check resulted in Virtio network device being skipped.3271worker2 # [ 12.830968] 8021q: adding VLAN 0 to HW filter on device eth03272lb # [ 12.849605] dhcpcd[669]: eth0: IAID 00:12:34:563273worker2 # [ 12.817091] dhcpcd[644]: eth0: waiting for carrier3274client # [ 12.817577] systemd[1]: Started Getty on tty1.3275lb # [ 12.853392] systemd[1]: Starting Address configuration of eth1...3276worker2 # [ 12.821421] network-addresses-eth1-start[659]: adding address 2001:db8:1::4/64... done3277client # [ 12.820585] systemd[1]: Reached target Login Prompts.3278worker1 # [ 12.862041] network-addresses-eth1-start[681]: adding address 2001:db8:1::3/64... done3279worker2 # [ 12.825526] dhcpcd[644]: eth0: waiting for carrier3280worker2 # [ 12.828818] dhcpcd[644]: eth0: carrier acquired3281worker1 # [ 12.884144] systemd[1]: Finished Address configuration of eth1.3282worker2 # [ 12.849281] dhcpcd[644]: DUID 00:01:00:01:32:42:5d:35:52:54:00:12:34:563283worker2 # [ 12.850354] dhcpcd[644]: eth0: IAID 00:12:34:563284worker2 # [ 12.851004] dhcpcd[644]: eth0: adding address fe80::5054:ff:fe12:34563285worker2 # [ 12.855106] systemd[1]: Finished Address configuration of eth1.3286lb # [ 12.887910] postgresql-pre-start[693]: The files belonging to this database system will be owned by user "postgres".3287lb # [ 12.892389] postgresql-pre-start[693]: This user must also own the server process.3288lb # [ 12.910044] postgresql-pre-start[693]: The database cluster will be initialized with locale "en_US.UTF-8".3289worker1 # [ 12.914459] systemd-logind[508]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3290lb # [ 12.913067] postgresql-pre-start[693]: The default database encoding has accordingly been set to "UTF8".3291lb # [ 12.915667] postgresql-pre-start[693]: The default text search configuration will be set to "english".3292lb # [ 12.919449] postgresql-pre-start[693]: Data page checksums are enabled.3293lb # [ 12.923081] postgresql-pre-start[693]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3294lb # [ 12.926999] postgresql-pre-start[693]: creating subdirectories ... ok3295lb # [ 12.932320] postgresql-pre-start[693]: selecting dynamic shared memory implementation ... posix3296worker2 # [ 12.916731] mousedev: PS/2 mouse device common for all mice3297worker1 # [ 12.982220] mousedev: PS/2 mouse device common for all mice3298worker2 # [ 12.932427] systemd-logind[511]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3299client: (finished: waiting for unit network-addresses-eth1.service, in 13.40 seconds)3300client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3301lb # [ 13.012686] 8021q: adding VLAN 0 to HW filter on device eth13302worker1 # [ 13.022073] systemd-logind[508]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3303lb # [ 13.036467] network-addresses-eth1-start[709]: adding address 192.168.1.2/24... done3304client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.06 seconds)3305lb: waiting for unit network-addresses-eth1.service3306lb: waiting for the VM to finish booting3307lb: Guest shell says: b'Spawning backdoor root shell...\n'3308lb: connected to guest root shell3309lb: (connecting took 0.00 seconds)3310lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3311lb # [ 13.060761] network-addresses-eth1-start[709]: adding address 2001:db8:1::2/64... done3312lb # [ 13.106057] systemd[1]: Finished Address configuration of eth1.3313lb # [ 13.184168] postgresql-pre-start[693]: selecting default "max_connections" ... 1003314lb: (finished: waiting for unit network-addresses-eth1.service, in 0.15 seconds)3315lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3316lb # [ 13.270474] systemd-logind[523]: Watching system buttons on /dev/input/event0 (gpio-keys)3317lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.09 seconds)3318worker1: waiting for unit network-addresses-eth1.service3319worker1: waiting for the VM to finish booting3320worker1: Guest shell says: b'Spawning backdoor root shell...\n'3321worker1: connected to guest root shell3322worker1: (connecting took 0.00 seconds)3323worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3324worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3325worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3326lb # [ 13.405802] postgresql-pre-start[693]: selecting default "shared_buffers" ... 128MB3327worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3328worker2: waiting for unit network-addresses-eth1.service3329worker2: waiting for the VM to finish booting3330worker2: Guest shell says: b'Spawning backdoor root shell...\n'3331worker2: connected to guest root shell3332worker2: (connecting took 0.00 seconds)3333worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3334worker2 # [ 13.422219] dhcpcd[644]: eth0: soliciting a DHCP lease3335worker2 # [ 13.428497] dhcpcd[644]: eth0: offered 10.0.2.15 from 10.0.2.23336worker2 # [ 13.436254] dhcpcd[644]: eth0: probing address 10.0.2.15/243337client # [ 13.505329] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33338worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3339worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3340worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3341lb: waiting for unit niks3.service3342lb # [ 13.783111] mousedev: PS/2 mouse device common for all mice3343worker2 # [ 13.758050] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33344lb # [ 13.834167] systemd-logind[523]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3345client # [ 13.829186] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3346client # [ 13.838845] systemd[1]: Starting Virtual Console Setup...3347client # [ 13.864731] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3348client # [ 13.866992] systemd[1]: Stopped Virtual Console Setup.3349client # [ 13.878416] systemd[1]: Starting Virtual Console Setup...3350client # [ 13.916794] systemd-logind[430]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3351worker1 # [ 14.028656] dhcpcd[636]: eth0: soliciting a DHCP lease3352worker1 # [ 14.036658] dhcpcd[636]: eth0: offered 10.0.2.15 from 10.0.2.23353worker1 # [ 14.044293] dhcpcd[636]: eth0: probing address 10.0.2.15/243354worker2 # [ 14.053816] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3355worker2 # [ 14.074005] systemd[1]: Starting Virtual Console Setup...3356lb # [ 14.115661] dhcpcd[669]: eth0: soliciting a DHCP lease3357worker1 # [ 14.121669] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3358lb # [ 14.120632] dhcpcd[669]: eth0: offered 10.0.2.15 from 10.0.2.23359worker2 # [ 14.092482] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3360lb # [ 14.128339] dhcpcd[669]: eth0: probing address 10.0.2.15/243361worker2 # [ 14.098158] systemd[1]: Stopped Virtual Console Setup.3362worker1 # [ 14.135797] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3363worker1 # [ 14.139923] systemd[1]: Stopped Virtual Console Setup.3364worker2 # [ 14.106409] systemd[1]: Starting Virtual Console Setup...3365worker1 # [ 14.144536] systemd[1]: Stopping Virtual Console Setup...3366worker1 # [ 14.145376] systemd[1]: Starting Virtual Console Setup...3367worker1 # [ 14.168125] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3368worker1 # [ 14.172285] systemd[1]: Stopped Virtual Console Setup.3369worker1 # [ 14.174321] systemd[1]: Starting Virtual Console Setup...3370worker2 # [ 14.166832] systemd-logind[511]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3371client # [ 14.312225] systemd-vconsole-setup[649]: Configuration of first virtual console was skipped, ignoring remaining ones.3372client # [ 14.316397] systemd[1]: Finished Virtual Console Setup.3373worker1 # [ 14.491221] systemd-vconsole-setup[714]: Configuration of first virtual console was skipped, ignoring remaining ones.3374worker1 # [ 14.495448] systemd[1]: Finished Virtual Console Setup.3375worker2 # [ 14.542375] systemd-vconsole-setup[709]: Configuration of first virtual console was skipped, ignoring remaining ones.3376worker2 # [ 14.546501] systemd[1]: Finished Virtual Console Setup.3377client # [ 14.631474] dhcpcd[542]: eth0: soliciting an IPv6 router3378client # [ 14.635497] dhcpcd[542]: eth0: Router Advertisement from fe80::23379client # [ 14.638348] dhcpcd[542]: eth0: adding address fec0::5054:ff:fe12:3456/643380client # [ 14.641371] dhcpcd[542]: eth0: adding route to fec0::/643381client # [ 14.643755] dhcpcd[542]: eth0: adding default route via fe80::23382client # [ 14.652509] dhcpcd[542]: eth0: soliciting a DHCP lease3383client # [ 14.656980] dhcpcd[542]: eth0: offered 10.0.2.15 from 10.0.2.23384client # [ 14.660487] dhcpcd[542]: eth0: probing address 10.0.2.15/243385lb # [ 14.828293] dhcpcd[669]: eth0: soliciting an IPv6 router3386lb # [ 14.829856] dhcpcd[669]: eth0: Router Advertisement from fe80::23387lb # [ 14.830709] dhcpcd[669]: eth0: adding address fec0::5054:ff:fe12:3456/643388lb # [ 14.831591] dhcpcd[669]: eth0: adding route to fec0::/643389lb # [ 14.837263] dhcpcd[669]: eth0: adding default route via fe80::23390lb # [ 14.901447] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33391worker2 # [ 15.203247] dhcpcd[644]: eth0: soliciting an IPv6 router3392worker2 # [ 15.207100] dhcpcd[644]: eth0: Router Advertisement from fe80::23393worker2 # [ 15.210186] dhcpcd[644]: eth0: adding address fec0::5054:ff:fe12:3456/643394worker2 # [ 15.213097] dhcpcd[644]: eth0: adding route to fec0::/643395worker2 # [ 15.215372] dhcpcd[644]: eth0: adding default route via fe80::23396worker1 # [ 15.331745] dhcpcd[636]: eth0: soliciting an IPv6 router3397worker1 # [ 15.334647] dhcpcd[636]: eth0: Router Advertisement from fe80::23398worker1 # [ 15.336794] dhcpcd[636]: eth0: adding address fec0::5054:ff:fe12:3456/643399worker1 # [ 15.338737] dhcpcd[636]: eth0: adding route to fec0::/643400worker1 # [ 15.340390] dhcpcd[636]: eth0: adding default route via fe80::23401lb # [ 15.381880] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3402lb # [ 15.400765] systemd[1]: Starting Virtual Console Setup...3403lb # [ 15.451299] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3404lb # [ 15.454525] systemd[1]: Stopped Virtual Console Setup.3405lb # [ 15.472384] systemd[1]: Starting Virtual Console Setup...3406lb # [ 15.531331] systemd-logind[523]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3407lb # [ 15.974373] systemd-vconsole-setup[772]: Configuration of first virtual console was skipped, ignoring remaining ones.3408lb # [ 15.989319] systemd[1]: Finished Virtual Console Setup.3409lb # [ 16.218624] postgresql-pre-start[693]: selecting default time zone ... UTC3410lb # [ 16.222518] postgresql-pre-start[693]: creating configuration files ... ok3411lb # [ 16.503547] postgresql-pre-start[693]: running bootstrap script ... ok3412lb # [ 17.257475] postgresql-pre-start[693]: performing post-bootstrap initialization ... ok3413lb # [ 17.414920] postgresql-pre-start[693]: syncing data to disk ... ok3414lb # [ 17.417397] postgresql-pre-start[693]: initdb: warning: enabling "trust" authentication for local connections3415lb # [ 17.418740] postgresql-pre-start[693]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3416lb # [ 17.420968] postgresql-pre-start[693]: Success. You can now start the database server using:3417lb # [ 17.422183] postgresql-pre-start[693]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3418lb # [ 17.562757] postgres[806]: [806] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3419lb # [ 17.567488] postgres[806]: [806] LOG: listening on IPv6 address "::1", port 54323420lb # [ 17.568779] postgres[806]: [806] LOG: listening on IPv4 address "127.0.0.1", port 54323421lb # [ 17.570706] postgres[806]: [806] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3422lb # [ 17.584921] postgres[815]: [815] LOG: database system was shut down at 2026-09-20 09:00:41 GMT3423lb # [ 17.823748] postgres[806]: [806] LOG: database system is ready to accept connections3424lb # [ 17.841242] systemd[1]: Started PostgreSQL Server.3425lb # [ 17.870735] systemd[1]: Starting PostgreSQL Setup Scripts...3426worker2 # [ 18.053266] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds3427worker2 # [ 18.057069] dhcpcd[644]: eth0: adding route to 10.0.2.0/243428worker2 # [ 18.060809] dhcpcd[644]: eth0: adding default route via 10.0.2.23429lb # [ 18.150081] postgresql-setup-start[826]: CREATE DATABASE3430lb # [ 18.213220] postgresql-setup-start[831]: CREATE ROLE3431lb # [ 18.243630] postgresql-setup-start[833]: ALTER DATABASE3432lb # [ 18.254876] systemd[1]: Finished PostgreSQL Setup Scripts.3433worker2 # [ 18.222571] systemd[1]: Started DHCP Client.3434worker2 # [ 18.224897] systemd[1]: Reached target Multi-User System.3435lb # [ 18.258948] systemd[1]: Reached target PostgreSQL.3436worker2 # [ 18.225735] systemd[1]: Startup finished in 986ms (kernel) + 5.488s (initrd) + 11.749s (userspace) = 18.224s.3437worker1 # [ 19.028902] dhcpcd[636]: eth0: leased 10.0.2.15 for 86400 seconds3438worker1 # [ 19.033731] dhcpcd[636]: eth0: adding route to 10.0.2.0/243439worker1 # [ 19.037751] dhcpcd[636]: eth0: adding default route via 10.0.2.23440worker1 # [ 19.226560] systemd[1]: Started DHCP Client.3441worker1 # [ 19.229041] systemd[1]: Reached target Multi-User System.3442worker1 # [ 19.230225] systemd[1]: Startup finished in 985ms (kernel) + 4.642s (initrd) + 13.600s (userspace) = 19.228s.3443lb # [ 19.706296] dhcpcd[669]: eth0: leased 10.0.2.15 for 86400 seconds3444lb # [ 19.710832] dhcpcd[669]: eth0: adding route to 10.0.2.0/243445lb # [ 19.711172] dhcpcd[669]: eth0: adding default route via 10.0.2.23446lb # [ 19.880211] systemd[1]: Started DHCP Client.3447lb # [ 19.884318] systemd[1]: Reached target Network is Online.3448lb # [ 19.888753] systemd[1]: Started Envoy reverse proxy.3449lb # [ 19.896391] systemd[1]: Started mock-oidc.service.3450lb # [ 19.993151] mock-oidc-server[911]: Mock OIDC Server running3451lb # [ 19.994306] mock-oidc-server[911]: OIDC Address: 192.168.1.2:80803452lb # [ 19.996141] mock-oidc-server[911]: Issue Address: 0.0.0.0:80813453lb # [ 19.997429] mock-oidc-server[911]: Issuer: http://192.168.1.2:8080/oidc3454lb # [ 19.998783] mock-oidc-server[911]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3455lb # [ 20.000475] mock-oidc-server[911]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3456lb # [ 20.002290] mock-oidc-server[911]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3457client # [ 20.518541] dhcpcd[542]: eth0: leased 10.0.2.15 for 86400 seconds3458lb # [ 20.591924] envoy[910]: [2026-09-20 09:00:45.174][910][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3459lb # [ 20.594978] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:469] statically linked extensions:3460lb # [ 20.597007] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3461lb # [ 20.599260] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3462lb # [ 20.615525] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3463lb # [ 20.620704] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3464lb # [ 20.623977] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3465lb # [ 20.628886] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3466lb # [ 20.631197] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83467lb # [ 20.633373] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3468lb # [ 20.637167] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3469lb # [ 20.670072] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3470lb # [ 20.673611] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3471lb # [ 20.681711] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3472lb # [ 20.684112] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3473lb # [ 20.686182] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3474lb # [ 20.687903] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3475lb # [ 20.691084] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3476lb # [ 20.694816] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3477lb # [ 20.697939] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3478lb # [ 20.710693] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3479lb # [ 20.713576] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3480client # [ 20.522683] dhcpcd[542]: eth0: adding route to 10.0.2.0/243481client # [ 20.522937] dhcpcd[542]: eth0: adding default route via 10.0.2.23482client # [ 20.680920] systemd[1]: Started DHCP Client.3483client # [ 20.684475] systemd[1]: Reached target Multi-User System.3484client # [ 20.685297] systemd[1]: Startup finished in 973ms (kernel) + 5.452s (initrd) + 14.258s (userspace) = 20.684s.3485lb # [ 20.716092] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3486lb # [ 20.721719] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3487lb # [ 20.723740] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3488lb # [ 20.726527] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3489lb # [ 20.729555] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3490lb # [ 20.732447] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3491lb # [ 20.734318] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3492lb # [ 20.738766] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3493lb # [ 20.741668] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3494lb # [ 20.746108] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3495lb # [ 20.748184] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3496lb # [ 20.755383] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3497lb # [ 20.764199] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3498lb # [ 20.766216] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3499lb # [ 20.772078] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3500lb # [ 20.774258] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3501lb # [ 20.778399] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23502lb # [ 20.780302] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3503lb # [ 20.787479] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3504lb # [ 20.791041] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3505lb # [ 20.794246] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3506lb # [ 20.796442] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3507lb # [ 20.799356] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3508lb # [ 20.802851] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3509lb # [ 20.804606] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3510lb # [ 20.809467] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3511lb # [ 20.818148] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3512lb # [ 20.820717] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3513lb # [ 20.822774] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3514lb # [ 20.825653] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3515lb # [ 20.828261] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3516lb # [ 20.832847] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3517lb # [ 20.834791] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3518lb # [ 20.836652] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3519lb # [ 20.840497] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3520lb # [ 20.842512] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3521lb # [ 20.845193] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3522lb # [ 20.847229] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3523lb # [ 20.850022] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3524lb # [ 20.854857] envoy[910]: [2026-09-20 09:00:45.176][910][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3525lb # [ 20.857082] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3526lb # [ 20.859246] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3527lb # [ 20.865561] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3528lb # [ 20.868514] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3529lb # [ 20.870271] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3530lb # [ 20.872279] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3531lb # [ 20.874840] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3532lb # [ 20.877178] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3533lb # [ 20.878895] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3534lb # [ 20.882459] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3535lb # [ 20.885105] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3536lb # [ 20.887981] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3537lb # [ 20.889733] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3538lb # [ 20.892084] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3539lb # [ 20.897958] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3540lb # [ 20.900085] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3541lb # [ 20.901861] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3542lb # [ 20.905402] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3543lb # [ 20.910327] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3544lb # [ 20.912516] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3545lb # [ 20.914500] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3546lb # [ 20.928596] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23547lb # [ 20.930470] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3548lb # [ 20.933514] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3549lb # [ 20.935454] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3550lb # [ 20.937458] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23551lb # [ 20.940359] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13552lb # [ 20.942549] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3553lb # [ 20.944491] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3554lb # [ 20.947459] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3555lb # [ 20.950748] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3556lb # [ 20.953100] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3557lb # [ 20.955527] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3558lb # [ 20.958951] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3559lb # [ 20.960856] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3560lb # [ 20.964908] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3561lb # [ 20.967042] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3562lb # [ 20.969357] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3563lb # [ 20.971437] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3564lb # [ 20.982751] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3565lb # [ 20.984801] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3566lb # [ 20.987416] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3567lb # [ 20.989371] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3568lb # [ 20.991340] envoy[910]: [2026-09-20 09:00:45.177][910][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3569lb # [ 20.993894] envoy[910]: [2026-09-20 09:00:45.196][910][info][main] [source/server/server.cc:531] HTTP header map info:3570lb # [ 20.995361] envoy[910]: [2026-09-20 09:00:45.203][910][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3571lb # [ 21.011486] envoy[910]: [2026-09-20 09:00:45.203][910][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3572lb # [ 21.013252] envoy[910]: [2026-09-20 09:00:45.203][910][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3573lb # [ 21.022333] envoy[910]: [2026-09-20 09:00:45.203][910][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3574lb # [ 21.024546] envoy[910]: [2026-09-20 09:00:45.450][910][info][main] [source/server/server.cc:968] runtime: {}3575lb # [ 21.025885] envoy[910]: [2026-09-20 09:00:45.467][910][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3576lb # [ 21.027620] envoy[910]: [2026-09-20 09:00:45.467][910][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013577lb # [ 21.029637] envoy[910]: [2026-09-20 09:00:45.467][910][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013578lb # [ 21.031245] envoy[910]: [2026-09-20 09:00:45.480][910][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3579lb # [ 21.033099] envoy[910]: [2026-09-20 09:00:45.480][910][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3580lb # [ 21.034801] envoy[910]: [2026-09-20 09:00:45.480][910][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3581lb # [ 21.057010] envoy[910]: [2026-09-20 09:00:45.639][910][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3582lb # [ 21.067332] envoy[910]: [2026-09-20 09:00:45.649][910][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3583lb # [ 21.070510] envoy[910]: [2026-09-20 09:00:45.652][910][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3584worker2 # [ 21.038749] systemd[1]: Starting Nix worker-protocol over gRPC...3585lb # [ 21.073952] envoy[910]: [2026-09-20 09:00:45.652][910][info][main] [source/server/server.cc:1077] starting main dispatch loop3586worker1 # [ 21.076581] systemd[1]: Starting Nix worker-protocol over gRPC...3587worker1 # [ 21.331104] nix-grpc-daemon[779]: ts=2026-09-20T09:00:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3588worker2 # [ 21.300704] nix-grpc-daemon[774]: ts=2026-09-20T09:00:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3589worker1 # [ 21.342964] nix-grpc-daemon[779]: ts=2026-09-20T09:00:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13590worker2 # [ 21.312602] nix-grpc-daemon[774]: ts=2026-09-20T09:00:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13591worker1 # [ 21.385836] nix-grpc-daemon[779]: ts=2026-09-20T09:00:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3592worker1 # [ 21.387577] systemd[1]: Started Nix worker-protocol over gRPC.3593worker2 # [ 21.358925] nix-grpc-daemon[774]: ts=2026-09-20T09:00:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3594worker2 # [ 21.364307] systemd[1]: Started Nix worker-protocol over gRPC.3595lb # [ 21.427694] envoy[910]: [2026-09-20 09:00:46.009][910][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3596lb # [ 21.436082] envoy[910]: [2026-09-20 09:00:46.009][910][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3597lb # [ 21.448238] envoy[910]: [2026-09-20 09:00:46.009][910][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3598worker1 # [ 21.465157] nix-grpc-daemon[779]: ts=2026-09-20T09:00:46Z level=info event=scheduler_connected addr=lb:500513599lb # [ 21.459773] envoy[910]: [2026-09-20 09:00:46.009][910][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3600worker2 # [ 21.440393] nix-grpc-daemon[774]: ts=2026-09-20T09:00:46Z level=info event=scheduler_connected addr=lb:500513601worker1 # [ 21.488170] nix-grpc-daemon[779]: ts=2026-09-20T09:00:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3602worker2 # [ 21.454712] nix-grpc-daemon[774]: ts=2026-09-20T09:00:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3603worker1 # [ 21.689340] nix-grpc-daemon[779]: ts=2026-09-20T09:00:46Z level=info event=scheduler_connected addr=lb:500513604worker2 # [ 21.655985] nix-grpc-daemon[774]: ts=2026-09-20T09:00:46Z level=info event=scheduler_connected addr=lb:500513605worker1 # [ 21.696548] nix-grpc-daemon[779]: ts=2026-09-20T09:00:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3606worker2 # [ 21.661478] nix-grpc-daemon[774]: ts=2026-09-20T09:00:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3607worker1 # [ 21.897813] nix-grpc-daemon[779]: ts=2026-09-20T09:00:46Z level=info event=scheduler_connected addr=lb:500513608worker2 # [ 21.862556] nix-grpc-daemon[774]: ts=2026-09-20T09:00:46Z level=info event=scheduler_connected addr=lb:500513609worker2 # [ 21.869044] nix-grpc-daemon[774]: ts=2026-09-20T09:00:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3610worker1 # [ 21.906965] nix-grpc-daemon[779]: ts=2026-09-20T09:00:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3611worker2 # [ 22.069948] nix-grpc-daemon[774]: ts=2026-09-20T09:00:46Z level=info event=scheduler_connected addr=lb:500513612worker1 # [ 22.108410] nix-grpc-daemon[779]: ts=2026-09-20T09:00:46Z level=info event=scheduler_connected addr=lb:500513613worker2 # [ 22.077128] nix-grpc-daemon[774]: ts=2026-09-20T09:00:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3614worker1 # [ 22.115267] nix-grpc-daemon[779]: ts=2026-09-20T09:00:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3615worker2 # [ 22.278232] nix-grpc-daemon[774]: ts=2026-09-20T09:00:46Z level=info event=scheduler_connected addr=lb:500513616worker1 # [ 22.316379] nix-grpc-daemon[779]: ts=2026-09-20T09:00:46Z level=info event=scheduler_connected addr=lb:500513617worker2 # [ 22.285351] nix-grpc-daemon[774]: ts=2026-09-20T09:00:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3618worker1 # [ 22.323507] nix-grpc-daemon[779]: ts=2026-09-20T09:00:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3619worker1 # [ 22.525979] nix-grpc-daemon[779]: ts=2026-09-20T09:00:47Z level=info event=scheduler_connected addr=lb:500513620worker2 # [ 22.489047] nix-grpc-daemon[774]: ts=2026-09-20T09:00:47Z level=info event=scheduler_connected addr=lb:500513621worker2 # [ 22.494394] nix-grpc-daemon[774]: ts=2026-09-20T09:00:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3622worker1 # [ 22.535327] nix-grpc-daemon[779]: ts=2026-09-20T09:00:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3623worker2 # [ 22.694978] nix-grpc-daemon[774]: ts=2026-09-20T09:00:47Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 22.733133] nix-grpc-daemon[779]: ts=2026-09-20T09:00:47Z level=info event=scheduler_connected addr=lb:500513625worker2 # [ 22.702731] nix-grpc-daemon[774]: ts=2026-09-20T09:00:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3626worker1 # [ 22.739885] nix-grpc-daemon[779]: ts=2026-09-20T09:00:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3627worker1 # [ 22.941005] nix-grpc-daemon[779]: ts=2026-09-20T09:00:47Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 22.904308] nix-grpc-daemon[774]: ts=2026-09-20T09:00:47Z level=info event=scheduler_connected addr=lb:500513629worker2 # [ 22.911481] nix-grpc-daemon[774]: ts=2026-09-20T09:00:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3630worker1 # [ 22.949612] nix-grpc-daemon[779]: ts=2026-09-20T09:00:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3631worker2 # [ 23.112150] nix-grpc-daemon[774]: ts=2026-09-20T09:00:47Z level=info event=scheduler_connected addr=lb:500513632worker1 # [ 23.150730] nix-grpc-daemon[779]: ts=2026-09-20T09:00:47Z level=info event=scheduler_connected addr=lb:500513633worker2 # [ 23.119181] nix-grpc-daemon[774]: ts=2026-09-20T09:00:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3634worker1 # [ 23.157336] nix-grpc-daemon[779]: ts=2026-09-20T09:00:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3635worker2 # [ 23.320363] nix-grpc-daemon[774]: ts=2026-09-20T09:00:47Z level=info event=scheduler_connected addr=lb:500513636worker1 # [ 23.358392] nix-grpc-daemon[779]: ts=2026-09-20T09:00:47Z level=info event=scheduler_connected addr=lb:500513637worker2 # [ 23.327018] nix-grpc-daemon[774]: ts=2026-09-20T09:00:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3638worker1 # [ 23.365035] nix-grpc-daemon[779]: ts=2026-09-20T09:00:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3639worker2 # [ 23.529318] nix-grpc-daemon[774]: ts=2026-09-20T09:00:48Z level=info event=scheduler_connected addr=lb:500513640worker1 # [ 23.568761] nix-grpc-daemon[779]: ts=2026-09-20T09:00:48Z level=info event=scheduler_connected addr=lb:500513641worker2 # [ 23.535419] nix-grpc-daemon[774]: ts=2026-09-20T09:00:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3642worker1 # [ 23.572818] nix-grpc-daemon[779]: ts=2026-09-20T09:00:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3643worker1 # [ 23.769884] nix-grpc-daemon[779]: ts=2026-09-20T09:00:48Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 23.736240] nix-grpc-daemon[774]: ts=2026-09-20T09:00:48Z level=info event=scheduler_connected addr=lb:500513645worker1 # [ 23.776481] nix-grpc-daemon[779]: ts=2026-09-20T09:00:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3646worker2 # [ 23.741417] nix-grpc-daemon[774]: ts=2026-09-20T09:00:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3647worker1 # [ 23.976997] nix-grpc-daemon[779]: ts=2026-09-20T09:00:48Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 23.942123] nix-grpc-daemon[774]: ts=2026-09-20T09:00:48Z level=info event=scheduler_connected addr=lb:500513649worker2 # [ 23.948141] nix-grpc-daemon[774]: ts=2026-09-20T09:00:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3650worker1 # [ 23.985496] nix-grpc-daemon[779]: ts=2026-09-20T09:00:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3651worker2 # [ 24.148894] nix-grpc-daemon[774]: ts=2026-09-20T09:00:48Z level=info event=scheduler_connected addr=lb:500513652worker1 # [ 24.186693] nix-grpc-daemon[779]: ts=2026-09-20T09:00:48Z level=info event=scheduler_connected addr=lb:500513653worker2 # [ 24.155507] nix-grpc-daemon[774]: ts=2026-09-20T09:00:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3654worker1 # [ 24.193381] nix-grpc-daemon[779]: ts=2026-09-20T09:00:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3655worker2 # [ 24.356550] nix-grpc-daemon[774]: ts=2026-09-20T09:00:48Z level=info event=scheduler_connected addr=lb:500513656worker1 # [ 24.394395] nix-grpc-daemon[779]: ts=2026-09-20T09:00:48Z level=info event=scheduler_connected addr=lb:500513657worker2 # [ 24.363197] nix-grpc-daemon[774]: ts=2026-09-20T09:00:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3658worker1 # [ 24.401352] nix-grpc-daemon[779]: ts=2026-09-20T09:00:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3659worker2 # [ 24.566513] nix-grpc-daemon[774]: ts=2026-09-20T09:00:49Z level=info event=scheduler_connected addr=lb:500513660worker1 # [ 24.605332] nix-grpc-daemon[779]: ts=2026-09-20T09:00:49Z level=info event=scheduler_connected addr=lb:500513661worker2 # [ 24.571840] nix-grpc-daemon[774]: ts=2026-09-20T09:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3662worker1 # [ 24.609796] nix-grpc-daemon[779]: ts=2026-09-20T09:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3663worker1 # [ 24.805804] nix-grpc-daemon[779]: ts=2026-09-20T09:00:49Z level=info event=scheduler_connected addr=lb:500513664worker2 # [ 24.772465] nix-grpc-daemon[774]: ts=2026-09-20T09:00:49Z level=info event=scheduler_connected addr=lb:500513665worker1 # [ 24.812150] nix-grpc-daemon[779]: ts=2026-09-20T09:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3666worker2 # [ 24.777634] nix-grpc-daemon[774]: ts=2026-09-20T09:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3667worker1 # [ 25.012815] nix-grpc-daemon[779]: ts=2026-09-20T09:00:49Z level=info event=scheduler_connected addr=lb:500513668worker2 # [ 24.978428] nix-grpc-daemon[774]: ts=2026-09-20T09:00:49Z level=info event=scheduler_connected addr=lb:500513669worker1 # [ 25.019586] nix-grpc-daemon[779]: ts=2026-09-20T09:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3670worker2 # [ 24.983663] nix-grpc-daemon[774]: ts=2026-09-20T09:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3671worker1 # [ 25.220457] nix-grpc-daemon[779]: ts=2026-09-20T09:00:49Z level=info event=scheduler_connected addr=lb:500513672worker2 # [ 25.185309] nix-grpc-daemon[774]: ts=2026-09-20T09:00:49Z level=info event=scheduler_connected addr=lb:500513673worker1 # [ 25.227601] nix-grpc-daemon[779]: ts=2026-09-20T09:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3674worker2 # [ 25.190866] nix-grpc-daemon[774]: ts=2026-09-20T09:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3675worker2 # [ 25.391806] nix-grpc-daemon[774]: ts=2026-09-20T09:00:49Z level=info event=scheduler_connected addr=lb:500513676worker1 # [ 25.428866] nix-grpc-daemon[779]: ts=2026-09-20T09:00:50Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 25.398570] nix-grpc-daemon[774]: ts=2026-09-20T09:00:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3678worker1 # [ 25.436844] nix-grpc-daemon[779]: ts=2026-09-20T09:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3679worker2 # [ 25.600924] nix-grpc-daemon[774]: ts=2026-09-20T09:00:50Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 25.640647] nix-grpc-daemon[779]: ts=2026-09-20T09:00:50Z level=info event=scheduler_connected addr=lb:500513681worker1 # [ 25.645006] nix-grpc-daemon[779]: ts=2026-09-20T09:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3682worker2 # [ 25.607624] nix-grpc-daemon[774]: ts=2026-09-20T09:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3683worker1 # [ 25.841765] nix-grpc-daemon[779]: ts=2026-09-20T09:00:50Z level=info event=scheduler_connected addr=lb:500513684worker2 # [ 25.808665] nix-grpc-daemon[774]: ts=2026-09-20T09:00:50Z level=info event=scheduler_connected addr=lb:500513685worker1 # [ 25.849911] nix-grpc-daemon[779]: ts=2026-09-20T09:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3686worker2 # [ 25.813956] nix-grpc-daemon[774]: ts=2026-09-20T09:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3687worker1 # [ 26.048965] nix-grpc-daemon[779]: ts=2026-09-20T09:00:50Z level=info event=scheduler_connected addr=lb:500513688worker2 # [ 26.014433] nix-grpc-daemon[774]: ts=2026-09-20T09:00:50Z level=info event=scheduler_connected addr=lb:500513689worker1 # [ 26.055430] nix-grpc-daemon[779]: ts=2026-09-20T09:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3690worker2 # [ 26.019921] nix-grpc-daemon[774]: ts=2026-09-20T09:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3691lb # [ 26.133134] rustfs-bucket-start[975]: mb s3://farm3692lb # [ 26.140468] systemd[1]: Finished rustfs-bucket.service.3693lb # [ 26.149827] systemd[1]: Starting niks3 server...3694worker1 # [ 26.255939] nix-grpc-daemon[779]: ts=2026-09-20T09:00:50Z level=info event=scheduler_connected addr=lb:500513695worker2 # [ 26.221276] nix-grpc-daemon[774]: ts=2026-09-20T09:00:50Z level=info event=scheduler_connected addr=lb:500513696worker2 # [ 26.227145] nix-grpc-daemon[774]: ts=2026-09-20T09:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3697worker1 # [ 26.264424] nix-grpc-daemon[779]: ts=2026-09-20T09:00:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3698lb # [ 26.356352] postgres[1000]: [1000] ERROR: relation "goose_db_version" does not exist at character 363699lb # [ 26.357762] postgres[1000]: [1000] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3700lb # [ 26.390519] niks3-server[993]: 2026/09/20 09:00:50 OK 20241026095416_initial_model.sql (20.11ms)3701lb # [ 26.394193] niks3-server[993]: 2026/09/20 09:00:50 OK 20251210153512_drop_unused_gin_index.sql (4.05ms)3702lb # [ 26.400092] niks3-server[993]: 2026/09/20 09:00:50 OK 20251218171726_add_pins.sql (5.76ms)3703lb # [ 26.405148] niks3-server[993]: 2026/09/20 09:00:50 OK 20260628120000_add_object_size_and_stats.sql (5.08ms)3704lb # [ 26.410523] niks3-server[993]: 2026/09/20 09:00:50 OK 20260905000000_add_claims.sql (5.34ms)3705lb # [ 26.415117] niks3-server[993]: 2026/09/20 09:00:50 OK 20260920000000_drop_claims.sql (4.46ms)3706lb # [ 26.417130] niks3-server[993]: 2026/09/20 09:00:50 goose: successfully migrated database to version: 202609200000003707lb # [ 26.421521] niks3-server[993]: 2026/09/20 09:00:51 OK 1_commit_pending_closure.sql (6.39ms)3708lb # [ 26.424086] niks3-server[993]: 2026/09/20 09:00:51 OK 2_object_stats_trigger.sql (2.41ms)3709lb # [ 26.425417] niks3-server[993]: 2026/09/20 09:00:51 goose: up to current file version: 23710lb # [ 26.429227] niks3-server[993]: 2026/09/20 09:00:51 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3711worker2 # [ 26.427491] nix-grpc-daemon[774]: ts=2026-09-20T09:00:51Z level=info event=scheduler_connected addr=lb:500513712worker1 # [ 26.465988] nix-grpc-daemon[779]: ts=2026-09-20T09:00:51Z level=info event=scheduler_connected addr=lb:500513713worker2 # [ 26.434351] nix-grpc-daemon[774]: ts=2026-09-20T09:00:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3714worker1 # [ 26.471538] nix-grpc-daemon[779]: ts=2026-09-20T09:00:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3715lb # [ 26.478890] niks3-server[993]: 2026/09/20 09:00:51 INFO Read proxy enabled — serving cache objects from S33716lb # [ 26.481009] niks3-server[993]: 2026/09/20 09:00:51 INFO Using socket-activated listener address=0.0.0.0:57513717lb # [ 26.484135] niks3-server[993]: 2026/09/20 09:00:51 INFO systemd watchdog enabled interval=15s3718lb # [ 26.485326] systemd[1]: Started niks3 server.3719lb # [ 26.490457] niks3-server[993]: 2026/09/20 09:00:51 INFO Starting HTTP server address=0.0.0.0:57513720lb # [ 26.494017] niks3-server[993]: 2026/09/20 09:00:51 INFO lead: acquired remote=192.168.1.4:443863721lb # [ 26.499110] systemd[1]: Reached target Multi-User System.3722worker2 # [ 26.463796] nix-grpc-daemon[774]: ts=2026-09-20T09:00:51Z level=info event=scheduler_take_over3723lb # [ 26.499901] systemd[1]: Startup finished in 986ms (kernel) + 5.346s (initrd) + 20.155s (userspace) = 26.488s.3724worker2 # [ 26.636868] nix-grpc-daemon[774]: ts=2026-09-20T09:00:51Z level=info event=scheduler_connected addr=lb:500513725worker1 # [ 26.674753] nix-grpc-daemon[779]: ts=2026-09-20T09:00:51Z level=info event=scheduler_connected addr=lb:500513726worker1 # [ 26.680068] nix-grpc-daemon[779]: ts=2026-09-20T09:00:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3727worker2 # [ 26.643419] nix-grpc-daemon[774]: ts=2026-09-20T09:00:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03728worker1 # [ 26.880870] nix-grpc-daemon[779]: ts=2026-09-20T09:00:51Z level=info event=scheduler_connected addr=lb:500513729worker2 # [ 26.845817] nix-grpc-daemon[774]: ts=2026-09-20T09:00:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03730lb: (finished: waiting for unit niks3.service, in 13.68 seconds)3731lb: waiting for TCP port 5751 on localhost3732lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3733lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds)3734lb: waiting for unit envoy.service3735lb: (finished: waiting for unit envoy.service, in 0.06 seconds)3736lb: waiting for TCP port 50051 on localhost3737lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3738lb # [ 27.479505] envoy[910]: conn peer=[::1]:36664 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33739lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3740lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3741??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3742 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283743lb: must succeed: curl -sf localhost:9901/clusters3744lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3745lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)3746subtest: one node schedules and both builders hold a WorkerSession on it3747lb: must succeed: curl -sf localhost:9901/clusters3748lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3749worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3750worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)3751(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.15 seconds)3752subtest: balancer auth: client cert, bearer token, nothing, unknown CN3753worker1 # [ 28.263420] nix-grpc-daemon[779]: ts=2026-09-20T09:00:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:370623754worker1 # [ 28.280667] systemd[1]: Started Nix Daemon.3755worker1 # [ 28.570661] nix-daemon[835]: accepted connection from pid 779, user nix-grpc-daemon (trusted)3756worker1 # [ 28.605929] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5)3757worker1 # [ 28.705330] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 2/5)3758worker1 # [ 28.771827] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 351 ms (attempt 3/5)3759worker1 # [ 29.130567] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 528 ms (attempt 4/5)3760worker1 # [ 29.662212] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3761worker2 # [ 29.662948] nix-grpc-daemon[774]: ts=2026-09-20T09:00:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:525463762worker2 # [ 29.681182] systemd[1]: Started Nix Daemon.3763worker2 # [ 29.954450] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3764worker2 # [ 29.982202] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5)3765worker2 # [ 30.066562] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 2/5)3766worker2 # [ 30.115970] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 248 ms (attempt 3/5)3767worker2 # [ 30.364637] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 252 ms (attempt 4/5)3768worker2 # [ 30.619278] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3769worker2 # [ 30.634916] nix-grpc-daemon[774]: ts=2026-09-20T09:00:55Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it"3770worker1 # [ 30.687035] nix-grpc-daemon[779]: ts=2026-09-20T09:00:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:370623771worker1 # [ 30.702396] nix-grpc-daemon[779]: ts=2026-09-20T09:00:55Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it"3772client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3773client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)3774client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3775client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3776lb # [ 31.058346] envoy[910]: conn peer=[2001:db8:1::1]:56706 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=24923777worker2 # [ 31.109387] nix-grpc-daemon[774]: ts=2026-09-20T09:00:55Z level=info event=oidc_jwks provider=mock keys=13778worker2 # [ 31.117676] nix-grpc-daemon[774]: ts=2026-09-20T09:00:55Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:525463779worker1 # [ 31.178290] nix-grpc-daemon[779]: ts=2026-09-20T09:00:55Z level=info event=oidc_jwks provider=mock keys=13780worker1 # [ 31.184534] nix-grpc-daemon[779]: ts=2026-09-20T09:00:55Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:370623781worker1 # [ 31.192738] nix-grpc-daemon[779]: ts=2026-09-20T09:00:55Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it"3782worker2 # [ 31.159723] nix-grpc-daemon[774]: ts=2026-09-20T09:00:55Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:525463783worker2 # [ 31.171480] nix-grpc-daemon[774]: ts=2026-09-20T09:00:55Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it"3784client: must succeed: rm -r /var/lib/nix-grpc-store3785client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds)3786worker1 # [ 31.499759] nix-grpc-daemon[779]: ts=2026-09-20T09:00:56Z level=info event=denied method=QueryMissing cn=- role=none3787worker1 # [ 31.748661] nix-grpc-daemon[779]: ts=2026-09-20T09:00:56Z level=info event=denied method=QueryMissing cn=stranger role=none3788(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.86 seconds)3789subtest: DAG build is scheduled across workers and lands in the cache3790client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23791worker1 # [ 31.992272] nix-grpc-daemon[779]: ts=2026-09-20T09:00:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:370623792client # don't know how to build these paths:3793client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3794worker1 # [ 32.005962] nix-grpc-daemon[779]: ts=2026-09-20T09:00:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370623795worker2 # [ 32.005841] nix-grpc-daemon[774]: ts=2026-09-20T09:00:56Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03796worker2 # [ 32.012968] nix-grpc-daemon[774]: ts=2026-09-20T09:00:56Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=13797worker2 # [ 32.051362] nix-grpc-daemon[774]: ts=2026-09-20T09:00:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525463798worker2 # [ 32.076997] nix-grpc-daemon[774]: ts=2026-09-20T09:00:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525463799client # copying 1 paths to 'lb:50051'...3800worker2 # [ 32.093162] nix-grpc-daemon[774]: ts=2026-09-20T09:00:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:525463801client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3802worker2 # [ 32.123813] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3803worker2 # [ 32.169901] nix-grpc-daemon[774]: ts=2026-09-20T09:00:56Z level=info event=niks3_push_started pid=8473804worker2 # [ 32.648543] nix-daemon[836]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3805worker2 # [ 32.666662] nix-daemon[836]: reaped child process 863, status = succeeded3806worker2 # [ 32.859107] nix-daemon[836]: accepted connection from pid 865, user nix-grpc-daemon (trusted)3807worker2 # [ 32.881339] nix-daemon[836]: reaped child process 868, status = succeeded3808lb # [ 32.926540] niks3-server[993]: 2026/09/20 09:00:57 INFO Received uploads request method=POST path=/api/pending_closures3809worker2 # [ 32.923284] nix-grpc-daemon[847]: time=2026-09-20T09:00:57.503Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3810worker2 # [ 32.925390] nix-grpc-daemon[847]: time=2026-09-20T09:00:57.504Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3811lb # [ 33.000951] niks3-server[993]: 2026/09/20 09:00:57 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3812lb # [ 33.012839] niks3-server[993]: 2026/09/20 09:00:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3813lb # [ 33.015829] niks3-server[993]: 2026/09/20 09:00:57 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3814lb # [ 33.033623] niks3-server[993]: 2026/09/20 09:00:57 INFO Signed narinfos id=1 count=13815worker2 # [ 33.006060] nix-grpc-daemon[847]: time=2026-09-20T09:00:57.587Z level=INFO msg="Uploading 1 narinfos"3816lb # [ 33.045132] niks3-server[993]: 2026/09/20 09:00:57 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3817lb # [ 33.050981] niks3-server[993]: 2026/09/20 09:00:57 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3818lb # [ 33.065198] niks3-server[993]: 2026/09/20 09:00:57 INFO Completed upload id=13819worker2 # [ 33.034210] nix-grpc-daemon[847]: time=2026-09-20T09:00:57.616Z level=INFO msg="Upload complete. (569ms)"3820worker2 # [ 33.045404] nix-grpc-daemon[774]: ts=2026-09-20T09:00:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=0 paths=1 nar_bytes_in=5043821worker2 # [ 33.060700] nix-grpc-daemon[774]: ts=2026-09-20T09:00:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525463822worker2 # [ 33.071933] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3823worker2 # [ 33.078501] nix-daemon[836]: reaped child process 845, status = succeeded3824client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3825worker2 # [ 33.092387] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3826client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3827client # farm-a> LOG-farm-a-t13828worker2 # [ 33.716619] nix-daemon[836]: reaped child process 873, status = succeeded3829worker2 # [ 33.876137] nix-daemon[836]: accepted connection from pid 888, user nix-grpc-daemon (trusted)3830worker2 # [ 33.893413] nix-daemon[836]: reaped child process 891, status = succeeded3831lb # [ 33.938860] niks3-server[993]: 2026/09/20 09:00:58 INFO Received uploads request method=POST path=/api/pending_closures3832worker2 # [ 33.918268] nix-grpc-daemon[847]: time=2026-09-20T09:00:58.500Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3833worker2 # [ 33.919948] nix-grpc-daemon[847]: time=2026-09-20T09:00:58.500Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3834lb # [ 33.990223] niks3-server[993]: 2026/09/20 09:00:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3835worker2 # [ 33.978347] nix-grpc-daemon[847]: time=2026-09-20T09:00:58.558Z level=INFO msg="Uploading 1 narinfos"3836lb # [ 34.010604] niks3-server[993]: 2026/09/20 09:00:58 INFO Signed narinfos id=2 count=13837lb # [ 34.024508] niks3-server[993]: 2026/09/20 09:00:58 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3838lb # [ 34.035450] niks3-server[993]: 2026/09/20 09:00:58 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3839worker2 # [ 34.016969] nix-grpc-daemon[847]: time=2026-09-20T09:00:58.599Z level=INFO msg="Upload complete. (310ms)"3840lb # [ 34.051786] niks3-server[993]: 2026/09/20 09:00:58 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3841lb # [ 34.061833] niks3-server[993]: 2026/09/20 09:00:58 INFO Completed upload id=23842lb # [ 34.064894] niks3-server[993]: 2026/09/20 09:00:58 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3843worker2 # [ 34.038840] nix-grpc-daemon[774]: ts=2026-09-20T09:00:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=0 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13844lb # [ 34.075566] niks3-server[993]: 2026/09/20 09:00:58 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3845worker2 # [ 34.055086] nix-grpc-daemon[774]: ts=2026-09-20T09:00:58Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03846worker2 # [ 34.059453] nix-grpc-daemon[774]: ts=2026-09-20T09:00:58Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=13847worker2 # [ 34.063954] nix-daemon[836]: reaped child process 871, status = succeeded3848worker2 # [ 34.083411] nix-grpc-daemon[774]: ts=2026-09-20T09:00:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525463849worker2 # [ 34.098362] nix-grpc-daemon[774]: ts=2026-09-20T09:00:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525463850worker2 # [ 34.115088] nix-grpc-daemon[847]: time=2026-09-20T09:00:58.697Z level=INFO msg="All 1 paths already cached"3851client # copying 1 paths to 'lb:50051'...3852worker2 # [ 34.125101] nix-grpc-daemon[774]: ts=2026-09-20T09:00:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:525463853client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3854worker2 # [ 34.147852] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3855worker2 # [ 34.351810] nix-daemon[836]: accepted connection from pid 897, user nix-grpc-daemon (trusted)3856worker2 # [ 34.371504] nix-daemon[836]: reaped child process 900, status = succeeded3857worker2 # [ 34.547657] nix-daemon[836]: accepted connection from pid 902, user nix-grpc-daemon (trusted)3858worker2 # [ 34.565284] nix-daemon[836]: reaped child process 905, status = succeeded3859lb # [ 34.609246] niks3-server[993]: 2026/09/20 09:00:59 INFO Received uploads request method=POST path=/api/pending_closures3860worker2 # [ 34.589083] nix-grpc-daemon[847]: time=2026-09-20T09:00:59.171Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3861worker2 # [ 34.590755] nix-grpc-daemon[847]: time=2026-09-20T09:00:59.171Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3862lb # [ 34.642968] niks3-server[993]: 2026/09/20 09:00:59 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3863worker2 # [ 34.620807] nix-grpc-daemon[847]: time=2026-09-20T09:00:59.203Z level=INFO msg="Uploading 1 narinfos"3864lb # [ 34.658175] niks3-server[993]: 2026/09/20 09:00:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3865lb # [ 34.669103] niks3-server[993]: 2026/09/20 09:00:59 INFO Signed narinfos id=3 count=13866lb # [ 34.675213] niks3-server[993]: 2026/09/20 09:00:59 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3867lb # [ 34.682211] niks3-server[993]: 2026/09/20 09:00:59 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3868lb # [ 34.687530] niks3-server[993]: 2026/09/20 09:00:59 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3869lb # [ 34.691542] niks3-server[993]: 2026/09/20 09:00:59 INFO Completed upload id=33870worker2 # [ 34.658520] nix-grpc-daemon[847]: time=2026-09-20T09:00:59.241Z level=INFO msg="Upload complete. (493ms)"3871worker2 # [ 34.668304] nix-grpc-daemon[774]: ts=2026-09-20T09:00:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=0 paths=1 nar_bytes_in=6243872worker2 # [ 34.681754] nix-grpc-daemon[774]: ts=2026-09-20T09:00:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525463873worker2 # [ 34.690926] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3874worker2 # [ 34.694196] nix-daemon[836]: reaped child process 895, status = succeeded3875client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3876client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3877worker2 # [ 34.707365] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3878client # farm-b> LOG-farm-b-t13879worker2 # [ 35.941383] nix-daemon[836]: reaped child process 909, status = succeeded3880worker2 # [ 36.113443] nix-daemon[836]: accepted connection from pid 924, user nix-grpc-daemon (trusted)3881worker2 # [ 36.141152] nix-daemon[836]: reaped child process 927, status = succeeded3882lb # [ 36.186296] niks3-server[993]: 2026/09/20 09:01:00 INFO Received uploads request method=POST path=/api/pending_closures3883worker2 # [ 36.164486] nix-grpc-daemon[847]: time=2026-09-20T09:01:00.745Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3884worker2 # [ 36.167466] nix-grpc-daemon[847]: time=2026-09-20T09:01:00.745Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3885lb # [ 36.221587] niks3-server[993]: 2026/09/20 09:01:00 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3886lb # [ 36.233691] niks3-server[993]: 2026/09/20 09:01:00 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3887lb # [ 36.244175] niks3-server[993]: 2026/09/20 09:01:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3888worker2 # [ 36.217596] nix-grpc-daemon[847]: time=2026-09-20T09:01:00.800Z level=INFO msg="Uploading 1 narinfos"3889lb # [ 36.250405] niks3-server[993]: 2026/09/20 09:01:00 INFO Signed narinfos id=4 count=13890lb # [ 36.254967] niks3-server[993]: 2026/09/20 09:01:00 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3891lb # [ 36.267504] niks3-server[993]: 2026/09/20 09:01:00 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3892worker2 # [ 36.240029] nix-grpc-daemon[847]: time=2026-09-20T09:01:00.822Z level=INFO msg="Upload complete. (322ms)"3893lb # [ 36.273859] niks3-server[993]: 2026/09/20 09:01:00 INFO Completed upload id=43894lb # [ 36.278120] niks3-server[993]: 2026/09/20 09:01:00 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3895worker2 # [ 36.248498] nix-grpc-daemon[774]: ts=2026-09-20T09:01:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13896worker2 # [ 36.258319] nix-grpc-daemon[774]: ts=2026-09-20T09:01:00Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03897worker2 # [ 36.261337] nix-grpc-daemon[774]: ts=2026-09-20T09:01:00Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=13898worker2 # [ 36.264207] nix-daemon[836]: reaped child process 907, status = succeeded3899worker2 # [ 36.303000] nix-grpc-daemon[774]: ts=2026-09-20T09:01:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525463900worker2 # [ 36.315904] nix-grpc-daemon[774]: ts=2026-09-20T09:01:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525463901worker2 # [ 36.328243] nix-grpc-daemon[847]: time=2026-09-20T09:01:00.910Z level=INFO msg="All 2 paths already cached"3902client # copying 1 paths to 'lb:50051'...3903client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3904worker2 # [ 36.338072] nix-grpc-daemon[774]: ts=2026-09-20T09:01:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:525463905worker2 # [ 36.354797] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3906worker2 # [ 36.553913] nix-daemon[836]: accepted connection from pid 934, user nix-grpc-daemon (trusted)3907worker2 # [ 36.575386] nix-daemon[836]: reaped child process 937, status = succeeded3908worker2 # [ 36.749738] nix-daemon[836]: accepted connection from pid 939, user nix-grpc-daemon (trusted)3909worker2 # [ 36.768802] nix-daemon[836]: reaped child process 942, status = succeeded3910lb # [ 36.812836] niks3-server[993]: 2026/09/20 09:01:01 INFO Received uploads request method=POST path=/api/pending_closures3911worker2 # [ 36.789024] nix-grpc-daemon[847]: time=2026-09-20T09:01:01.371Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3912worker2 # [ 36.790507] nix-grpc-daemon[847]: time=2026-09-20T09:01:01.371Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3913lb # [ 36.839617] niks3-server[993]: 2026/09/20 09:01:01 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3914worker2 # [ 36.819889] nix-grpc-daemon[847]: time=2026-09-20T09:01:01.402Z level=INFO msg="Uploading 1 narinfos"3915lb # [ 36.855184] niks3-server[993]: 2026/09/20 09:01:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3916lb # [ 36.866594] niks3-server[993]: 2026/09/20 09:01:01 INFO Signed narinfos id=5 count=13917lb # [ 36.874738] niks3-server[993]: 2026/09/20 09:01:01 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3918lb # [ 36.925684] niks3-server[993]: 2026/09/20 09:01:01 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3919lb # [ 36.933327] niks3-server[993]: 2026/09/20 09:01:01 INFO Completed upload id=53920worker2 # [ 36.900536] nix-grpc-daemon[847]: time=2026-09-20T09:01:01.483Z level=INFO msg="Upload complete. (530ms)"3921lb # [ 36.937411] niks3-server[993]: 2026/09/20 09:01:01 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3922worker2 # [ 36.912415] nix-grpc-daemon[774]: ts=2026-09-20T09:01:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=0 paths=1 nar_bytes_in=7523923worker2 # [ 36.930967] nix-grpc-daemon[774]: ts=2026-09-20T09:01:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525463924worker2 # [ 36.939721] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3925worker2 # [ 36.947874] nix-daemon[836]: reaped child process 932, status = succeeded3926client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3927client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3928worker2 # [ 36.966600] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3929client # farm-top> LOG-farm-top-t13930worker2 # [ 38.395707] nix-daemon[836]: reaped child process 946, status = succeeded3931worker2 # [ 38.557332] nix-daemon[836]: accepted connection from pid 961, user nix-grpc-daemon (trusted)3932worker2 # [ 38.577331] nix-daemon[836]: reaped child process 964, status = succeeded3933lb # [ 38.625576] niks3-server[993]: 2026/09/20 09:01:03 INFO Received uploads request method=POST path=/api/pending_closures3934worker2 # [ 38.604445] nix-grpc-daemon[847]: time=2026-09-20T09:01:03.185Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3935worker2 # [ 38.605929] nix-grpc-daemon[847]: time=2026-09-20T09:01:03.185Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3936lb # [ 38.661938] niks3-server[993]: 2026/09/20 09:01:03 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3937lb # [ 38.679545] niks3-server[993]: 2026/09/20 09:01:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3938worker2 # [ 38.652109] nix-grpc-daemon[847]: time=2026-09-20T09:01:03.234Z level=INFO msg="Uploading 1 narinfos"3939lb # [ 38.690677] niks3-server[993]: 2026/09/20 09:01:03 INFO Signed narinfos id=6 count=13940lb # [ 38.695267] niks3-server[993]: 2026/09/20 09:01:03 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3941lb # [ 38.702243] niks3-server[993]: 2026/09/20 09:01:03 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3942lb # [ 38.711485] niks3-server[993]: 2026/09/20 09:01:03 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3943lb # [ 38.716916] niks3-server[993]: 2026/09/20 09:01:03 INFO Completed upload id=63944worker2 # [ 38.684183] nix-grpc-daemon[847]: time=2026-09-20T09:01:03.266Z level=INFO msg="Upload complete. (304ms)"3945lb # [ 38.719391] niks3-server[993]: 2026/09/20 09:01:03 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3946worker2 # [ 38.697284] nix-grpc-daemon[774]: ts=2026-09-20T09:01:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13947worker2 # [ 38.712803] nix-daemon[836]: reaped child process 944, status = succeeded3948client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.01 seconds)3949client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3950client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds)3951client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3952client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds)3953client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3954client # copying 3 paths...3955client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3956client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3957client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3958client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.34 seconds)3959(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.73 seconds)3960subtest: repeat is answered Cached by the scheduler without building3961worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3962worker1 # finding garbage collector roots...3963worker1 # deleting specified paths...3964worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3965worker1 # deleting unused links...3966worker1 # note: hard linking is currently saving 0.0 KiB3967worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)3968worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3969worker2 # finding garbage collector roots...3970worker2 # deleting specified paths...3971worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3972worker2 # deleting unused links...3973worker2 # note: hard linking is currently saving 0.0 KiB3974worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.27 seconds)3975client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23976worker2 # [ 40.300221] nix-grpc-daemon[774]: ts=2026-09-20T09:01:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:525463977client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):3978client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3979worker2 # [ 40.318934] nix-grpc-daemon[774]: ts=2026-09-20T09:01:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525463980worker2 # [ 40.365742] nix-grpc-daemon[847]: time=2026-09-20T09:01:04.947Z level=INFO msg="All 2 paths already cached"3981worker2 # [ 40.384865] nix-grpc-daemon[774]: ts=2026-09-20T09:01:04Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=13982client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.39 seconds)3983client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3984client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds)3985lb: must succeed: curl -sf localhost:9901/clusters3986lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3987lb: must succeed: curl -sf localhost:9901/clusters3988lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3989worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true3990worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.08 seconds)3991(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.53 seconds)3992subtest: inputs already in the cache are not sent to the scheduler3993lb: must succeed: curl -sf localhost:9901/clusters3994lb # [ 41.059625] envoy[910]: conn peer=[2001:db8:1::1]:55600 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=913995lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3996lb: must succeed: curl -sf localhost:9901/clusters3997lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3998worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true3999worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4000client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24001worker2 # [ 41.483460] nix-grpc-daemon[774]: ts=2026-09-20T09:01:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:525464002client # don't know how to build these paths:4003client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4004worker1 # [ 41.533999] nix-grpc-daemon[779]: ts=2026-09-20T09:01:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370624005worker2 # [ 41.524757] nix-grpc-daemon[774]: ts=2026-09-20T09:01:06Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04006worker2 # [ 41.531705] nix-grpc-daemon[774]: ts=2026-09-20T09:01:06Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=14007worker2 # [ 41.540285] nix-grpc-daemon[774]: ts=2026-09-20T09:01:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525464008worker2 # [ 41.551661] nix-grpc-daemon[774]: ts=2026-09-20T09:01:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525464009worker2 # [ 41.570094] nix-grpc-daemon[847]: time=2026-09-20T09:01:06.151Z level=INFO msg="All 2 paths already cached"4010client # copying 1 paths to 'lb:50051'...4011client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4012worker2 # [ 41.580740] nix-grpc-daemon[774]: ts=2026-09-20T09:01:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:525464013worker2 # [ 41.595656] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4014lb # [ 41.067554] envoy[910]: conn peer=[2001:db8:1::1]:55612 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=134015lb # [ 41.067706] envoy[910]: conn peer=[2001:db8:1::1]:55620 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=124016lb # [ 41.067822] envoy[910]: conn peer=[2001:db8:1::1]:55626 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9562 tx=3867 ms=67714017lb # [ 41.067968] envoy[910]: conn peer=[2001:db8:1::1]:55632 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=1094018worker2 # [ 41.797490] nix-daemon[836]: accepted connection from pid 996, user nix-grpc-daemon (trusted)4019worker2 # [ 41.816908] nix-daemon[836]: reaped child process 999, status = succeeded4020worker2 # [ 41.991858] nix-daemon[836]: accepted connection from pid 1001, user nix-grpc-daemon (trusted)4021worker2 # [ 42.009912] nix-daemon[836]: reaped child process 1004, status = succeeded4022lb # [ 42.055754] niks3-server[993]: 2026/09/20 09:01:06 INFO Received uploads request method=POST path=/api/pending_closures4023worker2 # [ 42.032729] nix-grpc-daemon[847]: time=2026-09-20T09:01:06.615Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4024worker2 # [ 42.034277] nix-grpc-daemon[847]: time=2026-09-20T09:01:06.615Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4025lb # [ 42.084599] niks3-server[993]: 2026/09/20 09:01:06 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4026worker2 # [ 42.066237] nix-grpc-daemon[847]: time=2026-09-20T09:01:06.648Z level=INFO msg="Uploading 1 narinfos"4027lb # [ 42.099220] niks3-server[993]: 2026/09/20 09:01:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4028lb # [ 42.110287] niks3-server[993]: 2026/09/20 09:01:06 INFO Signed narinfos id=7 count=14029lb # [ 42.120120] niks3-server[993]: 2026/09/20 09:01:06 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4030worker2 # [ 42.093347] nix-grpc-daemon[847]: time=2026-09-20T09:01:06.675Z level=INFO msg="Upload complete. (481ms)"4031lb # [ 42.126976] niks3-server[993]: 2026/09/20 09:01:06 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4032lb # [ 42.132726] niks3-server[993]: 2026/09/20 09:01:06 INFO Completed upload id=74033worker2 # [ 42.099535] nix-grpc-daemon[774]: ts=2026-09-20T09:01:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=0 paths=1 nar_bytes_in=7524034lb # [ 42.136086] niks3-server[993]: 2026/09/20 09:01:06 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4035worker2 # [ 42.111813] nix-grpc-daemon[774]: ts=2026-09-20T09:01:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525464036worker2 # [ 42.118145] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4037worker2 # [ 42.122730] nix-daemon[836]: reaped child process 994, status = succeeded4038client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4039client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4040worker2 # [ 42.135485] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4041client # farm-top> LOG-farm-top-t1b4042worker2 # [ 42.963420] nix-daemon[836]: reaped child process 1008, status = succeeded4043worker2 # [ 43.125639] nix-daemon[836]: accepted connection from pid 1024, user nix-grpc-daemon (trusted)4044worker2 # [ 43.145380] nix-daemon[836]: reaped child process 1027, status = succeeded4045lb # [ 43.194681] niks3-server[993]: 2026/09/20 09:01:07 INFO Received uploads request method=POST path=/api/pending_closures4046worker2 # [ 43.172406] nix-grpc-daemon[847]: time=2026-09-20T09:01:07.754Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4047worker2 # [ 43.173894] nix-grpc-daemon[847]: time=2026-09-20T09:01:07.754Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4048lb # [ 43.232348] niks3-server[993]: 2026/09/20 09:01:07 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4049lb # [ 43.244741] niks3-server[993]: 2026/09/20 09:01:07 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4050worker2 # [ 43.224667] nix-grpc-daemon[847]: time=2026-09-20T09:01:07.807Z level=INFO msg="Uploading 1 narinfos"4051lb # [ 43.260005] niks3-server[993]: 2026/09/20 09:01:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4052lb # [ 43.270867] niks3-server[993]: 2026/09/20 09:01:07 INFO Signed narinfos id=8 count=14053lb # [ 43.274485] niks3-server[993]: 2026/09/20 09:01:07 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4054lb # [ 43.282340] niks3-server[993]: 2026/09/20 09:01:07 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4055lb # [ 43.286772] niks3-server[993]: 2026/09/20 09:01:07 INFO Completed upload id=84056worker2 # [ 43.253764] nix-grpc-daemon[847]: time=2026-09-20T09:01:07.836Z level=INFO msg="Upload complete. (309ms)"4057lb # [ 43.289283] niks3-server[993]: 2026/09/20 09:01:07 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4058worker2 # [ 43.265130] nix-grpc-daemon[774]: ts=2026-09-20T09:01:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14059worker2 # [ 43.282986] nix-daemon[836]: reaped child process 1006, status = succeeded4060client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.11 seconds)4061client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4062client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.25 seconds)4063lb: must succeed: curl -sf localhost:9901/clusters4064lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4065lb: must succeed: curl -sf localhost:9901/clusters4066lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4067worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4068worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4069(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.77 seconds)4070subtest: two clients wanting the same drv build it once4071client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4072client # [ 43.842044] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4073client # Running as unit: dedup1.service; invocation ID: b9ae231ee6c34c58a017468119d0dd844074client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4075client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4076client # [ 44.096945] nix[875]: don't know how to build these paths:4077client # [ 44.097922] nix[875]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4078worker2 # [ 44.096295] nix-grpc-daemon[774]: ts=2026-09-20T09:01:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:525464079worker2 # [ 44.110020] nix-grpc-daemon[774]: ts=2026-09-20T09:01:08Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04080worker2 # [ 44.116417] nix-grpc-daemon[774]: ts=2026-09-20T09:01:08Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14081worker1 # [ 44.158973] nix-grpc-daemon[779]: ts=2026-09-20T09:01:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370624082worker1 # [ 44.176139] nix-grpc-daemon[779]: ts=2026-09-20T09:01:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370624083client # [ 44.149955] nix[875]: copying 1 paths to 'lb:50051'...4084client # [ 44.152850] nix[875]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4085worker1 # [ 44.192492] nix-grpc-daemon[779]: ts=2026-09-20T09:01:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:370624086worker1 # [ 44.210018] nix-daemon[835]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4087worker1 # [ 44.236609] nix-grpc-daemon[779]: ts=2026-09-20T09:01:08Z level=info event=niks3_push_started pid=8624088worker1 # [ 44.702798] nix-daemon[835]: accepted connection from pid 875, user nix-grpc-daemon (trusted)4089worker1 # [ 44.724421] nix-daemon[835]: reaped child process 878, status = succeeded4090worker1 # [ 44.900769] nix-daemon[835]: accepted connection from pid 880, user nix-grpc-daemon (trusted)4091worker1 # [ 44.919160] nix-daemon[835]: reaped child process 883, status = succeeded4092lb # [ 44.927843] niks3-server[993]: 2026/09/20 09:01:09 INFO Received uploads request method=POST path=/api/pending_closures4093worker1 # [ 44.945179] nix-grpc-daemon[862]: time=2026-09-20T09:01:09.526Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4094worker1 # [ 44.947208] nix-grpc-daemon[862]: time=2026-09-20T09:01:09.526Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4095lb # [ 44.967696] niks3-server[993]: 2026/09/20 09:01:09 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4096worker1 # [ 44.991728] nix-grpc-daemon[862]: time=2026-09-20T09:01:09.574Z level=INFO msg="Uploading 1 narinfos"4097lb # [ 44.981008] niks3-server[993]: 2026/09/20 09:01:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4098lb # [ 44.993665] niks3-server[993]: 2026/09/20 09:01:09 INFO Signed narinfos id=9 count=14099lb # [ 44.999499] niks3-server[993]: 2026/09/20 09:01:09 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4100client # [ 44.961593] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4101lb # [ 45.012858] niks3-server[993]: 2026/09/20 09:01:09 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4102client # Running as unit: dedup2.service; invocation ID: 9844d9dcf9d5445d877d0a34486b1ae04103worker1 # [ 45.022614] nix-grpc-daemon[862]: time=2026-09-20T09:01:09.605Z level=INFO msg="Upload complete. (507ms)"4104lb # [ 45.020067] niks3-server[993]: 2026/09/20 09:01:09 INFO Completed upload id=94105lb # [ 45.024296] niks3-server[993]: 2026/09/20 09:01:09 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4106client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4107worker1 # [ 45.032337] nix-grpc-daemon[779]: ts=2026-09-20T09:01:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37062 duration_s=0 paths=1 nar_bytes_in=4324108worker1 # [ 45.046563] nix-grpc-daemon[779]: ts=2026-09-20T09:01:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370624109worker1 # [ 45.055883] nix-daemon[835]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4110worker1 # [ 45.063909] nix-daemon[835]: reaped child process 860, status = succeeded4111client # [ 45.039763] nix[875]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4112worker1 # [ 45.085255] nix-daemon[835]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4113client # [ 45.303864] nix[890]: don't know how to build these paths:4114client # [ 45.305212] nix[890]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4115worker2 # [ 45.303751] nix-grpc-daemon[774]: ts=2026-09-20T09:01:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:525464116worker2 # [ 45.316980] nix-grpc-daemon[774]: ts=2026-09-20T09:01:09Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04117worker1 # [ 45.361618] nix-grpc-daemon[779]: ts=2026-09-20T09:01:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370624118client # [ 45.330258] nix[890]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4119client: must succeed: sleep 24120client: (finished: must succeed: sleep 2, in 2.06 seconds)4121worker1 # [ 49.714874] nix-daemon[835]: reaped child process 891, status = succeeded4122??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4123 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394124client: waiting for success: ! systemctl is-active dedup1 dedup24125??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4126 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394127worker1 # [ 49.870975] nix-daemon[835]: accepted connection from pid 921, user nix-grpc-daemon (trusted)4128worker1 # [ 49.887538] nix-daemon[835]: reaped child process 924, status = succeeded4129lb # [ 49.898027] niks3-server[993]: 2026/09/20 09:01:14 INFO Received uploads request method=POST path=/api/pending_closures4130worker1 # [ 49.912175] nix-grpc-daemon[862]: time=2026-09-20T09:01:14.494Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4131worker1 # [ 49.913905] nix-grpc-daemon[862]: time=2026-09-20T09:01:14.494Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4132lb # [ 49.939967] niks3-server[993]: 2026/09/20 09:01:14 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4133lb # [ 49.952975] niks3-server[993]: 2026/09/20 09:01:14 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4134lb # [ 49.960957] niks3-server[993]: 2026/09/20 09:01:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4135lb # [ 49.966986] niks3-server[993]: 2026/09/20 09:01:14 INFO Signed narinfos id=10 count=14136worker1 # [ 49.972152] nix-grpc-daemon[862]: time=2026-09-20T09:01:14.554Z level=INFO msg="Uploading 1 narinfos"4137lb # [ 49.969910] niks3-server[993]: 2026/09/20 09:01:14 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4138lb # [ 49.982443] niks3-server[993]: 2026/09/20 09:01:14 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4139lb # [ 49.987677] niks3-server[993]: 2026/09/20 09:01:14 INFO Completed upload id=104140worker1 # [ 49.991427] nix-grpc-daemon[862]: time=2026-09-20T09:01:14.574Z level=INFO msg="Upload complete. (289ms)"4141lb # [ 49.990458] niks3-server[993]: 2026/09/20 09:01:14 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4142worker1 # [ 50.000973] nix-grpc-daemon[779]: ts=2026-09-20T09:01:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37062 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14143worker1 # [ 50.016657] nix-grpc-daemon[779]: ts=2026-09-20T09:01:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37062 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14144worker1 # [ 50.022112] nix-daemon[835]: reaped child process 888, status = succeeded4145client # [ 50.006445] systemd[1]: dedup1.service: Deactivated successfully.4146client # [ 50.014745] systemd[1]: dedup1.service: Consumed 156ms CPU time over 6.169s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.4147client # [ 50.056703] systemd[1]: dedup2.service: Deactivated successfully.4148client # [ 50.061120] systemd[1]: dedup2.service: Consumed 197ms CPU time over 5.098s wall clock time, 33M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic.4149client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4150client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4151client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4152worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4153worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4154worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4155lb # [ 51.055789] envoy[910]: conn peer=[2001:db8:1::1]:40216 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4142 tx=1713 ms=18334156lb # [ 51.060845] envoy[910]: conn peer=[2001:db8:1::1]:40230 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2962 tx=1355 ms=58844157lb # [ 51.067224] envoy[910]: conn peer=[2001:db8:1::1]:40238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=47334158worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4159worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4160worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.10 seconds)4161worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4162worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4163(finished: subtest: two clients wanting the same drv build it once, in 7.50 seconds)4164subtest: build hook: nix-daemon with builders = grpc://lb4165client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4166client # [ 51.508612] systemd[1]: Started Nix Daemon.4167client # [ 51.695162] nix-daemon[932]: accepted connection from pid 929, user root (trusted)4168worker2 # [ 51.899617] nix-grpc-daemon[774]: ts=2026-09-20T09:01:16Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:525464169worker1 # [ 51.942962] nix-grpc-daemon[779]: ts=2026-09-20T09:01:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370624170worker2 # [ 51.925719] nix-grpc-daemon[774]: ts=2026-09-20T09:01:16Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04171worker2 # [ 51.932828] nix-grpc-daemon[774]: ts=2026-09-20T09:01:16Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14172worker2 # [ 51.970899] nix-grpc-daemon[774]: ts=2026-09-20T09:01:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525464173worker2 # [ 51.988155] nix-grpc-daemon[774]: ts=2026-09-20T09:01:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525464174worker2 # [ 52.003246] nix-grpc-daemon[774]: ts=2026-09-20T09:01:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:525464175worker2 # [ 52.018385] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4176worker2 # [ 52.226067] nix-daemon[836]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4177worker2 # [ 52.249002] nix-daemon[836]: reaped child process 1073, status = succeeded4178worker2 # [ 52.427445] nix-daemon[836]: accepted connection from pid 1075, user nix-grpc-daemon (trusted)4179worker2 # [ 52.445515] nix-daemon[836]: reaped child process 1078, status = succeeded4180lb # [ 52.493402] niks3-server[993]: 2026/09/20 09:01:17 INFO Received uploads request method=POST path=/api/pending_closures4181worker2 # [ 52.471564] nix-grpc-daemon[847]: time=2026-09-20T09:01:17.053Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4182worker2 # [ 52.473254] nix-grpc-daemon[847]: time=2026-09-20T09:01:17.053Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4183lb # [ 52.523768] niks3-server[993]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4184lb # [ 52.541145] niks3-server[993]: 2026/09/20 09:01:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4185worker2 # [ 52.514087] nix-grpc-daemon[847]: time=2026-09-20T09:01:17.096Z level=INFO msg="Uploading 1 narinfos"4186lb # [ 52.551286] niks3-server[993]: 2026/09/20 09:01:17 INFO Signed narinfos id=11 count=14187lb # [ 52.557407] niks3-server[993]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4188lb # [ 52.570361] niks3-server[993]: 2026/09/20 09:01:17 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4189lb # [ 52.576270] niks3-server[993]: 2026/09/20 09:01:17 INFO Completed upload id=114190worker2 # [ 52.542464] nix-grpc-daemon[847]: time=2026-09-20T09:01:17.125Z level=INFO msg="Upload complete. (507ms)"4191lb # [ 52.580140] niks3-server[993]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4192worker2 # [ 52.552825] nix-grpc-daemon[774]: ts=2026-09-20T09:01:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=0 paths=1 nar_bytes_in=5124193worker2 # [ 52.563865] nix-grpc-daemon[774]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525464194worker2 # [ 52.571239] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4195worker2 # [ 52.576083] nix-daemon[836]: reaped child process 1068, status = succeeded4196worker2 # [ 52.586992] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4197worker2 # [ 53.630844] nix-daemon[836]: reaped child process 1082, status = succeeded4198worker2 # [ 53.822358] nix-daemon[836]: accepted connection from pid 1097, user nix-grpc-daemon (trusted)4199worker2 # [ 53.841359] nix-daemon[836]: reaped child process 1100, status = succeeded4200lb # [ 53.890198] niks3-server[993]: 2026/09/20 09:01:18 INFO Received uploads request method=POST path=/api/pending_closures4201worker2 # [ 53.872532] nix-grpc-daemon[847]: time=2026-09-20T09:01:18.451Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4202worker2 # [ 53.874073] nix-grpc-daemon[847]: time=2026-09-20T09:01:18.451Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4203lb # [ 53.933953] niks3-server[993]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4204lb # [ 53.948636] niks3-server[993]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4205lb # [ 53.958033] niks3-server[993]: 2026/09/20 09:01:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4206worker2 # [ 53.930505] nix-grpc-daemon[847]: time=2026-09-20T09:01:18.512Z level=INFO msg="Uploading 1 narinfos"4207lb # [ 53.967526] niks3-server[993]: 2026/09/20 09:01:18 INFO Signed narinfos id=12 count=14208lb # [ 53.972808] niks3-server[993]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4209lb # [ 53.981804] niks3-server[993]: 2026/09/20 09:01:18 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4210lb # [ 53.988527] niks3-server[993]: 2026/09/20 09:01:18 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4211lb # [ 53.994137] niks3-server[993]: 2026/09/20 09:01:18 INFO Completed upload id=124212worker2 # [ 53.961367] nix-grpc-daemon[847]: time=2026-09-20T09:01:18.543Z level=INFO msg="Upload complete. (361ms)"4213worker1 # [ 54.015851] nix-grpc-daemon[779]: ts=2026-09-20T09:01:18Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:370624214worker2 # [ 53.977264] nix-grpc-daemon[774]: ts=2026-09-20T09:01:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14215worker2 # [ 53.994369] nix-daemon[836]: reaped child process 1080, status = succeeded4216worker1 # [ 54.035214] nix-grpc-daemon[779]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4217worker2 # [ 54.048129] nix-grpc-daemon[774]: ts=2026-09-20T09:01:18Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:525464218worker2 # [ 54.056079] nix-grpc-daemon[774]: ts=2026-09-20T09:01:18Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=0 paths=1 nar_bytes_out=1284219worker1 # [ 54.363379] nix-grpc-daemon[779]: ts=2026-09-20T09:01:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:370624220worker1 # [ 54.371897] nix-grpc-daemon[779]: ts=2026-09-20T09:01:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370624221worker1 # [ 54.379981] nix-grpc-daemon[862]: time=2026-09-20T09:01:18.960Z level=INFO msg="All 1 paths already cached"4222worker2 # [ 54.355646] nix-grpc-daemon[774]: ts=2026-09-20T09:01:18Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04223worker2 # [ 54.363167] nix-grpc-daemon[774]: ts=2026-09-20T09:01:18Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14224worker2 # [ 54.404699] nix-grpc-daemon[774]: ts=2026-09-20T09:01:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525464225worker2 # [ 54.421953] nix-grpc-daemon[774]: ts=2026-09-20T09:01:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525464226worker2 # [ 54.439981] nix-grpc-daemon[847]: time=2026-09-20T09:01:19.022Z level=INFO msg="All 1 paths already cached"4227worker2 # [ 54.450850] nix-grpc-daemon[774]: ts=2026-09-20T09:01:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:525464228worker2 # [ 54.465819] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4229worker2 # [ 54.681267] nix-daemon[836]: accepted connection from pid 1106, user nix-grpc-daemon (trusted)4230worker2 # [ 54.702707] nix-daemon[836]: reaped child process 1109, status = succeeded4231worker2 # [ 54.881801] nix-daemon[836]: accepted connection from pid 1111, user nix-grpc-daemon (trusted)4232worker2 # [ 54.901554] nix-daemon[836]: reaped child process 1114, status = succeeded4233lb # [ 54.950021] niks3-server[993]: 2026/09/20 09:01:19 INFO Received uploads request method=POST path=/api/pending_closures4234worker2 # [ 54.928911] nix-grpc-daemon[847]: time=2026-09-20T09:01:19.510Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4235worker2 # [ 54.930458] nix-grpc-daemon[847]: time=2026-09-20T09:01:19.510Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4236worker2 # [ 54.969560] nix-grpc-daemon[847]: time=2026-09-20T09:01:19.551Z level=INFO msg="Uploading 1 narinfos"4237lb # [ 54.993974] niks3-server[993]: 2026/09/20 09:01:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4238lb # [ 55.008937] niks3-server[993]: 2026/09/20 09:01:19 INFO Signed narinfos id=13 count=14239lb # [ 55.018788] niks3-server[993]: 2026/09/20 09:01:19 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4240lb # [ 55.233504] niks3-server[993]: 2026/09/20 09:01:19 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4241lb # [ 55.245980] niks3-server[993]: 2026/09/20 09:01:19 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4242lb # [ 55.253706] niks3-server[993]: 2026/09/20 09:01:19 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4243lb # [ 55.265435] niks3-server[993]: 2026/09/20 09:01:19 INFO Completed upload id=134244worker2 # [ 55.232908] nix-grpc-daemon[847]: time=2026-09-20T09:01:19.815Z level=INFO msg="Upload complete. (748ms)"4245worker2 # [ 55.246074] nix-grpc-daemon[774]: ts=2026-09-20T09:01:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=0 paths=1 nar_bytes_in=6244246worker2 # [ 55.261211] nix-grpc-daemon[774]: ts=2026-09-20T09:01:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525464247worker2 # [ 55.275891] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4248worker2 # [ 55.284775] nix-daemon[836]: reaped child process 1104, status = succeeded4249worker2 # [ 55.302526] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4250worker2 # [ 56.568286] nix-daemon[836]: reaped child process 1118, status = succeeded4251worker2 # [ 56.764275] nix-daemon[836]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)4252worker2 # [ 56.782839] nix-daemon[836]: reaped child process 1136, status = succeeded4253lb # [ 56.835962] niks3-server[993]: 2026/09/20 09:01:21 INFO Received uploads request method=POST path=/api/pending_closures4254worker2 # [ 56.816467] nix-grpc-daemon[847]: time=2026-09-20T09:01:21.397Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4255worker2 # [ 56.817957] nix-grpc-daemon[847]: time=2026-09-20T09:01:21.397Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4256lb # [ 56.880257] niks3-server[993]: 2026/09/20 09:01:21 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4257lb # [ 56.896158] niks3-server[993]: 2026/09/20 09:01:21 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4258lb # [ 56.915385] niks3-server[993]: 2026/09/20 09:01:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4259worker2 # [ 56.888870] nix-grpc-daemon[847]: time=2026-09-20T09:01:21.471Z level=INFO msg="Uploading 1 narinfos"4260lb # [ 56.928441] niks3-server[993]: 2026/09/20 09:01:21 INFO Signed narinfos id=14 count=14261lb # [ 56.935165] niks3-server[993]: 2026/09/20 09:01:21 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4262lb # [ 56.944439] niks3-server[993]: 2026/09/20 09:01:21 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4263lb # [ 56.953883] niks3-server[993]: 2026/09/20 09:01:21 INFO Completed upload id=144264worker2 # [ 56.921209] nix-grpc-daemon[847]: time=2026-09-20T09:01:21.503Z level=INFO msg="Upload complete. (403ms)"4265lb # [ 56.956580] niks3-server[993]: 2026/09/20 09:01:21 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4266worker2 # [ 56.937748] nix-grpc-daemon[774]: ts=2026-09-20T09:01:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14267worker2 # [ 56.961722] nix-daemon[836]: reaped child process 1116, status = succeeded4268worker1 # [ 57.021694] nix-grpc-daemon[779]: ts=2026-09-20T09:01:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:370624269worker1 # [ 57.040498] nix-grpc-daemon[779]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4270worker1 # [ 57.096309] nix-grpc-daemon[779]: ts=2026-09-20T09:01:21Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:370624271worker1 # [ 57.104587] nix-grpc-daemon[779]: ts=2026-09-20T09:01:21Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37062 duration_s=0 paths=1 nar_bytes_out=1764272worker1 # [ 57.465477] nix-grpc-daemon[779]: ts=2026-09-20T09:01:22Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:370624273worker2 # [ 57.434184] nix-grpc-daemon[774]: ts=2026-09-20T09:01:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525464274worker2 # [ 57.446838] nix-grpc-daemon[847]: time=2026-09-20T09:01:22.029Z level=INFO msg="All 2 paths already cached"4275worker2 # [ 57.470805] nix-grpc-daemon[774]: ts=2026-09-20T09:01:22Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04276worker2 # [ 57.479285] nix-grpc-daemon[774]: ts=2026-09-20T09:01:22Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14277worker2 # [ 57.490532] nix-grpc-daemon[774]: ts=2026-09-20T09:01:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525464278worker2 # [ 57.505617] nix-grpc-daemon[774]: ts=2026-09-20T09:01:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525464279worker2 # [ 57.530210] nix-grpc-daemon[847]: time=2026-09-20T09:01:22.112Z level=INFO msg="All 2 paths already cached"4280worker2 # [ 57.542651] nix-grpc-daemon[774]: ts=2026-09-20T09:01:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:525464281worker2 # [ 57.560665] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4282worker2 # [ 57.786237] nix-daemon[836]: accepted connection from pid 1142, user nix-grpc-daemon (trusted)4283worker2 # [ 57.806937] nix-daemon[836]: reaped child process 1145, status = succeeded4284worker2 # [ 57.989456] nix-daemon[836]: accepted connection from pid 1147, user nix-grpc-daemon (trusted)4285worker2 # [ 58.009201] nix-daemon[836]: reaped child process 1150, status = succeeded4286lb # [ 58.055019] niks3-server[993]: 2026/09/20 09:01:22 INFO Received uploads request method=POST path=/api/pending_closures4287worker2 # [ 58.032312] nix-grpc-daemon[847]: time=2026-09-20T09:01:22.614Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4288worker2 # [ 58.033826] nix-grpc-daemon[847]: time=2026-09-20T09:01:22.614Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4289lb # [ 58.086795] niks3-server[993]: 2026/09/20 09:01:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4290worker2 # [ 58.062738] nix-grpc-daemon[847]: time=2026-09-20T09:01:22.645Z level=INFO msg="Uploading 1 narinfos"4291lb # [ 58.100109] niks3-server[993]: 2026/09/20 09:01:22 INFO Signed narinfos id=15 count=14292lb # [ 58.108359] niks3-server[993]: 2026/09/20 09:01:22 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4293worker2 # [ 58.088376] nix-grpc-daemon[847]: time=2026-09-20T09:01:22.670Z level=INFO msg="Upload complete. (508ms)"4294lb # [ 58.121988] niks3-server[993]: 2026/09/20 09:01:22 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4295worker2 # [ 58.096848] nix-grpc-daemon[774]: ts=2026-09-20T09:01:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=0 paths=1 nar_bytes_in=7524296lb # [ 58.129892] niks3-server[993]: 2026/09/20 09:01:22 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4297lb # [ 58.135784] niks3-server[993]: 2026/09/20 09:01:22 INFO Completed upload id=154298worker2 # [ 58.104315] nix-grpc-daemon[774]: ts=2026-09-20T09:01:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525464299lb # [ 58.138647] niks3-server[993]: 2026/09/20 09:01:22 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4300worker2 # [ 58.116858] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4301worker2 # [ 58.119416] nix-daemon[836]: reaped child process 1140, status = succeeded4302worker2 # [ 58.131786] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4303worker2 # [ 59.154794] nix-daemon[836]: reaped child process 1154, status = succeeded4304worker2 # [ 59.316987] nix-daemon[836]: accepted connection from pid 1169, user nix-grpc-daemon (trusted)4305worker2 # [ 59.339033] nix-daemon[836]: reaped child process 1172, status = succeeded4306lb # [ 59.386405] niks3-server[993]: 2026/09/20 09:01:23 INFO Received uploads request method=POST path=/api/pending_closures4307worker2 # [ 59.364610] nix-grpc-daemon[847]: time=2026-09-20T09:01:23.944Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4308worker2 # [ 59.368861] nix-grpc-daemon[847]: time=2026-09-20T09:01:23.944Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4309lb # [ 59.426427] niks3-server[993]: 2026/09/20 09:01:24 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4310worker2 # [ 59.407506] nix-grpc-daemon[847]: time=2026-09-20T09:01:23.989Z level=INFO msg="Uploading 1 narinfos"4311lb # [ 59.443510] niks3-server[993]: 2026/09/20 09:01:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4312lb # [ 59.453636] niks3-server[993]: 2026/09/20 09:01:24 INFO Signed narinfos id=16 count=14313lb # [ 59.455992] niks3-server[993]: 2026/09/20 09:01:24 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4314lb # [ 59.463928] niks3-server[993]: 2026/09/20 09:01:24 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4315lb # [ 59.470971] niks3-server[993]: 2026/09/20 09:01:24 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4316lb # [ 59.476054] niks3-server[993]: 2026/09/20 09:01:24 INFO Completed upload id=164317worker2 # [ 59.442336] nix-grpc-daemon[847]: time=2026-09-20T09:01:24.024Z level=INFO msg="Upload complete. (301ms)"4318lb # [ 59.478495] niks3-server[993]: 2026/09/20 09:01:24 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4319worker2 # [ 59.453535] nix-grpc-daemon[774]: ts=2026-09-20T09:01:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14320worker2 # [ 59.470080] nix-grpc-daemon[774]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:525464321worker2 # [ 59.473960] nix-daemon[836]: reaped child process 1152, status = succeeded4322worker1 # [ 59.529027] nix-grpc-daemon[779]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:370624323worker1 # [ 59.543194] nix-grpc-daemon[779]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4324worker1 # [ 59.560882] nix-grpc-daemon[779]: ts=2026-09-20T09:01:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37062 duration_s=0 paths=1 nar_bytes_out=2324325client # [ 59.659016] nix-daemon[932]: reaped child process 934, status = succeeded4326client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.41 seconds)4327client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4328client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4329client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4330client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4331client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4332client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4333(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.54 seconds)4334subtest: an input only one worker has still reaches the builder4335client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4336client # this derivation will be built:4337client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4338client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4339client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.43 seconds)4340client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4341client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds)4342worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4343worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds)4344worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4345worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4346client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24347client # [ 60.952262] nix-daemon[932]: accepted connection from pid 1012, user root (trusted)4348client # this derivation will be built:4349client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4350lb # [ 61.057728] envoy[910]: conn peer=[2001:db8:1::1]:47094 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=324351lb # [ 61.062650] envoy[910]: conn peer=[2001:db8:1::1]:47092 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3391 tx=1777 ms=21764352lb # [ 61.067698] envoy[910]: conn peer=[2001:db8:1::1]:47108 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3905 tx=2008 ms=28064353lb # [ 61.074449] envoy[910]: conn peer=[2001:db8:1::1]:47120 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=824354lb # [ 61.079172] envoy[910]: conn peer=[2001:db8:1::1]:47134 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4326 tx=2112 ms=21574355lb # [ 61.083966] envoy[910]: conn peer=[2001:db8:1::1]:47150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=407 ms=984356worker1 # [ 61.191485] nix-grpc-daemon[779]: ts=2026-09-20T09:01:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:370624357client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4358worker1 # [ 61.199753] nix-grpc-daemon[779]: ts=2026-09-20T09:01:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370624359worker1 # [ 61.401934] nix-daemon[835]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4360worker1 # [ 61.418769] nix-daemon[835]: reaped child process 948, status = succeeded4361lb # [ 61.431615] niks3-server[993]: 2026/09/20 09:01:26 INFO Received uploads request method=POST path=/api/pending_closures4362worker1 # [ 61.445093] nix-grpc-daemon[862]: time=2026-09-20T09:01:26.027Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4363worker1 # [ 61.446579] nix-grpc-daemon[862]: time=2026-09-20T09:01:26.027Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4364lb # [ 61.462127] niks3-server[993]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4365worker1 # [ 61.483895] nix-grpc-daemon[862]: time=2026-09-20T09:01:26.066Z level=INFO msg="Uploading 1 narinfos"4366lb # [ 61.472789] niks3-server[993]: 2026/09/20 09:01:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4367lb # [ 61.486306] niks3-server[993]: 2026/09/20 09:01:26 INFO Signed narinfos id=17 count=14368lb # [ 61.494561] niks3-server[993]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4369lb # [ 61.503848] niks3-server[993]: 2026/09/20 09:01:26 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4370lb # [ 61.508740] niks3-server[993]: 2026/09/20 09:01:26 INFO Completed upload id=174371worker1 # [ 61.512247] nix-grpc-daemon[862]: time=2026-09-20T09:01:26.095Z level=INFO msg="Upload complete. (313ms)"4372lb # [ 61.511609] niks3-server[993]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4373worker2 # [ 61.501418] nix-grpc-daemon[774]: ts=2026-09-20T09:01:26Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04374worker2 # [ 61.501730] nix-grpc-daemon[774]: ts=2026-09-20T09:01:26Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14375worker1 # [ 61.585158] nix-grpc-daemon[779]: ts=2026-09-20T09:01:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370624376worker1 # [ 61.600991] nix-grpc-daemon[779]: ts=2026-09-20T09:01:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370624377client # copying 2 paths to 'lb:50051'...4378client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4379worker1 # [ 61.621425] nix-grpc-daemon[779]: ts=2026-09-20T09:01:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:370624380client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4381worker1 # [ 61.635407] nix-daemon[835]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4382worker1 # [ 61.847990] nix-daemon[835]: accepted connection from pid 952, user nix-grpc-daemon (trusted)4383worker1 # [ 61.867964] nix-daemon[835]: reaped child process 955, status = succeeded4384worker1 # [ 62.040195] nix-daemon[835]: accepted connection from pid 957, user nix-grpc-daemon (trusted)4385worker1 # [ 62.057774] nix-daemon[835]: reaped child process 960, status = succeeded4386lb # [ 62.064960] niks3-server[993]: 2026/09/20 09:01:26 INFO Received uploads request method=POST path=/api/pending_closures4387lb # [ 62.074389] niks3-server[993]: 2026/09/20 09:01:26 INFO Received uploads request method=POST path=/api/pending_closures4388worker1 # [ 62.087954] nix-grpc-daemon[862]: time=2026-09-20T09:01:26.670Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4389worker1 # [ 62.089549] nix-grpc-daemon[862]: time=2026-09-20T09:01:26.670Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4390worker1 # [ 62.091255] nix-grpc-daemon[862]: time=2026-09-20T09:01:26.670Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4391lb # [ 62.118459] niks3-server[993]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4392lb # [ 62.129999] niks3-server[993]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4393worker1 # [ 62.151402] nix-grpc-daemon[862]: time=2026-09-20T09:01:26.733Z level=INFO msg="Uploading 3 narinfos"4394lb # [ 62.147499] niks3-server[993]: 2026/09/20 09:01:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4395lb # [ 62.156150] niks3-server[993]: 2026/09/20 09:01:26 INFO Signed narinfos id=18 count=14396lb # [ 62.161730] niks3-server[993]: 2026/09/20 09:01:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4397lb # [ 62.167702] niks3-server[993]: 2026/09/20 09:01:26 INFO Signed narinfos id=19 count=24398lb # [ 62.173850] niks3-server[993]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4399lb # [ 62.180306] niks3-server[993]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4400lb # [ 62.186339] niks3-server[993]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4401lb # [ 62.190021] niks3-server[993]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4402lb # [ 62.195810] niks3-server[993]: 2026/09/20 09:01:26 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4403lb # [ 62.199801] niks3-server[993]: 2026/09/20 09:01:26 INFO Completed upload id=184404lb # [ 62.202519] niks3-server[993]: 2026/09/20 09:01:26 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4405lb # [ 62.206380] niks3-server[993]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4406lb # [ 62.209925] niks3-server[993]: 2026/09/20 09:01:26 INFO Completed upload id=194407worker1 # [ 62.213994] nix-grpc-daemon[862]: time=2026-09-20T09:01:26.797Z level=INFO msg="Upload complete. (558ms)"4408worker1 # [ 62.226322] nix-grpc-daemon[779]: ts=2026-09-20T09:01:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37062 duration_s=0 paths=2 nar_bytes_in=9844409worker1 # [ 62.244545] nix-grpc-daemon[779]: ts=2026-09-20T09:01:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370624410worker1 # [ 62.255919] nix-daemon[835]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4411worker1 # [ 62.259598] nix-daemon[835]: reaped child process 950, status = succeeded4412client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4413worker1 # [ 62.274819] nix-daemon[835]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4414client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4415worker1 # [ 63.723333] nix-daemon[835]: reaped child process 964, status = succeeded4416worker1 # [ 63.910032] nix-daemon[835]: accepted connection from pid 979, user nix-grpc-daemon (trusted)4417worker1 # [ 63.928173] nix-daemon[835]: reaped child process 982, status = succeeded4418lb # [ 63.937775] niks3-server[993]: 2026/09/20 09:01:28 INFO Received uploads request method=POST path=/api/pending_closures4419worker1 # [ 63.950041] nix-grpc-daemon[862]: time=2026-09-20T09:01:28.532Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4420lb # [ 63.968407] niks3-server[993]: 2026/09/20 09:01:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4421worker1 # [ 63.981046] nix-grpc-daemon[862]: time=2026-09-20T09:01:28.564Z level=INFO msg="Uploading 1 narinfos"4422lb # [ 63.981807] niks3-server[993]: 2026/09/20 09:01:28 INFO Signed narinfos id=20 count=14423lb # [ 63.987375] niks3-server[993]: 2026/09/20 09:01:28 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4424lb # [ 63.994230] niks3-server[993]: 2026/09/20 09:01:28 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4425lb # [ 63.999882] niks3-server[993]: 2026/09/20 09:01:28 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4426worker1 # [ 64.008623] nix-grpc-daemon[862]: time=2026-09-20T09:01:28.591Z level=INFO msg="Upload complete. (315ms)"4427lb # [ 64.005812] niks3-server[993]: 2026/09/20 09:01:28 INFO Completed upload id=204428lb # [ 64.008522] niks3-server[993]: 2026/09/20 09:01:28 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4429worker1 # [ 64.020765] nix-grpc-daemon[779]: ts=2026-09-20T09:01:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37062 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14430worker1 # [ 64.031801] nix-daemon[835]: reaped child process 962, status = succeeded4431client # copying 1 paths...4432worker2 # [ 64.030402] nix-grpc-daemon[774]: ts=2026-09-20T09:01:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:525464433worker2 # [ 64.047152] nix-grpc-daemon[774]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4434client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4435worker1 # [ 64.135150] nix-grpc-daemon[779]: ts=2026-09-20T09:01:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:370624436worker1 # [ 64.142097] nix-grpc-daemon[779]: ts=2026-09-20T09:01:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37062 duration_s=0 paths=1 nar_bytes_out=1204437client # [ 64.230158] nix-daemon[932]: reaped child process 1015, status = succeeded4438client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.51 seconds)4439client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24440client # [ 64.449428] nix-daemon[932]: accepted connection from pid 1033, user root (trusted)4441client # this derivation will be built:4442client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4443worker1 # [ 64.691985] nix-grpc-daemon[779]: ts=2026-09-20T09:01:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:370624444client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4445worker2 # [ 64.659039] nix-grpc-daemon[774]: ts=2026-09-20T09:01:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525464446worker2 # [ 64.687365] nix-grpc-daemon[774]: ts=2026-09-20T09:01:29Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04447worker2 # [ 64.695142] nix-grpc-daemon[774]: ts=2026-09-20T09:01:29Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14448worker2 # [ 64.704910] nix-grpc-daemon[774]: ts=2026-09-20T09:01:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525464449worker2 # [ 64.716158] nix-grpc-daemon[774]: ts=2026-09-20T09:01:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525464450client # copying 1 paths to 'lb:50051'...4451client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4452worker2 # [ 64.737724] nix-grpc-daemon[774]: ts=2026-09-20T09:01:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:525464453worker2 # [ 64.752979] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4454worker2 # [ 64.773356] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 1/5)4455worker2 # [ 64.861488] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 2/5)4456worker2 # [ 64.901989] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 224 ms (attempt 3/5)4457worker2 # [ 65.134880] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 544 ms (attempt 4/5)4458worker2 # [ 65.678465] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4459worker2 # [ 65.688728] nix-grpc-daemon[774]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4460worker2 # [ 65.933326] nix-daemon[836]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)4461worker2 # [ 65.951988] nix-daemon[836]: reaped child process 1191, status = succeeded4462worker2 # [ 66.123914] nix-daemon[836]: accepted connection from pid 1193, user nix-grpc-daemon (trusted)4463worker2 # [ 66.141256] nix-daemon[836]: reaped child process 1196, status = succeeded4464lb # [ 66.186897] niks3-server[993]: 2026/09/20 09:01:30 INFO Received uploads request method=POST path=/api/pending_closures4465worker2 # [ 66.163751] nix-grpc-daemon[847]: time=2026-09-20T09:01:30.745Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4466worker2 # [ 66.165414] nix-grpc-daemon[847]: time=2026-09-20T09:01:30.745Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4467lb # [ 66.218704] niks3-server[993]: 2026/09/20 09:01:30 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4468worker2 # [ 66.197652] nix-grpc-daemon[847]: time=2026-09-20T09:01:30.780Z level=INFO msg="Uploading 1 narinfos"4469lb # [ 66.232359] niks3-server[993]: 2026/09/20 09:01:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4470lb # [ 66.242238] niks3-server[993]: 2026/09/20 09:01:30 INFO Signed narinfos id=21 count=14471worker2 # [ 66.218924] nix-grpc-daemon[847]: time=2026-09-20T09:01:30.801Z level=INFO msg="Upload complete. (495ms)"4472lb # [ 66.253208] niks3-server[993]: 2026/09/20 09:01:30 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4473worker2 # [ 66.224639] nix-grpc-daemon[774]: ts=2026-09-20T09:01:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=1 paths=1 nar_bytes_in=5684474lb # [ 66.259441] niks3-server[993]: 2026/09/20 09:01:30 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4475lb # [ 66.265426] niks3-server[993]: 2026/09/20 09:01:30 INFO Completed upload id=214476worker2 # [ 66.232739] nix-grpc-daemon[774]: ts=2026-09-20T09:01:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:525464477lb # [ 66.268295] niks3-server[993]: 2026/09/20 09:01:30 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4478worker2 # [ 66.240999] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4479worker2 # [ 66.244775] nix-daemon[836]: reaped child process 1182, status = succeeded4480worker2 # [ 66.251743] nix-grpc-daemon[774]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4481worker2 # [ 66.264992] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4482client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4483client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4484worker2 # [ 67.294687] nix-daemon[836]: reaped child process 1201, status = succeeded4485worker2 # [ 67.459101] nix-daemon[836]: accepted connection from pid 1216, user nix-grpc-daemon (trusted)4486worker2 # [ 67.475501] nix-daemon[836]: reaped child process 1219, status = succeeded4487lb # [ 67.525838] niks3-server[993]: 2026/09/20 09:01:32 INFO Received uploads request method=POST path=/api/pending_closures4488worker2 # [ 67.500525] nix-grpc-daemon[847]: time=2026-09-20T09:01:32.082Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4489lb # [ 67.556672] niks3-server[993]: 2026/09/20 09:01:32 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4490lb # [ 67.566007] niks3-server[993]: 2026/09/20 09:01:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4491worker2 # [ 67.539731] nix-grpc-daemon[847]: time=2026-09-20T09:01:32.122Z level=INFO msg="Uploading 1 narinfos"4492lb # [ 67.578978] niks3-server[993]: 2026/09/20 09:01:32 INFO Signed narinfos id=22 count=14493lb # [ 67.588898] niks3-server[993]: 2026/09/20 09:01:32 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4494worker2 # [ 67.562698] nix-grpc-daemon[847]: time=2026-09-20T09:01:32.145Z level=INFO msg="Upload complete. (287ms)"4495lb # [ 67.596909] niks3-server[993]: 2026/09/20 09:01:32 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4496lb # [ 67.604371] niks3-server[993]: 2026/09/20 09:01:32 INFO Completed upload id=224497worker2 # [ 67.571473] nix-grpc-daemon[774]: ts=2026-09-20T09:01:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14498lb # [ 67.607796] niks3-server[993]: 2026/09/20 09:01:32 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4499client # copying 1 paths...4500worker2 # [ 67.585107] nix-daemon[836]: reaped child process 1198, status = succeeded4501worker1 # [ 67.625392] nix-grpc-daemon[779]: ts=2026-09-20T09:01:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:370624502worker1 # [ 67.638938] nix-grpc-daemon[779]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4503client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4504worker1 # [ 67.684120] nix-grpc-daemon[779]: ts=2026-09-20T09:01:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:370624505worker1 # [ 67.689359] nix-grpc-daemon[779]: ts=2026-09-20T09:01:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37062 duration_s=0 paths=1 nar_bytes_out=1204506client # [ 67.778311] nix-daemon[932]: reaped child process 1036, status = succeeded4507client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.55 seconds)4508client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24509client # [ 67.998722] nix-daemon[932]: accepted connection from pid 1054, user root (trusted)4510client # this derivation will be built:4511client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4512worker2 # [ 68.196150] nix-grpc-daemon[774]: ts=2026-09-20T09:01:32Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:525464513client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4514worker2 # [ 68.206068] nix-grpc-daemon[774]: ts=2026-09-20T09:01:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525464515worker2 # [ 68.216688] nix-grpc-daemon[847]: time=2026-09-20T09:01:32.799Z level=INFO msg="All 1 paths already cached"4516worker2 # [ 68.233651] nix-grpc-daemon[774]: ts=2026-09-20T09:01:32Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04517worker2 # [ 68.240378] nix-grpc-daemon[774]: ts=2026-09-20T09:01:32Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14518worker1 # [ 68.280442] nix-grpc-daemon[779]: ts=2026-09-20T09:01:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370624519worker1 # [ 68.296616] nix-grpc-daemon[779]: ts=2026-09-20T09:01:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370624520worker1 # [ 68.329418] nix-grpc-daemon[862]: time=2026-09-20T09:01:32.911Z level=INFO msg="All 1 paths already cached"4521client # copying 1 paths to 'lb:50051'...4522worker1 # [ 68.340165] nix-grpc-daemon[779]: ts=2026-09-20T09:01:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:370624523client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4524worker1 # [ 68.355482] nix-daemon[835]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4525worker1 # [ 68.560668] nix-daemon[835]: accepted connection from pid 987, user nix-grpc-daemon (trusted)4526worker1 # [ 68.580869] nix-daemon[835]: reaped child process 990, status = succeeded4527worker1 # [ 68.748714] nix-daemon[835]: accepted connection from pid 992, user nix-grpc-daemon (trusted)4528worker1 # [ 68.768355] nix-daemon[835]: reaped child process 995, status = succeeded4529lb # [ 68.778345] niks3-server[993]: 2026/09/20 09:01:33 INFO Received uploads request method=POST path=/api/pending_closures4530worker1 # [ 68.789632] nix-grpc-daemon[862]: time=2026-09-20T09:01:33.372Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4531worker1 # [ 68.791145] nix-grpc-daemon[862]: time=2026-09-20T09:01:33.372Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4532lb # [ 68.805169] niks3-server[993]: 2026/09/20 09:01:33 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4533worker1 # [ 68.827465] nix-grpc-daemon[862]: time=2026-09-20T09:01:33.410Z level=INFO msg="Uploading 1 narinfos"4534lb # [ 68.816562] niks3-server[993]: 2026/09/20 09:01:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4535lb # [ 68.829132] niks3-server[993]: 2026/09/20 09:01:33 INFO Signed narinfos id=23 count=14536lb # [ 68.836364] niks3-server[993]: 2026/09/20 09:01:33 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4537worker1 # [ 68.849871] nix-grpc-daemon[862]: time=2026-09-20T09:01:33.433Z level=INFO msg="Upload complete. (476ms)"4538lb # [ 68.846706] niks3-server[993]: 2026/09/20 09:01:33 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4539lb # [ 68.852816] niks3-server[993]: 2026/09/20 09:01:33 INFO Completed upload id=234540worker1 # [ 68.857488] nix-grpc-daemon[779]: ts=2026-09-20T09:01:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37062 duration_s=0 paths=1 nar_bytes_in=5684541lb # [ 68.856782] niks3-server[993]: 2026/09/20 09:01:33 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4542worker1 # [ 68.870395] nix-grpc-daemon[779]: ts=2026-09-20T09:01:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:370624543worker1 # [ 68.877488] nix-daemon[835]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4544worker1 # [ 68.882393] nix-daemon[835]: reaped child process 985, status = succeeded4545worker1 # [ 68.893063] nix-daemon[835]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4546client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4547client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4548worker1 # [ 69.729482] nix-daemon[835]: reaped child process 999, status = succeeded4549worker1 # [ 69.895179] nix-daemon[835]: accepted connection from pid 1014, user nix-grpc-daemon (trusted)4550worker1 # [ 69.914904] nix-daemon[835]: reaped child process 1017, status = succeeded4551lb # [ 69.922570] niks3-server[993]: 2026/09/20 09:01:34 INFO Received uploads request method=POST path=/api/pending_closures4552worker1 # [ 69.938148] nix-grpc-daemon[862]: time=2026-09-20T09:01:34.519Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4553lb # [ 69.952492] niks3-server[993]: 2026/09/20 09:01:34 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4554worker1 # [ 69.966073] nix-grpc-daemon[862]: time=2026-09-20T09:01:34.549Z level=INFO msg="Uploading 1 narinfos"4555lb # [ 69.964433] niks3-server[993]: 2026/09/20 09:01:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4556lb # [ 69.973453] niks3-server[993]: 2026/09/20 09:01:34 INFO Signed narinfos id=24 count=14557worker1 # [ 69.986334] nix-grpc-daemon[862]: time=2026-09-20T09:01:34.569Z level=INFO msg="Upload complete. (282ms)"4558lb # [ 69.979201] niks3-server[993]: 2026/09/20 09:01:34 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4559lb # [ 69.990385] niks3-server[993]: 2026/09/20 09:01:34 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4560worker1 # [ 69.995152] nix-grpc-daemon[779]: ts=2026-09-20T09:01:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37062 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14561lb # [ 69.995052] niks3-server[993]: 2026/09/20 09:01:34 INFO Completed upload id=244562lb # [ 69.997600] niks3-server[993]: 2026/09/20 09:01:34 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4563worker1 # [ 70.006510] nix-daemon[835]: reaped child process 997, status = succeeded4564client # copying 1 paths...4565worker1 # [ 70.040689] nix-grpc-daemon[779]: ts=2026-09-20T09:01:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:370624566client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4567worker2 # [ 70.039161] nix-grpc-daemon[774]: ts=2026-09-20T09:01:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:525464568worker2 # [ 70.053076] nix-grpc-daemon[774]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4569worker2 # [ 70.070184] nix-grpc-daemon[774]: ts=2026-09-20T09:01:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52546 duration_s=0 paths=1 nar_bytes_out=1204570client # [ 70.194908] nix-daemon[932]: reaped child process 1057, status = succeeded4571client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.41 seconds)4572(finished: subtest: an input only one worker has still reaches the builder, in 10.40 seconds)4573subtest: upload whose reference the worker lacks is completed from the cache4574client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4575client # this derivation will be built:4576client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4577client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4578client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds)4579client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4580client # this derivation will be built:4581client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4582lb # [ 71.057716] envoy[910]: conn peer=[2001:db8:1::1]:58710 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3864 tx=1878 ms=30114583lb # [ 71.062640] envoy[910]: conn peer=[2001:db8:1::1]:58718 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=714584lb # [ 71.067614] envoy[910]: conn peer=[2001:db8:1::1]:58730 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3713 tx=1919 ms=30534585lb # [ 71.074495] envoy[910]: conn peer=[2001:db8:1::1]:58740 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=654586lb # [ 71.079199] envoy[910]: conn peer=[2001:db8:1::1]:58746 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=1802 ms=19314587client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4588lb # [ 71.083957] envoy[910]: conn peer=[2001:db8:1::1]:58758 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=944589client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds)4590client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4591client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4592worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4593worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4594worker2 # [ 71.610068] systemd[1]: Stopping Nix worker-protocol over gRPC...4595worker2 # [ 72.398174] nix-grpc-daemon[774]: ts=2026-09-20T09:01:36Z level=info event=signal_exit4596worker2 # [ 72.629112] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=scheduler_yield4597worker1 # [ 72.671667] nix-grpc-daemon[779]: ts=2026-09-20T09:01:37Z level=info event=scheduler_restarting addr=lb:500514598worker2 # [ 72.635647] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:525324599lb # [ 72.670777] niks3-server[993]: 2026/09/20 09:01:37 INFO lead: released remote=192.168.1.4:443864600worker2 # [ 72.642647] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=worker_gone addr=192.168.1.3:500514601worker2 # [ 72.646937] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=scheduler_restarting addr=lb:500514602worker2 # [ 72.651195] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:525324603worker2 # [ 72.655663] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=worker_gone addr=192.168.1.4:500514604worker1 # [ 72.871690] nix-grpc-daemon[779]: ts=2026-09-20T09:01:37Z level=info event=scheduler_connected addr=lb:500514605worker2 # [ 72.836783] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=scheduler_connected addr=lb:500514606worker1 # [ 72.878740] nix-grpc-daemon[779]: ts=2026-09-20T09:01:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4607worker2 # [ 72.856836] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4608worker1 # [ 73.080058] nix-grpc-daemon[779]: ts=2026-09-20T09:01:37Z level=info event=scheduler_connected addr=lb:500514609worker1 # [ 73.086667] nix-grpc-daemon[779]: ts=2026-09-20T09:01:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4610worker2 # [ 73.057978] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=scheduler_connected addr=lb:500514611worker2 # [ 73.065102] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4612worker1 # [ 73.287716] nix-grpc-daemon[779]: ts=2026-09-20T09:01:37Z level=info event=scheduler_connected addr=lb:500514613worker1 # [ 73.294252] nix-grpc-daemon[779]: ts=2026-09-20T09:01:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4614worker2 # [ 73.266217] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=scheduler_connected addr=lb:500514615worker2 # [ 73.273055] nix-grpc-daemon[774]: ts=2026-09-20T09:01:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4616worker1 # [ 73.495364] nix-grpc-daemon[779]: ts=2026-09-20T09:01:38Z level=info event=scheduler_connected addr=lb:500514617worker1 # [ 73.502638] nix-grpc-daemon[779]: ts=2026-09-20T09:01:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4618worker2 # [ 73.477009] nix-grpc-daemon[774]: ts=2026-09-20T09:01:38Z level=info event=scheduler_connected addr=lb:500514619worker2 # [ 73.481243] nix-grpc-daemon[774]: ts=2026-09-20T09:01:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4620worker2 # [ 73.635047] nix-grpc-daemon[774]: ts=2026-09-20T09:01:38Z level=info event=scheduler_restarting4621worker2 # [ 73.672943] nix-daemon[836]: reaped child process 838, status = succeeded4622worker1 # [ 73.711193] nix-grpc-daemon[779]: ts=2026-09-20T09:01:38Z level=info event=scheduler_connected addr=lb:500514623worker1 # [ 73.716335] nix-grpc-daemon[779]: ts=2026-09-20T09:01:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4624worker2 # [ 73.702606] nix-grpc-daemon[774]: ts=2026-09-20T09:01:38Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4625worker1 # [ 73.917038] nix-grpc-daemon[779]: ts=2026-09-20T09:01:38Z level=info event=scheduler_connected addr=lb:500514626worker2 # [ 73.882389] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4627worker2 # [ 73.886966] nix-grpc-daemon[774]: E0000 00:00:1789894898.464673 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true4628worker2 # [ 74.551528] nix-grpc-daemon[774]: E0000 00:00:1789894899.132807 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4629worker2 # [ 74.551831] nix-grpc-daemon[774]: E0000 00:00:1789894899.133003 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4630worker1 # [ 75.361091] nix-grpc-daemon[779]: ts=2026-09-20T09:01:39Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4631worker2 # [ 75.345174] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4632worker2 # [ 75.352294] systemd[1]: Stopped Nix worker-protocol over gRPC.4633worker2 # [ 75.354817] systemd[1]: nix-grpc-daemon.service: Consumed 3.538s CPU time over 54.304s wall clock time, 65.7M memory peak, 87.6K incoming IP traffic, 166.4K outgoing IP traffic.4634worker2 # [ 75.368447] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4635worker2 # [ 75.370496] systemd[1]: Closed Nix worker-protocol over gRPC.4636worker2 # [ 75.372636] systemd[1]: nix-grpc-daemon.socket: Consumed 606us CPU time over 1min 3.775s wall clock time, 256K memory peak, 104.7K incoming IP traffic, 84.5K outgoing IP traffic.4637lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4638lb: must succeed: curl -sf localhost:9901/clusters4639lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4640lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4641client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24642worker1 # [ 75.560792] nix-grpc-daemon[779]: ts=2026-09-20T09:01:40Z level=info event=scheduler_connected addr=lb:500514643worker1 # [ 75.567768] nix-grpc-daemon[779]: ts=2026-09-20T09:01:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4644worker1 # [ 75.736596] nix-grpc-daemon[779]: ts=2026-09-20T09:01:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:370624645worker1 # [ 75.745672] nix-grpc-daemon[779]: ts=2026-09-20T09:01:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:370624646client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4647worker1 # [ 75.768719] nix-grpc-daemon[779]: ts=2026-09-20T09:01:40Z level=info event=scheduler_connected addr=lb:500514648client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.27 seconds)4649worker1 # [ 75.773983] nix-grpc-daemon[779]: ts=2026-09-20T09:01:40Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4650worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4651worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4652worker2 # [ 75.846358] systemd[1]: Listening on Nix worker-protocol over gRPC.4653worker1 # [ 75.962509] systemd[1]: Stopping Nix worker-protocol over gRPC...4654worker1 # [ 75.975133] nix-grpc-daemon[779]: ts=2026-09-20T09:01:40Z level=info event=scheduler_connected addr=lb:500514655worker1 # [ 75.981527] nix-grpc-daemon[779]: ts=2026-09-20T09:01:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4656worker1 # [ 76.182584] nix-grpc-daemon[779]: ts=2026-09-20T09:01:40Z level=info event=scheduler_connected addr=lb:500514657worker2 # [ 76.159065] systemd[1]: Starting Nix worker-protocol over gRPC...4658worker2 # [ 76.374631] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4659worker2 # [ 76.377114] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14660worker2 # [ 76.384702] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4661worker2 # [ 76.386746] systemd[1]: Started Nix worker-protocol over gRPC.4662worker1 # [ 76.427481] nix-grpc-daemon[779]: ts=2026-09-20T09:01:41Z level=info event=signal_exit4663worker2 # [ 76.402321] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:40Z level=info event=scheduler_take_over4664lb # [ 76.436581] niks3-server[993]: 2026/09/20 09:01:41 INFO lead: acquired remote=192.168.1.4:381384665worker2 # [ 76.418711] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04666worker2 # [ 76.433893] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:41Z level=info event=scheduler_connected addr=lb:500514667worker2 # [ 76.435873] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04668worker2 # [ 77.468867] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:528844669worker2 # [ 77.473577] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:42Z level=info event=worker_gone addr=192.168.1.3:500514670worker1 # [ 77.519597] nix-grpc-daemon[779]: ts=2026-09-20T09:01:42Z level=info event=scheduler_restarting4671worker1 # [ 77.526409] nix-grpc-daemon[779]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4672worker1 # [ 77.544320] nix-grpc-daemon[779]: E0000 00:00:1789894902.087919 822 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4673worker1 # [ 77.556314] nix-grpc-daemon[779]: E0000 00:00:1789894902.088125 822 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4674worker1 # [ 77.563012] nix-grpc-daemon[779]: ts=2026-09-20T09:01:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4675worker1 # [ 77.567015] nix-daemon[835]: reaped child process 837, status = succeeded4676worker1 # [ 79.285084] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4677worker1 # [ 79.289203] systemd[1]: Stopped Nix worker-protocol over gRPC.4678worker1 # [ 79.291625] systemd[1]: nix-grpc-daemon.service: Consumed 1.847s CPU time over 58.209s wall clock time, 51.9M memory peak, 49K incoming IP traffic, 84.1K outgoing IP traffic.4679worker1 # [ 79.307865] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4680worker1 # [ 79.312823] systemd[1]: Closed Nix worker-protocol over gRPC.4681worker1 # [ 79.314535] systemd[1]: nix-grpc-daemon.socket: Consumed 552us CPU time over 1min 8.304s wall clock time, 256K memory peak, 76.6K incoming IP traffic, 68K outgoing IP traffic.4682lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4683lb: must succeed: curl -sf localhost:9901/clusters4684lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4685lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4686client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24687worker2 # [ 79.627476] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:529104688worker2 # [ 79.642542] nix-daemon[836]: accepted connection from pid 1243, user nix-grpc-daemon (trusted)4689worker2 # [ 79.667843] nix-grpc-daemon[1243]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5)4690worker2 # [ 79.701518] nix-grpc-daemon[1243]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 2/5)4691worker2 # [ 79.765282] nix-grpc-daemon[1243]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 3/5)4692worker2 # [ 79.785569] nix-grpc-daemon[1243]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 494 ms (attempt 4/5)4693worker2 # [ 80.287980] nix-grpc-daemon[1243]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4694client # copying 2 paths...4695client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4696worker2 # [ 80.313266] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:529104697client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4698worker2 # [ 80.331712] nix-daemon[836]: accepted connection from pid 1243, user nix-grpc-daemon (trusted)4699worker2 # [ 80.361212] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:44Z level=info event=niks3_push_started pid=12994700worker2 # [ 80.751583] nix-daemon[836]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)4701worker2 # [ 80.768140] nix-daemon[836]: reaped child process 1315, status = succeeded4702lb # [ 80.816775] niks3-server[993]: 2026/09/20 09:01:45 INFO Received uploads request method=POST path=/api/pending_closures4703lb # [ 80.826601] niks3-server[993]: 2026/09/20 09:01:45 INFO Received uploads request method=POST path=/api/pending_closures4704worker2 # [ 80.803882] nix-grpc-daemon[1299]: time=2026-09-20T09:01:45.385Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4705worker2 # [ 80.807351] nix-grpc-daemon[1299]: time=2026-09-20T09:01:45.385Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4706worker2 # [ 80.809454] nix-grpc-daemon[1299]: time=2026-09-20T09:01:45.385Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4707lb # [ 80.884737] niks3-server[993]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4708lb # [ 80.895180] niks3-server[993]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4709worker2 # [ 80.876105] nix-grpc-daemon[1299]: time=2026-09-20T09:01:45.457Z level=INFO msg="Uploading 3 narinfos"4710lb # [ 80.909344] niks3-server[993]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4711lb # [ 80.911974] niks3-server[993]: 2026/09/20 09:01:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4712lb # [ 80.920969] niks3-server[993]: 2026/09/20 09:01:45 INFO Signed narinfos id=25 count=14713lb # [ 80.922733] niks3-server[993]: 2026/09/20 09:01:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4714lb # [ 80.930384] niks3-server[993]: 2026/09/20 09:01:45 INFO Signed narinfos id=26 count=24715lb # [ 80.934319] niks3-server[993]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4716lb # [ 80.941725] niks3-server[993]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4717lb # [ 80.952625] niks3-server[993]: 2026/09/20 09:01:45 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4718lb # [ 80.959339] niks3-server[993]: 2026/09/20 09:01:45 INFO Completed upload id=254719worker2 # [ 80.926614] nix-grpc-daemon[1299]: time=2026-09-20T09:01:45.509Z level=INFO msg="Upload complete. (344ms)"4720lb # [ 80.963773] niks3-server[993]: 2026/09/20 09:01:45 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4721lb # [ 80.970863] niks3-server[993]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4722lb # [ 80.974598] niks3-server[993]: 2026/09/20 09:01:45 INFO Completed upload id=264723lb # [ 80.981505] niks3-server[993]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4724worker2 # [ 80.937341] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52910 duration_s=0 paths=2 nar_bytes_in=3124725worker2 # [ 80.956187] nix-daemon[836]: reaped child process 1297, status = succeeded4726client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.61 seconds)4727worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4728worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4729lb # [ 81.062457] envoy[910]: conn peer=[2001:db8:1::4]:53248 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5817 tx=1874 ms=522644730lb # [ 81.067801] envoy[910]: conn peer=[2001:db8:1::1]:58694 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=284731lb # [ 81.073303] envoy[910]: conn peer=[2001:db8:1::3]:33252 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5989 tx=1804 ms=560594732lb # [ 81.079202] envoy[910]: conn peer=[2001:db8:1::1]:58698 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1009 tx=304 ms=13304733worker1 # [ 81.130958] systemd[1]: Listening on Nix worker-protocol over gRPC.4734worker1 # [ 81.141168] systemd[1]: Starting Nix worker-protocol over gRPC...4735worker1 # [ 81.339262] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4736worker1 # [ 81.341774] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14737worker1 # [ 81.349641] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4738worker1 # [ 81.351388] systemd[1]: Started Nix worker-protocol over gRPC.4739lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4740lb: must succeed: curl -sf localhost:9901/clusters4741worker1 # [ 81.400765] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:45Z level=info event=scheduler_connected addr=lb:500514742worker2 # [ 81.367335] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:45Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04743lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4744lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4745(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.24 seconds)4746subtest: scheduler down: the other node takes the lock and keeps it4747lb: must succeed: curl -sf localhost:9901/clusters4748lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4749lb: must succeed: curl -sf localhost:9901/clusters4750lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4751lb: must succeed: curl -sf localhost:9901/clusters4752lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4753lb: must succeed: curl -sf localhost:9901/clusters4754lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4755worker2 # [ 81.708988] systemd[1]: Stopping Nix worker-protocol over gRPC...4756worker2 # [ 82.397546] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:46Z level=info event=signal_exit4757worker2 # [ 82.605362] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=scheduler_yield4758lb # [ 82.641347] niks3-server[993]: 2026/09/20 09:01:47 INFO lead: released remote=192.168.1.4:381384759worker1 # [ 82.648543] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:47Z level=info event=scheduler_restarting addr=lb:500514760worker2 # [ 82.620473] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:528844761worker2 # [ 82.629220] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=worker_gone addr=192.168.1.3:500514762worker2 # [ 82.633134] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=scheduler_restarting addr=lb:500514763worker2 # [ 82.636881] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:528844764worker2 # [ 82.641103] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=worker_gone addr=192.168.1.4:500514765worker1 # [ 82.848449] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:47Z level=info event=scheduler_connected addr=lb:500514766worker1 # [ 82.858612] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4767worker2 # [ 82.828284] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=scheduler_connected addr=lb:500514768worker2 # [ 82.848356] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4769worker1 # [ 83.059553] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:47Z level=info event=scheduler_connected addr=lb:500514770worker1 # [ 83.066726] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4771worker2 # [ 83.049270] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=scheduler_connected addr=lb:500514772worker2 # [ 83.056358] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4773worker1 # [ 83.267663] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:47Z level=info event=scheduler_connected addr=lb:500514774worker1 # [ 83.274219] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4775worker2 # [ 83.257322] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=scheduler_connected addr=lb:500514776worker2 # [ 83.263835] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4777worker1 # [ 83.475165] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:48Z level=info event=scheduler_connected addr=lb:500514778worker1 # [ 83.481826] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4779worker2 # [ 83.467143] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:48Z level=info event=scheduler_connected addr=lb:500514780worker2 # [ 83.471399] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4781worker2 # [ 83.610667] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:48Z level=info event=scheduler_restarting4782worker2 # [ 83.640883] nix-daemon[836]: reaped child process 1292, status = succeeded4783worker1 # [ 83.684749] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:48Z level=info event=scheduler_connected addr=lb:500514784worker1 # [ 83.689524] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4785worker2 # [ 83.686889] nix-grpc-daemon[1243]: ts=2026-09-20T09:01:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4786worker1 # [ 83.886402] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:48Z level=info event=scheduler_connected addr=lb:500514787worker2 # [ 83.851440] nix-grpc-daemon[1243]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4788worker2 # [ 83.856082] nix-grpc-daemon[1243]: E0000 00:00:1789894908.433822 1286 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4789worker1 # [ 84.435331] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:49Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4790worker2 # [ 84.420669] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4791worker2 # [ 84.423558] systemd[1]: Stopped Nix worker-protocol over gRPC.4792worker2 # [ 84.434228] systemd[1]: nix-grpc-daemon.service: Consumed 487ms CPU time over 8.260s wall clock time, 33.3M memory peak, 17.7K incoming IP traffic, 22K outgoing IP traffic.4793worker2 # [ 84.451051] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4794worker2 # [ 84.455792] systemd[1]: Closed Nix worker-protocol over gRPC.4795worker2 # [ 84.459576] systemd[1]: nix-grpc-daemon.socket: Consumed 788us CPU time over 8.610s wall clock time, 256K memory peak, 27.1K incoming IP traffic, 23.4K outgoing IP traffic.4796worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4797worker1 # [ 84.636514] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:49Z level=info event=scheduler_connected addr=lb:500514798worker1 # [ 84.643381] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4799worker1 # [ 84.845758] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:49Z level=info event=scheduler_connected addr=lb:500514800worker1 # [ 84.850841] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:49Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4801worker1 # [ 85.051621] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:49Z level=info event=scheduler_connected addr=lb:500514802worker1 # [ 85.058282] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4803worker1 # [ 85.259203] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:49Z level=info event=scheduler_connected addr=lb:500514804worker1 # [ 85.264510] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:49Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4805worker1 # [ 85.465179] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:50Z level=info event=scheduler_connected addr=lb:500514806worker1 # [ 85.471481] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4807worker1 # [ 85.672632] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:50Z level=info event=scheduler_connected addr=lb:500514808worker1 # [ 85.677423] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:50Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4809worker1 # [ 85.880303] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:50Z level=info event=scheduler_connected addr=lb:500514810worker1 # [ 85.885351] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4811worker1 # [ 86.086146] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:50Z level=info event=scheduler_connected addr=lb:500514812worker1 # [ 86.091347] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:50Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4813worker1 # [ 86.292213] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:50Z level=info event=scheduler_connected addr=lb:500514814worker1 # [ 86.298708] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4815worker1 # [ 86.362586] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:50Z level=info event=scheduler_take_over4816lb # [ 86.359377] niks3-server[993]: 2026/09/20 09:01:50 INFO lead: acquired remote=192.168.1.3:396664817worker1 # [ 86.499609] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:51Z level=info event=scheduler_connected addr=lb:500514818worker1 # [ 86.505087] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04819worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.23 seconds)4820worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4821worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4822client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24823worker1 # [ 87.061115] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:545144824worker1 # [ 87.077103] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4825client # don't know how to build these paths:4826client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4827worker1 # [ 87.095085] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:545144828worker1 # [ 87.110999] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 1/5)4829worker1 # [ 87.150439] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5)4830worker1 # [ 87.242645] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 383 ms (attempt 3/5)4831worker1 # [ 87.633438] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 545 ms (attempt 4/5)4832worker1 # [ 88.189305] nix-grpc-daemon[1040]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4833worker1 # [ 88.222586] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:52Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04834worker1 # [ 88.229663] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:52Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14835worker1 # [ 88.269506] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545144836worker1 # [ 88.284891] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:545144837client # copying 1 paths to 'lb:50051'...4838client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4839worker1 # [ 88.300425] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:545144840worker1 # [ 88.315839] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4841worker1 # [ 88.342563] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:52Z level=info event=niks3_push_started pid=11214842worker1 # [ 88.724947] nix-daemon[835]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)4843worker1 # [ 88.742455] nix-daemon[835]: reaped child process 1137, status = succeeded4844worker1 # [ 88.918182] nix-daemon[835]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)4845worker1 # [ 88.935039] nix-daemon[835]: reaped child process 1142, status = succeeded4846lb # [ 88.943359] niks3-server[993]: 2026/09/20 09:01:53 INFO Received uploads request method=POST path=/api/pending_closures4847worker1 # [ 88.959286] nix-grpc-daemon[1121]: time=2026-09-20T09:01:53.540Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4848worker1 # [ 88.961139] nix-grpc-daemon[1121]: time=2026-09-20T09:01:53.540Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4849lb # [ 88.980112] niks3-server[993]: 2026/09/20 09:01:53 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4850lb # [ 88.995872] niks3-server[993]: 2026/09/20 09:01:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4851worker1 # [ 89.007220] nix-grpc-daemon[1121]: time=2026-09-20T09:01:53.590Z level=INFO msg="Uploading 1 narinfos"4852lb # [ 89.009181] niks3-server[993]: 2026/09/20 09:01:53 INFO Signed narinfos id=27 count=14853lb # [ 89.021474] niks3-server[993]: 2026/09/20 09:01:53 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4854lb # [ 89.031440] niks3-server[993]: 2026/09/20 09:01:53 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4855lb # [ 89.045874] niks3-server[993]: 2026/09/20 09:01:53 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4856lb # [ 89.050263] niks3-server[993]: 2026/09/20 09:01:53 INFO Completed upload id=274857worker1 # [ 89.054575] nix-grpc-daemon[1121]: time=2026-09-20T09:01:53.637Z level=INFO msg="Upload complete. (498ms)"4858worker1 # [ 89.065278] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54514 duration_s=0 paths=1 nar_bytes_in=5204859worker1 # [ 89.082891] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545144860worker1 # [ 89.089695] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4861worker1 # [ 89.095236] nix-daemon[835]: reaped child process 1119, status = succeeded4862client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4863worker1 # [ 89.107416] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4864client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4865client # farm-a> LOG-farm-a-on-standby4866worker1 # [ 90.537131] nix-daemon[835]: reaped child process 1146, status = succeeded4867worker1 # [ 90.696293] nix-daemon[835]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)4868worker1 # [ 90.716131] nix-daemon[835]: reaped child process 1164, status = succeeded4869lb # [ 90.726069] niks3-server[993]: 2026/09/20 09:01:55 INFO Received uploads request method=POST path=/api/pending_closures4870worker1 # [ 90.740202] nix-grpc-daemon[1121]: time=2026-09-20T09:01:55.323Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4871worker1 # [ 90.745447] nix-grpc-daemon[1121]: time=2026-09-20T09:01:55.325Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4872worker1 # [ 90.786436] nix-grpc-daemon[1121]: time=2026-09-20T09:01:55.368Z level=INFO msg="Uploading 1 narinfos"4873lb # [ 90.769833] niks3-server[993]: 2026/09/20 09:01:55 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4874lb # [ 90.785932] niks3-server[993]: 2026/09/20 09:01:55 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4875lb # [ 90.794791] niks3-server[993]: 2026/09/20 09:01:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4876lb # [ 90.798598] niks3-server[993]: 2026/09/20 09:01:55 INFO Signed narinfos id=28 count=14877lb # [ 90.804579] niks3-server[993]: 2026/09/20 09:01:55 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4878lb # [ 90.807528] niks3-server[993]: 2026/09/20 09:01:55 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4879worker1 # [ 90.815231] nix-grpc-daemon[1121]: time=2026-09-20T09:01:55.398Z level=INFO msg="Upload complete. (290ms)"4880lb # [ 90.811573] niks3-server[993]: 2026/09/20 09:01:55 INFO Completed upload id=284881lb # [ 90.814144] niks3-server[993]: 2026/09/20 09:01:55 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4882worker1 # [ 90.830359] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54514 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14883worker1 # [ 90.843839] nix-daemon[835]: reaped child process 1144, status = succeeded4884worker1 # [ 90.847472] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:55Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04885worker1 # [ 90.851039] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:55Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14886worker1 # [ 90.893464] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545144887worker1 # [ 90.909367] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:545144888worker1 # [ 90.925743] nix-grpc-daemon[1121]: time=2026-09-20T09:01:55.508Z level=INFO msg="All 1 paths already cached"4889client # copying 1 paths to 'lb:50051'...4890client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4891worker1 # [ 90.935987] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:545144892worker1 # [ 90.949701] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4893lb # [ 91.059378] envoy[910]: conn peer=[2001:db8:1::4]:59562 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1003 tx=362 ms=72424894worker1 # [ 91.153431] nix-daemon[835]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)4895worker1 # [ 91.172786] nix-daemon[835]: reaped child process 1173, status = succeeded4896worker1 # [ 91.347703] nix-daemon[835]: accepted connection from pid 1175, user nix-grpc-daemon (trusted)4897worker1 # [ 91.368194] nix-daemon[835]: reaped child process 1178, status = succeeded4898lb # [ 91.374811] niks3-server[993]: 2026/09/20 09:01:55 INFO Received uploads request method=POST path=/api/pending_closures4899worker1 # [ 91.389492] nix-grpc-daemon[1121]: time=2026-09-20T09:01:55.972Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4900worker1 # [ 91.390999] nix-grpc-daemon[1121]: time=2026-09-20T09:01:55.972Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4901lb # [ 91.406652] niks3-server[993]: 2026/09/20 09:01:55 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4902lb # [ 91.416783] niks3-server[993]: 2026/09/20 09:01:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4903worker1 # [ 91.428612] nix-grpc-daemon[1121]: time=2026-09-20T09:01:56.011Z level=INFO msg="Uploading 1 narinfos"4904lb # [ 91.428276] niks3-server[993]: 2026/09/20 09:01:56 INFO Signed narinfos id=29 count=14905lb # [ 91.430987] niks3-server[993]: 2026/09/20 09:01:56 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4906lb # [ 91.440624] niks3-server[993]: 2026/09/20 09:01:56 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4907lb # [ 91.446968] niks3-server[993]: 2026/09/20 09:01:56 INFO Completed upload id=294908worker1 # [ 91.451053] nix-grpc-daemon[1121]: time=2026-09-20T09:01:56.034Z level=INFO msg="Upload complete. (485ms)"4909lb # [ 91.449844] niks3-server[993]: 2026/09/20 09:01:56 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4910worker1 # [ 91.460239] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54514 duration_s=0 paths=1 nar_bytes_in=6404911worker1 # [ 91.470431] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545144912worker1 # [ 91.477445] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4913worker1 # [ 91.482064] nix-daemon[835]: reaped child process 1168, status = succeeded4914client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4915client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4916worker1 # [ 91.495676] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4917client # farm-b> LOG-farm-b-on-standby4918worker1 # [ 92.767670] nix-daemon[835]: reaped child process 1182, status = succeeded4919worker1 # [ 92.968143] nix-daemon[835]: accepted connection from pid 1197, user nix-grpc-daemon (trusted)4920worker1 # [ 92.989021] nix-daemon[835]: reaped child process 1200, status = succeeded4921lb # [ 93.003144] niks3-server[993]: 2026/09/20 09:01:57 INFO Received uploads request method=POST path=/api/pending_closures4922worker1 # [ 93.021337] nix-grpc-daemon[1121]: time=2026-09-20T09:01:57.603Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4923worker1 # [ 93.022878] nix-grpc-daemon[1121]: time=2026-09-20T09:01:57.603Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4924lb # [ 93.064142] niks3-server[993]: 2026/09/20 09:01:57 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4925worker1 # [ 93.077607] nix-grpc-daemon[1121]: time=2026-09-20T09:01:57.659Z level=INFO msg="Uploading 1 narinfos"4926lb # [ 93.077973] niks3-server[993]: 2026/09/20 09:01:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4927lb # [ 93.085086] niks3-server[993]: 2026/09/20 09:01:57 INFO Signed narinfos id=30 count=14928lb # [ 93.090052] niks3-server[993]: 2026/09/20 09:01:57 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4929lb # [ 93.095429] niks3-server[993]: 2026/09/20 09:01:57 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4930lb # [ 93.103984] niks3-server[993]: 2026/09/20 09:01:57 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4931lb # [ 93.107792] niks3-server[993]: 2026/09/20 09:01:57 INFO Completed upload id=304932worker1 # [ 93.112058] nix-grpc-daemon[1121]: time=2026-09-20T09:01:57.695Z level=INFO msg="Upload complete. (402ms)"4933lb # [ 93.111149] niks3-server[993]: 2026/09/20 09:01:57 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4934worker1 # [ 93.135742] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54514 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14935worker1 # [ 93.156222] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:57Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04936worker1 # [ 93.160737] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:57Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=14937worker1 # [ 93.165517] nix-daemon[835]: reaped child process 1180, status = succeeded4938worker1 # [ 93.182216] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545144939worker1 # [ 93.201385] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:545144940worker1 # [ 93.220224] nix-grpc-daemon[1121]: time=2026-09-20T09:01:57.803Z level=INFO msg="All 2 paths already cached"4941client # copying 1 paths to 'lb:50051'...4942client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4943worker1 # [ 93.231918] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:545144944worker1 # [ 93.251156] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4945worker1 # [ 93.531251] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)4946worker1 # [ 93.557800] nix-daemon[835]: reaped child process 1209, status = succeeded4947worker1 # [ 93.783835] nix-daemon[835]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)4948worker1 # [ 93.808328] nix-daemon[835]: reaped child process 1214, status = succeeded4949lb # [ 93.816685] niks3-server[993]: 2026/09/20 09:01:58 INFO Received uploads request method=POST path=/api/pending_closures4950worker1 # [ 93.837375] nix-grpc-daemon[1121]: time=2026-09-20T09:01:58.419Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4951worker1 # [ 93.838943] nix-grpc-daemon[1121]: time=2026-09-20T09:01:58.419Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4952lb # [ 93.871893] niks3-server[993]: 2026/09/20 09:01:58 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst4953worker1 # [ 93.888090] nix-grpc-daemon[1121]: time=2026-09-20T09:01:58.470Z level=INFO msg="Uploading 1 narinfos"4954lb # [ 93.883871] niks3-server[993]: 2026/09/20 09:01:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4955lb # [ 93.896661] niks3-server[993]: 2026/09/20 09:01:58 INFO Signed narinfos id=31 count=14956lb # [ 93.906939] niks3-server[993]: 2026/09/20 09:01:58 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls4957lb # [ 93.918291] niks3-server[993]: 2026/09/20 09:01:58 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete4958lb # [ 93.927526] niks3-server[993]: 2026/09/20 09:01:58 INFO Completed upload id=314959worker1 # [ 93.930513] nix-grpc-daemon[1121]: time=2026-09-20T09:01:58.513Z level=INFO msg="Upload complete. (656ms)"4960lb # [ 93.930555] niks3-server[993]: 2026/09/20 09:01:58 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo4961worker1 # [ 93.945685] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54514 duration_s=0 paths=1 nar_bytes_in=7684962worker1 # [ 93.957652] nix-grpc-daemon[1040]: ts=2026-09-20T09:01:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545144963worker1 # [ 93.977381] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4964worker1 # [ 93.985625] nix-daemon[835]: reaped child process 1204, status = succeeded4965client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...4966client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4967worker1 # [ 94.006970] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4968client # farm-top> LOG-farm-top-on-standby4969worker1 # [ 95.685080] nix-daemon[835]: reaped child process 1218, status = succeeded4970worker1 # [ 95.951149] nix-daemon[835]: accepted connection from pid 1233, user nix-grpc-daemon (trusted)4971worker1 # [ 95.976113] nix-daemon[835]: reaped child process 1236, status = succeeded4972lb # [ 95.992002] niks3-server[993]: 2026/09/20 09:02:00 INFO Received uploads request method=POST path=/api/pending_closures4973worker1 # [ 96.011049] nix-grpc-daemon[1121]: time=2026-09-20T09:02:00.591Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4974worker1 # [ 96.012773] nix-grpc-daemon[1121]: time=2026-09-20T09:02:00.591Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"4975lb # [ 96.056708] niks3-server[993]: 2026/09/20 09:02:00 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst4976lb # [ 96.069219] niks3-server[993]: 2026/09/20 09:02:00 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4977worker1 # [ 96.084191] nix-grpc-daemon[1121]: time=2026-09-20T09:02:00.666Z level=INFO msg="Uploading 1 narinfos"4978lb # [ 96.082123] niks3-server[993]: 2026/09/20 09:02:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign4979lb # [ 96.093011] niks3-server[993]: 2026/09/20 09:02:00 INFO Signed narinfos id=32 count=14980lb # [ 96.095302] niks3-server[993]: 2026/09/20 09:02:00 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls4981lb # [ 96.109070] niks3-server[993]: 2026/09/20 09:02:00 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete4982lb # [ 96.119004] niks3-server[993]: 2026/09/20 09:02:00 INFO Completed upload id=324983worker1 # [ 96.123408] nix-grpc-daemon[1121]: time=2026-09-20T09:02:00.706Z level=INFO msg="Upload complete. (494ms)"4984lb # [ 96.122135] niks3-server[993]: 2026/09/20 09:02:00 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo4985worker1 # [ 96.141845] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54514 duration_s=2 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=14986worker1 # [ 96.164456] nix-daemon[835]: reaped child process 1216, status = succeeded4987client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 9.41 seconds)4988client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath4989client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.25 seconds)4990worker2 # [ 96.519443] systemd[1]: Listening on Nix worker-protocol over gRPC.4991worker2 # [ 96.527179] systemd[1]: Starting Nix worker-protocol over gRPC...4992worker2 # [ 96.736455] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4993worker2 # [ 96.739930] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14994worker2 # [ 96.748058] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4995worker2 # [ 96.756219] systemd[1]: Started Nix worker-protocol over gRPC.4996lb: must succeed: curl -sf localhost:9901/clusters4997worker2 # [ 96.794073] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:01Z level=info event=scheduler_connected addr=lb:500514998worker1 # [ 96.832839] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04999lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5000worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5001worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5002lb: must succeed: curl -sf localhost:9901/clusters5003lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5004lb: must succeed: curl -sf localhost:9901/clusters5005lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5006worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5007worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5008(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 15.71 seconds)5009subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5010client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5011client # [ 97.229927] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5012client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5013client # Running as unit: rs.service; invocation ID: 48b0722f01b34a35a2befc875588071b5014client # [ 97.464239] nix[1155]: don't know how to build these paths:5015client # [ 97.466096] nix[1155]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5016worker1 # [ 97.502066] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:545145017worker1 # [ 97.515760] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:02Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05018worker1 # [ 97.522757] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:02Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15019worker1 # [ 97.560761] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545145020worker1 # [ 97.576407] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:545145021client # [ 97.552916] nix[1155]: copying 1 paths to 'lb:50051'...5022worker1 # [ 97.590246] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:545145023client # [ 97.555245] nix[1155]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5024worker1 # [ 97.608294] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)5025worker1 # [ 97.811806] nix-daemon[835]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5026worker1 # [ 97.829497] nix-daemon[835]: reaped child process 1254, status = succeeded5027worker1 # [ 98.007220] nix-daemon[835]: accepted connection from pid 1256, user nix-grpc-daemon (trusted)5028worker1 # [ 98.024504] nix-daemon[835]: reaped child process 1259, status = succeeded5029lb # [ 98.035232] niks3-server[993]: 2026/09/20 09:02:02 INFO Received uploads request method=POST path=/api/pending_closures5030worker1 # [ 98.049918] nix-grpc-daemon[1121]: time=2026-09-20T09:02:02.632Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5031worker1 # [ 98.051382] nix-grpc-daemon[1121]: time=2026-09-20T09:02:02.632Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5032lb # [ 98.068675] niks3-server[993]: 2026/09/20 09:02:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5033lb # [ 98.085933] niks3-server[993]: 2026/09/20 09:02:02 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5034lb # [ 98.097183] niks3-server[993]: 2026/09/20 09:02:02 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5035lb # [ 98.102248] niks3-server[993]: 2026/09/20 09:02:02 INFO Signed narinfos id=33 count=15036worker1 # [ 98.106752] nix-grpc-daemon[1121]: time=2026-09-20T09:02:02.689Z level=INFO msg="Uploading 1 narinfos"5037lb # [ 98.110712] niks3-server[993]: 2026/09/20 09:02:02 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5038lb # [ 98.118537] niks3-server[993]: 2026/09/20 09:02:02 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5039lb # [ 98.130503] niks3-server[993]: 2026/09/20 09:02:02 INFO Completed upload id=335040worker1 # [ 98.134781] nix-grpc-daemon[1121]: time=2026-09-20T09:02:02.717Z level=INFO msg="Upload complete. (510ms)"5041worker1 # [ 98.148378] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54514 duration_s=0 paths=1 nar_bytes_in=4165042worker1 # [ 98.160475] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:545145043worker1 # [ 98.169439] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)5044worker1 # [ 98.174949] nix-daemon[835]: reaped child process 1249, status = succeeded5045client # [ 98.147654] nix[1155]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5046worker1 # [ 98.187708] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)5047lb: must succeed: curl -sf localhost:9901/clusters5048lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5049lb: must succeed: curl -sf localhost:9901/clusters5050lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5051lb: must succeed: curl -sf localhost:9901/clusters5052lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5053lb: must succeed: curl -sf localhost:9901/clusters5054lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5055worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5056worker2 # [ 100.180758] systemd-journald[275]: Received client request to rotate journal, rotating.5057worker2 # [ 100.205388] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/28de0b01b19647479674957e356a8ee8.5058worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)5059worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5060worker1 # [ 100.299812] systemd[1]: Stopping Nix worker-protocol over gRPC...5061worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5062??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5063 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735064client: must succeed: sleep 5.05065worker1 # [ 100.368137] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:04Z level=info event=draining5066lb # [ 101.058551] envoy[910]: conn peer=[2001:db8:1::1]:41002 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=3884 ms=91045067client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5068worker1 # [ 105.617930] nix-daemon[835]: reaped child process 1263, status = succeeded5069worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5070worker1 # [ 105.776154] nix-daemon[835]: accepted connection from pid 1303, user nix-grpc-daemon (trusted)5071worker1 # [ 105.795439] nix-daemon[835]: reaped child process 1306, status = succeeded5072lb # [ 105.803984] niks3-server[993]: 2026/09/20 09:02:10 INFO Received uploads request method=POST path=/api/pending_closures5073worker1 # [ 105.823883] nix-grpc-daemon[1121]: time=2026-09-20T09:02:10.404Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5074worker1 # [ 105.825607] nix-grpc-daemon[1121]: time=2026-09-20T09:02:10.404Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5075lb # [ 105.851325] niks3-server[993]: 2026/09/20 09:02:10 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5076lb # [ 105.863476] niks3-server[993]: 2026/09/20 09:02:10 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5077lb # [ 105.872089] niks3-server[993]: 2026/09/20 09:02:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5078worker1 # [ 105.881118] nix-grpc-daemon[1121]: time=2026-09-20T09:02:10.463Z level=INFO msg="Uploading 1 narinfos"5079lb # [ 105.879640] niks3-server[993]: 2026/09/20 09:02:10 INFO Signed narinfos id=34 count=15080lb # [ 105.885061] niks3-server[993]: 2026/09/20 09:02:10 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5081lb # [ 105.892782] niks3-server[993]: 2026/09/20 09:02:10 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5082lb # [ 105.900742] niks3-server[993]: 2026/09/20 09:02:10 INFO Completed upload id=345083worker1 # [ 105.904310] nix-grpc-daemon[1121]: time=2026-09-20T09:02:10.487Z level=INFO msg="Upload complete. (299ms)"5084lb # [ 105.903401] niks3-server[993]: 2026/09/20 09:02:10 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5085worker1 # [ 105.916981] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54514 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15086worker1 # [ 105.933750] nix-daemon[835]: reaped child process 1261, status = succeeded5087client # [ 105.919327] systemd[1]: rs.service: Deactivated successfully.5088client # [ 105.923817] systemd[1]: rs.service: Consumed 155ms CPU time over 8.693s wall clock time, 37M memory peak, 8.4K incoming IP traffic, 8.8K outgoing IP traffic.5089worker1 # [ 106.369887] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:10Z level=info event=signal_exit5090worker1 # [ 106.583749] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:11Z level=info event=scheduler_yield5091lb # [ 106.588787] niks3-server[993]: 2026/09/20 09:02:11 INFO lead: released remote=192.168.1.3:396665092worker1 # [ 106.593926] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:11Z level=info event=scheduler_restarting addr=lb:500515093worker2 # [ 106.557999] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:11Z level=info event=scheduler_restarting addr=lb:500515094worker1 # [ 106.600994] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:545105095worker1 # [ 106.605583] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:11Z level=info event=worker_gone addr=192.168.1.3:500515096worker1 # [ 106.609611] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:545105097worker1 # [ 106.614123] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:11Z level=info event=worker_gone addr=192.168.1.4:500515098worker2 # [ 106.757692] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:11Z level=info event=scheduler_connected addr=lb:500515099worker1 # [ 106.795370] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:11Z level=info event=scheduler_connected addr=lb:500515100lb # [ 106.792462] niks3-server[993]: 2026/09/20 09:02:11 INFO lead: acquired remote=192.168.1.4:413345101worker2 # [ 106.763054] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:11Z level=info event=scheduler_take_over5102worker2 # [ 106.770431] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05103worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.14 seconds)5104client: waiting for success: ! systemctl is-active rs5105worker1 # [ 106.819321] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5106client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5107client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5108client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5109client: must fail: journalctl -u rs | grep -q 'reconnecting'5110client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5111lb: must succeed: curl -sf localhost:9901/clusters5112worker1 # [ 107.021623] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:11Z level=info event=scheduler_connected addr=lb:500515113worker2 # [ 106.985482] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=0 running=05114lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5115worker1 # [ 107.589885] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:12Z level=info event=scheduler_restarting5116worker2 # [ 107.559508] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:563045117worker2 # [ 107.564341] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:12Z level=info event=worker_gone addr=192.168.1.3:500515118worker1 # [ 107.623674] nix-grpc-daemon[1040]: ts=2026-09-20T09:02:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5119worker1 # [ 107.650319] nix-daemon[835]: reaped child process 1112, status = succeeded5120lb: must succeed: curl -sf localhost:9901/clusters5121lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5122worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5123worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5124worker1 # [ 108.427936] nix-grpc-daemon[1040]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5125worker1 # [ 108.432794] nix-grpc-daemon[1040]: E0000 00:00:1789894933.009818 1083 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5126worker1 # [ 108.433452] nix-grpc-daemon[1040]: E0000 00:00:1789894933.016575 1083 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5127worker1 # [ 109.030259] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5128worker1 # [ 109.058045] systemd[1]: Stopped Nix worker-protocol over gRPC.5129worker1 # [ 109.060277] systemd[1]: nix-grpc-daemon.service: Consumed 2.040s CPU time over 27.889s wall clock time, 36.7M memory peak, 46.5K incoming IP traffic, 85.4K outgoing IP traffic.5130worker1 # [ 109.067741] systemd[1]: Starting Nix worker-protocol over gRPC...5131lb: must succeed: curl -sf localhost:9901/clusters5132worker1 # [ 109.268646] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5133worker1 # [ 109.272054] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15134worker1 # [ 109.280244] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5135worker1 # [ 109.282027] systemd[1]: Started Nix worker-protocol over gRPC.5136lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5137worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5138worker1 # [ 109.314883] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:13Z level=info event=scheduler_connected addr=lb:500515139worker2 # [ 109.281331] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05140worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5141(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.19 seconds)5142subtest: scheduler restart mid-build: build finishes, no double build5143client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5144client # [ 109.419728] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5145client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5146worker2 # [ 109.664117] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:563145147worker2 # [ 109.679192] nix-daemon[836]: accepted connection from pid 1336, user nix-grpc-daemon (trusted)5148client # Running as unit: mid.service; invocation ID: 271ec0cb8ca84abc9c6f7a392a64e6985149client # [ 109.697054] nix[1190]: don't know how to build these paths:5150client # [ 109.700059] nix[1190]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5151worker2 # [ 109.713479] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:14Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05152worker2 # [ 109.720701] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:14Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15153worker2 # [ 109.760681] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:563145154worker2 # [ 109.780793] nix-grpc-daemon[1336]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 1/5)5155worker2 # [ 109.834131] nix-grpc-daemon[1336]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 2/5)5156worker2 # [ 109.884415] nix-grpc-daemon[1336]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 3/5)5157worker2 # [ 109.976869] nix-grpc-daemon[1336]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 4/5)5158worker2 # [ 110.056093] nix-grpc-daemon[1336]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5159worker2 # [ 110.076679] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:563145160client # [ 110.088270] nix[1190]: copying 1 paths to 'lb:50051'...5161worker2 # [ 110.091252] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:563145162client # [ 110.093576] nix[1190]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5163worker2 # [ 110.106347] nix-daemon[836]: accepted connection from pid 1336, user nix-grpc-daemon (trusted)5164worker2 # [ 110.135706] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:14Z level=info event=niks3_push_started pid=14545165worker2 # [ 110.523890] nix-daemon[836]: accepted connection from pid 1467, user nix-grpc-daemon (trusted)5166worker2 # [ 110.541255] nix-daemon[836]: reaped child process 1470, status = succeeded5167worker2 # [ 110.727284] nix-daemon[836]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)5168worker2 # [ 110.752297] nix-daemon[836]: reaped child process 1478, status = succeeded5169lb # [ 110.797868] niks3-server[993]: 2026/09/20 09:02:15 INFO Received uploads request method=POST path=/api/pending_closures5170worker2 # [ 110.776752] nix-grpc-daemon[1454]: time=2026-09-20T09:02:15.357Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5171worker2 # [ 110.778225] nix-grpc-daemon[1454]: time=2026-09-20T09:02:15.357Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5172lb # [ 110.835124] niks3-server[993]: 2026/09/20 09:02:15 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5173lb # [ 110.846583] niks3-server[993]: 2026/09/20 09:02:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5174worker2 # [ 110.821570] nix-grpc-daemon[1454]: time=2026-09-20T09:02:15.403Z level=INFO msg="Uploading 1 narinfos"5175lb # [ 110.859483] niks3-server[993]: 2026/09/20 09:02:15 INFO Signed narinfos id=35 count=15176lb # [ 110.866839] niks3-server[993]: 2026/09/20 09:02:15 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5177worker2 # [ 110.847901] nix-grpc-daemon[1454]: time=2026-09-20T09:02:15.430Z level=INFO msg="Upload complete. (492ms)"5178lb # [ 110.881024] niks3-server[993]: 2026/09/20 09:02:15 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5179lb # [ 110.886235] niks3-server[993]: 2026/09/20 09:02:15 INFO Completed upload id=355180lb # [ 110.889448] niks3-server[993]: 2026/09/20 09:02:15 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5181worker2 # [ 110.857518] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56314 duration_s=0 paths=1 nar_bytes_in=4245182worker2 # [ 110.866112] nix-grpc-daemon[1336]: ts=2026-09-20T09:02:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:563145183worker2 # [ 110.872306] nix-daemon[836]: accepted connection from pid 1336, user nix-grpc-daemon (trusted)5184worker2 # [ 110.876516] nix-daemon[836]: reaped child process 1452, status = succeeded5185client # [ 110.885032] nix[1190]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5186worker2 # [ 110.888199] nix-daemon[836]: accepted connection from pid 1336, user nix-grpc-daemon (trusted)5187lb # [ 111.056385] envoy[910]: conn peer=[2001:db8:1::1]:39100 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2923 tx=1332 ms=84285188lb # [ 111.062380] envoy[910]: conn peer=[2001:db8:1::3]:44082 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3772 tx=1263 ms=262085189lb: must succeed: curl -sf localhost:9901/clusters5190lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)5191lb: must succeed: curl -sf localhost:9901/clusters5192lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5193worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5194worker2 # [ 112.303229] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1336 (nix-grpc-daemon) on client request.5195worker2 # [ 112.305214] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5196client # [ 112.315726] nix[1190]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5197worker1 # [ 112.353743] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5198lb # [ 112.355252] niks3-server[993]: 2026/09/20 09:02:16 INFO lead: released remote=192.168.1.4:413345199client # [ 112.322257] nix[1190]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5200worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5201client: must succeed: sleep 5.05202worker2 # [ 112.349080] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5203worker2 # [ 112.350612] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5204worker2 # [ 112.351842] systemd[1]: nix-grpc-daemon.service: Consumed 571ms CPU time over 15.816s wall clock time, 34M memory peak, 13.2K incoming IP traffic, 18.8K outgoing IP traffic.5205worker2 # [ 112.364831] nix-daemon[836]: reaped child process 1445, status = succeeded5206worker2 # [ 112.365909] nix-daemon[836]: reaped child process 1481, status = succeeded5207worker2 # [ 112.372566] nix-daemon[1483]: unexpected Nix daemon error: error: interrupted by the user5208worker2 # [ 112.379281] nix-daemon[836]: reaped child process 1483, status = failed with exit code 15209worker2 # [ 112.497870] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5210worker2 # [ 112.505343] systemd[1]: Starting Nix worker-protocol over gRPC...5211worker1 # [ 112.553983] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:17Z level=info event=scheduler_connected addr=lb:500515212worker2 # [ 112.696971] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5213worker2 # [ 112.699202] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15214worker2 # [ 112.706869] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5215worker2 # [ 112.717446] systemd[1]: Started Nix worker-protocol over gRPC.5216lb # [ 112.757713] niks3-server[993]: 2026/09/20 09:02:17 INFO lead: acquired remote=192.168.1.4:562785217worker2 # [ 112.728159] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:17Z level=info event=scheduler_take_over5218worker2 # [ 112.740970] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05219worker2 # [ 112.754460] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:17Z level=info event=scheduler_connected addr=lb:500515220worker2 # [ 112.756327] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05221worker2 # [ 112.826283] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:17Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05222worker2 # [ 112.830435] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:17Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15223worker1 # [ 112.921994] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465185224worker1 # [ 112.937086] nix-daemon[835]: accepted connection from pid 1313, user nix-grpc-daemon (trusted)5225worker1 # [ 112.963975] nix-grpc-daemon[1313]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 1/5)5226worker1 # [ 113.003660] nix-grpc-daemon[1313]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 2/5)5227worker1 # [ 113.055896] nix-grpc-daemon[1313]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 291 ms (attempt 3/5)5228worker1 # [ 113.355665] nix-grpc-daemon[1313]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 342 ms (attempt 4/5)5229worker1 # [ 113.697797] nix-grpc-daemon[1313]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5230worker1 # [ 113.716635] nix-grpc-daemon[1313]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5231worker1 # [ 113.744760] nix-daemon[835]: accepted connection from pid 1313, user nix-grpc-daemon (trusted)5232client # [ 113.723919] nix[1190]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5233worker1 # [ 113.766458] nix-daemon[835]: accepted connection from pid 1313, user nix-grpc-daemon (trusted)5234client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5235client: waiting for success: ! systemctl is-active mid5236worker1 # [ 117.797771] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:22Z level=info event=niks3_push_started pid=14105237worker1 # [ 117.834735] nix-daemon[835]: reaped child process 1386, status = succeeded5238worker1 # [ 118.198522] nix-daemon[835]: accepted connection from pid 1423, user nix-grpc-daemon (trusted)5239worker1 # [ 118.215866] nix-daemon[835]: reaped child process 1426, status = succeeded5240lb # [ 118.225389] niks3-server[993]: 2026/09/20 09:02:22 INFO Received uploads request method=POST path=/api/pending_closures5241worker1 # [ 118.240436] nix-grpc-daemon[1410]: time=2026-09-20T09:02:22.822Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5242worker1 # [ 118.241936] nix-grpc-daemon[1410]: time=2026-09-20T09:02:22.822Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5243lb # [ 118.281420] niks3-server[993]: 2026/09/20 09:02:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5244lb # [ 118.293795] niks3-server[993]: 2026/09/20 09:02:22 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5245lb # [ 118.308471] niks3-server[993]: 2026/09/20 09:02:22 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5246lb # [ 118.321970] niks3-server[993]: 2026/09/20 09:02:22 INFO Signed narinfos id=36 count=15247worker1 # [ 118.327803] nix-grpc-daemon[1410]: time=2026-09-20T09:02:22.909Z level=INFO msg="Uploading 1 narinfos"5248lb # [ 118.334294] niks3-server[993]: 2026/09/20 09:02:22 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5249lb # [ 118.342007] niks3-server[993]: 2026/09/20 09:02:22 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5250lb # [ 118.347749] niks3-server[993]: 2026/09/20 09:02:22 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5251lb # [ 118.352704] niks3-server[993]: 2026/09/20 09:02:22 INFO Completed upload id=365252worker1 # [ 118.357199] nix-grpc-daemon[1410]: time=2026-09-20T09:02:22.940Z level=INFO msg="Upload complete. (332ms)"5253worker1 # [ 118.368408] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46518 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15254worker1 # [ 118.387073] nix-daemon[835]: reaped child process 1384, status = succeeded5255client # [ 118.373126] systemd[1]: mid.service: Deactivated successfully.5256client # [ 118.377379] systemd[1]: mid.service: Consumed 166ms CPU time over 8.957s wall clock time, 37M memory peak, 9.8K incoming IP traffic, 10.7K outgoing IP traffic.5257client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5258client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5259client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)5260(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.54 seconds)5261subtest: interrupting the client stops the build on the worker5262client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5263client # [ 118.934497] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5264client # Running as unit: intr.service; invocation ID: 6a99f69b630440a68aba20ea256b658c5265client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.05 seconds)5266worker1 # [ 119.190814] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:465185267client # [ 119.160221] nix[1225]: don't know how to build these paths:5268client # [ 119.161866] nix[1225]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5269worker2 # [ 119.176596] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:23Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05270worker2 # [ 119.181989] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:23Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15271worker2 # [ 119.234153] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439145272worker2 # [ 119.248913] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5273worker2 # [ 119.271971] nix-grpc-daemon[1515]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5)5274worker2 # [ 119.296947] nix-grpc-daemon[1515]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 2/5)5275worker2 # [ 119.356467] nix-grpc-daemon[1515]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 276 ms (attempt 3/5)5276worker2 # [ 119.640084] nix-grpc-daemon[1515]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 299 ms (attempt 4/5)5277worker2 # [ 119.939644] nix-grpc-daemon[1515]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5278worker2 # [ 119.961059] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:439145279client # [ 119.975833] nix[1225]: copying 1 paths to 'lb:50051'...5280worker2 # [ 119.977069] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:439145281client # [ 119.976273] nix[1225]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5282worker2 # [ 119.991216] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5283worker2 # [ 120.017663] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:24Z level=info event=niks3_push_started pid=15875284worker2 # [ 120.407801] nix-daemon[836]: accepted connection from pid 1604, user nix-grpc-daemon (trusted)5285worker2 # [ 120.426525] nix-daemon[836]: reaped child process 1607, status = succeeded5286worker2 # [ 120.599363] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5287worker2 # [ 120.614945] nix-daemon[836]: reaped child process 1612, status = succeeded5288lb # [ 120.665475] niks3-server[993]: 2026/09/20 09:02:25 INFO Received uploads request method=POST path=/api/pending_closures5289worker2 # [ 120.644416] nix-grpc-daemon[1587]: time=2026-09-20T09:02:25.225Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5290worker2 # [ 120.645846] nix-grpc-daemon[1587]: time=2026-09-20T09:02:25.225Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5291worker2 # [ 120.685215] nix-grpc-daemon[1587]: time=2026-09-20T09:02:25.267Z level=INFO msg="Uploading 1 narinfos"5292lb # [ 120.708954] niks3-server[993]: 2026/09/20 09:02:25 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5293lb # [ 120.723005] niks3-server[993]: 2026/09/20 09:02:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5294lb # [ 120.733981] niks3-server[993]: 2026/09/20 09:02:25 INFO Signed narinfos id=37 count=15295lb # [ 120.737995] niks3-server[993]: 2026/09/20 09:02:25 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5296lb # [ 120.746731] niks3-server[993]: 2026/09/20 09:02:25 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5297lb # [ 120.751251] niks3-server[993]: 2026/09/20 09:02:25 INFO Completed upload id=375298worker2 # [ 120.718506] nix-grpc-daemon[1587]: time=2026-09-20T09:02:25.301Z level=INFO msg="Upload complete. (482ms)"5299lb # [ 120.754093] niks3-server[993]: 2026/09/20 09:02:25 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5300worker2 # [ 120.730019] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=0 paths=1 nar_bytes_in=4245301worker2 # [ 120.742201] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439145302worker2 # [ 120.748464] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5303worker2 # [ 120.754662] nix-daemon[836]: reaped child process 1585, status = succeeded5304client # [ 120.763735] nix[1225]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5305worker2 # [ 120.767469] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5306lb # [ 121.057752] envoy[910]: conn peer=[2001:db8:1::4]:48828 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=656 tx=311 ms=155345307lb # [ 121.062928] envoy[910]: conn peer=[2001:db8:1::1]:38380 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3858 tx=1702 ms=86845308client: must succeed: systemctl kill -s INT intr5309client # [ 122.643544] systemd[1]: intr.service: Sent signal SIGINT to main process 1225 (nix) on client request.5310client # [ 122.650898] nix[1225]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5311client # [ 122.662076] nix[1225]: error: interrupted by the user5312client: (finished: must succeed: systemctl kill -s INT intr, in 0.09 seconds)5313client # [ 122.691679] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5314client # [ 122.696542] systemd[1]: intr.service: Failed with result 'exit-code'.5315client # [ 122.698627] systemd[1]: intr.service: Consumed 139ms CPU time over 3.760s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.5316worker2 # [ 122.804335] nix-daemon[1616]: unexpected Nix daemon error: error: interrupted by the user5317worker2 # [ 122.813633] nix-daemon[836]: reaped child process 1614, status = succeeded5318worker2 # [ 122.819572] nix-daemon[836]: reaped child process 1616, status = failed with exit code 15319(finished: subtest: interrupting the client stops the build on the worker, in 3.93 seconds)5320subtest: a deploy mid-build drains: the build finishes, the new generation takes over5321client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5322client # [ 122.893538] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5323client # Running as unit: sw.service; invocation ID: 77e929584d1d451c90b797f6f2245dac5324client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5325worker2 # [ 123.130892] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:439145326client # [ 123.138356] nix[1244]: don't know how to build these paths:5327client # [ 123.139600] nix[1244]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5328worker2 # [ 123.148261] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:27Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05329worker2 # [ 123.154144] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:27Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15330worker1 # [ 123.239621] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465185331worker1 # [ 123.254690] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:465185332client # [ 123.231328] nix[1244]: copying 1 paths to 'lb:50051'...5333worker1 # [ 123.269519] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:465185334client # [ 123.233912] nix[1244]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5335worker1 # [ 123.284736] nix-daemon[835]: accepted connection from pid 1313, user nix-grpc-daemon (trusted)5336worker1 # [ 123.490183] nix-daemon[835]: accepted connection from pid 1454, user nix-grpc-daemon (trusted)5337worker1 # [ 123.509150] nix-daemon[835]: reaped child process 1457, status = succeeded5338worker1 # [ 123.682024] nix-daemon[835]: accepted connection from pid 1459, user nix-grpc-daemon (trusted)5339worker1 # [ 123.698321] nix-daemon[835]: reaped child process 1462, status = succeeded5340lb # [ 123.707334] niks3-server[993]: 2026/09/20 09:02:28 INFO Received uploads request method=POST path=/api/pending_closures5341worker1 # [ 123.721159] nix-grpc-daemon[1410]: time=2026-09-20T09:02:28.303Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5342worker1 # [ 123.722666] nix-grpc-daemon[1410]: time=2026-09-20T09:02:28.303Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5343lb # [ 123.736842] niks3-server[993]: 2026/09/20 09:02:28 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5344lb # [ 123.747730] niks3-server[993]: 2026/09/20 09:02:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5345worker1 # [ 123.757452] nix-grpc-daemon[1410]: time=2026-09-20T09:02:28.340Z level=INFO msg="Uploading 1 narinfos"5346lb # [ 123.755926] niks3-server[993]: 2026/09/20 09:02:28 INFO Signed narinfos id=38 count=15347lb # [ 123.764655] niks3-server[993]: 2026/09/20 09:02:28 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5348lb # [ 123.772235] niks3-server[993]: 2026/09/20 09:02:28 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5349lb # [ 123.779957] niks3-server[993]: 2026/09/20 09:02:28 INFO Completed upload id=385350worker1 # [ 123.783579] nix-grpc-daemon[1410]: time=2026-09-20T09:02:28.366Z level=INFO msg="Upload complete. (480ms)"5351lb # [ 123.782536] niks3-server[993]: 2026/09/20 09:02:28 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5352worker1 # [ 123.792238] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46518 duration_s=0 paths=1 nar_bytes_in=4165353worker1 # [ 123.803178] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:465185354worker1 # [ 123.812452] nix-daemon[835]: accepted connection from pid 1313, user nix-grpc-daemon (trusted)5355worker1 # [ 123.815311] nix-daemon[835]: reaped child process 1452, status = succeeded5356client # [ 123.786194] nix[1244]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5357worker1 # [ 123.828173] nix-daemon[835]: accepted connection from pid 1313, user nix-grpc-daemon (trusted)5358worker1: must succeed: systemctl reload nix-grpc-daemon.service5359worker1 # [ 125.635400] systemd[1]: Reloading Nix worker-protocol over gRPC...5360worker1 # [ 125.686394] systemd[1]: Reloaded Nix worker-protocol over gRPC.5361worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5362worker1: must succeed: pgrep -f 'read -t [9]0 x'5363worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5364client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25365worker2 # [ 125.973074] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:439145366client # don't know how to build these paths:5367client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5368worker2 # [ 125.982673] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:439145369worker2 # [ 126.009050] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:30Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05370worker2 # [ 126.015640] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:30Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15371worker2 # [ 126.060167] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439145372worker2 # [ 126.075133] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:439145373client # copying 1 paths to 'lb:50051'...5374worker2 # [ 126.090692] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:439145375client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5376worker2 # [ 126.114988] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5377worker1 # [ 126.290471] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:30Z level=info event=draining5378worker2 # [ 126.317665] nix-daemon[836]: accepted connection from pid 1666, user nix-grpc-daemon (trusted)5379worker2 # [ 126.335232] nix-daemon[836]: reaped child process 1669, status = succeeded5380worker2 # [ 126.507961] nix-daemon[836]: accepted connection from pid 1671, user nix-grpc-daemon (trusted)5381worker2 # [ 126.525711] nix-daemon[836]: reaped child process 1674, status = succeeded5382lb # [ 126.570530] niks3-server[993]: 2026/09/20 09:02:31 INFO Received uploads request method=POST path=/api/pending_closures5383worker2 # [ 126.547654] nix-grpc-daemon[1587]: time=2026-09-20T09:02:31.129Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5384worker2 # [ 126.549250] nix-grpc-daemon[1587]: time=2026-09-20T09:02:31.129Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5385lb # [ 126.618927] niks3-server[993]: 2026/09/20 09:02:31 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5386worker2 # [ 126.597186] nix-grpc-daemon[1587]: time=2026-09-20T09:02:31.179Z level=INFO msg="Uploading 1 narinfos"5387lb # [ 126.630394] niks3-server[993]: 2026/09/20 09:02:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5388lb # [ 126.639208] niks3-server[993]: 2026/09/20 09:02:31 INFO Signed narinfos id=39 count=15389lb # [ 126.644604] niks3-server[993]: 2026/09/20 09:02:31 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5390worker2 # [ 126.619364] nix-grpc-daemon[1587]: time=2026-09-20T09:02:31.201Z level=INFO msg="Upload complete. (487ms)"5391lb # [ 126.652847] niks3-server[993]: 2026/09/20 09:02:31 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5392lb # [ 126.657132] niks3-server[993]: 2026/09/20 09:02:31 INFO Completed upload id=395393lb # [ 126.660440] niks3-server[993]: 2026/09/20 09:02:31 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5394worker2 # [ 126.626816] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=0 paths=1 nar_bytes_in=5285395worker2 # [ 126.642660] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439145396worker2 # [ 126.650120] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5397worker2 # [ 126.655495] nix-daemon[836]: reaped child process 1664, status = succeeded5398client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5399client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5400worker2 # [ 126.668923] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5401client # farm-a> LOG-farm-a-during-drain5402worker2 # [ 128.289887] nix-daemon[836]: reaped child process 1678, status = succeeded5403worker2 # [ 128.446088] nix-daemon[836]: accepted connection from pid 1693, user nix-grpc-daemon (trusted)5404worker2 # [ 128.463790] nix-daemon[836]: reaped child process 1696, status = succeeded5405lb # [ 128.513723] niks3-server[993]: 2026/09/20 09:02:33 INFO Received uploads request method=POST path=/api/pending_closures5406worker2 # [ 128.488574] nix-grpc-daemon[1587]: time=2026-09-20T09:02:33.070Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5407worker2 # [ 128.493014] nix-grpc-daemon[1587]: time=2026-09-20T09:02:33.072Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5408lb # [ 128.551054] niks3-server[993]: 2026/09/20 09:02:33 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5409worker2 # [ 128.535439] nix-grpc-daemon[1587]: time=2026-09-20T09:02:33.117Z level=INFO msg="Uploading 1 narinfos"5410lb # [ 128.565146] niks3-server[993]: 2026/09/20 09:02:33 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5411lb # [ 128.578388] niks3-server[993]: 2026/09/20 09:02:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5412lb # [ 128.586284] niks3-server[993]: 2026/09/20 09:02:33 INFO Signed narinfos id=40 count=15413worker2 # [ 128.560105] nix-grpc-daemon[1587]: time=2026-09-20T09:02:33.142Z level=INFO msg="Upload complete. (281ms)"5414lb # [ 128.594458] niks3-server[993]: 2026/09/20 09:02:33 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5415lb # [ 128.600445] niks3-server[993]: 2026/09/20 09:02:33 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5416worker2 # [ 128.568765] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15417lb # [ 128.606584] niks3-server[993]: 2026/09/20 09:02:33 INFO Completed upload id=405418lb # [ 128.609527] niks3-server[993]: 2026/09/20 09:02:33 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5419worker2 # [ 128.585321] nix-daemon[836]: reaped child process 1676, status = succeeded5420worker2 # [ 128.588365] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:33Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05421worker2 # [ 128.592272] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:33Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15422worker2 # [ 128.641111] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439145423worker2 # [ 128.655688] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:439145424worker2 # [ 128.669522] nix-grpc-daemon[1587]: time=2026-09-20T09:02:33.252Z level=INFO msg="All 1 paths already cached"5425client # copying 1 paths to 'lb:50051'...5426worker2 # [ 128.679429] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:439145427client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5428worker2 # [ 128.702854] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5429worker2 # [ 128.907346] nix-daemon[836]: accepted connection from pid 1702, user nix-grpc-daemon (trusted)5430worker2 # [ 128.926611] nix-daemon[836]: reaped child process 1705, status = succeeded5431worker2 # [ 129.098575] nix-daemon[836]: accepted connection from pid 1707, user nix-grpc-daemon (trusted)5432worker2 # [ 129.114714] nix-daemon[836]: reaped child process 1710, status = succeeded5433lb # [ 129.159442] niks3-server[993]: 2026/09/20 09:02:33 INFO Received uploads request method=POST path=/api/pending_closures5434worker2 # [ 129.135321] nix-grpc-daemon[1587]: time=2026-09-20T09:02:33.717Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5435worker2 # [ 129.136971] nix-grpc-daemon[1587]: time=2026-09-20T09:02:33.717Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5436lb # [ 129.187365] niks3-server[993]: 2026/09/20 09:02:33 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5437lb # [ 129.199637] niks3-server[993]: 2026/09/20 09:02:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5438worker2 # [ 129.173287] nix-grpc-daemon[1587]: time=2026-09-20T09:02:33.755Z level=INFO msg="Uploading 1 narinfos"5439lb # [ 129.211408] niks3-server[993]: 2026/09/20 09:02:33 INFO Signed narinfos id=41 count=15440lb # [ 129.218872] niks3-server[993]: 2026/09/20 09:02:33 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5441lb # [ 129.226514] niks3-server[993]: 2026/09/20 09:02:33 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5442lb # [ 129.232770] niks3-server[993]: 2026/09/20 09:02:33 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5443lb # [ 129.237879] niks3-server[993]: 2026/09/20 09:02:33 INFO Completed upload id=415444worker2 # [ 129.205035] nix-grpc-daemon[1587]: time=2026-09-20T09:02:33.787Z level=INFO msg="Upload complete. (484ms)"5445worker2 # [ 129.216663] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=0 paths=1 nar_bytes_in=6405446worker2 # [ 129.228220] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439145447worker2 # [ 129.233586] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5448worker2 # [ 129.238552] nix-daemon[836]: reaped child process 1700, status = succeeded5449client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5450worker2 # [ 129.250158] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5451client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5452worker2 # [ 130.277290] nix-daemon[836]: reaped child process 1714, status = succeeded5453client # farm-b> LOG-farm-b-during-drain5454worker2 # [ 130.439128] nix-daemon[836]: accepted connection from pid 1729, user nix-grpc-daemon (trusted)5455worker2 # [ 130.458072] nix-daemon[836]: reaped child process 1732, status = succeeded5456lb # [ 130.504811] niks3-server[993]: 2026/09/20 09:02:35 INFO Received uploads request method=POST path=/api/pending_closures5457worker2 # [ 130.483438] nix-grpc-daemon[1587]: time=2026-09-20T09:02:35.065Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5458worker2 # [ 130.485073] nix-grpc-daemon[1587]: time=2026-09-20T09:02:35.065Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5459lb # [ 130.536267] niks3-server[993]: 2026/09/20 09:02:35 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5460lb # [ 130.552722] niks3-server[993]: 2026/09/20 09:02:35 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5461lb # [ 130.563794] niks3-server[993]: 2026/09/20 09:02:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5462worker2 # [ 130.535628] nix-grpc-daemon[1587]: time=2026-09-20T09:02:35.117Z level=INFO msg="Uploading 1 narinfos"5463lb # [ 130.570715] niks3-server[993]: 2026/09/20 09:02:35 INFO Signed narinfos id=42 count=15464lb # [ 130.577398] niks3-server[993]: 2026/09/20 09:02:35 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5465lb # [ 130.585979] niks3-server[993]: 2026/09/20 09:02:35 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5466lb # [ 130.591843] niks3-server[993]: 2026/09/20 09:02:35 INFO Completed upload id=425467worker2 # [ 130.558447] nix-grpc-daemon[1587]: time=2026-09-20T09:02:35.141Z level=INFO msg="Upload complete. (296ms)"5468lb # [ 130.594196] niks3-server[993]: 2026/09/20 09:02:35 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5469worker2 # [ 130.574605] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15470worker2 # [ 130.589750] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:35Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05471worker2 # [ 130.593424] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:35Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15472worker2 # [ 130.597088] nix-daemon[836]: reaped child process 1712, status = succeeded5473worker2 # [ 130.619855] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439145474worker2 # [ 130.635302] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:439145475worker2 # [ 130.651293] nix-grpc-daemon[1587]: time=2026-09-20T09:02:35.233Z level=INFO msg="All 2 paths already cached"5476client # copying 1 paths to 'lb:50051'...5477client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5478worker2 # [ 130.661835] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:439145479worker2 # [ 130.680716] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5480worker2 # [ 130.881122] nix-daemon[836]: accepted connection from pid 1738, user nix-grpc-daemon (trusted)5481worker2 # [ 130.900756] nix-daemon[836]: reaped child process 1741, status = succeeded5482lb # [ 131.059103] envoy[910]: conn peer=[2001:db8:1::1]:54162 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=756 ms=35205483worker2 # [ 131.071139] nix-daemon[836]: accepted connection from pid 1743, user nix-grpc-daemon (trusted)5484worker2 # [ 131.090202] nix-daemon[836]: reaped child process 1746, status = succeeded5485lb # [ 131.134639] niks3-server[993]: 2026/09/20 09:02:35 INFO Received uploads request method=POST path=/api/pending_closures5486worker2 # [ 131.110982] nix-grpc-daemon[1587]: time=2026-09-20T09:02:35.693Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5487worker2 # [ 131.112553] nix-grpc-daemon[1587]: time=2026-09-20T09:02:35.693Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5488lb # [ 131.162502] niks3-server[993]: 2026/09/20 09:02:35 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5489lb # [ 131.174205] niks3-server[993]: 2026/09/20 09:02:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5490worker2 # [ 131.148696] nix-grpc-daemon[1587]: time=2026-09-20T09:02:35.731Z level=INFO msg="Uploading 1 narinfos"5491lb # [ 131.183735] niks3-server[993]: 2026/09/20 09:02:35 INFO Signed narinfos id=43 count=15492lb # [ 131.189986] niks3-server[993]: 2026/09/20 09:02:35 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5493lb # [ 131.198978] niks3-server[993]: 2026/09/20 09:02:35 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5494lb # [ 131.205350] niks3-server[993]: 2026/09/20 09:02:35 INFO Completed upload id=435495worker2 # [ 131.172527] nix-grpc-daemon[1587]: time=2026-09-20T09:02:35.755Z level=INFO msg="Upload complete. (474ms)"5496lb # [ 131.208135] niks3-server[993]: 2026/09/20 09:02:35 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5497worker2 # [ 131.182317] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=0 paths=1 nar_bytes_in=7685498worker2 # [ 131.193205] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439145499worker2 # [ 131.198884] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5500worker2 # [ 131.203164] nix-daemon[836]: reaped child process 1736, status = succeeded5501client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5502worker2 # [ 131.215711] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5503client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5504client # farm-top> LOG-farm-top-during-drain5505worker2 # [ 132.262194] nix-daemon[836]: reaped child process 1750, status = succeeded5506worker2 # [ 132.427121] nix-daemon[836]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)5507worker2 # [ 132.444454] nix-daemon[836]: reaped child process 1768, status = succeeded5508lb # [ 132.492459] niks3-server[993]: 2026/09/20 09:02:37 INFO Received uploads request method=POST path=/api/pending_closures5509worker2 # [ 132.472508] nix-grpc-daemon[1587]: time=2026-09-20T09:02:37.053Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5510worker2 # [ 132.474656] nix-grpc-daemon[1587]: time=2026-09-20T09:02:37.054Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5511lb # [ 132.535727] niks3-server[993]: 2026/09/20 09:02:37 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5512worker2 # [ 132.515009] nix-grpc-daemon[1587]: time=2026-09-20T09:02:37.097Z level=INFO msg="Uploading 1 narinfos"5513lb # [ 132.550185] niks3-server[993]: 2026/09/20 09:02:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5514lb # [ 132.561011] niks3-server[993]: 2026/09/20 09:02:37 INFO Signed narinfos id=44 count=15515lb # [ 132.566549] niks3-server[993]: 2026/09/20 09:02:37 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5516lb # [ 132.571604] niks3-server[993]: 2026/09/20 09:02:37 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5517worker2 # [ 132.547827] nix-grpc-daemon[1587]: time=2026-09-20T09:02:37.130Z level=INFO msg="Upload complete. (322ms)"5518lb # [ 132.581462] niks3-server[993]: 2026/09/20 09:02:37 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5519lb # [ 132.585433] niks3-server[993]: 2026/09/20 09:02:37 INFO Completed upload id=445520lb # [ 132.589387] niks3-server[993]: 2026/09/20 09:02:37 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5521worker2 # [ 132.561900] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15522worker2 # [ 132.579973] nix-daemon[836]: reaped child process 1748, status = succeeded5523client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.90 seconds)5524client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5525client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5526worker1: must succeed: pkill -f 'read -t [9]0 x'5527worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5528client: waiting for success: ! systemctl is-active sw5529worker1 # [ 133.067018] nix-daemon[835]: reaped child process 1466, status = succeeded5530worker1 # [ 133.236610] nix-daemon[835]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5531worker1 # [ 133.254806] nix-daemon[835]: reaped child process 1509, status = succeeded5532lb # [ 133.263914] niks3-server[993]: 2026/09/20 09:02:37 INFO Received uploads request method=POST path=/api/pending_closures5533worker1 # [ 133.278267] nix-grpc-daemon[1410]: time=2026-09-20T09:02:37.860Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5534worker1 # [ 133.279743] nix-grpc-daemon[1410]: time=2026-09-20T09:02:37.860Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5535lb # [ 133.289989] niks3-server[993]: 2026/09/20 09:02:37 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5536lb # [ 133.310447] niks3-server[993]: 2026/09/20 09:02:37 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5537lb # [ 133.319818] niks3-server[993]: 2026/09/20 09:02:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5538worker1 # [ 133.329359] nix-grpc-daemon[1410]: time=2026-09-20T09:02:37.911Z level=INFO msg="Uploading 1 narinfos"5539lb # [ 133.326930] niks3-server[993]: 2026/09/20 09:02:37 INFO Signed narinfos id=45 count=15540lb # [ 133.331618] niks3-server[993]: 2026/09/20 09:02:37 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5541lb # [ 133.340096] niks3-server[993]: 2026/09/20 09:02:37 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5542lb # [ 133.346337] niks3-server[993]: 2026/09/20 09:02:37 INFO Completed upload id=455543worker1 # [ 133.350519] nix-grpc-daemon[1410]: time=2026-09-20T09:02:37.933Z level=INFO msg="Upload complete. (307ms)"5544lb # [ 133.349632] niks3-server[993]: 2026/09/20 09:02:37 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5545worker1 # [ 133.361008] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46518 duration_s=9 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15546worker1 # [ 133.376993] nix-daemon[835]: reaped child process 1464, status = succeeded5547client # [ 133.365593] systemd[1]: sw.service: Deactivated successfully.5548client # [ 133.371000] systemd[1]: sw.service: Consumed 154ms CPU time over 10.472s wall clock time, 37M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5549client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds)5550client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5551client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5552worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5553worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.07 seconds)5554lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5555lb: must succeed: curl -sf localhost:9901/clusters5556lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5557worker1 # [ 134.292663] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:38Z level=info event=signal_exit5558lb: must succeed: curl -sf localhost:9901/clusters5559lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5560worker2 # [ 135.482621] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:438985561worker1 # [ 135.522172] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:40Z level=info event=scheduler_restarting5562worker2 # [ 135.483095] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:40Z level=info event=worker_gone addr=192.168.1.3:500515563worker1 # [ 135.545598] nix-grpc-daemon[1313]: ts=2026-09-20T09:02:40Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5564worker1 # [ 135.571427] nix-daemon[835]: reaped child process 1378, status = succeeded5565worker1 # [ 136.064965] nix-grpc-daemon[1313]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5566worker1 # [ 136.069679] nix-grpc-daemon[1313]: E0000 00:00:1789894960.647969 1356 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5567worker1 # [ 136.082246] nix-grpc-daemon[1313]: E0000 00:00:1789894960.665307 1356 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5568lb: must succeed: curl -sf localhost:9901/clusters5569lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5570worker1 # [ 137.343817] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5571worker1 # [ 137.347235] systemd[1]: nix-grpc-daemon.service: Consumed 868ms CPU time over 28.279s wall clock time, 33.1M memory peak, 21.2K incoming IP traffic, 27.7K outgoing IP traffic.5572lb: must succeed: curl -sf localhost:9901/clusters5573lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5574worker1 # [ 138.331911] systemd[1]: Starting Nix worker-protocol over gRPC...5575lb: must succeed: curl -sf localhost:9901/clusters5576worker1 # [ 138.543387] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5577worker1 # [ 138.546689] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15578worker1 # [ 138.554478] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5579worker1 # [ 138.565469] systemd[1]: Started Nix worker-protocol over gRPC.5580worker1 # [ 138.598660] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:43Z level=info event=scheduler_connected addr=lb:500515581worker2 # [ 138.564810] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05582lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5583lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 4.41 seconds)5584lb: must succeed: curl -sf localhost:9901/clusters5585lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5586worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5587worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5588(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.88 seconds)5589subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5590client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15591worker2 # [ 138.952509] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:439145592worker2 # [ 138.964135] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:439145593worker2 # [ 138.993791] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:43Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05594worker2 # [ 138.999846] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:43Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15595worker2 # [ 139.005941] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:43Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05596worker2 # [ 139.011186] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:43Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05597worker1 # [ 139.082066] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925598worker1 # [ 139.096122] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5599worker1 # [ 139.120833] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5)5600worker1 # [ 139.196733] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 2/5)5601worker1 # [ 139.277083] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 3/5)5602worker1 # [ 139.442528] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 188 ms (attempt 4/5)5603worker1 # [ 139.639692] nix-grpc-daemon[1521]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5604worker1 # [ 139.660150] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410925605worker1 # [ 139.675389] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410925606worker1 # [ 139.689631] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5607worker1 # [ 139.719779] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:44Z level=info event=niks3_push_started pid=15775608worker1 # [ 140.119943] nix-daemon[835]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)5609worker1 # [ 140.137105] nix-daemon[835]: reaped child process 1593, status = succeeded5610worker1 # [ 140.316988] nix-daemon[835]: accepted connection from pid 1595, user nix-grpc-daemon (trusted)5611worker1 # [ 140.334393] nix-daemon[835]: reaped child process 1598, status = succeeded5612lb # [ 140.342665] niks3-server[993]: 2026/09/20 09:02:44 INFO Received uploads request method=POST path=/api/pending_closures5613worker1 # [ 140.356396] nix-grpc-daemon[1577]: time=2026-09-20T09:02:44.939Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5614worker1 # [ 140.357920] nix-grpc-daemon[1577]: time=2026-09-20T09:02:44.939Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5615lb # [ 140.380476] niks3-server[993]: 2026/09/20 09:02:44 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5616worker1 # [ 140.394291] nix-grpc-daemon[1577]: time=2026-09-20T09:02:44.977Z level=INFO msg="Uploading 1 narinfos"5617lb # [ 140.391552] niks3-server[993]: 2026/09/20 09:02:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5618lb # [ 140.403426] niks3-server[993]: 2026/09/20 09:02:44 INFO Signed narinfos id=46 count=15619lb # [ 140.413409] niks3-server[993]: 2026/09/20 09:02:44 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5620lb # [ 140.418432] niks3-server[993]: 2026/09/20 09:02:44 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5621worker1 # [ 140.422012] nix-grpc-daemon[1577]: time=2026-09-20T09:02:45.005Z level=INFO msg="Upload complete. (475ms)"5622lb # [ 140.423806] niks3-server[993]: 2026/09/20 09:02:45 INFO Completed upload id=465623worker1 # [ 140.428356] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=0 paths=1 nar_bytes_in=5125624lb # [ 140.427182] niks3-server[993]: 2026/09/20 09:02:45 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5625worker1 # [ 140.440643] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925626worker1 # [ 140.444357] nix-daemon[835]: reaped child process 1575, status = succeeded5627worker1 # [ 140.451676] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5628worker1 # [ 140.462923] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5629lb # [ 141.058562] envoy[910]: conn peer=[2001:db8:1::1]:43316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9569 tx=3857 ms=66095630lb # [ 141.063605] envoy[910]: conn peer=[2001:db8:1::1]:43302 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1349 ms=102075631lb # [ 141.068521] envoy[910]: conn peer=[2001:db8:1::3]:33410 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=448 ms=262105632worker1 # [ 141.911626] nix-daemon[835]: reaped child process 1602, status = succeeded5633worker1 # [ 142.091316] nix-daemon[835]: accepted connection from pid 1617, user nix-grpc-daemon (trusted)5634worker1 # [ 142.107512] nix-daemon[835]: reaped child process 1620, status = succeeded5635lb # [ 142.119227] niks3-server[993]: 2026/09/20 09:02:46 INFO Received uploads request method=POST path=/api/pending_closures5636worker1 # [ 142.135262] nix-grpc-daemon[1577]: time=2026-09-20T09:02:46.715Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5637worker1 # [ 142.137448] nix-grpc-daemon[1577]: time=2026-09-20T09:02:46.715Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5638lb # [ 142.153527] niks3-server[993]: 2026/09/20 09:02:46 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5639lb # [ 142.167626] niks3-server[993]: 2026/09/20 09:02:46 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5640worker1 # [ 142.185237] nix-grpc-daemon[1577]: time=2026-09-20T09:02:46.767Z level=INFO msg="Uploading 1 narinfos"5641lb # [ 142.180104] niks3-server[993]: 2026/09/20 09:02:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5642lb # [ 142.189309] niks3-server[993]: 2026/09/20 09:02:46 INFO Signed narinfos id=47 count=15643lb # [ 142.191867] niks3-server[993]: 2026/09/20 09:02:46 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5644lb # [ 142.201072] niks3-server[993]: 2026/09/20 09:02:46 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5645lb # [ 142.208842] niks3-server[993]: 2026/09/20 09:02:46 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5646lb # [ 142.213303] niks3-server[993]: 2026/09/20 09:02:46 INFO Completed upload id=475647worker1 # [ 142.217640] nix-grpc-daemon[1577]: time=2026-09-20T09:02:46.800Z level=INFO msg="Upload complete. (342ms)"5648worker2 # [ 142.192637] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:46Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15649worker1 # [ 142.233106] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15650worker2 # [ 142.200298] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:46Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05651worker1 # [ 142.247654] nix-daemon[835]: reaped child process 1600, status = succeeded5652worker1 # [ 142.272842] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925653worker1 # [ 142.288257] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410925654worker1 # [ 142.302559] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410925655worker1 # [ 142.316938] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5656worker1 # [ 142.518874] nix-daemon[835]: accepted connection from pid 1624, user nix-grpc-daemon (trusted)5657worker1 # [ 142.537495] nix-daemon[835]: reaped child process 1627, status = succeeded5658worker1 # [ 142.713048] nix-daemon[835]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)5659worker1 # [ 142.730700] nix-daemon[835]: reaped child process 1632, status = succeeded5660lb # [ 142.737506] niks3-server[993]: 2026/09/20 09:02:47 INFO Received uploads request method=POST path=/api/pending_closures5661worker1 # [ 142.751748] nix-grpc-daemon[1577]: time=2026-09-20T09:02:47.334Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5662worker1 # [ 142.753467] nix-grpc-daemon[1577]: time=2026-09-20T09:02:47.334Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5663lb # [ 142.766785] niks3-server[993]: 2026/09/20 09:02:47 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5664worker1 # [ 142.784065] nix-grpc-daemon[1577]: time=2026-09-20T09:02:47.367Z level=INFO msg="Uploading 1 narinfos"5665lb # [ 142.781687] niks3-server[993]: 2026/09/20 09:02:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5666lb # [ 142.792484] niks3-server[993]: 2026/09/20 09:02:47 INFO Signed narinfos id=48 count=15667lb # [ 142.802958] niks3-server[993]: 2026/09/20 09:02:47 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5668worker1 # [ 142.814720] nix-grpc-daemon[1577]: time=2026-09-20T09:02:47.397Z level=INFO msg="Upload complete. (482ms)"5669lb # [ 142.815365] niks3-server[993]: 2026/09/20 09:02:47 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5670lb # [ 142.822215] niks3-server[993]: 2026/09/20 09:02:47 INFO Completed upload id=485671worker1 # [ 142.824409] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=0 paths=1 nar_bytes_in=5125672lb # [ 142.826750] niks3-server[993]: 2026/09/20 09:02:47 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5673worker1 # [ 142.835197] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925674worker1 # [ 142.844343] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5675worker1 # [ 142.846996] nix-daemon[835]: reaped child process 1622, status = succeeded5676worker1 # [ 142.857781] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5677worker1 # [ 143.479543] nix-daemon[835]: reaped child process 1636, status = succeeded5678worker1 # [ 143.642553] nix-daemon[835]: accepted connection from pid 1651, user nix-grpc-daemon (trusted)5679worker1 # [ 143.659851] nix-daemon[835]: reaped child process 1654, status = succeeded5680lb # [ 143.670374] niks3-server[993]: 2026/09/20 09:02:48 INFO Received uploads request method=POST path=/api/pending_closures5681worker1 # [ 143.682843] nix-grpc-daemon[1577]: time=2026-09-20T09:02:48.265Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5682worker1 # [ 143.684419] nix-grpc-daemon[1577]: time=2026-09-20T09:02:48.265Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5683lb # [ 143.694901] niks3-server[993]: 2026/09/20 09:02:48 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5684worker1 # [ 143.723204] nix-grpc-daemon[1577]: time=2026-09-20T09:02:48.306Z level=INFO msg="Uploading 1 narinfos"5685lb # [ 143.719442] niks3-server[993]: 2026/09/20 09:02:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5686lb # [ 143.729921] niks3-server[993]: 2026/09/20 09:02:48 INFO Signed narinfos id=49 count=15687lb # [ 143.736257] niks3-server[993]: 2026/09/20 09:02:48 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5688lb # [ 143.742269] niks3-server[993]: 2026/09/20 09:02:48 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5689lb # [ 143.753650] niks3-server[993]: 2026/09/20 09:02:48 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5690lb # [ 143.759878] niks3-server[993]: 2026/09/20 09:02:48 INFO Completed upload id=495691worker1 # [ 143.764069] nix-grpc-daemon[1577]: time=2026-09-20T09:02:48.347Z level=INFO msg="Upload complete. (295ms)"5692lb # [ 143.762934] niks3-server[993]: 2026/09/20 09:02:48 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5693worker2 # [ 143.736593] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:48Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15694worker1 # [ 143.774258] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=0 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15695worker2 # [ 143.748467] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:48Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05696worker1 # [ 143.792323] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925697worker1 # [ 143.798302] nix-daemon[835]: reaped child process 1634, status = succeeded5698worker1 # [ 143.802311] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410925699worker1 # [ 143.810529] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410925700worker1 # [ 143.820821] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5701worker1 # [ 144.005946] nix-daemon[835]: accepted connection from pid 1658, user nix-grpc-daemon (trusted)5702worker1 # [ 144.025202] nix-daemon[835]: reaped child process 1661, status = succeeded5703worker1 # [ 144.203328] nix-daemon[835]: accepted connection from pid 1663, user nix-grpc-daemon (trusted)5704worker1 # [ 144.219815] nix-daemon[835]: reaped child process 1666, status = succeeded5705lb # [ 144.230040] niks3-server[993]: 2026/09/20 09:02:48 INFO Received uploads request method=POST path=/api/pending_closures5706worker1 # [ 144.243551] nix-grpc-daemon[1577]: time=2026-09-20T09:02:48.826Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5707worker1 # [ 144.245237] nix-grpc-daemon[1577]: time=2026-09-20T09:02:48.826Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5708lb # [ 144.261223] niks3-server[993]: 2026/09/20 09:02:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5709worker1 # [ 144.272529] nix-grpc-daemon[1577]: time=2026-09-20T09:02:48.855Z level=INFO msg="Uploading 1 narinfos"5710lb # [ 144.276735] niks3-server[993]: 2026/09/20 09:02:48 INFO Signed narinfos id=50 count=15711lb # [ 144.279901] niks3-server[993]: 2026/09/20 09:02:48 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5712lb # [ 144.289835] niks3-server[993]: 2026/09/20 09:02:48 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5713lb # [ 144.299985] niks3-server[993]: 2026/09/20 09:02:48 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5714worker1 # [ 144.309487] nix-grpc-daemon[1577]: time=2026-09-20T09:02:48.892Z level=INFO msg="Upload complete. (476ms)"5715lb # [ 144.306033] niks3-server[993]: 2026/09/20 09:02:48 INFO Completed upload id=505716lb # [ 144.310229] niks3-server[993]: 2026/09/20 09:02:48 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5717worker1 # [ 144.316158] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=0 paths=1 nar_bytes_in=5125718worker1 # [ 144.331115] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925719worker1 # [ 144.337751] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5720worker1 # [ 144.342354] nix-daemon[835]: reaped child process 1656, status = succeeded5721worker1 # [ 144.355273] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5722worker1 # [ 145.796949] nix-daemon[835]: reaped child process 1670, status = succeeded5723worker1 # [ 145.985462] nix-daemon[835]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)5724worker1 # [ 146.002855] nix-daemon[835]: reaped child process 1688, status = succeeded5725lb # [ 146.011346] niks3-server[993]: 2026/09/20 09:02:50 INFO Received uploads request method=POST path=/api/pending_closures5726worker1 # [ 146.024373] nix-grpc-daemon[1577]: time=2026-09-20T09:02:50.607Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5727worker1 # [ 146.025885] nix-grpc-daemon[1577]: time=2026-09-20T09:02:50.607Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5728lb # [ 146.048719] niks3-server[993]: 2026/09/20 09:02:50 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5729lb # [ 146.059167] niks3-server[993]: 2026/09/20 09:02:50 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5730lb # [ 146.071147] niks3-server[993]: 2026/09/20 09:02:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5731lb # [ 146.077740] niks3-server[993]: 2026/09/20 09:02:50 INFO Signed narinfos id=51 count=15732worker1 # [ 146.082020] nix-grpc-daemon[1577]: time=2026-09-20T09:02:50.664Z level=INFO msg="Uploading 1 narinfos"5733lb # [ 146.082168] niks3-server[993]: 2026/09/20 09:02:50 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5734lb # [ 146.091309] niks3-server[993]: 2026/09/20 09:02:50 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5735lb # [ 146.098891] niks3-server[993]: 2026/09/20 09:02:50 INFO Completed upload id=515736worker1 # [ 146.103142] nix-grpc-daemon[1577]: time=2026-09-20T09:02:50.686Z level=INFO msg="Upload complete. (337ms)"5737lb # [ 146.101714] niks3-server[993]: 2026/09/20 09:02:50 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5738worker2 # [ 146.075079] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:50Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15739worker1 # [ 146.117218] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15740worker2 # [ 146.089620] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:50Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05741worker1 # [ 146.132677] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925742worker1 # [ 146.140674] nix-daemon[835]: reaped child process 1668, status = succeeded5743worker1 # [ 146.147979] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410925744worker1 # [ 146.158655] nix-grpc-daemon[1577]: time=2026-09-20T09:02:50.741Z level=INFO msg="All 1 paths already cached"5745worker1 # [ 146.166540] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410925746worker1 # [ 146.178054] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5747worker1 # [ 146.369845] nix-daemon[835]: accepted connection from pid 1692, user nix-grpc-daemon (trusted)5748worker1 # [ 146.388712] nix-daemon[835]: reaped child process 1695, status = succeeded5749worker1 # [ 146.568355] nix-daemon[835]: accepted connection from pid 1697, user nix-grpc-daemon (trusted)5750worker1 # [ 146.587355] nix-daemon[835]: reaped child process 1700, status = succeeded5751lb # [ 146.595989] niks3-server[993]: 2026/09/20 09:02:51 INFO Received uploads request method=POST path=/api/pending_closures5752worker1 # [ 146.608621] nix-grpc-daemon[1577]: time=2026-09-20T09:02:51.191Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5753worker1 # [ 146.610140] nix-grpc-daemon[1577]: time=2026-09-20T09:02:51.191Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5754lb # [ 146.621541] niks3-server[993]: 2026/09/20 09:02:51 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5755lb # [ 146.634608] niks3-server[993]: 2026/09/20 09:02:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5756worker1 # [ 146.644838] nix-grpc-daemon[1577]: time=2026-09-20T09:02:51.227Z level=INFO msg="Uploading 1 narinfos"5757lb # [ 146.644173] niks3-server[993]: 2026/09/20 09:02:51 INFO Signed narinfos id=52 count=15758lb # [ 146.646839] niks3-server[993]: 2026/09/20 09:02:51 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5759lb # [ 146.658070] niks3-server[993]: 2026/09/20 09:02:51 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5760lb # [ 146.662773] niks3-server[993]: 2026/09/20 09:02:51 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5761lb # [ 146.666649] niks3-server[993]: 2026/09/20 09:02:51 INFO Completed upload id=525762worker1 # [ 146.670817] nix-grpc-daemon[1577]: time=2026-09-20T09:02:51.254Z level=INFO msg="Upload complete. (480ms)"5763worker1 # [ 146.677819] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=0 paths=1 nar_bytes_in=6245764worker1 # [ 146.690466] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925765worker1 # [ 146.696230] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5766worker1 # [ 146.701068] nix-daemon[835]: reaped child process 1690, status = succeeded5767worker1 # [ 146.714018] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5768worker1 # [ 147.760833] nix-daemon[835]: reaped child process 1704, status = succeeded5769worker1 # [ 147.941582] nix-daemon[835]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)5770worker1 # [ 147.959303] nix-daemon[835]: reaped child process 1722, status = succeeded5771lb # [ 147.967296] niks3-server[993]: 2026/09/20 09:02:52 INFO Received uploads request method=POST path=/api/pending_closures5772worker1 # [ 147.982014] nix-grpc-daemon[1577]: time=2026-09-20T09:02:52.563Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5773worker1 # [ 147.983562] nix-grpc-daemon[1577]: time=2026-09-20T09:02:52.563Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5774lb # [ 148.012067] niks3-server[993]: 2026/09/20 09:02:52 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5775lb # [ 148.020238] niks3-server[993]: 2026/09/20 09:02:52 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5776worker1 # [ 148.030882] nix-grpc-daemon[1577]: time=2026-09-20T09:02:52.613Z level=INFO msg="Uploading 1 narinfos"5777lb # [ 148.029344] niks3-server[993]: 2026/09/20 09:02:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5778lb # [ 148.037764] niks3-server[993]: 2026/09/20 09:02:52 INFO Signed narinfos id=53 count=15779lb # [ 148.041342] niks3-server[993]: 2026/09/20 09:02:52 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5780worker1 # [ 148.052726] nix-grpc-daemon[1577]: time=2026-09-20T09:02:52.635Z level=INFO msg="Upload complete. (327ms)"5781lb # [ 148.049744] niks3-server[993]: 2026/09/20 09:02:52 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5782lb # [ 148.055414] niks3-server[993]: 2026/09/20 09:02:52 INFO Completed upload id=535783lb # [ 148.058295] niks3-server[993]: 2026/09/20 09:02:52 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5784worker2 # [ 148.023552] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:52Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15785worker1 # [ 148.065034] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15786worker2 # [ 148.037202] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:52Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05787worker1 # [ 148.081151] nix-daemon[835]: reaped child process 1702, status = succeeded5788worker1 # [ 148.116179] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925789worker1 # [ 148.131786] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410925790worker1 # [ 148.145849] nix-grpc-daemon[1577]: time=2026-09-20T09:02:52.728Z level=INFO msg="All 1 paths already cached"5791worker1 # [ 148.154337] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410925792worker1 # [ 148.170155] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5793worker1 # [ 148.374637] nix-daemon[835]: accepted connection from pid 1726, user nix-grpc-daemon (trusted)5794worker1 # [ 148.391974] nix-daemon[835]: reaped child process 1729, status = succeeded5795worker1 # [ 148.563645] nix-daemon[835]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)5796worker1 # [ 148.580819] nix-daemon[835]: reaped child process 1734, status = succeeded5797lb # [ 148.587612] niks3-server[993]: 2026/09/20 09:02:53 INFO Received uploads request method=POST path=/api/pending_closures5798worker1 # [ 148.602033] nix-grpc-daemon[1577]: time=2026-09-20T09:02:53.184Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5799worker1 # [ 148.603556] nix-grpc-daemon[1577]: time=2026-09-20T09:02:53.185Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5800lb # [ 148.618312] niks3-server[993]: 2026/09/20 09:02:53 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5801worker1 # [ 148.634871] nix-grpc-daemon[1577]: time=2026-09-20T09:02:53.217Z level=INFO msg="Uploading 1 narinfos"5802lb # [ 148.633113] niks3-server[993]: 2026/09/20 09:02:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5803lb # [ 148.642372] niks3-server[993]: 2026/09/20 09:02:53 INFO Signed narinfos id=54 count=15804lb # [ 148.653000] niks3-server[993]: 2026/09/20 09:02:53 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5805lb # [ 148.657172] niks3-server[993]: 2026/09/20 09:02:53 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5806worker1 # [ 148.666402] nix-grpc-daemon[1577]: time=2026-09-20T09:02:53.249Z level=INFO msg="Upload complete. (479ms)"5807lb # [ 148.662306] niks3-server[993]: 2026/09/20 09:02:53 INFO Completed upload id=545808lb # [ 148.665745] niks3-server[993]: 2026/09/20 09:02:53 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5809worker1 # [ 148.676254] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=0 paths=1 nar_bytes_in=6245810worker1 # [ 148.686194] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925811worker1 # [ 148.695697] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5812worker1 # [ 148.698287] nix-daemon[835]: reaped child process 1724, status = succeeded5813worker1 # [ 148.710547] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5814worker1 # [ 150.158708] nix-daemon[835]: reaped child process 1738, status = succeeded5815worker1 # [ 150.348255] nix-daemon[835]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)5816worker1 # [ 150.365782] nix-daemon[835]: reaped child process 1756, status = succeeded5817lb # [ 150.376715] niks3-server[993]: 2026/09/20 09:02:54 INFO Received uploads request method=POST path=/api/pending_closures5818worker1 # [ 150.392450] nix-grpc-daemon[1577]: time=2026-09-20T09:02:54.972Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5819worker1 # [ 150.394166] nix-grpc-daemon[1577]: time=2026-09-20T09:02:54.972Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5820lb # [ 150.417645] niks3-server[993]: 2026/09/20 09:02:55 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5821lb # [ 150.430088] niks3-server[993]: 2026/09/20 09:02:55 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5822worker1 # [ 150.443744] nix-grpc-daemon[1577]: time=2026-09-20T09:02:55.026Z level=INFO msg="Uploading 1 narinfos"5823lb # [ 150.443353] niks3-server[993]: 2026/09/20 09:02:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5824lb # [ 150.452201] niks3-server[993]: 2026/09/20 09:02:55 INFO Signed narinfos id=55 count=15825lb # [ 150.454931] niks3-server[993]: 2026/09/20 09:02:55 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5826lb # [ 150.463522] niks3-server[993]: 2026/09/20 09:02:55 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5827lb # [ 150.471422] niks3-server[993]: 2026/09/20 09:02:55 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5828lb # [ 150.476413] niks3-server[993]: 2026/09/20 09:02:55 INFO Completed upload id=555829worker1 # [ 150.480702] nix-grpc-daemon[1577]: time=2026-09-20T09:02:55.063Z level=INFO msg="Upload complete. (357ms)"5830worker2 # [ 150.451666] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:55Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15831worker1 # [ 150.493140] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15832worker2 # [ 150.465572] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:55Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05833worker1 # [ 150.512952] nix-daemon[835]: reaped child process 1736, status = succeeded5834worker1 # [ 150.540673] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925835worker1 # [ 150.555686] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410925836worker1 # [ 150.569258] nix-grpc-daemon[1577]: time=2026-09-20T09:02:55.152Z level=INFO msg="All 1 paths already cached"5837worker1 # [ 150.578500] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410925838worker1 # [ 150.592667] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5839worker1 # [ 150.796667] nix-daemon[835]: accepted connection from pid 1760, user nix-grpc-daemon (trusted)5840worker1 # [ 150.813446] nix-daemon[835]: reaped child process 1763, status = succeeded5841worker1 # [ 150.987769] nix-daemon[835]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)5842worker1 # [ 151.004464] nix-daemon[835]: reaped child process 1768, status = succeeded5843lb # [ 151.012703] niks3-server[993]: 2026/09/20 09:02:55 INFO Received uploads request method=POST path=/api/pending_closures5844worker1 # [ 151.029161] nix-grpc-daemon[1577]: time=2026-09-20T09:02:55.612Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5845worker1 # [ 151.030641] nix-grpc-daemon[1577]: time=2026-09-20T09:02:55.612Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5846lb # [ 151.045750] niks3-server[993]: 2026/09/20 09:02:55 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5847worker1 # [ 151.059756] nix-grpc-daemon[1577]: time=2026-09-20T09:02:55.642Z level=INFO msg="Uploading 1 narinfos"5848lb # [ 151.057148] niks3-server[993]: 2026/09/20 09:02:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5849lb # [ 151.068616] niks3-server[993]: 2026/09/20 09:02:55 INFO Signed narinfos id=56 count=15850lb # [ 151.075316] niks3-server[993]: 2026/09/20 09:02:55 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5851lb # [ 151.083571] niks3-server[993]: 2026/09/20 09:02:55 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5852lb # [ 151.090627] niks3-server[993]: 2026/09/20 09:02:55 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5853lb # [ 151.097242] niks3-server[993]: 2026/09/20 09:02:55 INFO Completed upload id=565854worker1 # [ 151.100845] nix-grpc-daemon[1577]: time=2026-09-20T09:02:55.684Z level=INFO msg="Upload complete. (490ms)"5855worker1 # [ 151.108204] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=0 paths=1 nar_bytes_in=6245856worker1 # [ 151.120971] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925857worker1 # [ 151.133182] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5858worker1 # [ 151.138767] nix-daemon[835]: reaped child process 1758, status = succeeded5859worker1 # [ 151.153720] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5860worker1 # [ 152.783091] nix-daemon[835]: reaped child process 1772, status = succeeded5861worker1 # [ 152.949699] nix-daemon[835]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)5862worker1 # [ 152.967269] nix-daemon[835]: reaped child process 1790, status = succeeded5863lb # [ 152.974974] niks3-server[993]: 2026/09/20 09:02:57 INFO Received uploads request method=POST path=/api/pending_closures5864worker1 # [ 152.988678] nix-grpc-daemon[1577]: time=2026-09-20T09:02:57.571Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5865worker1 # [ 152.991296] nix-grpc-daemon[1577]: time=2026-09-20T09:02:57.573Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5866lb # [ 153.007799] niks3-server[993]: 2026/09/20 09:02:57 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5867lb # [ 153.024299] niks3-server[993]: 2026/09/20 09:02:57 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5868lb # [ 153.032923] niks3-server[993]: 2026/09/20 09:02:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5869worker1 # [ 153.042773] nix-grpc-daemon[1577]: time=2026-09-20T09:02:57.625Z level=INFO msg="Uploading 1 narinfos"5870lb # [ 153.042862] niks3-server[993]: 2026/09/20 09:02:57 INFO Signed narinfos id=57 count=15871lb # [ 153.048226] niks3-server[993]: 2026/09/20 09:02:57 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5872lb # [ 153.055849] niks3-server[993]: 2026/09/20 09:02:57 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5873lb # [ 153.063421] niks3-server[993]: 2026/09/20 09:02:57 INFO Completed upload id=575874worker1 # [ 153.067674] nix-grpc-daemon[1577]: time=2026-09-20T09:02:57.650Z level=INFO msg="Upload complete. (302ms)"5875lb # [ 153.066690] niks3-server[993]: 2026/09/20 09:02:57 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5876worker2 # [ 153.041075] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:57Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15877worker1 # [ 153.079163] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=15878worker2 # [ 153.053625] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:57Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05879worker1 # [ 153.100416] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925880worker1 # [ 153.107447] nix-daemon[835]: reaped child process 1770, status = succeeded5881worker1 # [ 153.111563] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410925882worker1 # [ 153.119679] nix-grpc-daemon[1577]: time=2026-09-20T09:02:57.702Z level=INFO msg="All 2 paths already cached"5883worker1 # [ 153.127033] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410925884worker1 # [ 153.138349] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5885worker1 # [ 153.327405] nix-daemon[835]: accepted connection from pid 1794, user nix-grpc-daemon (trusted)5886worker1 # [ 153.344262] nix-daemon[835]: reaped child process 1797, status = succeeded5887worker1 # [ 153.517715] nix-daemon[835]: accepted connection from pid 1799, user nix-grpc-daemon (trusted)5888worker1 # [ 153.535633] nix-daemon[835]: reaped child process 1802, status = succeeded5889lb # [ 153.546195] niks3-server[993]: 2026/09/20 09:02:58 INFO Received uploads request method=POST path=/api/pending_closures5890worker1 # [ 153.559347] nix-grpc-daemon[1577]: time=2026-09-20T09:02:58.142Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5891worker1 # [ 153.560975] nix-grpc-daemon[1577]: time=2026-09-20T09:02:58.142Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5892lb # [ 153.573679] niks3-server[993]: 2026/09/20 09:02:58 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5893lb # [ 153.586235] niks3-server[993]: 2026/09/20 09:02:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5894worker1 # [ 153.597089] nix-grpc-daemon[1577]: time=2026-09-20T09:02:58.180Z level=INFO msg="Uploading 1 narinfos"5895lb # [ 153.596119] niks3-server[993]: 2026/09/20 09:02:58 INFO Signed narinfos id=58 count=15896lb # [ 153.606849] niks3-server[993]: 2026/09/20 09:02:58 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5897lb # [ 153.614305] niks3-server[993]: 2026/09/20 09:02:58 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5898worker1 # [ 153.622105] nix-grpc-daemon[1577]: time=2026-09-20T09:02:58.205Z level=INFO msg="Upload complete. (471ms)"5899lb # [ 153.618506] niks3-server[993]: 2026/09/20 09:02:58 INFO Completed upload id=585900lb # [ 153.621154] niks3-server[993]: 2026/09/20 09:02:58 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5901worker1 # [ 153.628253] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=0 paths=1 nar_bytes_in=7525902worker1 # [ 153.642390] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925903worker1 # [ 153.649215] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5904worker1 # [ 153.653865] nix-daemon[835]: reaped child process 1792, status = succeeded5905worker1 # [ 153.667049] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5906worker1 # [ 154.709686] nix-daemon[835]: reaped child process 1806, status = succeeded5907worker1 # [ 154.882165] nix-daemon[835]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)5908worker1 # [ 154.899052] nix-daemon[835]: reaped child process 1824, status = succeeded5909lb # [ 154.909621] niks3-server[993]: 2026/09/20 09:02:59 INFO Received uploads request method=POST path=/api/pending_closures5910worker1 # [ 154.924405] nix-grpc-daemon[1577]: time=2026-09-20T09:02:59.505Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5911worker1 # [ 154.925944] nix-grpc-daemon[1577]: time=2026-09-20T09:02:59.505Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5912lb # [ 154.949781] niks3-server[993]: 2026/09/20 09:02:59 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5913lb # [ 154.963247] niks3-server[993]: 2026/09/20 09:02:59 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5914lb # [ 154.971004] niks3-server[993]: 2026/09/20 09:02:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5915worker1 # [ 154.980245] nix-grpc-daemon[1577]: time=2026-09-20T09:02:59.563Z level=INFO msg="Uploading 1 narinfos"5916lb # [ 154.979757] niks3-server[993]: 2026/09/20 09:02:59 INFO Signed narinfos id=59 count=15917lb # [ 154.985015] niks3-server[993]: 2026/09/20 09:02:59 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5918lb # [ 154.992272] niks3-server[993]: 2026/09/20 09:02:59 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5919lb # [ 154.998514] niks3-server[993]: 2026/09/20 09:02:59 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo5920lb # [ 155.003746] niks3-server[993]: 2026/09/20 09:02:59 INFO Completed upload id=595921worker1 # [ 155.008053] nix-grpc-daemon[1577]: time=2026-09-20T09:02:59.591Z level=INFO msg="Upload complete. (330ms)"5922worker2 # [ 154.978982] nix-grpc-daemon[1515]: ts=2026-09-20T09:02:59Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=15923worker1 # [ 155.021017] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=15924worker1 # [ 155.038421] nix-daemon[835]: reaped child process 1804, status = succeeded5925worker1 # [ 155.068113] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925926worker1 # [ 155.083330] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410925927worker1 # [ 155.097565] nix-grpc-daemon[1577]: time=2026-09-20T09:02:59.680Z level=INFO msg="All 2 paths already cached"5928worker1 # [ 155.106243] nix-grpc-daemon[1521]: ts=2026-09-20T09:02:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410925929worker1 # [ 155.120235] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5930worker1 # [ 155.321758] nix-daemon[835]: accepted connection from pid 1828, user nix-grpc-daemon (trusted)5931worker1 # [ 155.341104] nix-daemon[835]: reaped child process 1831, status = succeeded5932worker1 # [ 155.517503] nix-daemon[835]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)5933worker1 # [ 155.536276] nix-daemon[835]: reaped child process 1836, status = succeeded5934lb # [ 155.546129] niks3-server[993]: 2026/09/20 09:03:00 INFO Received uploads request method=POST path=/api/pending_closures5935worker1 # [ 155.559938] nix-grpc-daemon[1577]: time=2026-09-20T09:03:00.142Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5936worker1 # [ 155.561658] nix-grpc-daemon[1577]: time=2026-09-20T09:03:00.142Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"5937lb # [ 155.577945] niks3-server[993]: 2026/09/20 09:03:00 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst5938worker1 # [ 155.588778] nix-grpc-daemon[1577]: time=2026-09-20T09:03:00.171Z level=INFO msg="Uploading 1 narinfos"5939lb # [ 155.590467] niks3-server[993]: 2026/09/20 09:03:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign5940worker1 # [ 155.609854] nix-grpc-daemon[1577]: time=2026-09-20T09:03:00.193Z level=INFO msg="Upload complete. (471ms)"5941lb # [ 155.602673] niks3-server[993]: 2026/09/20 09:03:00 INFO Signed narinfos id=60 count=15942lb # [ 155.610398] niks3-server[993]: 2026/09/20 09:03:00 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls5943worker1 # [ 155.616315] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=0 paths=1 nar_bytes_in=7525944lb # [ 155.615533] niks3-server[993]: 2026/09/20 09:03:00 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete5945lb # [ 155.619816] niks3-server[993]: 2026/09/20 09:03:00 INFO Completed upload id=605946worker1 # [ 155.624380] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925947lb # [ 155.622581] niks3-server[993]: 2026/09/20 09:03:00 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo5948worker1 # [ 155.634201] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5949worker1 # [ 155.638284] nix-daemon[835]: reaped child process 1826, status = succeeded5950worker1 # [ 155.650445] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5951worker1 # [ 156.697836] nix-daemon[835]: reaped child process 1840, status = succeeded5952worker1 # [ 156.879263] nix-daemon[835]: accepted connection from pid 1855, user nix-grpc-daemon (trusted)5953worker1 # [ 156.895874] nix-daemon[835]: reaped child process 1858, status = succeeded5954lb # [ 156.908922] niks3-server[993]: 2026/09/20 09:03:01 INFO Received uploads request method=POST path=/api/pending_closures5955worker1 # [ 156.924441] nix-grpc-daemon[1577]: time=2026-09-20T09:03:01.506Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5956worker1 # [ 156.926005] nix-grpc-daemon[1577]: time=2026-09-20T09:03:01.506Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"5957lb # [ 156.940245] niks3-server[993]: 2026/09/20 09:03:01 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst5958lb # [ 156.957996] niks3-server[993]: 2026/09/20 09:03:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign5959worker1 # [ 156.967670] nix-grpc-daemon[1577]: time=2026-09-20T09:03:01.550Z level=INFO msg="Uploading 1 narinfos"5960lb # [ 156.969050] niks3-server[993]: 2026/09/20 09:03:01 INFO Signed narinfos id=61 count=15961lb # [ 156.971513] niks3-server[993]: 2026/09/20 09:03:01 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls5962lb # [ 156.980680] niks3-server[993]: 2026/09/20 09:03:01 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv5963lb # [ 156.987330] niks3-server[993]: 2026/09/20 09:03:01 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete5964lb # [ 156.991645] niks3-server[993]: 2026/09/20 09:03:01 INFO Completed upload id=615965worker1 # [ 156.995868] nix-grpc-daemon[1577]: time=2026-09-20T09:03:01.579Z level=INFO msg="Upload complete. (336ms)"5966lb # [ 156.994190] niks3-server[993]: 2026/09/20 09:03:01 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo5967worker2 # [ 156.967299] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:01Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=15968worker1 # [ 157.009067] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=15969worker1 # [ 157.023790] nix-daemon[835]: reaped child process 1838, status = succeeded5970worker1 # [ 157.056830] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925971worker1 # [ 157.072448] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410925972worker1 # [ 157.086556] nix-grpc-daemon[1577]: time=2026-09-20T09:03:01.669Z level=INFO msg="All 2 paths already cached"5973worker1 # [ 157.095759] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410925974worker1 # [ 157.110863] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5975worker1 # [ 157.315852] nix-daemon[835]: accepted connection from pid 1862, user nix-grpc-daemon (trusted)5976worker1 # [ 157.333929] nix-daemon[835]: reaped child process 1865, status = succeeded5977worker1 # [ 157.511091] nix-daemon[835]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)5978worker1 # [ 157.531563] nix-daemon[835]: reaped child process 1870, status = succeeded5979lb # [ 157.539392] niks3-server[993]: 2026/09/20 09:03:02 INFO Received uploads request method=POST path=/api/pending_closures5980worker1 # [ 157.552774] nix-grpc-daemon[1577]: time=2026-09-20T09:03:02.135Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5981worker1 # [ 157.554359] nix-grpc-daemon[1577]: time=2026-09-20T09:03:02.135Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"5982lb # [ 157.567945] niks3-server[993]: 2026/09/20 09:03:02 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst5983lb # [ 157.580204] niks3-server[993]: 2026/09/20 09:03:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign5984worker1 # [ 157.590772] nix-grpc-daemon[1577]: time=2026-09-20T09:03:02.173Z level=INFO msg="Uploading 1 narinfos"5985lb # [ 157.590907] niks3-server[993]: 2026/09/20 09:03:02 INFO Signed narinfos id=62 count=15986lb # [ 157.597087] niks3-server[993]: 2026/09/20 09:03:02 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls5987lb # [ 157.606028] niks3-server[993]: 2026/09/20 09:03:02 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete5988worker1 # [ 157.614826] nix-grpc-daemon[1577]: time=2026-09-20T09:03:02.198Z level=INFO msg="Upload complete. (486ms)"5989lb # [ 157.611720] niks3-server[993]: 2026/09/20 09:03:02 INFO Completed upload id=625990lb # [ 157.614425] niks3-server[993]: 2026/09/20 09:03:02 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo5991worker1 # [ 157.624408] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=0 paths=1 nar_bytes_in=7525992worker1 # [ 157.632713] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410925993worker1 # [ 157.646277] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5994worker1 # [ 157.649489] nix-daemon[835]: reaped child process 1860, status = succeeded5995worker1 # [ 157.661541] nix-daemon[835]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5996worker1 # [ 158.491065] nix-daemon[835]: reaped child process 1874, status = succeeded5997worker1 # [ 158.665603] nix-daemon[835]: accepted connection from pid 1889, user nix-grpc-daemon (trusted)5998worker1 # [ 158.685107] nix-daemon[835]: reaped child process 1892, status = succeeded5999lb # [ 158.695928] niks3-server[993]: 2026/09/20 09:03:03 INFO Received uploads request method=POST path=/api/pending_closures6000worker1 # [ 158.712430] nix-grpc-daemon[1577]: time=2026-09-20T09:03:03.294Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6001worker1 # [ 158.714002] nix-grpc-daemon[1577]: time=2026-09-20T09:03:03.294Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6002worker1 # [ 158.758817] nix-grpc-daemon[1577]: time=2026-09-20T09:03:03.341Z level=INFO msg="Uploading 1 narinfos"6003lb # [ 158.743502] niks3-server[993]: 2026/09/20 09:03:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6004lb # [ 158.759276] niks3-server[993]: 2026/09/20 09:03:03 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6005lb # [ 158.769342] niks3-server[993]: 2026/09/20 09:03:03 INFO Signed narinfos id=63 count=16006lb # [ 158.773423] niks3-server[993]: 2026/09/20 09:03:03 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6007lb # [ 158.782991] niks3-server[993]: 2026/09/20 09:03:03 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6008lb # [ 158.788465] niks3-server[993]: 2026/09/20 09:03:03 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6009lb # [ 158.793649] niks3-server[993]: 2026/09/20 09:03:03 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6010worker1 # [ 158.797573] nix-grpc-daemon[1577]: time=2026-09-20T09:03:03.380Z level=INFO msg="Upload complete. (323ms)"6011lb # [ 158.797685] niks3-server[993]: 2026/09/20 09:03:03 INFO Completed upload id=636012worker1 # [ 158.809172] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41092 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16013worker1 # [ 158.827794] nix-daemon[835]: reaped child process 1872, status = succeeded6014client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.14 seconds)6015worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6016worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.08 seconds)6017client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16018worker1 # [ 159.205960] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:410926019worker1 # [ 159.215215] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410926020worker2 # [ 159.201457] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:03Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06021client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.30 seconds)6022(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 20.53 seconds)6023subtest: low disk drains a worker and builds go to the other6024worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6025worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds)6026worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6027worker1 # [ 160.573759] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:05Z level=info event=unhealthy reason=min_free6028lb # [ 161.060510] envoy[910]: conn peer=[2001:db8:1::1]:38150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27144 tx=10638 ms=198376029lb # [ 161.060820] envoy[910]: conn peer=[2001:db8:1::1]:40646 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=880 tx=482 ms=556030worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6031client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26032worker1 # [ 161.747396] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:410926033client # don't know how to build these paths:6034client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6035worker2 # [ 161.722788] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:439146036worker2 # [ 161.748140] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:06Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06037worker2 # [ 161.755065] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:06Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16038worker2 # [ 161.798825] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439146039worker2 # [ 161.813728] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:439146040client # copying 1 paths to 'lb:50051'...6041client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6042worker2 # [ 161.829281] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:439146043worker2 # [ 161.844270] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)6044worker2 # [ 162.060129] nix-daemon[836]: accepted connection from pid 1795, user nix-grpc-daemon (trusted)6045worker2 # [ 162.076839] nix-daemon[836]: reaped child process 1798, status = succeeded6046worker2 # [ 162.252314] nix-daemon[836]: accepted connection from pid 1800, user nix-grpc-daemon (trusted)6047worker2 # [ 162.268691] nix-daemon[836]: reaped child process 1803, status = succeeded6048lb # [ 162.316652] niks3-server[993]: 2026/09/20 09:03:06 INFO Received uploads request method=POST path=/api/pending_closures6049worker2 # [ 162.295045] nix-grpc-daemon[1587]: time=2026-09-20T09:03:06.877Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6050worker2 # [ 162.296722] nix-grpc-daemon[1587]: time=2026-09-20T09:03:06.877Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6051lb # [ 162.349414] niks3-server[993]: 2026/09/20 09:03:06 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6052worker2 # [ 162.335275] nix-grpc-daemon[1587]: time=2026-09-20T09:03:06.917Z level=INFO msg="Uploading 1 narinfos"6053lb # [ 162.361192] niks3-server[993]: 2026/09/20 09:03:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6054lb # [ 162.372274] niks3-server[993]: 2026/09/20 09:03:06 INFO Signed narinfos id=64 count=16055lb # [ 162.378652] niks3-server[993]: 2026/09/20 09:03:06 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6056lb # [ 162.388585] niks3-server[993]: 2026/09/20 09:03:06 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6057worker2 # [ 162.361561] nix-grpc-daemon[1587]: time=2026-09-20T09:03:06.944Z level=INFO msg="Upload complete. (499ms)"6058lb # [ 162.396396] niks3-server[993]: 2026/09/20 09:03:06 INFO Completed upload id=646059lb # [ 162.399577] niks3-server[993]: 2026/09/20 09:03:06 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6060worker2 # [ 162.368266] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=0 paths=1 nar_bytes_in=5126061worker2 # [ 162.382602] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439146062worker2 # [ 162.390043] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)6063worker2 # [ 162.395593] nix-daemon[836]: reaped child process 1793, status = succeeded6064client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6065client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6066worker2 # [ 162.407129] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)6067client # farm-a> LOG-farm-a-drain6068worker2 # [ 164.054981] nix-daemon[836]: reaped child process 1807, status = succeeded6069worker2 # [ 164.236566] nix-daemon[836]: accepted connection from pid 1822, user nix-grpc-daemon (trusted)6070worker2 # [ 164.254387] nix-daemon[836]: reaped child process 1825, status = succeeded6071lb # [ 164.301407] niks3-server[993]: 2026/09/20 09:03:08 INFO Received uploads request method=POST path=/api/pending_closures6072worker2 # [ 164.280445] nix-grpc-daemon[1587]: time=2026-09-20T09:03:08.860Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6073worker2 # [ 164.282065] nix-grpc-daemon[1587]: time=2026-09-20T09:03:08.860Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6074lb # [ 164.340752] niks3-server[993]: 2026/09/20 09:03:08 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6075lb # [ 164.359048] niks3-server[993]: 2026/09/20 09:03:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6076worker2 # [ 164.331713] nix-grpc-daemon[1587]: time=2026-09-20T09:03:08.913Z level=INFO msg="Uploading 1 narinfos"6077lb # [ 164.373270] niks3-server[993]: 2026/09/20 09:03:08 INFO Signed narinfos id=65 count=16078lb # [ 164.379360] niks3-server[993]: 2026/09/20 09:03:08 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6079lb # [ 164.386024] niks3-server[993]: 2026/09/20 09:03:08 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6080lb # [ 164.395285] niks3-server[993]: 2026/09/20 09:03:08 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6081lb # [ 164.400700] niks3-server[993]: 2026/09/20 09:03:08 INFO Completed upload id=656082worker2 # [ 164.367662] nix-grpc-daemon[1587]: time=2026-09-20T09:03:08.950Z level=INFO msg="Upload complete. (346ms)"6083lb # [ 164.403704] niks3-server[993]: 2026/09/20 09:03:08 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6084worker2 # [ 164.388154] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=2 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16085worker2 # [ 164.403727] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:08Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06086worker2 # [ 164.407925] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:08Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16087worker2 # [ 164.412230] nix-daemon[836]: reaped child process 1805, status = succeeded6088worker2 # [ 164.431997] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439146089worker2 # [ 164.448351] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:439146090worker2 # [ 164.463814] nix-grpc-daemon[1587]: time=2026-09-20T09:03:09.046Z level=INFO msg="All 1 paths already cached"6091client # copying 1 paths to 'lb:50051'...6092client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6093worker2 # [ 164.474786] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:439146094worker2 # [ 164.488990] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)6095worker2 # [ 164.695574] nix-daemon[836]: accepted connection from pid 1831, user nix-grpc-daemon (trusted)6096worker2 # [ 164.714396] nix-daemon[836]: reaped child process 1834, status = succeeded6097worker2 # [ 164.892858] nix-daemon[836]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6098worker2 # [ 164.911096] nix-daemon[836]: reaped child process 1839, status = succeeded6099lb # [ 164.956044] niks3-server[993]: 2026/09/20 09:03:09 INFO Received uploads request method=POST path=/api/pending_closures6100worker2 # [ 164.932826] nix-grpc-daemon[1587]: time=2026-09-20T09:03:09.515Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6101worker2 # [ 164.934358] nix-grpc-daemon[1587]: time=2026-09-20T09:03:09.515Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6102lb # [ 164.985190] niks3-server[993]: 2026/09/20 09:03:09 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6103worker2 # [ 164.973087] nix-grpc-daemon[1587]: time=2026-09-20T09:03:09.555Z level=INFO msg="Uploading 1 narinfos"6104lb # [ 165.000074] niks3-server[993]: 2026/09/20 09:03:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6105lb # [ 165.013372] niks3-server[993]: 2026/09/20 09:03:09 INFO Signed narinfos id=66 count=16106lb # [ 165.018922] niks3-server[993]: 2026/09/20 09:03:09 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6107worker2 # [ 164.992909] nix-grpc-daemon[1587]: time=2026-09-20T09:03:09.575Z level=INFO msg="Upload complete. (488ms)"6108lb # [ 165.028123] niks3-server[993]: 2026/09/20 09:03:09 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6109lb # [ 165.033695] niks3-server[993]: 2026/09/20 09:03:09 INFO Completed upload id=666110worker2 # [ 165.000348] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=0 paths=1 nar_bytes_in=6326111lb # [ 165.037154] niks3-server[993]: 2026/09/20 09:03:09 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6112worker2 # [ 165.008622] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439146113worker2 # [ 165.018866] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)6114worker2 # [ 165.023577] nix-daemon[836]: reaped child process 1829, status = succeeded6115client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6116client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6117worker2 # [ 165.037532] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)6118client # farm-b> LOG-farm-b-drain6119worker2 # [ 166.679772] nix-daemon[836]: reaped child process 1843, status = succeeded6120worker2 # [ 166.993813] nix-daemon[836]: accepted connection from pid 1858, user nix-grpc-daemon (trusted)6121worker2 # [ 167.019860] nix-daemon[836]: reaped child process 1861, status = succeeded6122lb # [ 167.080633] niks3-server[993]: 2026/09/20 09:03:11 INFO Received uploads request method=POST path=/api/pending_closures6123worker2 # [ 167.060671] nix-grpc-daemon[1587]: time=2026-09-20T09:03:11.641Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6124worker2 # [ 167.062433] nix-grpc-daemon[1587]: time=2026-09-20T09:03:11.641Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6125lb # [ 167.145274] niks3-server[993]: 2026/09/20 09:03:11 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6126lb # [ 167.170816] niks3-server[993]: 2026/09/20 09:03:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6127worker2 # [ 167.139392] nix-grpc-daemon[1587]: time=2026-09-20T09:03:11.720Z level=INFO msg="Uploading 1 narinfos"6128lb # [ 167.186606] niks3-server[993]: 2026/09/20 09:03:11 INFO Signed narinfos id=67 count=16129lb # [ 167.193693] niks3-server[993]: 2026/09/20 09:03:11 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6130lb # [ 167.209877] niks3-server[993]: 2026/09/20 09:03:11 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6131worker2 # [ 167.183312] nix-grpc-daemon[1587]: time=2026-09-20T09:03:11.765Z level=INFO msg="Upload complete. (533ms)"6132lb # [ 167.218433] niks3-server[993]: 2026/09/20 09:03:11 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6133lb # [ 167.221804] niks3-server[993]: 2026/09/20 09:03:11 INFO Completed upload id=676134lb # [ 167.226222] niks3-server[993]: 2026/09/20 09:03:11 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6135worker2 # [ 167.214910] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=2 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16136worker2 # [ 167.232707] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:11Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06137worker2 # [ 167.244525] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:11Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16138worker2 # [ 167.253227] nix-daemon[836]: reaped child process 1841, status = succeeded6139worker2 # [ 167.258443] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439146140worker2 # [ 167.281595] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:439146141worker2 # [ 167.303294] nix-grpc-daemon[1587]: time=2026-09-20T09:03:11.885Z level=INFO msg="All 2 paths already cached"6142client # copying 1 paths to 'lb:50051'...6143client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6144worker2 # [ 167.317496] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:439146145worker2 # [ 167.339734] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)6146worker2 # [ 167.636319] nix-daemon[836]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)6147worker2 # [ 167.663804] nix-daemon[836]: reaped child process 1870, status = succeeded6148worker2 # [ 167.909550] nix-daemon[836]: accepted connection from pid 1872, user nix-grpc-daemon (trusted)6149worker2 # [ 167.931539] nix-daemon[836]: reaped child process 1875, status = succeeded6150lb # [ 167.979608] niks3-server[993]: 2026/09/20 09:03:12 INFO Received uploads request method=POST path=/api/pending_closures6151worker2 # [ 167.962755] nix-grpc-daemon[1587]: time=2026-09-20T09:03:12.544Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6152worker2 # [ 167.964463] nix-grpc-daemon[1587]: time=2026-09-20T09:03:12.544Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6153lb # [ 168.035120] niks3-server[993]: 2026/09/20 09:03:12 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6154lb # [ 168.055884] niks3-server[993]: 2026/09/20 09:03:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6155worker2 # [ 168.029553] nix-grpc-daemon[1587]: time=2026-09-20T09:03:12.611Z level=INFO msg="Uploading 1 narinfos"6156lb # [ 168.071622] niks3-server[993]: 2026/09/20 09:03:12 INFO Signed narinfos id=68 count=16157lb # [ 168.079847] niks3-server[993]: 2026/09/20 09:03:12 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6158lb # [ 168.090023] niks3-server[993]: 2026/09/20 09:03:12 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6159lb # [ 168.097806] niks3-server[993]: 2026/09/20 09:03:12 INFO Completed upload id=686160worker2 # [ 168.065392] nix-grpc-daemon[1587]: time=2026-09-20T09:03:12.646Z level=INFO msg="Upload complete. (697ms)"6161lb # [ 168.100410] niks3-server[993]: 2026/09/20 09:03:12 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6162worker2 # [ 168.080393] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=0 paths=1 nar_bytes_in=7606163worker2 # [ 168.092646] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:439146164worker2 # [ 168.106004] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)6165worker2 # [ 168.111554] nix-daemon[836]: reaped child process 1865, status = succeeded6166client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6167client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6168worker2 # [ 168.126758] nix-daemon[836]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)6169client # farm-top> LOG-farm-top-drain6170worker2 # [ 169.157794] nix-daemon[836]: reaped child process 1879, status = succeeded6171worker2 # [ 169.322977] nix-daemon[836]: accepted connection from pid 1894, user nix-grpc-daemon (trusted)6172worker2 # [ 169.339278] nix-daemon[836]: reaped child process 1897, status = succeeded6173lb # [ 169.388842] niks3-server[993]: 2026/09/20 09:03:13 INFO Received uploads request method=POST path=/api/pending_closures6174worker2 # [ 169.366818] nix-grpc-daemon[1587]: time=2026-09-20T09:03:13.947Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6175worker2 # [ 169.368369] nix-grpc-daemon[1587]: time=2026-09-20T09:03:13.947Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6176lb # [ 169.423942] niks3-server[993]: 2026/09/20 09:03:14 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6177lb # [ 169.437675] niks3-server[993]: 2026/09/20 09:03:14 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6178lb # [ 169.448365] niks3-server[993]: 2026/09/20 09:03:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6179worker2 # [ 169.421422] nix-grpc-daemon[1587]: time=2026-09-20T09:03:14.003Z level=INFO msg="Uploading 1 narinfos"6180lb # [ 169.457973] niks3-server[993]: 2026/09/20 09:03:14 INFO Signed narinfos id=69 count=16181lb # [ 169.463536] niks3-server[993]: 2026/09/20 09:03:14 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6182lb # [ 169.474133] niks3-server[993]: 2026/09/20 09:03:14 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6183lb # [ 169.480052] niks3-server[993]: 2026/09/20 09:03:14 INFO Completed upload id=696184worker2 # [ 169.447119] nix-grpc-daemon[1587]: time=2026-09-20T09:03:14.029Z level=INFO msg="Upload complete. (305ms)"6185lb # [ 169.483016] niks3-server[993]: 2026/09/20 09:03:14 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6186worker2 # [ 169.461094] nix-grpc-daemon[1515]: ts=2026-09-20T09:03:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43914 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16187worker2 # [ 169.474866] nix-daemon[836]: reaped child process 1877, status = succeeded6188client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 8.05 seconds)6189client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6190client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds)6191worker1: must succeed: rm /nix/.rw-store/fill6192worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6193worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6194worker1 # [ 170.583707] nix-grpc-daemon[1521]: ts=2026-09-20T09:03:15Z level=info event=healthy reason=min_free6195lb # [ 171.058106] envoy[910]: conn peer=[2001:db8:1::1]:40232 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9562 tx=3876 ms=77626196worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6197(finished: subtest: low disk drains a worker and builds go to the other, in 11.90 seconds)6198(finished: run the VM test script, in 172.20 seconds)6199test script finished in 172.50s6200cleanup6201kill QemuMachine (pid 49)6202client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6203kill QemuMachine (pid 50)6204lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6205kill QemuMachine (pid 51)6206worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6207kill QemuMachine (pid 52)6208worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6209(finished: cleanup, in 1.23 seconds)6210additionally exposed symbols:6211 client, lb, worker1, worker2,6212 vlan1,6213 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh