vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #351
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13client # Disk image does not exist, creating the virtualisation disk image...14worker1: QEMU running (pid 52)15worker1 # Formatting '/build/vm-state-worker1/tmp.Lit9zxfCLu', fmt=raw size=107374182416worker2 # Disk image does not exist, creating the virtualisation disk image...17client: QEMU running (pid 49)18lb: QEMU running (pid 50)19worker1 # mke2fs 1.47.4 (6-Mar-2025)20worker2 # Formatting '/build/vm-state-worker2/tmp.NBsWdSyZU6', fmt=raw size=107374182421worker2: QEMU running (pid 51)22client # Formatting '/build/vm-state-client/tmp.4yHDj91n3g', fmt=raw size=107374182423lb # Disk image does not exist, creating the virtualisation disk image...24worker1 # Discarding device blocks: 0/262144 done25worker2 # mke2fs 1.47.4 (6-Mar-2025)26lb # Formatting '/build/vm-state-lb/tmp.o2BHWhdhwR', fmt=raw size=107374182427worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes28(finished: start all VMs, in 0.59 seconds)29lb # mke2fs 1.47.4 (6-Mar-2025)30worker1 # Filesystem UUID: bcf37906-84d4-41b2-a3ef-a9ed2a544dc931client: waiting for unit network-addresses-eth1.service32lb # Discarding device blocks: 0/262144 done33worker1 # Superblock backups stored on blocks:34worker2 # Discarding device blocks: 0/262144 done35lb # Creating filesystem with 262144 4k blocks and 65536 inodes36worker1 # 32768, 98304, 163840, 22937637worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes38lb # Filesystem UUID: cb321861-5bfe-4e69-a8ad-a65d6a8caadf39worker1 # 40worker2 # Filesystem UUID: dff3dfd2-8e23-4bb4-beb3-ac610f1e9ecb41lb # Superblock backups stored on blocks:42worker1 # Allocating group tables: 0/8 done43worker2 # Superblock backups stored on blocks:44lb # 32768, 98304, 163840, 22937645worker1 # Writing inode tables: 0/8 done46worker2 # 32768, 98304, 163840, 22937647lb # 48worker1 # Creating journal (8192 blocks): done49worker2 # 50lb # Allocating group tables: 0/8 done51worker1 # Writing superblocks and filesystem accounting information: 0/8 done52worker2 # Allocating group tables: 0/8 done53lb # Writing inode tables: 0/8 done54worker1 # 55worker2 # Writing inode tables: 0/8 done56lb # Creating journal (8192 blocks): done57worker1 # Virtualisation disk image created.58worker2 # Creating journal (8192 blocks): done59lb # Writing superblocks and filesystem accounting information: 0/8 done60client # mke2fs 1.47.4 (6-Mar-2025)61lb # 62client # Discarding device blocks: 0/262144 done63worker2 # Writing superblocks and filesystem accounting information: 0/8 done64client: waiting for the VM to finish booting65lb # Virtualisation disk image created.66client # Creating filesystem with 262144 4k blocks and 65536 inodes67worker2 # 68client # Filesystem UUID: d1ece586-8d49-4d52-bd4a-9eb83e5fd2c269worker2 # Virtualisation disk image created.70client # Superblock backups stored on blocks:71client # 32768, 98304, 163840, 22937672client # 73client # Allocating group tables: 0/8 done74client # Writing inode tables: 0/8 done75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker2 # [ 0.000000] KASLR enabled82worker2 # [ 0.000000] random: crng init done83worker2 # [ 0.000000] Machine model: linux,dummy-virt84worker2 # [ 0.000000] efi: UEFI not found.85worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88worker2 # [ 0.000000] Zone ranges:89worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90worker2 # [ 0.000000] DMA32 empty91worker2 # [ 0.000000] Normal empty92worker2 # [ 0.000000] Device empty93worker2 # [ 0.000000] Movable zone start for each node94worker2 # [ 0.000000] Early memory node ranges95worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098worker2 # [ 0.000000] psci: probing for conduit method from DT.99worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.100worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]101worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs102worker2 # [ 0.000000] psci: Trusted OS migration not required103worker2 # [ 0.000000] psci: SMC Calling Convention v1.1104worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026105worker1 # [ 0.000000] KASLR enabled106worker1 # [ 0.000000] random: crng init done107worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)108worker1 # [ 0.000000] Machine model: linux,dummy-virt109worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296110worker1 # [ 0.000000] efi: UEFI not found.111worker2 # [ 0.000000] Detected PIPT I-cache on CPU0112worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT113worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)114worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]115worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface116worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]117worker2 # [ 0.000000] CPU features: detected: Spectre-v4118worker1 # [ 0.000000] Zone ranges:119worker2 # [ 0.000000] CPU features: detected: Spectre-BHB120worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]121worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38122worker1 # [ 0.000000] DMA32 empty123worker1 # [ 0.000000] Normal empty124worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23125worker1 # [ 0.000000] Device empty126worker2 # [ 0.000000] alternatives: applying boot alternatives127worker1 # [ 0.000000] Movable zone start for each node128worker1 # [ 0.000000] Early memory node ranges129worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]130worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]131worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000132worker1 # [ 0.000000] psci: probing for conduit method from DT.133worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5wv9z2czc5d0k10pkabsgssf2vd4m4yv-nixos-system-worker2-test/init regInfo=/nix/store/x405489p1glh213r6pmcv2k9dy26lbc7-closure-info/registration console=ttyAMA0,115200n8 console=tty0134worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.135worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs136worker1 # [ 0.000000] psci: Trusted OS migration not required137worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/x405489p1glh213r6pmcv2k9dy26lbc7-closure-info/registration", will be passed to user space.138worker1 # [ 0.000000] psci: SMC Calling Convention v1.1139worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes140worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)141worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)142worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296143worker1 # [ 0.000000] Detected PIPT I-cache on CPU0144worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)145worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB146worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)147worker2 # [ 0.000000] software IO TLB: area num 1.148worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface149worker1 # [ 0.000000] CPU features: detected: Spectre-v4150worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB151worker1 # [ 0.000000] CPU features: detected: Spectre-BHB152worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)153worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38154worker2 # [ 0.000000] Fallback order for Node 0: 0155worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23156worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216157client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]158worker2 # [ 0.000000] Policy zone: DMA159worker1 # [ 0.000000] alternatives: applying boot alternatives160worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off161client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026162worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1163client # [ 0.000000] KASLR enabled164client # [ 0.000000] random: crng init done165worker2 # [ 0.000000] allocated 3145728 bytes of page_ext166client # [ 0.000000] Machine model: linux,dummy-virt167worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages168client # [ 0.000000] efi: UEFI not found.169worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups170worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/r540w8gvfskpjz6grbyg2ika5l55kh6m-nixos-system-worker1-test/init regInfo=/nix/store/knybk48ww2ibxq3qn1yri7hrj780rnb9-closure-info/registration console=ttyAMA0,115200n8 console=tty0171client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT172worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.173worker2 # [ 0.000000] rcu: RCU event tracing is enabled.174client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]175worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.176client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]177client # [ 0.000000] Zone ranges:178worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.179worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/knybk48ww2ibxq3qn1yri7hrj780rnb9-closure-info/registration", will be passed to user space.180client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]181worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.182client # [ 0.000000] DMA32 empty183worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.184client # [ 0.000000] Normal empty185worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes186client # [ 0.000000] Device empty187worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.188client # [ 0.000000] Movable zone start for each node189worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)190client # [ 0.000000] Early memory node ranges191worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1192worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)193client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]194worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.195worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB196client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]197worker1 # [ 0.000000] software IO TLB: area num 1.198client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000199worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.200worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB201client # [ 0.000000] psci: probing for conduit method from DT.202client # [ 0.000000] psci: PSCIv1.3 detected in firmware.203worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.204worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)205client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs206worker1 # [ 0.000000] Fallback order for Node 0: 0207worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0208client # [ 0.000000] psci: Trusted OS migration not required209worker2 # [ 0.000000] GICv3: 256 SPIs implemented210worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216211client # [ 0.000000] psci: SMC Calling Convention v1.1212worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented213worker1 # [ 0.000000] Policy zone: DMA214worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq215worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off216client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)217worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI218worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1219client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296220worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0221client # [ 0.000000] Detected PIPT I-cache on CPU0222worker1 # [ 0.000000] allocated 3145728 bytes of page_ext223worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000224worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages225worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]226client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)227worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups228client # [ 0.000000] CPU features: detected: GICv3 CPU interface229worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.230worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)231client # [ 0.000000] CPU features: detected: Spectre-v4232worker1 # [ 0.000000] rcu: RCU event tracing is enabled.233client # [ 0.000000] CPU features: detected: Spectre-BHB234worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.235worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)236client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38237worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.238worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000239client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23240worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.241client # [ 0.000000] alternatives: applying boot alternatives242worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000243worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.244worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.245worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.246worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1247worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns248worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).249worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.250client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rixsn5f5nyiysml7gkkcnwgvwp0s4kzd-nixos-system-client-test/init regInfo=/nix/store/5p6ifa9x84yyhxmqgxpkx5b45r4y5wf6-closure-info/registration console=ttyAMA0,115200n8 console=tty0251worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.252worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns253worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns254worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.255client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/5p6ifa9x84yyhxmqgxpkx5b45r4y5wf6-closure-info/registration", will be passed to user space.256worker2 # [ 0.000040] arm-pv: using stolen time PV257worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0258client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes259worker1 # [ 0.000000] GICv3: 256 SPIs implemented260worker2 # [ 0.000844] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)261worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented262client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)263worker2 # [ 0.001039] Console: colour dummy device 80x25264worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq265worker2 # [ 0.001047] printk: legacy console [tty0] enabled266worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI267client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)268worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0269client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB270worker2 # [ 0.001246] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)271worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000272client # [ 0.000000] software IO TLB: area num 1.273worker2 # [ 0.001254] pid_max: default: 32768 minimum: 301274worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]275lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]276client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB277worker2 # [ 0.001333] LSM: initializing lsm=capability,landlock,yama,bpf,ima278worker2 # [ 0.001544] landlock: Up and running.279worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)280client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)281worker2 # [ 0.001547] Yama: becoming mindful.282lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026283client # [ 0.000000] Fallback order for Node 0: 0284lb # [ 0.000000] KASLR enabled285worker2 # [ 0.002240] LSM support for eBPF active286lb # [ 0.000000] random: crng init done287worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)288client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216289client # [ 0.000000] Policy zone: DMA290lb # [ 0.000000] Machine model: linux,dummy-virt291worker2 # [ 0.002421] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)292worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000293lb # [ 0.000000] efi: UEFI not found.294client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off295worker2 # [ 0.002454] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)296worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000297lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT298client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1299worker2 # [ 0.003616] cacheinfo: Unable to detect cache hierarchy for CPU 0300worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.301client # [ 0.000000] allocated 3145728 bytes of page_ext302worker2 # [ 0.004379] rcu: Hierarchical SRCU implementation.303lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]304client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages305worker2 # [ 0.004384] rcu: Max phase no-delay instances is 1000.306lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]307worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns308lb # [ 0.000000] Zone ranges:309client # [ 0.000000] ftrace: allocated 294 pages with 4 groups310worker2 # [ 0.005616] fsl-mc MSI: its@8080000 domain created311worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).312worker2 # [ 0.005707] EFI services will not be available.313client # [ 0.000000] rcu: Hierarchical RCU implementation.314lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]315lb # [ 0.000000] DMA32 empty316worker2 # [ 0.005775] smp: Bringing up secondary CPUs ...317client # [ 0.000000] rcu: RCU event tracing is enabled.318lb # [ 0.000000] Normal empty319worker2 # [ 0.005784] smp: Brought up 1 node, 1 CPU320worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns321lb # [ 0.000000] Device empty322client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.323worker2 # [ 0.005788] SMP: Total of 1 processors activated.324lb # [ 0.000000] Movable zone start for each node325client # [ 0.000000] Trampoline variant of Tasks RCU enabled.326worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns327worker2 # [ 0.005794] CPU: All CPU(s) started at EL1328lb # [ 0.000000] Early memory node ranges329client # [ 0.000000] Rude variant of Tasks RCU enabled.330worker1 # [ 0.000034] arm-pv: using stolen time PV331worker2 # [ 0.005806] CPU features: detected: Branch Target Identification332lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]333client # [ 0.000000] Tracing variant of Tasks RCU enabled.334worker2 # [ 0.005811] CPU features: detected: ARMv8.4 Translation Table Level335worker1 # [ 0.000567] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)336lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]337client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.338worker1 # [ 0.000791] Console: colour dummy device 80x25339lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000340worker2 # [ 0.005814] CPU features: detected: Instruction cache invalidation not required for I/D coherence341worker1 # [ 0.000799] printk: legacy console [tty0] enabled342client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1343lb # [ 0.000000] psci: probing for conduit method from DT.344lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.345worker2 # [ 0.005818] CPU features: detected: Data cache clean to the PoU not required for I/D coherence346client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.347worker1 # [ 0.000998] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)348lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs349worker2 # [ 0.005821] CPU features: detected: Common not Private translations350worker1 # [ 0.001005] pid_max: default: 32768 minimum: 301351lb # [ 0.000000] psci: Trusted OS migration not required352worker2 # [ 0.005825] CPU features: detected: CRC32 instructions353client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.354lb # [ 0.000000] psci: SMC Calling Convention v1.1355worker1 # [ 0.001078] LSM: initializing lsm=capability,landlock,yama,bpf,ima356worker1 # [ 0.001279] landlock: Up and running.357worker2 # [ 0.005828] CPU features: detected: Data cache clean to Point of Deep Persistence358client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.359worker1 # [ 0.001282] Yama: becoming mindful.360lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)361worker1 # [ 0.002045] LSM support for eBPF active362worker2 # [ 0.005831] CPU features: detected: Data cache clean to Point of Persistence363client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0364lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296365client # [ 0.000000] GICv3: 256 SPIs implemented366worker1 # [ 0.002203] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)367worker2 # [ 0.005835] CPU features: detected: Data independent timing control (DIT)368lb # [ 0.000000] Detected PIPT I-cache on CPU0369client # [ 0.000000] GICv3: 0 Extended SPIs implemented370worker2 # [ 0.005838] CPU features: detected: E0PD371client # [ 0.000000] Root IRQ handler: gic_handle_irq372worker1 # [ 0.002242] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)373worker2 # [ 0.005840] CPU features: detected: Enhanced Counter Virtualization374lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)375client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI376worker1 # [ 0.003393] cacheinfo: Unable to detect cache hierarchy for CPU 0377lb # [ 0.000000] CPU features: detected: GICv3 CPU interface378client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0379worker2 # [ 0.005843] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)380worker1 # [ 0.004264] rcu: Hierarchical SRCU implementation.381lb # [ 0.000000] CPU features: detected: Spectre-v4382client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000383worker2 # [ 0.005846] CPU features: detected: Enhanced Virtualization Traps384worker1 # [ 0.004268] rcu: Max phase no-delay instances is 1000.385lb # [ 0.000000] CPU features: detected: Spectre-BHB386client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]387worker1 # [ 0.005483] fsl-mc MSI: its@8080000 domain created388worker2 # [ 0.005849] CPU features: detected: Fine Grained Traps389lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38390worker1 # [ 0.005575] EFI services will not be available.391client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)392worker2 # [ 0.005853] CPU features: detected: Generic authentication (architected QARMA5 algorithm)393lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23394worker1 # [ 0.005642] smp: Bringing up secondary CPUs ...395worker1 # [ 0.005651] smp: Brought up 1 node, 1 CPU396lb # [ 0.000000] alternatives: applying boot alternatives397worker2 # [ 0.005858] CPU features: detected: RCpc load-acquire (LDAPR)398client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)399worker1 # [ 0.005654] SMP: Total of 1 processors activated.400worker2 # [ 0.005861] CPU features: detected: LSE atomic instructions401worker1 # [ 0.005660] CPU: All CPU(s) started at EL1402client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000403worker2 # [ 0.005864] CPU features: detected: Privileged Access Never404worker1 # [ 0.005671] CPU features: detected: Branch Target Identification405worker2 # [ 0.005867] CPU features: detected: PMUv3406client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000407worker1 # [ 0.005676] CPU features: detected: ARMv8.4 Translation Table Level408worker2 # [ 0.005869] CPU features: detected: RAS Extension Support409client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.410worker2 # [ 0.005872] CPU features: detected: RASv1p1 Extension Support411worker1 # [ 0.005679] CPU features: detected: Instruction cache invalidation not required for I/D coherence412lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vxdvyfckv3fa5vvy0rlij5wdsyis6xyw-nixos-system-lb-test/init regInfo=/nix/store/rryawwr0z7ph8mmfx4sny70z8sn2lsl9-closure-info/registration console=ttyAMA0,115200n8 console=tty0413worker2 # [ 0.005875] CPU features: detected: Random Number Generator414client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns415worker2 # [ 0.005877] CPU features: detected: Speculation barrier (SB)416worker1 # [ 0.005683] CPU features: detected: Data cache clean to the PoU not required for I/D coherence417client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).418worker2 # [ 0.005880] CPU features: detected: Stage-2 Force Write-Back419worker1 # [ 0.005687] CPU features: detected: Common not Private translations420lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/rryawwr0z7ph8mmfx4sny70z8sn2lsl9-closure-info/registration", will be passed to user space.421worker1 # [ 0.005690] CPU features: detected: CRC32 instructions422worker2 # [ 0.005883] CPU features: detected: TLB range maintenance instructions423client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns424lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes425worker1 # [ 0.005692] CPU features: detected: Data cache clean to Point of Deep Persistence426worker2 # [ 0.005888] CPU features: detected: Speculative Store Bypassing Safe (SSBS)427client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns428lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)429worker2 # [ 0.005930] alternatives: applying system-wide alternatives430client # [ 0.000033] arm-pv: using stolen time PV431worker1 # [ 0.005696] CPU features: detected: Data cache clean to Point of Persistence432lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)433worker2 # [ 0.009155] CPU features: detected: BBM Level 2 without TLB conflict abort434worker1 # [ 0.005700] CPU features: detected: Data independent timing control (DIT)435client # [ 0.000483] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)436worker1 # [ 0.005703] CPU features: detected: E0PD437lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB438client # [ 0.000663] Console: colour dummy device 80x25439lb # [ 0.000000] software IO TLB: area num 1.440worker1 # [ 0.005705] CPU features: detected: Enhanced Counter Virtualization441client # [ 0.000672] printk: legacy console [tty0] enabled442worker2 # [ 0.009343] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)443lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB444worker2 # [ 0.009755] devtmpfs: initialized445worker1 # [ 0.005708] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)446client # [ 0.000862] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)447worker2 # [ 0.011844] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)448worker1 # [ 0.005711] CPU features: detected: Enhanced Virtualization Traps449lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)450client # [ 0.000869] pid_max: default: 32768 minimum: 301451lb # [ 0.000000] Fallback order for Node 0: 0452worker1 # [ 0.005714] CPU features: detected: Fine Grained Traps453worker2 # [ 0.011868] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).454client # [ 0.000940] LSM: initializing lsm=capability,landlock,yama,bpf,ima455lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216456client # [ 0.001084] landlock: Up and running.457worker1 # [ 0.005718] CPU features: detected: Generic authentication (architected QARMA5 algorithm)458worker2 # [ 0.012059] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL459lb # [ 0.000000] Policy zone: DMA460client # [ 0.001087] Yama: becoming mindful.461worker1 # [ 0.005722] CPU features: detected: RCpc load-acquire (LDAPR)462worker2 # [ 0.012064] 0 pages in range for non-PLT usage463client # [ 0.001584] LSM support for eBPF active464lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off465worker2 # [ 0.012065] 508288 pages in range for PLT usage466worker1 # [ 0.005725] CPU features: detected: LSE atomic instructions467lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1468client # [ 0.001752] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)469worker2 # [ 0.012178] pinctrl core: initialized pinctrl subsystem470worker1 # [ 0.005727] CPU features: detected: Privileged Access Never471lb # [ 0.000000] allocated 3145728 bytes of page_ext472worker2 # [ 0.012996] DMI not present or invalid.473worker1 # [ 0.005730] CPU features: detected: PMUv3474client # [ 0.001783] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)475lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages476worker2 # [ 0.016722] NET: Registered PF_NETLINK/PF_ROUTE protocol family477worker1 # [ 0.005732] CPU features: detected: RAS Extension Support478client # [ 0.002937] cacheinfo: Unable to detect cache hierarchy for CPU 0479lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups480worker1 # [ 0.005735] CPU features: detected: RASv1p1 Extension Support481worker2 # [ 0.019071] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations482client # [ 0.003737] rcu: Hierarchical SRCU implementation.483lb # [ 0.000000] rcu: Hierarchical RCU implementation.484worker1 # [ 0.005738] CPU features: detected: Random Number Generator485client # [ 0.003741] rcu: Max phase no-delay instances is 1000.486lb # [ 0.000000] rcu: RCU event tracing is enabled.487worker2 # [ 0.019282] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations488worker1 # [ 0.005740] CPU features: detected: Speculation barrier (SB)489client # [ 0.004982] fsl-mc MSI: its@8080000 domain created490lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.491worker2 # [ 0.019509] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations492client # [ 0.005074] EFI services will not be available.493worker1 # [ 0.005743] CPU features: detected: Stage-2 Force Write-Back494lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.495worker2 # [ 0.019535] audit: initializing netlink subsys (disabled)496client # [ 0.005173] smp: Bringing up secondary CPUs ...497worker1 # [ 0.005745] CPU features: detected: TLB range maintenance instructions498lb # [ 0.000000] Rude variant of Tasks RCU enabled.499client # [ 0.005183] smp: Brought up 1 node, 1 CPU500worker2 # [ 0.020165] thermal_sys: Registered thermal governor 'fair_share'501lb # [ 0.000000] Tracing variant of Tasks RCU enabled.502client # [ 0.005187] SMP: Total of 1 processors activated.503worker1 # [ 0.005750] CPU features: detected: Speculative Store Bypassing Safe (SSBS)504client # [ 0.005192] CPU: All CPU(s) started at EL1505worker2 # [ 0.020167] thermal_sys: Registered thermal governor 'bang_bang'506worker1 # [ 0.005789] alternatives: applying system-wide alternatives507lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.508client # [ 0.005204] CPU features: detected: Branch Target Identification509worker1 # [ 0.008875] CPU features: detected: BBM Level 2 without TLB conflict abort510lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1511client # [ 0.005208] CPU features: detected: ARMv8.4 Translation Table Level512worker2 # [ 0.020171] thermal_sys: Registered thermal governor 'step_wise'513lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.514worker2 # [ 0.020177] thermal_sys: Registered thermal governor 'user_space'515client # [ 0.005211] CPU features: detected: Instruction cache invalidation not required for I/D coherence516worker1 # [ 0.009093] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)517worker2 # [ 0.020179] thermal_sys: Registered thermal governor 'power_allocator'518worker1 # [ 0.009514] devtmpfs: initialized519lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.520client # [ 0.005215] CPU features: detected: Data cache clean to the PoU not required for I/D coherence521worker2 # [ 0.020207] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1522worker1 # [ 0.011385] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)523client # [ 0.005218] CPU features: detected: Common not Private translations524lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.525worker2 # [ 0.020216] cpuidle: using governor ladder526worker2 # [ 0.020222] cpuidle: using governor menu527client # [ 0.005221] CPU features: detected: CRC32 instructions528lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0529worker1 # [ 0.011407] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).530lb # [ 0.000000] GICv3: 256 SPIs implemented531worker1 # [ 0.011617] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL532client # [ 0.005224] CPU features: detected: Data cache clean to Point of Deep Persistence533worker2 # [ 0.020447] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.534lb # [ 0.000000] GICv3: 0 Extended SPIs implemented535worker2 # [ 0.020465] ASID allocator initialised with 65536 entries536worker1 # [ 0.011622] 0 pages in range for non-PLT usage537lb # [ 0.000000] Root IRQ handler: gic_handle_irq538worker2 # [ 0.021790] Serial: AMBA PL011 UART driver539worker1 # [ 0.011623] 508288 pages in range for PLT usage540lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI541client # [ 0.005228] CPU features: detected: Data cache clean to Point of Persistence542worker1 # [ 0.011728] pinctrl core: initialized pinctrl subsystem543lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0544worker2 # [ 0.027237] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1545worker1 # [ 0.012532] DMI not present or invalid.546client # [ 0.005231] CPU features: detected: Data independent timing control (DIT)547worker2 # [ 0.027402] printk: console [ttyAMA0] enabled548lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000549client # [ 0.005234] CPU features: detected: E0PD550worker1 # [ 0.015648] NET: Registered PF_NETLINK/PF_ROUTE protocol family551lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]552client # [ 0.005237] CPU features: detected: Enhanced Counter Virtualization553worker1 # [ 0.017925] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations554lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)555client # [ 0.005240] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)556worker1 # [ 0.018108] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations557client # [ 0.005243] CPU features: detected: Enhanced Virtualization Traps558lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)559worker1 # [ 0.018338] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations560client # [ 0.005246] CPU features: detected: Fine Grained Traps561worker1 # [ 0.018364] audit: initializing netlink subsys (disabled)562lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000563client # [ 0.005249] CPU features: detected: Generic authentication (architected QARMA5 algorithm)564worker1 # [ 0.018922] thermal_sys: Registered thermal governor 'fair_share'565lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000566client # [ 0.005254] CPU features: detected: RCpc load-acquire (LDAPR)567worker1 # [ 0.018924] thermal_sys: Registered thermal governor 'bang_bang'568lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.569client # [ 0.005257] CPU features: detected: LSE atomic instructions570worker1 # [ 0.018927] thermal_sys: Registered thermal governor 'step_wise'571client # [ 0.005260] CPU features: detected: Privileged Access Never572worker1 # [ 0.018933] thermal_sys: Registered thermal governor 'user_space'573lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns574client # [ 0.005263] CPU features: detected: PMUv3575client # [ 0.005266] CPU features: detected: RAS Extension Support576lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).577client # [ 0.005269] CPU features: detected: RASv1p1 Extension Support578client # [ 0.005271] CPU features: detected: Random Number Generator579lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns580client # [ 0.005274] CPU features: detected: Speculation barrier (SB)581lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns582worker2 # [ 0.149546] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages583client # [ 0.005276] CPU features: detected: Stage-2 Force Write-Back584lb # [ 0.000031] arm-pv: using stolen time PV585worker2 # [ 0.149570] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page586client # [ 0.005279] CPU features: detected: TLB range maintenance instructions587worker2 # [ 0.149576] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages588lb # [ 0.000453] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)589client # [ 0.005284] CPU features: detected: Speculative Store Bypassing Safe (SSBS)590lb # [ 0.000651] Console: colour dummy device 80x25591worker2 # [ 0.149581] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page592client # [ 0.005323] alternatives: applying system-wide alternatives593lb # [ 0.000659] printk: legacy console [tty0] enabled594worker2 # [ 0.149585] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages595client # [ 0.008556] CPU features: detected: BBM Level 2 without TLB conflict abort596worker2 # [ 0.149589] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page597lb # [ 0.000851] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)598lb # [ 0.000858] pid_max: default: 32768 minimum: 301599worker2 # [ 0.149594] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages600client # [ 0.008726] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)601lb # [ 0.000937] LSM: initializing lsm=capability,landlock,yama,bpf,ima602worker2 # [ 0.149598] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page603client # [ 0.009150] devtmpfs: initialized604worker1 # [ 0.018935] thermal_sys: Registered thermal governor 'power_allocator'605lb # [ 0.001068] landlock: Up and running.606lb # [ 0.001071] Yama: becoming mindful.607client # [ 0.011028] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)608lb # [ 0.001570] LSM support for eBPF active609worker1 # [ 0.018962] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1610worker1 # [ 0.018970] cpuidle: using governor ladder611client # [ 0.011051] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).612lb # [ 0.001745] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)613worker1 # [ 0.018976] cpuidle: using governor menu614worker2 # [ 0.157063] fbcon: Taking over console615client # [ 0.011237] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL616worker2 # [ 0.157082] ACPI: Interpreter disabled.617worker1 # [ 0.019176] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.618lb # [ 0.001782] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)619client # [ 0.011242] 0 pages in range for non-PLT usage620worker1 # [ 0.019191] ASID allocator initialised with 65536 entries621client # [ 0.011243] 508288 pages in range for PLT usage622lb # [ 0.002966] cacheinfo: Unable to detect cache hierarchy for CPU 0623worker1 # [ 0.020445] Serial: AMBA PL011 UART driver624client # [ 0.011365] pinctrl core: initialized pinctrl subsystem625lb # [ 0.003656] rcu: Hierarchical SRCU implementation.626client # [ 0.012193] DMI not present or invalid.627lb # [ 0.003659] rcu: Max phase no-delay instances is 1000.628worker1 # [ 0.025857] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1629client # [ 0.015570] NET: Registered PF_NETLINK/PF_ROUTE protocol family630lb # [ 0.004907] fsl-mc MSI: its@8080000 domain created631worker1 # [ 0.025992] printk: console [ttyAMA0] enabled632lb # [ 0.005006] EFI services will not be available.633client # [ 0.017859] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations634lb # [ 0.005089] smp: Bringing up secondary CPUs ...635worker1 # [ 0.147695] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages636client # [ 0.018058] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations637lb # [ 0.005098] smp: Brought up 1 node, 1 CPU638lb # [ 0.005101] SMP: Total of 1 processors activated.639worker1 # [ 0.147717] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page640client # [ 0.018264] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations641lb # [ 0.005107] CPU: All CPU(s) started at EL1642worker1 # [ 0.147722] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages643client # [ 0.018291] audit: initializing netlink subsys (disabled)644lb # [ 0.005119] CPU features: detected: Branch Target Identification645worker1 # [ 0.147726] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page646client # [ 0.018872] thermal_sys: Registered thermal governor 'fair_share'647lb # [ 0.005124] CPU features: detected: ARMv8.4 Translation Table Level648client # [ 0.018874] thermal_sys: Registered thermal governor 'bang_bang'649worker1 # [ 0.147730] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages650client # [ 0.018877] thermal_sys: Registered thermal governor 'step_wise'651lb # [ 0.005127] CPU features: detected: Instruction cache invalidation not required for I/D coherence652worker2 # [ 0.165810] iommu: Default domain type: Translated653worker1 # [ 0.147735] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page654client # [ 0.018882] thermal_sys: Registered thermal governor 'user_space'655worker1 # [ 0.147739] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages656lb # [ 0.005130] CPU features: detected: Data cache clean to the PoU not required for I/D coherence657worker2 # [ 0.165822] iommu: DMA domain TLB invalidation policy: strict mode658worker2 # [ 0.166219] SCSI subsystem initialized659worker1 # [ 0.147743] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page660client # [ 0.018885] thermal_sys: Registered thermal governor 'power_allocator'661lb # [ 0.005134] CPU features: detected: Common not Private translations662lb # [ 0.005137] CPU features: detected: CRC32 instructions663client # [ 0.018909] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1664worker2 # [ 0.168218] usbcore: registered new interface driver usbfs665client # [ 0.018918] cpuidle: using governor ladder666worker2 # [ 0.168253] usbcore: registered new interface driver hub667lb # [ 0.005140] CPU features: detected: Data cache clean to Point of Deep Persistence668client # [ 0.018923] cpuidle: using governor menu669worker2 # [ 0.168272] usbcore: registered new device driver usb670worker1 # [ 0.155084] fbcon: Taking over console671lb # [ 0.005144] CPU features: detected: Data cache clean to Point of Persistence672client # [ 0.019132] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.673worker2 # [ 0.168574] pps_core: LinuxPPS API ver. 1 registered674worker1 # [ 0.155100] ACPI: Interpreter disabled.675client # [ 0.019149] ASID allocator initialised with 65536 entries676lb # [ 0.005147] CPU features: detected: Data independent timing control (DIT)677client # [ 0.020449] Serial: AMBA PL011 UART driver678lb # [ 0.005150] CPU features: detected: E0PD679worker2 # [ 0.168580] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>680worker2 # [ 0.168591] PTP clock support registered681lb # [ 0.005153] CPU features: detected: Enhanced Counter Virtualization682client # [ 0.025667] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1683worker2 # [ 0.168642] EDAC MC: Ver: 3.0.0684client # [ 0.025837] printk: console [ttyAMA0] enabled685lb # [ 0.005156] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)686worker2 # [ 0.173220] scmi_core: SCMI protocol bus registered687lb # [ 0.005159] CPU features: detected: Enhanced Virtualization Traps688lb # [ 0.005162] CPU features: detected: Fine Grained Traps689worker2 # [ 0.174240] FPGA manager framework690worker2 # [ 0.175260] vgaarb: loaded691lb # [ 0.005166] CPU features: detected: Generic authentication (architected QARMA5 algorithm)692worker2 # [ 0.175926] clocksource: Switched to clocksource arch_sys_counter693lb # [ 0.005171] CPU features: detected: RCpc load-acquire (LDAPR)694worker1 # [ 0.162083] iommu: Default domain type: Translated695lb # [ 0.005175] CPU features: detected: LSE atomic instructions696worker1 # [ 0.162093] iommu: DMA domain TLB invalidation policy: strict mode697worker2 # [ 0.177529] VFS: Disk quotas dquot_6.6.0698lb # [ 0.005177] CPU features: detected: Privileged Access Never699worker1 # [ 0.163864] SCSI subsystem initialized700lb # [ 0.005180] CPU features: detected: PMUv3701worker2 # [ 0.177568] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)702lb # [ 0.005183] CPU features: detected: RAS Extension Support703lb # [ 0.005185] CPU features: detected: RASv1p1 Extension Support704worker1 # [ 0.164563] usbcore: registered new interface driver usbfs705worker1 # [ 0.164596] usbcore: registered new interface driver hub706lb # [ 0.005188] CPU features: detected: Random Number Generator707worker1 # [ 0.164615] usbcore: registered new device driver usb708lb # [ 0.005191] CPU features: detected: Speculation barrier (SB)709worker2 # [ 0.181224] netfs: FS-Cache loaded710worker1 # [ 0.164946] pps_core: LinuxPPS API ver. 1 registered711lb # [ 0.005194] CPU features: detected: Stage-2 Force Write-Back712worker2 # [ 0.181353] pnp: PnP ACPI: disabled713lb # [ 0.005197] CPU features: detected: TLB range maintenance instructions714client # [ 0.146419] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages715worker1 # [ 0.164951] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>716worker1 # [ 0.164962] PTP clock support registered717client # [ 0.146439] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page718lb # [ 0.005201] CPU features: detected: Speculative Store Bypassing Safe (SSBS)719worker1 # [ 0.165015] EDAC MC: Ver: 3.0.0720lb # [ 0.005240] alternatives: applying system-wide alternatives721client # [ 0.146444] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages722worker1 # [ 0.169668] scmi_core: SCMI protocol bus registered723lb # [ 0.008376] CPU features: detected: BBM Level 2 without TLB conflict abort724client # [ 0.146448] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page725worker1 # [ 0.170647] FPGA manager framework726client # [ 0.146453] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages727worker1 # [ 0.171586] vgaarb: loaded728client # [ 0.146457] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page729lb # [ 0.008664] Memory: 1406564K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)730worker1 # [ 0.172225] clocksource: Switched to clocksource arch_sys_counter731lb # [ 0.009069] devtmpfs: initialized732client # [ 0.146461] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages733lb # [ 0.011117] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)734client # [ 0.146466] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page735worker2 # [ 0.185428] NET: Registered PF_INET protocol family736lb # [ 0.011140] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).737worker2 # [ 0.185684] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)738lb # [ 0.011331] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL739lb # [ 0.011336] 0 pages in range for non-PLT usage740worker1 # [ 0.175648] VFS: Disk quotas dquot_6.6.0741client # [ 0.153957] fbcon: Taking over console742lb # [ 0.011337] 508288 pages in range for PLT usage743client # [ 0.153973] ACPI: Interpreter disabled.744worker1 # [ 0.175678] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)745lb # [ 0.011473] pinctrl core: initialized pinctrl subsystem746client # [ 0.155861] iommu: Default domain type: Translated747lb # [ 0.012280] DMI not present or invalid.748client # [ 0.155871] iommu: DMA domain TLB invalidation policy: strict mode749lb # [ 0.015363] NET: Registered PF_NETLINK/PF_ROUTE protocol family750client # [ 0.157577] SCSI subsystem initialized751lb # [ 0.017677] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations752worker1 # [ 0.179416] netfs: FS-Cache loaded753lb # [ 0.017879] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations754worker1 # [ 0.179551] pnp: PnP ACPI: disabled755lb # [ 0.018089] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations756lb # [ 0.018113] audit: initializing netlink subsys (disabled)757lb # [ 0.018722] thermal_sys: Registered thermal governor 'fair_share'758lb # [ 0.018724] thermal_sys: Registered thermal governor 'bang_bang'759worker1 # [ 0.183796] NET: Registered PF_INET protocol family760lb # [ 0.018727] thermal_sys: Registered thermal governor 'step_wise'761client # [ 0.162881] usbcore: registered new interface driver usbfs762worker1 # [ 0.184072] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)763lb # [ 0.018734] thermal_sys: Registered thermal governor 'user_space'764client # [ 0.162914] usbcore: registered new interface driver hub765client # [ 0.162933] usbcore: registered new device driver usb766lb # [ 0.018737] thermal_sys: Registered thermal governor 'power_allocator'767client # [ 0.163218] pps_core: LinuxPPS API ver. 1 registered768lb # [ 0.018763] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1769lb # [ 0.018772] cpuidle: using governor ladder770client # [ 0.163224] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>771lb # [ 0.018778] cpuidle: using governor menu772client # [ 0.163234] PTP clock support registered773client # [ 0.163281] EDAC MC: Ver: 3.0.0774lb # [ 0.018985] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.775client # [ 0.167994] scmi_core: SCMI protocol bus registered776lb # [ 0.019001] ASID allocator initialised with 65536 entries777lb # [ 0.020216] Serial: AMBA PL011 UART driver778client # [ 0.168973] FPGA manager framework779client # [ 0.169920] vgaarb: loaded780lb # [ 0.025738] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1781lb # [ 0.025919] printk: console [ttyAMA0] enabled782client # [ 0.170576] clocksource: Switched to clocksource arch_sys_counter783client # [ 0.176724] VFS: Disk quotas dquot_6.6.0784client # [ 0.176785] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)785client # [ 0.178466] netfs: FS-Cache loaded786client # [ 0.179046] pnp: PnP ACPI: disabled787lb # [ 0.149122] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages788lb # [ 0.149146] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page789lb # [ 0.149152] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages790lb # [ 0.149156] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page791client # [ 0.182454] NET: Registered PF_INET protocol family792lb # [ 0.149160] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages793lb # [ 0.149165] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page794lb # [ 0.149169] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages795lb # [ 0.149173] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page796client # [ 0.183369] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)797lb # [ 0.156943] fbcon: Taking over console798lb # [ 0.156958] ACPI: Interpreter disabled.799lb # [ 0.158967] iommu: Default domain type: Translated800worker2 # [ 0.216722] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)801lb # [ 0.158978] iommu: DMA domain TLB invalidation policy: strict mode802worker2 # [ 0.216784] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)803lb # [ 0.160738] SCSI subsystem initialized804worker2 # [ 0.216817] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)805worker2 # [ 0.216911] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)806worker2 # [ 0.217055] TCP: Hash tables configured (established 16384 bind 16384)807worker2 # [ 0.217153] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)808worker2 # [ 0.217192] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)809worker2 # [ 0.217231] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)810worker2 # [ 0.217325] NET: Registered PF_UNIX/PF_LOCAL protocol family811lb # [ 0.165740] usbcore: registered new interface driver usbfs812worker2 # [ 0.217358] NET: Registered PF_XDP protocol family813lb # [ 0.165774] usbcore: registered new interface driver hub814worker2 # [ 0.217377] PCI: CLS 0 bytes, default 64815lb # [ 0.165794] usbcore: registered new device driver usb816worker2 # [ 0.217639] Trying to unpack rootfs image as initramfs...817lb # [ 0.166114] pps_core: LinuxPPS API ver. 1 registered818lb # [ 0.166120] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>819lb # [ 0.166131] PTP clock support registered820lb # [ 0.166181] EDAC MC: Ver: 3.0.0821lb # [ 0.170945] scmi_core: SCMI protocol bus registered822lb # [ 0.171971] FPGA manager framework823lb # [ 0.172941] vgaarb: loaded824worker1 # [ 0.214951] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)825lb # [ 0.173587] clocksource: Switched to clocksource arch_sys_counter826worker2 # [ 0.233834] kvm [1]: HYP mode not available827worker1 # [ 0.215012] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)828worker1 # [ 0.215046] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)829worker1 # [ 0.215143] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)830worker1 # [ 0.215286] TCP: Hash tables configured (established 16384 bind 16384)831worker1 # [ 0.215385] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)832lb # [ 0.178732] VFS: Disk quotas dquot_6.6.0833worker1 # [ 0.215424] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)834lb # [ 0.178770] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)835worker1 # [ 0.215462] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)836worker1 # [ 0.215554] NET: Registered PF_UNIX/PF_LOCAL protocol family837worker1 # [ 0.215579] NET: Registered PF_XDP protocol family838worker1 # [ 0.215598] PCI: CLS 0 bytes, default 64839worker1 # [ 0.215846] Trying to unpack rootfs image as initramfs...840lb # [ 0.182564] netfs: FS-Cache loaded841lb # [ 0.182703] pnp: PnP ACPI: disabled842worker1 # [ 0.234133] kvm [1]: HYP mode not available843lb # [ 0.186667] NET: Registered PF_INET protocol family844lb # [ 0.186931] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)845client # [ 0.213816] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846client # [ 0.213875] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847client # [ 0.213910] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)848client # [ 0.214001] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849client # [ 0.214145] TCP: Hash tables configured (established 16384 bind 16384)850client # [ 0.214238] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)851client # [ 0.214276] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)852client # [ 0.214314] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)853client # [ 0.214405] NET: Registered PF_UNIX/PF_LOCAL protocol family854client # [ 0.214429] NET: Registered PF_XDP protocol family855client # [ 0.214449] PCI: CLS 0 bytes, default 64856client # [ 0.214691] Trying to unpack rootfs image as initramfs...857client # [ 0.232556] kvm [1]: HYP mode not available858lb # [ 0.218594] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)859lb # [ 0.218658] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)860lb # [ 0.218696] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)861lb # [ 0.218786] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)862lb # [ 0.218932] TCP: Hash tables configured (established 16384 bind 16384)863lb # [ 0.219033] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)864lb # [ 0.219074] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)865lb # [ 0.219112] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)866lb # [ 0.219230] NET: Registered PF_UNIX/PF_LOCAL protocol family867lb # [ 0.219254] NET: Registered PF_XDP protocol family868lb # [ 0.219274] PCI: CLS 0 bytes, default 64869lb # [ 0.219558] Trying to unpack rootfs image as initramfs...870lb # [ 0.235706] kvm [1]: HYP mode not available871worker2 # [ 0.393114] Initialise system trusted keyrings872worker2 # [ 0.393888] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker2 # [ 0.395167] squashfs: version 4.0 (2009/01/31) Phillip Lougher874worker2 # [ 0.396040] 9p: Installing v9fs 9p2000 file system support875worker1 # [ 0.392882] Initialise system trusted keyrings876worker1 # [ 0.393667] workingset: timestamp_bits=42 max_order=19 bucket_order=0877worker1 # [ 0.394932] squashfs: version 4.0 (2009/01/31) Phillip Lougher878worker1 # [ 0.395705] 9p: Installing v9fs 9p2000 file system support879worker2 # [ 0.424133] Key type asymmetric registered880worker2 # [ 0.424164] Asymmetric key parser 'x509' registered881worker2 # [ 0.424256] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)882worker2 # [ 0.426390] io scheduler mq-deadline registered883worker2 # [ 0.426402] io scheduler kyber registered884client # [ 0.395622] Initialise system trusted keyrings885client # [ 0.396371] workingset: timestamp_bits=42 max_order=19 bucket_order=0886client # [ 0.397624] squashfs: version 4.0 (2009/01/31) Phillip Lougher887client # [ 0.398393] 9p: Installing v9fs 9p2000 file system support888worker2 # [ 0.436122] pl061_gpio 9030000.pl061: PL061 GPIO chip registered889worker1 # [ 0.424486] Key type asymmetric registered890worker1 # [ 0.424517] Asymmetric key parser 'x509' registered891worker2 # [ 0.437666] ledtrig-cpu: registered to indicate activity on CPUs892worker1 # [ 0.424593] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)893worker2 # [ 0.438090] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:894worker1 # [ 0.426776] io scheduler mq-deadline registered895worker1 # [ 0.426789] io scheduler kyber registered896worker2 # [ 0.438109] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000897worker2 # [ 0.438122] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000898worker2 # [ 0.438139] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000899worker2 # [ 0.438172] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits900worker2 # [ 0.438199] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]901worker2 # [ 0.438278] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00902worker2 # [ 0.438288] pci_bus 0000:00: root bus resource [bus 00-ff]903worker2 # [ 0.438294] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]904worker2 # [ 0.438300] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]905worker2 # [ 0.438305] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]906worker2 # [ 0.438368] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint907worker1 # [ 0.436423] pl061_gpio 9030000.pl061: PL061 GPIO chip registered908worker2 # [ 0.438808] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint909worker2 # [ 0.438993] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]910worker2 # [ 0.439011] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]911worker2 # [ 0.439071] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]912worker1 # [ 0.437934] ledtrig-cpu: registered to indicate activity on CPUs913worker2 # [ 0.439088] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]914worker1 # [ 0.438376] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:915worker2 # [ 0.439559] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint916worker1 # [ 0.438397] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000917worker2 # [ 0.439744] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]918worker2 # [ 0.439759] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]919worker1 # [ 0.438410] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000920worker2 # [ 0.439789] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]921worker1 # [ 0.438418] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000922worker1 # [ 0.438444] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits923worker1 # [ 0.438472] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]924worker1 # [ 0.438561] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00925worker1 # [ 0.438570] pci_bus 0000:00: root bus resource [bus 00-ff]926client # [ 0.427295] Key type asymmetric registered927lb # [ 0.398121] Initialise system trusted keyrings928client # [ 0.427333] Asymmetric key parser 'x509' registered929worker1 # [ 0.438576] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]930worker1 # [ 0.438581] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]931client # [ 0.427435] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)932worker1 # [ 0.438586] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]933client # [ 0.429713] io scheduler mq-deadline registered934client # [ 0.429728] io scheduler kyber registered935worker1 # [ 0.438688] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint936worker1 # [ 0.439137] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint937worker1 # [ 0.439325] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]938worker1 # [ 0.439342] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]939worker1 # [ 0.439371] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]940worker1 # [ 0.439387] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]941worker2 # [ 0.464419] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint942worker2 # [ 0.464634] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]943worker2 # [ 0.464653] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]944worker2 # [ 0.464683] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]945worker1 # [ 0.439848] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint946worker2 # [ 0.465160] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint947lb # [ 0.405689] workingset: timestamp_bits=42 max_order=19 bucket_order=0948worker1 # [ 0.440031] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]949worker2 # [ 0.465343] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]950worker1 # [ 0.440046] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]951lb # [ 0.407127] squashfs: version 4.0 (2009/01/31) Phillip Lougher952worker2 # [ 0.465359] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]953worker1 # [ 0.440076] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]954worker2 # [ 0.465393] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]955worker2 # [ 0.465880] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint956worker2 # [ 0.466066] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]957lb # [ 0.407952] 9p: Installing v9fs 9p2000 file system support958worker2 # [ 0.466082] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]959worker2 # [ 0.466111] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]960worker2 # [ 0.466584] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint961worker2 # [ 0.466770] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]962worker2 # [ 0.466786] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]963client # [ 0.443303] pl061_gpio 9030000.pl061: PL061 GPIO chip registered964worker2 # [ 0.466816] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]965worker2 # [ 0.467301] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint966worker2 # [ 0.467489] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]967worker2 # [ 0.467504] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]968client # [ 0.444749] ledtrig-cpu: registered to indicate activity on CPUs969worker1 # [ 0.464707] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint970worker2 # [ 0.467533] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]971client # [ 0.445161] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:972worker1 # [ 0.464956] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]973worker2 # [ 0.467549] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]974client # [ 0.445179] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000975worker1 # [ 0.464975] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]976worker1 # [ 0.465005] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]977client # [ 0.445192] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000978worker1 # [ 0.465475] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint979client # [ 0.445200] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000980worker1 # [ 0.465660] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]981worker1 # [ 0.465676] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]982client # [ 0.445229] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits983worker2 # [ 0.484602] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint984worker1 # [ 0.465708] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]985client # [ 0.445254] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]986worker2 # [ 0.484806] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]987worker1 # [ 0.466171] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint988client # [ 0.445334] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00989worker2 # [ 0.484835] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]990worker1 # [ 0.466354] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]991client # [ 0.445344] pci_bus 0000:00: root bus resource [bus 00-ff]992worker1 # [ 0.466371] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]993worker2 # [ 0.485349] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint994client # [ 0.445350] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]995worker1 # [ 0.466400] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]996worker2 # [ 0.485538] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]997client # [ 0.445356] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]998worker2 # [ 0.485567] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]999worker1 # [ 0.466855] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1000client # [ 0.445361] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1001worker1 # [ 0.467039] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1002worker2 # [ 0.485963] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1003client # [ 0.445421] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1004worker1 # [ 0.467055] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1005worker2 # [ 0.486148] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1006lb # [ 0.428783] Key type asymmetric registered1007client # [ 0.445870] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1008worker1 # [ 0.467085] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1009lb # [ 0.428817] Asymmetric key parser 'x509' registered1010worker2 # [ 0.486399] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1011client # [ 0.446058] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1012worker2 # [ 0.486693] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1013worker1 # [ 0.467551] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1014client # [ 0.446074] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1015lb # [ 0.428909] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1016worker2 # [ 0.486711] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1017worker1 # [ 0.467735] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1018client # [ 0.446103] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1019worker1 # [ 0.467751] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1020worker2 # [ 0.486741] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1021client # [ 0.446119] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1022worker1 # [ 0.467780] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1023worker2 # [ 0.487236] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1024worker1 # [ 0.467797] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1025worker2 # [ 0.487420] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1026worker2 # [ 0.487435] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1027worker2 # [ 0.487464] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1028client # [ 0.462617] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1029worker1 # [ 0.485015] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1030client # [ 0.462808] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1031lb # [ 0.437689] io scheduler mq-deadline registered1032worker1 # [ 0.485210] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1033lb # [ 0.437717] io scheduler kyber registered1034client # [ 0.462824] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1035worker1 # [ 0.485240] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1036client # [ 0.462854] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1037worker1 # [ 0.485725] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1038client # [ 0.463372] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1039worker1 # [ 0.485912] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1040client # [ 0.463564] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1041worker1 # [ 0.485942] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1042client # [ 0.463579] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1043client # [ 0.463610] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1044worker1 # [ 0.486328] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1045worker1 # [ 0.486508] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1046client # [ 0.464069] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1047lb # [ 0.443162] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1048client # [ 0.464252] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1049worker1 # [ 0.486752] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1050client # [ 0.464267] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1051worker1 # [ 0.487047] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1052worker1 # [ 0.487064] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1053client # [ 0.464300] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1054worker1 # [ 0.487092] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1055client # [ 0.464770] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1056worker2 # [ 0.508253] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1057client # [ 0.464952] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1058worker1 # [ 0.487561] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1059worker2 # [ 0.508287] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1060client # [ 0.464968] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1061worker1 # [ 0.487744] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1062worker2 # [ 0.508293] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1063worker1 # [ 0.487760] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1064client # [ 0.464997] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1065worker2 # [ 0.508348] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1066worker1 # [ 0.487789] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1067client # [ 0.465441] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1068worker2 # [ 0.508398] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1069client # [ 0.465623] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1070client # [ 0.465639] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1071worker2 # [ 0.508446] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1072client # [ 0.465668] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1073worker2 # [ 0.508494] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1074client # [ 0.466161] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1075worker2 # [ 0.508543] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1076lb # [ 0.449651] ledtrig-cpu: registered to indicate activity on CPUs1077client # [ 0.466347] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1078client # [ 0.466363] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1079worker2 # [ 0.508597] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1080lb # [ 0.450228] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1081client # [ 0.466392] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1082worker2 # [ 0.508648] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1083lb # [ 0.450250] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001084client # [ 0.466408] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1085worker2 # [ 0.508697] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1086lb # [ 0.450263] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001087worker2 # [ 0.508746] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1088lb # [ 0.450288] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001089worker2 # [ 0.508882] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1090lb # [ 0.450311] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1091worker2 # [ 0.508932] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1092lb # [ 0.450337] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1093worker2 # [ 0.508954] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1094lb # [ 0.450423] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001095worker2 # [ 0.508976] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1096worker1 # [ 0.508535] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1097lb # [ 0.450433] pci_bus 0000:00: root bus resource [bus 00-ff]1098worker2 # [ 0.509003] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1099worker1 # [ 0.508571] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1100lb # [ 0.450439] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1101worker2 # [ 0.509029] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1102worker1 # [ 0.508577] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1103lb # [ 0.450445] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1104worker2 # [ 0.509051] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1105lb # [ 0.450451] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1106worker1 # [ 0.508631] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1107worker2 # [ 0.509074] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1108client # [ 0.491017] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1109lb # [ 0.450573] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1110worker2 # [ 0.509097] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1111worker1 # [ 0.508684] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1112client # [ 0.491236] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1113worker2 # [ 0.509119] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1114lb # [ 0.451067] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1115worker1 # [ 0.508752] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1116lb # [ 0.451272] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1117client # [ 0.491267] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1118worker2 # [ 0.509142] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1119worker1 # [ 0.508801] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1120lb # [ 0.451290] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1121worker2 # [ 0.509167] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1122client # [ 0.491763] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1123worker1 # [ 0.508850] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1124lb # [ 0.451319] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1125client # [ 0.491957] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1126worker2 # [ 0.509190] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1127lb # [ 0.451335] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1128worker1 # [ 0.508897] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1129worker2 # [ 0.509212] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1130client # [ 0.491988] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131worker1 # [ 0.508946] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1132lb # [ 0.451814] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1133worker2 # [ 0.509234] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1134client # [ 0.492379] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1135worker2 # [ 0.509255] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1136lb # [ 0.452003] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1137client # [ 0.492562] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1138worker1 # [ 0.508995] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1139lb # [ 0.452018] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1140worker2 # [ 0.509277] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1141worker1 # [ 0.509044] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1142client # [ 0.492810] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1143worker2 # [ 0.509299] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1144lb # [ 0.452049] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1145client # [ 0.493122] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1146worker2 # [ 0.509322] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1147worker1 # [ 0.509167] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1148client # [ 0.493141] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1149lb # [ 0.452516] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1150worker2 # [ 0.509343] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1151worker1 # [ 0.509218] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1152lb # [ 0.452706] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1153client # [ 0.493171] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1154worker2 # [ 0.509366] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1155worker1 # [ 0.509242] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1156lb # [ 0.452722] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1157worker2 # [ 0.509388] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1158client # [ 0.493639] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1159worker1 # [ 0.509264] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1160lb # [ 0.452752] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1161worker2 # [ 0.509418] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1162client # [ 0.493825] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1163worker1 # [ 0.509286] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1164worker2 # [ 0.509428] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1165client # [ 0.493841] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1166lb # [ 0.453228] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1167worker1 # [ 0.509314] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1168lb # [ 0.453416] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1169worker2 # [ 0.509433] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1170client # [ 0.493870] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1171worker1 # [ 0.509335] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1172worker2 # [ 0.510637] pci 0000:00:0a.0: enabling device (0000 -> 0002)1173lb # [ 0.453432] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1174client # [ 0.494473] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1175worker1 # [ 0.509357] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1176lb # [ 0.453466] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1177client # [ 0.494484] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1178worker1 # [ 0.509379] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1179client # [ 0.494490] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1180worker1 # [ 0.509401] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1181client # [ 0.494538] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1182worker1 # [ 0.509423] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1183worker1 # [ 0.509447] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1184lb # [ 0.479540] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1185worker1 # [ 0.509470] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1186lb # [ 0.479738] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1187worker1 # [ 0.509491] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1188lb # [ 0.479755] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1189worker1 # [ 0.509513] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1190lb # [ 0.479786] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1191worker1 # [ 0.509534] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1192lb # [ 0.480257] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1193worker1 # [ 0.509555] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1194lb # [ 0.480450] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1195worker1 # [ 0.509577] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1196lb # [ 0.480466] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1197worker1 # [ 0.509599] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1198lb # [ 0.480498] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1199worker1 # [ 0.509620] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1200worker1 # [ 0.509642] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1201lb # [ 0.480976] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1202client # [ 0.514666] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1203worker1 # [ 0.509664] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1204lb # [ 0.481174] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1205worker1 # [ 0.509693] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1206lb # [ 0.481191] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1207client # [ 0.514735] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1208worker1 # [ 0.509702] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1209lb # [ 0.481222] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1210client # [ 0.514783] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1211worker1 # [ 0.509707] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1212lb # [ 0.481238] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1213client # [ 0.514831] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1214worker1 # [ 0.510903] pci 0000:00:0a.0: enabling device (0000 -> 0002)1215client # [ 0.514881] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1216client # [ 0.514929] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1217client # [ 0.514978] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1218client # [ 0.515027] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1219client # [ 0.515158] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1220client # [ 0.515208] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1221client # [ 0.515231] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1222client # [ 0.515253] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1223client # [ 0.515275] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1224client # [ 0.515301] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1225client # [ 0.515324] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1226worker2 # [ 0.566883] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1227client # [ 0.515346] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1228client # [ 0.515368] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1229client # [ 0.515390] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1230client # [ 0.515412] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1231lb # [ 0.497895] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1232client # [ 0.515436] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1233lb # [ 0.498126] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1234client # [ 0.515459] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1235lb # [ 0.498158] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1236client # [ 0.515480] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1237lb # [ 0.498651] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1238client # [ 0.515527] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1239lb # [ 0.498845] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1240client # [ 0.515550] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1241client # [ 0.515571] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1242lb # [ 0.498876] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1243client # [ 0.515592] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1244lb # [ 0.499283] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1245worker2 # [ 0.573379] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1246client # [ 0.515615] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1247lb # [ 0.499472] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1248client # [ 0.515636] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1249worker2 # [ 0.575457] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1250lb # [ 0.499726] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1251client # [ 0.515658] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1252worker1 # [ 0.562851] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1253lb # [ 0.500033] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1254client # [ 0.515680] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1255lb # [ 0.500051] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1256client # [ 0.515715] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1257lb # [ 0.500081] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1258client # [ 0.515725] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1259client # [ 0.515729] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1260lb # [ 0.500574] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1261client # [ 0.516925] pci 0000:00:0a.0: enabling device (0000 -> 0002)1262lb # [ 0.500763] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1263lb # [ 0.500779] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1264lb # [ 0.500809] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1265lb # [ 0.501412] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1266lb # [ 0.501424] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1267lb # [ 0.501430] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1268lb # [ 0.501478] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1269worker2 # [ 0.585551] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1270lb # [ 0.501526] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1271worker2 # [ 0.587597] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1272lb # [ 0.501575] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1273lb # [ 0.501654] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1274worker1 # [ 0.573032] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1275lb # [ 0.501706] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1276worker1 # [ 0.575977] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1277lb # [ 0.501756] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1278lb # [ 0.501806] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1279lb # [ 0.501854] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1280lb # [ 0.501902] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1281lb # [ 0.501985] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1282lb # [ 0.502032] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1283lb # [ 0.502053] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1284lb # [ 0.502075] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1285worker2 # [ 0.598931] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1286lb # [ 0.502097] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1287lb # [ 0.502123] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1288lb # [ 0.502145] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1289lb # [ 0.502168] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1290worker1 # [ 0.586489] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1291lb # [ 0.502190] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1292worker2 # [ 0.602001] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1293lb # [ 0.502212] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1294lb # [ 0.502234] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1295lb # [ 0.502258] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1296lb # [ 0.502280] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1297lb # [ 0.502302] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1298lb # [ 0.502324] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1299lb # [ 0.502345] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1300lb # [ 0.502367] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1301client # [ 0.573802] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1302worker1 # [ 0.592921] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1303lb # [ 0.502388] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1304lb # [ 0.502410] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1305lb # [ 0.502432] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1306worker1 # [ 0.595007] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1307lb # [ 0.502454] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1308lb # [ 0.502476] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1309lb # [ 0.502504] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1310lb # [ 0.502514] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1311lb # [ 0.502519] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1312worker2 # [ 0.612223] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1313lb # [ 0.503734] pci 0000:00:0a.0: enabling device (0000 -> 0002)1314worker2 # [ 0.614639] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1315client # [ 0.580110] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1316worker2 # [ 0.618199] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1317client # [ 0.582115] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1318worker1 # [ 0.605606] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1319worker1 # [ 0.607786] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1320worker1 # [ 0.611780] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1321worker2 # [ 0.624639] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1322client # [ 0.592213] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1323client # [ 0.594134] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1324worker1 # [ 0.618340] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1325worker2 # [ 0.641321] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1326client # [ 0.605889] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1327lb # [ 0.576856] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1328worker2 # [ 0.644196] msm_serial: driver initialized1329worker1 # [ 0.628812] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1330worker2 # [ 0.644345] SuperH (H)SCI(F) driver initialized1331worker2 # [ 0.644400] STM32 USART driver initialized1332lb # [ 0.587126] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1333client # [ 0.616102] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1334worker1 # [ 0.641603] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1335client # [ 0.621571] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1336worker1 # [ 0.644466] msm_serial: driver initialized1337worker1 # [ 0.644621] SuperH (H)SCI(F) driver initialized1338worker1 # [ 0.644673] STM32 USART driver initialized1339client # [ 0.628017] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1340client # [ 0.629823] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1341lb # [ 0.598351] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1342lb # [ 0.600416] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1343lb # [ 0.602477] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1344lb # [ 0.604632] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1345client # [ 0.640296] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1346worker2 # [ 0.678821] loop: module loaded1347worker2 # [ 0.679250] virtio_blk virtio5: 1/0/0 default/read/poll queues1348worker2 # [ 0.681208] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1349lb # [ 0.615239] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1350lb # [ 0.617485] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1351client # [ 0.653429] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1352worker2 # [ 0.688070] megasas: 07.734.00.00-rc11353worker2 # [ 0.688950] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1354client # [ 0.656123] msm_serial: driver initialized1355worker2 # [ 0.690863] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001356worker1 # [ 0.679229] loop: module loaded1357client # [ 0.656259] SuperH (H)SCI(F) driver initialized1358worker2 # [ 0.690892] Intel/Sharp Extended Query Table at 0x00311359worker1 # [ 0.679439] virtio_blk virtio5: 1/0/0 default/read/poll queues1360client # [ 0.656312] STM32 USART driver initialized1361lb # [ 0.628955] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1362worker1 # [ 0.681439] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1363lb # [ 0.631665] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1364worker2 # [ 0.704709] Using buffer write method1365worker2 # [ 0.704800] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1366worker2 # [ 0.706631] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001367worker2 # [ 0.706669] Intel/Sharp Extended Query Table at 0x00311368lb # [ 0.641970] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1369worker2 # [ 0.708386] Using buffer write method1370worker2 # [ 0.708412] Concatenating MTD devices:1371worker2 # [ 0.708416] (0): "0.flash"1372worker2 # [ 0.708420] (1): "0.flash"1373worker2 # [ 0.708423] into device "0.flash"1374worker1 # [ 0.693091] megasas: 07.734.00.00-rc11375worker1 # [ 0.693876] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1376worker1 # [ 0.696306] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001377worker1 # [ 0.696333] Intel/Sharp Extended Query Table at 0x00311378worker1 # [ 0.697854] Using buffer write method1379worker1 # [ 0.697934] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1380worker1 # [ 0.699544] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001381lb # [ 0.655051] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1382worker1 # [ 0.699574] Intel/Sharp Extended Query Table at 0x00311383lb # [ 0.658019] msm_serial: driver initialized1384lb # [ 0.658175] SuperH (H)SCI(F) driver initialized1385lb # [ 0.658232] STM32 USART driver initialized1386client # [ 0.691187] loop: module loaded1387client # [ 0.691420] virtio_blk virtio5: 1/0/0 default/read/poll queues1388client # [ 0.692195] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1389worker1 # [ 0.718257] Using buffer write method1390worker1 # [ 0.718311] Concatenating MTD devices:1391worker1 # [ 0.718315] (0): "0.flash"1392worker1 # [ 0.718319] (1): "0.flash"1393worker1 # [ 0.718323] into device "0.flash"1394client # [ 0.703382] megasas: 07.734.00.00-rc11395client # [ 0.704211] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1396client # [ 0.706071] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001397client # [ 0.706102] Intel/Sharp Extended Query Table at 0x00311398client # [ 0.707926] Using buffer write method1399client # [ 0.708005] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1400client # [ 0.709922] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001401client # [ 0.709955] Intel/Sharp Extended Query Table at 0x00311402lb # [ 0.690856] loop: module loaded1403lb # [ 0.691052] virtio_blk virtio5: 1/0/0 default/read/poll queues1404lb # [ 0.691787] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1405client # [ 0.729946] Using buffer write method1406client # [ 0.730001] Concatenating MTD devices:1407client # [ 0.730006] (0): "0.flash"1408client # [ 0.730011] (1): "0.flash"1409client # [ 0.730014] into device "0.flash"1410lb # [ 0.702423] megasas: 07.734.00.00-rc11411lb # [ 0.703205] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1412lb # [ 0.705125] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001413lb # [ 0.705156] Intel/Sharp Extended Query Table at 0x00311414lb # [ 0.710212] Using buffer write method1415lb # [ 0.710323] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1416lb # [ 0.712147] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001417lb # [ 0.712179] Intel/Sharp Extended Query Table at 0x00311418lb # [ 0.725660] Using buffer write method1419lb # [ 0.725701] Concatenating MTD devices:1420lb # [ 0.725705] (0): "0.flash"1421lb # [ 0.725710] (1): "0.flash"1422lb # [ 0.725713] into device "0.flash"1423worker2 # [ 0.973069] Freeing initrd memory: 26148K1424worker2 # [ 0.979303] tun: Universal TUN/TAP device driver, 1.61425worker2 # [ 0.983236] thunder_xcv, ver 1.01426worker2 # [ 0.983291] thunder_bgx, ver 1.01427worker2 # [ 0.983316] nicpf, ver 1.01428worker2 # [ 0.983891] e1000: Intel(R) PRO/1000 Network Driver1429worker2 # [ 0.983898] e1000: Copyright (c) 1999-2006 Intel Corporation.1430worker1 # [ 0.971877] Freeing initrd memory: 26148K1431worker2 # [ 0.983924] e1000e: Intel(R) PRO/1000 Network Driver1432worker2 # [ 0.987096] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1433worker2 # [ 0.987148] igb: Intel(R) Gigabit Ethernet Network Driver1434worker2 # [ 0.987154] igb: Copyright (c) 2007-2014 Intel Corporation.1435worker2 # [ 0.987180] igbvf: Intel(R) Gigabit Virtual Function Network Driver1436worker2 # [ 0.987186] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1437worker2 # [ 0.987338] sky2: driver version 1.301438worker1 # [ 0.978139] tun: Universal TUN/TAP device driver, 1.61439worker2 # [ 0.993144] usbcore: registered new interface driver usb-storage1440worker2 # [ 0.993200] usbcore: registered new interface driver usbserial_generic1441worker2 # [ 0.993215] usbserial: USB Serial support registered for generic1442worker2 # [ 0.993820] hv_vmbus: registering driver hyperv_keyboard1443worker2 # [ 0.995200] ehci-pci 0000:00:0a.0: EHCI Host Controller1444worker2 # [ 0.995228] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11445worker1 # [ 0.981903] thunder_xcv, ver 1.01446worker1 # [ 0.981950] thunder_bgx, ver 1.01447worker2 # [ 0.995518] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001448worker1 # [ 0.981977] nicpf, ver 1.01449worker1 # [ 0.982525] e1000: Intel(R) PRO/1000 Network Driver1450worker1 # [ 0.982532] e1000: Copyright (c) 1999-2006 Intel Corporation.1451worker1 # [ 0.982557] e1000e: Intel(R) PRO/1000 Network Driver1452worker2 # [ 1.001087] rtc-pl031 9010000.pl031: registered as rtc01453worker1 # [ 0.982567] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1454worker2 # [ 1.001122] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:47:30 UTC (1789908450)1455worker1 # [ 0.982601] igb: Intel(R) Gigabit Ethernet Network Driver1456worker2 # [ 1.001542] i2c_dev: i2c /dev entries driver1457worker1 # [ 0.982606] igb: Copyright (c) 2007-2014 Intel Corporation.1458worker1 # [ 0.982629] igbvf: Intel(R) Gigabit Virtual Function Network Driver1459worker2 # [ 1.004663] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001460worker1 # [ 0.982635] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1461worker2 # [ 1.004993] hub 1-0:1.0: USB hub found1462worker1 # [ 0.982769] sky2: driver version 1.301463worker2 # [ 1.005014] hub 1-0:1.0: 6 ports detected1464worker1 # [ 0.985055] ehci-pci 0000:00:0a.0: EHCI Host Controller1465client # [ 0.971312] Freeing initrd memory: 26160K1466worker1 # [ 0.985081] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11467worker1 # [ 0.985383] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001468worker1 # [ 0.994968] usbcore: registered new interface driver usb-storage1469worker2 # [ 1.009092] sdhci: Secure Digital Host Controller Interface driver1470worker1 # [ 0.995082] usbcore: registered new interface driver usbserial_generic1471worker2 # [ 1.009101] sdhci: Copyright(c) Pierre Ossman1472worker1 # [ 0.995098] usbserial: USB Serial support registered for generic1473client # [ 0.977360] tun: Universal TUN/TAP device driver, 1.61474worker2 # [ 1.009375] Synopsys Designware Multimedia Card Interface Driver1475worker1 # [ 0.995717] hv_vmbus: registering driver hyperv_keyboard1476worker2 # [ 1.009759] sdhci-pltfm: SDHCI platform and OF driver helper1477worker1 # [ 0.996280] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001478worker2 # [ 1.011594] hid: raw HID events driver (C) Jiri Kosina1479worker1 # [ 0.996689] hub 1-0:1.0: USB hub found1480worker1 # [ 0.996720] hub 1-0:1.0: 6 ports detected1481worker2 # [ 1.011882] usbcore: registered new interface driver usbhid1482worker2 # [ 1.011889] usbhid: USB HID core driver1483worker1 # [ 1.002147] rtc-pl031 9010000.pl031: registered as rtc01484client # [ 0.981232] thunder_xcv, ver 1.01485client # [ 0.981279] thunder_bgx, ver 1.01486worker1 # [ 1.002175] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:47:30 UTC (1789908450)1487client # [ 0.981303] nicpf, ver 1.01488worker1 # [ 1.002527] i2c_dev: i2c /dev entries driver1489client # [ 0.981861] e1000: Intel(R) PRO/1000 Network Driver1490client # [ 0.981868] e1000: Copyright (c) 1999-2006 Intel Corporation.1491worker2 # [ 1.017607] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1492client # [ 0.981892] e1000e: Intel(R) PRO/1000 Network Driver1493worker2 # [ 1.019191] drop_monitor: Initializing network drop monitor service1494client # [ 0.981900] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1495worker2 # [ 1.019388] NET: Registered PF_INET6 protocol family1496client # [ 0.981929] igb: Intel(R) Gigabit Ethernet Network Driver1497worker2 # [ 1.022467] Segment Routing with IPv61498worker1 # [ 1.007481] sdhci: Secure Digital Host Controller Interface driver1499client # [ 0.981935] igb: Copyright (c) 2007-2014 Intel Corporation.1500worker2 # [ 1.022499] In-situ OAM (IOAM) with IPv61501worker1 # [ 1.007490] sdhci: Copyright(c) Pierre Ossman1502client # [ 0.981959] igbvf: Intel(R) Gigabit Virtual Function Network Driver1503worker2 # [ 1.022531] NET: Registered PF_PACKET protocol family1504worker1 # [ 1.007758] Synopsys Designware Multimedia Card Interface Driver1505client # [ 0.981965] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1506worker1 # [ 1.008132] sdhci-pltfm: SDHCI platform and OF driver helper1507client # [ 0.982098] sky2: driver version 1.301508client # [ 0.991217] ehci-pci 0000:00:0a.0: EHCI Host Controller1509worker2 # [ 1.024145] 9pnet: Installing 9P2000 support1510client # [ 0.991249] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11511worker1 # [ 1.012504] hid: raw HID events driver (C) Jiri Kosina1512worker2 # [ 1.026371] Key type dns_resolver registered1513worker1 # [ 1.012807] usbcore: registered new interface driver usbhid1514client # [ 0.991414] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001515worker1 # [ 1.012814] usbhid: USB HID core driver1516client # [ 0.994447] usbcore: registered new interface driver usb-storage1517worker1 # [ 1.015659] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1518client # [ 0.994576] usbcore: registered new interface driver usbserial_generic1519worker1 # [ 1.018337] drop_monitor: Initializing network drop monitor service1520client # [ 0.996219] usbserial: USB Serial support registered for generic1521worker1 # [ 1.018537] NET: Registered PF_INET6 protocol family1522client # [ 0.996848] hv_vmbus: registering driver hyperv_keyboard1523worker1 # [ 1.020501] Segment Routing with IPv61524worker1 # [ 1.020518] In-situ OAM (IOAM) with IPv61525worker1 # [ 1.020548] NET: Registered PF_PACKET protocol family1526worker2 # [ 1.033838] registered taskstats version 11527client # [ 0.999280] rtc-pl031 9010000.pl031: registered as rtc01528worker2 # [ 1.033989] Loading compiled-in X.509 certificates1529client # [ 0.999314] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:47:30 UTC (1789908450)1530client # [ 0.999679] i2c_dev: i2c /dev entries driver1531worker1 # [ 1.022215] 9pnet: Installing 9P2000 support1532client # [ 1.003016] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001533client # [ 1.003346] hub 1-0:1.0: USB hub found1534client # [ 1.003368] hub 1-0:1.0: 6 ports detected1535worker1 # [ 1.025217] Key type dns_resolver registered1536worker2 # [ 1.042776] Demotion targets for Node 0: null1537worker2 # [ 1.042898] Key type .fscrypt registered1538worker2 # [ 1.042905] Key type fscrypt-provisioning registered1539worker2 # [ 1.043004] ima: No TPM chip found, activating TPM-bypass!1540worker2 # [ 1.043024] ima: Allocated hash algorithm: sha11541worker2 # [ 1.043063] ima: No architecture policies found1542lb # [ 0.980866] Freeing initrd memory: 26140K1543worker1 # [ 1.031655] registered taskstats version 11544client # [ 1.007683] sdhci: Secure Digital Host Controller Interface driver1545worker1 # [ 1.031808] Loading compiled-in X.509 certificates1546client # [ 1.007695] sdhci: Copyright(c) Pierre Ossman1547worker2 # [ 1.047299] input: gpio-keys as /devices/platform/gpio-keys/input/input01548client # [ 1.007972] Synopsys Designware Multimedia Card Interface Driver1549client # [ 1.008346] sdhci-pltfm: SDHCI platform and OF driver helper1550client # [ 1.010183] hid: raw HID events driver (C) Jiri Kosina1551client # [ 1.010463] usbcore: registered new interface driver usbhid1552client # [ 1.010480] usbhid: USB HID core driver1553lb # [ 0.987094] tun: Universal TUN/TAP device driver, 1.61554client # [ 1.016795] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1555worker1 # [ 1.040532] Demotion targets for Node 0: null1556client # [ 1.018416] drop_monitor: Initializing network drop monitor service1557worker1 # [ 1.040649] Key type .fscrypt registered1558client # [ 1.020620] NET: Registered PF_INET6 protocol family1559worker1 # [ 1.040656] Key type fscrypt-provisioning registered1560worker1 # [ 1.040839] ima: No TPM chip found, activating TPM-bypass!1561client # [ 1.021905] Segment Routing with IPv61562worker1 # [ 1.040863] ima: Allocated hash algorithm: sha11563client # [ 1.021927] In-situ OAM (IOAM) with IPv61564worker1 # [ 1.040885] ima: No architecture policies found1565client # [ 1.021962] NET: Registered PF_PACKET protocol family1566worker1 # [ 1.045306] input: gpio-keys as /devices/platform/gpio-keys/input/input01567lb # [ 0.990950] thunder_xcv, ver 1.01568lb # [ 0.990997] thunder_bgx, ver 1.01569lb # [ 0.991020] nicpf, ver 1.01570lb # [ 0.991585] e1000: Intel(R) PRO/1000 Network Driver1571lb # [ 0.991593] e1000: Copyright (c) 1999-2006 Intel Corporation.1572client # [ 1.023760] 9pnet: Installing 9P2000 support1573lb # [ 0.991617] e1000e: Intel(R) PRO/1000 Network Driver1574client # [ 1.026084] Key type dns_resolver registered1575lb # [ 0.991625] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1576lb # [ 0.991655] igb: Intel(R) Gigabit Ethernet Network Driver1577lb # [ 0.991661] igb: Copyright (c) 2007-2014 Intel Corporation.1578lb # [ 0.991684] igbvf: Intel(R) Gigabit Virtual Function Network Driver1579lb # [ 0.991690] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1580lb # [ 0.991829] sky2: driver version 1.301581lb # [ 0.993457] usbcore: registered new interface driver usb-storage1582worker2 # [ 1.066533] clk: Disabling unused clocks1583lb # [ 0.993562] usbcore: registered new interface driver usbserial_generic1584worker2 # [ 1.066574] PM: genpd: Disabling unused power domains1585lb # [ 0.993577] usbserial: USB Serial support registered for generic1586lb # [ 0.994379] ehci-pci 0000:00:0a.0: EHCI Host Controller1587client # [ 1.033816] registered taskstats version 11588lb # [ 0.994411] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11589client # [ 1.033982] Loading compiled-in X.509 certificates1590worker2 # [ 1.070933] Freeing unused kernel memory: 4736K1591worker2 # [ 1.071149] Run /init as init process1592lb # [ 0.994640] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001593lb # [ 1.005831] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001594lb # [ 1.006204] hub 1-0:1.0: USB hub found1595lb # [ 1.006220] hub 1-0:1.0: 6 ports detected1596lb # [ 1.009744] hv_vmbus: registering driver hyperv_keyboard1597lb # [ 1.011425] rtc-pl031 9010000.pl031: registered as rtc01598client # [ 1.042762] Demotion targets for Node 0: null1599lb # [ 1.011455] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:47:30 UTC (1789908450)1600client # [ 1.042895] Key type .fscrypt registered1601lb # [ 1.011766] i2c_dev: i2c /dev entries driver1602client # [ 1.042902] Key type fscrypt-provisioning registered1603client # [ 1.043008] ima: No TPM chip found, activating TPM-bypass!1604worker1 # [ 1.064517] clk: Disabling unused clocks1605client # [ 1.043029] ima: Allocated hash algorithm: sha11606worker1 # [ 1.064547] PM: genpd: Disabling unused power domains1607client # [ 1.043056] ima: No architecture policies found1608lb # [ 1.017103] sdhci: Secure Digital Host Controller Interface driver1609worker1 # [ 1.068849] Freeing unused kernel memory: 4736K1610client # [ 1.047718] input: gpio-keys as /devices/platform/gpio-keys/input/input01611lb # [ 1.017113] sdhci: Copyright(c) Pierre Ossman1612worker1 # [ 1.069062] Run /init as init process1613lb # [ 1.017388] Synopsys Designware Multimedia Card Interface Driver1614worker2 # [ 1.086302] systemd[1]: Successfully made /usr/ read-only.1615lb # [ 1.019853] sdhci-pltfm: SDHCI platform and OF driver helper1616lb # [ 1.022388] hid: raw HID events driver (C) Jiri Kosina1617lb # [ 1.022667] usbcore: registered new interface driver usbhid1618lb # [ 1.022674] usbhid: USB HID core driver1619lb # [ 1.025650] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1620lb # [ 1.027239] drop_monitor: Initializing network drop monitor service1621lb # [ 1.027405] NET: Registered PF_INET6 protocol family1622lb # [ 1.030818] Segment Routing with IPv61623lb # [ 1.030858] In-situ OAM (IOAM) with IPv61624lb # [ 1.030890] NET: Registered PF_PACKET protocol family1625lb # [ 1.032560] 9pnet: Installing 9P2000 support1626worker1 # [ 1.086824] systemd[1]: Successfully made /usr/ read-only.1627lb # [ 1.035364] Key type dns_resolver registered1628client # [ 1.067640] clk: Disabling unused clocks1629client # [ 1.067679] PM: genpd: Disabling unused power domains1630client # [ 1.072085] Freeing unused kernel memory: 4736K1631client # [ 1.072296] Run /init as init process1632lb # [ 1.042115] registered taskstats version 11633lb # [ 1.042267] Loading compiled-in X.509 certificates1634lb # [ 1.051207] Demotion targets for Node 0: null1635lb # [ 1.051352] Key type .fscrypt registered1636lb # [ 1.051359] Key type fscrypt-provisioning registered1637lb # [ 1.051460] ima: No TPM chip found, activating TPM-bypass!1638lb # [ 1.051481] ima: Allocated hash algorithm: sha11639lb # [ 1.051504] ima: No architecture policies found1640lb # [ 1.056010] input: gpio-keys as /devices/platform/gpio-keys/input/input01641client # [ 1.089200] systemd[1]: Successfully made /usr/ read-only.1642lb # [ 1.076201] clk: Disabling unused clocks1643lb # [ 1.076237] PM: genpd: Disabling unused power domains1644lb # [ 1.080655] Freeing unused kernel memory: 4736K1645lb # [ 1.080901] Run /init as init process1646lb # [ 1.096096] systemd[1]: Successfully made /usr/ read-only.1647worker2 # [ 1.252053] usb 1-1: new high-speed USB device number 2 using ehci-pci1648worker1 # [ 1.248329] usb 1-1: new high-speed USB device number 2 using ehci-pci1649client # [ 1.250688] usb 1-1: new high-speed USB device number 2 using ehci-pci1650lb # [ 1.253680] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker2 # [ 1.408749] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652worker1 # [ 1.409155] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653worker2 # [ 1.421602] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1654worker2 # [ 1.433873] systemd[1]: Detected virtualization qemu.1655worker2 # [ 1.436092] systemd[1]: Detected architecture arm64.1656worker2 # [ 1.438106] systemd[1]: Running in initrd.1657worker2 # [ 1.440764] systemd[1]: Initializing machine ID from random generator.1658worker2 # [ 1.443772] systemd[1]: Hostname set to <worker2>.1659client # [ 1.405366] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660worker1 # [ 1.422100] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1661worker1 # [ 1.434408] systemd[1]: Detected virtualization qemu.1662worker1 # [ 1.436541] systemd[1]: Detected architecture arm64.1663worker1 # [ 1.438565] systemd[1]: Running in initrd.1664worker1 # [ 1.441223] systemd[1]: Initializing machine ID from random generator.1665worker1 # [ 1.444326] systemd[1]: Hostname set to <worker1>.1666client # [ 1.424255] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1667client # [ 1.436584] systemd[1]: Detected virtualization qemu.1668lb # [ 1.406050] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11669client # [ 1.436688] systemd[1]: Detected architecture arm64.1670client # [ 1.436715] systemd[1]: Running in initrd.1671client # [ 1.437690] systemd[1]: Initializing machine ID from random generator.1672client # [ 1.437972] systemd[1]: Hostname set to <client>.1673worker2 # [ 1.492313] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01674lb # [ 1.431008] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1675lb # [ 1.443351] systemd[1]: Detected virtualization qemu.1676worker1 # [ 1.492597] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01677lb # [ 1.445361] systemd[1]: Detected architecture arm64.1678lb # [ 1.447395] systemd[1]: Running in initrd.1679lb # [ 1.450100] systemd[1]: Initializing machine ID from random generator.1680lb # [ 1.452962] systemd[1]: Hostname set to <lb>.1681client # [ 1.490941] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682lb # [ 1.497933] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker2 # [ 1.616013] usb 1-2: new high-speed USB device number 3 using ehci-pci1684worker1 # [ 1.616314] usb 1-2: new high-speed USB device number 3 using ehci-pci1685client # [ 1.614627] usb 1-2: new high-speed USB device number 3 using ehci-pci1686lb # [ 1.621628] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker2 # [ 1.768842] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688worker1 # [ 1.761259] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689worker2 # [ 1.783101] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690worker2 # [ 1.787908] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691worker1 # [ 1.776758] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21692worker1 # [ 1.784565] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01693client # [ 1.775704] systemd[1]: bpf-restrict-fs: LSM BPF program attached1694client # [ 1.779055] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21695client # [ 1.779391] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01696lb # [ 1.772678] systemd[1]: bpf-restrict-fs: LSM BPF program attached1697lb # [ 1.789931] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21698lb # [ 1.795256] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01699worker2 # [ 1.873742] systemd[1]: Queued start job for default target Initrd Default Target.1700worker1 # [ 1.860933] systemd[1]: Queued start job for default target Initrd Default Target.1701worker2 # [ 1.883386] systemd[1]: Created slice Slice /system/modprobe.1702worker2 # [ 1.884656] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1703worker1 # [ 1.870688] systemd[1]: Created slice Slice /system/modprobe.1704worker2 # [ 1.885934] systemd[1]: Expecting device /dev/disk/by-label/nixos...1705worker1 # [ 1.871833] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1706worker2 # [ 1.886951] systemd[1]: Reached target Path Units.1707worker1 # [ 1.873169] systemd[1]: Expecting device /dev/disk/by-label/nixos...1708worker2 # [ 1.887744] systemd[1]: Reached target Slice Units.1709worker1 # [ 1.874146] systemd[1]: Reached target Path Units.1710worker2 # [ 1.888609] systemd[1]: Reached target Swaps.1711worker1 # [ 1.874836] systemd[1]: Reached target Slice Units.1712worker2 # [ 1.889358] systemd[1]: Reached target Timer Units.1713worker1 # [ 1.875571] systemd[1]: Reached target Swaps.1714worker1 # [ 1.876266] systemd[1]: Reached target Timer Units.1715worker2 # [ 1.890361] systemd[1]: Listening on D-Bus System Message Bus Socket.1716worker1 # [ 1.877229] systemd[1]: Listening on D-Bus System Message Bus Socket.1717worker2 # [ 1.891543] systemd[1]: Listening on Journal Socket (/dev/log).1718worker1 # [ 1.878353] systemd[1]: Listening on Journal Socket (/dev/log).1719worker1 # [ 1.879398] systemd[1]: Listening on Journal Sockets.1720worker2 # [ 1.892684] systemd[1]: Listening on Journal Sockets.1721worker1 # [ 1.880339] systemd[1]: Listening on udev Control Socket.1722worker2 # [ 1.892824] systemd[1]: Listening on udev Control Socket.1723worker1 # [ 1.881303] systemd[1]: Listening on udev Kernel Socket.1724worker2 # [ 1.892940] systemd[1]: Listening on udev Kernel Socket.1725worker1 # [ 1.882127] systemd[1]: Reached target Socket Units.1726worker2 # [ 1.892962] systemd[1]: Reached target Socket Units.1727worker2 # [ 1.897885] systemd[1]: Starting Create List of Static Device Nodes...1728worker1 # [ 1.884699] systemd[1]: Starting Create List of Static Device Nodes...1729worker2 # [ 1.904892] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1730worker2 # [ 1.906023] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1731worker1 # [ 1.892458] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1732worker1 # [ 1.893549] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1733worker1 # [ 1.899917] systemd[1]: Mounting Kernel Configuration File System...1734client # [ 1.880569] systemd[1]: Queued start job for default target Initrd Default Target.1735worker2 # [ 1.916754] systemd[1]: Mounting Kernel Configuration File System...1736client # [ 1.888935] systemd[1]: Created slice Slice /system/modprobe.1737client # [ 1.890099] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1738client # [ 1.891425] systemd[1]: Expecting device /dev/disk/by-label/nixos...1739client # [ 1.892558] systemd[1]: Reached target Path Units.1740client # [ 1.893324] systemd[1]: Reached target Slice Units.1741client # [ 1.894098] systemd[1]: Reached target Swaps.1742client # [ 1.894835] systemd[1]: Reached target Timer Units.1743worker1 # [ 1.916825] systemd[1]: Starting Journal Service...1744client # [ 1.895843] systemd[1]: Listening on D-Bus System Message Bus Socket.1745client # [ 1.897006] systemd[1]: Listening on Journal Socket (/dev/log).1746client # [ 1.898069] systemd[1]: Listening on Journal Sockets.1747worker2 # [ 1.932385] systemd[1]: Starting Journal Service...1748client # [ 1.899039] systemd[1]: Listening on udev Control Socket.1749client # [ 1.900043] systemd[1]: Listening on udev Kernel Socket.1750client # [ 1.900882] systemd[1]: Reached target Socket Units.1751client # [ 1.903454] systemd[1]: Starting Create List of Static Device Nodes...1752worker1 # [ 1.931025] systemd[1]: Starting Load Kernel Modules...1753worker1 # [ 1.931866] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1754client # [ 1.913976] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1755client # [ 1.915322] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1756lb # [ 1.886526] systemd[1]: Queued start job for default target Initrd Default Target.1757worker2 # [ 1.956134] systemd[1]: Starting Load Kernel Modules...1758worker2 # [ 1.957069] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1759worker1 # [ 1.945778] systemd[1]: Starting Coldplug All udev Devices...1760lb # [ 1.895920] systemd[1]: Created slice Slice /system/modprobe.1761lb # [ 1.897023] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1762lb # [ 1.898301] systemd[1]: Expecting device /dev/disk/by-label/nixos...1763worker2 # [ 1.964101] systemd[1]: Starting Coldplug All udev Devices...1764lb # [ 1.899253] systemd[1]: Reached target Path Units.1765lb # [ 1.899972] systemd[1]: Reached target Slice Units.1766lb # [ 1.900694] systemd[1]: Reached target Swaps.1767client # [ 1.928294] systemd[1]: Mounting Kernel Configuration File System...1768lb # [ 1.901353] systemd[1]: Reached target Timer Units.1769worker2 # [ 1.967416] systemd[1]: Finished Create List of Static Device Nodes.1770lb # [ 1.902377] systemd[1]: Listening on D-Bus System Message Bus Socket.1771lb # [ 1.903486] systemd[1]: Listening on Journal Socket (/dev/log).1772worker2 # [ 1.969339] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1773lb # [ 1.904492] systemd[1]: Listening on Journal Sockets.1774lb # [ 1.905381] systemd[1]: Listening on udev Control Socket.1775lb # [ 1.906393] systemd[1]: Listening on udev Kernel Socket.1776lb # [ 1.907191] systemd[1]: Reached target Socket Units.1777lb # [ 1.909559] systemd[1]: Starting Create List of Static Device Nodes...1778worker2 # [ 1.977297] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1779worker2 # [ 1.977703] systemd[1]: Mounted Kernel Configuration File System.1780worker1 # [ 1.964570] systemd[1]: Finished Create List of Static Device Nodes.1781worker1 # [ 1.965650] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1782worker1 # [ 1.965975] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1783lb # [ 1.917908] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1784worker1 # [ 1.966280] systemd[1]: Mounted Kernel Configuration File System.1785lb # [ 1.918006] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1786client # [ 1.951289] systemd[1]: Starting Journal Service...1787lb # [ 1.925989] systemd[1]: Mounting Kernel Configuration File System...1788client # [ 1.958827] systemd[1]: Starting Load Kernel Modules...1789worker1 # [ 1.980699] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1790client # [ 1.959819] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1791worker2 # [ 2.000258] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1792client # [ 1.974848] systemd[1]: Starting Coldplug All udev Devices...1793worker2 # [ 2.010059] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1794client # [ 1.979137] systemd[1]: Finished Create List of Static Device Nodes.1795client # [ 1.981003] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1796lb # [ 1.956523] systemd[1]: Starting Journal Service...1797client # [ 1.991152] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1798worker1 # [ 2.013621] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1799worker2 # [ 2.029906] systemd-journald[73]: Collecting audit messages is disabled.1800lb # [ 1.965926] systemd[1]: Starting Load Kernel Modules...1801lb # [ 1.966816] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1802worker1 # [ 2.019746] systemd-journald[73]: Collecting audit messages is disabled.1803worker2 # [ 2.036060] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1804lb # [ 1.973896] systemd[1]: Starting Coldplug All udev Devices...1805worker1 # [ 2.028437] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1806worker1 # [ 2.034184] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1807worker2 # [ 2.048271] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01808worker2 # [ 2.048515] [drm] features: -virgl +edid -resource_blob -host_visible1809worker2 # [ 2.048527] [drm] features: -context_init1810worker2 # [ 2.049287] [drm] number of scanouts: 11811worker2 # [ 2.049306] [drm] number of cap sets: 01812worker1 # [ 2.040501] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01813client # [ 2.020858] systemd-journald[73]: Collecting audit messages is disabled.1814worker1 # [ 2.040790] [drm] features: -virgl +edid -resource_blob -host_visible1815worker2 # [ 2.056745] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1816worker1 # [ 2.040802] [drm] features: -context_init1817worker1 # [ 2.041574] [drm] number of scanouts: 11818lb # [ 1.989908] systemd[1]: Finished Create List of Static Device Nodes.1819client # [ 2.022811] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1820worker1 # [ 2.041592] [drm] number of cap sets: 01821lb # [ 1.990910] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1822lb # [ 1.991239] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1823lb # [ 1.991488] systemd[1]: Mounted Kernel Configuration File System.1824client # [ 2.027865] systemd[1]: Mounted Kernel Configuration File System.1825worker1 # [ 2.052662] systemd[1]: Starting Create Static Device Nodes in /dev...1826client # [ 2.035344] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1827worker2 # [ 2.068519] systemd[1]: Starting Create Static Device Nodes in /dev...1828lb # [ 2.006416] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1829worker1 # [ 2.060695] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1830worker1 # [ 2.060752] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01831worker2 # [ 2.073301] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1832worker2 # [ 2.073331] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01833client # [ 2.046786] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1834client # [ 2.059108] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01835client # [ 2.059363] [drm] features: -virgl +edid -resource_blob -host_visible1836client # [ 2.059373] [drm] features: -context_init1837client # [ 2.060127] [drm] number of scanouts: 11838lb # [ 2.032060] systemd-journald[73]: Collecting audit messages is disabled.1839client # [ 2.060146] [drm] number of cap sets: 01840worker2 # [ 2.096697] Console: switching to colour frame buffer device 160x501841worker2 # [ 2.103327] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1842worker1 # [ 2.092707] Console: switching to colour frame buffer device 160x501843lb # [ 2.048852] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1844worker1 # [ 2.099450] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1845client # [ 2.078970] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1846client # [ 2.079001] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01847client # [ 2.088589] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1848lb # [ 2.057702] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1849lb # [ 2.062520] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01850worker2 # [ 2.128931] systemd[1]: Finished Create Static Device Nodes in /dev.1851lb # [ 2.062757] [drm] features: -virgl +edid -resource_blob -host_visible1852lb # [ 2.062766] [drm] features: -context_init1853worker2 # [ 2.129190] systemd[1]: Reached target Preparation for Local File Systems.1854lb # [ 2.063502] [drm] number of scanouts: 11855worker2 # [ 2.129226] systemd[1]: Reached target Local File Systems.1856lb # [ 2.063521] [drm] number of cap sets: 01857worker2 # [ 2.135557] systemd[1]: Starting Rule-based Manager for Device Events and Files...1858client # [ 2.098907] systemd[1]: Starting Create Static Device Nodes in /dev...1859worker1 # [ 2.127710] systemd[1]: Finished Create Static Device Nodes in /dev.1860lb # [ 2.078373] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1861worker1 # [ 2.127966] systemd[1]: Reached target Preparation for Local File Systems.1862worker1 # [ 2.128004] systemd[1]: Reached target Local File Systems.1863worker1 # [ 2.133681] systemd[1]: Starting Rule-based Manager for Device Events and Files...1864lb # [ 2.086034] systemd[1]: Starting Create Static Device Nodes in /dev...1865client # [ 2.114873] Console: switching to colour frame buffer device 160x501866client # [ 2.121617] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1867lb # [ 2.094043] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1868lb # [ 2.094071] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01869worker1 # [ 2.152506] systemd[1]: Finished Load Kernel Modules.1870worker2 # [ 2.168292] systemd[1]: Finished Load Kernel Modules.1871worker2 # [ 2.172114] systemd[1]: Starting Apply Kernel Variables...1872worker1 # [ 2.160699] systemd[1]: Starting Apply Kernel Variables...1873client # [ 2.147290] systemd[1]: Finished Load Kernel Modules.1874client # [ 2.149755] systemd[1]: Starting Apply Kernel Variables...1875lb # [ 2.117866] Console: switching to colour frame buffer device 160x501876lb # [ 2.146329] systemd[1]: Finished Create Static Device Nodes in /dev.1877lb # [ 2.146724] systemd[1]: Reached target Preparation for Local File Systems.1878lb # [ 2.146752] systemd[1]: Reached target Local File Systems.1879worker1 # [ 2.184699] systemd-modules-load[74]: Inserted module 'dm_mod'1880worker1 # [ 2.203348] systemd[1]: Started Journal Service.1881worker2 # [ 2.216451] systemd[1]: Started Journal Service.1882lb # [ 2.150972] systemd[1]: Starting Rule-based Manager for Device Events and Files...1883client # [ 2.183025] systemd[1]: Finished Create Static Device Nodes in /dev.1884client # [ 2.183322] systemd[1]: Reached target Preparation for Local File Systems.1885client # [ 2.183359] systemd[1]: Reached target Local File Systems.1886worker1 # [ 2.192702] systemd-modules-load[74]: Module 'virtio_balloon' is built in1887worker1 # [ 2.193859] systemd-modules-load[74]: Module 'virtio_console' is built in1888worker1 # [ 2.194954] systemd-modules-load[74]: Inserted module 'virtio_gpu'1889lb # [ 2.158518] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1890worker1 # [ 2.195975] systemd-modules-load[74]: Module 'virtio_rng' is built in1891client # [ 2.191187] systemd[1]: Starting Rule-based Manager for Device Events and Files...1892worker2 # [ 2.199917] systemd-modules-load[74]: Inserted module 'dm_mod'1893worker2 # [ 2.216431] systemd-modules-load[74]: Module 'virtio_balloon' is built in1894worker2 # [ 2.217695] systemd-modules-load[74]: Module 'virtio_console' is built in1895worker2 # [ 2.218788] systemd-modules-load[74]: Inserted module 'virtio_gpu'1896worker2 # [ 2.219862] systemd-modules-load[74]: Module 'virtio_rng' is built in1897lb # [ 2.173870] systemd[1]: Finished Load Kernel Modules.1898worker1 # [ 2.216528] systemd[1]: Starting Create System Files and Directories...1899lb # [ 2.182069] systemd[1]: Starting Apply Kernel Variables...1900worker2 # [ 2.237397] systemd[1]: Starting Create System Files and Directories...1901client # [ 2.219136] systemd[1]: Finished Apply Kernel Variables.1902client # [ 2.219441] systemd[1]: Started Journal Service.1903client # [ 2.203898] systemd-modules-load[74]: Inserted module 'dm_mod'1904client # [ 2.209005] systemd-modules-load[74]: Module 'virtio_balloon' is built in1905worker1 # [ 2.231159] systemd[1]: Finished Apply Kernel Variables.1906worker2 # [ 2.248776] systemd-udevd[79]: Using default interface naming scheme 'v261'.1907worker2 # [ 2.253963] systemd[1]: Finished Apply Kernel Variables.1908client # [ 2.220554] systemd-modules-load[74]: Module 'virtio_console' is built in1909client # [ 2.225771] systemd-modules-load[74]: Inserted module 'virtio_gpu'1910client # [ 2.232361] systemd-modules-load[74]: Module 'virtio_rng' is built in1911worker1 # [ 2.257517] systemd-udevd[79]: Using default interface naming scheme 'v261'.1912client # [ 2.240393] systemd[1]: Starting Create System Files and Directories...1913lb # [ 2.221911] systemd[1]: Started Journal Service.1914worker2 # [ 2.275468] systemd[1]: Finished Create System Files and Directories.1915worker1 # [ 2.269248] systemd[1]: Finished Create System Files and Directories.1916lb # [ 2.219489] systemd-modules-load[74]: Inserted module 'dm_mod'1917lb # [ 2.220934] systemd-modules-load[74]: Module 'virtio_balloon' is built in1918lb # [ 2.222004] systemd-modules-load[74]: Module 'virtio_console' is built in1919lb # [ 2.223102] systemd-modules-load[74]: Inserted module 'virtio_gpu'1920worker2 # [ 2.293237] systemd[1]: Started Rule-based Manager for Device Events and Files.1921lb # [ 2.236604] systemd-modules-load[74]: Module 'virtio_rng' is built in1922lb # [ 2.238910] systemd[1]: Starting Create System Files and Directories...1923worker1 # [ 2.292770] systemd[1]: Started Rule-based Manager for Device Events and Files.1924lb # [ 2.244465] systemd[1]: Finished Apply Kernel Variables.1925client # [ 2.281555] systemd-udevd[81]: Using default interface naming scheme 'v261'.1926client # [ 2.288997] systemd[1]: Finished Create System Files and Directories.1927lb # [ 2.266795] systemd[1]: Finished Create System Files and Directories.1928lb # [ 2.273591] systemd-udevd[79]: Using default interface naming scheme 'v261'.1929client # [ 2.313561] systemd[1]: Started Rule-based Manager for Device Events and Files.1930worker2 # [ 2.356913] systemd[1]: Starting Virtual Console Setup...1931worker1 # [ 2.352661] systemd[1]: Starting Virtual Console Setup...1932lb # [ 2.302923] systemd[1]: Started Rule-based Manager for Device Events and Files.1933worker2 # [ 2.412575] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1934client # [ 2.380141] systemd[1]: Starting Virtual Console Setup...1935worker2 # [ 2.416381] systemd[1]: Finished Virtual Console Setup.1936worker1 # [ 2.408616] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1937worker1 # [ 2.412320] systemd[1]: Finished Virtual Console Setup.1938lb # [ 2.368813] systemd[1]: Starting Virtual Console Setup...1939client # [ 2.428566] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940client # [ 2.432293] systemd[1]: Finished Virtual Console Setup.1941lb # [ 2.420612] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1942lb # [ 2.424427] systemd[1]: Finished Virtual Console Setup.1943worker1 # [ 3.003151] systemd[1]: Finished Coldplug All udev Devices.1944worker1 # [ 3.004234] systemd[1]: Reached target System Initialization.1945worker1 # [ 3.005313] systemd[1]: Reached target Basic System.1946worker2 # [ 3.042865] systemd[1]: Finished Coldplug All udev Devices.1947worker2 # [ 3.043964] systemd[1]: Reached target System Initialization.1948worker2 # [ 3.044886] systemd[1]: Reached target Basic System.1949client # [ 3.034356] systemd[1]: Finished Coldplug All udev Devices.1950client # [ 3.035369] systemd[1]: Reached target System Initialization.1951client # [ 3.036874] systemd[1]: Reached target Basic System.1952lb # [ 3.017390] systemd[1]: Finished Coldplug All udev Devices.1953lb # [ 3.018378] systemd[1]: Reached target System Initialization.1954lb # [ 3.019203] systemd[1]: Reached target Basic System.1955worker1 # [ 3.166980] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1956worker2 # [ 3.196451] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1957worker1 # [ 3.184112] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1958worker1 # [ 3.191052] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1959worker2 # [ 3.231915] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1960worker2 # [ 3.240413] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1961client # [ 3.219346] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1962lb # [ 3.186946] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1963client # [ 3.230537] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1964worker1 # [ 3.253008] systemd[1]: Found device /dev/disk/by-label/nixos.1965worker1 # [ 3.256194] systemd[1]: Reached target Initrd Root Device.1966client # [ 3.236740] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1967worker1 # [ 3.259793] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1968lb # [ 3.208497] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line.1969lb # [ 3.213054] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1970worker2 # [ 3.325286] systemd[1]: Found device /dev/disk/by-label/nixos.1971worker2 # [ 3.327846] systemd[1]: Reached target Initrd Root Device.1972client # [ 3.301064] systemd[1]: Found device /dev/disk/by-label/nixos.1973worker1 # [ 3.320800] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1974worker2 # [ 3.336073] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1975worker1 # [ 3.326740] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1976client # [ 3.308563] systemd[1]: Reached target Initrd Root Device.1977lb # [ 3.278639] systemd[1]: Found device /dev/disk/by-label/nixos.1978client # [ 3.315503] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1979lb # [ 3.284306] systemd[1]: Reached target Initrd Root Device.1980worker1 # [ 3.338243] systemd[1]: Mounting /sysroot...1981lb # [ 3.290984] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1982worker2 # [ 3.375896] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1983worker2 # [ 3.384126] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1984worker2 # [ 3.386121] systemd[1]: Mounting /sysroot...1985worker1 # [ 3.389808] EXT4-fs (vda): mounted filesystem bcf37906-84d4-41b2-a3ef-a9ed2a544dc9 r/w with ordered data mode. Quota mode: none.1986worker1 # [ 3.379459] systemd[1]: Mounted /sysroot.1987worker1 # [ 3.383060] systemd[1]: Reached target Initrd Root File System.1988worker1 # [ 3.387632] systemd[1]: Starting Mountpoints Configured in the Real Root...1989client # [ 3.369101] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1990client # [ 3.378114] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1991lb # [ 3.349349] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1992client # [ 3.384344] systemd[1]: Mounting /sysroot...1993lb # [ 3.356315] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1994worker2 # [ 3.443132] EXT4-fs (vda): mounted filesystem dff3dfd2-8e23-4bb4-beb3-ac610f1e9ecb r/w with ordered data mode. Quota mode: none.1995worker1 # [ 3.417033] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload.1996lb # [ 3.365838] systemd[1]: Mounting /sysroot...1997worker2 # [ 3.433811] systemd[1]: Mounted /sysroot.1998worker2 # [ 3.436071] systemd[1]: Reached target Initrd Root File System.1999worker1 # [ 3.424980] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)...2000worker2 # [ 3.441766] systemd[1]: Starting Mountpoints Configured in the Real Root...
loading 1,129 hidden lines…
3130worker2 # [ 12.505018] systemd[1]: Stopping Host and Network Name Lookups...3131worker2 # [ 12.511137] systemd[1]: Stopped target User and Group Name Lookups.3132client # [ 12.486359] systemd[1]: Condition check resulted in Virtio network device being skipped.3133worker2 # [ 12.523333] systemd[1]: Stopping User and Group Name Lookups...3134worker2 # [ 12.526493] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3135worker2 # [ 12.533050] systemd[1]: nscd.service: Deactivated successfully.3136worker2 # [ 12.541467] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3137worker2 # [ 12.542376] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3138worker1 # [ 12.528801] systemd[1]: linger-users.service: Deactivated successfully.3139worker1 # [ 12.530967] systemd[1]: Finished linger-users.service.3140worker1 # [ 12.536580] (udev-worker)[383]: Network interface NamePolicy= disabled on kernel command line.3141worker2 # [ 12.572636] systemd[1]: linger-users.service: Deactivated successfully.3142worker1 # [ 12.558248] systemd[1]: Started Name Service Cache Daemon (nsncd).3143worker1 # [ 12.559209] systemd[1]: Reached target Host and Network Name Lookups.3144worker2 # [ 12.578667] systemd[1]: Finished linger-users.service.3145worker1 # [ 12.563285] systemd[1]: Reached target User and Group Name Lookups.3146client # [ 12.550810] nsncd[499]: Sep 20 12:47:42.065 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3147worker1 # [ 12.567289] nsncd[570]: Sep 20 12:47:42.074 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3148worker1 # [ 12.574925] (udev-worker)[384]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3149client # [ 12.560695] systemd[1]: Started Name Service Cache Daemon (nsncd).3150worker1 # [ 12.581250] (udev-worker)[384]: Network interface NamePolicy= disabled on kernel command line.3151client # [ 12.562607] systemd[1]: Reached target Host and Network Name Lookups.3152client # [ 12.563477] systemd[1]: Reached target User and Group Name Lookups.3153client # [ 12.574692] systemd[1]: Finished resolvconf update.3154client # [ 12.585947] systemd[1]: Starting DHCP Client...3155worker2 # [ 12.627757] systemd[1]: Started Name Service Cache Daemon (nsncd).3156worker1 # [ 12.614698] systemd[1]: Finished resolvconf update.3157worker1 # [ 12.615542] systemd[1]: Reached target Preparation for Network.3158worker2 # [ 12.631369] systemd[1]: Reached target Host and Network Name Lookups.3159worker1 # [ 12.621937] systemd[1]: Starting DHCP Client...3160worker2 # [ 12.635664] nsncd[569]: Sep 20 12:47:42.143 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3161worker1 # [ 12.625140] systemd[1]: Starting Extra networking commands....3162worker2 # [ 12.641151] systemd[1]: Reached target User and Group Name Lookups.3163worker2 # [ 12.658028] (udev-worker)[385]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3164lb # [ 12.601472] postgresql-pre-start[679]: The files belonging to this database system will be owned by user "postgres".3165worker2 # [ 12.672434] systemd[1]: Finished resolvconf update.3166lb # [ 12.604825] postgresql-pre-start[679]: This user must also own the server process.3167worker2 # [ 12.673250] systemd[1]: Reached target Preparation for Network.3168worker2 # [ 12.679638] systemd[1]: Starting DHCP Client...3169client # [ 12.661087] mousedev: PS/2 mouse device common for all mice3170worker2 # [ 12.683490] (udev-worker)[382]: Network interface NamePolicy= disabled on kernel command line.3171lb # [ 12.617857] postgresql-pre-start[679]: The database cluster will be initialized with locale "en_US.UTF-8".3172worker2 # [ 12.686740] systemd[1]: Starting Extra networking commands....3173lb # [ 12.619373] postgresql-pre-start[679]: The default database encoding has accordingly been set to "UTF8".3174lb # [ 12.621611] postgresql-pre-start[679]: The default text search configuration will be set to "english".3175lb # [ 12.623361] postgresql-pre-start[679]: Data page checksums are enabled.3176lb # [ 12.625154] postgresql-pre-start[679]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3177worker2 # [ 12.692937] (udev-worker)[385]: Network interface NamePolicy= disabled on kernel command line.3178lb # [ 12.627737] postgresql-pre-start[679]: creating subdirectories ... ok3179lb # [ 12.630196] postgresql-pre-start[679]: selecting dynamic shared memory implementation ... posix3180worker1 # [ 12.830616] systemd-logind[522]: Watching system buttons on /dev/input/event0 (gpio-keys)3181client # [ 12.814140] dhcpcd[533]: dhcpcd-10.3.2 starting3182client # [ 12.832584] dhcpcd[543]: dev: loaded udev3183worker1 # [ 12.866383] dhcpcd[606]: dhcpcd-10.3.2 starting3184worker2 # [ 12.886042] systemd-logind[510]: Watching system buttons on /dev/input/event0 (gpio-keys)3185client # [ 12.856870] systemd[1]: Finished nftables firewall.3186client # [ 12.861417] systemd[1]: Reached target Preparation for Network.3187worker1 # [ 12.882782] dhcpcd[644]: dev: loaded udev3188lb # [ 12.833010] postgresql-pre-start[679]: selecting default "max_connections" ... 1003189client # [ 12.867567] systemd[1]: Starting Address configuration of eth1...3190client # [ 12.881950] systemd[1]: Starting Extra networking commands....3191client # [ 12.888380] systemd-logind[429]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3192worker2 # [ 12.924452] dhcpcd[603]: dhcpcd-10.3.2 starting3193client # [ 12.906156] 8021q: 802.1Q VLAN Support v1.83194worker1 # [ 12.935638] 8021q: 802.1Q VLAN Support v1.83195worker1 # [ 12.926462] systemd[1]: Condition check resulted in Virtio network device being skipped.3196worker2 # [ 12.942248] dhcpcd[638]: dev: loaded udev3197worker1 # [ 12.934486] systemd[1]: Starting Address configuration of eth1...3198worker2 # [ 12.979170] systemd[1]: Condition check resulted in Virtio network device being skipped.3199worker1 # [ 12.968489] systemd[1]: Finished Extra networking commands..3200worker2 # [ 12.983988] systemd[1]: Starting Address configuration of eth1...3201worker1 # [ 12.973738] systemd[1]: Reached target Network.3202worker2 # [ 13.004101] 8021q: 802.1Q VLAN Support v1.83203worker1 # [ 12.981050] systemd[1]: Starting Permit User Sessions...3204worker1 # [ 13.031143] cfg80211: Loading compiled-in X.509 certificates for regulatory database3205worker2 # [ 13.033022] systemd[1]: Finished Extra networking commands..3206worker2 # [ 13.033950] systemd[1]: Reached target Network.3207worker2 # [ 13.040436] systemd[1]: Starting Permit User Sessions...3208client # [ 13.032154] cfg80211: Loading compiled-in X.509 certificates for regulatory database3209client # [ 13.044930] 8021q: adding VLAN 0 to HW filter on device eth13210worker1 # [ 13.067903] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3211worker1 # [ 13.070681] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3212worker1 # [ 13.075322] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23213worker1 # [ 13.075662] cfg80211: failed to load regulatory.db3214worker2 # [ 13.105240] cfg80211: Loading compiled-in X.509 certificates for regulatory database3215lb # [ 13.027239] postgresql-pre-start[679]: selecting default "shared_buffers" ... 128MB3216client # [ 13.063625] network-addresses-eth1-start[547]: adding address 192.168.1.1/24... done3217worker1 # [ 13.083613] systemd[1]: Finished Permit User Sessions.3218worker1 # [ 13.088670] systemd[1]: Started Getty on tty1.3219worker1 # [ 13.089392] systemd[1]: Reached target Login Prompts.3220client # [ 13.090262] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3221client # [ 13.092815] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3222client # [ 13.098284] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23223client # [ 13.098696] cfg80211: failed to load regulatory.db3224client # [ 13.093855] network-addresses-eth1-start[547]: adding address 2001:db8:1::1/64... done3225worker2 # [ 13.144563] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3226worker2 # [ 13.145098] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3227worker2 # [ 13.132298] systemd[1]: Finished Permit User Sessions.3228worker2 # [ 13.151619] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23229worker1 # [ 13.139201] 8021q: adding VLAN 0 to HW filter on device eth13230worker2 # [ 13.153263] cfg80211: failed to load regulatory.db3231worker2 # [ 13.146926] systemd[1]: Started Getty on tty1.3232worker2 # [ 13.147729] systemd[1]: Reached target Login Prompts.3233client # [ 13.132182] systemd[1]: Finished Address configuration of eth1.3234worker1 # [ 13.153075] network-addresses-eth1-start[657]: adding address 192.168.1.3/24... done3235worker2 # [ 13.195870] 8021q: adding VLAN 0 to HW filter on device eth13236worker1 # [ 13.171467] network-addresses-eth1-start[657]: adding address 2001:db8:1::3/64... done3237worker1 # [ 13.193408] 8021q: adding VLAN 0 to HW filter on device eth03238worker1 # [ 13.180127] dhcpcd[644]: eth0: waiting for carrier3239worker1 # [ 13.184498] dhcpcd[644]: eth0: waiting for carrier3240worker1 # [ 13.187828] dhcpcd[644]: eth0: carrier acquired3241worker2 # [ 13.210564] network-addresses-eth1-start[652]: adding address 192.168.1.4/24... done3242worker1 # [ 13.202403] systemd[1]: Finished Address configuration of eth1.3243client # [ 13.189141] dhcpcd[603]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (551) - Operation not permitted3244worker1 # [ 13.210349] dhcpcd[644]: DUID 00:01:00:01:32:42:92:6e:52:54:00:12:34:563245client # [ 13.191078] dhcpcd[603]: .resolvconf-wrapped: clearing stale lock pid 5513246worker1 # [ 13.211374] dhcpcd[644]: eth0: IAID 00:12:34:563247worker1 # [ 13.212004] dhcpcd[644]: eth0: adding address fe80::5054:ff:fe12:34563248worker2 # [ 13.231194] network-addresses-eth1-start[652]: adding address 2001:db8:1::4/64... done3249lb # [ 13.187763] systemd[1]: Starting Virtual Console Setup...3250worker2 # [ 13.272219] 8021q: adding VLAN 0 to HW filter on device eth03251worker2 # [ 13.255855] systemd[1]: Finished Address configuration of eth1.3252worker2 # [ 13.261565] dhcpcd[638]: eth0: waiting for carrier3253worker2 # [ 13.264885] dhcpcd[638]: eth0: waiting for carrier3254worker2 # [ 13.267055] dhcpcd[638]: eth0: carrier acquired3255client # [ 13.254956] 8021q: adding VLAN 0 to HW filter on device eth03256client # [ 13.243703] dhcpcd[543]: eth0: waiting for carrier3257client # [ 13.247602] dhcpcd[543]: libudev: received NULL device3258client # [ 13.250265] dhcpcd[543]: libudev: received NULL device3259worker2 # [ 13.284941] dhcpcd[638]: DUID 00:01:00:01:32:42:92:6e:52:54:00:12:34:563260lb # [ 13.218206] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3261worker2 # [ 13.285947] dhcpcd[638]: eth0: IAID 00:12:34:563262worker2 # [ 13.286605] dhcpcd[638]: eth0: adding address fe80::5054:ff:fe12:34563263client # [ 13.254084] dhcpcd[543]: eth0: carrier acquired3264lb # [ 13.225097] systemd[1]: Stopped Virtual Console Setup.3265client # [ 13.261200] systemd[1]: Finished Extra networking commands..3266client # [ 13.264624] systemd[1]: Reached target Network.3267worker1 # [ 13.300375] mousedev: PS/2 mouse device common for all mice3268client # [ 13.271290] systemd[1]: Starting Permit User Sessions...3269lb # [ 13.241594] systemd[1]: Starting Virtual Console Setup...3270client # [ 13.274665] dhcpcd[543]: DUID 00:01:00:01:32:42:92:6e:52:54:00:12:34:563271client # [ 13.280727] dhcpcd[543]: eth0: IAID 00:12:34:563272client # [ 13.281507] dhcpcd[543]: eth0: adding address fe80::5054:ff:fe12:34563273lb # [ 13.257125] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs3274worker2 # [ 13.344052] mousedev: PS/2 mouse device common for all mice3275client # [ 13.328368] systemd[1]: Finished Permit User Sessions.3276client # [ 13.338763] systemd[1]: Started Getty on tty1.3277client # [ 13.343100] systemd[1]: Reached target Login Prompts.3278worker1 # [ 13.402107] systemd-logind[522]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3279client: (finished: waiting for unit network-addresses-eth1.service, in 13.84 seconds)3280worker2 # [ 13.452744] systemd-logind[510]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3281client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3282client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3283lb: waiting for unit network-addresses-eth1.service3284lb: waiting for the VM to finish booting3285lb # [ 13.485619] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.3286worker1 # [ 13.593958] dhcpcd[644]: eth0: soliciting a DHCP lease3287lb # [ 13.537688] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.3288lb # [ 13.546269] systemd[1]: Started backdoor.service.3289worker1 # [ 13.600636] dhcpcd[644]: eth0: offered 10.0.2.15 from 10.0.2.23290worker1 # [ 13.608266] dhcpcd[644]: eth0: probing address 10.0.2.15/243291lb # [ 13.636141] 8021q: 802.1Q VLAN Support v1.83292lb # connecting to host...3293lb: Guest shell says: b'Spawning backdoor root shell...\n'3294lb: connected to guest root shell3295lb: (connecting took 0.25 seconds)3296lb: (finished: waiting for the VM to finish booting, in 0.25 seconds)3297lb # [ 13.729680] (udev-worker)[696]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3298lb # [ 13.731827] (udev-worker)[696]: Network interface NamePolicy= disabled on kernel command line.3299lb # [ 13.793377] cfg80211: Loading compiled-in X.509 certificates for regulatory database3300lb # [ 13.819550] (udev-worker)[690]: Network interface NamePolicy= disabled on kernel command line.3301lb # [ 13.843915] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3302lb # [ 13.844429] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3303lb # [ 13.849362] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23304lb # [ 13.849767] cfg80211: failed to load regulatory.db3305lb # [ 13.843714] systemd-vconsole-setup[706]: Configuration of first virtual console was skipped, ignoring remaining ones.3306lb # [ 13.870559] systemd[1]: Finished Virtual Console Setup.3307client # [ 14.000345] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33308worker1 # [ 14.027725] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33309lb # [ 14.032546] systemd[1]: Condition check resulted in Virtio network device being skipped.3310lb # [ 14.039556] systemd[1]: Starting Address configuration of eth1...3311worker2 # [ 14.179903] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33312lb # [ 14.171204] 8021q: adding VLAN 0 to HW filter on device eth13313lb # [ 14.180281] network-addresses-eth1-start[734]: adding address 192.168.1.2/24... done3314lb # [ 14.203347] 8021q: adding VLAN 0 to HW filter on device eth03315lb # [ 14.189570] dhcpcd[651]: eth0: waiting for carrier3316lb # [ 14.192786] dhcpcd[651]: eth0: carrier acquired3317lb # [ 14.204148] network-addresses-eth1-start[734]: adding address 2001:db8:1::2/64... done3318lb # [ 14.213904] dhcpcd[651]: DUID 00:01:00:01:32:42:92:6f:52:54:00:12:34:563319lb # [ 14.216558] dhcpcd[651]: eth0: IAID 00:12:34:563320lb # [ 14.218997] dhcpcd[651]: eth0: adding address fe80::5054:ff:fe12:34563321lb # [ 14.235689] systemd[1]: Finished Address configuration of eth1.3322worker1 # [ 14.318341] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3323lb # [ 14.273048] systemd-logind[513]: Watching system buttons on /dev/input/event0 (gpio-keys)3324client # [ 14.314930] systemd[1]: Starting Virtual Console Setup...3325worker1 # [ 14.347270] systemd[1]: Starting Virtual Console Setup...3326client # [ 14.356400] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3327worker1 # [ 14.375734] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3328worker1 # [ 14.379980] systemd[1]: Stopped Virtual Console Setup.3329client # [ 14.362052] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3330worker1 # [ 14.383513] systemd[1]: Starting Virtual Console Setup...3331client # [ 14.365985] systemd[1]: Stopped Virtual Console Setup.3332lb # [ 14.362556] mousedev: PS/2 mouse device common for all mice3333client # [ 14.381336] systemd[1]: Starting Virtual Console Setup...3334worker1 # [ 14.426546] systemd-logind[522]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3335client # [ 14.423709] systemd-logind[429]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3336worker2 # [ 14.489312] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3337worker2 # [ 14.504450] systemd[1]: Starting Virtual Console Setup...3338worker2 # [ 14.523492] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3339worker2 # [ 14.526116] systemd[1]: Stopped Virtual Console Setup.3340worker2 # [ 14.529940] systemd[1]: Starting Virtual Console Setup...3341worker2 # [ 14.587027] systemd-logind[510]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3342lb # [ 14.519262] systemd-logind[513]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3343worker1 # [ 14.593024] dhcpcd[644]: eth0: soliciting an IPv6 router3344worker1 # [ 14.594400] dhcpcd[644]: eth0: Router Advertisement from fe80::23345worker1 # [ 14.595397] dhcpcd[644]: eth0: adding address fec0::5054:ff:fe12:3456/643346worker1 # [ 14.596685] dhcpcd[644]: eth0: adding route to fec0::/643347worker1 # [ 14.597592] dhcpcd[644]: eth0: adding default route via fe80::23348worker2 # [ 14.704144] dhcpcd[638]: eth0: soliciting a DHCP lease3349worker2 # [ 14.708582] dhcpcd[638]: eth0: offered 10.0.2.15 from 10.0.2.23350worker2 # [ 14.716250] dhcpcd[638]: eth0: probing address 10.0.2.15/243351worker1 # [ 14.814847] systemd-vconsole-setup[701]: Configuration of first virtual console was skipped, ignoring remaining ones.3352worker1 # [ 14.819721] systemd[1]: Finished Virtual Console Setup.3353client # [ 14.807590] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones.3354client # [ 14.812255] systemd[1]: Finished Virtual Console Setup.3355lb # [ 14.898281] dhcpcd[651]: eth0: soliciting a DHCP lease3356worker2 # [ 14.966686] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones.3357worker2 # [ 14.972247] dhcpcd[638]: eth0: soliciting an IPv6 router3358worker2 # [ 14.973076] systemd[1]: Finished Virtual Console Setup.3359worker2 # [ 14.973842] dhcpcd[638]: eth0: Router Advertisement from fe80::23360lb # [ 14.907160] dhcpcd[651]: eth0: offered 10.0.2.15 from 10.0.2.23361worker2 # [ 14.974674] dhcpcd[638]: eth0: adding address fec0::5054:ff:fe12:3456/643362worker2 # [ 14.975576] dhcpcd[638]: eth0: adding route to fec0::/643363worker2 # [ 14.976380] dhcpcd[638]: eth0: adding default route via fe80::23364lb # [ 14.916210] dhcpcd[651]: eth0: probing address 10.0.2.15/243365lb: (finished: waiting for unit network-addresses-eth1.service, in 1.60 seconds)3366lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3367lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.07 seconds)3368worker1: waiting for unit network-addresses-eth1.service3369worker1: waiting for the VM to finish booting3370worker1: Guest shell says: b'Spawning backdoor root shell...\n'3371worker1: connected to guest root shell3372worker1: (connecting took 0.00 seconds)3373worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3374client # [ 15.236756] dhcpcd[543]: eth0: soliciting a DHCP lease3375client # [ 15.241253] dhcpcd[543]: eth0: offered 10.0.2.15 from 10.0.2.23376worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3377worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3378client # [ 15.248566] dhcpcd[543]: eth0: probing address 10.0.2.15/243379worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3380worker2: waiting for unit network-addresses-eth1.service3381worker2: waiting for the VM to finish booting3382worker2: Guest shell says: b'Spawning backdoor root shell...\n'3383worker2: connected to guest root shell3384worker2: (connecting took 0.00 seconds)3385worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3386worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3387worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3388client # [ 15.409286] dhcpcd[543]: eth0: soliciting an IPv6 router3389client # [ 15.413170] dhcpcd[543]: eth0: Router Advertisement from fe80::23390client # [ 15.415685] dhcpcd[543]: eth0: adding address fec0::5054:ff:fe12:3456/643391client # [ 15.418589] dhcpcd[543]: eth0: adding route to fec0::/643392client # [ 15.420891] dhcpcd[543]: eth0: adding default route via fe80::23393worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3394lb: waiting for unit niks3.service3395lb # [ 16.048932] postgresql-pre-start[679]: selecting default time zone ... UTC3396lb # [ 16.053363] postgresql-pre-start[679]: creating configuration files ... ok3397lb # [ 16.365026] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3398lb # [ 16.375940] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3399lb # [ 16.383846] systemd[1]: Stopped Virtual Console Setup.3400lb # [ 16.384803] systemd[1]: Stopping Virtual Console Setup...3401lb # [ 16.391862] systemd[1]: Starting Virtual Console Setup...3402lb # [ 16.482829] systemd-logind[513]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3403lb # [ 16.492877] dhcpcd[651]: eth0: soliciting an IPv6 router3404lb # [ 16.494253] dhcpcd[651]: eth0: Router Advertisement from fe80::23405lb # [ 16.496151] dhcpcd[651]: eth0: adding address fec0::5054:ff:fe12:3456/643406lb # [ 16.500161] dhcpcd[651]: eth0: adding route to fec0::/643407lb # [ 16.500927] dhcpcd[651]: eth0: adding default route via fe80::23408lb # [ 16.605710] postgresql-pre-start[679]: running bootstrap script ... ok3409lb # [ 16.865747] systemd-vconsole-setup[787]: Configuration of first virtual console was skipped, ignoring remaining ones.3410lb # [ 16.877675] systemd[1]: Finished Virtual Console Setup.3411lb # [ 17.297246] postgresql-pre-start[679]: performing post-bootstrap initialization ... ok3412lb # [ 17.461616] postgresql-pre-start[679]: syncing data to disk ... ok3413lb # [ 17.463801] postgresql-pre-start[679]: initdb: warning: enabling "trust" authentication for local connections3414lb # [ 17.465408] postgresql-pre-start[679]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3415lb # [ 17.467559] postgresql-pre-start[679]: Success. You can now start the database server using:3416lb # [ 17.468963] postgresql-pre-start[679]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3417lb # [ 17.594487] postgres[805]: [805] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3418lb # [ 17.598742] postgres[805]: [805] LOG: listening on IPv6 address "::1", port 54323419lb # [ 17.599964] postgres[805]: [805] LOG: listening on IPv4 address "127.0.0.1", port 54323420lb # [ 17.603309] postgres[805]: [805] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3421lb # [ 17.616433] postgres[814]: [814] LOG: database system was shut down at 2026-09-20 12:47:46 GMT3422lb # [ 17.622793] postgres[805]: [805] LOG: database system is ready to accept connections3423lb # [ 17.628158] systemd[1]: Started PostgreSQL Server.3424lb # [ 17.637244] systemd[1]: Starting PostgreSQL Setup Scripts...3425lb # [ 17.889890] postgresql-setup-start[834]: CREATE DATABASE3426lb # [ 17.944944] postgresql-setup-start[839]: CREATE ROLE3427lb # [ 17.969814] postgresql-setup-start[841]: ALTER DATABASE3428lb # [ 17.976581] systemd[1]: Finished PostgreSQL Setup Scripts.3429lb # [ 17.978651] systemd[1]: Reached target PostgreSQL.3430worker1 # [ 18.315238] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds3431worker1 # [ 18.318857] dhcpcd[644]: eth0: adding route to 10.0.2.0/243432worker1 # [ 18.322423] dhcpcd[644]: eth0: adding default route via 10.0.2.23433worker1 # [ 18.485382] systemd[1]: Started DHCP Client.3434worker1 # [ 18.487301] systemd[1]: Reached target Multi-User System.3435worker1 # [ 18.488654] systemd[1]: Startup finished in 1.057s (kernel) + 5.543s (initrd) + 11.886s (userspace) = 18.487s.3436worker2 # [ 19.933320] dhcpcd[638]: eth0: leased 10.0.2.15 for 86400 seconds3437worker2 # [ 19.937542] dhcpcd[638]: eth0: adding route to 10.0.2.0/243438worker2 # [ 19.939917] dhcpcd[638]: eth0: adding default route via 10.0.2.23439lb # [ 20.022433] dhcpcd[651]: eth0: leased 10.0.2.15 for 86400 seconds3440lb # [ 20.022618] dhcpcd[651]: eth0: adding route to 10.0.2.0/243441lb # [ 20.022675] dhcpcd[651]: eth0: adding default route via 10.0.2.23442worker2 # [ 20.097239] systemd[1]: Started DHCP Client.3443worker2 # [ 20.099018] systemd[1]: Reached target Multi-User System.3444worker2 # [ 20.099814] systemd[1]: Startup finished in 1.059s (kernel) + 5.557s (initrd) + 13.481s (userspace) = 20.098s.3445lb # [ 20.151071] systemd[1]: Started DHCP Client.3446lb # [ 20.153160] systemd[1]: Reached target Network is Online.3447lb # [ 20.158131] systemd[1]: Started Envoy reverse proxy.3448lb # [ 20.164629] systemd[1]: Started mock-oidc.service.3449lb # [ 20.266879] mock-oidc-server[923]: Mock OIDC Server running3450lb # [ 20.268133] mock-oidc-server[923]: OIDC Address: 192.168.1.2:80803451lb # [ 20.269820] mock-oidc-server[923]: Issue Address: 0.0.0.0:80813452lb # [ 20.270977] mock-oidc-server[923]: Issuer: http://192.168.1.2:8080/oidc3453lb # [ 20.272735] mock-oidc-server[923]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3454lb # [ 20.274238] mock-oidc-server[923]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3455lb # [ 20.275559] mock-oidc-server[923]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3456client # [ 20.622336] dhcpcd[543]: eth0: leased 10.0.2.15 for 86400 seconds3457client # [ 20.625545] dhcpcd[543]: eth0: adding route to 10.0.2.0/243458client # [ 20.625707] dhcpcd[543]: eth0: adding default route via 10.0.2.23459client # [ 20.786519] systemd[1]: Started DHCP Client.3460client # [ 20.791312] systemd[1]: Reached target Multi-User System.3461client # [ 20.792436] systemd[1]: Startup finished in 1.062s (kernel) + 5.613s (initrd) + 14.114s (userspace) = 20.790s.3462lb # [ 20.845003] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3463lb # [ 20.846932] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:469] statically linked extensions:3464lb # [ 20.848537] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3465lb # [ 20.850843] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3466lb # [ 20.869349] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3467lb # [ 20.874184] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3468lb # [ 20.877941] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3469lb # [ 20.881809] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3470lb # [ 20.883951] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83471lb # [ 20.887126] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3472lb # [ 20.890349] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3473lb # [ 20.921740] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3474lb # [ 20.924610] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3475lb # [ 20.932066] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3476lb # [ 20.934153] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3477lb # [ 20.937203] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3478lb # [ 20.939062] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3479lb # [ 20.942455] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3480lb # [ 20.949192] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3481lb # [ 20.951975] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3482lb # [ 20.959949] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3483lb # [ 20.964126] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3484lb # [ 20.966068] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3485lb # [ 20.971589] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3486lb # [ 20.974357] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3487lb # [ 20.976873] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3488lb # [ 20.979206] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3489lb # [ 20.984212] envoy[922]: [2026-09-20 12:47:50.349][922][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3490lb # [ 20.985943] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3491lb # [ 20.987673] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3492lb # [ 20.991042] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3493lb # [ 20.994374] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3494lb # [ 20.996500] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3495lb # [ 21.005072] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3496lb # [ 21.011442] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3497lb # [ 21.013567] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3498lb # [ 21.020701] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3499lb # [ 21.023180] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3500lb # [ 21.026731] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23501lb # [ 21.030236] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3502lb # [ 21.037533] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3503lb # [ 21.042743] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3504lb # [ 21.046331] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3505lb # [ 21.048861] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3506lb # [ 21.051633] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3507lb # [ 21.055066] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3508lb # [ 21.057596] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3509lb # [ 21.063387] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3510lb # [ 21.074440] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3511lb # [ 21.077520] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3512lb # [ 21.079916] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3513lb # [ 21.083802] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3514lb # [ 21.087186] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3515lb # [ 21.092136] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3516lb # [ 21.095023] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3517lb # [ 21.102123] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3518lb # [ 21.107082] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3519lb # [ 21.110650] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3520lb # [ 21.115210] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3521lb # [ 21.118065] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3522lb # [ 21.122506] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3523lb # [ 21.127635] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3524lb # [ 21.130404] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3525lb # [ 21.132526] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3526lb # [ 21.138161] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3527lb # [ 21.141077] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3528lb # [ 21.142878] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3529lb # [ 21.145276] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3530lb # [ 21.148942] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3531lb # [ 21.150999] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3532lb # [ 21.153972] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3533lb # [ 21.158062] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3534lb # [ 21.160229] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3535lb # [ 21.162589] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3536lb # [ 21.165532] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3537lb # [ 21.168172] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3538lb # [ 21.174302] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3539lb # [ 21.176663] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3540lb # [ 21.178557] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3541lb # [ 21.182432] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3542lb # [ 21.187336] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3543lb # [ 21.190340] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3544lb # [ 21.193138] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3545lb # [ 21.206967] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23546lb # [ 21.208902] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3547lb # [ 21.211701] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3548lb # [ 21.214288] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3549lb # [ 21.219008] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23550lb # [ 21.224568] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13551lb # [ 21.227596] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3552lb # [ 21.234935] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3553lb # [ 21.238720] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3554lb # [ 21.241778] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3555lb # [ 21.244860] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3556lb # [ 21.247788] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3557lb # [ 21.252638] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3558lb # [ 21.254816] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3559lb # [ 21.258969] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3560lb # [ 21.262171] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3561lb # [ 21.265082] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3562lb # [ 21.268569] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3563lb # [ 21.281302] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3564lb # [ 21.283564] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3565lb # [ 21.287057] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3566lb # [ 21.290461] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3567lb # [ 21.295195] envoy[922]: [2026-09-20 12:47:50.350][922][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3568lb # [ 21.300464] envoy[922]: [2026-09-20 12:47:50.372][922][info][main] [source/server/server.cc:531] HTTP header map info:3569lb # [ 21.301794] envoy[922]: [2026-09-20 12:47:50.374][922][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3570lb # [ 21.319615] envoy[922]: [2026-09-20 12:47:50.374][922][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3571lb # [ 21.322694] envoy[922]: [2026-09-20 12:47:50.374][922][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3572lb # [ 21.332983] envoy[922]: [2026-09-20 12:47:50.374][922][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3573lb # [ 21.335699] envoy[922]: [2026-09-20 12:47:50.607][922][info][main] [source/server/server.cc:968] runtime: {}3574lb # [ 21.337481] envoy[922]: [2026-09-20 12:47:50.620][922][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3575lb # [ 21.339389] envoy[922]: [2026-09-20 12:47:50.620][922][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013576lb # [ 21.341347] envoy[922]: [2026-09-20 12:47:50.620][922][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013577lb # [ 21.343193] envoy[922]: [2026-09-20 12:47:50.627][922][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3578lb # [ 21.345665] envoy[922]: [2026-09-20 12:47:50.627][922][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3579lb # [ 21.347526] envoy[922]: [2026-09-20 12:47:50.627][922][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3580lb # [ 21.356827] envoy[922]: [2026-09-20 12:47:50.862][922][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3581worker2 # [ 21.427687] systemd[1]: Reached target Network is Online.3582worker1 # [ 21.418652] systemd[1]: Starting Nix worker-protocol over gRPC...3583worker2 # [ 21.439452] systemd[1]: Starting scheduler-token.service...3584lb # [ 21.371212] envoy[922]: [2026-09-20 12:47:50.877][922][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3585lb # [ 21.376238] envoy[922]: [2026-09-20 12:47:50.879][922][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3586lb # [ 21.379310] envoy[922]: [2026-09-20 12:47:50.879][922][info][main] [source/server/server.cc:1077] starting main dispatch loop3587worker2 # [ 21.565470] systemd[1]: scheduler-token.service: Deactivated successfully.3588worker2 # [ 21.572248] systemd[1]: Finished scheduler-token.service.3589worker2 # [ 21.574111] systemd[1]: scheduler-token.service: Consumed 54ms CPU time over 129ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3590worker2 # [ 21.584200] systemd[1]: Starting Nix worker-protocol over gRPC...3591worker1 # [ 21.670078] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3592worker1 # [ 21.682112] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3593worker1 # [ 21.684373] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13594worker1 # [ 21.733118] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3595worker1 # [ 21.737387] systemd[1]: Started Nix worker-protocol over gRPC.3596worker1 # [ 21.766025] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3597lb # [ 21.714201] envoy[922]: [2026-09-20 12:47:51.219][922][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3598lb # [ 21.721214] envoy[922]: [2026-09-20 12:47:51.219][922][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3599lb # [ 21.726741] envoy[922]: [2026-09-20 12:47:51.219][922][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3600lb # [ 21.732487] envoy[922]: [2026-09-20 12:47:51.219][922][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3601worker2 # [ 21.815667] nix-grpc-daemon[777]: ts=2026-09-20T12:47:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3602worker2 # [ 21.826464] nix-grpc-daemon[777]: ts=2026-09-20T12:47:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3603worker2 # [ 21.828948] nix-grpc-daemon[777]: ts=2026-09-20T12:47:51Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13604worker2 # [ 21.875993] nix-grpc-daemon[777]: ts=2026-09-20T12:47:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3605worker2 # [ 21.877760] systemd[1]: Started Nix worker-protocol over gRPC.3606worker2 # [ 21.913040] nix-grpc-daemon[777]: ts=2026-09-20T12:47:51Z level=info event=scheduler_connected addr=lb:500513607worker1 # [ 21.927297] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=oidc_jwks provider=mock keys=13608worker1 # [ 21.932197] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:377363609worker1 # [ 21.937700] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03610worker1 # [ 21.966825] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3611worker1 # [ 22.367778] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3612lb # [ 22.615044] envoy[922]: conn peer=[2001:db8:1::3]:42088 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=143613worker1 # [ 23.171840] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_connected addr=lb:500513614worker1 # [ 23.176086] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:377363615worker1 # [ 23.180905] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03616lb # [ 32.628595] rustfs-bucket-start[1033]: mb s3://farm3617lb # [ 32.637811] systemd[1]: Finished rustfs-bucket.service.3618lb # [ 32.654802] systemd[1]: Starting niks3 server...3619lb # [ 32.870198] postgres[1058]: [1058] ERROR: relation "goose_db_version" does not exist at character 363620lb # [ 32.871503] postgres[1058]: [1058] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3621lb # [ 32.907769] niks3-server[1053]: 2026/09/20 12:48:02 OK 20241026095416_initial_model.sql (23.59ms)3622lb # [ 32.911587] niks3-server[1053]: 2026/09/20 12:48:02 OK 20251210153512_drop_unused_gin_index.sql (4.19ms)3623lb # [ 32.918068] niks3-server[1053]: 2026/09/20 12:48:02 OK 20251218171726_add_pins.sql (6.39ms)3624lb # [ 32.923025] niks3-server[1053]: 2026/09/20 12:48:02 OK 20260628120000_add_object_size_and_stats.sql (4.97ms)3625lb # [ 32.928532] niks3-server[1053]: 2026/09/20 12:48:02 OK 20260905000000_add_claims.sql (5.33ms)3626lb # [ 32.930483] niks3-server[1053]: 2026/09/20 12:48:02 goose: successfully migrated database to version: 202609050000003627lb # [ 32.935991] niks3-server[1053]: 2026/09/20 12:48:02 OK 1_commit_pending_closure.sql (7.44ms)3628lb # [ 32.939111] niks3-server[1053]: 2026/09/20 12:48:02 OK 2_object_stats_trigger.sql (2.93ms)3629lb # [ 32.940714] niks3-server[1053]: 2026/09/20 12:48:02 goose: up to current file version: 23630lb # [ 32.944616] niks3-server[1053]: 2026/09/20 12:48:02 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3631lb # [ 32.991118] niks3-server[1053]: 2026/09/20 12:48:02 INFO Read proxy enabled — serving cache objects from S33632lb # [ 32.993589] niks3-server[1053]: 2026/09/20 12:48:02 INFO Using socket-activated listener address=0.0.0.0:57513633lb # [ 32.998135] niks3-server[1053]: 2026/09/20 12:48:02 INFO systemd watchdog enabled interval=15s3634lb # [ 33.002887] systemd[1]: Started niks3 server.3635lb # [ 33.004303] niks3-server[1053]: 2026/09/20 12:48:02 INFO Starting HTTP server address=0.0.0.0:57513636lb # [ 33.005532] systemd[1]: Reached target Multi-User System.3637lb # [ 33.006656] systemd[1]: Startup finished in 1.068s (kernel) + 4.731s (initrd) + 27.204s (userspace) = 33.003s.3638lb: (finished: waiting for unit niks3.service, in 18.40 seconds)3639lb: waiting for TCP port 5751 on localhost3640lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3641lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds)3642lb: waiting for unit envoy.service3643lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3644lb: waiting for TCP port 50051 on localhost3645lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3646lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3647worker2 # [ 34.285155] systemd[1]: Starting scheduler-token.service...3648worker2 # [ 34.377032] systemd[1]: scheduler-token.service: Deactivated successfully.3649worker2 # [ 34.379413] systemd[1]: Finished scheduler-token.service.3650worker2 # [ 34.385103] systemd[1]: scheduler-token.service: Consumed 38ms CPU time over 100ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3651lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3652??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3653 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283654lb: must succeed: curl -sf localhost:9901/clusters3655lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)3656lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)3657lb: waiting until exactly no endpoints of sched are unhealthy3658lb: must succeed: curl -sf localhost:9901/clusters3659lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3660lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 0.05 seconds)3661subtest: both builders hold a WorkerSession on the scheduler, worker2 by OIDC token3662worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics3663worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)3664worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'3665worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds)3666(finished: subtest: both builders hold a WorkerSession on the scheduler, worker2 by OIDC token, in 0.14 seconds)3667subtest: balancer auth: client cert, bearer token, nothing, unknown CN3668worker1 # [ 35.049372] nix-grpc-daemon[775]: ts=2026-09-20T12:48:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:464963669worker1 # [ 35.066057] systemd[1]: Started Nix Daemon.3670worker1 # [ 35.370585] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3671worker1 # [ 35.412606] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 1/5)3672worker1 # [ 35.480825] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 155 ms (attempt 2/5)3673worker1 # [ 35.636617] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 3/5)3674worker1 # [ 35.732915] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 362 ms (attempt 4/5)3675worker1 # [ 36.099246] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3676worker1 # [ 36.125318] nix-grpc-daemon[775]: ts=2026-09-20T12:48:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:464963677worker1 # [ 36.142383] nix-grpc-daemon[775]: ts=2026-09-20T12:48:05Z level=debug event=path_info_miss path=rixsn5f5nyiysml7gkkcnwgvwp0s4kzd-nixos-system-client-test error="error: path '/nix/store/rixsn5f5nyiysml7gkkcnwgvwp0s4kzd-nixos-system-client-test' is required, but there is no substituter that can build it"3678worker2 # [ 36.191714] nix-grpc-daemon[777]: ts=2026-09-20T12:48:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:568223679worker2 # [ 36.207749] systemd[1]: Started Nix Daemon.3680worker2 # [ 36.568109] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3681worker2 # [ 36.596439] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 1/5)3682worker2 # [ 36.611027] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 2/5)3683worker2 # [ 36.664205] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 263 ms (attempt 3/5)3684worker2 # [ 36.927776] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 4/5)3685worker2 # [ 36.990467] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3686worker2 # [ 37.007671] nix-grpc-daemon[777]: ts=2026-09-20T12:48:06Z level=debug event=path_info_miss path=rixsn5f5nyiysml7gkkcnwgvwp0s4kzd-nixos-system-client-test error="error: path '/nix/store/rixsn5f5nyiysml7gkkcnwgvwp0s4kzd-nixos-system-client-test' is required, but there is no substituter that can build it"3687client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3688client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds)3689client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3690client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds)3691worker1 # [ 37.483571] nix-grpc-daemon[775]: ts=2026-09-20T12:48:06Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:464963692worker2 # [ 37.533491] nix-grpc-daemon[777]: ts=2026-09-20T12:48:07Z level=info event=oidc_jwks provider=mock keys=13693worker2 # [ 37.542672] nix-grpc-daemon[777]: ts=2026-09-20T12:48:07Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:568223694worker2 # [ 37.551635] nix-grpc-daemon[777]: ts=2026-09-20T12:48:07Z level=debug event=path_info_miss path=rixsn5f5nyiysml7gkkcnwgvwp0s4kzd-nixos-system-client-test error="error: path '/nix/store/rixsn5f5nyiysml7gkkcnwgvwp0s4kzd-nixos-system-client-test' is required, but there is no substituter that can build it"3695worker2 # [ 37.567783] nix-grpc-daemon[777]: ts=2026-09-20T12:48:07Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:568223696worker2 # [ 37.577766] nix-grpc-daemon[777]: ts=2026-09-20T12:48:07Z level=debug event=path_info_miss path=rixsn5f5nyiysml7gkkcnwgvwp0s4kzd-nixos-system-client-test error="error: path '/nix/store/rixsn5f5nyiysml7gkkcnwgvwp0s4kzd-nixos-system-client-test' is required, but there is no substituter that can build it"3697client: must succeed: rm -r /var/lib/nix-grpc-store3698client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3699worker1 # [ 37.905100] nix-grpc-daemon[775]: ts=2026-09-20T12:48:07Z level=info event=denied method=QueryMissing cn=- role=none3700worker1 # [ 38.189818] nix-grpc-daemon[775]: ts=2026-09-20T12:48:07Z level=info event=denied method=QueryMissing cn=stranger role=none3701(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.56 seconds)3702subtest: DAG build is scheduled across workers and lands in the cache3703client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23704worker1 # [ 38.459991] nix-grpc-daemon[775]: ts=2026-09-20T12:48:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:464963705client # don't know how to build these paths:3706client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3707worker1 # [ 38.476234] nix-grpc-daemon[775]: ts=2026-09-20T12:48:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:464963708worker1 # [ 38.545123] nix-grpc-daemon[775]: ts=2026-09-20T12:48:08Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03709worker1 # [ 38.550644] nix-grpc-daemon[775]: ts=2026-09-20T12:48:08Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=13710worker2 # [ 38.617706] nix-grpc-daemon[777]: ts=2026-09-20T12:48:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568223711worker2 # [ 38.638715] nix-grpc-daemon[777]: ts=2026-09-20T12:48:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568223712client # copying 1 paths to 'lb:50051'...3713worker2 # [ 38.658484] nix-grpc-daemon[777]: ts=2026-09-20T12:48:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568223714client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3715worker2 # [ 38.695706] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3716worker2 # [ 38.744864] nix-grpc-daemon[777]: ts=2026-09-20T12:48:08Z level=info event=niks3_push_started pid=8133717worker2 # [ 39.068230] nix-grpc-daemon[813]: time=2026-09-20T12:48:08.580Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""3718worker2 # [ 39.281188] nix-daemon[803]: accepted connection from pid 826, user nix-grpc-daemon (trusted)3719worker2 # [ 39.303803] nix-daemon[803]: reaped child process 829, status = succeeded3720worker2 # [ 39.499813] nix-daemon[803]: accepted connection from pid 831, user nix-grpc-daemon (trusted)3721worker2 # [ 39.519358] nix-daemon[803]: reaped child process 834, status = succeeded3722lb # [ 39.470914] niks3-server[1053]: 2026/09/20 12:48:08 INFO Received uploads request method=POST path=/api/pending_closures3723worker2 # [ 39.569361] nix-grpc-daemon[813]: time=2026-09-20T12:48:09.084Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3724worker2 # [ 39.573286] nix-grpc-daemon[813]: time=2026-09-20T12:48:09.086Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3725lb # [ 39.549278] niks3-server[1053]: 2026/09/20 12:48:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3726lb # [ 39.588298] niks3-server[1053]: 2026/09/20 12:48:09 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3727lb # [ 39.617284] niks3-server[1053]: 2026/09/20 12:48:09 INFO Signed narinfos id=1 count=13728worker2 # [ 39.687754] nix-grpc-daemon[813]: time=2026-09-20T12:48:09.201Z level=INFO msg="Uploading 1 narinfos"3729lb # [ 39.635204] niks3-server[1053]: 2026/09/20 12:48:09 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3730lb # [ 39.641147] niks3-server[1053]: 2026/09/20 12:48:09 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3731lb # [ 39.653679] niks3-server[1053]: 2026/09/20 12:48:09 INFO Completed upload id=13732worker2 # [ 39.721204] nix-grpc-daemon[813]: time=2026-09-20T12:48:09.235Z level=INFO msg="Upload complete. (644ms)"3733lb # [ 39.664208] niks3-server[1053]: 2026/09/20 12:48:09 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3734worker2 # [ 39.733901] nix-grpc-daemon[777]: ts=2026-09-20T12:48:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=1 paths=1 nar_bytes_in=5043735worker2 # [ 39.749112] nix-grpc-daemon[777]: ts=2026-09-20T12:48:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568223736worker2 # [ 39.760905] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3737worker2 # [ 39.767266] nix-daemon[803]: reaped child process 811, status = succeeded3738client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3739worker2 # [ 39.779145] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3740client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3741client # farm-a> LOG-farm-a-t13742worker2 # [ 41.011557] nix-daemon[803]: reaped child process 838, status = succeeded3743worker2 # [ 41.188060] nix-daemon[803]: accepted connection from pid 854, user nix-grpc-daemon (trusted)3744worker2 # [ 41.207073] nix-daemon[803]: reaped child process 857, status = succeeded3745lb # [ 41.154324] niks3-server[1053]: 2026/09/20 12:48:10 INFO Received uploads request method=POST path=/api/pending_closures3746worker2 # [ 41.243353] nix-grpc-daemon[813]: time=2026-09-20T12:48:10.756Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3747worker2 # [ 41.245943] nix-grpc-daemon[813]: time=2026-09-20T12:48:10.756Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3748lb # [ 41.213232] niks3-server[1053]: 2026/09/20 12:48:10 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3749lb # [ 41.229005] niks3-server[1053]: 2026/09/20 12:48:10 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3750lb # [ 41.243565] niks3-server[1053]: 2026/09/20 12:48:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3751worker2 # [ 41.316296] nix-grpc-daemon[813]: time=2026-09-20T12:48:10.830Z level=INFO msg="Uploading 1 narinfos"3752lb # [ 41.251144] niks3-server[1053]: 2026/09/20 12:48:10 INFO Signed narinfos id=2 count=13753lb # [ 41.255068] niks3-server[1053]: 2026/09/20 12:48:10 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3754lb # [ 41.270705] niks3-server[1053]: 2026/09/20 12:48:10 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3755lb # [ 41.283287] niks3-server[1053]: 2026/09/20 12:48:10 INFO Completed upload id=23756lb # [ 41.286421] niks3-server[1053]: 2026/09/20 12:48:10 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3757worker2 # [ 41.350814] nix-grpc-daemon[813]: time=2026-09-20T12:48:10.865Z level=INFO msg="Upload complete. (357ms)"3758worker2 # [ 41.365574] nix-grpc-daemon[777]: ts=2026-09-20T12:48:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13759worker1 # [ 41.362443] nix-grpc-daemon[775]: ts=2026-09-20T12:48:10Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03760worker2 # [ 41.383997] nix-daemon[803]: reaped child process 836, status = succeeded3761worker1 # [ 41.369404] nix-grpc-daemon[775]: ts=2026-09-20T12:48:10Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=13762lb # [ 41.362799] envoy[922]: conn peer=[::1]:51430 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33763worker2 # [ 41.430756] nix-grpc-daemon[777]: ts=2026-09-20T12:48:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568223764lb # [ 41.367970] envoy[922]: conn peer=[2001:db8:1::1]:47076 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=20073765lb # [ 41.376971] envoy[922]: conn peer=[2001:db8:1::1]:47086 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=983766lb # [ 41.382546] envoy[922]: conn peer=[2001:db8:1::1]:47088 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=193767lb # [ 41.388364] envoy[922]: conn peer=[2001:db8:1::1]:47096 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=203768worker2 # [ 41.456429] nix-grpc-daemon[777]: ts=2026-09-20T12:48:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568223769worker2 # [ 41.472208] nix-grpc-daemon[813]: time=2026-09-20T12:48:10.986Z level=INFO msg="All 1 paths already cached"3770client # copying 1 paths to 'lb:50051'...3771worker2 # [ 41.483006] nix-grpc-daemon[777]: ts=2026-09-20T12:48:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568223772client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3773worker2 # [ 41.506423] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3774worker2 # [ 41.726733] nix-daemon[803]: accepted connection from pid 861, user nix-grpc-daemon (trusted)3775worker2 # [ 41.745861] nix-daemon[803]: reaped child process 864, status = succeeded3776worker2 # [ 41.926524] nix-daemon[803]: accepted connection from pid 866, user nix-grpc-daemon (trusted)3777worker2 # [ 41.946086] nix-daemon[803]: reaped child process 869, status = succeeded3778lb # [ 41.890476] niks3-server[1053]: 2026/09/20 12:48:11 INFO Received uploads request method=POST path=/api/pending_closures3779worker2 # [ 41.969978] nix-grpc-daemon[813]: time=2026-09-20T12:48:11.484Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3780worker2 # [ 41.971565] nix-grpc-daemon[813]: time=2026-09-20T12:48:11.484Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3781lb # [ 41.924656] niks3-server[1053]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3782lb # [ 41.937232] niks3-server[1053]: 2026/09/20 12:48:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3783worker2 # [ 42.011292] nix-grpc-daemon[813]: time=2026-09-20T12:48:11.525Z level=INFO msg="Uploading 1 narinfos"3784lb # [ 41.948758] niks3-server[1053]: 2026/09/20 12:48:11 INFO Signed narinfos id=3 count=13785lb # [ 41.951250] niks3-server[1053]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3786lb # [ 41.961467] niks3-server[1053]: 2026/09/20 12:48:11 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3787lb # [ 41.968884] niks3-server[1053]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3788lb # [ 41.972926] niks3-server[1053]: 2026/09/20 12:48:11 INFO Completed upload id=33789worker2 # [ 42.040463] nix-grpc-daemon[813]: time=2026-09-20T12:48:11.555Z level=INFO msg="Upload complete. (515ms)"3790worker2 # [ 42.049597] nix-grpc-daemon[777]: ts=2026-09-20T12:48:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=0 paths=1 nar_bytes_in=6243791worker2 # [ 42.063819] nix-grpc-daemon[777]: ts=2026-09-20T12:48:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568223792worker2 # [ 42.074641] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3793worker2 # [ 42.078531] nix-daemon[803]: reaped child process 859, status = succeeded3794client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3795worker2 # [ 42.089979] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3796client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3797client # farm-b> LOG-farm-b-t13798worker2 # [ 43.115141] nix-daemon[803]: reaped child process 873, status = succeeded3799worker2 # [ 43.279844] nix-daemon[803]: accepted connection from pid 889, user nix-grpc-daemon (trusted)3800worker2 # [ 43.302815] nix-daemon[803]: reaped child process 892, status = succeeded3801lb # [ 43.249429] niks3-server[1053]: 2026/09/20 12:48:12 INFO Received uploads request method=POST path=/api/pending_closures3802worker2 # [ 43.327212] nix-grpc-daemon[813]: time=2026-09-20T12:48:12.840Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3803worker2 # [ 43.328972] nix-grpc-daemon[813]: time=2026-09-20T12:48:12.840Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3804lb # [ 43.286998] niks3-server[1053]: 2026/09/20 12:48:12 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3805lb # [ 43.302039] niks3-server[1053]: 2026/09/20 12:48:12 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3806worker2 # [ 43.379243] nix-grpc-daemon[813]: time=2026-09-20T12:48:12.893Z level=INFO msg="Uploading 1 narinfos"3807lb # [ 43.312922] niks3-server[1053]: 2026/09/20 12:48:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3808lb # [ 43.321357] niks3-server[1053]: 2026/09/20 12:48:12 INFO Signed narinfos id=4 count=13809lb # [ 43.327454] niks3-server[1053]: 2026/09/20 12:48:12 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3810lb # [ 43.335657] niks3-server[1053]: 2026/09/20 12:48:12 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3811lb # [ 43.342512] niks3-server[1053]: 2026/09/20 12:48:12 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3812lb # [ 43.348389] niks3-server[1053]: 2026/09/20 12:48:12 INFO Completed upload id=43813worker2 # [ 43.415894] nix-grpc-daemon[813]: time=2026-09-20T12:48:12.930Z level=INFO msg="Upload complete. (312ms)"3814worker1 # [ 43.415915] nix-grpc-daemon[775]: ts=2026-09-20T12:48:12Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03815worker1 # [ 43.421951] nix-grpc-daemon[775]: ts=2026-09-20T12:48:12Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=13816worker2 # [ 43.429400] nix-grpc-daemon[777]: ts=2026-09-20T12:48:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13817worker2 # [ 43.449238] nix-daemon[803]: reaped child process 871, status = succeeded3818worker2 # [ 43.481924] nix-grpc-daemon[777]: ts=2026-09-20T12:48:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568223819worker2 # [ 43.500644] nix-grpc-daemon[777]: ts=2026-09-20T12:48:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568223820worker2 # [ 43.517829] nix-grpc-daemon[813]: time=2026-09-20T12:48:13.032Z level=INFO msg="All 2 paths already cached"3821client # copying 1 paths to 'lb:50051'...3822worker2 # [ 43.529543] nix-grpc-daemon[777]: ts=2026-09-20T12:48:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568223823client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3824worker2 # [ 43.554839] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3825worker2 # [ 43.763730] nix-daemon[803]: accepted connection from pid 896, user nix-grpc-daemon (trusted)3826worker2 # [ 43.783744] nix-daemon[803]: reaped child process 899, status = succeeded3827worker2 # [ 43.967953] nix-daemon[803]: accepted connection from pid 901, user nix-grpc-daemon (trusted)3828worker2 # [ 43.986942] nix-daemon[803]: reaped child process 904, status = succeeded3829lb # [ 43.932604] niks3-server[1053]: 2026/09/20 12:48:13 INFO Received uploads request method=POST path=/api/pending_closures3830worker2 # [ 44.010208] nix-grpc-daemon[813]: time=2026-09-20T12:48:13.524Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3831worker2 # [ 44.011816] nix-grpc-daemon[813]: time=2026-09-20T12:48:13.524Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3832lb # [ 43.962987] niks3-server[1053]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3833worker2 # [ 44.041461] nix-grpc-daemon[813]: time=2026-09-20T12:48:13.555Z level=INFO msg="Uploading 1 narinfos"3834lb # [ 43.977434] niks3-server[1053]: 2026/09/20 12:48:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3835lb # [ 43.988814] niks3-server[1053]: 2026/09/20 12:48:13 INFO Signed narinfos id=5 count=13836worker2 # [ 44.065898] nix-grpc-daemon[813]: time=2026-09-20T12:48:13.580Z level=INFO msg="Upload complete. (492ms)"3837lb # [ 43.998586] niks3-server[1053]: 2026/09/20 12:48:13 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3838lb # [ 44.005797] niks3-server[1053]: 2026/09/20 12:48:13 INFO Completed upload id=53839worker2 # [ 44.072066] nix-grpc-daemon[777]: ts=2026-09-20T12:48:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=0 paths=1 nar_bytes_in=7523840lb # [ 44.010067] niks3-server[1053]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3841worker2 # [ 44.080327] nix-grpc-daemon[777]: ts=2026-09-20T12:48:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568223842lb # [ 44.013373] niks3-server[1053]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3843worker2 # [ 44.092265] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3844worker2 # [ 44.094592] nix-daemon[803]: reaped child process 894, status = succeeded3845client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3846worker2 # [ 44.104780] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3847client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3848client # farm-top> LOG-farm-top-t13849worker2 # [ 45.333726] nix-daemon[803]: reaped child process 908, status = succeeded3850worker2 # [ 45.492674] nix-daemon[803]: accepted connection from pid 923, user nix-grpc-daemon (trusted)3851worker2 # [ 45.514229] nix-daemon[803]: reaped child process 926, status = succeeded3852lb # [ 45.458134] niks3-server[1053]: 2026/09/20 12:48:14 INFO Received uploads request method=POST path=/api/pending_closures3853worker2 # [ 45.532613] nix-grpc-daemon[813]: time=2026-09-20T12:48:15.045Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3854worker2 # [ 45.535329] nix-grpc-daemon[813]: time=2026-09-20T12:48:15.045Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3855lb # [ 45.481642] niks3-server[1053]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3856lb # [ 45.487869] niks3-server[1053]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3857worker2 # [ 45.565703] nix-grpc-daemon[813]: time=2026-09-20T12:48:15.080Z level=INFO msg="Uploading 1 narinfos"3858lb # [ 45.494568] niks3-server[1053]: 2026/09/20 12:48:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3859lb # [ 45.500468] niks3-server[1053]: 2026/09/20 12:48:15 INFO Signed narinfos id=6 count=13860lb # [ 45.503683] niks3-server[1053]: 2026/09/20 12:48:15 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3861lb # [ 45.511233] niks3-server[1053]: 2026/09/20 12:48:15 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3862lb # [ 45.515762] niks3-server[1053]: 2026/09/20 12:48:15 INFO Completed upload id=63863worker2 # [ 45.582747] nix-grpc-daemon[813]: time=2026-09-20T12:48:15.097Z level=INFO msg="Upload complete. (266ms)"3864lb # [ 45.517745] niks3-server[1053]: 2026/09/20 12:48:15 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3865worker2 # [ 45.592798] nix-grpc-daemon[777]: ts=2026-09-20T12:48:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13866worker2 # [ 45.601739] nix-daemon[803]: reaped child process 906, status = succeeded3867client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.41 seconds)3868client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3869client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.25 seconds)3870client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3871client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)3872client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3873client # copying 3 paths...3874client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3875client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3876client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3877client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)3878(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.11 seconds)3879subtest: repeat is answered Cached by the scheduler without building3880worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3881worker1 # finding garbage collector roots...3882worker1 # deleting specified paths...3883worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3884worker1 # deleting unused links...3885worker1 # note: hard linking is currently saving 0.0 KiB3886worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.32 seconds)3887worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3888worker2 # finding garbage collector roots...3889worker2 # deleting specified paths...3890worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3891worker2 # deleting unused links...3892worker2 # note: hard linking is currently saving 0.0 KiB3893worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)3894client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23895client # don't know how to build these paths:3896client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3897worker1 # [ 47.199328] nix-grpc-daemon[775]: ts=2026-09-20T12:48:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:464963898worker1 # [ 47.207614] nix-grpc-daemon[775]: ts=2026-09-20T12:48:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:464963899worker1 # [ 47.240194] nix-grpc-daemon[775]: ts=2026-09-20T12:48:16Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=13900client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.34 seconds)3901client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3902client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.22 seconds)3903worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics3904worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)3905(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.35 seconds)3906subtest: inputs already in the cache are not sent to the scheduler3907worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true3908worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)3909client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&23910worker2 # [ 48.005749] nix-grpc-daemon[777]: ts=2026-09-20T12:48:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:568223911client # don't know how to build these paths:3912client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv3913worker2 # [ 48.018786] nix-grpc-daemon[777]: ts=2026-09-20T12:48:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568223914worker2 # [ 48.029979] nix-grpc-daemon[813]: time=2026-09-20T12:48:17.543Z level=INFO msg="All 2 paths already cached"3915worker1 # [ 48.032949] nix-grpc-daemon[775]: ts=2026-09-20T12:48:17Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=03916worker1 # [ 48.033401] nix-grpc-daemon[775]: ts=2026-09-20T12:48:17Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=13917worker2 # [ 48.096133] nix-grpc-daemon[777]: ts=2026-09-20T12:48:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568223918worker2 # [ 48.112927] nix-grpc-daemon[777]: ts=2026-09-20T12:48:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568223919worker2 # [ 48.128662] nix-grpc-daemon[813]: time=2026-09-20T12:48:17.643Z level=INFO msg="All 2 paths already cached"3920client # copying 1 paths to 'lb:50051'...3921client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...3922worker2 # [ 48.139367] nix-grpc-daemon[777]: ts=2026-09-20T12:48:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568223923worker2 # [ 48.154999] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3924worker2 # [ 48.368164] nix-daemon[803]: accepted connection from pid 944, user nix-grpc-daemon (trusted)3925worker2 # [ 48.390349] nix-daemon[803]: reaped child process 947, status = succeeded3926worker2 # [ 48.566290] nix-daemon[803]: accepted connection from pid 949, user nix-grpc-daemon (trusted)3927worker2 # [ 48.585006] nix-daemon[803]: reaped child process 952, status = succeeded3928lb # [ 48.534170] niks3-server[1053]: 2026/09/20 12:48:18 INFO Received uploads request method=POST path=/api/pending_closures3929worker2 # [ 48.611858] nix-grpc-daemon[813]: time=2026-09-20T12:48:18.126Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3930worker2 # [ 48.613695] nix-grpc-daemon[813]: time=2026-09-20T12:48:18.126Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"3931lb # [ 48.565612] niks3-server[1053]: 2026/09/20 12:48:18 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst3932worker2 # [ 48.649940] nix-grpc-daemon[813]: time=2026-09-20T12:48:18.164Z level=INFO msg="Uploading 1 narinfos"3933lb # [ 48.583367] niks3-server[1053]: 2026/09/20 12:48:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign3934lb # [ 48.592305] niks3-server[1053]: 2026/09/20 12:48:18 INFO Signed narinfos id=7 count=13935lb # [ 48.604577] niks3-server[1053]: 2026/09/20 12:48:18 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete3936lb # [ 48.614804] niks3-server[1053]: 2026/09/20 12:48:18 INFO Completed upload id=73937worker2 # [ 48.682240] nix-grpc-daemon[813]: time=2026-09-20T12:48:18.196Z level=INFO msg="Upload complete. (508ms)"3938lb # [ 48.617546] niks3-server[1053]: 2026/09/20 12:48:18 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo3939lb # [ 48.623135] niks3-server[1053]: 2026/09/20 12:48:18 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls3940worker2 # [ 48.692294] nix-grpc-daemon[777]: ts=2026-09-20T12:48:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=0 paths=1 nar_bytes_in=7523941worker2 # [ 48.706898] nix-grpc-daemon[777]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568223942worker2 # [ 48.713807] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3943worker2 # [ 48.718947] nix-daemon[803]: reaped child process 942, status = succeeded3944client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...3945client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv3946worker2 # [ 48.731117] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3947worker2 # [ 50.160308] nix-daemon[803]: reaped child process 956, status = succeeded3948client # farm-top> LOG-farm-top-t1b3949worker2 # [ 50.323638] nix-daemon[803]: accepted connection from pid 971, user nix-grpc-daemon (trusted)3950worker2 # [ 50.344806] nix-daemon[803]: reaped child process 974, status = succeeded3951lb # [ 50.290816] niks3-server[1053]: 2026/09/20 12:48:19 INFO Received uploads request method=POST path=/api/pending_closures3952worker2 # [ 50.367627] nix-grpc-daemon[813]: time=2026-09-20T12:48:19.882Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3953worker2 # [ 50.372200] nix-grpc-daemon[813]: time=2026-09-20T12:48:19.883Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"3954lb # [ 50.331731] niks3-server[1053]: 2026/09/20 12:48:19 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv3955worker2 # [ 50.412676] nix-grpc-daemon[813]: time=2026-09-20T12:48:19.927Z level=INFO msg="Uploading 1 narinfos"3956lb # [ 50.345404] niks3-server[1053]: 2026/09/20 12:48:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign3957lb # [ 50.359085] niks3-server[1053]: 2026/09/20 12:48:19 INFO Signed narinfos id=8 count=13958lb # [ 50.365714] niks3-server[1053]: 2026/09/20 12:48:19 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst3959lb # [ 50.372783] niks3-server[1053]: 2026/09/20 12:48:19 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls3960lb # [ 50.382386] niks3-server[1053]: 2026/09/20 12:48:19 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete3961lb # [ 50.388131] niks3-server[1053]: 2026/09/20 12:48:19 INFO Completed upload id=83962worker2 # [ 50.455558] nix-grpc-daemon[813]: time=2026-09-20T12:48:19.970Z level=INFO msg="Upload complete. (310ms)"3963lb # [ 50.391704] niks3-server[1053]: 2026/09/20 12:48:19 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo3964worker2 # [ 50.465837] nix-grpc-daemon[777]: ts=2026-09-20T12:48:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=13965worker2 # [ 50.483403] nix-daemon[803]: reaped child process 954, status = succeeded3966client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.77 seconds)3967client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath3968client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds)3969worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true3970worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)3971(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.12 seconds)3972subtest: two clients wanting the same drv build it once3973client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup3974client # [ 50.854269] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.3975client # Running as unit: dedup1.service; invocation ID: ca6b9d5e7cd848fd955d723a745a259b3976client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.09 seconds)3977client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup3978worker2 # [ 51.133133] nix-grpc-daemon[777]: ts=2026-09-20T12:48:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:568223979client # [ 51.107468] nix[883]: don't know how to build these paths:3980client # [ 51.108575] nix[883]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv3981worker1 # [ 51.142022] nix-grpc-daemon[775]: ts=2026-09-20T12:48:20Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=03982worker1 # [ 51.142423] nix-grpc-daemon[775]: ts=2026-09-20T12:48:20Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=13983worker1 # [ 51.155636] nix-grpc-daemon[775]: ts=2026-09-20T12:48:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:464963984worker1 # [ 51.175319] nix-grpc-daemon[775]: ts=2026-09-20T12:48:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:464963985client # [ 51.170546] nix[883]: copying 1 paths to 'lb:50051'...3986client # [ 51.172483] nix[883]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...3987worker1 # [ 51.190679] nix-grpc-daemon[775]: ts=2026-09-20T12:48:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:464963988worker1 # [ 51.206861] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3989worker1 # [ 51.233127] nix-grpc-daemon[775]: ts=2026-09-20T12:48:20Z level=info event=niks3_push_started pid=8893990lb # [ 51.362666] envoy[922]: conn peer=[2001:db8:1::1]:47112 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9536 tx=3868 ms=71473991lb # [ 51.367854] envoy[922]: conn peer=[2001:db8:1::1]:42764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=683992lb # [ 51.372696] envoy[922]: conn peer=[2001:db8:1::1]:42772 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1707 ms=24763993worker1 # [ 51.499756] nix-grpc-daemon[889]: time=2026-09-20T12:48:21.012Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""3994worker1 # [ 51.699138] nix-daemon[838]: accepted connection from pid 902, user nix-grpc-daemon (trusted)3995worker1 # [ 51.722780] nix-daemon[838]: reaped child process 905, status = succeeded3996worker1 # [ 51.910778] nix-daemon[838]: accepted connection from pid 907, user nix-grpc-daemon (trusted)3997worker1 # [ 51.929417] nix-daemon[838]: reaped child process 910, status = succeeded3998lb # [ 51.889072] niks3-server[1053]: 2026/09/20 12:48:21 INFO Received uploads request method=POST path=/api/pending_closures3999worker1 # [ 51.953894] nix-grpc-daemon[889]: time=2026-09-20T12:48:21.467Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4000worker1 # [ 51.957426] nix-grpc-daemon[889]: time=2026-09-20T12:48:21.470Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4001lb # [ 51.928242] niks3-server[1053]: 2026/09/20 12:48:21 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4002worker1 # [ 51.995121] nix-grpc-daemon[889]: time=2026-09-20T12:48:21.508Z level=INFO msg="Uploading 1 narinfos"4003lb # [ 51.941943] niks3-server[1053]: 2026/09/20 12:48:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4004client # [ 51.967305] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4005lb # [ 51.958015] niks3-server[1053]: 2026/09/20 12:48:21 INFO Signed narinfos id=9 count=14006lb # [ 51.964381] niks3-server[1053]: 2026/09/20 12:48:21 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4007client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4008lb # [ 51.976811] niks3-server[1053]: 2026/09/20 12:48:21 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4009lb # [ 51.985519] niks3-server[1053]: 2026/09/20 12:48:21 INFO Completed upload id=94010worker1 # [ 52.039803] nix-grpc-daemon[889]: time=2026-09-20T12:48:21.552Z level=INFO msg="Upload complete. (528ms)"4011lb # [ 51.988991] niks3-server[1053]: 2026/09/20 12:48:21 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4012worker1 # [ 52.052393] nix-grpc-daemon[775]: ts=2026-09-20T12:48:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46496 duration_s=0 paths=1 nar_bytes_in=4324013worker1 # [ 52.055935] nix-grpc-daemon[775]: ts=2026-09-20T12:48:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:464964014worker1 # [ 52.070509] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4015worker1 # [ 52.074863] nix-daemon[838]: reaped child process 887, status = succeeded4016client # Running as unit: dedup2.service; invocation ID: 1a5ca285efc14f87b35ca97841208e084017client # [ 52.067352] nix[883]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4018worker1 # [ 52.091132] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4019client # [ 53.943764] nix[898]: don't know how to build these paths:4020worker2 # [ 53.974344] nix-grpc-daemon[777]: ts=2026-09-20T12:48:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:568224021client # [ 53.944003] nix[898]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4022worker1 # [ 53.974248] nix-grpc-daemon[775]: ts=2026-09-20T12:48:23Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04023worker1 # [ 53.977261] nix-grpc-daemon[775]: ts=2026-09-20T12:48:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:464964024client # [ 53.961086] nix[898]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4025client: must succeed: sleep 24026client: (finished: must succeed: sleep 2, in 2.06 seconds)4027worker1 # [ 56.720806] nix-daemon[838]: reaped child process 918, status = succeeded4028??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4029 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394030client: waiting for success: ! systemctl is-active dedup1 dedup24031??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4032 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394033worker1 # [ 56.889066] nix-daemon[838]: accepted connection from pid 949, user nix-grpc-daemon (trusted)4034worker1 # [ 56.908943] nix-daemon[838]: reaped child process 952, status = succeeded4035lb # [ 56.869475] niks3-server[1053]: 2026/09/20 12:48:26 INFO Received uploads request method=POST path=/api/pending_closures4036worker1 # [ 56.932542] nix-grpc-daemon[889]: time=2026-09-20T12:48:26.444Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4037worker1 # [ 56.934562] nix-grpc-daemon[889]: time=2026-09-20T12:48:26.444Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4038lb # [ 56.914854] niks3-server[1053]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4039lb # [ 56.928068] niks3-server[1053]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4040lb # [ 56.937615] niks3-server[1053]: 2026/09/20 12:48:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4041lb # [ 56.944325] niks3-server[1053]: 2026/09/20 12:48:26 INFO Signed narinfos id=10 count=14042worker1 # [ 56.998050] nix-grpc-daemon[889]: time=2026-09-20T12:48:26.510Z level=INFO msg="Uploading 1 narinfos"4043lb # [ 56.949170] niks3-server[1053]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4044lb # [ 56.959033] niks3-server[1053]: 2026/09/20 12:48:26 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4045lb # [ 56.968053] niks3-server[1053]: 2026/09/20 12:48:26 INFO Completed upload id=104046worker1 # [ 57.020840] nix-grpc-daemon[889]: time=2026-09-20T12:48:26.534Z level=INFO msg="Upload complete. (314ms)"4047lb # [ 56.971038] niks3-server[1053]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4048worker1 # [ 57.036144] nix-grpc-daemon[775]: ts=2026-09-20T12:48:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46496 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14049worker1 # [ 57.049324] nix-grpc-daemon[775]: ts=2026-09-20T12:48:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46496 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14050worker1 # [ 57.055033] nix-daemon[838]: reaped child process 916, status = succeeded4051client # [ 57.067589] systemd[1]: dedup2.service: Deactivated successfully.4052client # [ 57.075193] systemd[1]: dedup2.service: Consumed 226ms CPU time over 5.105s wall clock time, 33M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic.4053client # [ 57.120659] systemd[1]: dedup1.service: Deactivated successfully.4054client # [ 57.123387] systemd[1]: dedup1.service: Consumed 152ms CPU time over 6.269s wall clock time, 37.1M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.4055client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds)4056client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4057client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4058worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4059worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4060worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4061worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4062worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4063worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4064worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4065worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4066(finished: subtest: two clients wanting the same drv build it once, in 7.50 seconds)4067subtest: build hook: nix-daemon with builders = grpc://lb4068client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4069client # [ 58.515939] systemd[1]: Started Nix Daemon.4070client # [ 58.708560] nix-daemon[939]: accepted connection from pid 936, user root (trusted)4071worker2 # [ 58.945430] nix-grpc-daemon[777]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:568224072worker1 # [ 58.938093] nix-grpc-daemon[775]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:464964073worker1 # [ 58.950564] nix-grpc-daemon[775]: ts=2026-09-20T12:48:28Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04074worker1 # [ 58.956937] nix-grpc-daemon[775]: ts=2026-09-20T12:48:28Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14075worker2 # [ 59.012984] nix-grpc-daemon[777]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568224076worker2 # [ 59.032378] nix-grpc-daemon[777]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568224077worker2 # [ 59.050743] nix-grpc-daemon[777]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568224078worker2 # [ 59.066984] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4079worker2 # [ 59.283781] nix-daemon[803]: accepted connection from pid 1003, user nix-grpc-daemon (trusted)4080worker2 # [ 59.304911] nix-daemon[803]: reaped child process 1006, status = succeeded4081worker2 # [ 59.480163] nix-daemon[803]: accepted connection from pid 1008, user nix-grpc-daemon (trusted)4082worker2 # [ 59.498611] nix-daemon[803]: reaped child process 1011, status = succeeded4083lb # [ 59.445634] niks3-server[1053]: 2026/09/20 12:48:28 INFO Received uploads request method=POST path=/api/pending_closures4084worker2 # [ 59.522744] nix-grpc-daemon[813]: time=2026-09-20T12:48:29.036Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4085worker2 # [ 59.524325] nix-grpc-daemon[813]: time=2026-09-20T12:48:29.036Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4086lb # [ 59.476709] niks3-server[1053]: 2026/09/20 12:48:28 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4087lb # [ 59.493610] niks3-server[1053]: 2026/09/20 12:48:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4088worker2 # [ 59.566744] nix-grpc-daemon[813]: time=2026-09-20T12:48:29.081Z level=INFO msg="Uploading 1 narinfos"4089lb # [ 59.505734] niks3-server[1053]: 2026/09/20 12:48:29 INFO Signed narinfos id=11 count=14090lb # [ 59.512477] niks3-server[1053]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4091lb # [ 59.526800] niks3-server[1053]: 2026/09/20 12:48:29 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4092worker2 # [ 59.598253] nix-grpc-daemon[813]: time=2026-09-20T12:48:29.112Z level=INFO msg="Upload complete. (512ms)"4093lb # [ 59.532096] niks3-server[1053]: 2026/09/20 12:48:29 INFO Completed upload id=114094lb # [ 59.535706] niks3-server[1053]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4095worker2 # [ 59.609259] nix-grpc-daemon[777]: ts=2026-09-20T12:48:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=0 paths=1 nar_bytes_in=5124096worker2 # [ 59.620335] nix-grpc-daemon[777]: ts=2026-09-20T12:48:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568224097worker2 # [ 59.628950] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4098worker2 # [ 59.634431] nix-daemon[803]: reaped child process 1001, status = succeeded4099worker2 # [ 59.646947] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4100worker2 # [ 60.289572] nix-daemon[803]: reaped child process 1015, status = succeeded4101worker2 # [ 60.454615] nix-daemon[803]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4102worker2 # [ 60.475637] nix-daemon[803]: reaped child process 1033, status = succeeded4103lb # [ 60.420322] niks3-server[1053]: 2026/09/20 12:48:29 INFO Received uploads request method=POST path=/api/pending_closures4104worker2 # [ 60.500121] nix-grpc-daemon[813]: time=2026-09-20T12:48:30.011Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4105worker2 # [ 60.501644] nix-grpc-daemon[813]: time=2026-09-20T12:48:30.011Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4106lb # [ 60.461267] niks3-server[1053]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4107worker2 # [ 60.543418] nix-grpc-daemon[813]: time=2026-09-20T12:48:30.057Z level=INFO msg="Uploading 1 narinfos"4108lb # [ 60.477420] niks3-server[1053]: 2026/09/20 12:48:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4109lb # [ 60.489360] niks3-server[1053]: 2026/09/20 12:48:29 INFO Signed narinfos id=12 count=14110lb # [ 60.491945] niks3-server[1053]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4111lb # [ 60.508055] niks3-server[1053]: 2026/09/20 12:48:30 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4112worker2 # [ 60.581140] nix-grpc-daemon[813]: time=2026-09-20T12:48:30.095Z level=INFO msg="Upload complete. (320ms)"4113lb # [ 60.514404] niks3-server[1053]: 2026/09/20 12:48:30 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4114lb # [ 60.520909] niks3-server[1053]: 2026/09/20 12:48:30 INFO Completed upload id=124115lb # [ 60.523213] niks3-server[1053]: 2026/09/20 12:48:30 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4116worker2 # [ 60.593142] nix-grpc-daemon[777]: ts=2026-09-20T12:48:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=0 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14117worker2 # [ 60.607814] nix-daemon[803]: reaped child process 1013, status = succeeded4118worker1 # [ 60.622612] nix-grpc-daemon[775]: ts=2026-09-20T12:48:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:464964119worker1 # [ 60.640752] nix-grpc-daemon[775]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4120worker1 # [ 60.694462] nix-grpc-daemon[775]: ts=2026-09-20T12:48:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:464964121worker1 # [ 60.703120] nix-grpc-daemon[775]: ts=2026-09-20T12:48:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46496 duration_s=0 paths=1 nar_bytes_out=1284122worker1 # [ 61.015069] nix-grpc-daemon[775]: ts=2026-09-20T12:48:30Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:464964123worker1 # [ 61.023082] nix-grpc-daemon[775]: ts=2026-09-20T12:48:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:464964124worker1 # [ 61.031132] nix-grpc-daemon[889]: time=2026-09-20T12:48:30.543Z level=INFO msg="All 1 paths already cached"4125worker1 # [ 61.046574] nix-grpc-daemon[775]: ts=2026-09-20T12:48:30Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04126worker1 # [ 61.053161] nix-grpc-daemon[775]: ts=2026-09-20T12:48:30Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14127worker2 # [ 61.071297] nix-grpc-daemon[777]: ts=2026-09-20T12:48:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568224128worker2 # [ 61.088921] nix-grpc-daemon[777]: ts=2026-09-20T12:48:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568224129worker2 # [ 61.104923] nix-grpc-daemon[813]: time=2026-09-20T12:48:30.619Z level=INFO msg="All 1 paths already cached"4130worker2 # [ 61.115686] nix-grpc-daemon[777]: ts=2026-09-20T12:48:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568224131worker2 # [ 61.130912] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4132worker2 # [ 61.347428] nix-daemon[803]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)4133worker2 # [ 61.371879] nix-daemon[803]: reaped child process 1040, status = succeeded4134lb # [ 61.363869] envoy[922]: conn peer=[2001:db8:1::1]:36274 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=31064135lb # [ 61.369022] envoy[922]: conn peer=[2001:db8:1::1]:36266 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1372 ms=59864136lb # [ 61.373979] envoy[922]: conn peer=[2001:db8:1::1]:36280 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3391 tx=1773 ms=18334137lb # [ 61.379642] envoy[922]: conn peer=[2001:db8:1::1]:36292 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=794138worker2 # [ 61.554536] nix-daemon[803]: accepted connection from pid 1042, user nix-grpc-daemon (trusted)4139worker2 # [ 61.573037] nix-daemon[803]: reaped child process 1045, status = succeeded4140lb # [ 61.521322] niks3-server[1053]: 2026/09/20 12:48:31 INFO Received uploads request method=POST path=/api/pending_closures4141worker2 # [ 61.598917] nix-grpc-daemon[813]: time=2026-09-20T12:48:31.112Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4142worker2 # [ 61.600580] nix-grpc-daemon[813]: time=2026-09-20T12:48:31.112Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4143lb # [ 61.557627] niks3-server[1053]: 2026/09/20 12:48:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4144worker2 # [ 61.631025] nix-grpc-daemon[813]: time=2026-09-20T12:48:31.145Z level=INFO msg="Uploading 1 narinfos"4145lb # [ 61.568303] niks3-server[1053]: 2026/09/20 12:48:31 INFO Signed narinfos id=13 count=14146lb # [ 61.583298] niks3-server[1053]: 2026/09/20 12:48:31 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4147lb # [ 61.606142] niks3-server[1053]: 2026/09/20 12:48:31 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4148lb # [ 61.619597] niks3-server[1053]: 2026/09/20 12:48:31 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4149lb # [ 61.631982] niks3-server[1053]: 2026/09/20 12:48:31 INFO Completed upload id=134150worker2 # [ 61.699911] nix-grpc-daemon[813]: time=2026-09-20T12:48:31.214Z level=INFO msg="Upload complete. (550ms)"4151lb # [ 61.642208] niks3-server[1053]: 2026/09/20 12:48:31 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4152worker2 # [ 61.713293] nix-grpc-daemon[777]: ts=2026-09-20T12:48:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=0 paths=1 nar_bytes_in=6244153worker2 # [ 61.731793] nix-grpc-daemon[777]: ts=2026-09-20T12:48:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568224154worker2 # [ 61.742540] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4155worker2 # [ 61.752374] nix-daemon[803]: reaped child process 1035, status = succeeded4156worker2 # [ 61.764183] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4157worker2 # [ 62.992755] nix-daemon[803]: reaped child process 1049, status = succeeded4158worker2 # [ 63.157270] nix-daemon[803]: accepted connection from pid 1064, user nix-grpc-daemon (trusted)4159worker2 # [ 63.177672] nix-daemon[803]: reaped child process 1067, status = succeeded4160lb # [ 63.122973] niks3-server[1053]: 2026/09/20 12:48:32 INFO Received uploads request method=POST path=/api/pending_closures4161worker2 # [ 63.203612] nix-grpc-daemon[813]: time=2026-09-20T12:48:32.715Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4162worker2 # [ 63.205294] nix-grpc-daemon[813]: time=2026-09-20T12:48:32.715Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4163lb # [ 63.164552] niks3-server[1053]: 2026/09/20 12:48:32 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4164lb # [ 63.180796] niks3-server[1053]: 2026/09/20 12:48:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4165worker2 # [ 63.255218] nix-grpc-daemon[813]: time=2026-09-20T12:48:32.769Z level=INFO msg="Uploading 1 narinfos"4166lb # [ 63.190650] niks3-server[1053]: 2026/09/20 12:48:32 INFO Signed narinfos id=14 count=14167lb # [ 63.203349] niks3-server[1053]: 2026/09/20 12:48:32 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4168lb # [ 63.246492] niks3-server[1053]: 2026/09/20 12:48:32 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4169lb # [ 63.341294] niks3-server[1053]: 2026/09/20 12:48:32 INFO Completed upload id=144170worker2 # [ 63.408605] nix-grpc-daemon[813]: time=2026-09-20T12:48:32.923Z level=INFO msg="Upload complete. (431ms)"4171lb # [ 63.345929] niks3-server[1053]: 2026/09/20 12:48:32 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4172lb # [ 63.355039] niks3-server[1053]: 2026/09/20 12:48:32 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4173worker2 # [ 63.421230] nix-grpc-daemon[777]: ts=2026-09-20T12:48:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14174worker1 # [ 63.419158] nix-grpc-daemon[775]: ts=2026-09-20T12:48:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:464964175worker2 # [ 63.441291] nix-daemon[803]: reaped child process 1047, status = succeeded4176worker1 # [ 63.433758] nix-grpc-daemon[775]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4177worker1 # [ 63.476156] nix-grpc-daemon[775]: ts=2026-09-20T12:48:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:464964178worker1 # [ 63.482635] nix-grpc-daemon[775]: ts=2026-09-20T12:48:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46496 duration_s=0 paths=1 nar_bytes_out=1764179worker2 # [ 63.801830] nix-grpc-daemon[777]: ts=2026-09-20T12:48:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:568224180worker2 # [ 63.809630] nix-grpc-daemon[777]: ts=2026-09-20T12:48:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568224181worker2 # [ 63.816337] nix-grpc-daemon[813]: time=2026-09-20T12:48:33.329Z level=INFO msg="All 2 paths already cached"4182worker1 # [ 63.815308] nix-grpc-daemon[775]: ts=2026-09-20T12:48:33Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04183worker1 # [ 63.821961] nix-grpc-daemon[775]: ts=2026-09-20T12:48:33Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14184worker2 # [ 63.839659] nix-grpc-daemon[777]: ts=2026-09-20T12:48:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568224185worker2 # [ 63.855731] nix-grpc-daemon[777]: ts=2026-09-20T12:48:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568224186worker2 # [ 63.871022] nix-grpc-daemon[813]: time=2026-09-20T12:48:33.385Z level=INFO msg="All 2 paths already cached"4187worker2 # [ 63.880815] nix-grpc-daemon[777]: ts=2026-09-20T12:48:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568224188worker2 # [ 63.895460] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4189worker2 # [ 64.106866] nix-daemon[803]: accepted connection from pid 1071, user nix-grpc-daemon (trusted)4190worker2 # [ 64.129410] nix-daemon[803]: reaped child process 1074, status = succeeded4191worker2 # [ 64.308345] nix-daemon[803]: accepted connection from pid 1076, user nix-grpc-daemon (trusted)4192worker2 # [ 64.328309] nix-daemon[803]: reaped child process 1079, status = succeeded4193lb # [ 64.273904] niks3-server[1053]: 2026/09/20 12:48:33 INFO Received uploads request method=POST path=/api/pending_closures4194worker2 # [ 64.351832] nix-grpc-daemon[813]: time=2026-09-20T12:48:33.865Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4195worker2 # [ 64.353558] nix-grpc-daemon[813]: time=2026-09-20T12:48:33.865Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4196lb # [ 64.308526] niks3-server[1053]: 2026/09/20 12:48:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4197worker2 # [ 64.383871] nix-grpc-daemon[813]: time=2026-09-20T12:48:33.898Z level=INFO msg="Uploading 1 narinfos"4198lb # [ 64.318821] niks3-server[1053]: 2026/09/20 12:48:33 INFO Signed narinfos id=15 count=14199lb # [ 64.334002] niks3-server[1053]: 2026/09/20 12:48:33 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4200lb # [ 64.371719] niks3-server[1053]: 2026/09/20 12:48:33 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4201lb # [ 64.383696] niks3-server[1053]: 2026/09/20 12:48:33 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4202lb # [ 64.390798] niks3-server[1053]: 2026/09/20 12:48:33 INFO Completed upload id=154203worker2 # [ 64.458362] nix-grpc-daemon[813]: time=2026-09-20T12:48:33.972Z level=INFO msg="Upload complete. (542ms)"4204lb # [ 64.395200] niks3-server[1053]: 2026/09/20 12:48:33 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4205worker2 # [ 64.474428] nix-grpc-daemon[777]: ts=2026-09-20T12:48:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=0 paths=1 nar_bytes_in=7524206worker2 # [ 64.488938] nix-grpc-daemon[777]: ts=2026-09-20T12:48:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568224207worker2 # [ 64.498970] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4208worker2 # [ 64.507007] nix-daemon[803]: reaped child process 1069, status = succeeded4209worker2 # [ 64.522154] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4210worker2 # [ 65.571288] nix-daemon[803]: reaped child process 1083, status = succeeded4211worker2 # [ 65.752253] nix-daemon[803]: accepted connection from pid 1098, user nix-grpc-daemon (trusted)4212worker2 # [ 65.774280] nix-daemon[803]: reaped child process 1101, status = succeeded4213lb # [ 65.719624] niks3-server[1053]: 2026/09/20 12:48:35 INFO Received uploads request method=POST path=/api/pending_closures4214worker2 # [ 65.801644] nix-grpc-daemon[813]: time=2026-09-20T12:48:35.315Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4215worker2 # [ 65.807895] nix-grpc-daemon[813]: time=2026-09-20T12:48:35.318Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4216lb # [ 65.777109] niks3-server[1053]: 2026/09/20 12:48:35 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4217worker2 # [ 65.862478] nix-grpc-daemon[813]: time=2026-09-20T12:48:35.376Z level=INFO msg="Uploading 1 narinfos"4218lb # [ 65.788677] niks3-server[1053]: 2026/09/20 12:48:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4219lb # [ 65.799065] niks3-server[1053]: 2026/09/20 12:48:35 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4220lb # [ 65.809721] niks3-server[1053]: 2026/09/20 12:48:35 INFO Signed narinfos id=16 count=14221lb # [ 65.820100] niks3-server[1053]: 2026/09/20 12:48:35 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4222lb # [ 65.825189] niks3-server[1053]: 2026/09/20 12:48:35 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4223lb # [ 65.830995] niks3-server[1053]: 2026/09/20 12:48:35 INFO Completed upload id=164224worker2 # [ 65.898450] nix-grpc-daemon[813]: time=2026-09-20T12:48:35.413Z level=INFO msg="Upload complete. (360ms)"4225lb # [ 65.835782] niks3-server[1053]: 2026/09/20 12:48:35 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4226worker2 # [ 65.913450] nix-grpc-daemon[777]: ts=2026-09-20T12:48:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14227worker2 # [ 65.929392] nix-daemon[803]: reaped child process 1081, status = succeeded4228worker1 # [ 65.942597] nix-grpc-daemon[775]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:464964229worker1 # [ 65.962619] nix-grpc-daemon[775]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4230worker1 # [ 66.009657] nix-grpc-daemon[775]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:464964231worker1 # [ 66.014945] nix-grpc-daemon[775]: ts=2026-09-20T12:48:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46496 duration_s=0 paths=1 nar_bytes_out=2324232client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.85 seconds)4233client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4234client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4235client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4236client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds)4237client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4238client # [ 66.270372] nix-daemon[939]: reaped child process 941, status = succeeded4239client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4240(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.00 seconds)4241subtest: an input only one worker has still reaches the builder4242client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4243client # this derivation will be built:4244client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4245client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4246client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.54 seconds)4247client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4248client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.23 seconds)4249worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4250worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.27 seconds)4251worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4252worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4253client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24254client # [ 67.589535] nix-daemon[939]: accepted connection from pid 1019, user root (trusted)4255client # this derivation will be built:4256client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4257worker1 # [ 67.821153] nix-grpc-daemon[775]: ts=2026-09-20T12:48:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:464964258client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4259worker1 # [ 67.829106] nix-grpc-daemon[775]: ts=2026-09-20T12:48:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:464964260worker1 # [ 68.041230] nix-daemon[838]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4261worker1 # [ 68.060672] nix-daemon[838]: reaped child process 980, status = succeeded4262lb # [ 68.022254] niks3-server[1053]: 2026/09/20 12:48:37 INFO Received uploads request method=POST path=/api/pending_closures4263worker1 # [ 68.115114] nix-grpc-daemon[889]: time=2026-09-20T12:48:37.628Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4264worker1 # [ 68.117451] nix-grpc-daemon[889]: time=2026-09-20T12:48:37.628Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4265lb # [ 68.087540] niks3-server[1053]: 2026/09/20 12:48:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4266worker1 # [ 68.149144] nix-grpc-daemon[889]: time=2026-09-20T12:48:37.662Z level=INFO msg="Uploading 1 narinfos"4267lb # [ 68.099681] niks3-server[1053]: 2026/09/20 12:48:37 INFO Signed narinfos id=17 count=14268lb # [ 68.108895] niks3-server[1053]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4269lb # [ 68.121162] niks3-server[1053]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4270lb # [ 68.129723] niks3-server[1053]: 2026/09/20 12:48:37 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4271lb # [ 68.138459] niks3-server[1053]: 2026/09/20 12:48:37 INFO Completed upload id=174272worker1 # [ 68.191331] nix-grpc-daemon[889]: time=2026-09-20T12:48:37.705Z level=INFO msg="Upload complete. (363ms)"4273lb # [ 68.145630] niks3-server[1053]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4274worker1 # [ 68.216295] nix-grpc-daemon[775]: ts=2026-09-20T12:48:37Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04275worker1 # [ 68.223999] nix-grpc-daemon[775]: ts=2026-09-20T12:48:37Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14276worker1 # [ 68.269911] nix-grpc-daemon[775]: ts=2026-09-20T12:48:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:464964277worker1 # [ 68.287531] nix-grpc-daemon[775]: ts=2026-09-20T12:48:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:464964278client # copying 2 paths to 'lb:50051'...4279client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4280client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4281worker1 # [ 68.307663] nix-grpc-daemon[775]: ts=2026-09-20T12:48:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:464964282worker1 # [ 68.321900] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4283worker1 # [ 68.538136] nix-daemon[838]: accepted connection from pid 986, user nix-grpc-daemon (trusted)4284worker1 # [ 68.558304] nix-daemon[838]: reaped child process 989, status = succeeded4285worker1 # [ 68.734428] nix-daemon[838]: accepted connection from pid 991, user nix-grpc-daemon (trusted)4286worker1 # [ 68.753120] nix-daemon[838]: reaped child process 994, status = succeeded4287lb # [ 68.712296] niks3-server[1053]: 2026/09/20 12:48:38 INFO Received uploads request method=POST path=/api/pending_closures4288lb # [ 68.898734] niks3-server[1053]: 2026/09/20 12:48:38 INFO Received uploads request method=POST path=/api/pending_closures4289worker1 # [ 68.964350] nix-grpc-daemon[889]: time=2026-09-20T12:48:38.476Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4290worker1 # [ 68.969078] nix-grpc-daemon[889]: time=2026-09-20T12:48:38.476Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4291worker1 # [ 68.974541] nix-grpc-daemon[889]: time=2026-09-20T12:48:38.476Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4292lb # [ 68.941741] niks3-server[1053]: 2026/09/20 12:48:38 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4293lb # [ 68.958498] niks3-server[1053]: 2026/09/20 12:48:38 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4294lb # [ 68.972796] niks3-server[1053]: 2026/09/20 12:48:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4295worker1 # [ 69.034507] nix-grpc-daemon[889]: time=2026-09-20T12:48:38.547Z level=INFO msg="Uploading 3 narinfos"4296lb # [ 68.984336] niks3-server[1053]: 2026/09/20 12:48:38 INFO Signed narinfos id=18 count=14297lb # [ 68.990898] niks3-server[1053]: 2026/09/20 12:48:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4298lb # [ 69.000660] niks3-server[1053]: 2026/09/20 12:48:38 INFO Signed narinfos id=19 count=24299lb # [ 69.006392] niks3-server[1053]: 2026/09/20 12:48:38 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4300lb # [ 69.014644] niks3-server[1053]: 2026/09/20 12:48:38 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4301lb # [ 69.031749] niks3-server[1053]: 2026/09/20 12:48:38 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4302lb # [ 69.038340] niks3-server[1053]: 2026/09/20 12:48:38 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4303lb # [ 69.041311] niks3-server[1053]: 2026/09/20 12:48:38 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4304lb # [ 69.044915] niks3-server[1053]: 2026/09/20 12:48:38 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4305lb # [ 69.048227] niks3-server[1053]: 2026/09/20 12:48:38 INFO Completed upload id=184306lb # [ 69.051168] niks3-server[1053]: 2026/09/20 12:48:38 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4307lb # [ 69.054626] niks3-server[1053]: 2026/09/20 12:48:38 INFO Completed upload id=194308worker1 # [ 69.107563] nix-grpc-daemon[889]: time=2026-09-20T12:48:38.621Z level=INFO msg="Upload complete. (765ms)"4309worker1 # [ 69.119242] nix-grpc-daemon[775]: ts=2026-09-20T12:48:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46496 duration_s=0 paths=2 nar_bytes_in=9844310worker1 # [ 69.136409] nix-grpc-daemon[775]: ts=2026-09-20T12:48:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:464964311worker1 # [ 69.150751] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4312worker1 # [ 69.155451] nix-daemon[838]: reaped child process 984, status = succeeded4313client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4314worker1 # [ 69.168355] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4315client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4316worker1 # [ 70.221854] nix-daemon[838]: reaped child process 998, status = succeeded4317worker1 # [ 70.401139] nix-daemon[838]: accepted connection from pid 1013, user nix-grpc-daemon (trusted)4318worker1 # [ 70.419981] nix-daemon[838]: reaped child process 1016, status = succeeded4319lb # [ 70.380825] niks3-server[1053]: 2026/09/20 12:48:39 INFO Received uploads request method=POST path=/api/pending_closures4320worker1 # [ 70.444968] nix-grpc-daemon[889]: time=2026-09-20T12:48:39.957Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4321lb # [ 70.415458] niks3-server[1053]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4322worker1 # [ 70.483052] nix-grpc-daemon[889]: time=2026-09-20T12:48:39.996Z level=INFO msg="Uploading 1 narinfos"4323lb # [ 70.423933] niks3-server[1053]: 2026/09/20 12:48:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4324lb # [ 70.435425] niks3-server[1053]: 2026/09/20 12:48:39 INFO Signed narinfos id=20 count=14325lb # [ 70.442432] niks3-server[1053]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4326lb # [ 70.455016] niks3-server[1053]: 2026/09/20 12:48:39 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4327lb # [ 70.460068] niks3-server[1053]: 2026/09/20 12:48:39 INFO Completed upload id=204328worker1 # [ 70.512398] nix-grpc-daemon[889]: time=2026-09-20T12:48:40.026Z level=INFO msg="Upload complete. (328ms)"4329lb # [ 70.462813] niks3-server[1053]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4330worker1 # [ 70.525230] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46496 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14331worker1 # [ 70.543706] nix-daemon[838]: reaped child process 996, status = succeeded4332client # copying 1 paths...4333worker1 # [ 70.568790] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:464964334client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4335worker1 # [ 70.599839] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:464964336worker1 # [ 70.605384] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46496 duration_s=0 paths=1 nar_bytes_out=1204337client # [ 70.709052] nix-daemon[939]: reaped child process 1022, status = succeeded4338client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.36 seconds)4339client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24340client # [ 70.933186] nix-daemon[939]: accepted connection from pid 1040, user root (trusted)4341lb # [ 71.368429] envoy[922]: conn peer=[2001:db8:1::1]:34504 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3901 tx=1967 ms=25264342lb # [ 71.368783] envoy[922]: conn peer=[2001:db8:1::1]:34506 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=694343lb # [ 71.368894] envoy[922]: conn peer=[2001:db8:1::1]:34518 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2225 ms=22834344lb # [ 71.369019] envoy[922]: conn peer=[2001:db8:1::1]:34520 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=694345lb # [ 71.369121] envoy[922]: conn peer=[2001:db8:1::1]:34524 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3863 tx=1785 ms=28384346lb # [ 71.369215] envoy[922]: conn peer=[2001:db8:1::1]:34526 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=654347client # this derivation will be built:4348client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4349worker1 # [ 71.861094] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:464964350client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4351worker1 # [ 71.869983] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:464964352worker1 # [ 71.877756] nix-grpc-daemon[889]: time=2026-09-20T12:48:41.389Z level=INFO msg="All 1 paths already cached"4353worker1 # [ 71.891995] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04354worker2 # [ 71.913935] nix-grpc-daemon[777]: ts=2026-09-20T12:48:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568224355worker1 # [ 71.898832] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14356worker2 # [ 71.930447] nix-grpc-daemon[777]: ts=2026-09-20T12:48:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568224357client # copying 1 paths to 'lb:50051'...4358client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4359worker2 # [ 71.954786] nix-grpc-daemon[777]: ts=2026-09-20T12:48:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568224360worker2 # [ 71.970706] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4361worker2 # [ 71.994529] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5)4362worker2 # [ 72.044532] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 2/5)4363worker2 # [ 72.060821] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 3/5)4364worker2 # [ 72.077277] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 448 ms (attempt 4/5)4365worker2 # [ 72.533730] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4366worker2 # [ 72.543814] nix-grpc-daemon[777]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4367worker2 # [ 72.773132] nix-daemon[803]: accepted connection from pid 1112, user nix-grpc-daemon (trusted)4368worker2 # [ 72.793226] nix-daemon[803]: reaped child process 1115, status = succeeded4369worker2 # [ 72.974661] nix-daemon[803]: accepted connection from pid 1117, user nix-grpc-daemon (trusted)4370worker2 # [ 72.994309] nix-daemon[803]: reaped child process 1120, status = succeeded4371lb # [ 72.940802] niks3-server[1053]: 2026/09/20 12:48:42 INFO Received uploads request method=POST path=/api/pending_closures4372worker2 # [ 73.020530] nix-grpc-daemon[813]: time=2026-09-20T12:48:42.534Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4373worker2 # [ 73.022136] nix-grpc-daemon[813]: time=2026-09-20T12:48:42.534Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4374lb # [ 72.980472] niks3-server[1053]: 2026/09/20 12:48:42 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4375worker2 # [ 73.067037] nix-grpc-daemon[813]: time=2026-09-20T12:48:42.581Z level=INFO msg="Uploading 1 narinfos"4376lb # [ 72.999352] niks3-server[1053]: 2026/09/20 12:48:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4377lb # [ 73.007053] niks3-server[1053]: 2026/09/20 12:48:42 INFO Signed narinfos id=21 count=14378lb # [ 73.014795] niks3-server[1053]: 2026/09/20 12:48:42 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4379lb # [ 73.024967] niks3-server[1053]: 2026/09/20 12:48:42 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4380lb # [ 73.034326] niks3-server[1053]: 2026/09/20 12:48:42 INFO Completed upload id=214381worker2 # [ 73.101154] nix-grpc-daemon[813]: time=2026-09-20T12:48:42.615Z level=INFO msg="Upload complete. (532ms)"4382lb # [ 73.037250] niks3-server[1053]: 2026/09/20 12:48:42 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4383worker2 # [ 73.114250] nix-grpc-daemon[777]: ts=2026-09-20T12:48:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=1 paths=1 nar_bytes_in=5684384worker2 # [ 73.123135] nix-grpc-daemon[777]: ts=2026-09-20T12:48:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568224385worker2 # [ 73.134961] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4386worker2 # [ 73.139592] nix-daemon[803]: reaped child process 1106, status = succeeded4387worker2 # [ 73.157996] nix-grpc-daemon[777]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4388client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4389worker2 # [ 73.178362] nix-daemon[803]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4390client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4391worker2 # [ 74.034458] nix-daemon[803]: reaped child process 1125, status = succeeded4392worker2 # [ 74.235403] nix-daemon[803]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)4393worker2 # [ 74.256761] nix-daemon[803]: reaped child process 1143, status = succeeded4394lb # [ 74.203871] niks3-server[1053]: 2026/09/20 12:48:43 INFO Received uploads request method=POST path=/api/pending_closures4395worker2 # [ 74.300737] nix-grpc-daemon[813]: time=2026-09-20T12:48:43.813Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4396lb # [ 74.261133] niks3-server[1053]: 2026/09/20 12:48:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4397worker2 # [ 74.337660] nix-grpc-daemon[813]: time=2026-09-20T12:48:43.851Z level=INFO msg="Uploading 1 narinfos"4398lb # [ 74.272568] niks3-server[1053]: 2026/09/20 12:48:43 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4399lb # [ 74.284941] niks3-server[1053]: 2026/09/20 12:48:43 INFO Signed narinfos id=22 count=14400lb # [ 74.292791] niks3-server[1053]: 2026/09/20 12:48:43 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4401lb # [ 74.300436] niks3-server[1053]: 2026/09/20 12:48:43 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4402lb # [ 74.318923] niks3-server[1053]: 2026/09/20 12:48:43 INFO Completed upload id=224403worker2 # [ 74.385969] nix-grpc-daemon[813]: time=2026-09-20T12:48:43.900Z level=INFO msg="Upload complete. (392ms)"4404lb # [ 74.330617] niks3-server[1053]: 2026/09/20 12:48:43 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4405worker2 # [ 74.397419] nix-grpc-daemon[777]: ts=2026-09-20T12:48:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14406worker2 # [ 74.421052] nix-daemon[803]: reaped child process 1122, status = succeeded4407client # copying 1 paths...4408worker1 # [ 74.435909] nix-grpc-daemon[775]: ts=2026-09-20T12:48:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:464964409worker1 # [ 74.452771] nix-grpc-daemon[775]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4410client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4411worker2 # [ 74.523225] nix-grpc-daemon[777]: ts=2026-09-20T12:48:44Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:568224412worker2 # [ 74.533749] nix-grpc-daemon[777]: ts=2026-09-20T12:48:44Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=0 paths=1 nar_bytes_out=1204413client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.87 seconds)4414client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24415client # [ 74.719674] nix-daemon[939]: reaped child process 1043, status = succeeded4416client # [ 74.809763] nix-daemon[939]: accepted connection from pid 1061, user root (trusted)4417client # this derivation will be built:4418client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4419client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4420worker2 # [ 75.055266] nix-grpc-daemon[777]: ts=2026-09-20T12:48:44Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:568224421worker2 # [ 75.063563] nix-grpc-daemon[777]: ts=2026-09-20T12:48:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568224422worker2 # [ 75.071142] nix-grpc-daemon[813]: time=2026-09-20T12:48:44.584Z level=INFO msg="All 1 paths already cached"4423worker1 # [ 75.072352] nix-grpc-daemon[775]: ts=2026-09-20T12:48:44Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04424worker1 # [ 75.080492] nix-grpc-daemon[775]: ts=2026-09-20T12:48:44Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14425worker1 # [ 75.089191] nix-grpc-daemon[775]: ts=2026-09-20T12:48:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:464964426worker1 # [ 75.106583] nix-grpc-daemon[775]: ts=2026-09-20T12:48:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:464964427worker1 # [ 75.127150] nix-grpc-daemon[889]: time=2026-09-20T12:48:44.639Z level=INFO msg="All 1 paths already cached"4428client # copying 1 paths to 'lb:50051'...4429client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4430worker1 # [ 75.140140] nix-grpc-daemon[775]: ts=2026-09-20T12:48:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:464964431worker1 # [ 75.157124] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4432worker1 # [ 75.379447] nix-daemon[838]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4433worker1 # [ 75.401059] nix-daemon[838]: reaped child process 1028, status = succeeded4434worker1 # [ 75.578944] nix-daemon[838]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4435worker1 # [ 75.598645] nix-daemon[838]: reaped child process 1033, status = succeeded4436lb # [ 75.562265] niks3-server[1053]: 2026/09/20 12:48:45 INFO Received uploads request method=POST path=/api/pending_closures4437worker1 # [ 75.625145] nix-grpc-daemon[889]: time=2026-09-20T12:48:45.138Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4438worker1 # [ 75.626692] nix-grpc-daemon[889]: time=2026-09-20T12:48:45.139Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4439lb # [ 75.599202] niks3-server[1053]: 2026/09/20 12:48:45 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4440worker1 # [ 75.673096] nix-grpc-daemon[889]: time=2026-09-20T12:48:45.186Z level=INFO msg="Uploading 1 narinfos"4441lb # [ 75.613978] niks3-server[1053]: 2026/09/20 12:48:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4442lb # [ 75.626788] niks3-server[1053]: 2026/09/20 12:48:45 INFO Signed narinfos id=23 count=14443lb # [ 75.631926] niks3-server[1053]: 2026/09/20 12:48:45 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4444worker1 # [ 75.692169] nix-grpc-daemon[889]: time=2026-09-20T12:48:45.206Z level=INFO msg="Upload complete. (511ms)"4445lb # [ 75.641189] niks3-server[1053]: 2026/09/20 12:48:45 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4446lb # [ 75.646672] niks3-server[1053]: 2026/09/20 12:48:45 INFO Completed upload id=234447worker1 # [ 75.700845] nix-grpc-daemon[775]: ts=2026-09-20T12:48:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46496 duration_s=0 paths=1 nar_bytes_in=5684448lb # [ 75.650241] niks3-server[1053]: 2026/09/20 12:48:45 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4449worker1 # [ 75.716377] nix-grpc-daemon[775]: ts=2026-09-20T12:48:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:464964450worker1 # [ 75.723239] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4451worker1 # [ 75.731100] nix-daemon[838]: reaped child process 1023, status = succeeded4452worker1 # [ 75.742929] nix-daemon[838]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4453client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4454client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4455worker1 # [ 76.596652] nix-daemon[838]: reaped child process 1037, status = succeeded4456worker1 # [ 76.779993] nix-daemon[838]: accepted connection from pid 1052, user nix-grpc-daemon (trusted)4457worker1 # [ 76.800461] nix-daemon[838]: reaped child process 1055, status = succeeded4458lb # [ 76.761590] niks3-server[1053]: 2026/09/20 12:48:46 INFO Received uploads request method=POST path=/api/pending_closures4459worker1 # [ 76.829552] nix-grpc-daemon[889]: time=2026-09-20T12:48:46.343Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4460lb # [ 76.800805] niks3-server[1053]: 2026/09/20 12:48:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4461worker1 # [ 76.864185] nix-grpc-daemon[889]: time=2026-09-20T12:48:46.377Z level=INFO msg="Uploading 1 narinfos"4462lb # [ 76.818622] niks3-server[1053]: 2026/09/20 12:48:46 INFO Signed narinfos id=24 count=14463lb # [ 76.830688] niks3-server[1053]: 2026/09/20 12:48:46 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4464lb # [ 76.840383] niks3-server[1053]: 2026/09/20 12:48:46 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4465lb # [ 76.848696] niks3-server[1053]: 2026/09/20 12:48:46 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4466worker1 # [ 76.907661] nix-grpc-daemon[889]: time=2026-09-20T12:48:46.421Z level=INFO msg="Upload complete. (350ms)"4467lb # [ 76.857709] niks3-server[1053]: 2026/09/20 12:48:46 INFO Completed upload id=244468lb # [ 76.863810] niks3-server[1053]: 2026/09/20 12:48:46 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4469worker1 # [ 76.921348] nix-grpc-daemon[775]: ts=2026-09-20T12:48:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46496 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14470worker1 # [ 76.940553] nix-daemon[838]: reaped child process 1035, status = succeeded4471client # copying 1 paths...4472worker1 # [ 76.968084] nix-grpc-daemon[775]: ts=2026-09-20T12:48:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:464964473client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4474worker2 # [ 77.016727] nix-grpc-daemon[777]: ts=2026-09-20T12:48:46Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:568224475worker2 # [ 77.033020] nix-grpc-daemon[777]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4476worker2 # [ 77.053207] nix-grpc-daemon[777]: ts=2026-09-20T12:48:46Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56822 duration_s=0 paths=1 nar_bytes_out=1204477client # [ 77.153863] nix-daemon[939]: reaped child process 1064, status = succeeded4478client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.58 seconds)4479(finished: subtest: an input only one worker has still reaches the builder, in 10.88 seconds)4480subtest: upload whose reference the worker lacks is completed from the cache4481client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4482client # this derivation will be built:4483client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4484client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4485client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.48 seconds)4486client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4487client # this derivation will be built:4488client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4489client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4490client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.47 seconds)4491client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4492client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.22 seconds)4493worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4494worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.26 seconds)4495worker2 # [ 78.709109] systemd[1]: Stopping Nix worker-protocol over gRPC...4496worker2 # [ 78.929734] nix-grpc-daemon[777]: ts=2026-09-20T12:48:48Z level=info event=signal_exit4497worker1 # [ 78.932516] nix-grpc-daemon[775]: ts=2026-09-20T12:48:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:377364498worker1 # [ 78.932860] nix-grpc-daemon[775]: ts=2026-09-20T12:48:48Z level=info event=worker_gone addr=192.168.1.4:500514499worker2 # [ 78.965519] nix-grpc-daemon[777]: ts=2026-09-20T12:48:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4500worker2 # [ 78.990750] nix-daemon[803]: reaped child process 806, status = succeeded4501worker2 # [ 79.006038] nix-grpc-daemon[777]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4502worker2 # [ 79.010844] nix-grpc-daemon[777]: E0000 00:00:1789908528.520431 788 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true4503worker2 # [ 80.377913] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4504worker2 # [ 80.381959] systemd[1]: Stopped Nix worker-protocol over gRPC.4505worker2 # [ 80.390540] systemd[1]: nix-grpc-daemon.service: Consumed 3.415s CPU time over 58.789s wall clock time, 57.6M memory peak, 76.6K incoming IP traffic, 135.7K outgoing IP traffic.4506worker2 # [ 80.402194] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4507worker2 # [ 80.408195] systemd[1]: Closed Nix worker-protocol over gRPC.4508worker2 # [ 80.410890] systemd[1]: nix-grpc-daemon.socket: Consumed 625us CPU time over 1min 8.420s wall clock time, 256K memory peak, 54.6K incoming IP traffic, 41.9K outgoing IP traffic.4509lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4510lb: must succeed: curl -sf localhost:9901/clusters4511lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4512lb # [ 81.367579] envoy[922]: conn peer=[2001:db8:1::1]:44494 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3724 tx=1919 ms=26794513lb # [ 81.372743] envoy[922]: conn peer=[2001:db8:1::1]:44508 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=329 ms=384514lb # [ 81.377476] envoy[922]: conn peer=[2001:db8:1::1]:44522 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1779 ms=20594515lb # [ 81.382258] envoy[922]: conn peer=[2001:db8:1::1]:44526 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1064516lb # [ 81.387167] envoy[922]: conn peer=[2001:db8:1::4]:36058 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2531 tx=816 ms=570454517lb: must succeed: curl -sf localhost:9901/clusters4518lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4519lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 1.17 seconds)4520client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24521worker1 # [ 81.830956] nix-grpc-daemon[775]: ts=2026-09-20T12:48:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:464964522worker1 # [ 81.841074] nix-grpc-daemon[775]: ts=2026-09-20T12:48:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:464964523client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4524client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.31 seconds)4525worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4526worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4527worker2 # [ 82.002557] systemd[1]: Listening on Nix worker-protocol over gRPC.4528worker1 # [ 82.073802] systemd[1]: Stopping Nix worker-protocol over gRPC...4529worker2 # [ 82.368764] systemd[1]: Starting scheduler-token.service...4530worker2 # [ 82.473188] systemd[1]: scheduler-token.service: Deactivated successfully.4531worker2 # [ 82.477796] systemd[1]: Finished scheduler-token.service.4532worker2 # [ 82.479580] systemd[1]: scheduler-token.service: Consumed 54ms CPU time over 108ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4533worker2 # [ 82.490616] systemd[1]: Starting Nix worker-protocol over gRPC...4534worker2 # [ 82.678964] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4535worker2 # [ 82.681524] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4536worker2 # [ 82.683585] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:52Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14537worker2 # [ 82.691355] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4538worker2 # [ 82.698778] systemd[1]: Started Nix worker-protocol over gRPC.4539worker2 # [ 82.712550] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:52Z level=info event=scheduler_connected addr=lb:500514540worker1 # [ 82.701046] nix-grpc-daemon[775]: ts=2026-09-20T12:48:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:377364541worker1 # [ 82.706842] nix-grpc-daemon[775]: ts=2026-09-20T12:48:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04542worker1 # [ 82.768282] nix-grpc-daemon[775]: ts=2026-09-20T12:48:52Z level=info event=signal_exit4543worker2 # [ 82.784050] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:52Z level=info event=scheduler_restarting addr=lb:500514544worker1 # [ 82.781429] nix-grpc-daemon[775]: ts=2026-09-20T12:48:52Z level=info event=scheduler_restarting4545worker1 # [ 82.785549] nix-grpc-daemon[775]: ts=2026-09-20T12:48:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:377364546worker1 # [ 82.790494] nix-grpc-daemon[775]: ts=2026-09-20T12:48:52Z level=info event=worker_gone addr=192.168.1.4:500514547worker1 # [ 82.794946] nix-grpc-daemon[775]: ts=2026-09-20T12:48:52Z level=info event=scheduler_restarting addr=lb:500514548worker1 # [ 82.800516] nix-grpc-daemon[775]: ts=2026-09-20T12:48:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:377364549worker1 # [ 82.805157] nix-grpc-daemon[775]: ts=2026-09-20T12:48:52Z level=info event=worker_gone addr=192.168.1.3:500514550worker1 # [ 82.828532] nix-daemon[838]: reaped child process 840, status = succeeded4551worker1 # [ 82.893886] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4552worker1 # [ 82.898504] nix-grpc-daemon[775]: E0000 00:00:1789908532.406574 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true4553worker1 # [ 82.904942] nix-grpc-daemon[775]: E0000 00:00:1789908532.406797 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4554worker2 # [ 82.985630] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:52Z level=info event=scheduler_connected addr=lb:500514555worker1 # [ 82.973271] nix-grpc-daemon[775]: E0000 00:00:1789908532.487029 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4556worker1 # [ 83.000635] nix-grpc-daemon[775]: ts=2026-09-20T12:48:52Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4557worker2 # [ 84.292336] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:53Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4558worker1 # [ 84.296347] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4559worker1 # [ 84.302826] systemd[1]: Stopped Nix worker-protocol over gRPC.4560worker1 # [ 84.309058] systemd[1]: nix-grpc-daemon.service: Consumed 2.009s CPU time over 1min 2.877s wall clock time, 51.8M memory peak, 49.4K incoming IP traffic, 89.1K outgoing IP traffic.4561worker1 # [ 84.324969] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4562worker1 # [ 84.327184] systemd[1]: Closed Nix worker-protocol over gRPC.4563worker1 # [ 84.329650] systemd[1]: nix-grpc-daemon.socket: Consumed 702us CPU time over 1min 12.399s wall clock time, 256K memory peak, 81.9K incoming IP traffic, 70K outgoing IP traffic.4564lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4565lb: must succeed: curl -sf localhost:9901/clusters4566lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4567worker2 # [ 84.492738] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:54Z level=info event=scheduler_connected addr=lb:500514568worker2 # [ 84.498577] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:54Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4569worker2 # [ 84.699797] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:54Z level=info event=scheduler_connected addr=lb:500514570worker2 # [ 84.706404] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:54Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4571worker2 # [ 84.906990] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:54Z level=info event=scheduler_connected addr=lb:500514572worker2 # [ 84.912937] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:54Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4573worker2 # [ 85.113993] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:54Z level=info event=scheduler_connected addr=lb:500514574worker2 # [ 85.119540] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:54Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4575worker2 # [ 85.322103] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:54Z level=info event=scheduler_connected addr=lb:500514576worker2 # [ 85.327441] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:54Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4577lb: must succeed: curl -sf localhost:9901/clusters4578lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4579lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 1.16 seconds)4580client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24581worker2 # [ 85.529087] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=info event=scheduler_connected addr=lb:500514582worker2 # [ 85.534516] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4583worker2 # [ 85.735561] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=info event=scheduler_connected addr=lb:500514584worker2 # [ 85.741162] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4585worker2 # [ 85.779602] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473684586worker2 # [ 85.794361] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4587worker2 # [ 85.825682] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5)4588worker2 # [ 85.923027] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 2/5)4589worker2 # [ 85.942319] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=info event=scheduler_connected addr=lb:500514590worker2 # [ 85.947786] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4591worker2 # [ 85.993066] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 116 ms (attempt 3/5)4592worker2 # [ 86.116590] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 225 ms (attempt 4/5)4593worker2 # [ 86.148974] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=info event=scheduler_connected addr=lb:500514594worker2 # [ 86.154320] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4595worker2 # [ 86.350831] nix-grpc-daemon[1168]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4596worker2 # [ 86.361135] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=info event=scheduler_connected addr=lb:500514597worker2 # [ 86.367681] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4598client # copying 2 paths...4599client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4600worker2 # [ 86.388936] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473684601client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4602worker2 # [ 86.411168] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4603worker2 # [ 86.440879] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:55Z level=info event=niks3_push_started pid=11894604worker2 # [ 86.567973] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:56Z level=info event=scheduler_connected addr=lb:500514605worker2 # [ 86.571058] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:56Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4606worker2 # [ 86.664510] nix-grpc-daemon[1189]: time=2026-09-20T12:48:56.178Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4607worker2 # [ 86.772263] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:56Z level=info event=scheduler_connected addr=lb:500514608worker2 # [ 86.775037] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:56Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4609worker2 # [ 86.852643] nix-daemon[803]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4610worker2 # [ 86.871983] nix-daemon[803]: reaped child process 1205, status = succeeded4611lb # [ 86.818789] niks3-server[1053]: 2026/09/20 12:48:56 INFO Received uploads request method=POST path=/api/pending_closures4612lb # [ 86.829222] niks3-server[1053]: 2026/09/20 12:48:56 INFO Received uploads request method=POST path=/api/pending_closures4613worker2 # [ 86.907958] nix-grpc-daemon[1189]: time=2026-09-20T12:48:56.420Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4614worker2 # [ 86.909542] nix-grpc-daemon[1189]: time=2026-09-20T12:48:56.420Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4615worker2 # [ 86.911279] nix-grpc-daemon[1189]: time=2026-09-20T12:48:56.420Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4616lb # [ 86.880677] niks3-server[1053]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4617lb # [ 86.892636] niks3-server[1053]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4618lb # [ 86.906243] niks3-server[1053]: 2026/09/20 12:48:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4619worker2 # [ 86.976167] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:56Z level=info event=scheduler_connected addr=lb:500514620lb # [ 86.917124] niks3-server[1053]: 2026/09/20 12:48:56 INFO Signed narinfos id=26 count=24621worker2 # [ 86.983889] nix-grpc-daemon[1189]: time=2026-09-20T12:48:56.496Z level=INFO msg="Uploading 3 narinfos"4622lb # [ 86.919102] niks3-server[1053]: 2026/09/20 12:48:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4623worker2 # [ 86.987272] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:56Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4624lb # [ 86.930661] niks3-server[1053]: 2026/09/20 12:48:56 INFO Signed narinfos id=25 count=14625lb # [ 86.935856] niks3-server[1053]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4626lb # [ 86.942120] niks3-server[1053]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4627lb # [ 86.958242] niks3-server[1053]: 2026/09/20 12:48:56 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4628lb # [ 86.966070] niks3-server[1053]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4629lb # [ 86.970853] niks3-server[1053]: 2026/09/20 12:48:56 INFO Completed upload id=254630lb # [ 86.972701] niks3-server[1053]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4631lb # [ 86.975602] niks3-server[1053]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4632worker2 # [ 87.043174] nix-grpc-daemon[1189]: time=2026-09-20T12:48:56.557Z level=INFO msg="Upload complete. (374ms)"4633lb # [ 86.978662] niks3-server[1053]: 2026/09/20 12:48:56 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4634lb # [ 86.981423] niks3-server[1053]: 2026/09/20 12:48:56 INFO Completed upload id=264635worker2 # [ 87.056362] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47368 duration_s=0 paths=2 nar_bytes_in=3124636worker2 # [ 87.070159] nix-daemon[803]: reaped child process 1187, status = succeeded4637client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.58 seconds)4638worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4639worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4640worker2 # [ 87.188268] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:56Z level=info event=scheduler_connected addr=lb:500514641worker2 # [ 87.193680] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:56Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4642worker1 # [ 87.208960] systemd[1]: Listening on Nix worker-protocol over gRPC.4643worker1 # [ 87.215315] systemd[1]: Starting Nix worker-protocol over gRPC...4644worker2 # [ 87.396287] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:56Z level=info event=scheduler_connected addr=lb:500514645worker1 # [ 87.412920] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:56Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4646worker1 # [ 87.414709] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4647worker1 # [ 87.418837] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14648worker1 # [ 87.427488] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:56Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4649worker1 # [ 87.438749] systemd[1]: Started Nix worker-protocol over gRPC.4650lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4651lb: must succeed: curl -sf localhost:9901/clusters4652worker1 # [ 87.465095] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:56Z level=info event=oidc_jwks provider=mock keys=14653worker1 # [ 87.467101] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:56Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:444624654worker1 # [ 87.471607] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:56Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04655worker1 # [ 87.476300] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:56Z level=info event=scheduler_connected addr=lb:500514656worker1 # [ 87.480414] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:56Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:444624657worker1 # [ 87.482012] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04658lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4659lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4660(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.35 seconds)4661subtest: scheduler down: builds wait, then resume when it is back4662worker1 # [ 87.588933] systemd[1]: Stopping Nix worker-protocol over gRPC...4663worker1 # [ 88.433995] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:57Z level=info event=signal_exit4664worker2 # [ 88.450980] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:57Z level=info event=scheduler_restarting addr=lb:500514665worker1 # [ 88.434340] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:57Z level=info event=scheduler_restarting4666worker1 # [ 88.434534] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:57Z level=info event=scheduler_restarting addr=lb:500514667worker1 # [ 88.434667] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:444624668worker1 # [ 88.434810] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:57Z level=info event=worker_gone addr=192.168.1.3:500514669worker1 # [ 88.455245] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:444624670worker1 # [ 88.460695] nix-grpc-daemon[1078]: ts=2026-09-20T12:48:57Z level=info event=worker_gone addr=192.168.1.4:500514671worker1 # [ 88.472850] nix-grpc-daemon[1078]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4672worker1 # [ 88.477371] nix-grpc-daemon[1078]: E0000 00:00:1789908537.986419 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true4673worker1 # [ 88.483766] nix-grpc-daemon[1078]: E0000 00:00:1789908537.986673 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4674worker2 # [ 88.651381] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:58Z level=info event=scheduler_connected addr=lb:500514675worker1 # [ 88.638442] nix-grpc-daemon[1078]: E0000 00:00:1789908538.152206 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4676worker2 # [ 89.447529] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:58Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4677worker1 # [ 89.456559] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4678worker1 # [ 89.460783] systemd[1]: Stopped Nix worker-protocol over gRPC.4679worker1 # [ 89.463234] systemd[1]: nix-grpc-daemon.service: Consumed 158ms CPU time over 2.237s wall clock time, 10.6M memory peak, 8.1K incoming IP traffic, 5.8K outgoing IP traffic.4680worker1 # [ 89.479755] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4681worker1 # [ 89.482697] systemd[1]: Closed Nix worker-protocol over gRPC.4682worker1 # [ 89.487273] systemd[1]: nix-grpc-daemon.socket: Consumed 939us CPU time over 2.282s wall clock time, 256K memory peak, 14.9K incoming IP traffic, 12.6K outgoing IP traffic.4683lb: waiting until exactly ['worker1'] endpoints of sched are unhealthy4684lb: must succeed: curl -sf localhost:9901/clusters4685lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4686worker2 # [ 89.650390] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:59Z level=info event=scheduler_connected addr=lb:500514687worker2 # [ 89.655859] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:59Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4688worker2 # [ 89.857064] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:59Z level=info event=scheduler_connected addr=lb:500514689worker2 # [ 89.862553] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:59Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4690worker2 # [ 90.063634] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:59Z level=info event=scheduler_connected addr=lb:500514691worker2 # [ 90.069219] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:59Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4692worker2 # [ 90.270463] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:59Z level=info event=scheduler_connected addr=lb:500514693worker2 # [ 90.275871] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:59Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4694worker2 # [ 90.476991] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:59Z level=info event=scheduler_connected addr=lb:500514695worker2 # [ 90.482340] nix-grpc-daemon[1168]: ts=2026-09-20T12:48:59Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4696lb: must succeed: curl -sf localhost:9901/clusters4697lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4698lb: (finished: waiting until exactly ['worker1'] endpoints of sched are unhealthy, in 1.16 seconds)4699client: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag schedback4700worker2 # [ 90.684760] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:00Z level=info event=scheduler_connected addr=lb:500514701worker2 # [ 90.689905] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:00Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4702client # [ 90.708886] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag schedback.4703client # Running as unit: waits.service; invocation ID: 54320aa40368476eb823780ec3eee1f14704client: (finished: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag schedback, in 0.09 seconds)4705??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.4706 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5734707client: must succeed: sleep 3.04708worker2 # [ 90.890821] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:00Z level=info event=scheduler_connected addr=lb:500514709worker2 # [ 90.896241] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:00Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4710worker2 # [ 90.993909] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473684711client # [ 90.968340] nix[1141]: don't know how to build these paths:4712client # [ 90.969318] nix[1141]: /nix/store/8rw7s32g8cymsrvjv7ivdg5f5aznrbhx-farm-top.drv4713worker2 # [ 91.007189] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473684714client # [ 90.991908] nix[1141]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting4715worker2 # [ 91.097284] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:00Z level=info event=scheduler_connected addr=lb:500514716worker2 # [ 91.102634] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:00Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4717worker2 # [ 91.303830] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:00Z level=info event=scheduler_connected addr=lb:500514718worker2 # [ 91.309281] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:00Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4719lb # [ 91.373243] envoy[922]: conn peer=[2001:db8:1::1]:36002 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=523 ms=334720lb # [ 91.378056] envoy[922]: conn peer=192.168.1.3:38984 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1159 tx=468 ms=603394721lb # [ 91.384367] envoy[922]: conn peer=[2001:db8:1::1]:36016 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1006 tx=305 ms=12934722lb # [ 91.391650] envoy[922]: conn peer=[2001:db8:1::3]:60582 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=488 tx=177 ms=11794723worker2 # [ 91.510129] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:01Z level=info event=scheduler_connected addr=lb:500514724worker2 # [ 91.515415] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:01Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4725client # [ 91.495660] nix[1141]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting4726worker2 # [ 91.718061] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:01Z level=info event=scheduler_connected addr=lb:500514727worker2 # [ 91.723366] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:01Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4728worker2 # [ 91.924539] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:01Z level=info event=scheduler_connected addr=lb:500514729worker2 # [ 91.929995] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:01Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4730worker2 # [ 92.131046] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:01Z level=info event=scheduler_connected addr=lb:500514731worker2 # [ 92.136646] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:01Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4732worker2 # [ 92.337769] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:01Z level=info event=scheduler_connected addr=lb:500514733worker2 # [ 92.343135] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:01Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4734client # [ 92.501044] nix[1141]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting4735worker2 # [ 92.544388] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:02Z level=info event=scheduler_connected addr=lb:500514736worker2 # [ 92.549708] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:02Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4737worker2 # [ 92.751764] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:02Z level=info event=scheduler_connected addr=lb:500514738worker2 # [ 92.756954] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:02Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4739worker2 # [ 92.958068] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:02Z level=info event=scheduler_connected addr=lb:500514740worker2 # [ 92.963387] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:02Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4741worker2 # [ 93.165023] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:02Z level=info event=scheduler_connected addr=lb:500514742worker2 # [ 93.170478] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:02Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4743worker2 # [ 93.371625] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:02Z level=info event=scheduler_connected addr=lb:500514744worker2 # [ 93.377111] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:02Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4745worker2 # [ 93.578102] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:03Z level=info event=scheduler_connected addr=lb:500514746worker2 # [ 93.583399] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:03Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4747worker2 # [ 93.785826] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:03Z level=info event=scheduler_connected addr=lb:500514748worker2 # [ 93.790938] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:03Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4749client: (finished: must succeed: sleep 3.0, in 3.06 seconds)4750client: must succeed: systemctl is-active waits4751client: (finished: must succeed: systemctl is-active waits, in 0.05 seconds)4752worker1 # [ 93.953088] systemd[1]: Listening on Nix worker-protocol over gRPC.4753worker1 # [ 93.959353] systemd[1]: Starting Nix worker-protocol over gRPC...4754worker2 # [ 93.992219] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:03Z level=info event=scheduler_connected addr=lb:500514755worker1 # [ 94.153551] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:03Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4756worker1 # [ 94.156996] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4757worker1 # [ 94.159342] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14758worker1 # [ 94.167597] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4759worker1 # [ 94.176726] systemd[1]: Started Nix worker-protocol over gRPC.4760lb: waiting until exactly no endpoints of sched are unhealthy4761lb: must succeed: curl -sf localhost:9901/clusters4762worker1 # [ 94.186793] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:03Z level=info event=oidc_jwks provider=mock keys=14763worker1 # [ 94.188400] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:03Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:461384764worker1 # [ 94.190046] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04765worker1 # [ 94.196720] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:03Z level=info event=scheduler_connected addr=lb:500514766worker1 # [ 94.198626] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:03Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:461384767worker1 # [ 94.200270] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04768lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4769worker1 # [ 94.530815] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:04Z level=debug event=want client=1 drv=dzfgls2vlaqhbbk5sskyi467xips00ac-farm-a.drv cached=04770worker1 # [ 94.536870] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:04Z level=debug event=assigned drv=dzfgls2vlaqhbbk5sskyi467xips00ac-farm-a.drv worker=192.168.1.4:50051 clients=14771worker2 # [ 94.595662] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473684772worker2 # [ 94.613176] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473684773client # [ 94.593325] nix[1141]: copying 1 paths to 'lb:50051'...4774worker2 # [ 94.628120] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473684775client # [ 94.598458] nix[1141]: copying path '/nix/store/dzfgls2vlaqhbbk5sskyi467xips00ac-farm-a.drv' to 'lb:50051'...4776worker2 # [ 94.643333] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4777worker2 # [ 94.859717] nix-daemon[803]: accepted connection from pid 1212, user nix-grpc-daemon (trusted)4778worker2 # [ 94.877391] nix-daemon[803]: reaped child process 1215, status = succeeded4779worker2 # [ 95.054813] nix-daemon[803]: accepted connection from pid 1217, user nix-grpc-daemon (trusted)4780worker2 # [ 95.072448] nix-daemon[803]: reaped child process 1220, status = succeeded4781lb # [ 95.017450] niks3-server[1053]: 2026/09/20 12:49:04 INFO Received uploads request method=POST path=/api/pending_closures4782worker2 # [ 95.094708] nix-grpc-daemon[1189]: time=2026-09-20T12:49:04.608Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4783worker2 # [ 95.096274] nix-grpc-daemon[1189]: time=2026-09-20T12:49:04.608Z level=INFO msg="Uploading dzfgls2vlaqhbbk5sskyi467xips00ac-farm-a.drv (520B)"4784lb # [ 95.047442] niks3-server[1053]: 2026/09/20 12:49:04 INFO Registered completed upload object_key=nar/0afw7dyqzl1zkf57qy40rl4fdsl0fk39ah525h04mls8d7356jkm.nar.zst4785worker2 # [ 95.131995] nix-grpc-daemon[1189]: time=2026-09-20T12:49:04.646Z level=INFO msg="Uploading 1 narinfos"4786lb # [ 95.064299] niks3-server[1053]: 2026/09/20 12:49:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4787lb # [ 95.076342] niks3-server[1053]: 2026/09/20 12:49:04 INFO Signed narinfos id=27 count=14788lb # [ 95.083317] niks3-server[1053]: 2026/09/20 12:49:04 INFO Registered completed upload object_key=dzfgls2vlaqhbbk5sskyi467xips00ac.ls4789lb # [ 95.092321] niks3-server[1053]: 2026/09/20 12:49:04 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4790worker2 # [ 95.166308] nix-grpc-daemon[1189]: time=2026-09-20T12:49:04.680Z level=INFO msg="Upload complete. (505ms)"4791lb # [ 95.099722] niks3-server[1053]: 2026/09/20 12:49:04 INFO Completed upload id=274792worker2 # [ 95.174559] nix-grpc-daemon[1189]: time=2026-09-20T12:49:04.684Z level=WARN msg="Failed to register uploaded object" key=dzfgls2vlaqhbbk5sskyi467xips00ac.narinfo error="server returned 404: object is not pending upload\n"4793worker2 # [ 95.188715] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47368 duration_s=0 paths=1 nar_bytes_in=5204794worker2 # [ 95.193397] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473684795worker2 # [ 95.200298] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4796worker2 # [ 95.203549] nix-daemon[803]: reaped child process 1210, status = succeeded4797worker2 # [ 95.213198] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4798client # [ 95.178146] nix[1141]: building '/nix/store/dzfgls2vlaqhbbk5sskyi467xips00ac-farm-a.drv' on lb:50051...4799lb: must succeed: curl -sf localhost:9901/clusters4800lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4801lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 1.18 seconds)4802client: waiting for success: ! systemctl is-active waits4803worker2 # [ 96.241022] nix-daemon[803]: reaped child process 1224, status = succeeded4804worker2 # [ 96.407096] nix-daemon[803]: accepted connection from pid 1239, user nix-grpc-daemon (trusted)4805worker2 # [ 96.425814] nix-daemon[803]: reaped child process 1242, status = succeeded4806lb # [ 96.373201] niks3-server[1053]: 2026/09/20 12:49:05 INFO Received uploads request method=POST path=/api/pending_closures4807worker2 # [ 96.451488] nix-grpc-daemon[1189]: time=2026-09-20T12:49:05.963Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4808worker2 # [ 96.453228] nix-grpc-daemon[1189]: time=2026-09-20T12:49:05.963Z level=INFO msg="Uploading kkr6i9vbhy9k26salqm9cilwn709akgd-farm-a (136B)"4809lb # [ 96.405905] niks3-server[1053]: 2026/09/20 12:49:05 INFO Registered completed upload object_key=log/dzfgls2vlaqhbbk5sskyi467xips00ac-farm-a.drv4810lb # [ 96.419915] niks3-server[1053]: 2026/09/20 12:49:05 INFO Registered completed upload object_key=nar/0857pwr5xvcgvis5zd1wyn7l7dm0a00lpfjkz94axr76vhy2l88g.nar.zst4811lb # [ 96.433924] niks3-server[1053]: 2026/09/20 12:49:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4812worker2 # [ 96.506585] nix-grpc-daemon[1189]: time=2026-09-20T12:49:06.020Z level=INFO msg="Uploading 1 narinfos"4813lb # [ 96.443836] niks3-server[1053]: 2026/09/20 12:49:05 INFO Signed narinfos id=28 count=14814lb # [ 96.449299] niks3-server[1053]: 2026/09/20 12:49:05 INFO Registered completed upload object_key=kkr6i9vbhy9k26salqm9cilwn709akgd.ls4815lb # [ 96.456624] niks3-server[1053]: 2026/09/20 12:49:05 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4816lb # [ 96.464294] niks3-server[1053]: 2026/09/20 12:49:05 INFO Registered completed upload object_key=kkr6i9vbhy9k26salqm9cilwn709akgd.narinfo4817lb # [ 96.468734] niks3-server[1053]: 2026/09/20 12:49:05 INFO Completed upload id=284818worker2 # [ 96.535884] nix-grpc-daemon[1189]: time=2026-09-20T12:49:06.050Z level=INFO msg="Upload complete. (310ms)"4819worker2 # [ 96.549191] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47368 duration_s=1 drv=dzfgls2vlaqhbbk5sskyi467xips00ac-farm-a.drv assign_id=1 outputs=14820worker1 # [ 96.540501] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:06Z level=debug event=want client=1 drv=0d5zhxgph6fsfrwbx3iffkfcwzlpd5vf-farm-b.drv cached=04821worker1 # [ 96.540826] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:06Z level=debug event=assigned drv=0d5zhxgph6fsfrwbx3iffkfcwzlpd5vf-farm-b.drv worker=192.168.1.4:50051 clients=14822worker2 # [ 96.565980] nix-daemon[803]: reaped child process 1222, status = succeeded4823worker2 # [ 96.600297] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473684824worker2 # [ 96.615847] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473684825worker2 # [ 96.630771] nix-grpc-daemon[1189]: time=2026-09-20T12:49:06.145Z level=INFO msg="All 1 paths already cached"4826client # [ 96.607227] nix[1141]: copying 1 paths to 'lb:50051'...4827worker2 # [ 96.639896] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473684828client # [ 96.610308] nix[1141]: copying path '/nix/store/0d5zhxgph6fsfrwbx3iffkfcwzlpd5vf-farm-b.drv' to 'lb:50051'...4829worker2 # [ 96.659647] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4830worker2 # [ 96.875767] nix-daemon[803]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)4831worker2 # [ 96.894242] nix-daemon[803]: reaped child process 1249, status = succeeded4832worker2 # [ 97.075506] nix-daemon[803]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)4833worker2 # [ 97.096379] nix-daemon[803]: reaped child process 1254, status = succeeded4834lb # [ 97.043500] niks3-server[1053]: 2026/09/20 12:49:06 INFO Received uploads request method=POST path=/api/pending_closures4835worker2 # [ 97.120124] nix-grpc-daemon[1189]: time=2026-09-20T12:49:06.634Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4836worker2 # [ 97.121675] nix-grpc-daemon[1189]: time=2026-09-20T12:49:06.634Z level=INFO msg="Uploading 0d5zhxgph6fsfrwbx3iffkfcwzlpd5vf-farm-b.drv (640B)"4837lb # [ 97.073353] niks3-server[1053]: 2026/09/20 12:49:06 INFO Registered completed upload object_key=nar/0j8m9ib4qiz6b10m2phblx54xxiccd59w953mdi3fk0pgbyh4slz.nar.zst4838lb # [ 97.088166] niks3-server[1053]: 2026/09/20 12:49:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4839worker2 # [ 97.162411] nix-grpc-daemon[1189]: time=2026-09-20T12:49:06.676Z level=INFO msg="Uploading 1 narinfos"4840lb # [ 97.101012] niks3-server[1053]: 2026/09/20 12:49:06 INFO Signed narinfos id=29 count=14841lb # [ 97.107992] niks3-server[1053]: 2026/09/20 12:49:06 INFO Registered completed upload object_key=0d5zhxgph6fsfrwbx3iffkfcwzlpd5vf.ls4842worker2 # [ 97.185596] nix-grpc-daemon[1189]: time=2026-09-20T12:49:06.700Z level=INFO msg="Upload complete. (507ms)"4843lb # [ 97.118766] niks3-server[1053]: 2026/09/20 12:49:06 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4844lb # [ 97.124232] niks3-server[1053]: 2026/09/20 12:49:06 INFO Completed upload id=294845worker2 # [ 97.192297] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47368 duration_s=0 paths=1 nar_bytes_in=6404846lb # [ 97.127361] niks3-server[1053]: 2026/09/20 12:49:06 INFO Registered completed upload object_key=0d5zhxgph6fsfrwbx3iffkfcwzlpd5vf.narinfo4847worker2 # [ 97.206944] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473684848worker2 # [ 97.214423] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4849worker2 # [ 97.219718] nix-daemon[803]: reaped child process 1244, status = succeeded4850worker2 # [ 97.231763] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4851client # [ 97.196411] nix[1141]: building '/nix/store/0d5zhxgph6fsfrwbx3iffkfcwzlpd5vf-farm-b.drv' on lb:50051...4852worker2 # [ 98.273299] nix-daemon[803]: reaped child process 1258, status = succeeded4853worker2 # [ 98.446950] nix-daemon[803]: accepted connection from pid 1273, user nix-grpc-daemon (trusted)4854worker2 # [ 98.467543] nix-daemon[803]: reaped child process 1276, status = succeeded4855lb # [ 98.412959] niks3-server[1053]: 2026/09/20 12:49:07 INFO Received uploads request method=POST path=/api/pending_closures4856worker2 # [ 98.495627] nix-grpc-daemon[1189]: time=2026-09-20T12:49:08.009Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4857worker2 # [ 98.497291] nix-grpc-daemon[1189]: time=2026-09-20T12:49:08.009Z level=INFO msg="Uploading if9zinqci930693kisdl2ipz88mir9mw-farm-b (184B)"4858lb # [ 98.456542] niks3-server[1053]: 2026/09/20 12:49:07 INFO Registered completed upload object_key=nar/1ry4nlf2zyg4xy641vb3db6amzyl4shicsxv94n1g23wkj2dv5ba.nar.zst4859lb # [ 98.469766] niks3-server[1053]: 2026/09/20 12:49:07 INFO Registered completed upload object_key=log/0d5zhxgph6fsfrwbx3iffkfcwzlpd5vf-farm-b.drv4860worker2 # [ 98.545233] nix-grpc-daemon[1189]: time=2026-09-20T12:49:08.059Z level=INFO msg="Uploading 1 narinfos"4861lb # [ 98.481323] niks3-server[1053]: 2026/09/20 12:49:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4862lb # [ 98.497780] niks3-server[1053]: 2026/09/20 12:49:07 INFO Signed narinfos id=30 count=14863lb # [ 98.502363] niks3-server[1053]: 2026/09/20 12:49:07 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4864lb # [ 98.506787] niks3-server[1053]: 2026/09/20 12:49:07 INFO Registered completed upload object_key=if9zinqci930693kisdl2ipz88mir9mw.ls4865worker2 # [ 98.573589] nix-grpc-daemon[1189]: time=2026-09-20T12:49:08.088Z level=INFO msg="Upload complete. (328ms)"4866lb # [ 98.509959] niks3-server[1053]: 2026/09/20 12:49:08 INFO Completed upload id=304867lb # [ 98.513552] niks3-server[1053]: 2026/09/20 12:49:08 INFO Registered completed upload object_key=if9zinqci930693kisdl2ipz88mir9mw.narinfo4868worker2 # [ 98.585116] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47368 duration_s=1 drv=0d5zhxgph6fsfrwbx3iffkfcwzlpd5vf-farm-b.drv assign_id=2 outputs=14869worker1 # [ 98.578754] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:08Z level=debug event=want client=1 drv=8rw7s32g8cymsrvjv7ivdg5f5aznrbhx-farm-top.drv cached=04870worker1 # [ 98.579064] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:08Z level=debug event=assigned drv=8rw7s32g8cymsrvjv7ivdg5f5aznrbhx-farm-top.drv worker=192.168.1.4:50051 clients=14871worker2 # [ 98.603233] nix-daemon[803]: reaped child process 1256, status = succeeded4872worker2 # [ 98.640276] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473684873worker2 # [ 98.656914] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473684874worker2 # [ 98.673744] nix-grpc-daemon[1189]: time=2026-09-20T12:49:08.188Z level=INFO msg="All 2 paths already cached"4875client # [ 98.650909] nix[1141]: copying 1 paths to 'lb:50051'...4876worker2 # [ 98.683590] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473684877client # [ 98.656234] nix[1141]: copying path '/nix/store/8rw7s32g8cymsrvjv7ivdg5f5aznrbhx-farm-top.drv' to 'lb:50051'...4878worker2 # [ 98.704720] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4879worker2 # [ 98.912591] nix-daemon[803]: accepted connection from pid 1280, user nix-grpc-daemon (trusted)4880worker2 # [ 98.931168] nix-daemon[803]: reaped child process 1283, status = succeeded4881worker2 # [ 99.108866] nix-daemon[803]: accepted connection from pid 1285, user nix-grpc-daemon (trusted)4882worker2 # [ 99.127339] nix-daemon[803]: reaped child process 1288, status = succeeded4883lb # [ 99.071948] niks3-server[1053]: 2026/09/20 12:49:08 INFO Received uploads request method=POST path=/api/pending_closures4884worker2 # [ 99.151317] nix-grpc-daemon[1189]: time=2026-09-20T12:49:08.665Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4885worker2 # [ 99.152974] nix-grpc-daemon[1189]: time=2026-09-20T12:49:08.665Z level=INFO msg="Uploading 8rw7s32g8cymsrvjv7ivdg5f5aznrbhx-farm-top.drv (768B)"4886lb # [ 99.106615] niks3-server[1053]: 2026/09/20 12:49:08 INFO Registered completed upload object_key=nar/0r2arz178hkjg3frb0bx1bqs40xfj6jak65f0f6l80sgir910gi0.nar.zst4887worker2 # [ 99.185245] nix-grpc-daemon[1189]: time=2026-09-20T12:49:08.699Z level=INFO msg="Uploading 1 narinfos"4888lb # [ 99.122752] niks3-server[1053]: 2026/09/20 12:49:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4889lb # [ 99.132194] niks3-server[1053]: 2026/09/20 12:49:08 INFO Signed narinfos id=31 count=14890lb # [ 99.134682] niks3-server[1053]: 2026/09/20 12:49:08 INFO Registered completed upload object_key=8rw7s32g8cymsrvjv7ivdg5f5aznrbhx.ls4891lb # [ 99.141483] niks3-server[1053]: 2026/09/20 12:49:08 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete4892worker2 # [ 99.214495] nix-grpc-daemon[1189]: time=2026-09-20T12:49:08.729Z level=INFO msg="Upload complete. (490ms)"4893lb # [ 99.148195] niks3-server[1053]: 2026/09/20 12:49:08 INFO Completed upload id=314894lb # [ 99.151605] niks3-server[1053]: 2026/09/20 12:49:08 INFO Registered completed upload object_key=8rw7s32g8cymsrvjv7ivdg5f5aznrbhx.narinfo4895worker2 # [ 99.224049] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47368 duration_s=0 paths=1 nar_bytes_in=7684896worker2 # [ 99.227937] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473684897worker2 # [ 99.241012] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4898worker2 # [ 99.245726] nix-daemon[803]: reaped child process 1278, status = succeeded4899client # [ 99.221851] nix[1141]: building '/nix/store/8rw7s32g8cymsrvjv7ivdg5f5aznrbhx-farm-top.drv' on lb:50051...4900worker2 # [ 99.259207] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4901worker2 # [ 100.505293] nix-daemon[803]: reaped child process 1292, status = succeeded4902worker2 # [ 100.680830] nix-daemon[803]: accepted connection from pid 1307, user nix-grpc-daemon (trusted)4903worker2 # [ 100.698442] nix-daemon[803]: reaped child process 1310, status = succeeded4904lb # [ 100.648771] niks3-server[1053]: 2026/09/20 12:49:10 INFO Received uploads request method=POST path=/api/pending_closures4905worker2 # [ 100.727446] nix-grpc-daemon[1189]: time=2026-09-20T12:49:10.240Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4906worker2 # [ 100.729121] nix-grpc-daemon[1189]: time=2026-09-20T12:49:10.240Z level=INFO msg="Uploading cfwxlgnxq9zklnr4cqxiyhrj19b0h6pp-farm-top (240B)"4907lb # [ 100.682352] niks3-server[1053]: 2026/09/20 12:49:10 INFO Registered completed upload object_key=nar/0l5cr6x2xk2zfzsjap6axvaisjxa54z0dg8y59l0k2lkpfw56h7s.nar.zst4908lb # [ 100.696537] niks3-server[1053]: 2026/09/20 12:49:10 INFO Registered completed upload object_key=log/8rw7s32g8cymsrvjv7ivdg5f5aznrbhx-farm-top.drv4909lb # [ 100.709717] niks3-server[1053]: 2026/09/20 12:49:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign4910worker2 # [ 100.782909] nix-grpc-daemon[1189]: time=2026-09-20T12:49:10.297Z level=INFO msg="Uploading 1 narinfos"4911lb # [ 100.722278] niks3-server[1053]: 2026/09/20 12:49:10 INFO Signed narinfos id=32 count=14912lb # [ 100.731843] niks3-server[1053]: 2026/09/20 12:49:10 INFO Registered completed upload object_key=cfwxlgnxq9zklnr4cqxiyhrj19b0h6pp.ls4913lb # [ 100.741385] niks3-server[1053]: 2026/09/20 12:49:10 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete4914lb # [ 100.748375] niks3-server[1053]: 2026/09/20 12:49:10 INFO Completed upload id=324915worker2 # [ 100.815881] nix-grpc-daemon[1189]: time=2026-09-20T12:49:10.330Z level=INFO msg="Upload complete. (346ms)"4916lb # [ 100.752056] niks3-server[1053]: 2026/09/20 12:49:10 INFO Registered completed upload object_key=cfwxlgnxq9zklnr4cqxiyhrj19b0h6pp.narinfo4917worker2 # [ 100.829182] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47368 duration_s=1 drv=8rw7s32g8cymsrvjv7ivdg5f5aznrbhx-farm-top.drv assign_id=3 outputs=14918worker2 # [ 100.846015] nix-daemon[803]: reaped child process 1290, status = succeeded4919client # [ 100.835401] systemd[1]: waits.service: Deactivated successfully.4920client # [ 100.839871] systemd[1]: waits.service: Consumed 208ms CPU time over 10.130s wall clock time, 47.4M memory peak, 14.3K incoming IP traffic, 19.9K outgoing IP traffic.4921lb # [ 101.371004] envoy[922]: conn peer=[2001:db8:1::1]:42970 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=10171 tx=4115 ms=98484922client: (finished: waiting for success: ! systemctl is-active waits, in 6.49 seconds)4923client: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }4924client: (finished: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }, in 0.07 seconds)4925worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4926worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4927(finished: subtest: scheduler down: builds wait, then resume when it is back, in 14.46 seconds)4928subtest: clean scheduler restart: peers are told, reconnect without error or backoff4929client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs4930client # [ 102.048732] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.4931client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.08 seconds)4932worker1 # [ 102.310402] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:405944933worker1 # [ 102.326698] nix-daemon[838]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)4934client # Running as unit: rs.service; invocation ID: 0292f9f5c71041dea19a1931973689ee4935client # [ 102.325288] nix[1206]: don't know how to build these paths:4936client # [ 102.329472] nix[1206]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv4937worker1 # [ 102.358547] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:11Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=04938worker1 # [ 102.367008] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:11Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=14939worker1 # [ 102.413429] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405944940worker1 # [ 102.433282] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 93 ms (attempt 1/5)4941worker1 # [ 102.534205] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 179 ms (attempt 2/5)4942worker1 # [ 102.720909] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 213 ms (attempt 3/5)4943worker1 # [ 102.941729] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 367 ms (attempt 4/5)4944worker1 # [ 103.315086] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4945worker1 # [ 103.335989] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405944946client # [ 103.323949] nix[1206]: copying 1 paths to 'lb:50051'...4947worker1 # [ 103.344810] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:405944948client # [ 103.329108] nix[1206]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...4949worker1 # [ 103.366454] nix-daemon[838]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)4950worker1 # [ 103.388427] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:12Z level=info event=niks3_push_started pid=12114951worker1 # [ 103.595457] nix-grpc-daemon[1211]: time=2026-09-20T12:49:13.108Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""4952worker1 # [ 103.775883] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)4953worker1 # [ 103.793910] nix-daemon[838]: reaped child process 1227, status = succeeded4954worker1 # [ 103.976225] nix-daemon[838]: accepted connection from pid 1229, user nix-grpc-daemon (trusted)4955worker1 # [ 103.994005] nix-daemon[838]: reaped child process 1232, status = succeeded4956lb # [ 103.955893] niks3-server[1053]: 2026/09/20 12:49:13 INFO Received uploads request method=POST path=/api/pending_closures4957worker1 # [ 104.019932] nix-grpc-daemon[1211]: time=2026-09-20T12:49:13.532Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4958worker1 # [ 104.021773] nix-grpc-daemon[1211]: time=2026-09-20T12:49:13.532Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"4959lb # [ 103.990097] niks3-server[1053]: 2026/09/20 12:49:13 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst4960worker1 # [ 104.062161] nix-grpc-daemon[1211]: time=2026-09-20T12:49:13.575Z level=INFO msg="Uploading 1 narinfos"4961lb # [ 104.002698] niks3-server[1053]: 2026/09/20 12:49:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign4962lb # [ 104.015249] niks3-server[1053]: 2026/09/20 12:49:13 INFO Signed narinfos id=33 count=14963lb # [ 104.022241] niks3-server[1053]: 2026/09/20 12:49:13 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls4964lb # [ 104.035148] niks3-server[1053]: 2026/09/20 12:49:13 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete4965worker1 # [ 104.092737] nix-grpc-daemon[1211]: time=2026-09-20T12:49:13.606Z level=INFO msg="Upload complete. (493ms)"4966lb # [ 104.040374] niks3-server[1053]: 2026/09/20 12:49:13 INFO Completed upload id=334967lb # [ 104.044302] niks3-server[1053]: 2026/09/20 12:49:13 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo4968worker1 # [ 104.100145] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40594 duration_s=0 paths=1 nar_bytes_in=4164969worker1 # [ 104.108909] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405944970worker1 # [ 104.120718] nix-daemon[838]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)4971worker1 # [ 104.125323] nix-daemon[838]: reaped child process 1209, status = succeeded4972client # [ 104.115686] nix[1206]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...4973worker1 # [ 104.139335] nix-daemon[838]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)4974worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true4975worker2 # [ 105.848257] systemd-journald[274]: Received client request to rotate journal, rotating.4976worker2 # [ 105.862964] systemd-journald[274]: Vacuuming done, freed 0B of archived journals from /var/log/journal/cbb8954ac29644d485ce363307c0985d.4977worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds)4978worker1: must succeed: systemctl restart nix-grpc-daemon.service4979worker1 # [ 105.961304] systemd[1]: Stopping Nix worker-protocol over gRPC...4980worker1 # [ 105.976509] nix-daemon[838]: reaped child process 1236, status = succeeded4981worker1 # [ 106.129212] nix-daemon[838]: accepted connection from pid 1267, user nix-grpc-daemon (trusted)4982worker1 # [ 106.148801] nix-daemon[838]: reaped child process 1271, status = succeeded4983lb # [ 106.111636] niks3-server[1053]: 2026/09/20 12:49:15 INFO Received uploads request method=POST path=/api/pending_closures4984worker1 # [ 106.175605] nix-grpc-daemon[1211]: time=2026-09-20T12:49:15.687Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4985worker1 # [ 106.180388] nix-grpc-daemon[1211]: time=2026-09-20T12:49:15.687Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"4986worker1 # [ 106.182984] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:15Z level=info event=draining4987lb # [ 106.154096] niks3-server[1053]: 2026/09/20 12:49:15 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv4988lb # [ 106.165855] niks3-server[1053]: 2026/09/20 12:49:15 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst4989lb # [ 106.176863] niks3-server[1053]: 2026/09/20 12:49:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign4990worker1 # [ 106.236129] nix-grpc-daemon[1211]: time=2026-09-20T12:49:15.748Z level=INFO msg="Uploading 1 narinfos"4991lb # [ 106.183199] niks3-server[1053]: 2026/09/20 12:49:15 INFO Signed narinfos id=34 count=14992lb # [ 106.189448] niks3-server[1053]: 2026/09/20 12:49:15 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls4993lb # [ 106.202286] niks3-server[1053]: 2026/09/20 12:49:15 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete4994worker1 # [ 106.261328] nix-grpc-daemon[1211]: time=2026-09-20T12:49:15.775Z level=INFO msg="Upload complete. (309ms)"4995lb # [ 106.209250] niks3-server[1053]: 2026/09/20 12:49:15 INFO Completed upload id=344996lb # [ 106.213329] niks3-server[1053]: 2026/09/20 12:49:15 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo4997worker1 # [ 106.272320] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40594 duration_s=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=14998worker1 # [ 106.285336] nix-daemon[838]: reaped child process 1234, status = succeeded4999client # [ 106.302782] systemd[1]: rs.service: Deactivated successfully.5000client # [ 106.307033] systemd[1]: rs.service: Consumed 156ms CPU time over 4.258s wall clock time, 37M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5001worker1 # [ 107.179899] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:16Z level=info event=signal_exit5002worker2 # [ 107.197175] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:16Z level=info event=scheduler_restarting addr=lb:500515003worker1 # [ 107.187155] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:16Z level=info event=scheduler_restarting5004worker1 # [ 107.196786] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:461385005worker1 # [ 107.201719] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:16Z level=info event=worker_gone addr=192.168.1.4:500515006worker1 # [ 107.206210] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:16Z level=info event=scheduler_restarting addr=lb:500515007worker1 # [ 107.210858] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:461385008worker1 # [ 107.215780] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:16Z level=info event=worker_gone addr=192.168.1.3:500515009worker1 # [ 107.238652] nix-daemon[838]: reaped child process 1198, status = succeeded5010worker2 # [ 107.397025] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:16Z level=info event=scheduler_connected addr=lb:500515011worker1 # [ 107.384839] nix-grpc-daemon[1139]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5012worker1 # [ 107.406205] nix-grpc-daemon[1139]: E0000 00:00:1789908556.898557 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5013worker1 # [ 107.413209] nix-grpc-daemon[1139]: ts=2026-09-20T12:49:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5014worker1 # [ 107.468153] nix-grpc-daemon[1139]: E0000 00:00:1789908556.981801 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5015worker1 # [ 107.501095] nix-grpc-daemon[1139]: E0000 00:00:1789908557.014956 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5016worker2 # [ 108.034474] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:17Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5017worker1 # [ 108.042855] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5018worker1 # [ 108.048827] systemd[1]: Stopped Nix worker-protocol over gRPC.5019worker1 # [ 108.051332] systemd[1]: nix-grpc-daemon.service: Consumed 678ms CPU time over 14.081s wall clock time, 31.9M memory peak, 19.2K incoming IP traffic, 24K outgoing IP traffic.5020worker1 # [ 108.069495] systemd[1]: Starting Nix worker-protocol over gRPC...5021worker2 # [ 108.236982] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:17Z level=info event=scheduler_connected addr=lb:500515022worker1 # [ 108.270493] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5023worker1 # [ 108.273218] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5024worker1 # [ 108.277237] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15025worker1 # [ 108.285511] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5026worker1 # [ 108.287247] systemd[1]: Started Nix worker-protocol over gRPC.5027worker1: (finished: must succeed: systemctl restart nix-grpc-daemon.service, in 2.38 seconds)5028worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting5029worker1 # [ 108.303121] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:17Z level=info event=oidc_jwks provider=mock keys=15030worker1 # [ 108.304906] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:406325031worker1 # [ 108.309386] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05032worker1 # [ 108.312239] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:17Z level=info event=scheduler_connected addr=lb:500515033worker1 # [ 108.314128] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:406325034worker1 # [ 108.315694] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05035worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting, in 0.08 seconds)5036worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5037worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5038client: waiting for success: ! systemctl is-active rs5039client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5040client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5041client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5042client: must fail: journalctl -u rs | grep -q 'reconnecting'5043client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5044(finished: subtest: clean scheduler restart: peers are told, reconnect without error or backoff, in 6.73 seconds)5045subtest: scheduler restart mid-build: build finishes, no double build5046client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5047client # [ 108.746932] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5048client # Running as unit: mid.service; invocation ID: 289e5720b90847b9bba96216ee04a7a75049client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.05 seconds)5050worker2 # [ 109.000757] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473685051client # [ 108.974829] nix[1238]: don't know how to build these paths:5052client # [ 108.975797] nix[1238]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5053worker1 # [ 109.008169] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:18Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05054worker1 # [ 109.008598] nix-grpc-daemon[1278]: ts=2026-09-20T12:49:18Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15055worker2 # [ 109.079773] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473685056worker2 # [ 109.096308] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473685057client # [ 109.076251] nix[1238]: copying 1 paths to 'lb:50051'...5058worker2 # [ 109.110942] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473685059client # [ 109.078552] nix[1238]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5060worker2 # [ 109.126804] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)5061worker2 # [ 109.339381] nix-daemon[803]: accepted connection from pid 1349, user nix-grpc-daemon (trusted)5062worker2 # [ 109.359794] nix-daemon[803]: reaped child process 1352, status = succeeded5063worker2 # [ 109.537302] nix-daemon[803]: accepted connection from pid 1354, user nix-grpc-daemon (trusted)5064worker2 # [ 109.555185] nix-daemon[803]: reaped child process 1357, status = succeeded5065lb # [ 109.501882] niks3-server[1053]: 2026/09/20 12:49:19 INFO Received uploads request method=POST path=/api/pending_closures5066worker2 # [ 109.578944] nix-grpc-daemon[1189]: time=2026-09-20T12:49:19.093Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5067worker2 # [ 109.580513] nix-grpc-daemon[1189]: time=2026-09-20T12:49:19.093Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5068lb # [ 109.531001] niks3-server[1053]: 2026/09/20 12:49:19 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5069lb # [ 109.542279] niks3-server[1053]: 2026/09/20 12:49:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5070worker2 # [ 109.616697] nix-grpc-daemon[1189]: time=2026-09-20T12:49:19.131Z level=INFO msg="Uploading 1 narinfos"5071lb # [ 109.554242] niks3-server[1053]: 2026/09/20 12:49:19 INFO Signed narinfos id=35 count=15072lb # [ 109.560347] niks3-server[1053]: 2026/09/20 12:49:19 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5073lb # [ 109.567374] niks3-server[1053]: 2026/09/20 12:49:19 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5074lb # [ 109.573335] niks3-server[1053]: 2026/09/20 12:49:19 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5075lb # [ 109.578483] niks3-server[1053]: 2026/09/20 12:49:19 INFO Completed upload id=355076worker2 # [ 109.645870] nix-grpc-daemon[1189]: time=2026-09-20T12:49:19.160Z level=INFO msg="Upload complete. (502ms)"5077worker2 # [ 109.654813] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47368 duration_s=0 paths=1 nar_bytes_in=4245078worker2 # [ 109.668228] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473685079worker2 # [ 109.674972] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)5080worker2 # [ 109.679759] nix-daemon[803]: reaped child process 1347, status = succeeded5081client # [ 109.655624] nix[1238]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5082worker2 # [ 109.693905] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)5083worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5084lb # [ 111.372447] envoy[922]: conn peer=[2001:db8:1::1]:36096 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2940 tx=1374 ms=39885085lb # [ 111.372852] envoy[922]: conn peer=[2001:db8:1::3]:44586 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=700 tx=260 ms=132085086worker1 # [ 111.469169] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1278 (nix-grpc-daemon) on client request.5087worker2 # [ 111.498914] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:21Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5088worker1 # [ 111.483351] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5089client # [ 111.465991] nix[1238]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5090worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.11 seconds)5091client: must succeed: sleep 5.05092worker1 # [ 111.522664] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5093worker1 # [ 111.528001] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5094worker1 # [ 111.530055] systemd[1]: nix-grpc-daemon.service: Consumed 162ms CPU time over 3.452s wall clock time, 10.8M memory peak, 8.5K incoming IP traffic, 7.8K outgoing IP traffic.5095worker2 # [ 111.699233] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:21Z level=info event=scheduler_connected addr=lb:500515096worker1 # [ 111.689430] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5097worker1 # [ 111.702075] systemd[1]: Starting Nix worker-protocol over gRPC...5098worker1 # [ 111.922808] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:21Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5099worker1 # [ 111.925389] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5100worker1 # [ 111.929439] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15101worker1 # [ 111.937783] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5102worker1 # [ 111.939632] systemd[1]: Started Nix worker-protocol over gRPC.5103worker1 # [ 111.956086] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:21Z level=info event=oidc_jwks provider=mock keys=15104worker1 # [ 111.957451] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:21Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:471425105worker1 # [ 111.962399] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=15106worker1 # [ 111.965330] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:21Z level=info event=scheduler_connected addr=lb:500515107worker1 # [ 111.967201] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:21Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:471425108worker1 # [ 111.968889] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05109client: (finished: must succeed: sleep 5.0, in 5.07 seconds)5110client: waiting for success: ! systemctl is-active mid5111worker2 # [ 117.154698] nix-daemon[803]: reaped child process 1361, status = succeeded5112worker2 # [ 117.335168] nix-daemon[803]: accepted connection from pid 1397, user nix-grpc-daemon (trusted)5113worker2 # [ 117.356964] nix-daemon[803]: reaped child process 1400, status = succeeded5114lb # [ 117.308076] niks3-server[1053]: 2026/09/20 12:49:26 INFO Received uploads request method=POST path=/api/pending_closures5115worker2 # [ 117.387841] nix-grpc-daemon[1189]: time=2026-09-20T12:49:26.901Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5116worker2 # [ 117.395124] nix-grpc-daemon[1189]: time=2026-09-20T12:49:26.905Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5117lb # [ 117.372303] niks3-server[1053]: 2026/09/20 12:49:26 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5118lb # [ 117.381148] niks3-server[1053]: 2026/09/20 12:49:26 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5119lb # [ 117.391634] niks3-server[1053]: 2026/09/20 12:49:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5120worker2 # [ 117.458606] nix-grpc-daemon[1189]: time=2026-09-20T12:49:26.972Z level=INFO msg="Uploading 1 narinfos"5121lb # [ 117.399029] niks3-server[1053]: 2026/09/20 12:49:26 INFO Signed narinfos id=36 count=15122lb # [ 117.403277] niks3-server[1053]: 2026/09/20 12:49:26 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5123lb # [ 117.411050] niks3-server[1053]: 2026/09/20 12:49:26 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5124lb # [ 117.416775] niks3-server[1053]: 2026/09/20 12:49:26 INFO Completed upload id=365125worker2 # [ 117.482823] nix-grpc-daemon[1189]: time=2026-09-20T12:49:26.997Z level=INFO msg="Upload complete. (371ms)"5126lb # [ 117.419118] niks3-server[1053]: 2026/09/20 12:49:26 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5127worker2 # [ 117.497513] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47368 duration_s=7 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15128worker2 # [ 117.519879] nix-daemon[803]: reaped child process 1359, status = succeeded5129client # [ 117.532807] systemd[1]: mid.service: Deactivated successfully.5130client # [ 117.537580] systemd[1]: mid.service: Consumed 168ms CPU time over 8.789s wall clock time, 37M memory peak, 8.7K incoming IP traffic, 9.1K outgoing IP traffic.5131client: (finished: waiting for success: ! systemctl is-active mid, in 1.17 seconds)5132client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5133client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5134(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.47 seconds)5135subtest: interrupting the client stops the build on the worker5136client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5137client # [ 118.229469] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5138client # Running as unit: intr.service; invocation ID: 84251dec80dc4996bc8d2cd68e4d67105139client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5140worker2 # [ 118.511823] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:473685141client # [ 118.487979] nix[1273]: don't know how to build these paths:5142client # [ 118.489208] nix[1273]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5143worker1 # [ 118.529345] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:28Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05144worker1 # [ 118.535397] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:28Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15145worker1 # [ 118.580160] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705146worker1 # [ 118.599943] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5147worker1 # [ 118.631094] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5)5148worker1 # [ 118.720551] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 2/5)5149worker1 # [ 118.918028] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 3/5)5150worker1 # [ 118.962915] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 582 ms (attempt 4/5)5151worker1 # [ 119.547475] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5152worker1 # [ 119.569848] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705153client # [ 119.567587] nix[1273]: copying 1 paths to 'lb:50051'...5154worker1 # [ 119.591175] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705155client # [ 119.574510] nix[1273]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5156worker1 # [ 119.610470] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5157worker1 # [ 119.643449] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:29Z level=info event=niks3_push_started pid=14275158worker1 # [ 119.885870] nix-grpc-daemon[1427]: time=2026-09-20T12:49:29.398Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5159worker1 # [ 120.076878] nix-daemon[838]: accepted connection from pid 1440, user nix-grpc-daemon (trusted)5160worker1 # [ 120.097903] nix-daemon[838]: reaped child process 1443, status = succeeded5161worker1 # [ 120.294018] nix-daemon[838]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)5162worker1 # [ 120.314935] nix-daemon[838]: reaped child process 1448, status = succeeded5163lb # [ 120.279760] niks3-server[1053]: 2026/09/20 12:49:29 INFO Received uploads request method=POST path=/api/pending_closures5164worker1 # [ 120.346859] nix-grpc-daemon[1427]: time=2026-09-20T12:49:29.859Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5165worker1 # [ 120.348876] nix-grpc-daemon[1427]: time=2026-09-20T12:49:29.859Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5166lb # [ 120.323601] niks3-server[1053]: 2026/09/20 12:49:29 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5167lb # [ 120.339257] niks3-server[1053]: 2026/09/20 12:49:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5168worker1 # [ 120.400793] nix-grpc-daemon[1427]: time=2026-09-20T12:49:29.912Z level=INFO msg="Uploading 1 narinfos"5169lb # [ 120.349458] niks3-server[1053]: 2026/09/20 12:49:29 INFO Signed narinfos id=37 count=15170lb # [ 120.368092] niks3-server[1053]: 2026/09/20 12:49:29 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5171lb # [ 120.377685] niks3-server[1053]: 2026/09/20 12:49:29 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5172lb # [ 120.387257] niks3-server[1053]: 2026/09/20 12:49:29 INFO Completed upload id=375173worker1 # [ 120.439249] nix-grpc-daemon[1427]: time=2026-09-20T12:49:29.953Z level=INFO msg="Upload complete. (549ms)"5174lb # [ 120.390685] niks3-server[1053]: 2026/09/20 12:49:29 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5175worker1 # [ 120.453678] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=4245176worker1 # [ 120.468473] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705177worker1 # [ 120.477083] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5178worker1 # [ 120.483001] nix-daemon[838]: reaped child process 1425, status = succeeded5179client # [ 120.475018] nix[1273]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5180worker1 # [ 120.500214] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5181lb # [ 121.370064] envoy[922]: conn peer=[2001:db8:1::3]:45862 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=432 tx=55 ms=31805182lb # [ 121.375155] envoy[922]: conn peer=[2001:db8:1::1]:36112 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3022 tx=1398 ms=85105183client: must succeed: systemctl kill -s INT intr5184client # [ 122.060622] systemd[1]: intr.service: Sent signal SIGINT to main process 1273 (nix) on client request.5185client # [ 122.069527] nix[1273]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5186client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5187client # [ 122.079785] nix[1273]: error: interrupted by the user5188client # [ 122.117023] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5189worker1 # [ 122.139853] nix-daemon[838]: reaped child process 1450, status = succeeded5190client # [ 122.122079] systemd[1]: intr.service: Failed with result 'exit-code'.5191worker1 # [ 122.142817] nix-daemon[1452]: unexpected Nix daemon error: error: interrupted by the user5192client # [ 122.124334] systemd[1]: intr.service: Consumed 172ms CPU time over 3.890s wall clock time, 39.2M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5193worker1 # [ 122.152136] nix-daemon[838]: reaped child process 1452, status = failed with exit code 15194(finished: subtest: interrupting the client stops the build on the worker, in 4.05 seconds)5195subtest: a deploy mid-build drains: the build finishes, the new generation takes over5196client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5197client # [ 122.303887] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5198client # Running as unit: sw.service; invocation ID: 175cc099a0484a35b05d7584be59cc815199client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5200client # [ 122.541407] nix[1293]: don't know how to build these paths:5201client # [ 122.542712] nix[1293]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5202worker1 # [ 122.560150] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:471705203worker1 # [ 122.575252] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:32Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05204worker1 # [ 122.581108] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:32Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15205worker2 # [ 122.637569] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473685206worker2 # [ 122.657242] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:473685207client # [ 122.636194] nix[1293]: copying 1 paths to 'lb:50051'...5208worker2 # [ 122.672598] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:473685209client # [ 122.641239] nix[1293]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5210worker2 # [ 122.688552] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)5211worker2 # [ 122.899181] nix-daemon[803]: accepted connection from pid 1428, user nix-grpc-daemon (trusted)5212worker2 # [ 122.917187] nix-daemon[803]: reaped child process 1431, status = succeeded5213worker2 # [ 123.091560] nix-daemon[803]: accepted connection from pid 1433, user nix-grpc-daemon (trusted)5214worker2 # [ 123.110309] nix-daemon[803]: reaped child process 1436, status = succeeded5215lb # [ 123.059270] niks3-server[1053]: 2026/09/20 12:49:32 INFO Received uploads request method=POST path=/api/pending_closures5216worker2 # [ 123.136610] nix-grpc-daemon[1189]: time=2026-09-20T12:49:32.650Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5217worker2 # [ 123.138098] nix-grpc-daemon[1189]: time=2026-09-20T12:49:32.650Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5218lb # [ 123.088946] niks3-server[1053]: 2026/09/20 12:49:32 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5219worker2 # [ 123.170163] nix-grpc-daemon[1189]: time=2026-09-20T12:49:32.684Z level=INFO msg="Uploading 1 narinfos"5220lb # [ 123.103760] niks3-server[1053]: 2026/09/20 12:49:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5221lb # [ 123.114253] niks3-server[1053]: 2026/09/20 12:49:32 INFO Signed narinfos id=38 count=15222lb # [ 123.120260] niks3-server[1053]: 2026/09/20 12:49:32 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5223lb # [ 123.126313] niks3-server[1053]: 2026/09/20 12:49:32 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5224worker2 # [ 123.200061] nix-grpc-daemon[1189]: time=2026-09-20T12:49:32.714Z level=INFO msg="Upload complete. (493ms)"5225lb # [ 123.133574] niks3-server[1053]: 2026/09/20 12:49:32 INFO Completed upload id=385226lb # [ 123.136042] niks3-server[1053]: 2026/09/20 12:49:32 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5227worker2 # [ 123.208152] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47368 duration_s=0 paths=1 nar_bytes_in=4165228worker2 # [ 123.219984] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:473685229worker2 # [ 123.225741] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)5230worker2 # [ 123.230956] nix-daemon[803]: reaped child process 1426, status = succeeded5231client # [ 123.206575] nix[1293]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5232worker2 # [ 123.244218] nix-daemon[803]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)5233worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25234worker2 # Checking switch inhibitors... done5235worker2 # activating the configuration...5236worker2 # [ 125.847584] nixos[1471]: switching to system configuration /nix/store/iy5mi0dapk7k3i99ilixd1cfhmd31glv-nixos-system-worker2-test5237worker2 # [ 125.852473] systemd[1]: Stopped target Local File Systems.5238worker2 # [ 125.855281] systemd[1]: Stopped target Remote File Systems.5239worker2 # setting up /etc...5240worker2 # [ 126.657279] systemd[1]: Reload requested from client PID 1471 ('.switch-to-conf') (unit backdoor.service)...5241worker2 # [ 126.659441] systemd[1]: Reloading...5242worker2 # [ 127.566438] systemd[1]: Reloading finished in 905 ms.5243worker2 # restarting sysinit-reactivation.target5244worker2 # [ 127.652359] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5245worker2 # [ 127.806005] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5246worker2 # [ 127.807201] systemd[1]: Reached target Reactivate sysinit units.5247worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5248worker2 # [ 127.816508] systemd[1]: Reloading D-Bus System Message Bus...5249worker2 # [ 127.826628] dbus-broker-launch[500]: Caught SIGHUP, trigger reload.5250worker2 # [ 127.832280] systemd[1]: Reloading Nix worker-protocol over gRPC...5251worker2 # [ 127.846277] dbus-broker-launch[500]: Looking up NSS user entry for 'systemd-timesync'...5252worker2 # [ 127.851069] dbus-broker-launch[500]: NSS returned no entry for 'systemd-timesync'5253worker2 # [ 127.853980] dbus-broker-launch[500]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5254worker2 # [ 127.877764] systemd[1]: Reloaded Nix worker-protocol over gRPC.5255worker2 # [ 127.901603] systemd[1]: Reloaded D-Bus System Message Bus.5256worker2 # [ 127.914349] systemd[1]: Reached target Remote File Systems.5257worker2 # [ 127.917387] systemd[1]: Starting linger-users.service...5258worker2 # [ 127.937447] systemd[1]: Reached target Local File Systems.5259worker2 # [ 127.938391] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5260worker2 # [ 127.943791] systemd[1]: Starting Create SUID/SGID Wrappers...5261worker2 # [ 127.954691] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5262worker2 # [ 127.959575] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675263worker2 # [ 127.965574] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5264worker2 # [ 127.970545] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5265worker2 # [ 127.976220] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5266worker2 # [ 127.978261] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5267worker2 # [ 127.983589] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5268worker2 # [ 128.016990] systemd[1]: linger-users.service: Deactivated successfully.5269worker2 # [ 128.018000] systemd[1]: Finished linger-users.service.5270worker2 # [ 128.472721] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5271worker2 # [ 128.480098] systemd[1]: Finished Create SUID/SGID Wrappers.5272worker2 # [ 128.716330] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:38Z level=info event=draining5273worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5274worker2 # [ 128.731365] nixos[1471]: finished switching to system configuration /nix/store/iy5mi0dapk7k3i99ilixd1cfhmd31glv-nixos-system-worker2-test5275worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.74 seconds)5276worker2: must succeed: pgrep -f 'read -t [9]0 x'5277worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.07 seconds)5278client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25279worker1 # [ 129.061291] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:471705280client # don't know how to build these paths:5281client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5282worker1 # [ 129.073881] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705283worker1 # [ 129.103378] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:38Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05284worker1 # [ 129.110346] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:38Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15285worker1 # [ 129.154379] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705286worker1 # [ 129.170733] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705287client # copying 1 paths to 'lb:50051'...5288worker1 # [ 129.187910] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705289client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5290worker1 # [ 129.213174] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5291worker1 # [ 129.418265] nix-daemon[838]: accepted connection from pid 1502, user nix-grpc-daemon (trusted)5292worker1 # [ 129.438176] nix-daemon[838]: reaped child process 1505, status = succeeded5293worker1 # [ 129.611191] nix-daemon[838]: accepted connection from pid 1507, user nix-grpc-daemon (trusted)5294worker1 # [ 129.630704] nix-daemon[838]: reaped child process 1510, status = succeeded5295lb # [ 129.589784] niks3-server[1053]: 2026/09/20 12:49:39 INFO Received uploads request method=POST path=/api/pending_closures5296worker1 # [ 129.652283] nix-grpc-daemon[1427]: time=2026-09-20T12:49:39.165Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5297worker1 # [ 129.653760] nix-grpc-daemon[1427]: time=2026-09-20T12:49:39.165Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5298lb # [ 129.618813] niks3-server[1053]: 2026/09/20 12:49:39 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5299lb # [ 129.631580] niks3-server[1053]: 2026/09/20 12:49:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5300worker1 # [ 129.691601] nix-grpc-daemon[1427]: time=2026-09-20T12:49:39.205Z level=INFO msg="Uploading 1 narinfos"5301lb # [ 129.648468] niks3-server[1053]: 2026/09/20 12:49:39 INFO Signed narinfos id=39 count=15302lb # [ 129.651645] niks3-server[1053]: 2026/09/20 12:49:39 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5303lb # [ 129.662124] niks3-server[1053]: 2026/09/20 12:49:39 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5304lb # [ 129.668840] niks3-server[1053]: 2026/09/20 12:49:39 INFO Completed upload id=395305worker1 # [ 129.721603] nix-grpc-daemon[1427]: time=2026-09-20T12:49:39.235Z level=INFO msg="Upload complete. (491ms)"5306lb # [ 129.671455] niks3-server[1053]: 2026/09/20 12:49:39 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5307worker1 # [ 129.731729] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=5285308worker1 # [ 129.742922] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705309worker1 # [ 129.750380] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5310worker1 # [ 129.755087] nix-daemon[838]: reaped child process 1500, status = succeeded5311client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5312worker1 # [ 129.766373] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5313client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5314client # farm-a> LOG-farm-a-during-drain5315worker1 # [ 130.414274] nix-daemon[838]: reaped child process 1514, status = succeeded5316worker1 # [ 130.599779] nix-daemon[838]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5317worker1 # [ 130.617183] nix-daemon[838]: reaped child process 1532, status = succeeded5318lb # [ 130.577604] niks3-server[1053]: 2026/09/20 12:49:40 INFO Received uploads request method=POST path=/api/pending_closures5319worker1 # [ 130.643303] nix-grpc-daemon[1427]: time=2026-09-20T12:49:40.154Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5320worker1 # [ 130.645775] nix-grpc-daemon[1427]: time=2026-09-20T12:49:40.154Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5321lb # [ 130.610573] niks3-server[1053]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5322lb # [ 130.627947] niks3-server[1053]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5323lb # [ 130.643942] niks3-server[1053]: 2026/09/20 12:49:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5324worker1 # [ 130.703909] nix-grpc-daemon[1427]: time=2026-09-20T12:49:40.215Z level=INFO msg="Uploading 1 narinfos"5325lb # [ 130.656129] niks3-server[1053]: 2026/09/20 12:49:40 INFO Signed narinfos id=40 count=15326lb # [ 130.659142] niks3-server[1053]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5327lb # [ 130.668643] niks3-server[1053]: 2026/09/20 12:49:40 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5328lb # [ 130.676310] niks3-server[1053]: 2026/09/20 12:49:40 INFO Completed upload id=405329worker1 # [ 130.728522] nix-grpc-daemon[1427]: time=2026-09-20T12:49:40.242Z level=INFO msg="Upload complete. (349ms)"5330lb # [ 130.679270] niks3-server[1053]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5331worker1 # [ 130.743618] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=15332worker1 # [ 130.764849] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:40Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05333worker1 # [ 130.769075] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:40Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15334worker1 # [ 130.773424] nix-daemon[838]: reaped child process 1512, status = succeeded5335worker1 # [ 130.811181] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705336worker1 # [ 130.826462] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705337worker1 # [ 130.840871] nix-grpc-daemon[1427]: time=2026-09-20T12:49:40.354Z level=INFO msg="All 1 paths already cached"5338client # copying 1 paths to 'lb:50051'...5339worker1 # [ 130.851263] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705340client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5341worker1 # [ 130.871651] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5342worker1 # [ 131.082717] nix-daemon[838]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5343worker1 # [ 131.103106] nix-daemon[838]: reaped child process 1541, status = succeeded5344worker1 # [ 131.280114] nix-daemon[838]: accepted connection from pid 1543, user nix-grpc-daemon (trusted)5345worker1 # [ 131.296509] nix-daemon[838]: reaped child process 1546, status = succeeded5346lb # [ 131.257633] niks3-server[1053]: 2026/09/20 12:49:40 INFO Received uploads request method=POST path=/api/pending_closures5347worker1 # [ 131.319230] nix-grpc-daemon[1427]: time=2026-09-20T12:49:40.832Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5348worker1 # [ 131.320887] nix-grpc-daemon[1427]: time=2026-09-20T12:49:40.832Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5349lb # [ 131.286439] niks3-server[1053]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5350lb # [ 131.299355] niks3-server[1053]: 2026/09/20 12:49:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5351worker1 # [ 131.357433] nix-grpc-daemon[1427]: time=2026-09-20T12:49:40.871Z level=INFO msg="Uploading 1 narinfos"5352lb # [ 131.310063] niks3-server[1053]: 2026/09/20 12:49:40 INFO Signed narinfos id=41 count=15353lb # [ 131.316331] niks3-server[1053]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5354lb # [ 131.324135] niks3-server[1053]: 2026/09/20 12:49:40 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5355lb # [ 131.329758] niks3-server[1053]: 2026/09/20 12:49:40 INFO Completed upload id=415356worker1 # [ 131.382104] nix-grpc-daemon[1427]: time=2026-09-20T12:49:40.896Z level=INFO msg="Upload complete. (488ms)"5357lb # [ 131.332621] niks3-server[1053]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5358worker1 # [ 131.388254] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=6405359worker1 # [ 131.401339] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705360worker1 # [ 131.408509] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5361worker1 # [ 131.414271] nix-daemon[838]: reaped child process 1536, status = succeeded5362client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5363lb # [ 131.371916] envoy[922]: conn peer=[2001:db8:1::1]:55982 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=755 ms=36195364client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5365worker1 # [ 131.427720] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5366client # farm-b> LOG-farm-b-during-drain5367worker1 # [ 132.271116] nix-daemon[838]: reaped child process 1550, status = succeeded5368worker1 # [ 132.446739] nix-daemon[838]: accepted connection from pid 1565, user nix-grpc-daemon (trusted)5369worker1 # [ 132.465134] nix-daemon[838]: reaped child process 1568, status = succeeded5370lb # [ 132.425772] niks3-server[1053]: 2026/09/20 12:49:41 INFO Received uploads request method=POST path=/api/pending_closures5371worker1 # [ 132.486998] nix-grpc-daemon[1427]: time=2026-09-20T12:49:41.999Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5372worker1 # [ 132.489006] nix-grpc-daemon[1427]: time=2026-09-20T12:49:41.999Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5373lb # [ 132.451959] niks3-server[1053]: 2026/09/20 12:49:41 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5374lb # [ 132.467457] niks3-server[1053]: 2026/09/20 12:49:41 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5375lb # [ 132.488569] niks3-server[1053]: 2026/09/20 12:49:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5376worker1 # [ 132.547515] nix-grpc-daemon[1427]: time=2026-09-20T12:49:42.060Z level=INFO msg="Uploading 1 narinfos"5377lb # [ 132.498920] niks3-server[1053]: 2026/09/20 12:49:41 INFO Signed narinfos id=42 count=15378lb # [ 132.505495] niks3-server[1053]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5379lb # [ 132.513857] niks3-server[1053]: 2026/09/20 12:49:42 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5380lb # [ 132.521847] niks3-server[1053]: 2026/09/20 12:49:42 INFO Completed upload id=425381worker1 # [ 132.573849] nix-grpc-daemon[1427]: time=2026-09-20T12:49:42.087Z level=INFO msg="Upload complete. (336ms)"5382lb # [ 132.524901] niks3-server[1053]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5383worker1 # [ 132.596436] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=15384worker1 # [ 132.608299] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:42Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05385worker1 # [ 132.614975] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:42Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15386worker1 # [ 132.619618] nix-daemon[838]: reaped child process 1548, status = succeeded5387worker1 # [ 132.637370] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705388worker1 # [ 132.659011] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705389worker1 # [ 132.672794] nix-grpc-daemon[1427]: time=2026-09-20T12:49:42.186Z level=INFO msg="All 2 paths already cached"5390client # copying 1 paths to 'lb:50051'...5391worker1 # [ 132.683053] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705392client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5393worker1 # [ 132.706530] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5394worker1 # [ 132.909685] nix-daemon[838]: accepted connection from pid 1574, user nix-grpc-daemon (trusted)5395worker1 # [ 132.928313] nix-daemon[838]: reaped child process 1577, status = succeeded5396worker1 # [ 133.104490] nix-daemon[838]: accepted connection from pid 1579, user nix-grpc-daemon (trusted)5397worker1 # [ 133.122598] nix-daemon[838]: reaped child process 1582, status = succeeded5398lb # [ 133.080786] niks3-server[1053]: 2026/09/20 12:49:42 INFO Received uploads request method=POST path=/api/pending_closures5399worker1 # [ 133.143079] nix-grpc-daemon[1427]: time=2026-09-20T12:49:42.656Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5400worker1 # [ 133.144683] nix-grpc-daemon[1427]: time=2026-09-20T12:49:42.656Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5401lb # [ 133.107364] niks3-server[1053]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5402worker1 # [ 133.174333] nix-grpc-daemon[1427]: time=2026-09-20T12:49:42.688Z level=INFO msg="Uploading 1 narinfos"5403lb # [ 133.123252] niks3-server[1053]: 2026/09/20 12:49:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5404lb # [ 133.132896] niks3-server[1053]: 2026/09/20 12:49:42 INFO Signed narinfos id=43 count=15405lb # [ 133.140972] niks3-server[1053]: 2026/09/20 12:49:42 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5406worker1 # [ 133.203312] nix-grpc-daemon[1427]: time=2026-09-20T12:49:42.717Z level=INFO msg="Upload complete. (478ms)"5407lb # [ 133.150718] niks3-server[1053]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5408lb # [ 133.155926] niks3-server[1053]: 2026/09/20 12:49:42 INFO Completed upload id=435409lb # [ 133.159835] niks3-server[1053]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5410worker1 # [ 133.212313] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=7685411worker1 # [ 133.222362] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705412worker1 # [ 133.228550] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5413worker1 # [ 133.232724] nix-daemon[838]: reaped child process 1572, status = succeeded5414client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5415worker1 # [ 133.244191] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5416client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5417client # farm-top> LOG-farm-top-during-drain5418worker1 # [ 134.671564] nix-daemon[838]: reaped child process 1586, status = succeeded5419worker1 # [ 134.834911] nix-daemon[838]: accepted connection from pid 1601, user nix-grpc-daemon (trusted)5420worker1 # [ 134.855090] nix-daemon[838]: reaped child process 1604, status = succeeded5421lb # [ 134.814767] niks3-server[1053]: 2026/09/20 12:49:44 INFO Received uploads request method=POST path=/api/pending_closures5422worker1 # [ 134.877717] nix-grpc-daemon[1427]: time=2026-09-20T12:49:44.391Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5423worker1 # [ 134.880982] nix-grpc-daemon[1427]: time=2026-09-20T12:49:44.393Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5424lb # [ 134.859959] niks3-server[1053]: 2026/09/20 12:49:44 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5425lb # [ 134.873705] niks3-server[1053]: 2026/09/20 12:49:44 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5426lb # [ 134.883536] niks3-server[1053]: 2026/09/20 12:49:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5427worker1 # [ 134.942227] nix-grpc-daemon[1427]: time=2026-09-20T12:49:44.455Z level=INFO msg="Uploading 1 narinfos"5428lb # [ 134.891220] niks3-server[1053]: 2026/09/20 12:49:44 INFO Signed narinfos id=44 count=15429lb # [ 134.895925] niks3-server[1053]: 2026/09/20 12:49:44 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5430lb # [ 134.903166] niks3-server[1053]: 2026/09/20 12:49:44 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5431lb # [ 134.909494] niks3-server[1053]: 2026/09/20 12:49:44 INFO Completed upload id=445432lb # [ 134.913409] niks3-server[1053]: 2026/09/20 12:49:44 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5433worker1 # [ 134.962628] nix-grpc-daemon[1427]: time=2026-09-20T12:49:44.476Z level=INFO msg="Upload complete. (308ms)"5434worker1 # [ 134.977246] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=15435worker1 # [ 134.992741] nix-daemon[838]: reaped child process 1584, status = succeeded5436client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.23 seconds)5437client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5438client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5439worker2: must succeed: pkill -f 'read -t [9]0 x'5440worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5441client: waiting for success: ! systemctl is-active sw5442worker2 # [ 135.494510] nix-daemon[803]: reaped child process 1440, status = succeeded5443worker2 # [ 135.672991] nix-daemon[803]: accepted connection from pid 1611, user nix-grpc-daemon (trusted)5444worker2 # [ 135.692674] nix-daemon[803]: reaped child process 1614, status = succeeded5445lb # [ 135.636631] niks3-server[1053]: 2026/09/20 12:49:45 INFO Received uploads request method=POST path=/api/pending_closures5446worker2 # [ 135.716438] nix-grpc-daemon[1189]: time=2026-09-20T12:49:45.228Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5447worker2 # [ 135.719693] nix-grpc-daemon[1189]: time=2026-09-20T12:49:45.228Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5448lb # [ 135.679965] niks3-server[1053]: 2026/09/20 12:49:45 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5449worker2 # [ 135.760471] nix-grpc-daemon[1189]: time=2026-09-20T12:49:45.274Z level=INFO msg="Uploading 1 narinfos"5450lb # [ 135.693441] niks3-server[1053]: 2026/09/20 12:49:45 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5451lb # [ 135.702573] niks3-server[1053]: 2026/09/20 12:49:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5452lb # [ 135.712880] niks3-server[1053]: 2026/09/20 12:49:45 INFO Signed narinfos id=45 count=15453worker2 # [ 135.779710] nix-grpc-daemon[1189]: time=2026-09-20T12:49:45.294Z level=INFO msg="Upload complete. (309ms)"5454lb # [ 135.715126] niks3-server[1053]: 2026/09/20 12:49:45 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5455worker2 # [ 135.788958] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47368 duration_s=12 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=15456lb # [ 135.720911] niks3-server[1053]: 2026/09/20 12:49:45 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5457lb # [ 135.727093] niks3-server[1053]: 2026/09/20 12:49:45 INFO Completed upload id=455458lb # [ 135.730584] niks3-server[1053]: 2026/09/20 12:49:45 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5459worker2 # [ 135.802107] nix-daemon[803]: reaped child process 1438, status = succeeded5460client # [ 135.805930] systemd[1]: sw.service: Deactivated successfully.5461client # [ 135.811125] systemd[1]: sw.service: Consumed 158ms CPU time over 13.505s wall clock time, 37M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5462client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5463client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5464client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5465worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5466worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.07 seconds)5467lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5468lb: must succeed: curl -sf localhost:9901/clusters5469lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5470worker2 # [ 136.719841] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:46Z level=info event=signal_exit5471worker1 # [ 136.716367] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:471425472worker1 # [ 136.716764] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:46Z level=info event=worker_gone addr=192.168.1.4:500515473worker2 # [ 136.745116] nix-grpc-daemon[1168]: ts=2026-09-20T12:49:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5474worker2 # [ 136.775951] nix-daemon[803]: reaped child process 1182, status = succeeded5475worker2 # [ 136.800414] nix-grpc-daemon[1168]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5476worker2 # [ 136.804961] nix-grpc-daemon[1168]: E0000 00:00:1789908586.313809 1179 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true5477lb: must succeed: curl -sf localhost:9901/clusters5478lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5479lb: must succeed: curl -sf localhost:9901/clusters5480worker2 # [ 138.782800] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5481worker2 # [ 138.787760] systemd[1]: nix-grpc-daemon.service: Consumed 2.387s CPU time over 56.296s wall clock time, 33.6M memory peak, 65.2K incoming IP traffic, 130.8K outgoing IP traffic.5482lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5483worker2 # [ 139.776782] systemd[1]: Starting scheduler-token.service...5484lb: must succeed: curl -sf localhost:9901/clusters5485worker2 # [ 139.890492] systemd[1]: scheduler-token.service: Deactivated successfully.5486worker2 # [ 139.896529] systemd[1]: Finished scheduler-token.service.5487worker2 # [ 139.898278] systemd[1]: scheduler-token.service: Consumed 56ms CPU time over 117ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5488worker2 # [ 139.908399] systemd[1]: Starting Nix worker-protocol over gRPC...5489lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5490worker2 # [ 140.101753] nix-grpc-daemon[1629]: ts=2026-09-20T12:49:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5491worker2 # [ 140.104427] nix-grpc-daemon[1629]: ts=2026-09-20T12:49:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5492worker2 # [ 140.106527] nix-grpc-daemon[1629]: ts=2026-09-20T12:49:49Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15493worker2 # [ 140.114817] nix-grpc-daemon[1629]: ts=2026-09-20T12:49:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5494worker2 # [ 140.120355] systemd[1]: Started Nix worker-protocol over gRPC.5495worker2 # [ 140.136490] nix-grpc-daemon[1629]: ts=2026-09-20T12:49:49Z level=info event=scheduler_connected addr=lb:500515496worker1 # [ 140.125927] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:49Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:471425497worker1 # [ 140.131928] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:49Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05498lb: must succeed: curl -sf localhost:9901/clusters5499lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5500lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 4.42 seconds)5501worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5502worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5503(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 18.82 seconds)5504subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5505client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15506worker1 # [ 141.326178] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:471705507worker2 # [ 141.351153] nix-grpc-daemon[1629]: ts=2026-09-20T12:49:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325508worker2 # [ 141.366042] nix-daemon[803]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)5509worker2 # [ 141.395714] nix-grpc-daemon[1629]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5)5510lb # [ 141.375501] envoy[922]: conn peer=[2001:db8:1::1]:45246 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9582 tx=3826 ms=59315511worker2 # [ 141.485537] nix-grpc-daemon[1629]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 138 ms (attempt 2/5)5512worker2 # [ 141.631244] nix-grpc-daemon[1629]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 247 ms (attempt 3/5)5513worker2 # [ 141.878618] nix-grpc-daemon[1629]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 295 ms (attempt 4/5)5514lb # [ 141.381426] envoy[922]: conn peer=[2001:db8:1::1]:45236 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1352 ms=132405515lb # [ 141.381590] envoy[922]: conn peer=[2001:db8:1::4]:44852 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=34185 tx=2208 ms=540265516worker2 # [ 142.181814] nix-grpc-daemon[1629]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5517worker1 # [ 142.220176] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:51Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05518worker1 # [ 142.220626] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:51Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15519worker1 # [ 142.220777] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:51Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05520worker1 # [ 142.220913] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:51Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05521worker1 # [ 142.289671] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705522worker1 # [ 142.305232] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705523worker1 # [ 142.320133] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705524worker1 # [ 142.335264] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5525worker1 # [ 142.540756] nix-daemon[838]: accepted connection from pid 1613, user nix-grpc-daemon (trusted)5526worker1 # [ 142.562276] nix-daemon[838]: reaped child process 1616, status = succeeded5527worker1 # [ 142.739540] nix-daemon[838]: accepted connection from pid 1618, user nix-grpc-daemon (trusted)5528worker1 # [ 142.757096] nix-daemon[838]: reaped child process 1621, status = succeeded5529lb # [ 142.718912] niks3-server[1053]: 2026/09/20 12:49:52 INFO Received uploads request method=POST path=/api/pending_closures5530worker1 # [ 142.786361] nix-grpc-daemon[1427]: time=2026-09-20T12:49:52.299Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5531worker1 # [ 142.787940] nix-grpc-daemon[1427]: time=2026-09-20T12:49:52.299Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5532lb # [ 142.752176] niks3-server[1053]: 2026/09/20 12:49:52 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5533lb # [ 142.768284] niks3-server[1053]: 2026/09/20 12:49:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5534worker1 # [ 142.828714] nix-grpc-daemon[1427]: time=2026-09-20T12:49:52.342Z level=INFO msg="Uploading 1 narinfos"5535lb # [ 142.780981] niks3-server[1053]: 2026/09/20 12:49:52 INFO Signed narinfos id=46 count=15536lb # [ 142.783932] niks3-server[1053]: 2026/09/20 12:49:52 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5537lb # [ 142.799272] niks3-server[1053]: 2026/09/20 12:49:52 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5538worker1 # [ 142.856585] nix-grpc-daemon[1427]: time=2026-09-20T12:49:52.370Z level=INFO msg="Upload complete. (504ms)"5539lb # [ 142.803288] niks3-server[1053]: 2026/09/20 12:49:52 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5540lb # [ 142.807622] niks3-server[1053]: 2026/09/20 12:49:52 INFO Completed upload id=465541worker1 # [ 142.864946] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=5125542worker1 # [ 142.882708] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705543worker1 # [ 142.889663] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5544worker1 # [ 142.896164] nix-daemon[838]: reaped child process 1611, status = succeeded5545worker1 # [ 142.910864] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5546worker1 # [ 144.344200] nix-daemon[838]: reaped child process 1625, status = succeeded5547worker1 # [ 144.509687] nix-daemon[838]: accepted connection from pid 1640, user nix-grpc-daemon (trusted)5548worker1 # [ 144.529356] nix-daemon[838]: reaped child process 1643, status = succeeded5549lb # [ 144.493298] niks3-server[1053]: 2026/09/20 12:49:53 INFO Received uploads request method=POST path=/api/pending_closures5550worker1 # [ 144.556425] nix-grpc-daemon[1427]: time=2026-09-20T12:49:54.068Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5551worker1 # [ 144.557922] nix-grpc-daemon[1427]: time=2026-09-20T12:49:54.068Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5552lb # [ 144.531675] niks3-server[1053]: 2026/09/20 12:49:54 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5553lb # [ 144.544765] niks3-server[1053]: 2026/09/20 12:49:54 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5554worker1 # [ 144.606661] nix-grpc-daemon[1427]: time=2026-09-20T12:49:54.120Z level=INFO msg="Uploading 1 narinfos"5555lb # [ 144.558153] niks3-server[1053]: 2026/09/20 12:49:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5556lb # [ 144.566177] niks3-server[1053]: 2026/09/20 12:49:54 INFO Signed narinfos id=47 count=15557lb # [ 144.572483] niks3-server[1053]: 2026/09/20 12:49:54 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5558worker1 # [ 144.625090] nix-grpc-daemon[1427]: time=2026-09-20T12:49:54.138Z level=INFO msg="Upload complete. (302ms)"5559lb # [ 144.576061] niks3-server[1053]: 2026/09/20 12:49:54 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5560lb # [ 144.580189] niks3-server[1053]: 2026/09/20 12:49:54 INFO Completed upload id=475561lb # [ 144.582816] niks3-server[1053]: 2026/09/20 12:49:54 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5562worker1 # [ 144.639570] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=15563worker1 # [ 144.656377] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:54Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15564worker1 # [ 144.662034] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705565worker1 # [ 144.665930] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:54Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05566worker1 # [ 144.670825] nix-daemon[838]: reaped child process 1623, status = succeeded5567worker1 # [ 144.674298] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705568worker1 # [ 144.685949] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705569worker1 # [ 144.696357] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5570worker1 # [ 144.883489] nix-daemon[838]: accepted connection from pid 1649, user nix-grpc-daemon (trusted)5571worker1 # [ 144.902196] nix-daemon[838]: reaped child process 1652, status = succeeded5572worker1 # [ 145.080064] nix-daemon[838]: accepted connection from pid 1654, user nix-grpc-daemon (trusted)5573worker1 # [ 145.097168] nix-daemon[838]: reaped child process 1657, status = succeeded5574lb # [ 145.058218] niks3-server[1053]: 2026/09/20 12:49:54 INFO Received uploads request method=POST path=/api/pending_closures5575worker1 # [ 145.119740] nix-grpc-daemon[1427]: time=2026-09-20T12:49:54.633Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5576worker1 # [ 145.121564] nix-grpc-daemon[1427]: time=2026-09-20T12:49:54.633Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5577lb # [ 145.087697] niks3-server[1053]: 2026/09/20 12:49:54 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5578worker1 # [ 145.150415] nix-grpc-daemon[1427]: time=2026-09-20T12:49:54.664Z level=INFO msg="Uploading 1 narinfos"5579lb # [ 145.103448] niks3-server[1053]: 2026/09/20 12:49:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5580lb # [ 145.117715] niks3-server[1053]: 2026/09/20 12:49:54 INFO Signed narinfos id=48 count=15581worker1 # [ 145.173575] nix-grpc-daemon[1427]: time=2026-09-20T12:49:54.687Z level=INFO msg="Upload complete. (466ms)"5582lb # [ 145.122406] niks3-server[1053]: 2026/09/20 12:49:54 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5583worker1 # [ 145.179778] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=5125584lb # [ 145.127465] niks3-server[1053]: 2026/09/20 12:49:54 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5585lb # [ 145.132239] niks3-server[1053]: 2026/09/20 12:49:54 INFO Completed upload id=485586lb # [ 145.134431] niks3-server[1053]: 2026/09/20 12:49:54 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5587worker1 # [ 145.188495] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705588worker1 # [ 145.197464] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5589worker1 # [ 145.201882] nix-daemon[838]: reaped child process 1647, status = succeeded5590worker1 # [ 145.213876] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5591worker1 # [ 146.459811] nix-daemon[838]: reaped child process 1661, status = succeeded5592worker1 # [ 146.643547] nix-daemon[838]: accepted connection from pid 1676, user nix-grpc-daemon (trusted)5593worker1 # [ 146.663458] nix-daemon[838]: reaped child process 1679, status = succeeded5594lb # [ 146.623386] niks3-server[1053]: 2026/09/20 12:49:56 INFO Received uploads request method=POST path=/api/pending_closures5595worker1 # [ 146.685656] nix-grpc-daemon[1427]: time=2026-09-20T12:49:56.199Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5596worker1 # [ 146.692133] nix-grpc-daemon[1427]: time=2026-09-20T12:49:56.202Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5597lb # [ 146.669214] niks3-server[1053]: 2026/09/20 12:49:56 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5598worker1 # [ 146.733782] nix-grpc-daemon[1427]: time=2026-09-20T12:49:56.247Z level=INFO msg="Uploading 1 narinfos"5599lb # [ 146.684292] niks3-server[1053]: 2026/09/20 12:49:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5600lb # [ 146.694263] niks3-server[1053]: 2026/09/20 12:49:56 INFO Signed narinfos id=49 count=15601lb # [ 146.701452] niks3-server[1053]: 2026/09/20 12:49:56 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5602worker1 # [ 146.764519] nix-grpc-daemon[1427]: time=2026-09-20T12:49:56.278Z level=INFO msg="Upload complete. (340ms)"5603lb # [ 146.712452] niks3-server[1053]: 2026/09/20 12:49:56 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5604lb # [ 146.717182] niks3-server[1053]: 2026/09/20 12:49:56 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5605lb # [ 146.722217] niks3-server[1053]: 2026/09/20 12:49:56 INFO Completed upload id=495606lb # [ 146.725457] niks3-server[1053]: 2026/09/20 12:49:56 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5607worker1 # [ 146.776812] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=15608worker1 # [ 146.804336] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:56Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15609worker1 # [ 146.810790] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705610worker1 # [ 146.815689] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:56Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05611worker1 # [ 146.819416] nix-daemon[838]: reaped child process 1659, status = succeeded5612worker1 # [ 146.832763] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705613worker1 # [ 146.846754] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705614worker1 # [ 146.860786] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5615worker1 # [ 147.059422] nix-daemon[838]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)5616worker1 # [ 147.077610] nix-daemon[838]: reaped child process 1688, status = succeeded5617worker1 # [ 147.256820] nix-daemon[838]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)5618worker1 # [ 147.273766] nix-daemon[838]: reaped child process 1693, status = succeeded5619lb # [ 147.234164] niks3-server[1053]: 2026/09/20 12:49:56 INFO Received uploads request method=POST path=/api/pending_closures5620worker1 # [ 147.297847] nix-grpc-daemon[1427]: time=2026-09-20T12:49:56.811Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5621worker1 # [ 147.299516] nix-grpc-daemon[1427]: time=2026-09-20T12:49:56.811Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5622lb # [ 147.262672] niks3-server[1053]: 2026/09/20 12:49:56 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5623worker1 # [ 147.327992] nix-grpc-daemon[1427]: time=2026-09-20T12:49:56.841Z level=INFO msg="Uploading 1 narinfos"5624lb # [ 147.277222] niks3-server[1053]: 2026/09/20 12:49:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5625lb # [ 147.286922] niks3-server[1053]: 2026/09/20 12:49:56 INFO Signed narinfos id=50 count=15626lb # [ 147.298896] niks3-server[1053]: 2026/09/20 12:49:56 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5627worker1 # [ 147.355984] nix-grpc-daemon[1427]: time=2026-09-20T12:49:56.869Z level=INFO msg="Upload complete. (481ms)"5628lb # [ 147.303962] niks3-server[1053]: 2026/09/20 12:49:56 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5629lb # [ 147.308210] niks3-server[1053]: 2026/09/20 12:49:56 INFO Completed upload id=505630lb # [ 147.310914] niks3-server[1053]: 2026/09/20 12:49:56 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5631worker1 # [ 147.364312] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=5125632worker1 # [ 147.375572] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705633worker1 # [ 147.381193] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5634worker1 # [ 147.385654] nix-daemon[838]: reaped child process 1683, status = succeeded5635worker1 # [ 147.396958] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5636worker1 # [ 148.627542] nix-daemon[838]: reaped child process 1697, status = succeeded5637worker1 # [ 148.797967] nix-daemon[838]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)5638worker1 # [ 148.815304] nix-daemon[838]: reaped child process 1715, status = succeeded5639lb # [ 148.775387] niks3-server[1053]: 2026/09/20 12:49:58 INFO Received uploads request method=POST path=/api/pending_closures5640worker1 # [ 148.839890] nix-grpc-daemon[1427]: time=2026-09-20T12:49:58.352Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5641worker1 # [ 148.841591] nix-grpc-daemon[1427]: time=2026-09-20T12:49:58.352Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5642lb # [ 148.815460] niks3-server[1053]: 2026/09/20 12:49:58 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5643worker1 # [ 148.880575] nix-grpc-daemon[1427]: time=2026-09-20T12:49:58.394Z level=INFO msg="Uploading 1 narinfos"5644lb # [ 148.831303] niks3-server[1053]: 2026/09/20 12:49:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5645lb # [ 148.842517] niks3-server[1053]: 2026/09/20 12:49:58 INFO Signed narinfos id=51 count=15646lb # [ 148.847797] niks3-server[1053]: 2026/09/20 12:49:58 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5647worker1 # [ 148.908829] nix-grpc-daemon[1427]: time=2026-09-20T12:49:58.422Z level=INFO msg="Upload complete. (302ms)"5648lb # [ 148.856385] niks3-server[1053]: 2026/09/20 12:49:58 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5649lb # [ 148.861883] niks3-server[1053]: 2026/09/20 12:49:58 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5650lb # [ 148.866749] niks3-server[1053]: 2026/09/20 12:49:58 INFO Completed upload id=515651lb # [ 148.872282] niks3-server[1053]: 2026/09/20 12:49:58 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5652worker1 # [ 148.925227] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=15653worker1 # [ 148.937692] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:58Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15654worker1 # [ 148.941577] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:58Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05655worker1 # [ 148.946082] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705656worker1 # [ 148.950089] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705657worker1 # [ 148.954004] nix-daemon[838]: reaped child process 1695, status = succeeded5658worker1 # [ 148.956833] nix-grpc-daemon[1427]: time=2026-09-20T12:49:58.470Z level=INFO msg="All 1 paths already cached"5659worker1 # [ 148.962797] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705660worker1 # [ 148.970762] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5661worker1 # [ 149.154441] nix-daemon[838]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)5662worker1 # [ 149.173952] nix-daemon[838]: reaped child process 1724, status = succeeded5663worker1 # [ 149.354353] nix-daemon[838]: accepted connection from pid 1726, user nix-grpc-daemon (trusted)5664worker1 # [ 149.371282] nix-daemon[838]: reaped child process 1729, status = succeeded5665lb # [ 149.330030] niks3-server[1053]: 2026/09/20 12:49:58 INFO Received uploads request method=POST path=/api/pending_closures5666worker1 # [ 149.392515] nix-grpc-daemon[1427]: time=2026-09-20T12:49:58.906Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5667worker1 # [ 149.394039] nix-grpc-daemon[1427]: time=2026-09-20T12:49:58.906Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5668lb # [ 149.360134] niks3-server[1053]: 2026/09/20 12:49:58 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5669worker1 # [ 149.431160] nix-grpc-daemon[1427]: time=2026-09-20T12:49:58.944Z level=INFO msg="Uploading 1 narinfos"5670lb # [ 149.373259] niks3-server[1053]: 2026/09/20 12:49:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5671lb # [ 149.382364] niks3-server[1053]: 2026/09/20 12:49:58 INFO Signed narinfos id=52 count=15672lb # [ 149.388874] niks3-server[1053]: 2026/09/20 12:49:58 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5673lb # [ 149.399969] niks3-server[1053]: 2026/09/20 12:49:58 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5674lb # [ 149.405530] niks3-server[1053]: 2026/09/20 12:49:58 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5675lb # [ 149.410701] niks3-server[1053]: 2026/09/20 12:49:58 INFO Completed upload id=525676worker1 # [ 149.463077] nix-grpc-daemon[1427]: time=2026-09-20T12:49:58.976Z level=INFO msg="Upload complete. (482ms)"5677worker1 # [ 149.470654] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=6245678worker1 # [ 149.484511] nix-grpc-daemon[1356]: ts=2026-09-20T12:49:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705679worker1 # [ 149.491246] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5680worker1 # [ 149.496106] nix-daemon[838]: reaped child process 1719, status = succeeded5681worker1 # [ 149.509973] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5682worker1 # [ 150.358586] nix-daemon[838]: reaped child process 1733, status = succeeded5683worker1 # [ 150.536360] nix-daemon[838]: accepted connection from pid 1748, user nix-grpc-daemon (trusted)5684worker1 # [ 150.553462] nix-daemon[838]: reaped child process 1751, status = succeeded5685lb # [ 150.514978] niks3-server[1053]: 2026/09/20 12:50:00 INFO Received uploads request method=POST path=/api/pending_closures5686worker1 # [ 150.580414] nix-grpc-daemon[1427]: time=2026-09-20T12:50:00.091Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5687worker1 # [ 150.581908] nix-grpc-daemon[1427]: time=2026-09-20T12:50:00.091Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5688lb # [ 150.554098] niks3-server[1053]: 2026/09/20 12:50:00 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5689lb # [ 150.565348] niks3-server[1053]: 2026/09/20 12:50:00 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5690lb # [ 150.577247] niks3-server[1053]: 2026/09/20 12:50:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5691worker1 # [ 150.635176] nix-grpc-daemon[1427]: time=2026-09-20T12:50:00.148Z level=INFO msg="Uploading 1 narinfos"5692lb # [ 150.586158] niks3-server[1053]: 2026/09/20 12:50:00 INFO Signed narinfos id=53 count=15693lb # [ 150.591617] niks3-server[1053]: 2026/09/20 12:50:00 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5694lb # [ 150.600757] niks3-server[1053]: 2026/09/20 12:50:00 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5695lb # [ 150.605940] niks3-server[1053]: 2026/09/20 12:50:00 INFO Completed upload id=535696worker1 # [ 150.658671] nix-grpc-daemon[1427]: time=2026-09-20T12:50:00.172Z level=INFO msg="Upload complete. (335ms)"5697lb # [ 150.609023] niks3-server[1053]: 2026/09/20 12:50:00 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5698worker1 # [ 150.676856] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=15699worker1 # [ 150.692803] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:00Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15700worker1 # [ 150.699899] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705701worker1 # [ 150.704628] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:00Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05702worker1 # [ 150.708636] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705703worker1 # [ 150.712486] nix-daemon[838]: reaped child process 1731, status = succeeded5704worker1 # [ 150.714107] nix-grpc-daemon[1427]: time=2026-09-20T12:50:00.221Z level=INFO msg="All 1 paths already cached"5705worker1 # [ 150.716335] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705706worker1 # [ 150.725938] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5707worker1 # [ 150.909940] nix-daemon[838]: accepted connection from pid 1757, user nix-grpc-daemon (trusted)5708worker1 # [ 150.929850] nix-daemon[838]: reaped child process 1760, status = succeeded5709worker1 # [ 151.112275] nix-daemon[838]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)5710worker1 # [ 151.133157] nix-daemon[838]: reaped child process 1765, status = succeeded5711lb # [ 151.091635] niks3-server[1053]: 2026/09/20 12:50:00 INFO Received uploads request method=POST path=/api/pending_closures5712worker1 # [ 151.153134] nix-grpc-daemon[1427]: time=2026-09-20T12:50:00.666Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5713worker1 # [ 151.154696] nix-grpc-daemon[1427]: time=2026-09-20T12:50:00.666Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5714lb # [ 151.118452] niks3-server[1053]: 2026/09/20 12:50:00 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5715lb # [ 151.132108] niks3-server[1053]: 2026/09/20 12:50:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5716worker1 # [ 151.191341] nix-grpc-daemon[1427]: time=2026-09-20T12:50:00.705Z level=INFO msg="Uploading 1 narinfos"5717lb # [ 151.142415] niks3-server[1053]: 2026/09/20 12:50:00 INFO Signed narinfos id=54 count=15718lb # [ 151.148964] niks3-server[1053]: 2026/09/20 12:50:00 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5719lb # [ 151.157617] niks3-server[1053]: 2026/09/20 12:50:00 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5720lb # [ 151.164222] niks3-server[1053]: 2026/09/20 12:50:00 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5721lb # [ 151.169919] niks3-server[1053]: 2026/09/20 12:50:00 INFO Completed upload id=545722worker1 # [ 151.222690] nix-grpc-daemon[1427]: time=2026-09-20T12:50:00.736Z level=INFO msg="Upload complete. (487ms)"5723worker1 # [ 151.230452] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=6245724worker1 # [ 151.244220] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705725worker1 # [ 151.250007] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5726worker1 # [ 151.254539] nix-daemon[838]: reaped child process 1755, status = succeeded5727worker1 # [ 151.265881] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5728worker1 # [ 152.102180] nix-daemon[838]: reaped child process 1769, status = succeeded5729worker1 # [ 152.278538] nix-daemon[838]: accepted connection from pid 1784, user nix-grpc-daemon (trusted)5730worker1 # [ 152.296682] nix-daemon[838]: reaped child process 1787, status = succeeded5731lb # [ 152.257780] niks3-server[1053]: 2026/09/20 12:50:01 INFO Received uploads request method=POST path=/api/pending_closures5732worker1 # [ 152.319392] nix-grpc-daemon[1427]: time=2026-09-20T12:50:01.832Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5733worker1 # [ 152.321042] nix-grpc-daemon[1427]: time=2026-09-20T12:50:01.832Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5734lb # [ 152.296151] niks3-server[1053]: 2026/09/20 12:50:01 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5735worker1 # [ 152.361779] nix-grpc-daemon[1427]: time=2026-09-20T12:50:01.875Z level=INFO msg="Uploading 1 narinfos"5736lb # [ 152.307455] niks3-server[1053]: 2026/09/20 12:50:01 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5737lb # [ 152.320945] niks3-server[1053]: 2026/09/20 12:50:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5738lb # [ 152.325254] niks3-server[1053]: 2026/09/20 12:50:01 INFO Signed narinfos id=55 count=15739lb # [ 152.330764] niks3-server[1053]: 2026/09/20 12:50:01 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5740lb # [ 152.334148] niks3-server[1053]: 2026/09/20 12:50:01 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5741lb # [ 152.338065] niks3-server[1053]: 2026/09/20 12:50:01 INFO Completed upload id=555742worker1 # [ 152.390313] nix-grpc-daemon[1427]: time=2026-09-20T12:50:01.904Z level=INFO msg="Upload complete. (312ms)"5743lb # [ 152.340532] niks3-server[1053]: 2026/09/20 12:50:01 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5744worker1 # [ 152.405299] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=15745worker1 # [ 152.422715] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:01Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15746worker1 # [ 152.426422] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705747worker1 # [ 152.430683] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:01Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05748worker1 # [ 152.434854] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705749worker1 # [ 152.438534] nix-daemon[838]: reaped child process 1767, status = succeeded5750worker1 # [ 152.440243] nix-grpc-daemon[1427]: time=2026-09-20T12:50:01.951Z level=INFO msg="All 1 paths already cached"5751worker1 # [ 152.443184] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705752worker1 # [ 152.453055] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5753worker1 # [ 152.633092] nix-daemon[838]: accepted connection from pid 1793, user nix-grpc-daemon (trusted)5754worker1 # [ 152.650419] nix-daemon[838]: reaped child process 1796, status = succeeded5755worker1 # [ 152.823165] nix-daemon[838]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5756worker1 # [ 152.839909] nix-daemon[838]: reaped child process 1801, status = succeeded5757lb # [ 152.798649] niks3-server[1053]: 2026/09/20 12:50:02 INFO Received uploads request method=POST path=/api/pending_closures5758worker1 # [ 152.859933] nix-grpc-daemon[1427]: time=2026-09-20T12:50:02.373Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5759worker1 # [ 152.861556] nix-grpc-daemon[1427]: time=2026-09-20T12:50:02.373Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5760lb # [ 152.823391] niks3-server[1053]: 2026/09/20 12:50:02 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5761worker1 # [ 152.888917] nix-grpc-daemon[1427]: time=2026-09-20T12:50:02.402Z level=INFO msg="Uploading 1 narinfos"5762lb # [ 152.838877] niks3-server[1053]: 2026/09/20 12:50:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5763lb # [ 152.848688] niks3-server[1053]: 2026/09/20 12:50:02 INFO Signed narinfos id=56 count=15764lb # [ 152.856577] niks3-server[1053]: 2026/09/20 12:50:02 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5765worker1 # [ 152.913863] nix-grpc-daemon[1427]: time=2026-09-20T12:50:02.427Z level=INFO msg="Upload complete. (451ms)"5766lb # [ 152.862762] niks3-server[1053]: 2026/09/20 12:50:02 INFO Completed upload id=565767worker1 # [ 152.920193] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=6245768lb # [ 152.867128] niks3-server[1053]: 2026/09/20 12:50:02 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5769worker1 # [ 152.923875] nix-grpc-daemon[1427]: time=2026-09-20T12:50:02.430Z level=WARN msg="Failed to register uploaded object" key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo error="server returned 404: object is not pending upload\n"5770worker1 # [ 152.938604] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705771worker1 # [ 152.944458] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5772worker1 # [ 152.947300] nix-daemon[838]: reaped child process 1791, status = succeeded5773worker1 # [ 152.956523] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5774worker1 # [ 154.203848] nix-daemon[838]: reaped child process 1805, status = succeeded5775worker1 # [ 154.381207] nix-daemon[838]: accepted connection from pid 1820, user nix-grpc-daemon (trusted)5776worker1 # [ 154.398828] nix-daemon[838]: reaped child process 1823, status = succeeded5777lb # [ 154.358653] niks3-server[1053]: 2026/09/20 12:50:03 INFO Received uploads request method=POST path=/api/pending_closures5778worker1 # [ 154.422814] nix-grpc-daemon[1427]: time=2026-09-20T12:50:03.934Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5779worker1 # [ 154.424559] nix-grpc-daemon[1427]: time=2026-09-20T12:50:03.934Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5780lb # [ 154.399019] niks3-server[1053]: 2026/09/20 12:50:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5781worker1 # [ 154.463576] nix-grpc-daemon[1427]: time=2026-09-20T12:50:03.977Z level=INFO msg="Uploading 1 narinfos"5782lb # [ 154.415476] niks3-server[1053]: 2026/09/20 12:50:03 INFO Signed narinfos id=57 count=15783lb # [ 154.421938] niks3-server[1053]: 2026/09/20 12:50:03 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5784lb # [ 154.428158] niks3-server[1053]: 2026/09/20 12:50:03 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5785lb # [ 154.434665] niks3-server[1053]: 2026/09/20 12:50:03 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5786lb # [ 154.437949] niks3-server[1053]: 2026/09/20 12:50:03 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5787lb # [ 154.442340] niks3-server[1053]: 2026/09/20 12:50:03 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5788lb # [ 154.446179] niks3-server[1053]: 2026/09/20 12:50:03 INFO Completed upload id=575789worker1 # [ 154.499016] nix-grpc-daemon[1427]: time=2026-09-20T12:50:04.012Z level=INFO msg="Upload complete. (330ms)"5790worker1 # [ 154.516973] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=15791worker1 # [ 154.528285] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:04Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15792worker1 # [ 154.539202] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705793worker1 # [ 154.544234] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:04Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05794worker1 # [ 154.548817] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705795worker1 # [ 154.553767] nix-daemon[838]: reaped child process 1803, status = succeeded5796worker1 # [ 154.561321] nix-grpc-daemon[1427]: time=2026-09-20T12:50:04.061Z level=INFO msg="All 2 paths already cached"5797worker1 # [ 154.563793] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5798worker1 # [ 154.566172] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705799worker1 # [ 154.749027] nix-daemon[838]: accepted connection from pid 1829, user nix-grpc-daemon (trusted)5800worker1 # [ 154.769260] nix-daemon[838]: reaped child process 1832, status = succeeded5801worker1 # [ 154.947295] nix-daemon[838]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)5802worker1 # [ 154.966948] nix-daemon[838]: reaped child process 1837, status = succeeded5803lb # [ 154.926386] niks3-server[1053]: 2026/09/20 12:50:04 INFO Received uploads request method=POST path=/api/pending_closures5804worker1 # [ 154.990330] nix-grpc-daemon[1427]: time=2026-09-20T12:50:04.503Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5805worker1 # [ 154.991856] nix-grpc-daemon[1427]: time=2026-09-20T12:50:04.504Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5806lb # [ 154.956836] niks3-server[1053]: 2026/09/20 12:50:04 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5807worker1 # [ 155.022806] nix-grpc-daemon[1427]: time=2026-09-20T12:50:04.536Z level=INFO msg="Uploading 1 narinfos"5808lb # [ 154.972675] niks3-server[1053]: 2026/09/20 12:50:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5809lb # [ 154.984263] niks3-server[1053]: 2026/09/20 12:50:04 INFO Signed narinfos id=58 count=15810lb # [ 154.987007] niks3-server[1053]: 2026/09/20 12:50:04 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5811lb # [ 154.995526] niks3-server[1053]: 2026/09/20 12:50:04 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5812lb # [ 155.001787] niks3-server[1053]: 2026/09/20 12:50:04 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5813lb # [ 155.007095] niks3-server[1053]: 2026/09/20 12:50:04 INFO Completed upload id=585814worker1 # [ 155.059946] nix-grpc-daemon[1427]: time=2026-09-20T12:50:04.573Z level=INFO msg="Upload complete. (483ms)"5815worker1 # [ 155.069549] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=7525816worker1 # [ 155.083017] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705817worker1 # [ 155.089474] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5818worker1 # [ 155.094539] nix-daemon[838]: reaped child process 1827, status = succeeded5819worker1 # [ 155.109032] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5820worker1 # [ 155.946130] nix-daemon[838]: reaped child process 1841, status = succeeded5821worker1 # [ 156.124958] nix-daemon[838]: accepted connection from pid 1856, user nix-grpc-daemon (trusted)5822worker1 # [ 156.145858] nix-daemon[838]: reaped child process 1859, status = succeeded5823lb # [ 156.113210] niks3-server[1053]: 2026/09/20 12:50:05 INFO Received uploads request method=POST path=/api/pending_closures5824worker1 # [ 156.181622] nix-grpc-daemon[1427]: time=2026-09-20T12:50:05.691Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5825worker1 # [ 156.183705] nix-grpc-daemon[1427]: time=2026-09-20T12:50:05.691Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5826lb # [ 156.155986] niks3-server[1053]: 2026/09/20 12:50:05 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5827lb # [ 156.167838] niks3-server[1053]: 2026/09/20 12:50:05 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5828worker1 # [ 156.231579] nix-grpc-daemon[1427]: time=2026-09-20T12:50:05.745Z level=INFO msg="Uploading 1 narinfos"5829lb # [ 156.181494] niks3-server[1053]: 2026/09/20 12:50:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5830lb # [ 156.189177] niks3-server[1053]: 2026/09/20 12:50:05 INFO Signed narinfos id=59 count=15831lb # [ 156.191239] niks3-server[1053]: 2026/09/20 12:50:05 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5832lb # [ 156.198420] niks3-server[1053]: 2026/09/20 12:50:05 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5833lb # [ 156.203793] niks3-server[1053]: 2026/09/20 12:50:05 INFO Completed upload id=595834worker1 # [ 156.256749] nix-grpc-daemon[1427]: time=2026-09-20T12:50:05.770Z level=INFO msg="Upload complete. (337ms)"5835lb # [ 156.206333] niks3-server[1053]: 2026/09/20 12:50:05 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo5836worker1 # [ 156.273324] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=15837worker1 # [ 156.288365] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:05Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=15838worker1 # [ 156.294038] nix-daemon[838]: reaped child process 1839, status = succeeded5839worker1 # [ 156.315750] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705840worker1 # [ 156.333518] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705841worker1 # [ 156.349908] nix-grpc-daemon[1427]: time=2026-09-20T12:50:05.863Z level=INFO msg="All 2 paths already cached"5842worker1 # [ 156.361409] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705843worker1 # [ 156.377583] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5844worker1 # [ 156.605135] nix-daemon[838]: accepted connection from pid 1863, user nix-grpc-daemon (trusted)5845worker1 # [ 156.624945] nix-daemon[838]: reaped child process 1866, status = succeeded5846worker1 # [ 156.824262] nix-daemon[838]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)5847worker1 # [ 156.842772] nix-daemon[838]: reaped child process 1871, status = succeeded5848lb # [ 156.803659] niks3-server[1053]: 2026/09/20 12:50:06 INFO Received uploads request method=POST path=/api/pending_closures5849worker1 # [ 156.867279] nix-grpc-daemon[1427]: time=2026-09-20T12:50:06.380Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5850worker1 # [ 156.868955] nix-grpc-daemon[1427]: time=2026-09-20T12:50:06.380Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"5851lb # [ 156.836802] niks3-server[1053]: 2026/09/20 12:50:06 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst5852lb # [ 156.853582] niks3-server[1053]: 2026/09/20 12:50:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign5853worker1 # [ 156.915946] nix-grpc-daemon[1427]: time=2026-09-20T12:50:06.429Z level=INFO msg="Uploading 1 narinfos"5854lb # [ 156.863487] niks3-server[1053]: 2026/09/20 12:50:06 INFO Signed narinfos id=60 count=15855lb # [ 156.872729] niks3-server[1053]: 2026/09/20 12:50:06 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls5856lb # [ 156.885077] niks3-server[1053]: 2026/09/20 12:50:06 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete5857lb # [ 156.892226] niks3-server[1053]: 2026/09/20 12:50:06 INFO Completed upload id=605858worker1 # [ 156.944391] nix-grpc-daemon[1427]: time=2026-09-20T12:50:06.458Z level=INFO msg="Upload complete. (546ms)"5859lb # [ 156.894797] niks3-server[1053]: 2026/09/20 12:50:06 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo5860worker1 # [ 156.955614] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=7525861worker1 # [ 156.972896] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705862worker1 # [ 156.981531] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5863worker1 # [ 156.987412] nix-daemon[838]: reaped child process 1861, status = succeeded5864worker1 # [ 157.003655] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5865worker1 # [ 157.841374] nix-daemon[838]: reaped child process 1875, status = succeeded5866worker1 # [ 158.061488] nix-daemon[838]: accepted connection from pid 1890, user nix-grpc-daemon (trusted)5867worker1 # [ 158.081346] nix-daemon[838]: reaped child process 1893, status = succeeded5868lb # [ 158.041687] niks3-server[1053]: 2026/09/20 12:50:07 INFO Received uploads request method=POST path=/api/pending_closures5869worker1 # [ 158.109508] nix-grpc-daemon[1427]: time=2026-09-20T12:50:07.620Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5870worker1 # [ 158.111054] nix-grpc-daemon[1427]: time=2026-09-20T12:50:07.620Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"5871lb # [ 158.109743] niks3-server[1053]: 2026/09/20 12:50:07 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst5872lb # [ 158.118909] niks3-server[1053]: 2026/09/20 12:50:07 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv5873lb # [ 158.127694] niks3-server[1053]: 2026/09/20 12:50:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign5874lb # [ 158.134009] niks3-server[1053]: 2026/09/20 12:50:07 INFO Signed narinfos id=61 count=15875worker1 # [ 158.187425] nix-grpc-daemon[1427]: time=2026-09-20T12:50:07.700Z level=INFO msg="Uploading 1 narinfos"5876lb # [ 158.139635] niks3-server[1053]: 2026/09/20 12:50:07 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls5877lb # [ 158.152466] niks3-server[1053]: 2026/09/20 12:50:07 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete5878lb # [ 158.161447] niks3-server[1053]: 2026/09/20 12:50:07 INFO Completed upload id=615879lb # [ 158.164334] niks3-server[1053]: 2026/09/20 12:50:07 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo5880worker1 # [ 158.214108] nix-grpc-daemon[1427]: time=2026-09-20T12:50:07.727Z level=INFO msg="Upload complete. (398ms)"5881worker1 # [ 158.229629] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=15882worker1 # [ 158.252672] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:07Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=15883worker1 # [ 158.260484] nix-daemon[838]: reaped child process 1873, status = succeeded5884worker1 # [ 158.270361] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705885worker1 # [ 158.288488] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:471705886worker1 # [ 158.306781] nix-grpc-daemon[1427]: time=2026-09-20T12:50:07.820Z level=INFO msg="All 2 paths already cached"5887worker1 # [ 158.317368] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:471705888worker1 # [ 158.332626] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5889worker1 # [ 158.552153] nix-daemon[838]: accepted connection from pid 1897, user nix-grpc-daemon (trusted)5890worker1 # [ 158.572247] nix-daemon[838]: reaped child process 1900, status = succeeded5891worker1 # [ 158.758993] nix-daemon[838]: accepted connection from pid 1902, user nix-grpc-daemon (trusted)5892worker1 # [ 158.776792] nix-daemon[838]: reaped child process 1905, status = succeeded5893lb # [ 158.740280] niks3-server[1053]: 2026/09/20 12:50:08 INFO Received uploads request method=POST path=/api/pending_closures5894worker1 # [ 158.802921] nix-grpc-daemon[1427]: time=2026-09-20T12:50:08.316Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5895worker1 # [ 158.804615] nix-grpc-daemon[1427]: time=2026-09-20T12:50:08.316Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"5896lb # [ 158.772041] niks3-server[1053]: 2026/09/20 12:50:08 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst5897lb # [ 158.788384] niks3-server[1053]: 2026/09/20 12:50:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign5898worker1 # [ 158.846856] nix-grpc-daemon[1427]: time=2026-09-20T12:50:08.360Z level=INFO msg="Uploading 1 narinfos"5899lb # [ 158.800538] niks3-server[1053]: 2026/09/20 12:50:08 INFO Signed narinfos id=62 count=15900lb # [ 158.806992] niks3-server[1053]: 2026/09/20 12:50:08 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls5901lb # [ 158.817343] niks3-server[1053]: 2026/09/20 12:50:08 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete5902lb # [ 158.824786] niks3-server[1053]: 2026/09/20 12:50:08 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo5903lb # [ 158.831229] niks3-server[1053]: 2026/09/20 12:50:08 INFO Completed upload id=625904worker1 # [ 158.884214] nix-grpc-daemon[1427]: time=2026-09-20T12:50:08.397Z level=INFO msg="Upload complete. (532ms)"5905worker1 # [ 158.894697] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=0 paths=1 nar_bytes_in=7525906worker1 # [ 158.910860] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:471705907worker1 # [ 158.918023] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5908worker1 # [ 158.923580] nix-daemon[838]: reaped child process 1895, status = succeeded5909worker1 # [ 158.942897] nix-daemon[838]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5910worker1 # [ 160.397571] nix-daemon[838]: reaped child process 1909, status = succeeded5911worker1 # [ 160.585460] nix-daemon[838]: accepted connection from pid 1924, user nix-grpc-daemon (trusted)5912worker1 # [ 160.607705] nix-daemon[838]: reaped child process 1927, status = succeeded5913lb # [ 160.570844] niks3-server[1053]: 2026/09/20 12:50:10 INFO Received uploads request method=POST path=/api/pending_closures5914worker1 # [ 160.639550] nix-grpc-daemon[1427]: time=2026-09-20T12:50:10.151Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5915worker1 # [ 160.641426] nix-grpc-daemon[1427]: time=2026-09-20T12:50:10.151Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"5916lb # [ 160.611339] niks3-server[1053]: 2026/09/20 12:50:10 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst5917lb # [ 160.632087] niks3-server[1053]: 2026/09/20 12:50:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign5918worker1 # [ 160.685550] nix-grpc-daemon[1427]: time=2026-09-20T12:50:10.198Z level=INFO msg="Uploading 1 narinfos"5919lb # [ 160.635208] niks3-server[1053]: 2026/09/20 12:50:10 INFO Signed narinfos id=63 count=15920lb # [ 160.647038] niks3-server[1053]: 2026/09/20 12:50:10 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv5921lb # [ 160.656946] niks3-server[1053]: 2026/09/20 12:50:10 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete5922lb # [ 160.665398] niks3-server[1053]: 2026/09/20 12:50:10 INFO Completed upload id=635923worker1 # [ 160.715797] nix-grpc-daemon[1427]: time=2026-09-20T12:50:10.229Z level=INFO msg="Upload complete. (354ms)"5924lb # [ 160.670424] niks3-server[1053]: 2026/09/20 12:50:10 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo5925lb # [ 160.675968] niks3-server[1053]: 2026/09/20 12:50:10 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls5926worker1 # [ 160.729250] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47170 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=15927worker1 # [ 160.745688] nix-daemon[838]: reaped child process 1907, status = succeeded5928client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.79 seconds)5929worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5930worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5931client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&15932worker2 # [ 161.210921] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:523325933worker2 # [ 161.222694] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325934worker1 # [ 161.236368] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:10Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=05935client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.33 seconds)5936(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 20.20 seconds)5937subtest: low disk drains a worker and builds go to the other5938worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill5939lb # [ 161.374954] envoy[922]: conn peer=[2001:db8:1::1]:39382 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27144 tx=10787 ms=194635940lb # [ 161.380419] envoy[922]: conn peer=[2001:db8:1::1]:36478 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=880 tx=483 ms=635941worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.22 seconds)5942worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'5943worker1 # [ 162.982165] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:12Z level=info event=unhealthy reason=min_free5944worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.15 seconds)5945client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&25946worker2 # [ 163.930105] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:523325947client # don't know how to build these paths:5948client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv5949worker2 # [ 163.943236] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325950worker1 # [ 163.963080] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:13Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=05951worker1 # [ 163.963414] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:13Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=15952worker2 # [ 164.025462] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523325953worker2 # [ 164.045465] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325954client # copying 1 paths to 'lb:50051'...5955client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...5956worker2 # [ 164.064166] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:523325957worker2 # [ 164.081292] nix-daemon[803]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)5958worker2 # [ 164.120831] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:13Z level=info event=niks3_push_started pid=16505959worker2 # [ 164.364422] nix-grpc-daemon[1650]: time=2026-09-20T12:50:13.878Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""5960worker2 # [ 164.560154] nix-daemon[803]: accepted connection from pid 1663, user nix-grpc-daemon (trusted)5961worker2 # [ 164.580507] nix-daemon[803]: reaped child process 1666, status = succeeded5962worker2 # [ 164.785459] nix-daemon[803]: accepted connection from pid 1668, user nix-grpc-daemon (trusted)5963worker2 # [ 164.805691] nix-daemon[803]: reaped child process 1671, status = succeeded5964lb # [ 164.751853] niks3-server[1053]: 2026/09/20 12:50:14 INFO Received uploads request method=POST path=/api/pending_closures5965worker2 # [ 164.836338] nix-grpc-daemon[1650]: time=2026-09-20T12:50:14.349Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5966worker2 # [ 164.837905] nix-grpc-daemon[1650]: time=2026-09-20T12:50:14.349Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"5967lb # [ 164.809816] niks3-server[1053]: 2026/09/20 12:50:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign5968worker2 # [ 164.889509] nix-grpc-daemon[1650]: time=2026-09-20T12:50:14.403Z level=INFO msg="Uploading 1 narinfos"5969lb # [ 164.824555] niks3-server[1053]: 2026/09/20 12:50:14 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst5970lb # [ 164.837955] niks3-server[1053]: 2026/09/20 12:50:14 INFO Signed narinfos id=64 count=15971lb # [ 164.843089] niks3-server[1053]: 2026/09/20 12:50:14 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls5972lb # [ 164.851331] niks3-server[1053]: 2026/09/20 12:50:14 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete5973lb # [ 164.860225] niks3-server[1053]: 2026/09/20 12:50:14 INFO Completed upload id=645974worker2 # [ 164.927855] nix-grpc-daemon[1650]: time=2026-09-20T12:50:14.442Z level=INFO msg="Upload complete. (559ms)"5975lb # [ 164.863559] niks3-server[1053]: 2026/09/20 12:50:14 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo5976worker2 # [ 164.943792] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_in=5125977worker2 # [ 164.960445] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523325978worker2 # [ 164.971100] nix-daemon[803]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)5979worker2 # [ 164.977305] nix-daemon[803]: reaped child process 1648, status = succeeded5980client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...5981client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv5982worker2 # [ 164.993578] nix-daemon[803]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)5983client # farm-a> LOG-farm-a-drain5984worker2 # [ 166.036472] nix-daemon[803]: reaped child process 1675, status = succeeded5985worker2 # [ 166.211258] nix-daemon[803]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)5986worker2 # [ 166.231400] nix-daemon[803]: reaped child process 1693, status = succeeded5987lb # [ 166.176759] niks3-server[1053]: 2026/09/20 12:50:15 INFO Received uploads request method=POST path=/api/pending_closures5988worker2 # [ 166.256297] nix-grpc-daemon[1650]: time=2026-09-20T12:50:15.767Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5989worker2 # [ 166.257762] nix-grpc-daemon[1650]: time=2026-09-20T12:50:15.767Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"5990lb # [ 166.209779] niks3-server[1053]: 2026/09/20 12:50:15 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv5991lb # [ 166.223655] niks3-server[1053]: 2026/09/20 12:50:15 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst5992lb # [ 166.240847] niks3-server[1053]: 2026/09/20 12:50:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign5993worker2 # [ 166.315552] nix-grpc-daemon[1650]: time=2026-09-20T12:50:15.828Z level=INFO msg="Uploading 1 narinfos"5994lb # [ 166.253257] niks3-server[1053]: 2026/09/20 12:50:15 INFO Signed narinfos id=65 count=15995lb # [ 166.259862] niks3-server[1053]: 2026/09/20 12:50:15 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls5996lb # [ 166.268398] niks3-server[1053]: 2026/09/20 12:50:15 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete5997lb # [ 166.273555] niks3-server[1053]: 2026/09/20 12:50:15 INFO Completed upload id=655998worker2 # [ 166.340940] nix-grpc-daemon[1650]: time=2026-09-20T12:50:15.855Z level=INFO msg="Upload complete. (335ms)"5999lb # [ 166.276594] niks3-server[1053]: 2026/09/20 12:50:15 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6000worker1 # [ 166.345468] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:15Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06001worker2 # [ 166.353056] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=16002worker1 # [ 166.352129] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:15Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16003worker2 # [ 166.370907] nix-daemon[803]: reaped child process 1673, status = succeeded6004worker2 # [ 166.412418] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523326005worker2 # [ 166.428903] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523326006worker2 # [ 166.443164] nix-grpc-daemon[1650]: time=2026-09-20T12:50:15.957Z level=INFO msg="All 1 paths already cached"6007client # copying 1 paths to 'lb:50051'...6008client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6009worker2 # [ 166.454183] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:523326010worker2 # [ 166.468117] nix-daemon[803]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)6011worker2 # [ 166.678876] nix-daemon[803]: accepted connection from pid 1697, user nix-grpc-daemon (trusted)6012worker2 # [ 166.696449] nix-daemon[803]: reaped child process 1700, status = succeeded6013worker2 # [ 166.871168] nix-daemon[803]: accepted connection from pid 1702, user nix-grpc-daemon (trusted)6014worker2 # [ 166.888751] nix-daemon[803]: reaped child process 1705, status = succeeded6015lb # [ 166.832699] niks3-server[1053]: 2026/09/20 12:50:16 INFO Received uploads request method=POST path=/api/pending_closures6016worker2 # [ 166.909271] nix-grpc-daemon[1650]: time=2026-09-20T12:50:16.423Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6017worker2 # [ 166.910759] nix-grpc-daemon[1650]: time=2026-09-20T12:50:16.423Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6018lb # [ 166.860718] niks3-server[1053]: 2026/09/20 12:50:16 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6019worker2 # [ 166.942124] nix-grpc-daemon[1650]: time=2026-09-20T12:50:16.456Z level=INFO msg="Uploading 1 narinfos"6020lb # [ 166.878653] niks3-server[1053]: 2026/09/20 12:50:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6021lb # [ 166.889583] niks3-server[1053]: 2026/09/20 12:50:16 INFO Signed narinfos id=66 count=16022worker2 # [ 166.965563] nix-grpc-daemon[1650]: time=2026-09-20T12:50:16.480Z level=INFO msg="Upload complete. (479ms)"6023lb # [ 166.899947] niks3-server[1053]: 2026/09/20 12:50:16 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6024lb # [ 166.904994] niks3-server[1053]: 2026/09/20 12:50:16 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6025worker2 # [ 166.972087] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_in=6326026lb # [ 166.909374] niks3-server[1053]: 2026/09/20 12:50:16 INFO Completed upload id=666027lb # [ 166.911393] niks3-server[1053]: 2026/09/20 12:50:16 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6028worker2 # [ 166.983067] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523326029worker2 # [ 166.989414] nix-daemon[803]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)6030worker2 # [ 166.993762] nix-daemon[803]: reaped child process 1695, status = succeeded6031client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6032worker2 # [ 167.005813] nix-daemon[803]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)6033client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6034client # farm-b> LOG-farm-b-drain6035worker2 # [ 168.636465] nix-daemon[803]: reaped child process 1709, status = succeeded6036worker2 # [ 168.809969] nix-daemon[803]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6037worker2 # [ 168.827467] nix-daemon[803]: reaped child process 1727, status = succeeded6038lb # [ 168.772718] niks3-server[1053]: 2026/09/20 12:50:18 INFO Received uploads request method=POST path=/api/pending_closures6039worker2 # [ 168.851148] nix-grpc-daemon[1650]: time=2026-09-20T12:50:18.365Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6040worker2 # [ 168.852775] nix-grpc-daemon[1650]: time=2026-09-20T12:50:18.365Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6041lb # [ 168.805965] niks3-server[1053]: 2026/09/20 12:50:18 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6042lb # [ 168.824413] niks3-server[1053]: 2026/09/20 12:50:18 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6043worker2 # [ 168.899147] nix-grpc-daemon[1650]: time=2026-09-20T12:50:18.413Z level=INFO msg="Uploading 1 narinfos"6044lb # [ 168.835227] niks3-server[1053]: 2026/09/20 12:50:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6045lb # [ 168.844900] niks3-server[1053]: 2026/09/20 12:50:18 INFO Signed narinfos id=67 count=16046lb # [ 168.848875] niks3-server[1053]: 2026/09/20 12:50:18 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6047worker2 # [ 168.925503] nix-grpc-daemon[1650]: time=2026-09-20T12:50:18.440Z level=INFO msg="Upload complete. (309ms)"6048lb # [ 168.859186] niks3-server[1053]: 2026/09/20 12:50:18 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6049lb # [ 168.864834] niks3-server[1053]: 2026/09/20 12:50:18 INFO Completed upload id=676050lb # [ 168.867893] niks3-server[1053]: 2026/09/20 12:50:18 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6051worker2 # [ 168.936951] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=16052worker1 # [ 168.929419] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:18Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06053worker2 # [ 168.951388] nix-daemon[803]: reaped child process 1707, status = succeeded6054worker1 # [ 168.935633] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:18Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16055worker2 # [ 168.996551] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523326056worker2 # [ 169.011662] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523326057worker2 # [ 169.026837] nix-grpc-daemon[1650]: time=2026-09-20T12:50:18.541Z level=INFO msg="All 2 paths already cached"6058client # copying 1 paths to 'lb:50051'...6059client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6060worker2 # [ 169.037819] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:523326061worker2 # [ 169.050840] nix-daemon[803]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)6062worker2 # [ 169.253142] nix-daemon[803]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6063worker2 # [ 169.271794] nix-daemon[803]: reaped child process 1734, status = succeeded6064worker2 # [ 169.447594] nix-daemon[803]: accepted connection from pid 1736, user nix-grpc-daemon (trusted)6065worker2 # [ 169.466562] nix-daemon[803]: reaped child process 1739, status = succeeded6066lb # [ 169.410692] niks3-server[1053]: 2026/09/20 12:50:18 INFO Received uploads request method=POST path=/api/pending_closures6067worker2 # [ 169.487332] nix-grpc-daemon[1650]: time=2026-09-20T12:50:19.001Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6068worker2 # [ 169.488977] nix-grpc-daemon[1650]: time=2026-09-20T12:50:19.001Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6069lb # [ 169.437954] niks3-server[1053]: 2026/09/20 12:50:18 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6070worker2 # [ 169.516122] nix-grpc-daemon[1650]: time=2026-09-20T12:50:19.030Z level=INFO msg="Uploading 1 narinfos"6071lb # [ 169.453182] niks3-server[1053]: 2026/09/20 12:50:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6072lb # [ 169.463768] niks3-server[1053]: 2026/09/20 12:50:18 INFO Signed narinfos id=68 count=16073worker2 # [ 169.540963] nix-grpc-daemon[1650]: time=2026-09-20T12:50:19.055Z level=INFO msg="Upload complete. (473ms)"6074lb # [ 169.474109] niks3-server[1053]: 2026/09/20 12:50:18 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6075worker2 # [ 169.546872] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_in=7606076lb # [ 169.479830] niks3-server[1053]: 2026/09/20 12:50:18 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6077lb # [ 169.485254] niks3-server[1053]: 2026/09/20 12:50:18 INFO Completed upload id=686078lb # [ 169.487827] niks3-server[1053]: 2026/09/20 12:50:18 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6079worker2 # [ 169.558685] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523326080worker2 # [ 169.565004] nix-daemon[803]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)6081worker2 # [ 169.569868] nix-daemon[803]: reaped child process 1729, status = succeeded6082client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6083worker2 # [ 169.580005] nix-daemon[803]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)6084client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6085client # farm-top> LOG-farm-top-drain6086worker2 # [ 170.820820] nix-daemon[803]: reaped child process 1743, status = succeeded6087worker2 # [ 170.996200] nix-daemon[803]: accepted connection from pid 1758, user nix-grpc-daemon (trusted)6088worker2 # [ 171.013755] nix-daemon[803]: reaped child process 1761, status = succeeded6089lb # [ 170.962250] niks3-server[1053]: 2026/09/20 12:50:20 INFO Received uploads request method=POST path=/api/pending_closures6090worker2 # [ 171.042333] nix-grpc-daemon[1650]: time=2026-09-20T12:50:20.555Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6091worker2 # [ 171.043842] nix-grpc-daemon[1650]: time=2026-09-20T12:50:20.555Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6092lb # [ 171.001027] niks3-server[1053]: 2026/09/20 12:50:20 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6093lb # [ 171.012382] niks3-server[1053]: 2026/09/20 12:50:20 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6094lb # [ 171.022560] niks3-server[1053]: 2026/09/20 12:50:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6095worker2 # [ 171.095071] nix-grpc-daemon[1650]: time=2026-09-20T12:50:20.609Z level=INFO msg="Uploading 1 narinfos"6096lb # [ 171.029516] niks3-server[1053]: 2026/09/20 12:50:20 INFO Signed narinfos id=69 count=16097lb # [ 171.034807] niks3-server[1053]: 2026/09/20 12:50:20 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6098lb # [ 171.043624] niks3-server[1053]: 2026/09/20 12:50:20 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6099lb # [ 171.049994] niks3-server[1053]: 2026/09/20 12:50:20 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6100lb # [ 171.055558] niks3-server[1053]: 2026/09/20 12:50:20 INFO Completed upload id=696101worker2 # [ 171.122988] nix-grpc-daemon[1650]: time=2026-09-20T12:50:20.637Z level=INFO msg="Upload complete. (331ms)"6102worker2 # [ 171.134744] nix-grpc-daemon[1629]: ts=2026-09-20T12:50:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=16103worker2 # [ 171.152309] nix-daemon[803]: reaped child process 1741, status = succeeded6104client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.53 seconds)6105client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6106client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.25 seconds)6107lb # [ 171.376632] envoy[922]: conn peer=[2001:db8:1::1]:36494 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9566 tx=3890 ms=72206108worker1: must succeed: rm /nix/.rw-store/fill6109worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds)6110worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6111worker1 # [ 171.993558] nix-grpc-daemon[1356]: ts=2026-09-20T12:50:21Z level=info event=healthy reason=min_free6112worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6113(finished: subtest: low disk drains a worker and builds go to the other, in 11.53 seconds)6114(finished: run the VM test script, in 173.81 seconds)6115test script finished in 174.11s6116cleanup6117kill QemuMachine (pid 49)6118client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6119kill QemuMachine (pid 50)6120lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6121kill QemuMachine (pid 52)6122worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6123kill QemuMachine (pid 51)6124worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6125(finished: cleanup, in 1.23 seconds)6126additionally exposed symbols:6127 client, lb, worker1, worker2,6128 vlan1,6129 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh